[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:08:15.009865 25293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.179.126:35377
I20260709 12:08:15.011710 25293 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:08:15.013059 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:15.031503 25299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:15.034173 25293 server_base.cc:1061] running on GCE node
W20260709 12:08:15.031554 25300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:15.032653 25302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.225731 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.226043 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.226291 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783598896226258 us; error 0 us; skew 500 ppm
I20260709 12:08:16.227421 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.234836 25293 webserver.cc:533] Webserver started at http://127.24.179.126:41071/ using document root <none> and password file <none>
I20260709 12:08:16.235759 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.235971 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.236429 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.242931 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894834136-25293-0/minicluster-data/master-0-root/instance:
uuid: "647a5efb921945c2a88611d8854e483f"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-tjfs"
I20260709 12:08:16.252166 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.003s	sys 0.005s
I20260709 12:08:16.258265 25308 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.259789 25293 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:08:16.260221 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894834136-25293-0/minicluster-data/master-0-root
uuid: "647a5efb921945c2a88611d8854e483f"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-tjfs"
I20260709 12:08:16.260649 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894834136-25293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894834136-25293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894834136-25293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:16.330761 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:16.332502 25293 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:08:16.333065 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:16.413517 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.126:35377
I20260709 12:08:16.413590 25359 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.126:35377 every 8 connection(s)
I20260709 12:08:16.422577 25360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.448323 25360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f: Bootstrap starting.
I20260709 12:08:16.455713 25360 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:16.457937 25360 log.cc:826] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f: Log is configured to *not* fsync() on all Append() calls
I20260709 12:08:16.463160 25360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f: No bootstrap required, opened a new log
I20260709 12:08:16.484794 25360 raft_consensus.cc:359] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "647a5efb921945c2a88611d8854e483f" member_type: VOTER }
I20260709 12:08:16.485387 25360 raft_consensus.cc:385] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:16.485595 25360 raft_consensus.cc:740] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 647a5efb921945c2a88611d8854e483f, State: Initialized, Role: FOLLOWER
I20260709 12:08:16.486627 25360 consensus_queue.cc:260] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "647a5efb921945c2a88611d8854e483f" member_type: VOTER }
I20260709 12:08:16.487129 25360 raft_consensus.cc:399] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:16.487396 25360 raft_consensus.cc:493] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:16.487696 25360 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:16.492098 25360 raft_consensus.cc:515] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "647a5efb921945c2a88611d8854e483f" member_type: VOTER }
I20260709 12:08:16.492935 25360 leader_election.cc:304] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 647a5efb921945c2a88611d8854e483f; no voters: 
I20260709 12:08:16.494768 25360 leader_election.cc:290] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:16.495154 25363 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:16.498364 25363 raft_consensus.cc:697] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f [term 1 LEADER]: Becoming Leader. State: Replica: 647a5efb921945c2a88611d8854e483f, State: Running, Role: LEADER
I20260709 12:08:16.499409 25363 consensus_queue.cc:237] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "647a5efb921945c2a88611d8854e483f" member_type: VOTER }
I20260709 12:08:16.500530 25360 sys_catalog.cc:565] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:16.512686 25365 sys_catalog.cc:455] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 647a5efb921945c2a88611d8854e483f. Latest consensus state: current_term: 1 leader_uuid: "647a5efb921945c2a88611d8854e483f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "647a5efb921945c2a88611d8854e483f" member_type: VOTER } }
I20260709 12:08:16.513669 25365 sys_catalog.cc:458] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:16.512548 25364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "647a5efb921945c2a88611d8854e483f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "647a5efb921945c2a88611d8854e483f" member_type: VOTER } }
I20260709 12:08:16.514751 25364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:16.517653 25373 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:16.532339 25373 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:16.535393 25293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:16.553869 25373 catalog_manager.cc:1383] Generated new cluster ID: 7e07a9544dd24e029067e50987ee77c5
I20260709 12:08:16.554175 25373 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:16.579044 25373 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:16.580756 25373 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:16.598030 25373 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f: Generated new TSK 0
I20260709 12:08:16.599150 25373 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:16.667359 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:16.678259 25382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.680069 25383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.683874 25293 server_base.cc:1061] running on GCE node
W20260709 12:08:16.684115 25385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.685539 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.685863 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.686106 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783598896686080 us; error 0 us; skew 500 ppm
I20260709 12:08:16.687074 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.691926 25293 webserver.cc:533] Webserver started at http://127.24.179.65:44297/ using document root <none> and password file <none>
I20260709 12:08:16.692767 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.693097 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.693495 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.695343 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894834136-25293-0/minicluster-data/ts-0-root/instance:
uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-tjfs"
I20260709 12:08:16.703927 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:08:16.710158 25390 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.711233 25293 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 12:08:16.711642 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894834136-25293-0/minicluster-data/ts-0-root
uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-tjfs"
I20260709 12:08:16.712056 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894834136-25293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894834136-25293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894834136-25293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:16.746268 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:16.747833 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:16.750352 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:16.754839 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:16.755146 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.755424 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:16.755612 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.865114 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.65:36641
I20260709 12:08:16.865221 25452 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.65:36641 every 8 connection(s)
I20260709 12:08:16.873023 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:16.884872 25457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.888456 25458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.895413 25460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.897589 25293 server_base.cc:1061] running on GCE node
I20260709 12:08:16.898713 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.899022 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.899225 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783598896899209 us; error 0 us; skew 500 ppm
I20260709 12:08:16.900030 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.903056 25453 heartbeater.cc:344] Connected to a master server at 127.24.179.126:35377
I20260709 12:08:16.903816 25453 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:16.905586 25453 heartbeater.cc:507] Master 127.24.179.126:35377 requested a full tablet report, sending...
I20260709 12:08:16.910560 25325 ts_manager.cc:194] Registered new tserver with Master: 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641)
I20260709 12:08:16.911108 25293 webserver.cc:533] Webserver started at http://127.24.179.66:45579/ using document root <none> and password file <none>
I20260709 12:08:16.911859 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.912169 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.912568 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.913880 25325 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58396
I20260709 12:08:16.914287 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894834136-25293-0/minicluster-data/ts-1-root/instance:
uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-tjfs"
I20260709 12:08:16.921666 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:08:16.926640 25465 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.927665 25293 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:08:16.927999 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894834136-25293-0/minicluster-data/ts-1-root
uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-tjfs"
I20260709 12:08:16.928330 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894834136-25293-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894834136-25293-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894834136-25293-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:16.944224 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:16.945714 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:16.948747 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:16.951964 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:16.952172 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.952512 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:16.952658 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.067890 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.66:46575
I20260709 12:08:17.068032 25527 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.66:46575 every 8 connection(s)
I20260709 12:08:17.077804 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:17.087075 25531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:17.088828 25532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.095691 25528 heartbeater.cc:344] Connected to a master server at 127.24.179.126:35377
I20260709 12:08:17.096329 25528 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:17.097929 25528 heartbeater.cc:507] Master 127.24.179.126:35377 requested a full tablet report, sending...
I20260709 12:08:17.101048 25293 server_base.cc:1061] running on GCE node
I20260709 12:08:17.100975 25325 ts_manager.cc:194] Registered new tserver with Master: abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575)
W20260709 12:08:17.101784 25534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.103094 25325 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58402
I20260709 12:08:17.103645 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:17.103930 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:17.104141 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783598897104122 us; error 0 us; skew 500 ppm
I20260709 12:08:17.104902 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:17.107754 25293 webserver.cc:533] Webserver started at http://127.24.179.67:36919/ using document root <none> and password file <none>
I20260709 12:08:17.108271 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:17.108513 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:17.108801 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:17.109886 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894834136-25293-0/minicluster-data/ts-2-root/instance:
uuid: "63a331ccd01d463fb5569613ba13a187"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-tjfs"
I20260709 12:08:17.115039 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:08:17.118827 25539 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.119799 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:08:17.120116 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894834136-25293-0/minicluster-data/ts-2-root
uuid: "63a331ccd01d463fb5569613ba13a187"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-tjfs"
I20260709 12:08:17.120412 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894834136-25293-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894834136-25293-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894834136-25293-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.134148 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.135506 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.137403 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:17.140728 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:17.140928 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.141232 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:17.141398 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.255157 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.67:44927
I20260709 12:08:17.255705 25601 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.67:44927 every 8 connection(s)
I20260709 12:08:17.274075 25602 heartbeater.cc:344] Connected to a master server at 127.24.179.126:35377
I20260709 12:08:17.274565 25602 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:17.275660 25602 heartbeater.cc:507] Master 127.24.179.126:35377 requested a full tablet report, sending...
I20260709 12:08:17.278046 25325 ts_manager.cc:194] Registered new tserver with Master: 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:17.278672 25293 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01790438s
I20260709 12:08:17.279946 25325 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58412
I20260709 12:08:17.344007 25325 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58420:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:17.348815 25325 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:17.465917 25417 tablet_service.cc:1511] Processing CreateTablet for tablet 25d52b113a784bf79866f1220037adc5 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:17.467149 25418 tablet_service.cc:1511] Processing CreateTablet for tablet 4409906fca2d49c7b9e247556f7376e5 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:17.469385 25415 tablet_service.cc:1511] Processing CreateTablet for tablet 02e035521a0e44adb8664f0ab720bb8b (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:17.467877 25417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d52b113a784bf79866f1220037adc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.471563 25567 tablet_service.cc:1511] Processing CreateTablet for tablet 4409906fca2d49c7b9e247556f7376e5 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:17.472723 25415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02e035521a0e44adb8664f0ab720bb8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.473140 25567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4409906fca2d49c7b9e247556f7376e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.472908 25566 tablet_service.cc:1511] Processing CreateTablet for tablet 25d52b113a784bf79866f1220037adc5 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:17.475778 25566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d52b113a784bf79866f1220037adc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.478919 25418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4409906fca2d49c7b9e247556f7376e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.479311 25564 tablet_service.cc:1511] Processing CreateTablet for tablet 02e035521a0e44adb8664f0ab720bb8b (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:17.478520 25416 tablet_service.cc:1511] Processing CreateTablet for tablet 31864e4fd2bb4861bccb7d60a5b5ed49 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:17.487910 25564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02e035521a0e44adb8664f0ab720bb8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.491842 25416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31864e4fd2bb4861bccb7d60a5b5ed49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.481142 25565 tablet_service.cc:1511] Processing CreateTablet for tablet 31864e4fd2bb4861bccb7d60a5b5ed49 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:17.492333 25413 tablet_service.cc:1511] Processing CreateTablet for tablet 892869c2646b42028fdf458924a0ad16 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:17.496840 25563 tablet_service.cc:1511] Processing CreateTablet for tablet 298d4051223d4c35ad797749a2005e85 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:17.499061 25413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 892869c2646b42028fdf458924a0ad16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.501293 25562 tablet_service.cc:1511] Processing CreateTablet for tablet 892869c2646b42028fdf458924a0ad16 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:17.491811 25414 tablet_service.cc:1511] Processing CreateTablet for tablet 298d4051223d4c35ad797749a2005e85 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:17.521508 25565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31864e4fd2bb4861bccb7d60a5b5ed49. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:08:17.529304 25372 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:17.530813 25414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298d4051223d4c35ad797749a2005e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.532841 25563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298d4051223d4c35ad797749a2005e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.533844 25562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 892869c2646b42028fdf458924a0ad16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.556499 25412 tablet_service.cc:1511] Processing CreateTablet for tablet 99f874dc6c584199a8954d6f13fcc926 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:17.558097 25412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99f874dc6c584199a8954d6f13fcc926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.568372 25492 tablet_service.cc:1511] Processing CreateTablet for tablet 25d52b113a784bf79866f1220037adc5 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:17.569804 25493 tablet_service.cc:1511] Processing CreateTablet for tablet 4409906fca2d49c7b9e247556f7376e5 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:17.570964 25492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d52b113a784bf79866f1220037adc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.587806 25493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4409906fca2d49c7b9e247556f7376e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.579835 25560 tablet_service.cc:1511] Processing CreateTablet for tablet e1263c7541b64286a507ee25aa8d9571 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:17.587677 25490 tablet_service.cc:1511] Processing CreateTablet for tablet 02e035521a0e44adb8664f0ab720bb8b (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:17.585106 25561 tablet_service.cc:1511] Processing CreateTablet for tablet 99f874dc6c584199a8954d6f13fcc926 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:17.600919 25488 tablet_service.cc:1511] Processing CreateTablet for tablet 892869c2646b42028fdf458924a0ad16 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:17.607869 25486 tablet_service.cc:1511] Processing CreateTablet for tablet e1263c7541b64286a507ee25aa8d9571 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:17.610723 25487 tablet_service.cc:1511] Processing CreateTablet for tablet 99f874dc6c584199a8954d6f13fcc926 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:17.610101 25488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 892869c2646b42028fdf458924a0ad16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.611814 25560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1263c7541b64286a507ee25aa8d9571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.608016 25491 tablet_service.cc:1511] Processing CreateTablet for tablet 31864e4fd2bb4861bccb7d60a5b5ed49 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:17.612636 25489 tablet_service.cc:1511] Processing CreateTablet for tablet 298d4051223d4c35ad797749a2005e85 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:17.603914 25411 tablet_service.cc:1511] Processing CreateTablet for tablet e1263c7541b64286a507ee25aa8d9571 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:17.638823 25487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99f874dc6c584199a8954d6f13fcc926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.650566 25561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99f874dc6c584199a8954d6f13fcc926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.666949 25491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31864e4fd2bb4861bccb7d60a5b5ed49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.681313 25486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1263c7541b64286a507ee25aa8d9571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.640581 25559 tablet_service.cc:1511] Processing CreateTablet for tablet 29403a2ca1794b3b80c5f51f2b56a401 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:17.655265 25410 tablet_service.cc:1511] Processing CreateTablet for tablet 29403a2ca1794b3b80c5f51f2b56a401 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:17.663969 25485 tablet_service.cc:1511] Processing CreateTablet for tablet 29403a2ca1794b3b80c5f51f2b56a401 (DEFAULT_TABLE table=test-workload [id=aad5462ef3eb41838592fc3d176daf1f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:17.681365 25411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1263c7541b64286a507ee25aa8d9571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.689213 25559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29403a2ca1794b3b80c5f51f2b56a401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.702966 25490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02e035521a0e44adb8664f0ab720bb8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.707772 25410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29403a2ca1794b3b80c5f51f2b56a401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.710824 25485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29403a2ca1794b3b80c5f51f2b56a401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.715663 25489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298d4051223d4c35ad797749a2005e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.749373 25620 tablet_bootstrap.cc:492] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187: Bootstrap starting.
I20260709 12:08:17.773722 25621 tablet_bootstrap.cc:492] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba: Bootstrap starting.
I20260709 12:08:17.820174 25620 tablet_bootstrap.cc:654] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.841954 25622 tablet_bootstrap.cc:492] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f: Bootstrap starting.
I20260709 12:08:17.874182 25622 tablet_bootstrap.cc:654] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.875348 25621 tablet_bootstrap.cc:654] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.876487 25620 tablet_bootstrap.cc:492] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187: No bootstrap required, opened a new log
I20260709 12:08:17.877657 25620 ts_tablet_manager.cc:1403] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187: Time spent bootstrapping tablet: real 0.165s	user 0.020s	sys 0.015s
I20260709 12:08:17.886112 25620 raft_consensus.cc:359] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } }
I20260709 12:08:17.887341 25620 raft_consensus.cc:385] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.887746 25620 raft_consensus.cc:740] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63a331ccd01d463fb5569613ba13a187, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.888600 25620 consensus_queue.cc:260] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } }
I20260709 12:08:17.890357 25622 tablet_bootstrap.cc:492] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f: No bootstrap required, opened a new log
I20260709 12:08:17.891047 25622 ts_tablet_manager.cc:1403] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f: Time spent bootstrapping tablet: real 0.095s	user 0.015s	sys 0.006s
I20260709 12:08:17.892379 25602 heartbeater.cc:499] Master 127.24.179.126:35377 was elected leader, sending a full tablet report...
I20260709 12:08:17.894362 25621 tablet_bootstrap.cc:492] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba: No bootstrap required, opened a new log
I20260709 12:08:17.894968 25621 ts_tablet_manager.cc:1403] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba: Time spent bootstrapping tablet: real 0.134s	user 0.015s	sys 0.002s
I20260709 12:08:17.894476 25622 raft_consensus.cc:359] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } }
I20260709 12:08:17.895503 25622 raft_consensus.cc:385] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.895905 25622 raft_consensus.cc:740] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.896903 25622 consensus_queue.cc:260] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } }
I20260709 12:08:17.908622 25622 ts_tablet_manager.cc:1434] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.006s
I20260709 12:08:17.909307 25620 ts_tablet_manager.cc:1434] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.010s
I20260709 12:08:17.909582 25528 heartbeater.cc:499] Master 127.24.179.126:35377 was elected leader, sending a full tablet report...
I20260709 12:08:17.910320 25620 tablet_bootstrap.cc:492] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187: Bootstrap starting.
I20260709 12:08:17.910953 25621 raft_consensus.cc:359] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:17.911873 25621 raft_consensus.cc:385] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.912164 25621 raft_consensus.cc:740] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.912943 25621 consensus_queue.cc:260] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:17.918183 25620 tablet_bootstrap.cc:654] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.918586 25453 heartbeater.cc:499] Master 127.24.179.126:35377 was elected leader, sending a full tablet report...
I20260709 12:08:17.918597 25622 tablet_bootstrap.cc:492] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f: Bootstrap starting.
I20260709 12:08:17.926164 25621 ts_tablet_manager.cc:1434] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.005s
I20260709 12:08:17.929087 25621 tablet_bootstrap.cc:492] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba: Bootstrap starting.
I20260709 12:08:17.934023 25622 tablet_bootstrap.cc:654] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.936689 25621 tablet_bootstrap.cc:654] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.948993 25621 tablet_bootstrap.cc:492] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba: No bootstrap required, opened a new log
I20260709 12:08:17.949648 25621 ts_tablet_manager.cc:1403] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.002s
I20260709 12:08:17.951370 25622 tablet_bootstrap.cc:492] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f: No bootstrap required, opened a new log
I20260709 12:08:17.951897 25622 ts_tablet_manager.cc:1403] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.012s
I20260709 12:08:17.955956 25621 raft_consensus.cc:359] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:17.956804 25621 raft_consensus.cc:385] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.957157 25621 raft_consensus.cc:740] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.958007 25621 consensus_queue.cc:260] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:17.962116 25620 tablet_bootstrap.cc:492] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187: No bootstrap required, opened a new log
I20260709 12:08:17.962663 25620 ts_tablet_manager.cc:1403] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.031s
I20260709 12:08:17.957703 25622 raft_consensus.cc:359] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:17.964493 25622 raft_consensus.cc:385] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.964852 25622 raft_consensus.cc:740] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.965619 25622 consensus_queue.cc:260] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:17.967284 25620 raft_consensus.cc:359] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:17.968050 25620 raft_consensus.cc:385] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.968356 25620 raft_consensus.cc:740] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63a331ccd01d463fb5569613ba13a187, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.969807 25622 ts_tablet_manager.cc:1434] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.003s
I20260709 12:08:17.970067 25620 consensus_queue.cc:260] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:17.972635 25620 ts_tablet_manager.cc:1434] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:08:17.971071 25622 tablet_bootstrap.cc:492] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f: Bootstrap starting.
I20260709 12:08:17.973675 25620 tablet_bootstrap.cc:492] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187: Bootstrap starting.
I20260709 12:08:17.977460 25621 ts_tablet_manager.cc:1434] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba: Time spent starting tablet: real 0.027s	user 0.002s	sys 0.004s
I20260709 12:08:17.980518 25622 tablet_bootstrap.cc:654] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.980865 25620 tablet_bootstrap.cc:654] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.985010 25621 tablet_bootstrap.cc:492] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba: Bootstrap starting.
I20260709 12:08:17.993381 25622 tablet_bootstrap.cc:492] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f: No bootstrap required, opened a new log
I20260709 12:08:17.993551 25620 tablet_bootstrap.cc:492] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187: No bootstrap required, opened a new log
I20260709 12:08:17.993984 25622 ts_tablet_manager.cc:1403] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.002s
I20260709 12:08:17.993984 25620 ts_tablet_manager.cc:1403] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 12:08:17.997542 25621 tablet_bootstrap.cc:654] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.997421 25620 raft_consensus.cc:359] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:17.997566 25622 raft_consensus.cc:359] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:17.998289 25620 raft_consensus.cc:385] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.998477 25622 raft_consensus.cc:385] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.998679 25620 raft_consensus.cc:740] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63a331ccd01d463fb5569613ba13a187, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.998844 25622 raft_consensus.cc:740] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.999675 25620 consensus_queue.cc:260] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:17.999645 25622 consensus_queue.cc:260] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.002653 25620 ts_tablet_manager.cc:1434] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:08:18.003783 25620 tablet_bootstrap.cc:492] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187: Bootstrap starting.
I20260709 12:08:18.007020 25622 ts_tablet_manager.cc:1434] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:08:18.008265 25622 tablet_bootstrap.cc:492] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f: Bootstrap starting.
I20260709 12:08:18.012027 25620 tablet_bootstrap.cc:654] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187: Neither blocks nor log segments found. Creating new log.
W20260709 12:08:18.013551 25603 tablet.cc:2406] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:18.017830 25627 raft_consensus.cc:493] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.018566 25627 raft_consensus.cc:515] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } }
I20260709 12:08:18.022598 25620 tablet_bootstrap.cc:492] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187: No bootstrap required, opened a new log
I20260709 12:08:18.023176 25620 ts_tablet_manager.cc:1403] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:08:18.023746 25621 tablet_bootstrap.cc:492] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba: No bootstrap required, opened a new log
I20260709 12:08:18.024398 25621 ts_tablet_manager.cc:1403] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.006s
I20260709 12:08:18.025491 25627 leader_election.cc:290] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927), 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641)
I20260709 12:08:18.028399 25620 raft_consensus.cc:359] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.029166 25620 raft_consensus.cc:385] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.029680 25620 raft_consensus.cc:740] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63a331ccd01d463fb5569613ba13a187, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.029001 25621 raft_consensus.cc:359] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.030280 25621 raft_consensus.cc:385] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.030824 25621 raft_consensus.cc:740] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.030573 25620 consensus_queue.cc:260] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.031925 25621 consensus_queue.cc:260] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.033565 25620 ts_tablet_manager.cc:1434] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:08:18.034607 25620 tablet_bootstrap.cc:492] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187: Bootstrap starting.
I20260709 12:08:18.034950 25621 ts_tablet_manager.cc:1434] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.002s
I20260709 12:08:18.036090 25621 tablet_bootstrap.cc:492] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba: Bootstrap starting.
I20260709 12:08:18.042568 25620 tablet_bootstrap.cc:654] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.044159 25628 raft_consensus.cc:493] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.045105 25628 raft_consensus.cc:515] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.048520 25628 leader_election.cc:290] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:18.070513 25621 tablet_bootstrap.cc:654] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.091106 25622 tablet_bootstrap.cc:654] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.112069 25627 raft_consensus.cc:493] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.112632 25627 raft_consensus.cc:515] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.115830 25627 leader_election.cc:290] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:18.121728 25427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d52b113a784bf79866f1220037adc5" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" is_pre_election: true
I20260709 12:08:18.121382 25428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4409906fca2d49c7b9e247556f7376e5" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" is_pre_election: true
I20260709 12:08:18.129456 25621 tablet_bootstrap.cc:492] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba: No bootstrap required, opened a new log
W20260709 12:08:18.128930 25469 leader_election.cc:343] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.128031 25620 tablet_bootstrap.cc:492] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187: No bootstrap required, opened a new log
I20260709 12:08:18.130879 25621 ts_tablet_manager.cc:1403] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba: Time spent bootstrapping tablet: real 0.095s	user 0.020s	sys 0.005s
W20260709 12:08:18.132754 25469 leader_election.cc:343] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.132778 25620 ts_tablet_manager.cc:1403] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187: Time spent bootstrapping tablet: real 0.098s	user 0.021s	sys 0.005s
I20260709 12:08:18.143033 25622 tablet_bootstrap.cc:492] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f: No bootstrap required, opened a new log
I20260709 12:08:18.143932 25622 ts_tablet_manager.cc:1403] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f: Time spent bootstrapping tablet: real 0.136s	user 0.016s	sys 0.016s
I20260709 12:08:18.143644 25503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e035521a0e44adb8664f0ab720bb8b" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" is_pre_election: true
I20260709 12:08:18.144824 25576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d52b113a784bf79866f1220037adc5" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63a331ccd01d463fb5569613ba13a187" is_pre_election: true
I20260709 12:08:18.144886 25577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4409906fca2d49c7b9e247556f7376e5" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63a331ccd01d463fb5569613ba13a187" is_pre_election: true
I20260709 12:08:18.146500 25626 raft_consensus.cc:493] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.145210 25503 raft_consensus.cc:2468] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 0.
I20260709 12:08:18.149468 25628 raft_consensus.cc:493] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.150161 25628 raft_consensus.cc:515] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.151507 25575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e035521a0e44adb8664f0ab720bb8b" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63a331ccd01d463fb5569613ba13a187" is_pre_election: true
I20260709 12:08:18.152462 25628 leader_election.cc:290] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:18.147105 25577 raft_consensus.cc:2468] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 0.
I20260709 12:08:18.147163 25626 raft_consensus.cc:515] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.152218 25575 raft_consensus.cc:2468] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 0.
I20260709 12:08:18.154825 25574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "892869c2646b42028fdf458924a0ad16" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63a331ccd01d463fb5569613ba13a187" is_pre_election: true
I20260709 12:08:18.155925 25391 leader_election.cc:304] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 
I20260709 12:08:18.155052 25621 raft_consensus.cc:359] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } }
I20260709 12:08:18.157943 25621 raft_consensus.cc:385] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.156387 25576 raft_consensus.cc:2468] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 0.
I20260709 12:08:18.159091 25628 raft_consensus.cc:2804] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.146896 25620 raft_consensus.cc:359] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.160679 25628 raft_consensus.cc:493] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.158875 25621 raft_consensus.cc:740] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.161574 25620 raft_consensus.cc:385] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.159278 25467 leader_election.cc:304] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63a331ccd01d463fb5569613ba13a187, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 5e65bf7f211d48d18829fde7ab0a60ba
I20260709 12:08:18.160976 25503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "892869c2646b42028fdf458924a0ad16" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" is_pre_election: true
I20260709 12:08:18.162729 25628 raft_consensus.cc:3060] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.162364 25620 raft_consensus.cc:740] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63a331ccd01d463fb5569613ba13a187, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.164422 25626 leader_election.cc:290] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575)
I20260709 12:08:18.163260 25621 consensus_queue.cc:260] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } }
W20260709 12:08:18.189208 25392 leader_election.cc:343] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.168576 25627 raft_consensus.cc:2804] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.199467 25620 consensus_queue.cc:260] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.203511 25626 raft_consensus.cc:493] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:08:18.202378 25391 leader_election.cc:343] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.202832 25627 raft_consensus.cc:493] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.205595 25467 leader_election.cc:304] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63a331ccd01d463fb5569613ba13a187, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 5e65bf7f211d48d18829fde7ab0a60ba
I20260709 12:08:18.204856 25391 leader_election.cc:304] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba; no voters: 63a331ccd01d463fb5569613ba13a187, abdf95f659b14e17b4d98ba372cb3f1f
I20260709 12:08:18.204342 25626 raft_consensus.cc:515] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.207957 25627 raft_consensus.cc:3060] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.214871 25628 raft_consensus.cc:515] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.221114 25622 raft_consensus.cc:359] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.224946 25622 raft_consensus.cc:385] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.225303 25622 raft_consensus.cc:740] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.226024 25576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e035521a0e44adb8664f0ab720bb8b" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:18.233148 25576 raft_consensus.cc:3060] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.223858 25628 leader_election.cc:290] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 election: Requested vote from peers abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:18.238667 25626 leader_election.cc:290] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575)
I20260709 12:08:18.235432 25620 ts_tablet_manager.cc:1434] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187: Time spent starting tablet: real 0.102s	user 0.018s	sys 0.029s
I20260709 12:08:18.226068 25622 consensus_queue.cc:260] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.246680 25620 tablet_bootstrap.cc:492] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187: Bootstrap starting.
I20260709 12:08:18.249864 25628 raft_consensus.cc:2749] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.258093 25628 raft_consensus.cc:493] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.256312 25627 raft_consensus.cc:515] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } }
I20260709 12:08:18.259543 25650 raft_consensus.cc:2804] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.260023 25650 raft_consensus.cc:493] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.260386 25650 raft_consensus.cc:3060] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:18.252305 25391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:46575, user_credentials={real_user=slave}} blocked reactor thread for 55211.4us
I20260709 12:08:18.266503 25503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e035521a0e44adb8664f0ab720bb8b" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
I20260709 12:08:18.258627 25628 raft_consensus.cc:515] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } }
I20260709 12:08:18.267867 25574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4409906fca2d49c7b9e247556f7376e5" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:18.267983 25503 raft_consensus.cc:3060] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.271051 25627 leader_election.cc:290] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 1 election: Requested vote from peers 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927), 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641)
I20260709 12:08:18.271986 25574 raft_consensus.cc:3060] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.274499 25620 tablet_bootstrap.cc:654] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.275269 25428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4409906fca2d49c7b9e247556f7376e5" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
I20260709 12:08:18.271283 25621 ts_tablet_manager.cc:1434] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba: Time spent starting tablet: real 0.139s	user 0.001s	sys 0.024s
I20260709 12:08:18.277838 25428 raft_consensus.cc:3060] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.278529 25621 tablet_bootstrap.cc:492] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba: Bootstrap starting.
I20260709 12:08:18.281949 25628 leader_election.cc:290] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927), abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575)
I20260709 12:08:18.283356 25577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4409906fca2d49c7b9e247556f7376e5" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63a331ccd01d463fb5569613ba13a187" is_pre_election: true
I20260709 12:08:18.294854 25502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4409906fca2d49c7b9e247556f7376e5" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" is_pre_election: true
I20260709 12:08:18.302690 25502 raft_consensus.cc:2393] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e65bf7f211d48d18829fde7ab0a60ba in current term 1: Already voted for candidate abdf95f659b14e17b4d98ba372cb3f1f in this term.
I20260709 12:08:18.302577 25427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d52b113a784bf79866f1220037adc5" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" is_pre_election: true
I20260709 12:08:18.304497 25427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1263c7541b64286a507ee25aa8d9571" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" is_pre_election: true
I20260709 12:08:18.306293 25391 leader_election.cc:304] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba; no voters: 63a331ccd01d463fb5569613ba13a187, abdf95f659b14e17b4d98ba372cb3f1f
I20260709 12:08:18.305254 25428 raft_consensus.cc:2468] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 1.
I20260709 12:08:18.309294 25628 raft_consensus.cc:2749] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:08:18.309947 25543 leader_election.cc:343] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:18.310774 25543 leader_election.cc:343] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.312595 25501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1263c7541b64286a507ee25aa8d9571" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" is_pre_election: true
I20260709 12:08:18.309377 25576 raft_consensus.cc:2468] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 1.
W20260709 12:08:18.316530 25540 leader_election.cc:343] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.317008 25540 leader_election.cc:304] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63a331ccd01d463fb5569613ba13a187; no voters: 5e65bf7f211d48d18829fde7ab0a60ba, abdf95f659b14e17b4d98ba372cb3f1f
I20260709 12:08:18.318658 25574 raft_consensus.cc:2468] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 1.
I20260709 12:08:18.318914 25626 raft_consensus.cc:2749] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.316054 25392 leader_election.cc:304] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, 63a331ccd01d463fb5569613ba13a187; no voters: 
I20260709 12:08:18.320848 25622 ts_tablet_manager.cc:1434] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f: Time spent starting tablet: real 0.176s	user 0.013s	sys 0.012s
I20260709 12:08:18.312589 25502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d52b113a784bf79866f1220037adc5" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" is_pre_election: true
I20260709 12:08:18.322837 25628 raft_consensus.cc:2804] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.324481 25628 raft_consensus.cc:697] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Becoming Leader. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Running, Role: LEADER
I20260709 12:08:18.325357 25467 leader_election.cc:304] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63a331ccd01d463fb5569613ba13a187, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 
I20260709 12:08:18.326040 25628 consensus_queue.cc:237] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.328406 25622 tablet_bootstrap.cc:492] T 29403a2ca1794b3b80c5f51f2b56a401 P abdf95f659b14e17b4d98ba372cb3f1f: Bootstrap starting.
I20260709 12:08:18.328466 25652 raft_consensus.cc:2804] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.332120 25652 raft_consensus.cc:697] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 LEADER]: Becoming Leader. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Running, Role: LEADER
I20260709 12:08:18.337323 25503 raft_consensus.cc:2468] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 1.
I20260709 12:08:18.340502 25620 tablet_bootstrap.cc:492] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187: No bootstrap required, opened a new log
I20260709 12:08:18.342890 25620 ts_tablet_manager.cc:1403] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187: Time spent bootstrapping tablet: real 0.096s	user 0.026s	sys 0.007s
I20260709 12:08:18.346935 25621 tablet_bootstrap.cc:654] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.339706 25652 consensus_queue.cc:237] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } }
I20260709 12:08:18.342037 25650 raft_consensus.cc:515] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.350616 25502 raft_consensus.cc:2393] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63a331ccd01d463fb5569613ba13a187 in current term 1: Already voted for candidate abdf95f659b14e17b4d98ba372cb3f1f in this term.
I20260709 12:08:18.353653 25650 leader_election.cc:290] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 1 election: Requested vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:18.354511 25540 leader_election.cc:304] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63a331ccd01d463fb5569613ba13a187; no voters: 5e65bf7f211d48d18829fde7ab0a60ba, abdf95f659b14e17b4d98ba372cb3f1f
I20260709 12:08:18.356406 25626 raft_consensus.cc:3060] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.356894 25574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d52b113a784bf79866f1220037adc5" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:18.355911 25428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d52b113a784bf79866f1220037adc5" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
W20260709 12:08:18.362123 25469 leader_election.cc:343] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.361160 25620 raft_consensus.cc:359] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.363788 25620 raft_consensus.cc:385] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.364569 25620 raft_consensus.cc:740] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63a331ccd01d463fb5569613ba13a187, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.362125 25322 catalog_manager.cc:5697] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65). New cstate: current_term: 1 leader_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.366572 25620 consensus_queue.cc:260] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.370657 25622 tablet_bootstrap.cc:654] T 29403a2ca1794b3b80c5f51f2b56a401 P abdf95f659b14e17b4d98ba372cb3f1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.378854 25648 raft_consensus.cc:493] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.379630 25648 raft_consensus.cc:515] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.378386 25626 raft_consensus.cc:2749] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.383277 25628 raft_consensus.cc:493] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.383827 25628 raft_consensus.cc:515] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.385541 25648 leader_election.cc:290] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575)
I20260709 12:08:18.386821 25428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31864e4fd2bb4861bccb7d60a5b5ed49" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" is_pre_election: true
I20260709 12:08:18.387022 25620 ts_tablet_manager.cc:1434] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.005s
I20260709 12:08:18.386325 25628 leader_election.cc:290] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
W20260709 12:08:18.392534 25543 leader_election.cc:343] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.392794 25576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63a331ccd01d463fb5569613ba13a187" is_pre_election: true
I20260709 12:08:18.393800 25576 raft_consensus.cc:2468] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 0.
I20260709 12:08:18.394280 25502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31864e4fd2bb4861bccb7d60a5b5ed49" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" is_pre_election: true
I20260709 12:08:18.394972 25502 raft_consensus.cc:2468] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63a331ccd01d463fb5569613ba13a187 in term 0.
I20260709 12:08:18.395347 25392 leader_election.cc:304] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, 63a331ccd01d463fb5569613ba13a187; no voters: 
I20260709 12:08:18.397240 25649 raft_consensus.cc:2804] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.397809 25649 raft_consensus.cc:493] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.398288 25649 raft_consensus.cc:3060] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.400131 25503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" is_pre_election: true
I20260709 12:08:18.401298 25540 leader_election.cc:304] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63a331ccd01d463fb5569613ba13a187, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 5e65bf7f211d48d18829fde7ab0a60ba
W20260709 12:08:18.404273 25391 leader_election.cc:343] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.409463 25626 raft_consensus.cc:2804] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.411015 25626 raft_consensus.cc:493] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.411453 25626 raft_consensus.cc:3060] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.412459 25620 tablet_bootstrap.cc:492] T 298d4051223d4c35ad797749a2005e85 P 63a331ccd01d463fb5569613ba13a187: Bootstrap starting.
I20260709 12:08:18.417465 25649 raft_consensus.cc:515] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.426513 25574 raft_consensus.cc:2468] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 1.
I20260709 12:08:18.433091 25621 tablet_bootstrap.cc:492] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba: No bootstrap required, opened a new log
I20260709 12:08:18.433669 25621 ts_tablet_manager.cc:1403] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba: Time spent bootstrapping tablet: real 0.155s	user 0.012s	sys 0.033s
I20260709 12:08:18.435221 25467 leader_election.cc:304] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63a331ccd01d463fb5569613ba13a187, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 5e65bf7f211d48d18829fde7ab0a60ba
I20260709 12:08:18.436183 25652 raft_consensus.cc:2804] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.437044 25652 raft_consensus.cc:697] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 LEADER]: Becoming Leader. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Running, Role: LEADER
I20260709 12:08:18.437203 25325 catalog_manager.cc:5697] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f reported cstate change: term changed from 0 to 1, leader changed from <none> to abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66). New cstate: current_term: 1 leader_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:18.438328 25652 consensus_queue.cc:237] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.443089 25621 raft_consensus.cc:359] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.443852 25503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
I20260709 12:08:18.448176 25621 raft_consensus.cc:385] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.448613 25621 raft_consensus.cc:740] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.444567 25626 raft_consensus.cc:515] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.447577 25649 leader_election.cc:290] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 election: Requested vote from peers abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:18.449035 25574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:18.451665 25574 raft_consensus.cc:3060] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.452907 25626 leader_election.cc:290] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 1 election: Requested vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575)
I20260709 12:08:18.454187 25503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31864e4fd2bb4861bccb7d60a5b5ed49" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
I20260709 12:08:18.454891 25503 raft_consensus.cc:3060] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:18.449950 25391 leader_election.cc:343] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.450443 25621 consensus_queue.cc:260] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.458451 25428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31864e4fd2bb4861bccb7d60a5b5ed49" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
I20260709 12:08:18.456563 25620 tablet_bootstrap.cc:654] T 298d4051223d4c35ad797749a2005e85 P 63a331ccd01d463fb5569613ba13a187: Neither blocks nor log segments found. Creating new log.
W20260709 12:08:18.460664 25543 leader_election.cc:343] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.463776 25574 raft_consensus.cc:2468] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 1.
I20260709 12:08:18.465531 25503 raft_consensus.cc:2468] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63a331ccd01d463fb5569613ba13a187 in term 1.
I20260709 12:08:18.465360 25392 leader_election.cc:304] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, 63a331ccd01d463fb5569613ba13a187; no voters: abdf95f659b14e17b4d98ba372cb3f1f
I20260709 12:08:18.468659 25621 ts_tablet_manager.cc:1434] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.002s
I20260709 12:08:18.469513 25622 tablet_bootstrap.cc:492] T 29403a2ca1794b3b80c5f51f2b56a401 P abdf95f659b14e17b4d98ba372cb3f1f: No bootstrap required, opened a new log
I20260709 12:08:18.467478 25649 raft_consensus.cc:2804] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.470279 25622 ts_tablet_manager.cc:1403] T 29403a2ca1794b3b80c5f51f2b56a401 P abdf95f659b14e17b4d98ba372cb3f1f: Time spent bootstrapping tablet: real 0.143s	user 0.010s	sys 0.030s
I20260709 12:08:18.470836 25540 leader_election.cc:304] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63a331ccd01d463fb5569613ba13a187, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 5e65bf7f211d48d18829fde7ab0a60ba
I20260709 12:08:18.470979 25649 raft_consensus.cc:697] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Becoming Leader. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Running, Role: LEADER
I20260709 12:08:18.471908 25626 raft_consensus.cc:2804] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.472625 25626 raft_consensus.cc:697] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 1 LEADER]: Becoming Leader. State: Replica: 63a331ccd01d463fb5569613ba13a187, State: Running, Role: LEADER
I20260709 12:08:18.473467 25649 consensus_queue.cc:237] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.474701 25626 consensus_queue.cc:237] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.475831 25622 raft_consensus.cc:359] T 29403a2ca1794b3b80c5f51f2b56a401 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.476647 25622 raft_consensus.cc:385] T 29403a2ca1794b3b80c5f51f2b56a401 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.478286 25622 raft_consensus.cc:740] T 29403a2ca1794b3b80c5f51f2b56a401 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.479370 25622 consensus_queue.cc:260] T 29403a2ca1794b3b80c5f51f2b56a401 P abdf95f659b14e17b4d98ba372cb3f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.481914 25622 ts_tablet_manager.cc:1434] T 29403a2ca1794b3b80c5f51f2b56a401 P abdf95f659b14e17b4d98ba372cb3f1f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:08:18.473518 25621 tablet_bootstrap.cc:492] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba: Bootstrap starting.
I20260709 12:08:18.483325 25622 tablet_bootstrap.cc:492] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f: Bootstrap starting.
I20260709 12:08:18.499440 25620 tablet_bootstrap.cc:492] T 298d4051223d4c35ad797749a2005e85 P 63a331ccd01d463fb5569613ba13a187: No bootstrap required, opened a new log
I20260709 12:08:18.502056 25620 ts_tablet_manager.cc:1403] T 298d4051223d4c35ad797749a2005e85 P 63a331ccd01d463fb5569613ba13a187: Time spent bootstrapping tablet: real 0.090s	user 0.016s	sys 0.009s
I20260709 12:08:18.504516 25323 catalog_manager.cc:5697] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63a331ccd01d463fb5569613ba13a187 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "63a331ccd01d463fb5569613ba13a187" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:18.510766 25622 tablet_bootstrap.cc:654] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.511379 25621 tablet_bootstrap.cc:654] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.521867 25620 raft_consensus.cc:359] T 298d4051223d4c35ad797749a2005e85 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.522814 25620 raft_consensus.cc:385] T 298d4051223d4c35ad797749a2005e85 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.523144 25620 raft_consensus.cc:740] T 298d4051223d4c35ad797749a2005e85 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63a331ccd01d463fb5569613ba13a187, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.524009 25620 consensus_queue.cc:260] T 298d4051223d4c35ad797749a2005e85 P 63a331ccd01d463fb5569613ba13a187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.532367 25620 ts_tablet_manager.cc:1434] T 298d4051223d4c35ad797749a2005e85 P 63a331ccd01d463fb5569613ba13a187: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:08:18.533461 25620 tablet_bootstrap.cc:492] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187: Bootstrap starting.
I20260709 12:08:18.538214 25622 tablet_bootstrap.cc:492] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f: No bootstrap required, opened a new log
I20260709 12:08:18.538893 25622 ts_tablet_manager.cc:1403] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.009s
I20260709 12:08:18.542062 25622 raft_consensus.cc:359] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.543026 25622 raft_consensus.cc:385] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.543444 25622 raft_consensus.cc:740] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.544369 25622 consensus_queue.cc:260] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
W20260709 12:08:18.548980 25372 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:18.549273 25325 catalog_manager.cc:5697] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65). New cstate: current_term: 1 leader_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.553562 25621 tablet_bootstrap.cc:492] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba: No bootstrap required, opened a new log
I20260709 12:08:18.554081 25621 ts_tablet_manager.cc:1403] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba: Time spent bootstrapping tablet: real 0.081s	user 0.005s	sys 0.013s
I20260709 12:08:18.557116 25622 ts_tablet_manager.cc:1434] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:08:18.558215 25622 tablet_bootstrap.cc:492] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f: Bootstrap starting.
I20260709 12:08:18.560737 25620 tablet_bootstrap.cc:654] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.557104 25621 raft_consensus.cc:359] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.561159 25621 raft_consensus.cc:385] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.560524 25322 catalog_manager.cc:5697] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f reported cstate change: term changed from 0 to 1, leader changed from <none> to abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66). New cstate: current_term: 1 leader_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.561544 25621 raft_consensus.cc:740] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.562570 25621 consensus_queue.cc:260] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.570873 25621 ts_tablet_manager.cc:1434] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 12:08:18.572026 25621 tablet_bootstrap.cc:492] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba: Bootstrap starting.
I20260709 12:08:18.574769 25620 tablet_bootstrap.cc:492] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187: No bootstrap required, opened a new log
I20260709 12:08:18.568861 25622 tablet_bootstrap.cc:654] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.575284 25620 ts_tablet_manager.cc:1403] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.008s
I20260709 12:08:18.578224 25620 raft_consensus.cc:359] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.579005 25620 raft_consensus.cc:385] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.579329 25620 raft_consensus.cc:740] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63a331ccd01d463fb5569613ba13a187, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.580328 25620 consensus_queue.cc:260] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.582842 25620 ts_tablet_manager.cc:1434] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:08:18.583811 25620 tablet_bootstrap.cc:492] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187: Bootstrap starting.
I20260709 12:08:18.589358 25621 tablet_bootstrap.cc:654] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.592883 25620 tablet_bootstrap.cc:654] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.598985 25622 tablet_bootstrap.cc:492] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f: No bootstrap required, opened a new log
I20260709 12:08:18.599545 25622 ts_tablet_manager.cc:1403] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.007s
I20260709 12:08:18.603098 25622 raft_consensus.cc:359] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.604027 25622 raft_consensus.cc:385] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.604365 25622 raft_consensus.cc:740] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.605484 25622 consensus_queue.cc:260] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.611055 25622 ts_tablet_manager.cc:1434] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 12:08:18.612324 25622 tablet_bootstrap.cc:492] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f: Bootstrap starting.
I20260709 12:08:18.613373 25621 tablet_bootstrap.cc:492] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba: No bootstrap required, opened a new log
I20260709 12:08:18.613943 25621 ts_tablet_manager.cc:1403] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.018s
I20260709 12:08:18.617187 25621 raft_consensus.cc:359] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.617997 25621 raft_consensus.cc:385] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.618355 25621 raft_consensus.cc:740] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.619724 25622 tablet_bootstrap.cc:654] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.622891 25620 tablet_bootstrap.cc:492] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187: No bootstrap required, opened a new log
I20260709 12:08:18.623415 25620 ts_tablet_manager.cc:1403] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.006s
I20260709 12:08:18.624414 25649 raft_consensus.cc:493] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.624899 25649 raft_consensus.cc:515] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.627120 25649 leader_election.cc:290] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:18.626976 25620 raft_consensus.cc:359] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.627985 25620 raft_consensus.cc:385] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.628362 25620 raft_consensus.cc:740] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63a331ccd01d463fb5569613ba13a187, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.628952 25574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298d4051223d4c35ad797749a2005e85" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63a331ccd01d463fb5569613ba13a187" is_pre_election: true
I20260709 12:08:18.629232 25620 consensus_queue.cc:260] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.629642 25574 raft_consensus.cc:2468] T 298d4051223d4c35ad797749a2005e85 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 0.
I20260709 12:08:18.631879 25622 tablet_bootstrap.cc:492] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f: No bootstrap required, opened a new log
I20260709 12:08:18.631956 25503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298d4051223d4c35ad797749a2005e85" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" is_pre_election: true
I20260709 12:08:18.632344 25392 leader_election.cc:304] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, 63a331ccd01d463fb5569613ba13a187; no voters: 
I20260709 12:08:18.632437 25622 ts_tablet_manager.cc:1403] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.006s
W20260709 12:08:18.633589 25391 leader_election.cc:343] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.633663 25649 raft_consensus.cc:2804] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.634212 25649 raft_consensus.cc:493] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.634670 25649 raft_consensus.cc:3060] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.639194 25620 ts_tablet_manager.cc:1434] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:08:18.635866 25622 raft_consensus.cc:359] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.642791 25622 raft_consensus.cc:385] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.619282 25621 consensus_queue.cc:260] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.643139 25622 raft_consensus.cc:740] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.643918 25622 consensus_queue.cc:260] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.646268 25622 ts_tablet_manager.cc:1434] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:08:18.647468 25622 tablet_bootstrap.cc:492] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f: Bootstrap starting.
I20260709 12:08:18.652959 25622 tablet_bootstrap.cc:654] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.655297 25649 raft_consensus.cc:515] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.660576 25622 tablet_bootstrap.cc:492] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f: No bootstrap required, opened a new log
I20260709 12:08:18.656518 25621 ts_tablet_manager.cc:1434] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:08:18.661024 25622 ts_tablet_manager.cc:1403] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.002s
I20260709 12:08:18.661981 25621 tablet_bootstrap.cc:492] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba: Bootstrap starting.
I20260709 12:08:18.664350 25622 raft_consensus.cc:359] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.665088 25622 raft_consensus.cc:385] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.665280 25622 raft_consensus.cc:740] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.665843 25622 consensus_queue.cc:260] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.666728 25649 leader_election.cc:290] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 election: Requested vote from peers abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:18.667529 25503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298d4051223d4c35ad797749a2005e85" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
I20260709 12:08:18.667771 25574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298d4051223d4c35ad797749a2005e85" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:18.668107 25503 raft_consensus.cc:3060] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.668291 25574 raft_consensus.cc:3060] T 298d4051223d4c35ad797749a2005e85 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.669860 25622 ts_tablet_manager.cc:1434] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:08:18.673883 25621 tablet_bootstrap.cc:654] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.677752 25503 raft_consensus.cc:2468] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 1.
I20260709 12:08:18.679301 25391 leader_election.cc:304] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 
I20260709 12:08:18.680248 25649 raft_consensus.cc:2804] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.680763 25649 raft_consensus.cc:697] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Becoming Leader. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Running, Role: LEADER
I20260709 12:08:18.681607 25649 consensus_queue.cc:237] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.692612 25574 raft_consensus.cc:2468] T 298d4051223d4c35ad797749a2005e85 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 1.
I20260709 12:08:18.698571 25621 tablet_bootstrap.cc:492] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba: No bootstrap required, opened a new log
I20260709 12:08:18.699191 25621 ts_tablet_manager.cc:1403] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.003s
I20260709 12:08:18.700616 25323 catalog_manager.cc:5697] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65). New cstate: current_term: 1 leader_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.701830 25621 raft_consensus.cc:359] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.702543 25621 raft_consensus.cc:385] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.702811 25621 raft_consensus.cc:740] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.703490 25621 consensus_queue.cc:260] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.705406 25621 ts_tablet_manager.cc:1434] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:08:18.706238 25621 tablet_bootstrap.cc:492] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba: Bootstrap starting.
I20260709 12:08:18.712067 25621 tablet_bootstrap.cc:654] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.717235 25621 tablet_bootstrap.cc:492] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba: No bootstrap required, opened a new log
I20260709 12:08:18.717686 25621 ts_tablet_manager.cc:1403] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 12:08:18.720336 25621 raft_consensus.cc:359] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.721014 25621 raft_consensus.cc:385] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.721287 25621 raft_consensus.cc:740] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.721923 25621 consensus_queue.cc:260] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.724701 25621 ts_tablet_manager.cc:1434] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:08:18.753366 25649 raft_consensus.cc:493] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.753911 25649 raft_consensus.cc:515] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.755877 25649 leader_election.cc:290] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:18.756779 25503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1263c7541b64286a507ee25aa8d9571" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" is_pre_election: true
I20260709 12:08:18.757095 25574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1263c7541b64286a507ee25aa8d9571" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63a331ccd01d463fb5569613ba13a187" is_pre_election: true
I20260709 12:08:18.757464 25503 raft_consensus.cc:2468] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 0.
I20260709 12:08:18.757745 25574 raft_consensus.cc:2468] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 0.
I20260709 12:08:18.758802 25391 leader_election.cc:304] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 
I20260709 12:08:18.759989 25649 raft_consensus.cc:2804] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.760442 25649 raft_consensus.cc:493] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.760752 25649 raft_consensus.cc:3060] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.765982 25649 raft_consensus.cc:515] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.767783 25649 leader_election.cc:290] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 election: Requested vote from peers abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:18.768850 25503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1263c7541b64286a507ee25aa8d9571" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
I20260709 12:08:18.769024 25574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1263c7541b64286a507ee25aa8d9571" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:18.769403 25503 raft_consensus.cc:3060] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.769655 25574 raft_consensus.cc:3060] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.774497 25503 raft_consensus.cc:2468] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 1.
I20260709 12:08:18.775687 25391 leader_election.cc:304] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 
I20260709 12:08:18.776443 25649 raft_consensus.cc:2804] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.776585 25574 raft_consensus.cc:2468] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 1.
I20260709 12:08:18.777223 25649 raft_consensus.cc:697] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Becoming Leader. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Running, Role: LEADER
I20260709 12:08:18.778163 25649 consensus_queue.cc:237] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.787102 25323 catalog_manager.cc:5697] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65). New cstate: current_term: 1 leader_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.795295 25649 raft_consensus.cc:493] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.795841 25649 raft_consensus.cc:515] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.797524 25649 leader_election.cc:290] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:18.798444 25503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d52b113a784bf79866f1220037adc5" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" is_pre_election: true
I20260709 12:08:18.798629 25574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d52b113a784bf79866f1220037adc5" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63a331ccd01d463fb5569613ba13a187" is_pre_election: true
I20260709 12:08:18.799309 25574 raft_consensus.cc:2393] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e65bf7f211d48d18829fde7ab0a60ba in current term 1: Already voted for candidate abdf95f659b14e17b4d98ba372cb3f1f in this term.
I20260709 12:08:18.800336 25626 raft_consensus.cc:493] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.800448 25392 leader_election.cc:304] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba; no voters: 63a331ccd01d463fb5569613ba13a187, abdf95f659b14e17b4d98ba372cb3f1f
I20260709 12:08:18.800787 25626 raft_consensus.cc:515] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.801266 25649 raft_consensus.cc:3060] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.803053 25626 leader_election.cc:290] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575)
I20260709 12:08:18.804263 25503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "892869c2646b42028fdf458924a0ad16" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" is_pre_election: true
I20260709 12:08:18.804795 25428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "892869c2646b42028fdf458924a0ad16" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" is_pre_election: true
I20260709 12:08:18.805583 25428 raft_consensus.cc:2468] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63a331ccd01d463fb5569613ba13a187 in term 0.
I20260709 12:08:18.804879 25503 raft_consensus.cc:2468] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63a331ccd01d463fb5569613ba13a187 in term 0.
I20260709 12:08:18.807163 25543 leader_election.cc:304] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, 63a331ccd01d463fb5569613ba13a187; no voters: 
I20260709 12:08:18.808370 25626 raft_consensus.cc:2804] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.808691 25626 raft_consensus.cc:493] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.808995 25626 raft_consensus.cc:3060] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.809221 25649 raft_consensus.cc:2749] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.813720 25626 raft_consensus.cc:515] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.816020 25626 leader_election.cc:290] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 1 election: Requested vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575)
I20260709 12:08:18.817335 25503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "892869c2646b42028fdf458924a0ad16" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
I20260709 12:08:18.817247 25428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "892869c2646b42028fdf458924a0ad16" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
I20260709 12:08:18.818048 25503 raft_consensus.cc:3060] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.818053 25428 raft_consensus.cc:3060] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.823132 25503 raft_consensus.cc:2468] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63a331ccd01d463fb5569613ba13a187 in term 1.
I20260709 12:08:18.824216 25540 leader_election.cc:304] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63a331ccd01d463fb5569613ba13a187, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 
I20260709 12:08:18.824935 25626 raft_consensus.cc:2804] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.824925 25428 raft_consensus.cc:2468] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63a331ccd01d463fb5569613ba13a187 in term 1.
I20260709 12:08:18.825918 25626 raft_consensus.cc:697] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 1 LEADER]: Becoming Leader. State: Replica: 63a331ccd01d463fb5569613ba13a187, State: Running, Role: LEADER
I20260709 12:08:18.826845 25626 consensus_queue.cc:237] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.834766 25649 consensus_queue.cc:1048] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.835309 25323 catalog_manager.cc:5697] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63a331ccd01d463fb5569613ba13a187 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "63a331ccd01d463fb5569613ba13a187" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:18.858673 25428 raft_consensus.cc:3060] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.859612 25649 consensus_queue.cc:1048] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.876423 25652 consensus_queue.cc:1048] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.890228 25626 consensus_queue.cc:1048] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.893024 25652 consensus_queue.cc:1048] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.919874 25649 raft_consensus.cc:493] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.920415 25649 raft_consensus.cc:515] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.922683 25649 leader_election.cc:290] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:18.923803 25650 consensus_queue.cc:1048] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.923861 25576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29403a2ca1794b3b80c5f51f2b56a401" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63a331ccd01d463fb5569613ba13a187" is_pre_election: true
I20260709 12:08:18.926827 25503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29403a2ca1794b3b80c5f51f2b56a401" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" is_pre_election: true
I20260709 12:08:18.927366 25576 raft_consensus.cc:2468] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 0.
I20260709 12:08:18.927578 25503 raft_consensus.cc:2468] T 29403a2ca1794b3b80c5f51f2b56a401 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 0.
I20260709 12:08:18.929023 25391 leader_election.cc:304] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 
I20260709 12:08:18.930203 25649 raft_consensus.cc:2804] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.930625 25649 raft_consensus.cc:493] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.930984 25649 raft_consensus.cc:3060] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.942998 25648 consensus_queue.cc:1048] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.938308 25649 raft_consensus.cc:515] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.951295 25501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29403a2ca1794b3b80c5f51f2b56a401" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
I20260709 12:08:18.951819 25649 leader_election.cc:290] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 election: Requested vote from peers abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:18.951946 25501 raft_consensus.cc:3060] T 29403a2ca1794b3b80c5f51f2b56a401 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.952996 25574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29403a2ca1794b3b80c5f51f2b56a401" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:18.953595 25574 raft_consensus.cc:3060] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.961643 25574 raft_consensus.cc:2468] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 1.
I20260709 12:08:18.963253 25392 leader_election.cc:304] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, 63a331ccd01d463fb5569613ba13a187; no voters: 
I20260709 12:08:18.965263 25649 raft_consensus.cc:2804] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.965370 25628 consensus_queue.cc:1048] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.969645 25501 raft_consensus.cc:2468] T 29403a2ca1794b3b80c5f51f2b56a401 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 1.
I20260709 12:08:18.974339 25650 raft_consensus.cc:493] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.975008 25650 raft_consensus.cc:515] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.977855 25650 leader_election.cc:290] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:18.980219 25500 raft_consensus.cc:3060] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.980842 25425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" is_pre_election: true
I20260709 12:08:18.984166 25577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63a331ccd01d463fb5569613ba13a187" is_pre_election: true
I20260709 12:08:18.987720 25469 leader_election.cc:304] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abdf95f659b14e17b4d98ba372cb3f1f; no voters: 5e65bf7f211d48d18829fde7ab0a60ba, 63a331ccd01d463fb5569613ba13a187
I20260709 12:08:18.988683 25649 raft_consensus.cc:697] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Becoming Leader. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Running, Role: LEADER
I20260709 12:08:18.989674 25649 consensus_queue.cc:237] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:18.990597 25691 consensus_queue.cc:1048] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.990979 25650 raft_consensus.cc:2749] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:08:18.993263 25685 log.cc:927] Time spent T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:08:19.005400 25650 consensus_queue.cc:1048] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:08:19.043323 25543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:36641, user_credentials={real_user=slave}} blocked reactor thread for 99994.3us
I20260709 12:08:19.052122 25323 catalog_manager.cc:5697] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65). New cstate: current_term: 1 leader_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.193226 25628 consensus_queue.cc:1048] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.207217 25699 consensus_queue.cc:1048] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.222492 25626 consensus_queue.cc:1048] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.249684 25626 consensus_queue.cc:1048] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.359153 25500 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4409906fca2d49c7b9e247556f7376e5"
dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
mode: GRACEFUL
new_leader_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
 from {username='slave'} at 127.0.0.1:34266
I20260709 12:08:19.359807 25500 raft_consensus.cc:606] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 LEADER]: Received request to transfer leadership to TS 5e65bf7f211d48d18829fde7ab0a60ba
I20260709 12:08:19.365888 25500 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25d52b113a784bf79866f1220037adc5"
dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
mode: GRACEFUL
new_leader_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
 from {username='slave'} at 127.0.0.1:34266
I20260709 12:08:19.366482 25500 raft_consensus.cc:606] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 LEADER]: Received request to transfer leadership to TS 5e65bf7f211d48d18829fde7ab0a60ba
I20260709 12:08:19.379091 25699 consensus_queue.cc:1048] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.389544 25574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31864e4fd2bb4861bccb7d60a5b5ed49"
dest_uuid: "63a331ccd01d463fb5569613ba13a187"
mode: GRACEFUL
new_leader_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
 from {username='slave'} at 127.0.0.1:37308
I20260709 12:08:19.390187 25574 raft_consensus.cc:606] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 1 LEADER]: Received request to transfer leadership to TS 5e65bf7f211d48d18829fde7ab0a60ba
I20260709 12:08:19.399497 25649 consensus_queue.cc:1048] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.419956 25649 consensus_queue.cc:1048] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.427407 25427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "298d4051223d4c35ad797749a2005e85"
dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
mode: GRACEFUL
new_leader_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
 from {username='slave'} at 127.0.0.1:40358
I20260709 12:08:19.428149 25427 raft_consensus.cc:606] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Received request to transfer leadership to TS abdf95f659b14e17b4d98ba372cb3f1f
I20260709 12:08:19.436353 25574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "892869c2646b42028fdf458924a0ad16"
dest_uuid: "63a331ccd01d463fb5569613ba13a187"
mode: GRACEFUL
new_leader_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
 from {username='slave'} at 127.0.0.1:37308
I20260709 12:08:19.437079 25574 raft_consensus.cc:606] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 1 LEADER]: Received request to transfer leadership to TS abdf95f659b14e17b4d98ba372cb3f1f
I20260709 12:08:19.438814 25649 consensus_queue.cc:1048] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.445711 25427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926"
dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
mode: GRACEFUL
new_leader_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
 from {username='slave'} at 127.0.0.1:40358
I20260709 12:08:19.446377 25427 raft_consensus.cc:606] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Received request to transfer leadership to TS abdf95f659b14e17b4d98ba372cb3f1f
I20260709 12:08:19.453653 25427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1263c7541b64286a507ee25aa8d9571"
dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
mode: GRACEFUL
new_leader_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
 from {username='slave'} at 127.0.0.1:40358
I20260709 12:08:19.454315 25427 raft_consensus.cc:606] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Received request to transfer leadership to TS abdf95f659b14e17b4d98ba372cb3f1f
I20260709 12:08:19.460987 25695 raft_consensus.cc:993] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f: : Instructing follower 5e65bf7f211d48d18829fde7ab0a60ba to start an election
I20260709 12:08:19.461468 25695 raft_consensus.cc:1081] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 LEADER]: Signalling peer 5e65bf7f211d48d18829fde7ab0a60ba to start an election
I20260709 12:08:19.464461 25425 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4409906fca2d49c7b9e247556f7376e5"
dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
 from {username='slave'} at 127.0.0.1:40336
I20260709 12:08:19.465103 25425 raft_consensus.cc:493] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.465531 25425 raft_consensus.cc:3060] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.467628 25427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29403a2ca1794b3b80c5f51f2b56a401"
dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
mode: GRACEFUL
new_leader_uuid: "63a331ccd01d463fb5569613ba13a187"
 from {username='slave'} at 127.0.0.1:40358
I20260709 12:08:19.468317 25427 raft_consensus.cc:606] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Received request to transfer leadership to TS 63a331ccd01d463fb5569613ba13a187
I20260709 12:08:19.473310 25694 raft_consensus.cc:993] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f: : Instructing follower 5e65bf7f211d48d18829fde7ab0a60ba to start an election
I20260709 12:08:19.473758 25695 raft_consensus.cc:1081] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 LEADER]: Signalling peer 5e65bf7f211d48d18829fde7ab0a60ba to start an election
I20260709 12:08:19.474723 25425 raft_consensus.cc:515] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } }
I20260709 12:08:19.475574 25427 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25d52b113a784bf79866f1220037adc5"
dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
 from {username='slave'} at 127.0.0.1:40336
I20260709 12:08:19.476168 25427 raft_consensus.cc:493] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.476567 25427 raft_consensus.cc:3060] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.477770 25574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4409906fca2d49c7b9e247556f7376e5" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:19.478377 25574 raft_consensus.cc:3060] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.483070 25425 leader_election.cc:290] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 2 election: Requested vote from peers 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927), abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575)
I20260709 12:08:19.484033 25427 raft_consensus.cc:515] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:19.484647 25502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4409906fca2d49c7b9e247556f7376e5" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
I20260709 12:08:19.485256 25502 raft_consensus.cc:3055] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.485563 25502 raft_consensus.cc:740] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Running, Role: LEADER
I20260709 12:08:19.486335 25427 leader_election.cc:290] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 2 election: Requested vote from peers abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:19.486459 25502 consensus_queue.cc:260] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } }
I20260709 12:08:19.487113 25500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d52b113a784bf79866f1220037adc5" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
I20260709 12:08:19.487636 25500 raft_consensus.cc:3055] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.487848 25500 raft_consensus.cc:740] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Running, Role: LEADER
I20260709 12:08:19.487866 25502 raft_consensus.cc:3060] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.488569 25500 consensus_queue.cc:260] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:19.489385 25500 raft_consensus.cc:3060] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.493929 25574 raft_consensus.cc:2468] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 2.
I20260709 12:08:19.495033 25502 raft_consensus.cc:2468] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 2.
I20260709 12:08:19.495334 25392 leader_election.cc:304] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, 63a331ccd01d463fb5569613ba13a187; no voters: 
I20260709 12:08:19.496299 25649 raft_consensus.cc:2804] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.496251 25574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d52b113a784bf79866f1220037adc5" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:19.496958 25574 raft_consensus.cc:3060] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.496914 25649 raft_consensus.cc:697] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 LEADER]: Becoming Leader. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Running, Role: LEADER
I20260709 12:08:19.497982 25649 consensus_queue.cc:237] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } }
I20260709 12:08:19.499676 25500 raft_consensus.cc:2468] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 2.
I20260709 12:08:19.501109 25391 leader_election.cc:304] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 
I20260709 12:08:19.502099 25628 raft_consensus.cc:2804] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.502600 25628 raft_consensus.cc:697] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 LEADER]: Becoming Leader. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Running, Role: LEADER
I20260709 12:08:19.503273 25628 consensus_queue.cc:237] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:19.503906 25574 raft_consensus.cc:2468] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 2.
I20260709 12:08:19.509229 25325 catalog_manager.cc:5697] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba reported cstate change: term changed from 1 to 2, leader changed from abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66) to 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65). New cstate: current_term: 2 leader_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.522572 25325 catalog_manager.cc:5697] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba reported cstate change: term changed from 1 to 2, leader changed from abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66) to 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65). New cstate: current_term: 2 leader_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.606882 25628 raft_consensus.cc:993] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba: : Instructing follower abdf95f659b14e17b4d98ba372cb3f1f to start an election
I20260709 12:08:19.607417 25628 raft_consensus.cc:1081] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Signalling peer abdf95f659b14e17b4d98ba372cb3f1f to start an election
I20260709 12:08:19.609503 25500 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926"
dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
 from {username='slave'} at 127.0.0.1:34260
I20260709 12:08:19.610365 25500 raft_consensus.cc:493] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.610849 25500 raft_consensus.cc:3060] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.618499 25500 raft_consensus.cc:515] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:19.620926 25500 leader_election.cc:290] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 2 election: Requested vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:19.622054 25427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
I20260709 12:08:19.622179 25574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:19.623064 25427 raft_consensus.cc:3055] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.623140 25574 raft_consensus.cc:3060] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.623437 25427 raft_consensus.cc:740] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Running, Role: LEADER
I20260709 12:08:19.624481 25427 consensus_queue.cc:260] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:19.625774 25427 raft_consensus.cc:3060] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.631283 25427 raft_consensus.cc:2468] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 2.
I20260709 12:08:19.632027 25574 raft_consensus.cc:2468] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 2.
I20260709 12:08:19.632639 25469 leader_election.cc:304] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 
I20260709 12:08:19.633574 25695 raft_consensus.cc:2804] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.634130 25695 raft_consensus.cc:697] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 LEADER]: Becoming Leader. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Running, Role: LEADER
I20260709 12:08:19.635066 25695 consensus_queue.cc:237] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:19.642309 25325 catalog_manager.cc:5697] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f reported cstate change: term changed from 1 to 2, leader changed from 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65) to abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66). New cstate: current_term: 2 leader_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.772805 25649 raft_consensus.cc:993] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba: : Instructing follower abdf95f659b14e17b4d98ba372cb3f1f to start an election
I20260709 12:08:19.773346 25628 raft_consensus.cc:1081] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Signalling peer abdf95f659b14e17b4d98ba372cb3f1f to start an election
I20260709 12:08:19.775055 25500 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "298d4051223d4c35ad797749a2005e85"
dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
 from {username='slave'} at 127.0.0.1:34260
I20260709 12:08:19.775622 25500 raft_consensus.cc:493] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.775991 25500 raft_consensus.cc:3060] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.780687 25648 raft_consensus.cc:993] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187: : Instructing follower abdf95f659b14e17b4d98ba372cb3f1f to start an election
I20260709 12:08:19.781224 25626 raft_consensus.cc:1081] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 1 LEADER]: Signalling peer abdf95f659b14e17b4d98ba372cb3f1f to start an election
I20260709 12:08:19.782891 25500 raft_consensus.cc:515] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:19.783157 25502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "892869c2646b42028fdf458924a0ad16"
dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
 from {username='slave'} at 127.0.0.1:34264
I20260709 12:08:19.783743 25502 raft_consensus.cc:493] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.784111 25502 raft_consensus.cc:3060] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.785776 25427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298d4051223d4c35ad797749a2005e85" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
I20260709 12:08:19.786104 25574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298d4051223d4c35ad797749a2005e85" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:19.786577 25427 raft_consensus.cc:3055] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.786732 25574 raft_consensus.cc:3060] T 298d4051223d4c35ad797749a2005e85 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.786949 25427 raft_consensus.cc:740] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Running, Role: LEADER
I20260709 12:08:19.787873 25427 consensus_queue.cc:260] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:19.789057 25427 raft_consensus.cc:3060] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.793253 25502 raft_consensus.cc:515] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:19.794567 25500 leader_election.cc:290] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 2 election: Requested vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:19.795009 25574 raft_consensus.cc:2468] T 298d4051223d4c35ad797749a2005e85 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 2.
I20260709 12:08:19.795549 25502 leader_election.cc:290] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 2 election: Requested vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:19.796305 25467 leader_election.cc:304] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63a331ccd01d463fb5569613ba13a187, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 
I20260709 12:08:19.796521 25425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "892869c2646b42028fdf458924a0ad16" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
I20260709 12:08:19.796820 25577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "892869c2646b42028fdf458924a0ad16" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:19.797199 25425 raft_consensus.cc:3060] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.797441 25577 raft_consensus.cc:3055] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.797830 25577 raft_consensus.cc:740] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63a331ccd01d463fb5569613ba13a187, State: Running, Role: LEADER
I20260709 12:08:19.798650 25695 raft_consensus.cc:2804] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.799283 25695 raft_consensus.cc:697] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 LEADER]: Becoming Leader. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Running, Role: LEADER
I20260709 12:08:19.799712 25427 raft_consensus.cc:2468] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 2.
I20260709 12:08:19.798856 25577 consensus_queue.cc:260] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:19.800285 25695 consensus_queue.cc:237] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:19.801014 25577 raft_consensus.cc:3060] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.806842 25425 raft_consensus.cc:2468] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 2.
I20260709 12:08:19.806842 25577 raft_consensus.cc:2468] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 2.
I20260709 12:08:19.808328 25469 leader_election.cc:304] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 
I20260709 12:08:19.809249 25695 raft_consensus.cc:2804] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.809794 25695 raft_consensus.cc:697] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 LEADER]: Becoming Leader. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Running, Role: LEADER
I20260709 12:08:19.810274 25325 catalog_manager.cc:5697] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f reported cstate change: term changed from 1 to 2, leader changed from 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65) to abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66). New cstate: current_term: 2 leader_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.810542 25695 consensus_queue.cc:237] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:19.823036 25325 catalog_manager.cc:5697] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f reported cstate change: term changed from 1 to 2, leader changed from 63a331ccd01d463fb5569613ba13a187 (127.24.179.67) to abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66). New cstate: current_term: 2 leader_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.870944 25691 raft_consensus.cc:993] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba: : Instructing follower 63a331ccd01d463fb5569613ba13a187 to start an election
I20260709 12:08:19.871424 25628 raft_consensus.cc:1081] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Signalling peer 63a331ccd01d463fb5569613ba13a187 to start an election
I20260709 12:08:19.873028 25577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29403a2ca1794b3b80c5f51f2b56a401"
dest_uuid: "63a331ccd01d463fb5569613ba13a187"
 from {username='slave'} at 127.0.0.1:37292
I20260709 12:08:19.873509 25577 raft_consensus.cc:493] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.873780 25577 raft_consensus.cc:3060] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.878916 25577 raft_consensus.cc:515] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:19.880764 25577 leader_election.cc:290] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 2 election: Requested vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575)
I20260709 12:08:19.881711 25425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29403a2ca1794b3b80c5f51f2b56a401" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
I20260709 12:08:19.882203 25502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29403a2ca1794b3b80c5f51f2b56a401" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
I20260709 12:08:19.882371 25425 raft_consensus.cc:3055] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.882824 25502 raft_consensus.cc:3060] T 29403a2ca1794b3b80c5f51f2b56a401 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.882805 25425 raft_consensus.cc:740] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Running, Role: LEADER
I20260709 12:08:19.883924 25425 consensus_queue.cc:260] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:19.885334 25425 raft_consensus.cc:3060] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.890717 25502 raft_consensus.cc:2468] T 29403a2ca1794b3b80c5f51f2b56a401 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63a331ccd01d463fb5569613ba13a187 in term 2.
I20260709 12:08:19.892194 25540 leader_election.cc:304] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63a331ccd01d463fb5569613ba13a187, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 
I20260709 12:08:19.892485 25425 raft_consensus.cc:2468] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63a331ccd01d463fb5569613ba13a187 in term 2.
I20260709 12:08:19.893375 25626 raft_consensus.cc:2804] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.893934 25626 raft_consensus.cc:697] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 [term 2 LEADER]: Becoming Leader. State: Replica: 63a331ccd01d463fb5569613ba13a187, State: Running, Role: LEADER
I20260709 12:08:19.894866 25626 consensus_queue.cc:237] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:19.902004 25323 catalog_manager.cc:5697] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 reported cstate change: term changed from 1 to 2, leader changed from 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65) to 63a331ccd01d463fb5569613ba13a187 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "63a331ccd01d463fb5569613ba13a187" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:19.914978 25502 raft_consensus.cc:1275] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Refusing update from remote peer 5e65bf7f211d48d18829fde7ab0a60ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.916410 25628 consensus_queue.cc:1048] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.924463 25577 raft_consensus.cc:1275] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Refusing update from remote peer 5e65bf7f211d48d18829fde7ab0a60ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.926224 25649 consensus_queue.cc:1048] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.948884 25648 raft_consensus.cc:993] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187: : Instructing follower 5e65bf7f211d48d18829fde7ab0a60ba to start an election
I20260709 12:08:19.949326 25626 raft_consensus.cc:1081] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 1 LEADER]: Signalling peer 5e65bf7f211d48d18829fde7ab0a60ba to start an election
I20260709 12:08:19.950896 25425 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31864e4fd2bb4861bccb7d60a5b5ed49"
dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
 from {username='slave'} at 127.0.0.1:40348
I20260709 12:08:19.951404 25425 raft_consensus.cc:493] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.951730 25425 raft_consensus.cc:3060] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.956725 25425 raft_consensus.cc:515] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:19.958681 25425 leader_election.cc:290] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 2 election: Requested vote from peers abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:19.959430 25500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31864e4fd2bb4861bccb7d60a5b5ed49" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
I20260709 12:08:19.959810 25577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31864e4fd2bb4861bccb7d60a5b5ed49" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:19.960070 25500 raft_consensus.cc:3060] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.960475 25577 raft_consensus.cc:3055] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.960848 25577 raft_consensus.cc:740] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63a331ccd01d463fb5569613ba13a187, State: Running, Role: LEADER
I20260709 12:08:19.961601 25577 consensus_queue.cc:260] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:19.962589 25577 raft_consensus.cc:3060] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.965942 25574 raft_consensus.cc:1275] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Refusing update from remote peer 5e65bf7f211d48d18829fde7ab0a60ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.967417 25649 consensus_queue.cc:1048] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.967886 25500 raft_consensus.cc:2468] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 2.
I20260709 12:08:19.969188 25391 leader_election.cc:304] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 
I20260709 12:08:19.969421 25577 raft_consensus.cc:2468] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 2.
I20260709 12:08:19.970001 25649 raft_consensus.cc:2804] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.970539 25649 raft_consensus.cc:697] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 LEADER]: Becoming Leader. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Running, Role: LEADER
I20260709 12:08:19.971293 25649 consensus_queue.cc:237] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:19.977770 25500 raft_consensus.cc:1275] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Refusing update from remote peer 5e65bf7f211d48d18829fde7ab0a60ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.979321 25649 consensus_queue.cc:1048] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:19.980194 25325 catalog_manager.cc:5697] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba reported cstate change: term changed from 1 to 2, leader changed from 63a331ccd01d463fb5569613ba13a187 (127.24.179.67) to 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65). New cstate: current_term: 2 leader_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.986449 25699 raft_consensus.cc:993] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba: : Instructing follower abdf95f659b14e17b4d98ba372cb3f1f to start an election
I20260709 12:08:19.986954 25699 raft_consensus.cc:1081] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Signalling peer abdf95f659b14e17b4d98ba372cb3f1f to start an election
I20260709 12:08:19.989351 25500 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1263c7541b64286a507ee25aa8d9571"
dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
 from {username='slave'} at 127.0.0.1:34260
I20260709 12:08:19.990006 25500 raft_consensus.cc:493] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.990453 25500 raft_consensus.cc:3060] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.997660 25500 raft_consensus.cc:515] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:20.000993 25500 leader_election.cc:290] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 2 election: Requested vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:20.000977 25425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1263c7541b64286a507ee25aa8d9571" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
I20260709 12:08:20.001387 25574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1263c7541b64286a507ee25aa8d9571" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:20.001945 25574 raft_consensus.cc:3060] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.001893 25425 raft_consensus.cc:3055] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:20.002568 25425 raft_consensus.cc:740] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Running, Role: LEADER
I20260709 12:08:20.003566 25425 consensus_queue.cc:260] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:20.004866 25425 raft_consensus.cc:3060] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.007802 25574 raft_consensus.cc:2468] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 2.
I20260709 12:08:20.009025 25467 leader_election.cc:304] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63a331ccd01d463fb5569613ba13a187, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 
I20260709 12:08:20.009925 25695 raft_consensus.cc:2804] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:20.010531 25695 raft_consensus.cc:697] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 LEADER]: Becoming Leader. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Running, Role: LEADER
I20260709 12:08:20.010588 25425 raft_consensus.cc:2468] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 2.
I20260709 12:08:20.011546 25695 consensus_queue.cc:237] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:20.018436 25325 catalog_manager.cc:5697] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f reported cstate change: term changed from 1 to 2, leader changed from 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65) to abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66). New cstate: current_term: 2 leader_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:20.110291 25574 raft_consensus.cc:1275] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Refusing update from remote peer abdf95f659b14e17b4d98ba372cb3f1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.111572 25695 consensus_queue.cc:1048] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.120915 25425 raft_consensus.cc:1275] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Refusing update from remote peer abdf95f659b14e17b4d98ba372cb3f1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.122663 25714 consensus_queue.cc:1048] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.218336 25574 raft_consensus.cc:1275] T 298d4051223d4c35ad797749a2005e85 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Refusing update from remote peer abdf95f659b14e17b4d98ba372cb3f1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.219655 25695 consensus_queue.cc:1048] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.228701 25425 raft_consensus.cc:1275] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Refusing update from remote peer abdf95f659b14e17b4d98ba372cb3f1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.230903 25714 consensus_queue.cc:1048] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:20.315454 25500 raft_consensus.cc:1275] T 29403a2ca1794b3b80c5f51f2b56a401 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Refusing update from remote peer 63a331ccd01d463fb5569613ba13a187: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.316785 25626 consensus_queue.cc:1048] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.325047 25425 raft_consensus.cc:1275] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Refusing update from remote peer 63a331ccd01d463fb5569613ba13a187: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.329666 25718 consensus_queue.cc:1048] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.369982 25574 raft_consensus.cc:1275] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Refusing update from remote peer abdf95f659b14e17b4d98ba372cb3f1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.369987 25425 raft_consensus.cc:1275] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Refusing update from remote peer abdf95f659b14e17b4d98ba372cb3f1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.371634 25694 consensus_queue.cc:1048] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.372265 25714 consensus_queue.cc:1048] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.414628 25574 raft_consensus.cc:1275] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Refusing update from remote peer 5e65bf7f211d48d18829fde7ab0a60ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.415964 25699 consensus_queue.cc:1048] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.425377 25500 raft_consensus.cc:1275] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Refusing update from remote peer 5e65bf7f211d48d18829fde7ab0a60ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.427050 25628 consensus_queue.cc:1048] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.439143 25425 raft_consensus.cc:1275] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Refusing update from remote peer abdf95f659b14e17b4d98ba372cb3f1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.440833 25714 consensus_queue.cc:1048] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.450484 25574 raft_consensus.cc:1275] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Refusing update from remote peer abdf95f659b14e17b4d98ba372cb3f1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.451967 25714 consensus_queue.cc:1048] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:22.502601 25293 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:08:22.503402 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:22.524148 25425 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02e035521a0e44adb8664f0ab720bb8b"
dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
mode: GRACEFUL
new_leader_uuid: "63a331ccd01d463fb5569613ba13a187"
 from {username='slave'} at 127.0.0.1:40364
I20260709 12:08:22.524688 25425 raft_consensus.cc:606] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Received request to transfer leadership to TS 63a331ccd01d463fb5569613ba13a187
I20260709 12:08:22.536085 25502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926"
dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
mode: GRACEFUL
new_leader_uuid: "63a331ccd01d463fb5569613ba13a187"
 from {username='slave'} at 127.0.0.1:34280
I20260709 12:08:22.536688 25502 raft_consensus.cc:606] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 LEADER]: Received request to transfer leadership to TS 63a331ccd01d463fb5569613ba13a187
I20260709 12:08:22.537949 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:22.538516 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:22.553606 25691 raft_consensus.cc:993] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba: : Instructing follower 63a331ccd01d463fb5569613ba13a187 to start an election
I20260709 12:08:22.554126 25734 raft_consensus.cc:1081] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Signalling peer 63a331ccd01d463fb5569613ba13a187 to start an election
I20260709 12:08:22.556066 25577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02e035521a0e44adb8664f0ab720bb8b"
dest_uuid: "63a331ccd01d463fb5569613ba13a187"
 from {username='slave'} at 127.0.0.1:37292
I20260709 12:08:22.556708 25577 raft_consensus.cc:493] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:22.557071 25577 raft_consensus.cc:3060] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:22.562291 25577 raft_consensus.cc:515] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:22.564085 25577 leader_election.cc:290] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 2 election: Requested vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575)
I20260709 12:08:22.565246 25502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e035521a0e44adb8664f0ab720bb8b" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
I20260709 12:08:22.565246 25425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e035521a0e44adb8664f0ab720bb8b" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
I20260709 12:08:22.566099 25502 raft_consensus.cc:3060] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:22.566120 25425 raft_consensus.cc:3055] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:22.566725 25425 raft_consensus.cc:740] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Running, Role: LEADER
I20260709 12:08:22.567579 25425 consensus_queue.cc:260] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:22.568854 25425 raft_consensus.cc:3060] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:22.573621 25502 raft_consensus.cc:2468] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63a331ccd01d463fb5569613ba13a187 in term 2.
I20260709 12:08:22.575052 25540 leader_election.cc:304] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63a331ccd01d463fb5569613ba13a187, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 
I20260709 12:08:22.575829 25728 raft_consensus.cc:2804] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:22.575883 25425 raft_consensus.cc:2468] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63a331ccd01d463fb5569613ba13a187 in term 2.
I20260709 12:08:22.577298 25728 raft_consensus.cc:697] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [term 2 LEADER]: Becoming Leader. State: Replica: 63a331ccd01d463fb5569613ba13a187, State: Running, Role: LEADER
I20260709 12:08:22.578068 25728 consensus_queue.cc:237] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:22.586833 25323 catalog_manager.cc:5697] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 reported cstate change: term changed from 1 to 2, leader changed from 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65) to 63a331ccd01d463fb5569613ba13a187 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "63a331ccd01d463fb5569613ba13a187" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:22.647517 25741 raft_consensus.cc:993] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f: : Instructing follower 63a331ccd01d463fb5569613ba13a187 to start an election
I20260709 12:08:22.647989 25730 raft_consensus.cc:1081] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 LEADER]: Signalling peer 63a331ccd01d463fb5569613ba13a187 to start an election
I20260709 12:08:22.649605 25577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926"
dest_uuid: "63a331ccd01d463fb5569613ba13a187"
 from {username='slave'} at 127.0.0.1:37290
I20260709 12:08:22.650163 25577 raft_consensus.cc:493] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:22.650524 25577 raft_consensus.cc:3060] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.655426 25577 raft_consensus.cc:515] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:22.657248 25577 leader_election.cc:290] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 3 election: Requested vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575)
I20260709 12:08:22.658422 25502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
I20260709 12:08:22.658417 25425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
I20260709 12:08:22.659273 25502 raft_consensus.cc:3055] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:22.659312 25425 raft_consensus.cc:3060] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.659844 25502 raft_consensus.cc:740] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Running, Role: LEADER
I20260709 12:08:22.660748 25502 consensus_queue.cc:260] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:22.662060 25502 raft_consensus.cc:3060] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.667186 25425 raft_consensus.cc:2468] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63a331ccd01d463fb5569613ba13a187 in term 3.
I20260709 12:08:22.668586 25543 leader_election.cc:304] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, 63a331ccd01d463fb5569613ba13a187; no voters: 
I20260709 12:08:22.668922 25502 raft_consensus.cc:2468] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63a331ccd01d463fb5569613ba13a187 in term 3.
I20260709 12:08:22.669456 25728 raft_consensus.cc:2804] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:22.669951 25728 raft_consensus.cc:697] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 3 LEADER]: Becoming Leader. State: Replica: 63a331ccd01d463fb5569613ba13a187, State: Running, Role: LEADER
I20260709 12:08:22.670843 25728 consensus_queue.cc:237] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:22.677760 25323 catalog_manager.cc:5697] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 reported cstate change: term changed from 2 to 3, leader changed from abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66) to 63a331ccd01d463fb5569613ba13a187 (127.24.179.67). New cstate: current_term: 3 leader_uuid: "63a331ccd01d463fb5569613ba13a187" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:22.992009 25425 raft_consensus.cc:1275] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Refusing update from remote peer 63a331ccd01d463fb5569613ba13a187: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:22.993417 25728 consensus_queue.cc:1048] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:23.006434 25502 raft_consensus.cc:1275] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Refusing update from remote peer 63a331ccd01d463fb5569613ba13a187: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:23.008371 25745 consensus_queue.cc:1048] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:23.146633 25425 raft_consensus.cc:1275] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Refusing update from remote peer 63a331ccd01d463fb5569613ba13a187: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:23.147939 25735 consensus_queue.cc:1048] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:23.157325 25502 raft_consensus.cc:1275] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Refusing update from remote peer 63a331ccd01d463fb5569613ba13a187: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:23.159478 25728 consensus_queue.cc:1048] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:23.539660 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:23.544494 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:23.544889 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:24.545902 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:24.551604 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:24.552006 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:25.553184 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:25.559000 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:25.559401 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:26.560601 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:26.566738 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:26.567245 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:27.568344 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:27.573174 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:27.573742 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:28.574774 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:28.581327 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:28.581876 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:29.582970 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:29.589269 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:29.589740 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:30.590975 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:30.595867 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:30.596488 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:31.597692 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:31.602733 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:31.603212 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:32.636624 25293 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:08:32.641867 25427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4409906fca2d49c7b9e247556f7376e5"
dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
mode: GRACEFUL
new_leader_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
 from {username='slave'} at 127.0.0.1:40358
I20260709 12:08:32.642659 25427 raft_consensus.cc:606] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 LEADER]: Received request to transfer leadership to TS abdf95f659b14e17b4d98ba372cb3f1f
I20260709 12:08:32.648340 25427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25d52b113a784bf79866f1220037adc5"
dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
mode: GRACEFUL
new_leader_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
 from {username='slave'} at 127.0.0.1:40358
I20260709 12:08:32.648904 25427 raft_consensus.cc:606] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 LEADER]: Received request to transfer leadership to TS abdf95f659b14e17b4d98ba372cb3f1f
I20260709 12:08:32.654697 25427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31864e4fd2bb4861bccb7d60a5b5ed49"
dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
mode: GRACEFUL
new_leader_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
 from {username='slave'} at 127.0.0.1:40358
I20260709 12:08:32.655248 25427 raft_consensus.cc:606] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 LEADER]: Received request to transfer leadership to TS abdf95f659b14e17b4d98ba372cb3f1f
I20260709 12:08:32.660449 25577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02e035521a0e44adb8664f0ab720bb8b"
dest_uuid: "63a331ccd01d463fb5569613ba13a187"
mode: GRACEFUL
new_leader_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
 from {username='slave'} at 127.0.0.1:37308
I20260709 12:08:32.660981 25577 raft_consensus.cc:606] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [term 2 LEADER]: Received request to transfer leadership to TS abdf95f659b14e17b4d98ba372cb3f1f
I20260709 12:08:32.671890 25577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926"
dest_uuid: "63a331ccd01d463fb5569613ba13a187"
mode: GRACEFUL
new_leader_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
 from {username='slave'} at 127.0.0.1:37308
I20260709 12:08:32.672420 25577 raft_consensus.cc:606] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 3 LEADER]: Received request to transfer leadership to TS abdf95f659b14e17b4d98ba372cb3f1f
I20260709 12:08:32.723716 25763 raft_consensus.cc:993] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187: : Instructing follower abdf95f659b14e17b4d98ba372cb3f1f to start an election
I20260709 12:08:32.724332 25762 raft_consensus.cc:1081] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [term 2 LEADER]: Signalling peer abdf95f659b14e17b4d98ba372cb3f1f to start an election
I20260709 12:08:32.725957 25502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02e035521a0e44adb8664f0ab720bb8b"
dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
 from {username='slave'} at 127.0.0.1:34264
I20260709 12:08:32.726496 25502 raft_consensus.cc:493] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.726907 25502 raft_consensus.cc:3060] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.732556 25502 raft_consensus.cc:515] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:32.734195 25502 leader_election.cc:290] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 3 election: Requested vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:32.735357 25577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e035521a0e44adb8664f0ab720bb8b" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:32.735339 25427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02e035521a0e44adb8664f0ab720bb8b" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
I20260709 12:08:32.736142 25577 raft_consensus.cc:3055] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:32.736254 25427 raft_consensus.cc:3060] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.736443 25577 raft_consensus.cc:740] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63a331ccd01d463fb5569613ba13a187, State: Running, Role: LEADER
I20260709 12:08:32.737212 25577 consensus_queue.cc:260] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:32.738152 25577 raft_consensus.cc:3060] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.741585 25427 raft_consensus.cc:2468] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 3.
I20260709 12:08:32.742736 25577 raft_consensus.cc:2468] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 3.
I20260709 12:08:32.742862 25469 leader_election.cc:304] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 
I20260709 12:08:32.743794 25760 raft_consensus.cc:2804] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:32.744642 25760 raft_consensus.cc:697] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [term 3 LEADER]: Becoming Leader. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Running, Role: LEADER
I20260709 12:08:32.745548 25760 consensus_queue.cc:237] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:32.752744 25325 catalog_manager.cc:5697] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f reported cstate change: term changed from 2 to 3, leader changed from 63a331ccd01d463fb5569613ba13a187 (127.24.179.67) to abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66). New cstate: current_term: 3 leader_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:32.786793 25770 raft_consensus.cc:993] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba: : Instructing follower abdf95f659b14e17b4d98ba372cb3f1f to start an election
I20260709 12:08:32.787374 25758 raft_consensus.cc:1081] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 LEADER]: Signalling peer abdf95f659b14e17b4d98ba372cb3f1f to start an election
I20260709 12:08:32.789044 25502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25d52b113a784bf79866f1220037adc5"
dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
 from {username='slave'} at 127.0.0.1:34260
I20260709 12:08:32.789566 25502 raft_consensus.cc:493] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.789868 25502 raft_consensus.cc:3060] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.794369 25502 raft_consensus.cc:515] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:32.795965 25502 leader_election.cc:290] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 3 election: Requested vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:32.796988 25427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d52b113a784bf79866f1220037adc5" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
I20260709 12:08:32.797118 25577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d52b113a784bf79866f1220037adc5" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:32.797608 25427 raft_consensus.cc:3055] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:32.797674 25577 raft_consensus.cc:3060] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.797998 25427 raft_consensus.cc:740] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Running, Role: LEADER
I20260709 12:08:32.798852 25427 consensus_queue.cc:260] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:32.799916 25427 raft_consensus.cc:3060] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.802711 25577 raft_consensus.cc:2468] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 3.
I20260709 12:08:32.803894 25467 leader_election.cc:304] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63a331ccd01d463fb5569613ba13a187, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 
I20260709 12:08:32.804689 25760 raft_consensus.cc:2804] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:32.804919 25427 raft_consensus.cc:2468] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 3.
I20260709 12:08:32.805223 25760 raft_consensus.cc:697] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 LEADER]: Becoming Leader. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Running, Role: LEADER
I20260709 12:08:32.806149 25760 consensus_queue.cc:237] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:32.813594 25325 catalog_manager.cc:5697] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f reported cstate change: term changed from 2 to 3, leader changed from 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65) to abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66). New cstate: current_term: 3 leader_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:32.857017 25770 raft_consensus.cc:993] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba: : Instructing follower abdf95f659b14e17b4d98ba372cb3f1f to start an election
I20260709 12:08:32.857481 25758 raft_consensus.cc:1081] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 LEADER]: Signalling peer abdf95f659b14e17b4d98ba372cb3f1f to start an election
I20260709 12:08:32.859107 25502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31864e4fd2bb4861bccb7d60a5b5ed49"
dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
 from {username='slave'} at 127.0.0.1:34260
I20260709 12:08:32.859642 25502 raft_consensus.cc:493] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.859959 25502 raft_consensus.cc:3060] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.864702 25502 raft_consensus.cc:515] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:32.866313 25502 leader_election.cc:290] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 3 election: Requested vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:32.867200 25427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31864e4fd2bb4861bccb7d60a5b5ed49" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
I20260709 12:08:32.867391 25577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31864e4fd2bb4861bccb7d60a5b5ed49" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:32.867700 25427 raft_consensus.cc:3055] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:32.867970 25577 raft_consensus.cc:3060] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.867996 25427 raft_consensus.cc:740] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Running, Role: LEADER
I20260709 12:08:32.868808 25427 consensus_queue.cc:260] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:32.869669 25427 raft_consensus.cc:3060] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.872476 25577 raft_consensus.cc:2468] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 3.
I20260709 12:08:32.873554 25467 leader_election.cc:304] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63a331ccd01d463fb5569613ba13a187, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 
I20260709 12:08:32.873868 25427 raft_consensus.cc:2468] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 3.
I20260709 12:08:32.874342 25760 raft_consensus.cc:2804] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:32.874868 25760 raft_consensus.cc:697] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 LEADER]: Becoming Leader. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Running, Role: LEADER
I20260709 12:08:32.875686 25760 consensus_queue.cc:237] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:32.882186 25325 catalog_manager.cc:5697] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f reported cstate change: term changed from 2 to 3, leader changed from 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65) to abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66). New cstate: current_term: 3 leader_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:32.946261 25763 raft_consensus.cc:993] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187: : Instructing follower abdf95f659b14e17b4d98ba372cb3f1f to start an election
I20260709 12:08:32.946746 25762 raft_consensus.cc:1081] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 3 LEADER]: Signalling peer abdf95f659b14e17b4d98ba372cb3f1f to start an election
I20260709 12:08:32.948268 25502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926"
dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
 from {username='slave'} at 127.0.0.1:34264
I20260709 12:08:32.948750 25502 raft_consensus.cc:493] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.949044 25502 raft_consensus.cc:3060] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.953405 25502 raft_consensus.cc:515] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:32.954918 25502 leader_election.cc:290] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 4 election: Requested vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:32.955996 25427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
I20260709 12:08:32.956009 25577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:32.956808 25577 raft_consensus.cc:3055] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:32.956808 25427 raft_consensus.cc:3060] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.957309 25577 raft_consensus.cc:740] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 63a331ccd01d463fb5569613ba13a187, State: Running, Role: LEADER
I20260709 12:08:32.958133 25577 consensus_queue.cc:260] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:32.959342 25577 raft_consensus.cc:3060] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.963907 25427 raft_consensus.cc:2468] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 4.
I20260709 12:08:32.965116 25469 leader_election.cc:304] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 
I20260709 12:08:32.965708 25577 raft_consensus.cc:2468] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 4.
I20260709 12:08:32.965878 25760 raft_consensus.cc:2804] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:32.966496 25760 raft_consensus.cc:697] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 4 LEADER]: Becoming Leader. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Running, Role: LEADER
I20260709 12:08:32.967446 25760 consensus_queue.cc:237] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:32.974228 25325 catalog_manager.cc:5697] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f reported cstate change: term changed from 3 to 4, leader changed from 63a331ccd01d463fb5569613ba13a187 (127.24.179.67) to abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66). New cstate: current_term: 4 leader_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:33.010555 25770 raft_consensus.cc:993] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba: : Instructing follower abdf95f659b14e17b4d98ba372cb3f1f to start an election
I20260709 12:08:33.011039 25758 raft_consensus.cc:1081] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 LEADER]: Signalling peer abdf95f659b14e17b4d98ba372cb3f1f to start an election
I20260709 12:08:33.012625 25502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4409906fca2d49c7b9e247556f7376e5"
dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
 from {username='slave'} at 127.0.0.1:34260
I20260709 12:08:33.013113 25502 raft_consensus.cc:493] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:33.013402 25502 raft_consensus.cc:3060] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.017678 25502 raft_consensus.cc:515] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } }
I20260709 12:08:33.019312 25502 leader_election.cc:290] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 3 election: Requested vote from peers 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927), 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641)
I20260709 12:08:33.020128 25577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4409906fca2d49c7b9e247556f7376e5" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:33.020414 25427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4409906fca2d49c7b9e247556f7376e5" candidate_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
I20260709 12:08:33.020684 25577 raft_consensus.cc:3060] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.021046 25427 raft_consensus.cc:3055] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:33.021332 25427 raft_consensus.cc:740] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Running, Role: LEADER
I20260709 12:08:33.022097 25427 consensus_queue.cc:260] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } }
I20260709 12:08:33.023154 25427 raft_consensus.cc:3060] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.025592 25577 raft_consensus.cc:2468] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 3.
I20260709 12:08:33.026655 25467 leader_election.cc:304] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63a331ccd01d463fb5569613ba13a187, abdf95f659b14e17b4d98ba372cb3f1f; no voters: 
I20260709 12:08:33.027397 25760 raft_consensus.cc:2804] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:33.027804 25760 raft_consensus.cc:697] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 LEADER]: Becoming Leader. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Running, Role: LEADER
I20260709 12:08:33.027958 25427 raft_consensus.cc:2468] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abdf95f659b14e17b4d98ba372cb3f1f in term 3.
I20260709 12:08:33.028599 25760 consensus_queue.cc:237] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } }
I20260709 12:08:33.036727 25325 catalog_manager.cc:5697] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f reported cstate change: term changed from 2 to 3, leader changed from 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65) to abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66). New cstate: current_term: 3 leader_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:33.251551 25577 raft_consensus.cc:1275] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Refusing update from remote peer abdf95f659b14e17b4d98ba372cb3f1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.253244 25760 consensus_queue.cc:1048] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:33.265774 25427 raft_consensus.cc:1275] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Refusing update from remote peer abdf95f659b14e17b4d98ba372cb3f1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.267500 25779 consensus_queue.cc:1048] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:33.296643 25577 raft_consensus.cc:1275] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Refusing update from remote peer abdf95f659b14e17b4d98ba372cb3f1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.297920 25779 consensus_queue.cc:1048] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:33.307308 25427 raft_consensus.cc:1275] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Refusing update from remote peer abdf95f659b14e17b4d98ba372cb3f1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.309343 25779 consensus_queue.cc:1048] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:33.355322 25427 raft_consensus.cc:1275] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 4 FOLLOWER]: Refusing update from remote peer abdf95f659b14e17b4d98ba372cb3f1f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:33.356607 25779 consensus_queue.cc:1048] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:33.366746 25577 raft_consensus.cc:1275] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 4 FOLLOWER]: Refusing update from remote peer abdf95f659b14e17b4d98ba372cb3f1f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:33.368295 25779 consensus_queue.cc:1048] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:33.381830 25427 raft_consensus.cc:1275] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Refusing update from remote peer abdf95f659b14e17b4d98ba372cb3f1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.383069 25779 consensus_queue.cc:1048] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:33.391602 25577 raft_consensus.cc:1275] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Refusing update from remote peer abdf95f659b14e17b4d98ba372cb3f1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.393491 25779 consensus_queue.cc:1048] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:33.622685 25577 raft_consensus.cc:1275] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Refusing update from remote peer abdf95f659b14e17b4d98ba372cb3f1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.624061 25779 consensus_queue.cc:1048] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:33.633179 25427 raft_consensus.cc:1275] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Refusing update from remote peer abdf95f659b14e17b4d98ba372cb3f1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.634923 25778 consensus_queue.cc:1048] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:35.711721 25293 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:08:35.712770 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:35.721220 25502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25d52b113a784bf79866f1220037adc5"
dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
mode: GRACEFUL
new_leader_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
 from {username='slave'} at 127.0.0.1:34280
I20260709 12:08:35.721974 25502 raft_consensus.cc:606] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 LEADER]: Received request to transfer leadership to TS 5e65bf7f211d48d18829fde7ab0a60ba
I20260709 12:08:35.728260 25502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4409906fca2d49c7b9e247556f7376e5"
dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
mode: GRACEFUL
new_leader_uuid: "63a331ccd01d463fb5569613ba13a187"
 from {username='slave'} at 127.0.0.1:34280
I20260709 12:08:35.730189 25502 raft_consensus.cc:606] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 LEADER]: Received request to transfer leadership to TS 63a331ccd01d463fb5569613ba13a187
I20260709 12:08:35.735390 25502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "892869c2646b42028fdf458924a0ad16"
dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
mode: GRACEFUL
new_leader_uuid: "63a331ccd01d463fb5569613ba13a187"
 from {username='slave'} at 127.0.0.1:34280
I20260709 12:08:35.735996 25502 raft_consensus.cc:606] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 LEADER]: Received request to transfer leadership to TS 63a331ccd01d463fb5569613ba13a187
I20260709 12:08:35.739530 25502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926"
dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
mode: GRACEFUL
new_leader_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
 from {username='slave'} at 127.0.0.1:34280
I20260709 12:08:35.740231 25502 raft_consensus.cc:606] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 4 LEADER]: Received request to transfer leadership to TS 5e65bf7f211d48d18829fde7ab0a60ba
I20260709 12:08:35.743021 25502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1263c7541b64286a507ee25aa8d9571"
dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
mode: GRACEFUL
new_leader_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
 from {username='slave'} at 127.0.0.1:34280
I20260709 12:08:35.743616 25502 raft_consensus.cc:606] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 LEADER]: Received request to transfer leadership to TS 5e65bf7f211d48d18829fde7ab0a60ba
I20260709 12:08:35.744834 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:08:35.745479 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:35.760290 25778 raft_consensus.cc:993] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f: : Instructing follower 5e65bf7f211d48d18829fde7ab0a60ba to start an election
I20260709 12:08:35.760818 25792 raft_consensus.cc:1081] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 LEADER]: Signalling peer 5e65bf7f211d48d18829fde7ab0a60ba to start an election
I20260709 12:08:35.762599 25427 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1263c7541b64286a507ee25aa8d9571"
dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
 from {username='slave'} at 127.0.0.1:40336
I20260709 12:08:35.763204 25427 raft_consensus.cc:493] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.763562 25427 raft_consensus.cc:3060] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.769309 25427 raft_consensus.cc:515] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:35.771579 25427 leader_election.cc:290] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 3 election: Requested vote from peers abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:35.772646 25502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1263c7541b64286a507ee25aa8d9571" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
I20260709 12:08:35.773236 25577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1263c7541b64286a507ee25aa8d9571" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:35.773561 25502 raft_consensus.cc:3055] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:35.773790 25577 raft_consensus.cc:3060] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.773922 25502 raft_consensus.cc:740] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Running, Role: LEADER
I20260709 12:08:35.774928 25502 consensus_queue.cc:260] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:35.776288 25502 raft_consensus.cc:3060] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.780361 25577 raft_consensus.cc:2468] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 3.
I20260709 12:08:35.781852 25392 leader_election.cc:304] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, 63a331ccd01d463fb5569613ba13a187; no voters: 
I20260709 12:08:35.781980 25502 raft_consensus.cc:2468] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 3.
I20260709 12:08:35.783743 25793 raft_consensus.cc:2804] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:35.784626 25793 raft_consensus.cc:697] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 LEADER]: Becoming Leader. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Running, Role: LEADER
I20260709 12:08:35.785669 25793 consensus_queue.cc:237] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:35.792554 25325 catalog_manager.cc:5697] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba reported cstate change: term changed from 2 to 3, leader changed from abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66) to 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65). New cstate: current_term: 3 leader_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:35.991557 25778 raft_consensus.cc:993] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f: : Instructing follower 63a331ccd01d463fb5569613ba13a187 to start an election
I20260709 12:08:35.992072 25792 raft_consensus.cc:1081] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 LEADER]: Signalling peer 63a331ccd01d463fb5569613ba13a187 to start an election
I20260709 12:08:35.993769 25577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "892869c2646b42028fdf458924a0ad16"
dest_uuid: "63a331ccd01d463fb5569613ba13a187"
 from {username='slave'} at 127.0.0.1:37290
I20260709 12:08:35.994215 25577 raft_consensus.cc:493] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.994629 25577 raft_consensus.cc:3060] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.999414 25577 raft_consensus.cc:515] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:36.001355 25577 leader_election.cc:290] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 3 election: Requested vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575)
I20260709 12:08:36.002478 25427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "892869c2646b42028fdf458924a0ad16" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
I20260709 12:08:36.002554 25502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "892869c2646b42028fdf458924a0ad16" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
I20260709 12:08:36.003180 25427 raft_consensus.cc:3060] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:36.003281 25502 raft_consensus.cc:3055] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:36.004231 25502 raft_consensus.cc:740] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Running, Role: LEADER
I20260709 12:08:36.005079 25502 consensus_queue.cc:260] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:36.005997 25502 raft_consensus.cc:3060] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:36.009577 25427 raft_consensus.cc:2468] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63a331ccd01d463fb5569613ba13a187 in term 3.
I20260709 12:08:36.010689 25502 raft_consensus.cc:2468] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63a331ccd01d463fb5569613ba13a187 in term 3.
I20260709 12:08:36.010978 25543 leader_election.cc:304] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, 63a331ccd01d463fb5569613ba13a187; no voters: 
I20260709 12:08:36.012020 25790 raft_consensus.cc:2804] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:36.013188 25790 raft_consensus.cc:697] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 3 LEADER]: Becoming Leader. State: Replica: 63a331ccd01d463fb5569613ba13a187, State: Running, Role: LEADER
I20260709 12:08:36.014189 25790 consensus_queue.cc:237] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:36.021354 25325 catalog_manager.cc:5697] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 reported cstate change: term changed from 2 to 3, leader changed from abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66) to 63a331ccd01d463fb5569613ba13a187 (127.24.179.67). New cstate: current_term: 3 leader_uuid: "63a331ccd01d463fb5569613ba13a187" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:36.025104 25778 raft_consensus.cc:993] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f: : Instructing follower 5e65bf7f211d48d18829fde7ab0a60ba to start an election
I20260709 12:08:36.025600 25792 raft_consensus.cc:1081] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 LEADER]: Signalling peer 5e65bf7f211d48d18829fde7ab0a60ba to start an election
I20260709 12:08:36.027206 25427 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25d52b113a784bf79866f1220037adc5"
dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
 from {username='slave'} at 127.0.0.1:40336
I20260709 12:08:36.027791 25427 raft_consensus.cc:493] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:36.028163 25427 raft_consensus.cc:3060] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.033013 25427 raft_consensus.cc:515] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:36.034766 25427 leader_election.cc:290] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 4 election: Requested vote from peers abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:36.035920 25502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d52b113a784bf79866f1220037adc5" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
I20260709 12:08:36.036082 25577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d52b113a784bf79866f1220037adc5" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:36.036542 25502 raft_consensus.cc:3055] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:36.036612 25577 raft_consensus.cc:3060] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.036953 25502 raft_consensus.cc:740] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Running, Role: LEADER
I20260709 12:08:36.037724 25502 consensus_queue.cc:260] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:36.038661 25502 raft_consensus.cc:3060] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.041965 25577 raft_consensus.cc:2468] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 4.
I20260709 12:08:36.042804 25502 raft_consensus.cc:2468] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 4.
I20260709 12:08:36.043099 25392 leader_election.cc:304] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, 63a331ccd01d463fb5569613ba13a187; no voters: 
I20260709 12:08:36.043984 25793 raft_consensus.cc:2804] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:36.044431 25793 raft_consensus.cc:697] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 4 LEADER]: Becoming Leader. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Running, Role: LEADER
I20260709 12:08:36.045375 25793 consensus_queue.cc:237] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:36.052161 25325 catalog_manager.cc:5697] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba reported cstate change: term changed from 3 to 4, leader changed from abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66) to 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65). New cstate: current_term: 4 leader_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:36.121205 25778 raft_consensus.cc:993] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f: : Instructing follower 5e65bf7f211d48d18829fde7ab0a60ba to start an election
I20260709 12:08:36.121631 25792 raft_consensus.cc:1081] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 4 LEADER]: Signalling peer 5e65bf7f211d48d18829fde7ab0a60ba to start an election
I20260709 12:08:36.123289 25425 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926"
dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
 from {username='slave'} at 127.0.0.1:40336
I20260709 12:08:36.123759 25425 raft_consensus.cc:493] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:36.124022 25425 raft_consensus.cc:3060] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:36.128841 25425 raft_consensus.cc:515] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:36.130617 25425 leader_election.cc:290] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 5 election: Requested vote from peers abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575), 63a331ccd01d463fb5569613ba13a187 (127.24.179.67:44927)
I20260709 12:08:36.131377 25502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
I20260709 12:08:36.131654 25577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f874dc6c584199a8954d6f13fcc926" candidate_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "63a331ccd01d463fb5569613ba13a187"
I20260709 12:08:36.131884 25502 raft_consensus.cc:3055] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:08:36.132167 25577 raft_consensus.cc:3060] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:36.132184 25502 raft_consensus.cc:740] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Running, Role: LEADER
I20260709 12:08:36.133064 25502 consensus_queue.cc:260] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:36.133941 25502 raft_consensus.cc:3060] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:36.136736 25577 raft_consensus.cc:2468] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 5.
I20260709 12:08:36.137818 25392 leader_election.cc:304] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, 63a331ccd01d463fb5569613ba13a187; no voters: 
I20260709 12:08:36.138548 25502 raft_consensus.cc:2468] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e65bf7f211d48d18829fde7ab0a60ba in term 5.
I20260709 12:08:36.138679 25793 raft_consensus.cc:2804] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:08:36.139147 25793 raft_consensus.cc:697] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 5 LEADER]: Becoming Leader. State: Replica: 5e65bf7f211d48d18829fde7ab0a60ba, State: Running, Role: LEADER
I20260709 12:08:36.140067 25793 consensus_queue.cc:237] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } }
I20260709 12:08:36.146780 25325 catalog_manager.cc:5697] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba reported cstate change: term changed from 4 to 5, leader changed from abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66) to 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65). New cstate: current_term: 5 leader_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:36.202886 25577 raft_consensus.cc:1275] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Refusing update from remote peer 5e65bf7f211d48d18829fde7ab0a60ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.204200 25793 consensus_queue.cc:1048] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:36.215483 25502 raft_consensus.cc:1275] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Refusing update from remote peer 5e65bf7f211d48d18829fde7ab0a60ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.217034 25793 consensus_queue.cc:1048] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:36.296061 25778 raft_consensus.cc:993] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f: : Instructing follower 63a331ccd01d463fb5569613ba13a187 to start an election
I20260709 12:08:36.296506 25792 raft_consensus.cc:1081] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 LEADER]: Signalling peer 63a331ccd01d463fb5569613ba13a187 to start an election
I20260709 12:08:36.298166 25577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4409906fca2d49c7b9e247556f7376e5"
dest_uuid: "63a331ccd01d463fb5569613ba13a187"
 from {username='slave'} at 127.0.0.1:37290
I20260709 12:08:36.298668 25577 raft_consensus.cc:493] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:36.298956 25577 raft_consensus.cc:3060] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.303627 25577 raft_consensus.cc:515] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } }
I20260709 12:08:36.305174 25577 leader_election.cc:290] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 4 election: Requested vote from peers 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641), abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575)
I20260709 12:08:36.306088 25502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4409906fca2d49c7b9e247556f7376e5" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "abdf95f659b14e17b4d98ba372cb3f1f"
I20260709 12:08:36.306085 25425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4409906fca2d49c7b9e247556f7376e5" candidate_uuid: "63a331ccd01d463fb5569613ba13a187" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5e65bf7f211d48d18829fde7ab0a60ba"
I20260709 12:08:36.306746 25502 raft_consensus.cc:3055] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:36.306797 25425 raft_consensus.cc:3060] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.307026 25502 raft_consensus.cc:740] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abdf95f659b14e17b4d98ba372cb3f1f, State: Running, Role: LEADER
I20260709 12:08:36.307823 25502 consensus_queue.cc:260] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } }
I20260709 12:08:36.308718 25502 raft_consensus.cc:3060] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.312573 25425 raft_consensus.cc:2468] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63a331ccd01d463fb5569613ba13a187 in term 4.
I20260709 12:08:36.313206 25502 raft_consensus.cc:2468] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63a331ccd01d463fb5569613ba13a187 in term 4.
I20260709 12:08:36.313721 25543 leader_election.cc:304] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e65bf7f211d48d18829fde7ab0a60ba, 63a331ccd01d463fb5569613ba13a187; no voters: 
I20260709 12:08:36.314554 25790 raft_consensus.cc:2804] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:36.314989 25790 raft_consensus.cc:697] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [term 4 LEADER]: Becoming Leader. State: Replica: 63a331ccd01d463fb5569613ba13a187, State: Running, Role: LEADER
I20260709 12:08:36.315899 25790 consensus_queue.cc:237] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } }
I20260709 12:08:36.323706 25322 catalog_manager.cc:5697] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 reported cstate change: term changed from 3 to 4, leader changed from abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66) to 63a331ccd01d463fb5569613ba13a187 (127.24.179.67). New cstate: current_term: 4 leader_uuid: "63a331ccd01d463fb5569613ba13a187" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:36.414930 25502 raft_consensus.cc:1275] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Refusing update from remote peer 63a331ccd01d463fb5569613ba13a187: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.416141 25790 consensus_queue.cc:1048] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:36.427268 25425 raft_consensus.cc:1275] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Refusing update from remote peer 63a331ccd01d463fb5569613ba13a187: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.428947 25502 raft_consensus.cc:1275] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 4 FOLLOWER]: Refusing update from remote peer 5e65bf7f211d48d18829fde7ab0a60ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:36.429222 25800 consensus_queue.cc:1048] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:36.431572 25793 consensus_queue.cc:1048] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:36.446080 25577 raft_consensus.cc:1275] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 4 FOLLOWER]: Refusing update from remote peer 5e65bf7f211d48d18829fde7ab0a60ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:36.447808 25793 consensus_queue.cc:1048] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:36.541620 25502 raft_consensus.cc:1275] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 5 FOLLOWER]: Refusing update from remote peer 5e65bf7f211d48d18829fde7ab0a60ba: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:36.543107 25793 consensus_queue.cc:1048] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:36.552896 25577 raft_consensus.cc:1275] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 5 FOLLOWER]: Refusing update from remote peer 5e65bf7f211d48d18829fde7ab0a60ba: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:36.554715 25814 consensus_queue.cc:1048] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a331ccd01d463fb5569613ba13a187" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:08:36.707839 25502 raft_consensus.cc:1275] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 4 FOLLOWER]: Refusing update from remote peer 63a331ccd01d463fb5569613ba13a187: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:36.709164 25811 consensus_queue.cc:1048] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abdf95f659b14e17b4d98ba372cb3f1f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:36.718828 25427 raft_consensus.cc:1275] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 4 FOLLOWER]: Refusing update from remote peer 63a331ccd01d463fb5569613ba13a187: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:36.720233 25790 consensus_queue.cc:1048] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e65bf7f211d48d18829fde7ab0a60ba" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:36.746927 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:36.751959 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:36.752430 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:37.753472 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:37.758522 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:37.758987 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:38.760005 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:38.765900 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:38.766386 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:39.767508 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:39.775678 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:39.776268 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:40.777486 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:40.784505 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:40.785168 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:41.786381 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:41.791889 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:41.792472 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:42.793727 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:42.798843 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:42.799260 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:43.800325 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:43.806936 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:43.807349 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:44.808413 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:44.814235 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:44.814720 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:45.849093 25293 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:08:45.849713 25293 tablet_server.cc:179] TabletServer@127.24.179.65:0 shutting down...
I20260709 12:08:45.881590 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:45.882519 25293 tablet_replica.cc:333] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba: stopping tablet replica
I20260709 12:08:45.883354 25293 raft_consensus.cc:2243] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.884006 25293 raft_consensus.cc:2272] T 29403a2ca1794b3b80c5f51f2b56a401 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.886749 25293 tablet_replica.cc:333] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba: stopping tablet replica
I20260709 12:08:45.887288 25293 raft_consensus.cc:2243] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.888128 25293 raft_consensus.cc:2272] T e1263c7541b64286a507ee25aa8d9571 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.889916 25293 tablet_replica.cc:333] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba: stopping tablet replica
I20260709 12:08:45.890534 25293 raft_consensus.cc:2243] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.891183 25293 raft_consensus.cc:2272] T 298d4051223d4c35ad797749a2005e85 P 5e65bf7f211d48d18829fde7ab0a60ba [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:45.893200 25543 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:08:45.893870 25293 tablet_replica.cc:333] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba: stopping tablet replica
I20260709 12:08:45.894546 25293 raft_consensus.cc:2243] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.895094 25293 raft_consensus.cc:2272] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:45.897083 25543 consensus_peers.cc:597] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 -> Peer 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641): Couldn't send request to peer 5e65bf7f211d48d18829fde7ab0a60ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:45.897459 25293 tablet_replica.cc:333] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba: stopping tablet replica
I20260709 12:08:45.898017 25293 raft_consensus.cc:2243] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.898981 25293 raft_consensus.cc:2272] T 99f874dc6c584199a8954d6f13fcc926 P 5e65bf7f211d48d18829fde7ab0a60ba [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.900802 25293 tablet_replica.cc:333] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba: stopping tablet replica
I20260709 12:08:45.901352 25293 raft_consensus.cc:2243] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.901880 25293 raft_consensus.cc:2272] T 892869c2646b42028fdf458924a0ad16 P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.904357 25293 tablet_replica.cc:333] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba: stopping tablet replica
I20260709 12:08:45.904932 25293 raft_consensus.cc:2243] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.905810 25293 raft_consensus.cc:2272] T 25d52b113a784bf79866f1220037adc5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.907971 25293 tablet_replica.cc:333] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba: stopping tablet replica
I20260709 12:08:45.908519 25293 raft_consensus.cc:2243] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.909027 25293 raft_consensus.cc:2272] T 4409906fca2d49c7b9e247556f7376e5 P 5e65bf7f211d48d18829fde7ab0a60ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.910885 25293 tablet_replica.cc:333] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba: stopping tablet replica
I20260709 12:08:45.911429 25293 raft_consensus.cc:2243] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.911986 25293 raft_consensus.cc:2272] T 02e035521a0e44adb8664f0ab720bb8b P 5e65bf7f211d48d18829fde7ab0a60ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.018198 25293 tablet_server.cc:196] TabletServer@127.24.179.65:0 shutdown complete.
W20260709 12:08:46.019663 25469 consensus_peers.cc:597] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f -> Peer 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641): Couldn't send request to peer 5e65bf7f211d48d18829fde7ab0a60ba. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:36641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:46.031230 25543 consensus_peers.cc:597] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 -> Peer 5e65bf7f211d48d18829fde7ab0a60ba (127.24.179.65:36641): Couldn't send request to peer 5e65bf7f211d48d18829fde7ab0a60ba. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:36641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:46.041443 25293 tablet_server.cc:179] TabletServer@127.24.179.66:0 shutting down...
I20260709 12:08:46.074216 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:46.075090 25293 tablet_replica.cc:333] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f: stopping tablet replica
I20260709 12:08:46.076037 25293 raft_consensus.cc:2243] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.077003 25293 raft_consensus.cc:2272] T 298d4051223d4c35ad797749a2005e85 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.079074 25293 tablet_replica.cc:333] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f: stopping tablet replica
I20260709 12:08:46.079698 25293 raft_consensus.cc:2243] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.080236 25293 raft_consensus.cc:2272] T e1263c7541b64286a507ee25aa8d9571 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.082099 25293 tablet_replica.cc:333] T 29403a2ca1794b3b80c5f51f2b56a401 P abdf95f659b14e17b4d98ba372cb3f1f: stopping tablet replica
I20260709 12:08:46.082695 25293 raft_consensus.cc:2243] T 29403a2ca1794b3b80c5f51f2b56a401 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.083249 25293 raft_consensus.cc:2272] T 29403a2ca1794b3b80c5f51f2b56a401 P abdf95f659b14e17b4d98ba372cb3f1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.085373 25293 tablet_replica.cc:333] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f: stopping tablet replica
I20260709 12:08:46.085912 25293 raft_consensus.cc:2243] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.086381 25293 raft_consensus.cc:2272] T 99f874dc6c584199a8954d6f13fcc926 P abdf95f659b14e17b4d98ba372cb3f1f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.088263 25293 tablet_replica.cc:333] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f: stopping tablet replica
I20260709 12:08:46.088789 25293 raft_consensus.cc:2243] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.089624 25293 raft_consensus.cc:2272] T 31864e4fd2bb4861bccb7d60a5b5ed49 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.091567 25293 tablet_replica.cc:333] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f: stopping tablet replica
I20260709 12:08:46.092094 25293 raft_consensus.cc:2243] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.092953 25293 raft_consensus.cc:2272] T 02e035521a0e44adb8664f0ab720bb8b P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.094871 25293 tablet_replica.cc:333] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f: stopping tablet replica
I20260709 12:08:46.095379 25293 raft_consensus.cc:2243] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.095808 25293 raft_consensus.cc:2272] T 892869c2646b42028fdf458924a0ad16 P abdf95f659b14e17b4d98ba372cb3f1f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.097404 25293 tablet_replica.cc:333] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f: stopping tablet replica
I20260709 12:08:46.097903 25293 raft_consensus.cc:2243] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.098347 25293 raft_consensus.cc:2272] T 25d52b113a784bf79866f1220037adc5 P abdf95f659b14e17b4d98ba372cb3f1f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.100152 25293 tablet_replica.cc:333] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f: stopping tablet replica
I20260709 12:08:46.100554 25293 raft_consensus.cc:2243] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.100936 25293 raft_consensus.cc:2272] T 4409906fca2d49c7b9e247556f7376e5 P abdf95f659b14e17b4d98ba372cb3f1f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.129479 25293 tablet_server.cc:196] TabletServer@127.24.179.66:0 shutdown complete.
W20260709 12:08:46.137274 25540 consensus_peers.cc:597] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 -> Peer abdf95f659b14e17b4d98ba372cb3f1f (127.24.179.66:46575): Couldn't send request to peer abdf95f659b14e17b4d98ba372cb3f1f. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:46575: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:46.149127 25293 tablet_server.cc:179] TabletServer@127.24.179.67:0 shutting down...
I20260709 12:08:46.179270 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:46.180099 25293 tablet_replica.cc:333] T 298d4051223d4c35ad797749a2005e85 P 63a331ccd01d463fb5569613ba13a187: stopping tablet replica
I20260709 12:08:46.180716 25293 raft_consensus.cc:2243] T 298d4051223d4c35ad797749a2005e85 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.181164 25293 raft_consensus.cc:2272] T 298d4051223d4c35ad797749a2005e85 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.183010 25293 tablet_replica.cc:333] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187: stopping tablet replica
I20260709 12:08:46.183532 25293 raft_consensus.cc:2243] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.184000 25293 raft_consensus.cc:2272] T 99f874dc6c584199a8954d6f13fcc926 P 63a331ccd01d463fb5569613ba13a187 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.185839 25293 tablet_replica.cc:333] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187: stopping tablet replica
I20260709 12:08:46.186326 25293 raft_consensus.cc:2243] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.186884 25293 raft_consensus.cc:2272] T 31864e4fd2bb4861bccb7d60a5b5ed49 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.188730 25293 tablet_replica.cc:333] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187: stopping tablet replica
I20260709 12:08:46.189267 25293 raft_consensus.cc:2243] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.190109 25293 raft_consensus.cc:2272] T 29403a2ca1794b3b80c5f51f2b56a401 P 63a331ccd01d463fb5569613ba13a187 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.192099 25293 tablet_replica.cc:333] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187: stopping tablet replica
I20260709 12:08:46.192633 25293 raft_consensus.cc:2243] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.193104 25293 raft_consensus.cc:2272] T e1263c7541b64286a507ee25aa8d9571 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.194931 25293 tablet_replica.cc:333] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187: stopping tablet replica
I20260709 12:08:46.195441 25293 raft_consensus.cc:2243] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.196245 25293 raft_consensus.cc:2272] T 892869c2646b42028fdf458924a0ad16 P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.197966 25293 tablet_replica.cc:333] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187: stopping tablet replica
I20260709 12:08:46.198547 25293 raft_consensus.cc:2243] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.199375 25293 raft_consensus.cc:2272] T 4409906fca2d49c7b9e247556f7376e5 P 63a331ccd01d463fb5569613ba13a187 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.201161 25293 tablet_replica.cc:333] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187: stopping tablet replica
I20260709 12:08:46.201642 25293 raft_consensus.cc:2243] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.202159 25293 raft_consensus.cc:2272] T 25d52b113a784bf79866f1220037adc5 P 63a331ccd01d463fb5569613ba13a187 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.203913 25293 tablet_replica.cc:333] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187: stopping tablet replica
I20260709 12:08:46.204397 25293 raft_consensus.cc:2243] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.204836 25293 raft_consensus.cc:2272] T 02e035521a0e44adb8664f0ab720bb8b P 63a331ccd01d463fb5569613ba13a187 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.232775 25293 tablet_server.cc:196] TabletServer@127.24.179.67:0 shutdown complete.
I20260709 12:08:46.250989 25293 master.cc:562] Master@127.24.179.126:35377 shutting down...
I20260709 12:08:46.465646 25293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.466348 25293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.466791 25293 tablet_replica.cc:333] T 00000000000000000000000000000000 P 647a5efb921945c2a88611d8854e483f: stopping tablet replica
I20260709 12:08:46.487381 25293 master.cc:584] Master@127.24.179.126:35377 shutdown complete.
5e65bf7f211d48d18829fde7ab0a60ba  4
63a331ccd01d463fb5569613ba13a187  1
abdf95f659b14e17b4d98ba372cb3f1f  4
5e65bf7f211d48d18829fde7ab0a60ba  3
63a331ccd01d463fb5569613ba13a187  3
abdf95f659b14e17b4d98ba372cb3f1f  3
5e65bf7f211d48d18829fde7ab0a60ba  0
63a331ccd01d463fb5569613ba13a187  1
abdf95f659b14e17b4d98ba372cb3f1f  8
5e65bf7f211d48d18829fde7ab0a60ba  3
63a331ccd01d463fb5569613ba13a187  3
abdf95f659b14e17b4d98ba372cb3f1f  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31522 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:08:46.528620 25293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.179.126:40167
I20260709 12:08:46.529819 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:46.535380 25831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.537084 25834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.537231 25832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.537595 25293 server_base.cc:1061] running on GCE node
I20260709 12:08:46.538715 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:46.538901 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:46.539095 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783598926539074 us; error 0 us; skew 500 ppm
I20260709 12:08:46.539701 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:46.542181 25293 webserver.cc:533] Webserver started at http://127.24.179.126:39861/ using document root <none> and password file <none>
I20260709 12:08:46.542737 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:46.542941 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:46.543251 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:46.544466 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894834136-25293-0/minicluster-data/master-0-root/instance:
uuid: "60917f5e97a7454fabcf94b5f6fe0af9"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-tjfs"
I20260709 12:08:46.549239 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:08:46.552804 25839 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.553697 25293 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.001s
I20260709 12:08:46.553956 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894834136-25293-0/minicluster-data/master-0-root
uuid: "60917f5e97a7454fabcf94b5f6fe0af9"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-tjfs"
I20260709 12:08:46.554222 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894834136-25293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894834136-25293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894834136-25293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:46.564146 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:46.565335 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:46.605019 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.126:40167
I20260709 12:08:46.605139 25890 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.126:40167 every 8 connection(s)
I20260709 12:08:46.609455 25891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.620064 25891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9: Bootstrap starting.
I20260709 12:08:46.625128 25891 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.629542 25891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9: No bootstrap required, opened a new log
I20260709 12:08:46.631855 25891 raft_consensus.cc:359] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60917f5e97a7454fabcf94b5f6fe0af9" member_type: VOTER }
I20260709 12:08:46.632308 25891 raft_consensus.cc:385] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.632496 25891 raft_consensus.cc:740] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60917f5e97a7454fabcf94b5f6fe0af9, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.633023 25891 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60917f5e97a7454fabcf94b5f6fe0af9" member_type: VOTER }
I20260709 12:08:46.633445 25891 raft_consensus.cc:399] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:46.633663 25891 raft_consensus.cc:493] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:46.633884 25891 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.637961 25891 raft_consensus.cc:515] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60917f5e97a7454fabcf94b5f6fe0af9" member_type: VOTER }
I20260709 12:08:46.638706 25891 leader_election.cc:304] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 60917f5e97a7454fabcf94b5f6fe0af9; no voters: 
I20260709 12:08:46.639967 25891 leader_election.cc:290] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:46.640404 25894 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:46.641840 25894 raft_consensus.cc:697] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9 [term 1 LEADER]: Becoming Leader. State: Replica: 60917f5e97a7454fabcf94b5f6fe0af9, State: Running, Role: LEADER
I20260709 12:08:46.642606 25894 consensus_queue.cc:237] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60917f5e97a7454fabcf94b5f6fe0af9" member_type: VOTER }
I20260709 12:08:46.643151 25891 sys_catalog.cc:565] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:46.647701 25895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "60917f5e97a7454fabcf94b5f6fe0af9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60917f5e97a7454fabcf94b5f6fe0af9" member_type: VOTER } }
I20260709 12:08:46.647933 25896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60917f5e97a7454fabcf94b5f6fe0af9. Latest consensus state: current_term: 1 leader_uuid: "60917f5e97a7454fabcf94b5f6fe0af9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60917f5e97a7454fabcf94b5f6fe0af9" member_type: VOTER } }
I20260709 12:08:46.648403 25895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:46.648419 25896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:46.652326 25901 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:46.660930 25901 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:46.662063 25293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:46.671412 25901 catalog_manager.cc:1383] Generated new cluster ID: 6de9bf58ab934e9b94971e75bb1ffc18
I20260709 12:08:46.671693 25901 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:46.691512 25901 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:46.692929 25901 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:46.705880 25901 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9: Generated new TSK 0
I20260709 12:08:46.706583 25901 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:46.728816 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:46.735193 25912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.736501 25913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.739069 25915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.739120 25293 server_base.cc:1061] running on GCE node
I20260709 12:08:46.740336 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:46.740576 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:46.740748 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783598926740727 us; error 0 us; skew 500 ppm
I20260709 12:08:46.741298 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:46.743799 25293 webserver.cc:533] Webserver started at http://127.24.179.65:40895/ using document root <none> and password file <none>
I20260709 12:08:46.744355 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:46.744587 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:46.744886 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:46.746018 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894834136-25293-0/minicluster-data/ts-0-root/instance:
uuid: "0377e4c589564e739a0bba757431dcdd"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-tjfs"
I20260709 12:08:46.750890 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:08:46.754710 25920 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.755615 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:08:46.755951 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894834136-25293-0/minicluster-data/ts-0-root
uuid: "0377e4c589564e739a0bba757431dcdd"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-tjfs"
I20260709 12:08:46.756340 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894834136-25293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894834136-25293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894834136-25293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:46.775432 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:46.776734 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:46.778271 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:46.780822 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:46.781088 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.781364 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:46.781569 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.825307 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.65:43227
I20260709 12:08:46.825395 25982 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.65:43227 every 8 connection(s)
I20260709 12:08:46.830528 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:46.838313 25987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.840108 25988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.843147 25990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.844689 25983 heartbeater.cc:344] Connected to a master server at 127.24.179.126:40167
I20260709 12:08:46.844717 25293 server_base.cc:1061] running on GCE node
I20260709 12:08:46.845219 25983 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:46.845997 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:46.846216 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:46.846108 25983 heartbeater.cc:507] Master 127.24.179.126:40167 requested a full tablet report, sending...
I20260709 12:08:46.846570 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783598926846545 us; error 0 us; skew 500 ppm
I20260709 12:08:46.847184 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:46.848893 25856 ts_manager.cc:194] Registered new tserver with Master: 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227)
I20260709 12:08:46.849898 25293 webserver.cc:533] Webserver started at http://127.24.179.66:38465/ using document root <none> and password file <none>
I20260709 12:08:46.850517 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:46.850740 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:46.851032 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:46.851042 25856 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53124
I20260709 12:08:46.852406 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894834136-25293-0/minicluster-data/ts-1-root/instance:
uuid: "efc868618423419db4b805b6c69a88f8"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-tjfs"
I20260709 12:08:46.858361 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:08:46.862370 25995 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.863463 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 12:08:46.863775 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894834136-25293-0/minicluster-data/ts-1-root
uuid: "efc868618423419db4b805b6c69a88f8"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-tjfs"
I20260709 12:08:46.864060 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894834136-25293-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894834136-25293-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894834136-25293-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:46.884001 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:46.885242 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:46.886817 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:46.889178 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:46.889370 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.889680 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:46.889847 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.930720 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.66:44223
I20260709 12:08:46.930816 26057 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.66:44223 every 8 connection(s)
I20260709 12:08:46.935662 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:46.943151 26061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.944202 26062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.947032 26064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.948361 25293 server_base.cc:1061] running on GCE node
I20260709 12:08:46.949244 26058 heartbeater.cc:344] Connected to a master server at 127.24.179.126:40167
I20260709 12:08:46.949636 26058 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:46.949834 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:46.950099 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:46.950292 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783598926950256 us; error 0 us; skew 500 ppm
I20260709 12:08:46.950587 26058 heartbeater.cc:507] Master 127.24.179.126:40167 requested a full tablet report, sending...
I20260709 12:08:46.951020 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:46.953200 25856 ts_manager.cc:194] Registered new tserver with Master: efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223)
I20260709 12:08:46.954171 25293 webserver.cc:533] Webserver started at http://127.24.179.67:43369/ using document root <none> and password file <none>
I20260709 12:08:46.954879 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:46.955124 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:46.955299 25856 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53138
I20260709 12:08:46.955454 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:46.957161 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894834136-25293-0/minicluster-data/ts-2-root/instance:
uuid: "55a3a2c2e13946209305e725c47fab94"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-tjfs"
I20260709 12:08:46.962189 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.005s
I20260709 12:08:46.965965 26069 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.967026 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:08:46.967344 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894834136-25293-0/minicluster-data/ts-2-root
uuid: "55a3a2c2e13946209305e725c47fab94"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-tjfs"
I20260709 12:08:46.967597 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894834136-25293-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894834136-25293-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894834136-25293-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:46.980195 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:46.981429 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:46.983116 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:46.985491 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:46.985726 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.986006 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:46.986200 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.025772 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.67:42175
I20260709 12:08:47.025856 26131 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.67:42175 every 8 connection(s)
I20260709 12:08:47.040712 26132 heartbeater.cc:344] Connected to a master server at 127.24.179.126:40167
I20260709 12:08:47.041165 26132 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:47.041977 26132 heartbeater.cc:507] Master 127.24.179.126:40167 requested a full tablet report, sending...
I20260709 12:08:47.044222 25856 ts_manager.cc:194] Registered new tserver with Master: 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:08:47.044854 25293 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015939784s
I20260709 12:08:47.045763 25856 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53142
I20260709 12:08:47.072006 25856 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53156:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:47.075146 25856 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:47.146312 26097 tablet_service.cc:1511] Processing CreateTablet for tablet 444afdba57744ac6ac09fccdd0418fca (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:47.148156 26097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 444afdba57744ac6ac09fccdd0418fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.157524 26096 tablet_service.cc:1511] Processing CreateTablet for tablet 69753740148d474ca373a75492f69c82 (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:47.159443 26096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69753740148d474ca373a75492f69c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.164623 26095 tablet_service.cc:1511] Processing CreateTablet for tablet 5a82be63df514556be057c830c06e2eb (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:47.166215 26095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a82be63df514556be057c830c06e2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.169189 25948 tablet_service.cc:1511] Processing CreateTablet for tablet 444afdba57744ac6ac09fccdd0418fca (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:47.170859 25948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 444afdba57744ac6ac09fccdd0418fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.171317 26094 tablet_service.cc:1511] Processing CreateTablet for tablet a7e1bba4da21410685f7001aa07bfca5 (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:47.172149 25945 tablet_service.cc:1511] Processing CreateTablet for tablet a7e1bba4da21410685f7001aa07bfca5 (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:47.172910 26094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e1bba4da21410685f7001aa07bfca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.174306 25945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e1bba4da21410685f7001aa07bfca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.176749 25946 tablet_service.cc:1511] Processing CreateTablet for tablet 5a82be63df514556be057c830c06e2eb (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:47.192642 25946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a82be63df514556be057c830c06e2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.178817 25947 tablet_service.cc:1511] Processing CreateTablet for tablet 69753740148d474ca373a75492f69c82 (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:47.195160 25947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69753740148d474ca373a75492f69c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.197224 26147 tablet_bootstrap.cc:492] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd: Bootstrap starting.
I20260709 12:08:47.229773 25948 tablet_service.cc:1511] Processing CreateTablet for tablet d494488b914e40ddb30ce096a17593d7 (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:47.231384 25948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d494488b914e40ddb30ce096a17593d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.242138 26093 tablet_service.cc:1511] Processing CreateTablet for tablet d494488b914e40ddb30ce096a17593d7 (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:47.243698 26093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d494488b914e40ddb30ce096a17593d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.245362 25946 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4404e44e814753b1da44e2d750857f (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:47.247107 25946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4404e44e814753b1da44e2d750857f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.250675 26092 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4404e44e814753b1da44e2d750857f (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:47.252321 26092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4404e44e814753b1da44e2d750857f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.254873 26147 tablet_bootstrap.cc:654] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.268699 25945 tablet_service.cc:1511] Processing CreateTablet for tablet d4c07440e5674cd4b07a3d2c3a353a8b (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:47.269927 26023 tablet_service.cc:1511] Processing CreateTablet for tablet 444afdba57744ac6ac09fccdd0418fca (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:47.271469 26023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 444afdba57744ac6ac09fccdd0418fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.271348 26018 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4404e44e814753b1da44e2d750857f (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:47.272845 26018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4404e44e814753b1da44e2d750857f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.275774 26022 tablet_service.cc:1511] Processing CreateTablet for tablet 69753740148d474ca373a75492f69c82 (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:47.276803 26017 tablet_service.cc:1511] Processing CreateTablet for tablet d4c07440e5674cd4b07a3d2c3a353a8b (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:47.277343 26022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69753740148d474ca373a75492f69c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.278252 26017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4c07440e5674cd4b07a3d2c3a353a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.279451 26021 tablet_service.cc:1511] Processing CreateTablet for tablet 5a82be63df514556be057c830c06e2eb (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:47.280943 26021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a82be63df514556be057c830c06e2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.283794 26020 tablet_service.cc:1511] Processing CreateTablet for tablet a7e1bba4da21410685f7001aa07bfca5 (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:47.285400 26020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e1bba4da21410685f7001aa07bfca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.270339 25945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4c07440e5674cd4b07a3d2c3a353a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.288832 26019 tablet_service.cc:1511] Processing CreateTablet for tablet d494488b914e40ddb30ce096a17593d7 (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:47.292114 26019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d494488b914e40ddb30ce096a17593d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.287426 26091 tablet_service.cc:1511] Processing CreateTablet for tablet d4c07440e5674cd4b07a3d2c3a353a8b (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:47.295959 26091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4c07440e5674cd4b07a3d2c3a353a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.315135 25948 tablet_service.cc:1511] Processing CreateTablet for tablet 0e0798b624814b23ba96d2361b4961aa (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:47.316632 25948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e0798b624814b23ba96d2361b4961aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.326557 26150 tablet_bootstrap.cc:492] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8: Bootstrap starting.
I20260709 12:08:47.335386 26150 tablet_bootstrap.cc:654] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.352615 26147 tablet_bootstrap.cc:492] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd: No bootstrap required, opened a new log
I20260709 12:08:47.353318 26147 ts_tablet_manager.cc:1403] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd: Time spent bootstrapping tablet: real 0.157s	user 0.042s	sys 0.016s
I20260709 12:08:47.356678 26147 raft_consensus.cc:359] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } }
I20260709 12:08:47.357604 26147 raft_consensus.cc:385] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.358165 26147 raft_consensus.cc:740] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.359081 26148 tablet_bootstrap.cc:492] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94: Bootstrap starting.
I20260709 12:08:47.359436 26147 consensus_queue.cc:260] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } }
I20260709 12:08:47.365324 26017 tablet_service.cc:1511] Processing CreateTablet for tablet 0e0798b624814b23ba96d2361b4961aa (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:47.366808 26017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e0798b624814b23ba96d2361b4961aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.380020 26148 tablet_bootstrap.cc:654] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.380621 26092 tablet_service.cc:1511] Processing CreateTablet for tablet 0e0798b624814b23ba96d2361b4961aa (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:47.382175 26092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e0798b624814b23ba96d2361b4961aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.386583 25948 tablet_service.cc:1511] Processing CreateTablet for tablet 87545e0697f64558a1918d9dafd04b1f (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:47.390667 25948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87545e0697f64558a1918d9dafd04b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.390950 25945 tablet_service.cc:1511] Processing CreateTablet for tablet 101efc883fed47bc9c7bfabb594c138e (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:47.391063 26097 tablet_service.cc:1511] Processing CreateTablet for tablet 87545e0697f64558a1918d9dafd04b1f (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:47.392290 25945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 101efc883fed47bc9c7bfabb594c138e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.392488 26097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87545e0697f64558a1918d9dafd04b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.392556 26147 ts_tablet_manager.cc:1434] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd: Time spent starting tablet: real 0.039s	user 0.013s	sys 0.007s
I20260709 12:08:47.388221 26022 tablet_service.cc:1511] Processing CreateTablet for tablet 87545e0697f64558a1918d9dafd04b1f (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:47.395262 26150 tablet_bootstrap.cc:492] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8: No bootstrap required, opened a new log
I20260709 12:08:47.395713 26022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87545e0697f64558a1918d9dafd04b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.395820 26150 ts_tablet_manager.cc:1403] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.011s
I20260709 12:08:47.399296 26150 raft_consensus.cc:359] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.400151 26150 raft_consensus.cc:385] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.400506 26150 raft_consensus.cc:740] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc868618423419db4b805b6c69a88f8, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.401361 26150 consensus_queue.cc:260] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.404579 26019 tablet_service.cc:1511] Processing CreateTablet for tablet 101efc883fed47bc9c7bfabb594c138e (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:47.406133 26019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 101efc883fed47bc9c7bfabb594c138e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.406780 25983 heartbeater.cc:499] Master 127.24.179.126:40167 was elected leader, sending a full tablet report...
I20260709 12:08:47.411679 26147 tablet_bootstrap.cc:492] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd: Bootstrap starting.
I20260709 12:08:47.414139 26093 tablet_service.cc:1511] Processing CreateTablet for tablet 101efc883fed47bc9c7bfabb594c138e (DEFAULT_TABLE table=test-workload [id=db798e31e23f4283a4edc312c80241b9]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:47.415607 26093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 101efc883fed47bc9c7bfabb594c138e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.416997 26148 tablet_bootstrap.cc:492] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94: No bootstrap required, opened a new log
I20260709 12:08:47.417709 26148 ts_tablet_manager.cc:1403] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94: Time spent bootstrapping tablet: real 0.059s	user 0.005s	sys 0.005s
I20260709 12:08:47.439141 26148 raft_consensus.cc:359] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.439875 26058 heartbeater.cc:499] Master 127.24.179.126:40167 was elected leader, sending a full tablet report...
I20260709 12:08:47.440068 26148 raft_consensus.cc:385] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.440539 26150 ts_tablet_manager.cc:1434] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8: Time spent starting tablet: real 0.044s	user 0.023s	sys 0.013s
I20260709 12:08:47.441854 26150 tablet_bootstrap.cc:492] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8: Bootstrap starting.
I20260709 12:08:47.440471 26148 raft_consensus.cc:740] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.450670 26147 tablet_bootstrap.cc:654] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.451531 26148 consensus_queue.cc:260] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.458319 26150 tablet_bootstrap.cc:654] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.471606 26148 ts_tablet_manager.cc:1434] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94: Time spent starting tablet: real 0.054s	user 0.014s	sys 0.010s
I20260709 12:08:47.472460 26132 heartbeater.cc:499] Master 127.24.179.126:40167 was elected leader, sending a full tablet report...
I20260709 12:08:47.472807 26148 tablet_bootstrap.cc:492] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94: Bootstrap starting.
I20260709 12:08:47.481078 26148 tablet_bootstrap.cc:654] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.487190 26150 tablet_bootstrap.cc:492] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8: No bootstrap required, opened a new log
I20260709 12:08:47.487841 26150 ts_tablet_manager.cc:1403] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.009s
I20260709 12:08:47.489280 26147 tablet_bootstrap.cc:492] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd: No bootstrap required, opened a new log
I20260709 12:08:47.489939 26147 ts_tablet_manager.cc:1403] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.015s
I20260709 12:08:47.491528 26148 tablet_bootstrap.cc:492] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94: No bootstrap required, opened a new log
I20260709 12:08:47.491340 26150 raft_consensus.cc:359] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.492190 26148 ts_tablet_manager.cc:1403] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 12:08:47.492304 26150 raft_consensus.cc:385] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.492769 26150 raft_consensus.cc:740] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc868618423419db4b805b6c69a88f8, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.493688 26150 consensus_queue.cc:260] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.495348 26148 raft_consensus.cc:359] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.496192 26148 raft_consensus.cc:385] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.496275 26150 ts_tablet_manager.cc:1434] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:08:47.496635 26148 raft_consensus.cc:740] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.497534 26150 tablet_bootstrap.cc:492] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8: Bootstrap starting.
I20260709 12:08:47.497645 26148 consensus_queue.cc:260] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.498831 26152 raft_consensus.cc:493] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.499400 26152 raft_consensus.cc:515] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } }
I20260709 12:08:47.502099 26148 ts_tablet_manager.cc:1434] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:08:47.503155 26148 tablet_bootstrap.cc:492] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94: Bootstrap starting.
I20260709 12:08:47.506115 26150 tablet_bootstrap.cc:654] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.510170 26152 leader_election.cc:290] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175), efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223)
I20260709 12:08:47.512064 26148 tablet_bootstrap.cc:654] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.518978 26150 tablet_bootstrap.cc:492] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8: No bootstrap required, opened a new log
I20260709 12:08:47.519707 26150 ts_tablet_manager.cc:1403] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.009s
I20260709 12:08:47.523298 26150 raft_consensus.cc:359] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.524276 26150 raft_consensus.cc:385] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.524699 26150 raft_consensus.cc:740] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc868618423419db4b805b6c69a88f8, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.531790 26150 consensus_queue.cc:260] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.535676 26150 ts_tablet_manager.cc:1434] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.005s
I20260709 12:08:47.536686 26150 tablet_bootstrap.cc:492] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8: Bootstrap starting.
I20260709 12:08:47.543335 26150 tablet_bootstrap.cc:654] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.545461 26033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444afdba57744ac6ac09fccdd0418fca" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc868618423419db4b805b6c69a88f8" is_pre_election: true
I20260709 12:08:47.543351 26147 raft_consensus.cc:359] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.546751 26147 raft_consensus.cc:385] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.547088 26147 raft_consensus.cc:740] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.547747 26148 tablet_bootstrap.cc:492] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94: No bootstrap required, opened a new log
I20260709 12:08:47.548300 26148 ts_tablet_manager.cc:1403] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.018s
I20260709 12:08:47.547852 26147 consensus_queue.cc:260] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.550124 26147 ts_tablet_manager.cc:1434] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd: Time spent starting tablet: real 0.060s	user 0.004s	sys 0.000s
I20260709 12:08:47.551816 26148 raft_consensus.cc:359] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
W20260709 12:08:47.552301 25923 leader_election.cc:343] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.552861 26148 raft_consensus.cc:385] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.553218 26148 raft_consensus.cc:740] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.554512 26107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444afdba57744ac6ac09fccdd0418fca" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a3a2c2e13946209305e725c47fab94" is_pre_election: true
I20260709 12:08:47.554486 26148 consensus_queue.cc:260] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
W20260709 12:08:47.556713 25922 leader_election.cc:343] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.557253 25922 leader_election.cc:304] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd; no voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8
I20260709 12:08:47.557126 26148 ts_tablet_manager.cc:1434] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:08:47.558169 26147 tablet_bootstrap.cc:492] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd: Bootstrap starting.
I20260709 12:08:47.558827 26148 tablet_bootstrap.cc:492] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94: Bootstrap starting.
I20260709 12:08:47.560169 26150 tablet_bootstrap.cc:492] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8: No bootstrap required, opened a new log
I20260709 12:08:47.560793 26150 ts_tablet_manager.cc:1403] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 12:08:47.562840 26152 raft_consensus.cc:2749] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.565971 26150 raft_consensus.cc:359] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } }
I20260709 12:08:47.567028 26150 raft_consensus.cc:385] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.567443 26150 raft_consensus.cc:740] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc868618423419db4b805b6c69a88f8, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.568282 26148 tablet_bootstrap.cc:654] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.568372 26150 consensus_queue.cc:260] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } }
I20260709 12:08:47.571646 26150 ts_tablet_manager.cc:1434] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:08:47.572897 26150 tablet_bootstrap.cc:492] T a7e1bba4da21410685f7001aa07bfca5 P efc868618423419db4b805b6c69a88f8: Bootstrap starting.
I20260709 12:08:47.579891 26150 tablet_bootstrap.cc:654] T a7e1bba4da21410685f7001aa07bfca5 P efc868618423419db4b805b6c69a88f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.589270 26147 tablet_bootstrap.cc:654] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.592197 26150 tablet_bootstrap.cc:492] T a7e1bba4da21410685f7001aa07bfca5 P efc868618423419db4b805b6c69a88f8: No bootstrap required, opened a new log
I20260709 12:08:47.592927 26150 ts_tablet_manager.cc:1403] T a7e1bba4da21410685f7001aa07bfca5 P efc868618423419db4b805b6c69a88f8: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.009s
I20260709 12:08:47.596375 26150 raft_consensus.cc:359] T a7e1bba4da21410685f7001aa07bfca5 P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.599949 26150 raft_consensus.cc:385] T a7e1bba4da21410685f7001aa07bfca5 P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.600350 26150 raft_consensus.cc:740] T a7e1bba4da21410685f7001aa07bfca5 P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc868618423419db4b805b6c69a88f8, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.601373 26148 tablet_bootstrap.cc:492] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94: No bootstrap required, opened a new log
I20260709 12:08:47.602803 26148 ts_tablet_manager.cc:1403] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94: Time spent bootstrapping tablet: real 0.044s	user 0.027s	sys 0.013s
I20260709 12:08:47.602435 26150 consensus_queue.cc:260] T a7e1bba4da21410685f7001aa07bfca5 P efc868618423419db4b805b6c69a88f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.603483 26147 tablet_bootstrap.cc:492] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd: No bootstrap required, opened a new log
I20260709 12:08:47.603973 26147 ts_tablet_manager.cc:1403] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.004s
I20260709 12:08:47.605204 26150 ts_tablet_manager.cc:1434] T a7e1bba4da21410685f7001aa07bfca5 P efc868618423419db4b805b6c69a88f8: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:08:47.606381 26150 tablet_bootstrap.cc:492] T 69753740148d474ca373a75492f69c82 P efc868618423419db4b805b6c69a88f8: Bootstrap starting.
I20260709 12:08:47.606087 26148 raft_consensus.cc:359] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.606962 26148 raft_consensus.cc:385] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.607347 26148 raft_consensus.cc:740] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.607070 26147 raft_consensus.cc:359] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.607867 26147 raft_consensus.cc:385] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.608335 26147 raft_consensus.cc:740] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.608214 26148 consensus_queue.cc:260] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.609313 26147 consensus_queue.cc:260] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.610777 26148 ts_tablet_manager.cc:1434] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 12:08:47.611826 26148 tablet_bootstrap.cc:492] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94: Bootstrap starting.
I20260709 12:08:47.614701 26150 tablet_bootstrap.cc:654] T 69753740148d474ca373a75492f69c82 P efc868618423419db4b805b6c69a88f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.619931 26147 ts_tablet_manager.cc:1434] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 12:08:47.620843 26148 tablet_bootstrap.cc:654] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.631436 26147 tablet_bootstrap.cc:492] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd: Bootstrap starting.
I20260709 12:08:47.634280 26150 tablet_bootstrap.cc:492] T 69753740148d474ca373a75492f69c82 P efc868618423419db4b805b6c69a88f8: No bootstrap required, opened a new log
I20260709 12:08:47.634891 26150 ts_tablet_manager.cc:1403] T 69753740148d474ca373a75492f69c82 P efc868618423419db4b805b6c69a88f8: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.018s
I20260709 12:08:47.636802 26148 tablet_bootstrap.cc:492] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94: No bootstrap required, opened a new log
I20260709 12:08:47.637396 26148 ts_tablet_manager.cc:1403] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.009s
I20260709 12:08:47.637714 26150 raft_consensus.cc:359] T 69753740148d474ca373a75492f69c82 P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.638386 26150 raft_consensus.cc:385] T 69753740148d474ca373a75492f69c82 P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.638706 26150 raft_consensus.cc:740] T 69753740148d474ca373a75492f69c82 P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc868618423419db4b805b6c69a88f8, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.639405 26147 tablet_bootstrap.cc:654] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.639447 26150 consensus_queue.cc:260] T 69753740148d474ca373a75492f69c82 P efc868618423419db4b805b6c69a88f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.640520 26148 raft_consensus.cc:359] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.641299 26148 raft_consensus.cc:385] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.641597 26148 raft_consensus.cc:740] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.641865 26150 ts_tablet_manager.cc:1434] T 69753740148d474ca373a75492f69c82 P efc868618423419db4b805b6c69a88f8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:08:47.642982 26150 tablet_bootstrap.cc:492] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8: Bootstrap starting.
I20260709 12:08:47.642632 26148 consensus_queue.cc:260] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.646625 26148 ts_tablet_manager.cc:1434] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 12:08:47.648181 26148 tablet_bootstrap.cc:492] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94: Bootstrap starting.
I20260709 12:08:47.650506 26150 tablet_bootstrap.cc:654] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.651345 26147 tablet_bootstrap.cc:492] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd: No bootstrap required, opened a new log
I20260709 12:08:47.651988 26147 ts_tablet_manager.cc:1403] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
W20260709 12:08:47.655099 25904 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:47.655215 26148 tablet_bootstrap.cc:654] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.657721 26147 raft_consensus.cc:359] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.659129 26147 raft_consensus.cc:385] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.659590 26147 raft_consensus.cc:740] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.660856 26147 consensus_queue.cc:260] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.668355 26147 ts_tablet_manager.cc:1434] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 12:08:47.670222 26147 tablet_bootstrap.cc:492] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd: Bootstrap starting.
I20260709 12:08:47.673007 26155 raft_consensus.cc:493] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.673837 26155 raft_consensus.cc:515] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.692132 26164 raft_consensus.cc:493] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.693176 26164 raft_consensus.cc:515] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.696978 26150 tablet_bootstrap.cc:492] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8: No bootstrap required, opened a new log
I20260709 12:08:47.697144 26033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69753740148d474ca373a75492f69c82" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc868618423419db4b805b6c69a88f8" is_pre_election: true
I20260709 12:08:47.697518 26164 leader_election.cc:290] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:08:47.697793 26150 ts_tablet_manager.cc:1403] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.034s
I20260709 12:08:47.697870 26033 raft_consensus.cc:2468] T 69753740148d474ca373a75492f69c82 P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 0.
I20260709 12:08:47.699677 26107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69753740148d474ca373a75492f69c82" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a3a2c2e13946209305e725c47fab94" is_pre_election: true
I20260709 12:08:47.700243 26155 leader_election.cc:290] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223)
I20260709 12:08:47.700385 26107 raft_consensus.cc:2468] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 0.
I20260709 12:08:47.701552 26150 raft_consensus.cc:359] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.701995 25922 leader_election.cc:304] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd, 55a3a2c2e13946209305e725c47fab94; no voters: 
I20260709 12:08:47.702512 26150 raft_consensus.cc:385] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.702898 26150 raft_consensus.cc:740] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc868618423419db4b805b6c69a88f8, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.702921 26164 raft_consensus.cc:2804] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.704053 26150 consensus_queue.cc:260] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.704417 26164 raft_consensus.cc:493] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.704934 26164 raft_consensus.cc:3060] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.706547 26150 ts_tablet_manager.cc:1434] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:08:47.707592 26150 tablet_bootstrap.cc:492] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8: Bootstrap starting.
I20260709 12:08:47.714668 26150 tablet_bootstrap.cc:654] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.717208 26155 raft_consensus.cc:493] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.717947 26155 raft_consensus.cc:515] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.720925 26155 leader_election.cc:290] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223)
I20260709 12:08:47.724282 26154 raft_consensus.cc:493] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.724942 26154 raft_consensus.cc:515] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.729759 26148 tablet_bootstrap.cc:492] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94: No bootstrap required, opened a new log
I20260709 12:08:47.730502 26148 ts_tablet_manager.cc:1403] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94: Time spent bootstrapping tablet: real 0.083s	user 0.052s	sys 0.029s
I20260709 12:08:47.733680 26148 raft_consensus.cc:359] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } }
I20260709 12:08:47.734520 26148 raft_consensus.cc:385] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.734910 26148 raft_consensus.cc:740] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.735783 26148 consensus_queue.cc:260] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } }
I20260709 12:08:47.742309 26148 ts_tablet_manager.cc:1434] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:08:47.743463 26148 tablet_bootstrap.cc:492] T 3b4404e44e814753b1da44e2d750857f P 55a3a2c2e13946209305e725c47fab94: Bootstrap starting.
I20260709 12:08:47.743595 26154 leader_election.cc:290] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:08:47.750665 26148 tablet_bootstrap.cc:654] T 3b4404e44e814753b1da44e2d750857f P 55a3a2c2e13946209305e725c47fab94: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.760589 26147 tablet_bootstrap.cc:654] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.775215 26155 raft_consensus.cc:493] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.776026 26155 raft_consensus.cc:515] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } }
I20260709 12:08:47.779104 26155 leader_election.cc:290] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223), 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227)
I20260709 12:08:47.788226 26154 raft_consensus.cc:493] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.789083 26154 raft_consensus.cc:515] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.792351 26154 leader_election.cc:290] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:08:47.753115 26164 raft_consensus.cc:515] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.799083 26033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69753740148d474ca373a75492f69c82" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc868618423419db4b805b6c69a88f8"
I20260709 12:08:47.800052 26033 raft_consensus.cc:3060] T 69753740148d474ca373a75492f69c82 P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.802888 26032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c07440e5674cd4b07a3d2c3a353a8b" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc868618423419db4b805b6c69a88f8" is_pre_election: true
I20260709 12:08:47.803704 26032 raft_consensus.cc:2468] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 0.
I20260709 12:08:47.804934 26031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1bba4da21410685f7001aa07bfca5" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc868618423419db4b805b6c69a88f8" is_pre_election: true
I20260709 12:08:47.805124 26072 leader_election.cc:304] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:08:47.805783 26031 raft_consensus.cc:2468] T a7e1bba4da21410685f7001aa07bfca5 P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 0.
I20260709 12:08:47.806170 26155 raft_consensus.cc:2804] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.806677 26155 raft_consensus.cc:493] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.807060 26155 raft_consensus.cc:3060] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.806950 26030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444afdba57744ac6ac09fccdd0418fca" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc868618423419db4b805b6c69a88f8" is_pre_election: true
I20260709 12:08:47.807689 26030 raft_consensus.cc:2468] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 0.
I20260709 12:08:47.815214 26072 leader_election.cc:304] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:08:47.819615 26155 raft_consensus.cc:515] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.835515 26150 tablet_bootstrap.cc:492] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8: No bootstrap required, opened a new log
I20260709 12:08:47.836057 26150 ts_tablet_manager.cc:1403] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8: Time spent bootstrapping tablet: real 0.129s	user 0.048s	sys 0.061s
I20260709 12:08:47.835925 26107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69753740148d474ca373a75492f69c82" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a3a2c2e13946209305e725c47fab94"
I20260709 12:08:47.836580 26107 raft_consensus.cc:3060] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.839008 26150 raft_consensus.cc:359] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.839754 26150 raft_consensus.cc:385] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.840044 26150 raft_consensus.cc:740] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc868618423419db4b805b6c69a88f8, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.840277 26072 leader_election.cc:304] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:08:47.840936 26150 consensus_queue.cc:260] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.842046 26155 leader_election.cc:290] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 election: Requested vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223)
I20260709 12:08:47.854362 26106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c07440e5674cd4b07a3d2c3a353a8b" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a3a2c2e13946209305e725c47fab94" is_pre_election: true
I20260709 12:08:47.842922 26181 raft_consensus.cc:2804] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.854784 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a82be63df514556be057c830c06e2eb" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a3a2c2e13946209305e725c47fab94" is_pre_election: true
I20260709 12:08:47.855120 26181 raft_consensus.cc:493] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.855310 26106 raft_consensus.cc:2393] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc868618423419db4b805b6c69a88f8 in current term 1: Already voted for candidate 55a3a2c2e13946209305e725c47fab94 in this term.
I20260709 12:08:47.855588 26105 raft_consensus.cc:2468] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc868618423419db4b805b6c69a88f8 in term 0.
I20260709 12:08:47.856446 26155 raft_consensus.cc:2804] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.846987 25958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c07440e5674cd4b07a3d2c3a353a8b" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0377e4c589564e739a0bba757431dcdd" is_pre_election: true
I20260709 12:08:47.857393 26155 raft_consensus.cc:493] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.850239 25956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c07440e5674cd4b07a3d2c3a353a8b" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0377e4c589564e739a0bba757431dcdd" is_pre_election: true
I20260709 12:08:47.850553 26033 raft_consensus.cc:2468] T 69753740148d474ca373a75492f69c82 P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 1.
I20260709 12:08:47.851434 25955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1bba4da21410685f7001aa07bfca5" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0377e4c589564e739a0bba757431dcdd" is_pre_election: true
I20260709 12:08:47.852159 26150 ts_tablet_manager.cc:1434] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:08:47.852391 25954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444afdba57744ac6ac09fccdd0418fca" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0377e4c589564e739a0bba757431dcdd" is_pre_election: true
I20260709 12:08:47.853405 26148 tablet_bootstrap.cc:492] T 3b4404e44e814753b1da44e2d750857f P 55a3a2c2e13946209305e725c47fab94: No bootstrap required, opened a new log
I20260709 12:08:47.853327 25953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c07440e5674cd4b07a3d2c3a353a8b" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0377e4c589564e739a0bba757431dcdd"
I20260709 12:08:47.845726 26107 raft_consensus.cc:2468] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 1.
I20260709 12:08:47.856528 26147 tablet_bootstrap.cc:492] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd: No bootstrap required, opened a new log
I20260709 12:08:47.846210 26164 leader_election.cc:290] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 1 election: Requested vote from peers efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:08:47.856707 26154 raft_consensus.cc:493] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.857332 25997 leader_election.cc:304] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:08:47.848280 25957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a82be63df514556be057c830c06e2eb" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0377e4c589564e739a0bba757431dcdd" is_pre_election: true
W20260709 12:08:47.858644 25996 leader_election.cc:343] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:47.859606 26070 leader_election.cc:343] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.862345 26184 raft_consensus.cc:2804] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.861446 26150 tablet_bootstrap.cc:492] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8: Bootstrap starting.
I20260709 12:08:47.885084 26184 raft_consensus.cc:493] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.858927 25954 raft_consensus.cc:2468] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 0.
I20260709 12:08:47.885455 25996 leader_election.cc:304] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc868618423419db4b805b6c69a88f8; no voters: 0377e4c589564e739a0bba757431dcdd, 55a3a2c2e13946209305e725c47fab94
I20260709 12:08:47.887046 26184 raft_consensus.cc:3060] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.859124 26148 ts_tablet_manager.cc:1403] T 3b4404e44e814753b1da44e2d750857f P 55a3a2c2e13946209305e725c47fab94: Time spent bootstrapping tablet: real 0.116s	user 0.041s	sys 0.059s
I20260709 12:08:47.858800 25955 raft_consensus.cc:2468] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 0.
W20260709 12:08:47.885939 26070 leader_election.cc:343] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.861819 25957 raft_consensus.cc:2468] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc868618423419db4b805b6c69a88f8 in term 0.
I20260709 12:08:47.860831 26154 raft_consensus.cc:515] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.860459 26147 ts_tablet_manager.cc:1403] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd: Time spent bootstrapping tablet: real 0.191s	user 0.010s	sys 0.005s
I20260709 12:08:47.891331 26150 tablet_bootstrap.cc:654] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.860558 25922 leader_election.cc:304] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd, 55a3a2c2e13946209305e725c47fab94; no voters: 
I20260709 12:08:47.893769 26107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4404e44e814753b1da44e2d750857f" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a3a2c2e13946209305e725c47fab94" is_pre_election: true
I20260709 12:08:47.855582 26181 raft_consensus.cc:3060] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.894590 26164 raft_consensus.cc:2804] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.895098 26164 raft_consensus.cc:697] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [term 1 LEADER]: Becoming Leader. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Running, Role: LEADER
I20260709 12:08:47.891000 26148 raft_consensus.cc:359] T 3b4404e44e814753b1da44e2d750857f P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.895851 26148 raft_consensus.cc:385] T 3b4404e44e814753b1da44e2d750857f P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.895955 26164 consensus_queue.cc:237] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.896418 26148 raft_consensus.cc:740] T 3b4404e44e814753b1da44e2d750857f P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.857889 26155 raft_consensus.cc:3060] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.897646 26148 consensus_queue.cc:260] T 3b4404e44e814753b1da44e2d750857f P 55a3a2c2e13946209305e725c47fab94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.900895 26107 raft_consensus.cc:2468] T 3b4404e44e814753b1da44e2d750857f P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc868618423419db4b805b6c69a88f8 in term 0.
I20260709 12:08:47.901197 26148 ts_tablet_manager.cc:1434] T 3b4404e44e814753b1da44e2d750857f P 55a3a2c2e13946209305e725c47fab94: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:08:47.902582 26148 tablet_bootstrap.cc:492] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94: Bootstrap starting.
I20260709 12:08:47.902809 26154 leader_election.cc:290] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:08:47.903472 26154 raft_consensus.cc:3060] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.906728 26147 raft_consensus.cc:359] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
W20260709 12:08:47.910243 26072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:44223, user_credentials={real_user=slave}} blocked reactor thread for 70057.6us
I20260709 12:08:47.917851 26033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c07440e5674cd4b07a3d2c3a353a8b" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc868618423419db4b805b6c69a88f8"
I20260709 12:08:47.919041 26147 raft_consensus.cc:385] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.919242 26148 tablet_bootstrap.cc:654] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.924295 26147 raft_consensus.cc:740] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.918756 25852 catalog_manager.cc:5697] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd reported cstate change: term changed from 0 to 1, leader changed from <none> to 0377e4c589564e739a0bba757431dcdd (127.24.179.65). New cstate: current_term: 1 leader_uuid: "0377e4c589564e739a0bba757431dcdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.926295 26154 raft_consensus.cc:2749] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.923521 26184 raft_consensus.cc:515] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.925253 26147 consensus_queue.cc:260] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.928828 26147 ts_tablet_manager.cc:1434] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 12:08:47.929967 26147 tablet_bootstrap.cc:492] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd: Bootstrap starting.
I20260709 12:08:47.930186 25997 leader_election.cc:304] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8; no voters: 
W20260709 12:08:47.932010 25996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:43227, user_credentials={real_user=slave}} blocked reactor thread for 73515.2us
I20260709 12:08:47.932312 26150 tablet_bootstrap.cc:492] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8: No bootstrap required, opened a new log
I20260709 12:08:47.932852 26150 ts_tablet_manager.cc:1403] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.020s
I20260709 12:08:47.934790 25957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4404e44e814753b1da44e2d750857f" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0377e4c589564e739a0bba757431dcdd" is_pre_election: true
I20260709 12:08:47.935940 26150 raft_consensus.cc:359] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.936524 26185 raft_consensus.cc:2804] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.936743 26150 raft_consensus.cc:385] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.936993 26185 raft_consensus.cc:493] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.937147 26150 raft_consensus.cc:740] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc868618423419db4b805b6c69a88f8, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.937395 26185 raft_consensus.cc:3060] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.937686 26147 tablet_bootstrap.cc:654] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.921831 26155 raft_consensus.cc:515] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.941340 25957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1bba4da21410685f7001aa07bfca5" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0377e4c589564e739a0bba757431dcdd"
I20260709 12:08:47.942034 25957 raft_consensus.cc:3060] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.941676 26150 consensus_queue.cc:260] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.915838 26181 raft_consensus.cc:515] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } }
I20260709 12:08:47.943490 26107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a82be63df514556be057c830c06e2eb" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a3a2c2e13946209305e725c47fab94"
I20260709 12:08:47.944093 26107 raft_consensus.cc:3060] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.944890 26031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444afdba57744ac6ac09fccdd0418fca" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc868618423419db4b805b6c69a88f8"
I20260709 12:08:47.945484 26031 raft_consensus.cc:3060] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.951848 26107 raft_consensus.cc:2468] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc868618423419db4b805b6c69a88f8 in term 1.
I20260709 12:08:47.934054 26033 raft_consensus.cc:2468] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 1.
I20260709 12:08:47.953219 25997 leader_election.cc:304] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:08:47.953989 26072 leader_election.cc:304] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8; no voters: 0377e4c589564e739a0bba757431dcdd
I20260709 12:08:47.955840 26183 raft_consensus.cc:2804] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.955912 26184 leader_election.cc:290] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 election: Requested vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:08:47.958084 26030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1bba4da21410685f7001aa07bfca5" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc868618423419db4b805b6c69a88f8"
I20260709 12:08:47.958774 26030 raft_consensus.cc:3060] T a7e1bba4da21410685f7001aa07bfca5 P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.962217 26184 raft_consensus.cc:2804] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.962826 26184 raft_consensus.cc:697] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 1 LEADER]: Becoming Leader. State: Replica: efc868618423419db4b805b6c69a88f8, State: Running, Role: LEADER
I20260709 12:08:47.963717 26184 consensus_queue.cc:237] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.958227 26155 leader_election.cc:290] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 election: Requested vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223)
I20260709 12:08:47.967374 26030 raft_consensus.cc:2468] T a7e1bba4da21410685f7001aa07bfca5 P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 1.
I20260709 12:08:47.979967 26072 leader_election.cc:304] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:08:47.969026 26031 raft_consensus.cc:2468] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 1.
I20260709 12:08:47.972572 26164 raft_consensus.cc:493] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.972738 25955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444afdba57744ac6ac09fccdd0418fca" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0377e4c589564e739a0bba757431dcdd"
I20260709 12:08:47.981011 26148 tablet_bootstrap.cc:492] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94: No bootstrap required, opened a new log
I20260709 12:08:47.981550 25955 raft_consensus.cc:3060] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.981997 26148 ts_tablet_manager.cc:1403] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94: Time spent bootstrapping tablet: real 0.080s	user 0.021s	sys 0.012s
I20260709 12:08:47.982640 26147 tablet_bootstrap.cc:492] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd: No bootstrap required, opened a new log
I20260709 12:08:47.983206 26147 ts_tablet_manager.cc:1403] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.005s
I20260709 12:08:47.985304 26148 raft_consensus.cc:359] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.985970 25957 raft_consensus.cc:2468] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 1.
I20260709 12:08:47.980958 26155 raft_consensus.cc:2804] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.986771 26155 raft_consensus.cc:697] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [term 1 LEADER]: Becoming Leader. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Running, Role: LEADER
I20260709 12:08:47.986737 26164 raft_consensus.cc:515] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.988106 26155 consensus_queue.cc:237] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.989452 26164 leader_election.cc:290] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:08:47.990825 26107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d494488b914e40ddb30ce096a17593d7" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a3a2c2e13946209305e725c47fab94" is_pre_election: true
I20260709 12:08:47.991529 26107 raft_consensus.cc:2468] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 0.
I20260709 12:08:47.992959 25922 leader_election.cc:304] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd, 55a3a2c2e13946209305e725c47fab94; no voters: 
I20260709 12:08:47.993996 26164 raft_consensus.cc:2804] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.994521 26164 raft_consensus.cc:493] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.995308 26164 raft_consensus.cc:3060] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.995445 26150 ts_tablet_manager.cc:1434] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8: Time spent starting tablet: real 0.062s	user 0.015s	sys 0.010s
I20260709 12:08:47.996723 26150 tablet_bootstrap.cc:492] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8: Bootstrap starting.
I20260709 12:08:47.986159 26148 raft_consensus.cc:385] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.974267 26181 leader_election.cc:290] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 election: Requested vote from peers efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223), 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227)
I20260709 12:08:47.998380 25955 raft_consensus.cc:2468] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 1.
I20260709 12:08:47.999751 26072 leader_election.cc:304] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:08:47.998659 26148 raft_consensus.cc:740] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.003439 26150 tablet_bootstrap.cc:654] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.010074 26155 raft_consensus.cc:2804] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.010784 26155 raft_consensus.cc:697] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 1 LEADER]: Becoming Leader. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Running, Role: LEADER
I20260709 12:08:48.011858 26155 consensus_queue.cc:237] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } }
I20260709 12:08:48.012938 26148 consensus_queue.cc:260] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.010056 26185 raft_consensus.cc:515] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.015237 26148 ts_tablet_manager.cc:1434] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260709 12:08:48.015635 26185 leader_election.cc:290] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 election: Requested vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:08:48.003772 26164 raft_consensus.cc:515] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:47.988284 26147 raft_consensus.cc:359] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.016278 26148 tablet_bootstrap.cc:492] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94: Bootstrap starting.
I20260709 12:08:48.004997 26183 raft_consensus.cc:697] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 1 LEADER]: Becoming Leader. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Running, Role: LEADER
W20260709 12:08:48.007164 25996 leader_election.cc:343] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.007202 25957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a82be63df514556be057c830c06e2eb" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0377e4c589564e739a0bba757431dcdd"
I20260709 12:08:48.016487 26147 raft_consensus.cc:385] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.019989 25957 raft_consensus.cc:3060] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.020164 26147 raft_consensus.cc:740] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.021193 25955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4404e44e814753b1da44e2d750857f" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0377e4c589564e739a0bba757431dcdd"
I20260709 12:08:48.021039 26147 consensus_queue.cc:260] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.021724 26150 tablet_bootstrap.cc:492] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8: No bootstrap required, opened a new log
I20260709 12:08:48.022094 25955 raft_consensus.cc:3060] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.022557 26150 ts_tablet_manager.cc:1403] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.004s
I20260709 12:08:48.023729 26147 ts_tablet_manager.cc:1434] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.004s
I20260709 12:08:48.024859 26147 tablet_bootstrap.cc:492] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd: Bootstrap starting.
I20260709 12:08:48.025393 26150 raft_consensus.cc:359] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.026132 26150 raft_consensus.cc:385] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.026414 26150 raft_consensus.cc:740] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc868618423419db4b805b6c69a88f8, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.018009 26107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4404e44e814753b1da44e2d750857f" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a3a2c2e13946209305e725c47fab94"
I20260709 12:08:48.019714 26183 consensus_queue.cc:237] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.028254 26107 raft_consensus.cc:3060] T 3b4404e44e814753b1da44e2d750857f P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.007860 26030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d494488b914e40ddb30ce096a17593d7" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc868618423419db4b805b6c69a88f8" is_pre_election: true
I20260709 12:08:48.029453 25955 raft_consensus.cc:2468] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc868618423419db4b805b6c69a88f8 in term 1.
I20260709 12:08:48.019296 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d494488b914e40ddb30ce096a17593d7" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a3a2c2e13946209305e725c47fab94"
I20260709 12:08:48.030860 26030 raft_consensus.cc:2468] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 0.
I20260709 12:08:48.031049 26105 raft_consensus.cc:3060] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.031383 26031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d494488b914e40ddb30ce096a17593d7" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc868618423419db4b805b6c69a88f8"
I20260709 12:08:48.031951 26031 raft_consensus.cc:3060] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.017971 26164 leader_election.cc:290] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 1 election: Requested vote from peers efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
W20260709 12:08:48.035122 26133 tablet.cc:2406] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:48.016695 25852 catalog_manager.cc:5697] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to efc868618423419db4b805b6c69a88f8 (127.24.179.66). New cstate: current_term: 1 leader_uuid: "efc868618423419db4b805b6c69a88f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.039108 26031 raft_consensus.cc:2468] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 1.
I20260709 12:08:48.041245 25923 leader_election.cc:304] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:08:48.042196 26164 raft_consensus.cc:2804] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.042932 26164 raft_consensus.cc:697] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 1 LEADER]: Becoming Leader. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Running, Role: LEADER
I20260709 12:08:48.043779 26164 consensus_queue.cc:237] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.046913 25957 raft_consensus.cc:2468] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc868618423419db4b805b6c69a88f8 in term 1.
I20260709 12:08:48.050370 26148 tablet_bootstrap.cc:654] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.051751 26107 raft_consensus.cc:2468] T 3b4404e44e814753b1da44e2d750857f P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc868618423419db4b805b6c69a88f8 in term 1.
I20260709 12:08:48.045215 25996 leader_election.cc:304] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:08:48.053722 26184 raft_consensus.cc:2804] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.054574 26184 raft_consensus.cc:697] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [term 1 LEADER]: Becoming Leader. State: Replica: efc868618423419db4b805b6c69a88f8, State: Running, Role: LEADER
I20260709 12:08:48.055506 26184 consensus_queue.cc:237] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.058528 26105 raft_consensus.cc:2468] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 1.
I20260709 12:08:48.059074 26147 tablet_bootstrap.cc:654] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.027160 26150 consensus_queue.cc:260] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.064235 26150 ts_tablet_manager.cc:1434] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 12:08:48.069697 26147 tablet_bootstrap.cc:492] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd: No bootstrap required, opened a new log
I20260709 12:08:48.070331 26147 ts_tablet_manager.cc:1403] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.003s
I20260709 12:08:48.069340 26148 tablet_bootstrap.cc:492] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94: No bootstrap required, opened a new log
I20260709 12:08:48.071467 26148 ts_tablet_manager.cc:1403] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.002s
I20260709 12:08:48.074735 26148 raft_consensus.cc:359] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.075511 26148 raft_consensus.cc:385] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.075803 26148 raft_consensus.cc:740] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.075122 25852 catalog_manager.cc:5697] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to efc868618423419db4b805b6c69a88f8 (127.24.179.66). New cstate: current_term: 1 leader_uuid: "efc868618423419db4b805b6c69a88f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.076560 26148 consensus_queue.cc:260] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.078788 26148 ts_tablet_manager.cc:1434] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:08:48.079785 26148 tablet_bootstrap.cc:492] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94: Bootstrap starting.
I20260709 12:08:48.080153 26184 raft_consensus.cc:493] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.079506 25853 catalog_manager.cc:5697] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd reported cstate change: term changed from 0 to 1, leader changed from <none> to 0377e4c589564e739a0bba757431dcdd (127.24.179.65). New cstate: current_term: 1 leader_uuid: "0377e4c589564e739a0bba757431dcdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.080646 26184 raft_consensus.cc:515] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.083036 26184 leader_election.cc:290] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:08:48.083913 25957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0798b624814b23ba96d2361b4961aa" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0377e4c589564e739a0bba757431dcdd" is_pre_election: true
I20260709 12:08:48.084244 26155 raft_consensus.cc:493] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.091013 26155 raft_consensus.cc:515] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.093282 26155 leader_election.cc:290] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223)
I20260709 12:08:48.083554 25855 catalog_manager.cc:5697] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55a3a2c2e13946209305e725c47fab94 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "55a3a2c2e13946209305e725c47fab94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:48.095054 26031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87545e0697f64558a1918d9dafd04b1f" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc868618423419db4b805b6c69a88f8" is_pre_election: true
I20260709 12:08:48.095170 25955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87545e0697f64558a1918d9dafd04b1f" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0377e4c589564e739a0bba757431dcdd" is_pre_election: true
I20260709 12:08:48.095788 26031 raft_consensus.cc:2468] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 0.
I20260709 12:08:48.097038 26072 leader_election.cc:304] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:08:48.086676 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0798b624814b23ba96d2361b4961aa" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a3a2c2e13946209305e725c47fab94" is_pre_election: true
W20260709 12:08:48.097539 26070 leader_election.cc:343] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.097783 26155 raft_consensus.cc:2804] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.098260 26155 raft_consensus.cc:493] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.098652 26155 raft_consensus.cc:3060] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:48.098817 25997 leader_election.cc:343] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.086570 26147 raft_consensus.cc:359] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.088266 26148 tablet_bootstrap.cc:654] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.100984 26147 raft_consensus.cc:385] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.101408 26147 raft_consensus.cc:740] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.102373 26147 consensus_queue.cc:260] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.103435 25957 raft_consensus.cc:2468] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc868618423419db4b805b6c69a88f8 in term 0.
I20260709 12:08:48.104928 26147 ts_tablet_manager.cc:1434] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:08:48.105455 25996 leader_election.cc:304] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd, efc868618423419db4b805b6c69a88f8; no voters: 55a3a2c2e13946209305e725c47fab94
I20260709 12:08:48.106140 26155 raft_consensus.cc:515] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.106698 26184 raft_consensus.cc:2804] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.107117 26184 raft_consensus.cc:493] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.107460 26184 raft_consensus.cc:3060] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.109442 26147 tablet_bootstrap.cc:492] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd: Bootstrap starting.
I20260709 12:08:48.114177 26184 raft_consensus.cc:515] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.117390 26147 tablet_bootstrap.cc:654] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.116720 25853 catalog_manager.cc:5697] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55a3a2c2e13946209305e725c47fab94 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "55a3a2c2e13946209305e725c47fab94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:48.118314 25957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0798b624814b23ba96d2361b4961aa" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0377e4c589564e739a0bba757431dcdd"
I20260709 12:08:48.119210 25957 raft_consensus.cc:3060] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.121165 25955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87545e0697f64558a1918d9dafd04b1f" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0377e4c589564e739a0bba757431dcdd"
W20260709 12:08:48.123080 26070 leader_election.cc:343] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.125231 26031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87545e0697f64558a1918d9dafd04b1f" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc868618423419db4b805b6c69a88f8"
I20260709 12:08:48.125854 26031 raft_consensus.cc:3060] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.130322 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0798b624814b23ba96d2361b4961aa" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a3a2c2e13946209305e725c47fab94"
W20260709 12:08:48.132513 25997 leader_election.cc:343] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.133443 26184 leader_election.cc:290] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 election: Requested vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:08:48.136457 25957 raft_consensus.cc:2468] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc868618423419db4b805b6c69a88f8 in term 1.
I20260709 12:08:48.137782 25996 leader_election.cc:304] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd, efc868618423419db4b805b6c69a88f8; no voters: 55a3a2c2e13946209305e725c47fab94
I20260709 12:08:48.139564 26148 tablet_bootstrap.cc:492] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94: No bootstrap required, opened a new log
I20260709 12:08:48.140393 26148 ts_tablet_manager.cc:1403] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.015s
I20260709 12:08:48.140666 25853 catalog_manager.cc:5697] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55a3a2c2e13946209305e725c47fab94 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "55a3a2c2e13946209305e725c47fab94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.139518 26184 raft_consensus.cc:2804] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.142769 26184 raft_consensus.cc:697] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [term 1 LEADER]: Becoming Leader. State: Replica: efc868618423419db4b805b6c69a88f8, State: Running, Role: LEADER
I20260709 12:08:48.143265 26148 raft_consensus.cc:359] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.143957 26148 raft_consensus.cc:385] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.144311 26148 raft_consensus.cc:740] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.145444 26185 raft_consensus.cc:493] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.145128 26148 consensus_queue.cc:260] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.145853 26155 leader_election.cc:290] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 election: Requested vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223)
I20260709 12:08:48.145937 26185 raft_consensus.cc:515] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.147449 26148 ts_tablet_manager.cc:1434] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:08:48.137790 26031 raft_consensus.cc:2468] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 1.
I20260709 12:08:48.149680 25957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101efc883fed47bc9c7bfabb594c138e" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0377e4c589564e739a0bba757431dcdd" is_pre_election: true
I20260709 12:08:48.149884 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101efc883fed47bc9c7bfabb594c138e" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a3a2c2e13946209305e725c47fab94" is_pre_election: true
I20260709 12:08:48.150508 26105 raft_consensus.cc:2468] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc868618423419db4b805b6c69a88f8 in term 0.
I20260709 12:08:48.150452 26072 leader_election.cc:304] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8; no voters: 0377e4c589564e739a0bba757431dcdd
W20260709 12:08:48.151324 25996 leader_election.cc:343] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.151968 25997 leader_election.cc:304] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8; no voters: 0377e4c589564e739a0bba757431dcdd
I20260709 12:08:48.152302 26155 raft_consensus.cc:2804] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.144037 26184 consensus_queue.cc:237] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.152808 26191 raft_consensus.cc:2804] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.153239 26155 raft_consensus.cc:697] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [term 1 LEADER]: Becoming Leader. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Running, Role: LEADER
I20260709 12:08:48.153453 26191 raft_consensus.cc:493] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.153946 26191 raft_consensus.cc:3060] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.152835 26185 leader_election.cc:290] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:08:48.162511 25855 catalog_manager.cc:5697] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to efc868618423419db4b805b6c69a88f8 (127.24.179.66). New cstate: current_term: 1 leader_uuid: "efc868618423419db4b805b6c69a88f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.163080 26155 consensus_queue.cc:237] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.166091 26191 raft_consensus.cc:515] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.170441 25957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101efc883fed47bc9c7bfabb594c138e" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0377e4c589564e739a0bba757431dcdd"
I20260709 12:08:48.171324 26147 tablet_bootstrap.cc:492] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd: No bootstrap required, opened a new log
I20260709 12:08:48.171833 26147 ts_tablet_manager.cc:1403] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd: Time spent bootstrapping tablet: real 0.063s	user 0.026s	sys 0.030s
W20260709 12:08:48.172159 25996 leader_election.cc:343] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.174439 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101efc883fed47bc9c7bfabb594c138e" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a3a2c2e13946209305e725c47fab94"
I20260709 12:08:48.175087 26105 raft_consensus.cc:3060] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.174834 26147 raft_consensus.cc:359] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.175598 26147 raft_consensus.cc:385] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.175887 26147 raft_consensus.cc:740] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.176605 26147 consensus_queue.cc:260] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.178750 26147 ts_tablet_manager.cc:1434] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:08:48.179617 26147 tablet_bootstrap.cc:492] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd: Bootstrap starting.
I20260709 12:08:48.185737 26147 tablet_bootstrap.cc:654] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.186110 26191 leader_election.cc:290] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 election: Requested vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:08:48.185385 25855 catalog_manager.cc:5697] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55a3a2c2e13946209305e725c47fab94 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "55a3a2c2e13946209305e725c47fab94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:48.185472 26105 raft_consensus.cc:2468] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc868618423419db4b805b6c69a88f8 in term 1.
I20260709 12:08:48.188140 25997 leader_election.cc:304] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8; no voters: 0377e4c589564e739a0bba757431dcdd
I20260709 12:08:48.189689 26191 raft_consensus.cc:2804] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.190296 26191 raft_consensus.cc:697] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [term 1 LEADER]: Becoming Leader. State: Replica: efc868618423419db4b805b6c69a88f8, State: Running, Role: LEADER
I20260709 12:08:48.192512 26147 tablet_bootstrap.cc:492] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd: No bootstrap required, opened a new log
I20260709 12:08:48.192987 26147 ts_tablet_manager.cc:1403] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 12:08:48.191162 26191 consensus_queue.cc:237] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.195825 26147 raft_consensus.cc:359] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.196533 26147 raft_consensus.cc:385] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.196802 26147 raft_consensus.cc:740] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.197515 26147 consensus_queue.cc:260] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.199651 26147 ts_tablet_manager.cc:1434] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:08:48.200932 26147 tablet_bootstrap.cc:492] T 101efc883fed47bc9c7bfabb594c138e P 0377e4c589564e739a0bba757431dcdd: Bootstrap starting.
I20260709 12:08:48.208057 26147 tablet_bootstrap.cc:654] T 101efc883fed47bc9c7bfabb594c138e P 0377e4c589564e739a0bba757431dcdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.209524 25853 catalog_manager.cc:5697] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to efc868618423419db4b805b6c69a88f8 (127.24.179.66). New cstate: current_term: 1 leader_uuid: "efc868618423419db4b805b6c69a88f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.213042 26147 tablet_bootstrap.cc:492] T 101efc883fed47bc9c7bfabb594c138e P 0377e4c589564e739a0bba757431dcdd: No bootstrap required, opened a new log
I20260709 12:08:48.213486 26147 ts_tablet_manager.cc:1403] T 101efc883fed47bc9c7bfabb594c138e P 0377e4c589564e739a0bba757431dcdd: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:08:48.215802 26147 raft_consensus.cc:359] T 101efc883fed47bc9c7bfabb594c138e P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.216293 26147 raft_consensus.cc:385] T 101efc883fed47bc9c7bfabb594c138e P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.216571 26147 raft_consensus.cc:740] T 101efc883fed47bc9c7bfabb594c138e P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.217237 26147 consensus_queue.cc:260] T 101efc883fed47bc9c7bfabb594c138e P 0377e4c589564e739a0bba757431dcdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.219255 26147 ts_tablet_manager.cc:1434] T 101efc883fed47bc9c7bfabb594c138e P 0377e4c589564e739a0bba757431dcdd: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:08:48.356249 26105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "444afdba57744ac6ac09fccdd0418fca"
dest_uuid: "55a3a2c2e13946209305e725c47fab94"
mode: GRACEFUL
new_leader_uuid: "0377e4c589564e739a0bba757431dcdd"
 from {username='slave'} at 127.0.0.1:35420
I20260709 12:08:48.356856 26105 raft_consensus.cc:606] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 1 LEADER]: Received request to transfer leadership to TS 0377e4c589564e739a0bba757431dcdd
I20260709 12:08:48.374589 26031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a82be63df514556be057c830c06e2eb"
dest_uuid: "efc868618423419db4b805b6c69a88f8"
mode: GRACEFUL
new_leader_uuid: "0377e4c589564e739a0bba757431dcdd"
 from {username='slave'} at 127.0.0.1:60170
I20260709 12:08:48.375110 26031 raft_consensus.cc:606] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 1 LEADER]: Received request to transfer leadership to TS 0377e4c589564e739a0bba757431dcdd
I20260709 12:08:48.377660 26155 raft_consensus.cc:493] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.378147 26155 raft_consensus.cc:515] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.380158 26155 leader_election.cc:290] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223)
I20260709 12:08:48.381297 26031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0798b624814b23ba96d2361b4961aa" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc868618423419db4b805b6c69a88f8" is_pre_election: true
I20260709 12:08:48.381181 25957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0798b624814b23ba96d2361b4961aa" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0377e4c589564e739a0bba757431dcdd" is_pre_election: true
I20260709 12:08:48.381115 26105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7e1bba4da21410685f7001aa07bfca5"
dest_uuid: "55a3a2c2e13946209305e725c47fab94"
mode: GRACEFUL
new_leader_uuid: "0377e4c589564e739a0bba757431dcdd"
 from {username='slave'} at 127.0.0.1:35420
I20260709 12:08:48.382264 26105 raft_consensus.cc:606] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [term 1 LEADER]: Received request to transfer leadership to TS 0377e4c589564e739a0bba757431dcdd
I20260709 12:08:48.382386 25957 raft_consensus.cc:2393] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55a3a2c2e13946209305e725c47fab94 in current term 1: Already voted for candidate efc868618423419db4b805b6c69a88f8 in this term.
I20260709 12:08:48.383688 26070 leader_election.cc:304] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55a3a2c2e13946209305e725c47fab94; no voters: 0377e4c589564e739a0bba757431dcdd, efc868618423419db4b805b6c69a88f8
I20260709 12:08:48.384531 26155 raft_consensus.cc:3060] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.391208 26155 raft_consensus.cc:2749] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.395058 26105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4c07440e5674cd4b07a3d2c3a353a8b"
dest_uuid: "55a3a2c2e13946209305e725c47fab94"
mode: GRACEFUL
new_leader_uuid: "efc868618423419db4b805b6c69a88f8"
 from {username='slave'} at 127.0.0.1:35420
I20260709 12:08:48.395706 26105 raft_consensus.cc:606] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 1 LEADER]: Received request to transfer leadership to TS efc868618423419db4b805b6c69a88f8
I20260709 12:08:48.395901 26164 raft_consensus.cc:493] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.396368 26164 raft_consensus.cc:515] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.398378 26164 leader_election.cc:290] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:08:48.399262 26031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c07440e5674cd4b07a3d2c3a353a8b" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc868618423419db4b805b6c69a88f8" is_pre_election: true
I20260709 12:08:48.399437 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c07440e5674cd4b07a3d2c3a353a8b" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a3a2c2e13946209305e725c47fab94" is_pre_election: true
I20260709 12:08:48.400133 26031 raft_consensus.cc:2393] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0377e4c589564e739a0bba757431dcdd in current term 1: Already voted for candidate 55a3a2c2e13946209305e725c47fab94 in this term.
I20260709 12:08:48.401364 25923 leader_election.cc:304] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd; no voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8
I20260709 12:08:48.402104 26164 raft_consensus.cc:3060] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.405526 26105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87545e0697f64558a1918d9dafd04b1f"
dest_uuid: "55a3a2c2e13946209305e725c47fab94"
mode: GRACEFUL
new_leader_uuid: "efc868618423419db4b805b6c69a88f8"
 from {username='slave'} at 127.0.0.1:35420
I20260709 12:08:48.406227 26105 raft_consensus.cc:606] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [term 1 LEADER]: Received request to transfer leadership to TS efc868618423419db4b805b6c69a88f8
I20260709 12:08:48.408553 26164 raft_consensus.cc:2749] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.412719 26031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "101efc883fed47bc9c7bfabb594c138e"
dest_uuid: "efc868618423419db4b805b6c69a88f8"
mode: GRACEFUL
new_leader_uuid: "55a3a2c2e13946209305e725c47fab94"
 from {username='slave'} at 127.0.0.1:60170
I20260709 12:08:48.413307 26031 raft_consensus.cc:606] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [term 1 LEADER]: Received request to transfer leadership to TS 55a3a2c2e13946209305e725c47fab94
I20260709 12:08:48.420895 26155 consensus_queue.cc:1048] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.424643 26164 consensus_queue.cc:1048] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.429112 26193 raft_consensus.cc:993] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94: : Instructing follower 0377e4c589564e739a0bba757431dcdd to start an election
I20260709 12:08:48.435914 26183 consensus_queue.cc:1048] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.429656 26155 raft_consensus.cc:1081] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [term 1 LEADER]: Signalling peer 0377e4c589564e739a0bba757431dcdd to start an election
I20260709 12:08:48.443959 26164 raft_consensus.cc:493] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.444192 25957 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7e1bba4da21410685f7001aa07bfca5"
dest_uuid: "0377e4c589564e739a0bba757431dcdd"
 from {username='slave'} at 127.0.0.1:37064
I20260709 12:08:48.445204 26184 consensus_queue.cc:1048] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.445593 25957 raft_consensus.cc:493] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.446178 25957 raft_consensus.cc:3060] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.445214 26164 raft_consensus.cc:515] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.458477 26030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87545e0697f64558a1918d9dafd04b1f" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc868618423419db4b805b6c69a88f8" is_pre_election: true
I20260709 12:08:48.459484 26030 raft_consensus.cc:2393] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0377e4c589564e739a0bba757431dcdd in current term 1: Already voted for candidate 55a3a2c2e13946209305e725c47fab94 in this term.
I20260709 12:08:48.461225 26155 consensus_queue.cc:1048] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.462716 26164 leader_election.cc:290] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:08:48.464031 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87545e0697f64558a1918d9dafd04b1f" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a3a2c2e13946209305e725c47fab94" is_pre_election: true
I20260709 12:08:48.466341 25922 leader_election.cc:304] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd; no voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8
I20260709 12:08:48.469355 25957 raft_consensus.cc:515] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.474211 25957 leader_election.cc:290] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 2 election: Requested vote from peers efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:08:48.476470 26030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1bba4da21410685f7001aa07bfca5" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc868618423419db4b805b6c69a88f8"
I20260709 12:08:48.477839 26183 consensus_queue.cc:1048] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.480294 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e1bba4da21410685f7001aa07bfca5" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "55a3a2c2e13946209305e725c47fab94"
I20260709 12:08:48.481081 26105 raft_consensus.cc:3055] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.481518 26105 raft_consensus.cc:740] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Running, Role: LEADER
I20260709 12:08:48.481992 26220 raft_consensus.cc:3060] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.482427 26105 consensus_queue.cc:260] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.484527 26105 raft_consensus.cc:3060] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.490339 26220 raft_consensus.cc:2749] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.491961 26220 raft_consensus.cc:493] T 101efc883fed47bc9c7bfabb594c138e P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.492504 26220 raft_consensus.cc:515] T 101efc883fed47bc9c7bfabb594c138e P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.494067 26191 consensus_queue.cc:1048] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.495779 26220 leader_election.cc:290] T 101efc883fed47bc9c7bfabb594c138e P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:08:48.497627 26105 raft_consensus.cc:2468] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 2.
I20260709 12:08:48.498137 26164 consensus_queue.cc:1048] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.503548 26030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101efc883fed47bc9c7bfabb594c138e" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc868618423419db4b805b6c69a88f8" is_pre_election: true
I20260709 12:08:48.510661 26224 consensus_queue.cc:1048] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.496776 26184 raft_consensus.cc:993] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8: : Instructing follower 0377e4c589564e739a0bba757431dcdd to start an election
I20260709 12:08:48.512200 26185 raft_consensus.cc:1081] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 1 LEADER]: Signalling peer 0377e4c589564e739a0bba757431dcdd to start an election
I20260709 12:08:48.524955 25922 leader_election.cc:304] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd, 55a3a2c2e13946209305e725c47fab94; no voters: efc868618423419db4b805b6c69a88f8
I20260709 12:08:48.526959 26164 raft_consensus.cc:2804] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.527845 25957 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a82be63df514556be057c830c06e2eb"
dest_uuid: "0377e4c589564e739a0bba757431dcdd"
 from {username='slave'} at 127.0.0.1:37072
I20260709 12:08:48.530014 25957 raft_consensus.cc:493] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.529331 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101efc883fed47bc9c7bfabb594c138e" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a3a2c2e13946209305e725c47fab94" is_pre_election: true
I20260709 12:08:48.533290 26105 raft_consensus.cc:2393] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0377e4c589564e739a0bba757431dcdd in current term 1: Already voted for candidate efc868618423419db4b805b6c69a88f8 in this term.
I20260709 12:08:48.530579 26164 raft_consensus.cc:697] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd [term 2 LEADER]: Becoming Leader. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Running, Role: LEADER
I20260709 12:08:48.536125 26183 raft_consensus.cc:993] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94: : Instructing follower 0377e4c589564e739a0bba757431dcdd to start an election
I20260709 12:08:48.536595 26183 raft_consensus.cc:1081] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 1 LEADER]: Signalling peer 0377e4c589564e739a0bba757431dcdd to start an election
I20260709 12:08:48.537027 25957 raft_consensus.cc:3060] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.548915 25955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "444afdba57744ac6ac09fccdd0418fca"
dest_uuid: "0377e4c589564e739a0bba757431dcdd"
 from {username='slave'} at 127.0.0.1:37064
I20260709 12:08:48.550740 25955 raft_consensus.cc:493] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.551234 25955 raft_consensus.cc:3060] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.555142 26164 consensus_queue.cc:237] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.537400 25922 leader_election.cc:304] T 101efc883fed47bc9c7bfabb594c138e P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd; no voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8
I20260709 12:08:48.571458 26223 raft_consensus.cc:3060] T 101efc883fed47bc9c7bfabb594c138e P 0377e4c589564e739a0bba757431dcdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.585853 25955 raft_consensus.cc:515] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } }
I20260709 12:08:48.585646 25957 raft_consensus.cc:515] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.588896 25957 leader_election.cc:290] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 2 election: Requested vote from peers efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:08:48.589653 26033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a82be63df514556be057c830c06e2eb" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc868618423419db4b805b6c69a88f8"
I20260709 12:08:48.590745 26033 raft_consensus.cc:3055] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.591089 26033 raft_consensus.cc:740] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc868618423419db4b805b6c69a88f8, State: Running, Role: LEADER
I20260709 12:08:48.591957 26033 consensus_queue.cc:260] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.594226 26033 raft_consensus.cc:3060] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.595309 26031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444afdba57744ac6ac09fccdd0418fca" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc868618423419db4b805b6c69a88f8"
I20260709 12:08:48.596091 26031 raft_consensus.cc:3060] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.597496 25955 leader_election.cc:290] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 2 election: Requested vote from peers 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175), efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223)
I20260709 12:08:48.603199 26033 raft_consensus.cc:2468] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 2.
I20260709 12:08:48.604537 25923 leader_election.cc:304] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:08:48.604990 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444afdba57744ac6ac09fccdd0418fca" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "55a3a2c2e13946209305e725c47fab94"
I20260709 12:08:48.605578 26105 raft_consensus.cc:3055] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.605811 26105 raft_consensus.cc:740] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Running, Role: LEADER
I20260709 12:08:48.606571 26105 consensus_queue.cc:260] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } }
I20260709 12:08:48.607404 26105 raft_consensus.cc:3060] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.607739 26220 consensus_queue.cc:1048] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.609473 26220 raft_consensus.cc:2804] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.609972 26220 raft_consensus.cc:697] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [term 2 LEADER]: Becoming Leader. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Running, Role: LEADER
I20260709 12:08:48.610872 26220 consensus_queue.cc:237] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.611373 26155 consensus_queue.cc:1048] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.617061 26223 raft_consensus.cc:2749] T 101efc883fed47bc9c7bfabb594c138e P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.617857 26107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a82be63df514556be057c830c06e2eb" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "55a3a2c2e13946209305e725c47fab94"
I20260709 12:08:48.624177 26107 raft_consensus.cc:3060] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.624703 26184 consensus_queue.cc:1048] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.617527 26191 consensus_queue.cc:1048] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.607393 26031 raft_consensus.cc:2468] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 2.
I20260709 12:08:48.632071 25923 leader_election.cc:304] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:08:48.633386 26220 raft_consensus.cc:2804] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.634282 26220 raft_consensus.cc:697] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 2 LEADER]: Becoming Leader. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Running, Role: LEADER
I20260709 12:08:48.635423 26220 consensus_queue.cc:237] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } }
I20260709 12:08:48.637424 26105 raft_consensus.cc:2468] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 2.
I20260709 12:08:48.622284 25852 catalog_manager.cc:5697] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd reported cstate change: term changed from 1 to 2, leader changed from 55a3a2c2e13946209305e725c47fab94 (127.24.179.67) to 0377e4c589564e739a0bba757431dcdd (127.24.179.65). New cstate: current_term: 2 leader_uuid: "0377e4c589564e739a0bba757431dcdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.641386 26184 consensus_queue.cc:1048] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:08:48.656872 26185 consensus_queue.cc:1048] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.658545 26107 raft_consensus.cc:2468] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 2.
I20260709 12:08:48.655675 26155 consensus_queue.cc:1048] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.690197 26191 consensus_queue.cc:1048] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.692901 26183 raft_consensus.cc:993] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94: : Instructing follower efc868618423419db4b805b6c69a88f8 to start an election
I20260709 12:08:48.693390 26155 raft_consensus.cc:1081] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 1 LEADER]: Signalling peer efc868618423419db4b805b6c69a88f8 to start an election
I20260709 12:08:48.696164 26030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4c07440e5674cd4b07a3d2c3a353a8b"
dest_uuid: "efc868618423419db4b805b6c69a88f8"
 from {username='slave'} at 127.0.0.1:60156
I20260709 12:08:48.697279 26030 raft_consensus.cc:493] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.697782 26030 raft_consensus.cc:3060] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.709380 26184 raft_consensus.cc:993] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8: : Instructing follower 55a3a2c2e13946209305e725c47fab94 to start an election
I20260709 12:08:48.709896 26184 raft_consensus.cc:1081] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [term 1 LEADER]: Signalling peer 55a3a2c2e13946209305e725c47fab94 to start an election
I20260709 12:08:48.718276 26030 raft_consensus.cc:515] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.719753 26031 raft_consensus.cc:1240] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Rejecting Update request from peer 55a3a2c2e13946209305e725c47fab94 for earlier term 1. Current term is 2. Ops: []
I20260709 12:08:48.723500 25954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c07440e5674cd4b07a3d2c3a353a8b" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0377e4c589564e739a0bba757431dcdd"
I20260709 12:08:48.724489 25954 raft_consensus.cc:3060] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.724699 26105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "101efc883fed47bc9c7bfabb594c138e"
dest_uuid: "55a3a2c2e13946209305e725c47fab94"
 from {username='slave'} at 127.0.0.1:35418
I20260709 12:08:48.724565 26184 consensus_queue.cc:1048] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.725399 26105 raft_consensus.cc:493] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.725831 26105 raft_consensus.cc:3060] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.726090 26181 consensus_queue.cc:1059] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.727134 26181 raft_consensus.cc:3055] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.727463 26181 raft_consensus.cc:740] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Running, Role: LEADER
I20260709 12:08:48.728338 26181 consensus_queue.cc:260] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.729493 26181 raft_consensus.cc:3060] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.733392 26105 raft_consensus.cc:515] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.734638 25954 raft_consensus.cc:2468] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc868618423419db4b805b6c69a88f8 in term 2.
I20260709 12:08:48.736140 26030 leader_election.cc:290] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 2 election: Requested vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:08:48.736721 26104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c07440e5674cd4b07a3d2c3a353a8b" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "55a3a2c2e13946209305e725c47fab94"
I20260709 12:08:48.736177 25996 leader_election.cc:304] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:08:48.739708 26184 raft_consensus.cc:2804] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.740159 26184 raft_consensus.cc:697] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 2 LEADER]: Becoming Leader. State: Replica: efc868618423419db4b805b6c69a88f8, State: Running, Role: LEADER
I20260709 12:08:48.740900 26184 consensus_queue.cc:237] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.742009 26105 leader_election.cc:290] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 2 election: Requested vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223)
I20260709 12:08:48.742496 25954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101efc883fed47bc9c7bfabb594c138e" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0377e4c589564e739a0bba757431dcdd"
I20260709 12:08:48.745635 26030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "101efc883fed47bc9c7bfabb594c138e" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc868618423419db4b805b6c69a88f8"
I20260709 12:08:48.746291 26030 raft_consensus.cc:3055] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.746665 26030 raft_consensus.cc:740] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc868618423419db4b805b6c69a88f8, State: Running, Role: LEADER
I20260709 12:08:48.746544 25853 catalog_manager.cc:5697] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd reported cstate change: term changed from 1 to 2, leader changed from efc868618423419db4b805b6c69a88f8 (127.24.179.66) to 0377e4c589564e739a0bba757431dcdd (127.24.179.65). New cstate: current_term: 2 leader_uuid: "0377e4c589564e739a0bba757431dcdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.747531 26030 consensus_queue.cc:260] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.748670 26030 raft_consensus.cc:3060] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.748617 25853 catalog_manager.cc:5697] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd reported cstate change: term changed from 1 to 2, leader changed from 55a3a2c2e13946209305e725c47fab94 (127.24.179.67) to 0377e4c589564e739a0bba757431dcdd (127.24.179.65). New cstate: current_term: 2 leader_uuid: "0377e4c589564e739a0bba757431dcdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:48.756237 26030 raft_consensus.cc:2468] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 2.
I20260709 12:08:48.758456 26072 leader_election.cc:304] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8; no voters: 0377e4c589564e739a0bba757431dcdd
I20260709 12:08:48.759337 26193 raft_consensus.cc:2804] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.759832 26193 raft_consensus.cc:697] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 [term 2 LEADER]: Becoming Leader. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Running, Role: LEADER
I20260709 12:08:48.760771 26193 consensus_queue.cc:237] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.763105 26104 raft_consensus.cc:2468] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc868618423419db4b805b6c69a88f8 in term 2.
I20260709 12:08:48.775461 25853 catalog_manager.cc:5697] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 reported cstate change: term changed from 1 to 2, leader changed from 55a3a2c2e13946209305e725c47fab94 (127.24.179.67) to efc868618423419db4b805b6c69a88f8 (127.24.179.66). New cstate: current_term: 2 leader_uuid: "efc868618423419db4b805b6c69a88f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.786355 26193 consensus_queue.cc:1048] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.790599 26193 consensus_queue.cc:1048] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.792724 25855 catalog_manager.cc:5697] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 reported cstate change: term changed from 1 to 2, leader changed from efc868618423419db4b805b6c69a88f8 (127.24.179.66) to 55a3a2c2e13946209305e725c47fab94 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "55a3a2c2e13946209305e725c47fab94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:48.811582 26181 raft_consensus.cc:993] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94: : Instructing follower efc868618423419db4b805b6c69a88f8 to start an election
I20260709 12:08:48.812110 26193 raft_consensus.cc:1081] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [term 1 LEADER]: Signalling peer efc868618423419db4b805b6c69a88f8 to start an election
I20260709 12:08:48.814491 26030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87545e0697f64558a1918d9dafd04b1f"
dest_uuid: "efc868618423419db4b805b6c69a88f8"
 from {username='slave'} at 127.0.0.1:60156
I20260709 12:08:48.815964 26030 raft_consensus.cc:493] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.816416 26030 raft_consensus.cc:3060] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.823313 26030 raft_consensus.cc:515] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.825711 26030 leader_election.cc:290] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 2 election: Requested vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:08:48.826148 25955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87545e0697f64558a1918d9dafd04b1f" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0377e4c589564e739a0bba757431dcdd"
I20260709 12:08:48.826633 26104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87545e0697f64558a1918d9dafd04b1f" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "55a3a2c2e13946209305e725c47fab94"
I20260709 12:08:48.826857 25955 raft_consensus.cc:3060] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.827266 26104 raft_consensus.cc:3055] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.827616 26104 raft_consensus.cc:740] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Running, Role: LEADER
I20260709 12:08:48.828480 26104 consensus_queue.cc:260] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.829768 26104 raft_consensus.cc:3060] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.832412 25955 raft_consensus.cc:2468] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc868618423419db4b805b6c69a88f8 in term 2.
I20260709 12:08:48.833475 25996 leader_election.cc:304] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:08:48.834208 26184 raft_consensus.cc:2804] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.834686 26184 raft_consensus.cc:697] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 [term 2 LEADER]: Becoming Leader. State: Replica: efc868618423419db4b805b6c69a88f8, State: Running, Role: LEADER
I20260709 12:08:48.835423 26184 consensus_queue.cc:237] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:48.836400 26104 raft_consensus.cc:2468] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc868618423419db4b805b6c69a88f8 in term 2.
I20260709 12:08:48.842808 25852 catalog_manager.cc:5697] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 reported cstate change: term changed from 1 to 2, leader changed from 55a3a2c2e13946209305e725c47fab94 (127.24.179.67) to efc868618423419db4b805b6c69a88f8 (127.24.179.66). New cstate: current_term: 2 leader_uuid: "efc868618423419db4b805b6c69a88f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.973659 26030 raft_consensus.cc:3060] T a7e1bba4da21410685f7001aa07bfca5 P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.978719 26030 raft_consensus.cc:1275] T a7e1bba4da21410685f7001aa07bfca5 P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Refusing update from remote peer 0377e4c589564e739a0bba757431dcdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:48.980181 26223 consensus_queue.cc:1048] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:48.986946 26104 raft_consensus.cc:1275] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Refusing update from remote peer 0377e4c589564e739a0bba757431dcdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:48.989054 26223 consensus_queue.cc:1048] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.016147 26104 raft_consensus.cc:1275] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Refusing update from remote peer 0377e4c589564e739a0bba757431dcdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.017606 26223 consensus_queue.cc:1048] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.026121 26030 raft_consensus.cc:1275] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Refusing update from remote peer 0377e4c589564e739a0bba757431dcdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.028095 26220 consensus_queue.cc:1048] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.131676 26104 raft_consensus.cc:1275] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Refusing update from remote peer 0377e4c589564e739a0bba757431dcdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.132247 26107 raft_consensus.cc:1275] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Refusing update from remote peer efc868618423419db4b805b6c69a88f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.133164 26220 consensus_queue.cc:1048] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.133920 26191 consensus_queue.cc:1048] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.147514 25955 raft_consensus.cc:1275] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Refusing update from remote peer efc868618423419db4b805b6c69a88f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.149080 26030 raft_consensus.cc:1275] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Refusing update from remote peer 0377e4c589564e739a0bba757431dcdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.148967 26243 consensus_queue.cc:1048] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.150589 26220 consensus_queue.cc:1048] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.249912 26030 raft_consensus.cc:1275] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Refusing update from remote peer 55a3a2c2e13946209305e725c47fab94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.251375 26193 consensus_queue.cc:1048] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.259202 25955 raft_consensus.cc:3060] T 101efc883fed47bc9c7bfabb594c138e P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.266840 25955 raft_consensus.cc:1275] T 101efc883fed47bc9c7bfabb594c138e P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Refusing update from remote peer 55a3a2c2e13946209305e725c47fab94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.268199 26155 consensus_queue.cc:1048] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.278162 25955 raft_consensus.cc:1275] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Refusing update from remote peer efc868618423419db4b805b6c69a88f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.279768 26243 consensus_queue.cc:1048] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.289002 26104 raft_consensus.cc:1275] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Refusing update from remote peer efc868618423419db4b805b6c69a88f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.290845 26185 consensus_queue.cc:1048] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:08:50.264971 25923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:44223, user_credentials={real_user=slave}} blocked reactor thread for 73349.3us
W20260709 12:08:50.456854 25996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:43227, user_credentials={real_user=slave}} blocked reactor thread for 67348.8us
W20260709 12:08:51.321264 25979 debug-util.cc:398] Leaking SignalData structure 0x7b08001d2740 after lost signal to thread 25296
W20260709 12:08:51.322130 25979 debug-util.cc:398] Leaking SignalData structure 0x7b08001ba4c0 after lost signal to thread 25890
W20260709 12:08:51.323035 25979 debug-util.cc:398] Leaking SignalData structure 0x7b080008df20 after lost signal to thread 25982
W20260709 12:08:51.323755 25979 debug-util.cc:398] Leaking SignalData structure 0x7b080008c7c0 after lost signal to thread 26057
W20260709 12:08:51.324437 25979 debug-util.cc:398] Leaking SignalData structure 0x7b08001ba700 after lost signal to thread 26131
W20260709 12:08:51.324685 25979 debug-util.cc:398] Leaking SignalData structure 0x7b080014a440 after lost signal to thread 26155
I20260709 12:08:51.649297 25293 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:08:51.650074 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:51.673477 25955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "444afdba57744ac6ac09fccdd0418fca"
dest_uuid: "0377e4c589564e739a0bba757431dcdd"
mode: GRACEFUL
new_leader_uuid: "55a3a2c2e13946209305e725c47fab94"
 from {username='slave'} at 127.0.0.1:37088
I20260709 12:08:51.674096 25955 raft_consensus.cc:606] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 2 LEADER]: Received request to transfer leadership to TS 55a3a2c2e13946209305e725c47fab94
I20260709 12:08:51.677021 25955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d494488b914e40ddb30ce096a17593d7"
dest_uuid: "0377e4c589564e739a0bba757431dcdd"
mode: GRACEFUL
new_leader_uuid: "55a3a2c2e13946209305e725c47fab94"
 from {username='slave'} at 127.0.0.1:37088
I20260709 12:08:51.677608 25955 raft_consensus.cc:606] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 1 LEADER]: Received request to transfer leadership to TS 55a3a2c2e13946209305e725c47fab94
I20260709 12:08:51.678969 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:51.679662 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:51.805270 26252 raft_consensus.cc:993] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd: : Instructing follower 55a3a2c2e13946209305e725c47fab94 to start an election
I20260709 12:08:51.805788 26164 raft_consensus.cc:1081] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 2 LEADER]: Signalling peer 55a3a2c2e13946209305e725c47fab94 to start an election
I20260709 12:08:51.807435 26105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "444afdba57744ac6ac09fccdd0418fca"
dest_uuid: "55a3a2c2e13946209305e725c47fab94"
 from {username='slave'} at 127.0.0.1:57906
I20260709 12:08:51.807951 26105 raft_consensus.cc:493] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:51.808272 26105 raft_consensus.cc:3060] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:51.813568 26105 raft_consensus.cc:515] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } }
I20260709 12:08:51.816183 26105 leader_election.cc:290] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 3 election: Requested vote from peers efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223), 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227)
I20260709 12:08:51.816643 25955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444afdba57744ac6ac09fccdd0418fca" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0377e4c589564e739a0bba757431dcdd"
I20260709 12:08:51.816708 26031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444afdba57744ac6ac09fccdd0418fca" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "efc868618423419db4b805b6c69a88f8"
I20260709 12:08:51.817365 25955 raft_consensus.cc:3055] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:51.817448 26031 raft_consensus.cc:3060] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:51.817808 25955 raft_consensus.cc:740] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Running, Role: LEADER
I20260709 12:08:51.818682 25955 consensus_queue.cc:260] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } }
I20260709 12:08:51.819769 25955 raft_consensus.cc:3060] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:51.825256 25955 raft_consensus.cc:2468] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 3.
I20260709 12:08:51.825978 26031 raft_consensus.cc:2468] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 3.
I20260709 12:08:51.826546 26070 leader_election.cc:304] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd, 55a3a2c2e13946209305e725c47fab94; no voters: 
I20260709 12:08:51.827361 26246 raft_consensus.cc:2804] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:51.828751 26246 raft_consensus.cc:697] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 3 LEADER]: Becoming Leader. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Running, Role: LEADER
I20260709 12:08:51.829604 26246 consensus_queue.cc:237] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } }
I20260709 12:08:51.842453 25855 catalog_manager.cc:5697] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 reported cstate change: term changed from 2 to 3, leader changed from 0377e4c589564e739a0bba757431dcdd (127.24.179.65) to 55a3a2c2e13946209305e725c47fab94 (127.24.179.67). New cstate: current_term: 3 leader_uuid: "55a3a2c2e13946209305e725c47fab94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:51.996170 26252 raft_consensus.cc:993] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd: : Instructing follower 55a3a2c2e13946209305e725c47fab94 to start an election
I20260709 12:08:51.997822 26252 raft_consensus.cc:1081] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 1 LEADER]: Signalling peer 55a3a2c2e13946209305e725c47fab94 to start an election
I20260709 12:08:51.999953 26105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d494488b914e40ddb30ce096a17593d7"
dest_uuid: "55a3a2c2e13946209305e725c47fab94"
 from {username='slave'} at 127.0.0.1:57906
I20260709 12:08:52.000614 26105 raft_consensus.cc:493] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:52.001015 26105 raft_consensus.cc:3060] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:52.009208 26105 raft_consensus.cc:515] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:52.011554 26105 leader_election.cc:290] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 2 election: Requested vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223)
I20260709 12:08:52.012527 25955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d494488b914e40ddb30ce096a17593d7" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0377e4c589564e739a0bba757431dcdd"
I20260709 12:08:52.013260 25955 raft_consensus.cc:3055] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:52.013600 25955 raft_consensus.cc:740] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Running, Role: LEADER
I20260709 12:08:52.014642 26031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d494488b914e40ddb30ce096a17593d7" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc868618423419db4b805b6c69a88f8"
I20260709 12:08:52.014492 25955 consensus_queue.cc:260] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:52.015220 26031 raft_consensus.cc:3060] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:52.015977 25955 raft_consensus.cc:3060] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:52.020391 26031 raft_consensus.cc:2468] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 2.
I20260709 12:08:52.021725 26072 leader_election.cc:304] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:08:52.022547 26246 raft_consensus.cc:2804] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:52.023038 26246 raft_consensus.cc:697] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 2 LEADER]: Becoming Leader. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Running, Role: LEADER
I20260709 12:08:52.023806 26246 consensus_queue.cc:237] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:08:52.025054 25955 raft_consensus.cc:2468] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 2.
I20260709 12:08:52.032037 25855 catalog_manager.cc:5697] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 reported cstate change: term changed from 1 to 2, leader changed from 0377e4c589564e739a0bba757431dcdd (127.24.179.65) to 55a3a2c2e13946209305e725c47fab94 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "55a3a2c2e13946209305e725c47fab94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:52.388737 26031 raft_consensus.cc:1275] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8 [term 3 FOLLOWER]: Refusing update from remote peer 55a3a2c2e13946209305e725c47fab94: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:52.389946 25955 raft_consensus.cc:1275] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 3 FOLLOWER]: Refusing update from remote peer 55a3a2c2e13946209305e725c47fab94: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:52.390139 26246 consensus_queue.cc:1048] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:52.391646 26246 consensus_queue.cc:1048] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:52.438272 26030 raft_consensus.cc:1275] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Refusing update from remote peer 55a3a2c2e13946209305e725c47fab94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:52.440076 26246 consensus_queue.cc:1048] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:52.455677 25954 raft_consensus.cc:1275] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Refusing update from remote peer 55a3a2c2e13946209305e725c47fab94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:52.467150 26270 consensus_queue.cc:1048] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:52.680877 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:52.686585 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:52.687032 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:53.688155 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:53.694725 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:53.695153 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:54.696201 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:54.701683 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:54.702214 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:55.703496 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:55.709841 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:55.710247 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:56.711428 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:56.717249 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:56.717684 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:57.718858 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:57.724357 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:57.724977 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:58.725960 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:58.731393 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:58.731791 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:59.732867 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:59.738672 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:59.739137 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:00.740188 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:00.745824 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:00.746296 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:01.778834 25293 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:09:01.783676 26105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "444afdba57744ac6ac09fccdd0418fca"
dest_uuid: "55a3a2c2e13946209305e725c47fab94"
mode: GRACEFUL
new_leader_uuid: "0377e4c589564e739a0bba757431dcdd"
 from {username='slave'} at 127.0.0.1:35420
I20260709 12:09:01.784433 26105 raft_consensus.cc:606] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 3 LEADER]: Received request to transfer leadership to TS 0377e4c589564e739a0bba757431dcdd
I20260709 12:09:01.797644 26105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d494488b914e40ddb30ce096a17593d7"
dest_uuid: "55a3a2c2e13946209305e725c47fab94"
mode: GRACEFUL
new_leader_uuid: "0377e4c589564e739a0bba757431dcdd"
 from {username='slave'} at 127.0.0.1:35420
I20260709 12:09:01.798094 26105 raft_consensus.cc:606] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 2 LEADER]: Received request to transfer leadership to TS 0377e4c589564e739a0bba757431dcdd
I20260709 12:09:01.802884 26030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b4404e44e814753b1da44e2d750857f"
dest_uuid: "efc868618423419db4b805b6c69a88f8"
mode: GRACEFUL
new_leader_uuid: "0377e4c589564e739a0bba757431dcdd"
 from {username='slave'} at 127.0.0.1:60170
I20260709 12:09:01.803404 26030 raft_consensus.cc:606] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [term 1 LEADER]: Received request to transfer leadership to TS 0377e4c589564e739a0bba757431dcdd
I20260709 12:09:01.808462 26030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4c07440e5674cd4b07a3d2c3a353a8b"
dest_uuid: "efc868618423419db4b805b6c69a88f8"
mode: GRACEFUL
new_leader_uuid: "0377e4c589564e739a0bba757431dcdd"
 from {username='slave'} at 127.0.0.1:60170
I20260709 12:09:01.808962 26030 raft_consensus.cc:606] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 2 LEADER]: Received request to transfer leadership to TS 0377e4c589564e739a0bba757431dcdd
I20260709 12:09:01.813812 26030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e0798b624814b23ba96d2361b4961aa"
dest_uuid: "efc868618423419db4b805b6c69a88f8"
mode: GRACEFUL
new_leader_uuid: "0377e4c589564e739a0bba757431dcdd"
 from {username='slave'} at 127.0.0.1:60170
I20260709 12:09:01.814352 26030 raft_consensus.cc:606] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [term 1 LEADER]: Received request to transfer leadership to TS 0377e4c589564e739a0bba757431dcdd
I20260709 12:09:01.824658 26281 raft_consensus.cc:993] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8: : Instructing follower 0377e4c589564e739a0bba757431dcdd to start an election
I20260709 12:09:01.825191 26283 raft_consensus.cc:1081] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [term 1 LEADER]: Signalling peer 0377e4c589564e739a0bba757431dcdd to start an election
I20260709 12:09:01.826736 25955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b4404e44e814753b1da44e2d750857f"
dest_uuid: "0377e4c589564e739a0bba757431dcdd"
 from {username='slave'} at 127.0.0.1:37072
I20260709 12:09:01.827179 25955 raft_consensus.cc:493] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:01.827493 25955 raft_consensus.cc:3060] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:01.832789 25955 raft_consensus.cc:515] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:01.834581 25955 leader_election.cc:290] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 2 election: Requested vote from peers efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:09:01.835644 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4404e44e814753b1da44e2d750857f" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "55a3a2c2e13946209305e725c47fab94"
I20260709 12:09:01.835460 26030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4404e44e814753b1da44e2d750857f" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc868618423419db4b805b6c69a88f8"
I20260709 12:09:01.836259 26105 raft_consensus.cc:3060] T 3b4404e44e814753b1da44e2d750857f P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:01.836354 26030 raft_consensus.cc:3055] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:01.836716 26030 raft_consensus.cc:740] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc868618423419db4b805b6c69a88f8, State: Running, Role: LEADER
I20260709 12:09:01.837508 26030 consensus_queue.cc:260] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:01.838551 26030 raft_consensus.cc:3060] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:01.841414 26105 raft_consensus.cc:2468] T 3b4404e44e814753b1da44e2d750857f P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 2.
I20260709 12:09:01.842803 25922 leader_election.cc:304] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd, 55a3a2c2e13946209305e725c47fab94; no voters: 
I20260709 12:09:01.843767 26252 raft_consensus.cc:2804] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:01.843940 26030 raft_consensus.cc:2468] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 2.
I20260709 12:09:01.844807 26252 raft_consensus.cc:697] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd [term 2 LEADER]: Becoming Leader. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Running, Role: LEADER
I20260709 12:09:01.845839 26252 consensus_queue.cc:237] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:01.852952 25852 catalog_manager.cc:5697] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd reported cstate change: term changed from 1 to 2, leader changed from efc868618423419db4b805b6c69a88f8 (127.24.179.66) to 0377e4c589564e739a0bba757431dcdd (127.24.179.65). New cstate: current_term: 2 leader_uuid: "0377e4c589564e739a0bba757431dcdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:01.936452 26282 raft_consensus.cc:993] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94: : Instructing follower 0377e4c589564e739a0bba757431dcdd to start an election
I20260709 12:09:01.936895 26282 raft_consensus.cc:1081] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 2 LEADER]: Signalling peer 0377e4c589564e739a0bba757431dcdd to start an election
I20260709 12:09:01.938499 25955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d494488b914e40ddb30ce096a17593d7"
dest_uuid: "0377e4c589564e739a0bba757431dcdd"
 from {username='slave'} at 127.0.0.1:37064
I20260709 12:09:01.938997 25955 raft_consensus.cc:493] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:01.939325 25955 raft_consensus.cc:3060] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:01.944052 25955 raft_consensus.cc:515] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:01.945964 25955 leader_election.cc:290] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 3 election: Requested vote from peers efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:09:01.946696 26030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d494488b914e40ddb30ce096a17593d7" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "efc868618423419db4b805b6c69a88f8"
I20260709 12:09:01.947360 26030 raft_consensus.cc:3060] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:01.947613 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d494488b914e40ddb30ce096a17593d7" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "55a3a2c2e13946209305e725c47fab94"
I20260709 12:09:01.948261 26103 raft_consensus.cc:3055] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:01.948547 26103 raft_consensus.cc:740] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Running, Role: LEADER
I20260709 12:09:01.949364 26103 consensus_queue.cc:260] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:01.950446 26103 raft_consensus.cc:3060] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:01.953045 26030 raft_consensus.cc:2468] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 3.
I20260709 12:09:01.954370 25923 leader_election.cc:304] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:09:01.955262 26252 raft_consensus.cc:2804] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:01.955739 26252 raft_consensus.cc:697] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 3 LEADER]: Becoming Leader. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Running, Role: LEADER
I20260709 12:09:01.956522 26252 consensus_queue.cc:237] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:01.957614 26103 raft_consensus.cc:2468] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 3.
I20260709 12:09:01.964591 25852 catalog_manager.cc:5697] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd reported cstate change: term changed from 2 to 3, leader changed from 55a3a2c2e13946209305e725c47fab94 (127.24.179.67) to 0377e4c589564e739a0bba757431dcdd (127.24.179.65). New cstate: current_term: 3 leader_uuid: "0377e4c589564e739a0bba757431dcdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.019824 26281 raft_consensus.cc:993] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8: : Instructing follower 0377e4c589564e739a0bba757431dcdd to start an election
I20260709 12:09:02.020279 26283 raft_consensus.cc:1081] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 2 LEADER]: Signalling peer 0377e4c589564e739a0bba757431dcdd to start an election
I20260709 12:09:02.021631 25955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4c07440e5674cd4b07a3d2c3a353a8b"
dest_uuid: "0377e4c589564e739a0bba757431dcdd"
 from {username='slave'} at 127.0.0.1:37072
I20260709 12:09:02.022120 25955 raft_consensus.cc:493] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.022465 25955 raft_consensus.cc:3060] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.026842 25955 raft_consensus.cc:515] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:02.028411 25955 leader_election.cc:290] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 3 election: Requested vote from peers efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:09:02.029474 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c07440e5674cd4b07a3d2c3a353a8b" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "55a3a2c2e13946209305e725c47fab94"
I20260709 12:09:02.029397 26031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c07440e5674cd4b07a3d2c3a353a8b" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "efc868618423419db4b805b6c69a88f8"
I20260709 12:09:02.030145 26103 raft_consensus.cc:3060] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.030184 26031 raft_consensus.cc:3055] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:02.030656 26031 raft_consensus.cc:740] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: efc868618423419db4b805b6c69a88f8, State: Running, Role: LEADER
I20260709 12:09:02.031513 26031 consensus_queue.cc:260] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:02.032895 26031 raft_consensus.cc:3060] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.037675 26103 raft_consensus.cc:2468] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 3.
I20260709 12:09:02.038978 25922 leader_election.cc:304] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd, 55a3a2c2e13946209305e725c47fab94; no voters: 
I20260709 12:09:02.039867 26252 raft_consensus.cc:2804] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:02.040313 26252 raft_consensus.cc:697] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 3 LEADER]: Becoming Leader. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Running, Role: LEADER
I20260709 12:09:02.040360 26031 raft_consensus.cc:2468] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 3.
I20260709 12:09:02.041210 26252 consensus_queue.cc:237] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:02.048468 25852 catalog_manager.cc:5697] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd reported cstate change: term changed from 2 to 3, leader changed from efc868618423419db4b805b6c69a88f8 (127.24.179.66) to 0377e4c589564e739a0bba757431dcdd (127.24.179.65). New cstate: current_term: 3 leader_uuid: "0377e4c589564e739a0bba757431dcdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.139912 26290 raft_consensus.cc:993] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94: : Instructing follower 0377e4c589564e739a0bba757431dcdd to start an election
I20260709 12:09:02.140403 26290 raft_consensus.cc:1081] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 3 LEADER]: Signalling peer 0377e4c589564e739a0bba757431dcdd to start an election
I20260709 12:09:02.142015 25955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "444afdba57744ac6ac09fccdd0418fca"
dest_uuid: "0377e4c589564e739a0bba757431dcdd"
 from {username='slave'} at 127.0.0.1:37064
I20260709 12:09:02.142539 25955 raft_consensus.cc:493] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.142813 25955 raft_consensus.cc:3060] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.147281 25955 raft_consensus.cc:515] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } }
I20260709 12:09:02.148797 25955 leader_election.cc:290] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 4 election: Requested vote from peers 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175), efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223)
I20260709 12:09:02.149778 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444afdba57744ac6ac09fccdd0418fca" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "55a3a2c2e13946209305e725c47fab94"
I20260709 12:09:02.149959 26031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "444afdba57744ac6ac09fccdd0418fca" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "efc868618423419db4b805b6c69a88f8"
I20260709 12:09:02.150327 26103 raft_consensus.cc:3055] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:02.150584 26031 raft_consensus.cc:3060] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.150708 26103 raft_consensus.cc:740] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Running, Role: LEADER
I20260709 12:09:02.151512 26103 consensus_queue.cc:260] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } }
I20260709 12:09:02.152510 26103 raft_consensus.cc:3060] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.156232 26031 raft_consensus.cc:2468] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 4.
I20260709 12:09:02.157374 25923 leader_election.cc:304] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:09:02.157670 26103 raft_consensus.cc:2468] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 4.
I20260709 12:09:02.158100 26252 raft_consensus.cc:2804] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:02.158635 26252 raft_consensus.cc:697] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 4 LEADER]: Becoming Leader. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Running, Role: LEADER
I20260709 12:09:02.159385 26252 consensus_queue.cc:237] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } }
I20260709 12:09:02.165927 25852 catalog_manager.cc:5697] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd reported cstate change: term changed from 3 to 4, leader changed from 55a3a2c2e13946209305e725c47fab94 (127.24.179.67) to 0377e4c589564e739a0bba757431dcdd (127.24.179.65). New cstate: current_term: 4 leader_uuid: "0377e4c589564e739a0bba757431dcdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:02.233129 26281 raft_consensus.cc:993] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8: : Instructing follower 0377e4c589564e739a0bba757431dcdd to start an election
I20260709 12:09:02.233558 26283 raft_consensus.cc:1081] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [term 1 LEADER]: Signalling peer 0377e4c589564e739a0bba757431dcdd to start an election
I20260709 12:09:02.235105 25955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e0798b624814b23ba96d2361b4961aa"
dest_uuid: "0377e4c589564e739a0bba757431dcdd"
 from {username='slave'} at 127.0.0.1:37072
I20260709 12:09:02.235525 25955 raft_consensus.cc:493] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.235755 25955 raft_consensus.cc:3060] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:02.240163 25955 raft_consensus.cc:515] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:02.241818 25955 leader_election.cc:290] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 2 election: Requested vote from peers efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:09:02.242882 26031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0798b624814b23ba96d2361b4961aa" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc868618423419db4b805b6c69a88f8"
I20260709 12:09:02.243021 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0798b624814b23ba96d2361b4961aa" candidate_uuid: "0377e4c589564e739a0bba757431dcdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "55a3a2c2e13946209305e725c47fab94"
I20260709 12:09:02.243497 26031 raft_consensus.cc:3055] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:02.243572 26103 raft_consensus.cc:3060] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:02.243801 26031 raft_consensus.cc:740] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc868618423419db4b805b6c69a88f8, State: Running, Role: LEADER
I20260709 12:09:02.244640 26031 consensus_queue.cc:260] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:02.245616 26031 raft_consensus.cc:3060] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:02.248957 26103 raft_consensus.cc:2468] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 2.
I20260709 12:09:02.250098 25922 leader_election.cc:304] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0377e4c589564e739a0bba757431dcdd, 55a3a2c2e13946209305e725c47fab94; no voters: 
I20260709 12:09:02.250602 26031 raft_consensus.cc:2468] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0377e4c589564e739a0bba757431dcdd in term 2.
I20260709 12:09:02.250870 26252 raft_consensus.cc:2804] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:02.251402 26252 raft_consensus.cc:697] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd [term 2 LEADER]: Becoming Leader. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Running, Role: LEADER
I20260709 12:09:02.252166 26252 consensus_queue.cc:237] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:02.259421 25852 catalog_manager.cc:5697] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd reported cstate change: term changed from 1 to 2, leader changed from efc868618423419db4b805b6c69a88f8 (127.24.179.66) to 0377e4c589564e739a0bba757431dcdd (127.24.179.65). New cstate: current_term: 2 leader_uuid: "0377e4c589564e739a0bba757431dcdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.276293 26103 raft_consensus.cc:1275] T 3b4404e44e814753b1da44e2d750857f P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Refusing update from remote peer 0377e4c589564e739a0bba757431dcdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:02.277621 26252 consensus_queue.cc:1048] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:02.288938 26031 raft_consensus.cc:1275] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Refusing update from remote peer 0377e4c589564e739a0bba757431dcdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:02.291031 26284 consensus_queue.cc:1048] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:02.442831 26103 raft_consensus.cc:1275] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 3 FOLLOWER]: Refusing update from remote peer 0377e4c589564e739a0bba757431dcdd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.444205 26284 consensus_queue.cc:1048] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:02.453809 26031 raft_consensus.cc:1275] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [term 3 FOLLOWER]: Refusing update from remote peer 0377e4c589564e739a0bba757431dcdd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.456773 26252 consensus_queue.cc:1048] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:02.534351 26031 raft_consensus.cc:1275] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 3 FOLLOWER]: Refusing update from remote peer 0377e4c589564e739a0bba757431dcdd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.535742 26284 consensus_queue.cc:1048] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:02.545388 26103 raft_consensus.cc:1275] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 3 FOLLOWER]: Refusing update from remote peer 0377e4c589564e739a0bba757431dcdd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.548138 26284 consensus_queue.cc:1048] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:02.634021 26103 raft_consensus.cc:1275] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 4 FOLLOWER]: Refusing update from remote peer 0377e4c589564e739a0bba757431dcdd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:02.635603 26301 consensus_queue.cc:1048] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:02.645344 26031 raft_consensus.cc:1275] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8 [term 4 FOLLOWER]: Refusing update from remote peer 0377e4c589564e739a0bba757431dcdd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:02.647171 26304 consensus_queue.cc:1048] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:02.769102 26031 raft_consensus.cc:1275] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Refusing update from remote peer 0377e4c589564e739a0bba757431dcdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:02.770291 26304 consensus_queue.cc:1048] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:02.779649 26103 raft_consensus.cc:1275] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Refusing update from remote peer 0377e4c589564e739a0bba757431dcdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:02.781342 26284 consensus_queue.cc:1048] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:04.853451 25293 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:09:04.854247 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:04.862684 25955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a82be63df514556be057c830c06e2eb"
dest_uuid: "0377e4c589564e739a0bba757431dcdd"
mode: GRACEFUL
new_leader_uuid: "55a3a2c2e13946209305e725c47fab94"
 from {username='slave'} at 127.0.0.1:37088
I20260709 12:09:04.863260 25955 raft_consensus.cc:606] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [term 2 LEADER]: Received request to transfer leadership to TS 55a3a2c2e13946209305e725c47fab94
I20260709 12:09:04.865760 25955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69753740148d474ca373a75492f69c82"
dest_uuid: "0377e4c589564e739a0bba757431dcdd"
mode: GRACEFUL
new_leader_uuid: "55a3a2c2e13946209305e725c47fab94"
 from {username='slave'} at 127.0.0.1:37088
I20260709 12:09:04.866243 25955 raft_consensus.cc:606] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [term 1 LEADER]: Received request to transfer leadership to TS 55a3a2c2e13946209305e725c47fab94
I20260709 12:09:04.868673 25955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d494488b914e40ddb30ce096a17593d7"
dest_uuid: "0377e4c589564e739a0bba757431dcdd"
mode: GRACEFUL
new_leader_uuid: "efc868618423419db4b805b6c69a88f8"
 from {username='slave'} at 127.0.0.1:37088
I20260709 12:09:04.869393 25955 raft_consensus.cc:606] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 3 LEADER]: Received request to transfer leadership to TS efc868618423419db4b805b6c69a88f8
I20260709 12:09:04.871970 25955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4c07440e5674cd4b07a3d2c3a353a8b"
dest_uuid: "0377e4c589564e739a0bba757431dcdd"
mode: GRACEFUL
new_leader_uuid: "efc868618423419db4b805b6c69a88f8"
 from {username='slave'} at 127.0.0.1:37088
I20260709 12:09:04.872529 25955 raft_consensus.cc:606] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 3 LEADER]: Received request to transfer leadership to TS efc868618423419db4b805b6c69a88f8
I20260709 12:09:04.873453 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:04.873981 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:04.969569 26310 raft_consensus.cc:993] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd: : Instructing follower efc868618423419db4b805b6c69a88f8 to start an election
I20260709 12:09:04.970183 26284 raft_consensus.cc:1081] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 3 LEADER]: Signalling peer efc868618423419db4b805b6c69a88f8 to start an election
I20260709 12:09:04.972307 26031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4c07440e5674cd4b07a3d2c3a353a8b"
dest_uuid: "efc868618423419db4b805b6c69a88f8"
 from {username='slave'} at 127.0.0.1:47794
I20260709 12:09:04.972844 26031 raft_consensus.cc:493] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:04.973163 26031 raft_consensus.cc:3060] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:04.980623 26031 raft_consensus.cc:515] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:04.983922 25955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c07440e5674cd4b07a3d2c3a353a8b" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0377e4c589564e739a0bba757431dcdd"
I20260709 12:09:04.984583 25955 raft_consensus.cc:3055] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:04.984583 26103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c07440e5674cd4b07a3d2c3a353a8b" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "55a3a2c2e13946209305e725c47fab94"
I20260709 12:09:04.983273 26310 raft_consensus.cc:993] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd: : Instructing follower 55a3a2c2e13946209305e725c47fab94 to start an election
I20260709 12:09:04.985008 25955 raft_consensus.cc:740] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Running, Role: LEADER
I20260709 12:09:04.985277 26103 raft_consensus.cc:3060] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:04.985980 25955 consensus_queue.cc:260] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:04.986685 26311 raft_consensus.cc:1081] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [term 1 LEADER]: Signalling peer 55a3a2c2e13946209305e725c47fab94 to start an election
I20260709 12:09:04.987128 25955 raft_consensus.cc:3060] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:04.991672 26105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69753740148d474ca373a75492f69c82"
dest_uuid: "55a3a2c2e13946209305e725c47fab94"
 from {username='slave'} at 127.0.0.1:57906
I20260709 12:09:04.992302 26105 raft_consensus.cc:493] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:04.992748 26105 raft_consensus.cc:3060] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:04.993336 26103 raft_consensus.cc:2468] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc868618423419db4b805b6c69a88f8 in term 4.
I20260709 12:09:04.983584 26031 leader_election.cc:290] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 4 election: Requested vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:09:04.994917 25997 leader_election.cc:304] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:09:04.995864 26281 raft_consensus.cc:2804] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:04.996206 25955 raft_consensus.cc:2468] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc868618423419db4b805b6c69a88f8 in term 4.
I20260709 12:09:04.997541 26281 raft_consensus.cc:697] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 4 LEADER]: Becoming Leader. State: Replica: efc868618423419db4b805b6c69a88f8, State: Running, Role: LEADER
I20260709 12:09:04.998342 26281 consensus_queue.cc:237] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:05.001485 26105 raft_consensus.cc:515] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:05.005643 25955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69753740148d474ca373a75492f69c82" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0377e4c589564e739a0bba757431dcdd"
I20260709 12:09:05.005839 26031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69753740148d474ca373a75492f69c82" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc868618423419db4b805b6c69a88f8"
I20260709 12:09:05.006577 26031 raft_consensus.cc:3060] T 69753740148d474ca373a75492f69c82 P efc868618423419db4b805b6c69a88f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:05.008554 25852 catalog_manager.cc:5697] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 reported cstate change: term changed from 3 to 4, leader changed from 0377e4c589564e739a0bba757431dcdd (127.24.179.65) to efc868618423419db4b805b6c69a88f8 (127.24.179.66). New cstate: current_term: 4 leader_uuid: "efc868618423419db4b805b6c69a88f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:05.010529 26105 leader_election.cc:290] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 2 election: Requested vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223)
I20260709 12:09:05.006474 25955 raft_consensus.cc:3055] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:05.012913 25955 raft_consensus.cc:740] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Running, Role: LEADER
I20260709 12:09:05.013872 25955 consensus_queue.cc:260] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:05.015214 25955 raft_consensus.cc:3060] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:05.016413 26031 raft_consensus.cc:2468] T 69753740148d474ca373a75492f69c82 P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 2.
I20260709 12:09:05.018026 26072 leader_election.cc:304] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:09:05.019217 26290 raft_consensus.cc:2804] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:05.021728 25955 raft_consensus.cc:2468] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 2.
I20260709 12:09:05.027837 26290 raft_consensus.cc:697] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 [term 2 LEADER]: Becoming Leader. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Running, Role: LEADER
I20260709 12:09:05.028951 26290 consensus_queue.cc:237] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:05.036358 25852 catalog_manager.cc:5697] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 reported cstate change: term changed from 1 to 2, leader changed from 0377e4c589564e739a0bba757431dcdd (127.24.179.65) to 55a3a2c2e13946209305e725c47fab94 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "55a3a2c2e13946209305e725c47fab94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:05.037559 26310 raft_consensus.cc:993] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd: : Instructing follower 55a3a2c2e13946209305e725c47fab94 to start an election
I20260709 12:09:05.038197 26284 raft_consensus.cc:1081] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [term 2 LEADER]: Signalling peer 55a3a2c2e13946209305e725c47fab94 to start an election
I20260709 12:09:05.039857 26105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a82be63df514556be057c830c06e2eb"
dest_uuid: "55a3a2c2e13946209305e725c47fab94"
 from {username='slave'} at 127.0.0.1:57906
I20260709 12:09:05.040349 26105 raft_consensus.cc:493] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.040642 26105 raft_consensus.cc:3060] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.045635 26105 raft_consensus.cc:515] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:05.047277 26105 leader_election.cc:290] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 3 election: Requested vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223)
I20260709 12:09:05.048110 25955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a82be63df514556be057c830c06e2eb" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0377e4c589564e739a0bba757431dcdd"
I20260709 12:09:05.048485 26031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a82be63df514556be057c830c06e2eb" candidate_uuid: "55a3a2c2e13946209305e725c47fab94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "efc868618423419db4b805b6c69a88f8"
I20260709 12:09:05.048759 25955 raft_consensus.cc:3055] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:05.049055 26031 raft_consensus.cc:3060] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.049093 25955 raft_consensus.cc:740] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Running, Role: LEADER
I20260709 12:09:05.049985 25955 consensus_queue.cc:260] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:05.051011 25955 raft_consensus.cc:3060] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.053928 26031 raft_consensus.cc:2468] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 3.
I20260709 12:09:05.055181 26072 leader_election.cc:304] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:09:05.055730 25955 raft_consensus.cc:2468] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a3a2c2e13946209305e725c47fab94 in term 3.
I20260709 12:09:05.055944 26290 raft_consensus.cc:2804] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:05.056504 26290 raft_consensus.cc:697] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [term 3 LEADER]: Becoming Leader. State: Replica: 55a3a2c2e13946209305e725c47fab94, State: Running, Role: LEADER
I20260709 12:09:05.057372 26290 consensus_queue.cc:237] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:05.064313 25852 catalog_manager.cc:5697] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 reported cstate change: term changed from 2 to 3, leader changed from 0377e4c589564e739a0bba757431dcdd (127.24.179.65) to 55a3a2c2e13946209305e725c47fab94 (127.24.179.67). New cstate: current_term: 3 leader_uuid: "55a3a2c2e13946209305e725c47fab94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:05.123860 26310 raft_consensus.cc:993] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd: : Instructing follower efc868618423419db4b805b6c69a88f8 to start an election
I20260709 12:09:05.124311 26284 raft_consensus.cc:1081] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 3 LEADER]: Signalling peer efc868618423419db4b805b6c69a88f8 to start an election
I20260709 12:09:05.125746 26031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d494488b914e40ddb30ce096a17593d7"
dest_uuid: "efc868618423419db4b805b6c69a88f8"
 from {username='slave'} at 127.0.0.1:47794
I20260709 12:09:05.126168 26031 raft_consensus.cc:493] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.126428 26031 raft_consensus.cc:3060] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:05.130686 26031 raft_consensus.cc:515] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:05.132128 26031 leader_election.cc:290] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 4 election: Requested vote from peers 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227), 55a3a2c2e13946209305e725c47fab94 (127.24.179.67:42175)
I20260709 12:09:05.133082 25955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d494488b914e40ddb30ce096a17593d7" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0377e4c589564e739a0bba757431dcdd"
I20260709 12:09:05.133208 26105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d494488b914e40ddb30ce096a17593d7" candidate_uuid: "efc868618423419db4b805b6c69a88f8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "55a3a2c2e13946209305e725c47fab94"
I20260709 12:09:05.133670 25955 raft_consensus.cc:3055] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:05.133780 26105 raft_consensus.cc:3060] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:05.133960 25955 raft_consensus.cc:740] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0377e4c589564e739a0bba757431dcdd, State: Running, Role: LEADER
I20260709 12:09:05.134732 25955 consensus_queue.cc:260] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:05.135593 25955 raft_consensus.cc:3060] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:05.138444 26105 raft_consensus.cc:2468] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc868618423419db4b805b6c69a88f8 in term 4.
I20260709 12:09:05.139550 25997 leader_election.cc:304] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a3a2c2e13946209305e725c47fab94, efc868618423419db4b805b6c69a88f8; no voters: 
I20260709 12:09:05.140044 25955 raft_consensus.cc:2468] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc868618423419db4b805b6c69a88f8 in term 4.
I20260709 12:09:05.140269 26281 raft_consensus.cc:2804] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:05.140864 26281 raft_consensus.cc:697] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [term 4 LEADER]: Becoming Leader. State: Replica: efc868618423419db4b805b6c69a88f8, State: Running, Role: LEADER
I20260709 12:09:05.141731 26281 consensus_queue.cc:237] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } }
I20260709 12:09:05.149446 25852 catalog_manager.cc:5697] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 reported cstate change: term changed from 3 to 4, leader changed from 0377e4c589564e739a0bba757431dcdd (127.24.179.65) to efc868618423419db4b805b6c69a88f8 (127.24.179.66). New cstate: current_term: 4 leader_uuid: "efc868618423419db4b805b6c69a88f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:05.480919 25955 raft_consensus.cc:1275] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Refusing update from remote peer 55a3a2c2e13946209305e725c47fab94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:05.482640 26290 consensus_queue.cc:1048] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:05.496505 26031 raft_consensus.cc:1275] T 69753740148d474ca373a75492f69c82 P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Refusing update from remote peer 55a3a2c2e13946209305e725c47fab94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:05.498185 26290 consensus_queue.cc:1048] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:05.499348 25954 raft_consensus.cc:1275] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 4 FOLLOWER]: Refusing update from remote peer efc868618423419db4b805b6c69a88f8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:05.501252 26281 consensus_queue.cc:1048] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:05.521169 25955 raft_consensus.cc:1275] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [term 3 FOLLOWER]: Refusing update from remote peer 55a3a2c2e13946209305e725c47fab94: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.523131 26105 raft_consensus.cc:1275] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 4 FOLLOWER]: Refusing update from remote peer efc868618423419db4b805b6c69a88f8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:05.525238 26330 consensus_queue.cc:1048] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:05.526062 26325 consensus_queue.cc:1048] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:05.540228 26031 raft_consensus.cc:1275] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 3 FOLLOWER]: Refusing update from remote peer 55a3a2c2e13946209305e725c47fab94: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.542176 26290 consensus_queue.cc:1048] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc868618423419db4b805b6c69a88f8" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:05.749523 26103 raft_consensus.cc:1275] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 4 FOLLOWER]: Refusing update from remote peer efc868618423419db4b805b6c69a88f8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:05.750923 26330 consensus_queue.cc:1048] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a3a2c2e13946209305e725c47fab94" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:05.761451 25955 raft_consensus.cc:1275] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 4 FOLLOWER]: Refusing update from remote peer efc868618423419db4b805b6c69a88f8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:05.763167 26281 consensus_queue.cc:1048] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0377e4c589564e739a0bba757431dcdd" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 43227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:05.875126 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:05.881763 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:05.882319 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:06.883492 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:06.892143 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:06.892647 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:07.893738 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:07.899173 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:07.899682 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:08.900708 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:08.906459 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:08.906940 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:09.907919 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:09.913334 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:09.913825 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:10.914891 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:10.921667 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:10.922164 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:11.923218 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:11.928823 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:11.929287 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:12.930284 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:12.935608 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:12.936090 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:13.937124 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:13.942440 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:13.942909 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:14.976712 25293 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:09:14.977244 25293 tablet_server.cc:179] TabletServer@127.24.179.65:0 shutting down...
W20260709 12:09:14.995004 26070 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 12:09:14.998956 26070 consensus_peers.cc:597] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 -> Peer 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227): Couldn't send request to peer 0377e4c589564e739a0bba757431dcdd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.012885 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:15.013846 25293 tablet_replica.cc:333] T 101efc883fed47bc9c7bfabb594c138e P 0377e4c589564e739a0bba757431dcdd: stopping tablet replica
I20260709 12:09:15.014807 25293 raft_consensus.cc:2243] T 101efc883fed47bc9c7bfabb594c138e P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.015388 25293 raft_consensus.cc:2272] T 101efc883fed47bc9c7bfabb594c138e P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.017747 25293 tablet_replica.cc:333] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd: stopping tablet replica
I20260709 12:09:15.018548 25293 raft_consensus.cc:2243] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.019060 25293 raft_consensus.cc:2272] T d4c07440e5674cd4b07a3d2c3a353a8b P 0377e4c589564e739a0bba757431dcdd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.021296 25293 tablet_replica.cc:333] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd: stopping tablet replica
I20260709 12:09:15.022017 25293 raft_consensus.cc:2243] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.023274 25293 raft_consensus.cc:2272] T 3b4404e44e814753b1da44e2d750857f P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.026499 25293 tablet_replica.cc:333] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd: stopping tablet replica
I20260709 12:09:15.027397 25293 raft_consensus.cc:2243] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.027887 25293 raft_consensus.cc:2272] T 87545e0697f64558a1918d9dafd04b1f P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.031435 25293 tablet_replica.cc:333] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd: stopping tablet replica
I20260709 12:09:15.032366 25293 raft_consensus.cc:2243] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.033191 25293 raft_consensus.cc:2272] T d494488b914e40ddb30ce096a17593d7 P 0377e4c589564e739a0bba757431dcdd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.036348 25293 tablet_replica.cc:333] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd: stopping tablet replica
I20260709 12:09:15.037352 25293 raft_consensus.cc:2243] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.038662 25293 raft_consensus.cc:2272] T 444afdba57744ac6ac09fccdd0418fca P 0377e4c589564e739a0bba757431dcdd [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:15.040316 26070 consensus_peers.cc:597] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 -> Peer 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227): Couldn't send request to peer 0377e4c589564e739a0bba757431dcdd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.041385 25293 tablet_replica.cc:333] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd: stopping tablet replica
I20260709 12:09:15.042189 25293 raft_consensus.cc:2243] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.042798 25293 raft_consensus.cc:2272] T 69753740148d474ca373a75492f69c82 P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.045249 25293 tablet_replica.cc:333] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd: stopping tablet replica
I20260709 12:09:15.045835 25293 raft_consensus.cc:2243] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.046921 25293 raft_consensus.cc:2272] T a7e1bba4da21410685f7001aa07bfca5 P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.049141 25293 tablet_replica.cc:333] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd: stopping tablet replica
I20260709 12:09:15.049671 25293 raft_consensus.cc:2243] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.050491 25293 raft_consensus.cc:2272] T 0e0798b624814b23ba96d2361b4961aa P 0377e4c589564e739a0bba757431dcdd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.052481 25293 tablet_replica.cc:333] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd: stopping tablet replica
I20260709 12:09:15.052997 25293 raft_consensus.cc:2243] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.053442 25293 raft_consensus.cc:2272] T 5a82be63df514556be057c830c06e2eb P 0377e4c589564e739a0bba757431dcdd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.102149 25293 tablet_server.cc:196] TabletServer@127.24.179.65:0 shutdown complete.
I20260709 12:09:15.123456 25293 tablet_server.cc:179] TabletServer@127.24.179.66:0 shutting down...
I20260709 12:09:15.153440 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:15.154084 25293 tablet_replica.cc:333] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8: stopping tablet replica
I20260709 12:09:15.154974 25293 raft_consensus.cc:2243] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.155843 25293 raft_consensus.cc:2272] T 87545e0697f64558a1918d9dafd04b1f P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.157850 25293 tablet_replica.cc:333] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8: stopping tablet replica
I20260709 12:09:15.158459 25293 raft_consensus.cc:2243] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.159197 25293 raft_consensus.cc:2272] T d494488b914e40ddb30ce096a17593d7 P efc868618423419db4b805b6c69a88f8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.160955 25293 tablet_replica.cc:333] T 69753740148d474ca373a75492f69c82 P efc868618423419db4b805b6c69a88f8: stopping tablet replica
I20260709 12:09:15.161468 25293 raft_consensus.cc:2243] T 69753740148d474ca373a75492f69c82 P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.161863 25293 raft_consensus.cc:2272] T 69753740148d474ca373a75492f69c82 P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.163561 25293 tablet_replica.cc:333] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8: stopping tablet replica
I20260709 12:09:15.164198 25293 raft_consensus.cc:2243] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.164666 25293 raft_consensus.cc:2272] T 444afdba57744ac6ac09fccdd0418fca P efc868618423419db4b805b6c69a88f8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.166606 25293 tablet_replica.cc:333] T a7e1bba4da21410685f7001aa07bfca5 P efc868618423419db4b805b6c69a88f8: stopping tablet replica
I20260709 12:09:15.167124 25293 raft_consensus.cc:2243] T a7e1bba4da21410685f7001aa07bfca5 P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.167528 25293 raft_consensus.cc:2272] T a7e1bba4da21410685f7001aa07bfca5 P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.169430 25293 tablet_replica.cc:333] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8: stopping tablet replica
I20260709 12:09:15.169962 25293 raft_consensus.cc:2243] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.170487 25293 raft_consensus.cc:2272] T 101efc883fed47bc9c7bfabb594c138e P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.172197 25293 tablet_replica.cc:333] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8: stopping tablet replica
I20260709 12:09:15.172719 25293 raft_consensus.cc:2243] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.173179 25293 raft_consensus.cc:2272] T 3b4404e44e814753b1da44e2d750857f P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.174950 25293 tablet_replica.cc:333] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8: stopping tablet replica
I20260709 12:09:15.175441 25293 raft_consensus.cc:2243] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.176163 25293 raft_consensus.cc:2272] T d4c07440e5674cd4b07a3d2c3a353a8b P efc868618423419db4b805b6c69a88f8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.177806 25293 tablet_replica.cc:333] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8: stopping tablet replica
I20260709 12:09:15.178285 25293 raft_consensus.cc:2243] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.178766 25293 raft_consensus.cc:2272] T 0e0798b624814b23ba96d2361b4961aa P efc868618423419db4b805b6c69a88f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.180583 25293 tablet_replica.cc:333] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8: stopping tablet replica
I20260709 12:09:15.181044 25293 raft_consensus.cc:2243] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.181461 25293 raft_consensus.cc:2272] T 5a82be63df514556be057c830c06e2eb P efc868618423419db4b805b6c69a88f8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.210249 25293 tablet_server.cc:196] TabletServer@127.24.179.66:0 shutdown complete.
W20260709 12:09:15.226483 26070 consensus_peers.cc:597] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 -> Peer 0377e4c589564e739a0bba757431dcdd (127.24.179.65:43227): Couldn't send request to peer 0377e4c589564e739a0bba757431dcdd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:43227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.250533 25293 tablet_server.cc:179] TabletServer@127.24.179.67:0 shutting down...
I20260709 12:09:15.285527 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:15.286294 25293 tablet_replica.cc:333] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94: stopping tablet replica
I20260709 12:09:15.287151 25293 raft_consensus.cc:2243] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.287985 25293 raft_consensus.cc:2272] T 87545e0697f64558a1918d9dafd04b1f P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.290189 25293 tablet_replica.cc:333] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94: stopping tablet replica
I20260709 12:09:15.290808 25293 raft_consensus.cc:2243] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.291617 25293 raft_consensus.cc:2272] T d494488b914e40ddb30ce096a17593d7 P 55a3a2c2e13946209305e725c47fab94 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.294341 25293 tablet_replica.cc:333] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94: stopping tablet replica
I20260709 12:09:15.295110 25293 raft_consensus.cc:2243] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.297072 25293 raft_consensus.cc:2272] T 101efc883fed47bc9c7bfabb594c138e P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:15.298190 26072 consensus_peers.cc:597] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 -> Peer efc868618423419db4b805b6c69a88f8 (127.24.179.66:44223): Couldn't send request to peer efc868618423419db4b805b6c69a88f8. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.299433 25293 tablet_replica.cc:333] T 3b4404e44e814753b1da44e2d750857f P 55a3a2c2e13946209305e725c47fab94: stopping tablet replica
I20260709 12:09:15.299995 25293 raft_consensus.cc:2243] T 3b4404e44e814753b1da44e2d750857f P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.300554 25293 raft_consensus.cc:2272] T 3b4404e44e814753b1da44e2d750857f P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.302593 25293 tablet_replica.cc:333] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94: stopping tablet replica
I20260709 12:09:15.303125 25293 raft_consensus.cc:2243] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.303651 25293 raft_consensus.cc:2272] T d4c07440e5674cd4b07a3d2c3a353a8b P 55a3a2c2e13946209305e725c47fab94 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.305495 25293 tablet_replica.cc:333] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94: stopping tablet replica
I20260709 12:09:15.306031 25293 raft_consensus.cc:2243] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.306650 25293 raft_consensus.cc:2272] T a7e1bba4da21410685f7001aa07bfca5 P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.308708 25293 tablet_replica.cc:333] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94: stopping tablet replica
I20260709 12:09:15.309234 25293 raft_consensus.cc:2243] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.309711 25293 raft_consensus.cc:2272] T 444afdba57744ac6ac09fccdd0418fca P 55a3a2c2e13946209305e725c47fab94 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.311482 25293 tablet_replica.cc:333] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94: stopping tablet replica
I20260709 12:09:15.312008 25293 raft_consensus.cc:2243] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.313184 25293 raft_consensus.cc:2272] T 69753740148d474ca373a75492f69c82 P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.315155 25293 tablet_replica.cc:333] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94: stopping tablet replica
I20260709 12:09:15.315675 25293 raft_consensus.cc:2243] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.316200 25293 raft_consensus.cc:2272] T 0e0798b624814b23ba96d2361b4961aa P 55a3a2c2e13946209305e725c47fab94 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.317988 25293 tablet_replica.cc:333] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94: stopping tablet replica
I20260709 12:09:15.318537 25293 raft_consensus.cc:2243] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.319485 25293 raft_consensus.cc:2272] T 5a82be63df514556be057c830c06e2eb P 55a3a2c2e13946209305e725c47fab94 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.357784 25293 tablet_server.cc:196] TabletServer@127.24.179.67:0 shutdown complete.
I20260709 12:09:15.383623 25293 master.cc:562] Master@127.24.179.126:40167 shutting down...
I20260709 12:09:15.410880 25293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.411697 25293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.412025 25293 tablet_replica.cc:333] T 00000000000000000000000000000000 P 60917f5e97a7454fabcf94b5f6fe0af9: stopping tablet replica
I20260709 12:09:15.433158 25293 master.cc:584] Master@127.24.179.126:40167 shutdown complete.
0377e4c589564e739a0bba757431dcdd  5
55a3a2c2e13946209305e725c47fab94  1
efc868618423419db4b805b6c69a88f8  4
0377e4c589564e739a0bba757431dcdd  3
55a3a2c2e13946209305e725c47fab94  3
efc868618423419db4b805b6c69a88f8  4
0377e4c589564e739a0bba757431dcdd  8
55a3a2c2e13946209305e725c47fab94  1
efc868618423419db4b805b6c69a88f8  1
0377e4c589564e739a0bba757431dcdd  4
55a3a2c2e13946209305e725c47fab94  3
efc868618423419db4b805b6c69a88f8  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28955 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:09:15.484586 25293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.179.126:41797
I20260709 12:09:15.485832 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:15.491894 26346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.493170 26347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.493543 26349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:15.494349 25293 server_base.cc:1061] running on GCE node
I20260709 12:09:15.495735 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:15.495918 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:15.496034 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783598955496023 us; error 0 us; skew 500 ppm
I20260709 12:09:15.496538 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:15.499121 25293 webserver.cc:533] Webserver started at http://127.24.179.126:38751/ using document root <none> and password file <none>
I20260709 12:09:15.499598 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:15.499755 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:15.500005 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:15.501302 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/master-0-root/instance:
uuid: "8f3fd02e9cbb4cbb90df37bb5fd109c3"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-tjfs"
I20260709 12:09:15.506028 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:09:15.509770 26354 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.510726 25293 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:09:15.511143 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/master-0-root
uuid: "8f3fd02e9cbb4cbb90df37bb5fd109c3"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-tjfs"
I20260709 12:09:15.511634 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:15.536037 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:15.537302 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:15.577965 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.126:41797
I20260709 12:09:15.578058 26405 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.126:41797 every 8 connection(s)
I20260709 12:09:15.582159 26406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.593429 26406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Bootstrap starting.
I20260709 12:09:15.599071 26406 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.603615 26406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: No bootstrap required, opened a new log
I20260709 12:09:15.605913 26406 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f3fd02e9cbb4cbb90df37bb5fd109c3" member_type: VOTER }
I20260709 12:09:15.606451 26406 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.606734 26406 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f3fd02e9cbb4cbb90df37bb5fd109c3, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.607316 26406 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f3fd02e9cbb4cbb90df37bb5fd109c3" member_type: VOTER }
I20260709 12:09:15.607880 26406 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:09:15.608183 26406 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:09:15.608484 26406 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.613008 26406 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f3fd02e9cbb4cbb90df37bb5fd109c3" member_type: VOTER }
I20260709 12:09:15.613608 26406 leader_election.cc:304] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8f3fd02e9cbb4cbb90df37bb5fd109c3; no voters: 
I20260709 12:09:15.614990 26406 leader_election.cc:290] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:09:15.615419 26409 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:15.616822 26409 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3 [term 1 LEADER]: Becoming Leader. State: Replica: 8f3fd02e9cbb4cbb90df37bb5fd109c3, State: Running, Role: LEADER
I20260709 12:09:15.617619 26409 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f3fd02e9cbb4cbb90df37bb5fd109c3" member_type: VOTER }
I20260709 12:09:15.618147 26406 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:09:15.624210 26410 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8f3fd02e9cbb4cbb90df37bb5fd109c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f3fd02e9cbb4cbb90df37bb5fd109c3" member_type: VOTER } }
I20260709 12:09:15.624907 26410 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:15.624267 26411 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f3fd02e9cbb4cbb90df37bb5fd109c3. Latest consensus state: current_term: 1 leader_uuid: "8f3fd02e9cbb4cbb90df37bb5fd109c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f3fd02e9cbb4cbb90df37bb5fd109c3" member_type: VOTER } }
I20260709 12:09:15.625877 26411 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:15.631559 26418 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:09:15.636655 26418 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:09:15.637866 25293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:09:15.645641 26418 catalog_manager.cc:1383] Generated new cluster ID: 3a0cd253d6d84193a0ec5d1b4f0ee37e
I20260709 12:09:15.645932 26418 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:09:15.680413 26418 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:09:15.681847 26418 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:09:15.694732 26418 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Generated new TSK 0
I20260709 12:09:15.695356 26418 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:09:15.704741 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:15.711031 26427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.712347 26428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:15.714287 25293 server_base.cc:1061] running on GCE node
W20260709 12:09:15.714350 26430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:15.715622 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:15.715837 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:15.715965 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783598955715953 us; error 0 us; skew 500 ppm
I20260709 12:09:15.716444 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:15.718938 25293 webserver.cc:533] Webserver started at http://127.24.179.65:39383/ using document root <none> and password file <none>
I20260709 12:09:15.719404 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:15.719628 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:15.719949 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:15.721194 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-0-root/instance:
uuid: "01a57027214a411e80874ac7febd628b"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-tjfs"
I20260709 12:09:15.726347 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:09:15.730209 26435 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.731200 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:09:15.731527 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-0-root
uuid: "01a57027214a411e80874ac7febd628b"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-tjfs"
I20260709 12:09:15.731914 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:15.764429 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:15.765841 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:15.767472 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:15.769971 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:15.770216 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.770509 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:15.770712 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.815253 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.65:45149
I20260709 12:09:15.815359 26497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.65:45149 every 8 connection(s)
I20260709 12:09:15.820519 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:15.829532 26503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.828738 26502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:15.834928 26498 heartbeater.cc:344] Connected to a master server at 127.24.179.126:41797
I20260709 12:09:15.835409 26498 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:15.836302 25293 server_base.cc:1061] running on GCE node
I20260709 12:09:15.836520 26498 heartbeater.cc:507] Master 127.24.179.126:41797 requested a full tablet report, sending...
W20260709 12:09:15.837687 26505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:15.838791 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:15.839110 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:15.839138 26371 ts_manager.cc:194] Registered new tserver with Master: 01a57027214a411e80874ac7febd628b (127.24.179.65:45149)
I20260709 12:09:15.839416 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783598955839395 us; error 0 us; skew 500 ppm
I20260709 12:09:15.840225 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:15.841679 26371 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57044
I20260709 12:09:15.843235 25293 webserver.cc:533] Webserver started at http://127.24.179.66:45547/ using document root <none> and password file <none>
I20260709 12:09:15.843779 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:15.843948 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:15.844261 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:15.845454 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-1-root/instance:
uuid: "ac3ac2181aa941229a758ccf6b5607cd"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-tjfs"
I20260709 12:09:15.850092 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:09:15.853652 26510 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.854504 25293 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:09:15.854820 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-1-root
uuid: "ac3ac2181aa941229a758ccf6b5607cd"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-tjfs"
I20260709 12:09:15.855144 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:15.866667 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:15.867959 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:15.869540 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:15.872004 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:15.872242 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.872529 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:15.872709 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.913928 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.66:40567
I20260709 12:09:15.914023 26572 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.66:40567 every 8 connection(s)
I20260709 12:09:15.919314 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:15.926162 26576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.927297 26577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.930146 26579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:15.930176 25293 server_base.cc:1061] running on GCE node
I20260709 12:09:15.931563 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:15.931847 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:15.932067 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783598955932049 us; error 0 us; skew 500 ppm
I20260709 12:09:15.932816 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:15.932883 26573 heartbeater.cc:344] Connected to a master server at 127.24.179.126:41797
I20260709 12:09:15.933374 26573 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:15.934330 26573 heartbeater.cc:507] Master 127.24.179.126:41797 requested a full tablet report, sending...
I20260709 12:09:15.935865 25293 webserver.cc:533] Webserver started at http://127.24.179.67:36825/ using document root <none> and password file <none>
I20260709 12:09:15.936491 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:15.936688 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:15.936666 26371 ts_manager.cc:194] Registered new tserver with Master: ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:15.937119 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:15.938144 26371 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57048
I20260709 12:09:15.938323 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-2-root/instance:
uuid: "aaadfdd9ca9f424c91505f9b43876233"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-tjfs"
I20260709 12:09:15.943223 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:09:15.946799 26584 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.947659 25293 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:09:15.948051 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-2-root
uuid: "aaadfdd9ca9f424c91505f9b43876233"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-tjfs"
I20260709 12:09:15.948364 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:15.973707 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:15.975064 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:15.976652 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:15.979130 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:15.979336 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.979656 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:15.979807 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.021965 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.67:42217
I20260709 12:09:16.022059 26646 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.67:42217 every 8 connection(s)
I20260709 12:09:16.037227 26647 heartbeater.cc:344] Connected to a master server at 127.24.179.126:41797
I20260709 12:09:16.037582 26647 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:16.038352 26647 heartbeater.cc:507] Master 127.24.179.126:41797 requested a full tablet report, sending...
I20260709 12:09:16.040601 26371 ts_manager.cc:194] Registered new tserver with Master: aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:16.041579 25293 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015856608s
I20260709 12:09:16.042164 26371 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57052
I20260709 12:09:16.069166 26371 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57066:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:09:16.075621 26371 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:09:16.279980 26463 tablet_service.cc:1511] Processing CreateTablet for tablet ad6ce9ef10d748ecbe957fb8e6de47b0 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:16.281813 26463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6ce9ef10d748ecbe957fb8e6de47b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.295197 26612 tablet_service.cc:1511] Processing CreateTablet for tablet ad6ce9ef10d748ecbe957fb8e6de47b0 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:16.296198 26462 tablet_service.cc:1511] Processing CreateTablet for tablet de4e2c4be7474864b847ef2e617f6f49 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:16.296783 26612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6ce9ef10d748ecbe957fb8e6de47b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.297785 26462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de4e2c4be7474864b847ef2e617f6f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.299034 26610 tablet_service.cc:1511] Processing CreateTablet for tablet c4646c5ce9a9467da50e9f3587b11ad5 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:16.297818 26611 tablet_service.cc:1511] Processing CreateTablet for tablet de4e2c4be7474864b847ef2e617f6f49 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:16.300514 26610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4646c5ce9a9467da50e9f3587b11ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.301608 26611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de4e2c4be7474864b847ef2e617f6f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.303412 26538 tablet_service.cc:1511] Processing CreateTablet for tablet ad6ce9ef10d748ecbe957fb8e6de47b0 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:16.304097 26536 tablet_service.cc:1511] Processing CreateTablet for tablet c4646c5ce9a9467da50e9f3587b11ad5 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:16.304924 26538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6ce9ef10d748ecbe957fb8e6de47b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.306010 26609 tablet_service.cc:1511] Processing CreateTablet for tablet ff21e283775e459c8757d4d1c245c531 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:16.306504 26535 tablet_service.cc:1511] Processing CreateTablet for tablet ff21e283775e459c8757d4d1c245c531 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:16.307410 26609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff21e283775e459c8757d4d1c245c531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.308022 26535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff21e283775e459c8757d4d1c245c531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.307669 26537 tablet_service.cc:1511] Processing CreateTablet for tablet de4e2c4be7474864b847ef2e617f6f49 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:16.309041 26537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de4e2c4be7474864b847ef2e617f6f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.310940 26532 tablet_service.cc:1511] Processing CreateTablet for tablet 9275c8cfbe54472fba36a4ef3bf770f7 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:16.311640 26608 tablet_service.cc:1511] Processing CreateTablet for tablet 2251a6321412417a8079201067ae2d0d (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:16.312439 26532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9275c8cfbe54472fba36a4ef3bf770f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.313050 26608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2251a6321412417a8079201067ae2d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.314790 26606 tablet_service.cc:1511] Processing CreateTablet for tablet 9275c8cfbe54472fba36a4ef3bf770f7 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:16.315624 26531 tablet_service.cc:1511] Processing CreateTablet for tablet 94f480c16e1e4f31abd8773ea56f244b (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:16.316222 26606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9275c8cfbe54472fba36a4ef3bf770f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.316283 26461 tablet_service.cc:1511] Processing CreateTablet for tablet c4646c5ce9a9467da50e9f3587b11ad5 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:16.317095 26531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94f480c16e1e4f31abd8773ea56f244b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.317983 26607 tablet_service.cc:1511] Processing CreateTablet for tablet 8036dd24c55a4bc18661cc64c049a704 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:16.318943 26460 tablet_service.cc:1511] Processing CreateTablet for tablet ff21e283775e459c8757d4d1c245c531 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:16.319356 26533 tablet_service.cc:1511] Processing CreateTablet for tablet 8036dd24c55a4bc18661cc64c049a704 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:16.321290 26533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8036dd24c55a4bc18661cc64c049a704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.320960 26605 tablet_service.cc:1511] Processing CreateTablet for tablet 94f480c16e1e4f31abd8773ea56f244b (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:16.320960 26459 tablet_service.cc:1511] Processing CreateTablet for tablet 2251a6321412417a8079201067ae2d0d (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:16.323048 26458 tablet_service.cc:1511] Processing CreateTablet for tablet 8036dd24c55a4bc18661cc64c049a704 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:16.323495 26534 tablet_service.cc:1511] Processing CreateTablet for tablet 2251a6321412417a8079201067ae2d0d (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:16.325155 26534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2251a6321412417a8079201067ae2d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.324743 26604 tablet_service.cc:1511] Processing CreateTablet for tablet f6ba7060b20a4d598344385607b29c70 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:16.326660 26536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4646c5ce9a9467da50e9f3587b11ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.319517 26607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8036dd24c55a4bc18661cc64c049a704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.328644 26605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94f480c16e1e4f31abd8773ea56f244b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.330291 26604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ba7060b20a4d598344385607b29c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.331365 26530 tablet_service.cc:1511] Processing CreateTablet for tablet f6ba7060b20a4d598344385607b29c70 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:16.333158 26530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ba7060b20a4d598344385607b29c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.344187 26603 tablet_service.cc:1511] Processing CreateTablet for tablet cff430729a9d4c8183d8ddad129d6ecf (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:16.345660 26603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff430729a9d4c8183d8ddad129d6ecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.346711 26457 tablet_service.cc:1511] Processing CreateTablet for tablet 9275c8cfbe54472fba36a4ef3bf770f7 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:16.348093 26454 tablet_service.cc:1511] Processing CreateTablet for tablet cff430729a9d4c8183d8ddad129d6ecf (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:16.348834 26456 tablet_service.cc:1511] Processing CreateTablet for tablet 94f480c16e1e4f31abd8773ea56f244b (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:16.350967 26455 tablet_service.cc:1511] Processing CreateTablet for tablet f6ba7060b20a4d598344385607b29c70 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:16.352548 26529 tablet_service.cc:1511] Processing CreateTablet for tablet cff430729a9d4c8183d8ddad129d6ecf (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:16.354068 26529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff430729a9d4c8183d8ddad129d6ecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.375869 26456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94f480c16e1e4f31abd8773ea56f244b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.383051 26454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff430729a9d4c8183d8ddad129d6ecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.384519 26460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff21e283775e459c8757d4d1c245c531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.385985 26461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4646c5ce9a9467da50e9f3587b11ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.387753 26459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2251a6321412417a8079201067ae2d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.389487 26457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9275c8cfbe54472fba36a4ef3bf770f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.391317 26455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ba7060b20a4d598344385607b29c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.393049 26458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8036dd24c55a4bc18661cc64c049a704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.403900 26663 tablet_bootstrap.cc:492] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:16.431742 26662 tablet_bootstrap.cc:492] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:16.436147 26612 tablet_service.cc:1511] Processing CreateTablet for tablet fce5ecc0a3714c80861557f318edce9d (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:16.440976 26463 tablet_service.cc:1511] Processing CreateTablet for tablet fce5ecc0a3714c80861557f318edce9d (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:16.442669 26463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce5ecc0a3714c80861557f318edce9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.449541 26663 tablet_bootstrap.cc:654] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.454763 26612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce5ecc0a3714c80861557f318edce9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.459285 26534 tablet_service.cc:1511] Processing CreateTablet for tablet 6598ff9cfd5346af8da1e9928f3a5ac9 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:16.460892 26534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6598ff9cfd5346af8da1e9928f3a5ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.464159 26530 tablet_service.cc:1511] Processing CreateTablet for tablet fce5ecc0a3714c80861557f318edce9d (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:16.465585 26530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce5ecc0a3714c80861557f318edce9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.468953 26535 tablet_service.cc:1511] Processing CreateTablet for tablet 86001e7eca0b4ca4aed965b7d7e5820c (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:16.471266 26535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86001e7eca0b4ca4aed965b7d7e5820c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.483393 26532 tablet_service.cc:1511] Processing CreateTablet for tablet 14b3fc9b208642ffb7dbc462c4032c67 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:16.485217 26532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b3fc9b208642ffb7dbc462c4032c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.486166 26607 tablet_service.cc:1511] Processing CreateTablet for tablet 6598ff9cfd5346af8da1e9928f3a5ac9 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:16.470953 26537 tablet_service.cc:1511] Processing CreateTablet for tablet 54a09e3d025e44058af04b7f7fff12f3 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:16.499727 26537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a09e3d025e44058af04b7f7fff12f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.475510 26533 tablet_service.cc:1511] Processing CreateTablet for tablet 7c931e3af68c4073a5ed978eb0f43f3f (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:16.502511 26533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c931e3af68c4073a5ed978eb0f43f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.504565 26462 tablet_service.cc:1511] Processing CreateTablet for tablet 6598ff9cfd5346af8da1e9928f3a5ac9 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:16.506549 26604 tablet_service.cc:1511] Processing CreateTablet for tablet 86001e7eca0b4ca4aed965b7d7e5820c (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:16.508317 26604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86001e7eca0b4ca4aed965b7d7e5820c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.515585 26607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6598ff9cfd5346af8da1e9928f3a5ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.519246 26610 tablet_service.cc:1511] Processing CreateTablet for tablet 7c931e3af68c4073a5ed978eb0f43f3f (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:16.521241 26610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c931e3af68c4073a5ed978eb0f43f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.525609 26462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6598ff9cfd5346af8da1e9928f3a5ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.530364 26662 tablet_bootstrap.cc:654] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.532338 26609 tablet_service.cc:1511] Processing CreateTablet for tablet 54a09e3d025e44058af04b7f7fff12f3 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:16.533711 26609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a09e3d025e44058af04b7f7fff12f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.544328 26664 tablet_bootstrap.cc:492] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:16.545464 26455 tablet_service.cc:1511] Processing CreateTablet for tablet 86001e7eca0b4ca4aed965b7d7e5820c (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:16.546886 26455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86001e7eca0b4ca4aed965b7d7e5820c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.547129 26663 tablet_bootstrap.cc:492] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:16.547667 26663 ts_tablet_manager.cc:1403] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.144s	user 0.012s	sys 0.003s
I20260709 12:09:16.555785 26463 tablet_service.cc:1511] Processing CreateTablet for tablet 54a09e3d025e44058af04b7f7fff12f3 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:16.564584 26458 tablet_service.cc:1511] Processing CreateTablet for tablet 14b3fc9b208642ffb7dbc462c4032c67 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:16.565675 26456 tablet_service.cc:1511] Processing CreateTablet for tablet 7c931e3af68c4073a5ed978eb0f43f3f (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:16.577193 26456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c931e3af68c4073a5ed978eb0f43f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.577786 26536 tablet_service.cc:1511] Processing CreateTablet for tablet 5cba10e68f094822a7c267bdbd205a17 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:16.578680 26664 tablet_bootstrap.cc:654] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.579186 26536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cba10e68f094822a7c267bdbd205a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.583446 26458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b3fc9b208642ffb7dbc462c4032c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.588785 26605 tablet_service.cc:1511] Processing CreateTablet for tablet 5cba10e68f094822a7c267bdbd205a17 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:16.590204 26605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cba10e68f094822a7c267bdbd205a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.551106 26611 tablet_service.cc:1511] Processing CreateTablet for tablet 14b3fc9b208642ffb7dbc462c4032c67 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:16.603392 26611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b3fc9b208642ffb7dbc462c4032c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.603211 26529 tablet_service.cc:1511] Processing CreateTablet for tablet 5c23e0d03a4d457fa50856e09fe2f649 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:16.603514 26461 tablet_service.cc:1511] Processing CreateTablet for tablet 5c23e0d03a4d457fa50856e09fe2f649 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:16.604612 26529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c23e0d03a4d457fa50856e09fe2f649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.604848 26461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c23e0d03a4d457fa50856e09fe2f649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.569159 26663 raft_consensus.cc:359] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:16.570443 26460 tablet_service.cc:1511] Processing CreateTablet for tablet 5cba10e68f094822a7c267bdbd205a17 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:16.606470 26663 raft_consensus.cc:385] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.606830 26663 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.607230 26463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a09e3d025e44058af04b7f7fff12f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.608083 26460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cba10e68f094822a7c267bdbd205a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.607656 26663 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:16.616627 26603 tablet_service.cc:1511] Processing CreateTablet for tablet 5c23e0d03a4d457fa50856e09fe2f649 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:16.618052 26603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c23e0d03a4d457fa50856e09fe2f649. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:16.644132 26419 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:16.656320 26607 tablet_service.cc:1511] Processing CreateTablet for tablet 580883b917314b66883009ddb9259ac0 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:16.656908 26534 tablet_service.cc:1511] Processing CreateTablet for tablet 580883b917314b66883009ddb9259ac0 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:16.657804 26607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580883b917314b66883009ddb9259ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.659175 26534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580883b917314b66883009ddb9259ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.664530 26457 tablet_service.cc:1511] Processing CreateTablet for tablet ea50d3c1de374dff938c733fb02faf8c (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:16.665925 26457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea50d3c1de374dff938c733fb02faf8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.667544 26459 tablet_service.cc:1511] Processing CreateTablet for tablet 580883b917314b66883009ddb9259ac0 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:16.668919 26459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580883b917314b66883009ddb9259ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.673774 26538 tablet_service.cc:1511] Processing CreateTablet for tablet ea50d3c1de374dff938c733fb02faf8c (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:16.678675 26498 heartbeater.cc:499] Master 127.24.179.126:41797 was elected leader, sending a full tablet report...
I20260709 12:09:16.679037 26538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea50d3c1de374dff938c733fb02faf8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.684473 26662 tablet_bootstrap.cc:492] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:16.685027 26662 ts_tablet_manager.cc:1403] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.254s	user 0.022s	sys 0.023s
I20260709 12:09:16.688905 26662 raft_consensus.cc:359] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:16.689673 26662 raft_consensus.cc:385] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.689997 26662 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.690865 26662 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:16.696182 26454 tablet_service.cc:1511] Processing CreateTablet for tablet 68aec546ef604f45adc4b6dedb13e41f (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:16.697645 26454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68aec546ef604f45adc4b6dedb13e41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.696182 26536 tablet_service.cc:1511] Processing CreateTablet for tablet 68aec546ef604f45adc4b6dedb13e41f (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:16.703159 26536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68aec546ef604f45adc4b6dedb13e41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.703549 26612 tablet_service.cc:1511] Processing CreateTablet for tablet ea50d3c1de374dff938c733fb02faf8c (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:16.704627 26664 tablet_bootstrap.cc:492] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:16.704895 26612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea50d3c1de374dff938c733fb02faf8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.705163 26664 ts_tablet_manager.cc:1403] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.161s	user 0.007s	sys 0.006s
I20260709 12:09:16.708504 26664 raft_consensus.cc:359] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:16.709216 26664 raft_consensus.cc:385] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.709527 26664 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.710361 26664 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:16.722327 26663 ts_tablet_manager.cc:1434] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.174s	user 0.024s	sys 0.028s
I20260709 12:09:16.723472 26604 tablet_service.cc:1511] Processing CreateTablet for tablet 68aec546ef604f45adc4b6dedb13e41f (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:16.724886 26604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68aec546ef604f45adc4b6dedb13e41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.727061 26603 tablet_service.cc:1511] Processing CreateTablet for tablet 2c246551966f4307a9c8a66e2f024385 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:16.728543 26603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c246551966f4307a9c8a66e2f024385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.731453 26456 tablet_service.cc:1511] Processing CreateTablet for tablet 2c246551966f4307a9c8a66e2f024385 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:16.732869 26456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c246551966f4307a9c8a66e2f024385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.733105 26531 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce8bbdf417f47e7aabb967886d8c95a (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:16.735005 26531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce8bbdf417f47e7aabb967886d8c95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.743809 26532 tablet_service.cc:1511] Processing CreateTablet for tablet 2c246551966f4307a9c8a66e2f024385 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:16.745464 26532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c246551966f4307a9c8a66e2f024385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.723482 26663 tablet_bootstrap.cc:492] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:16.757553 26462 tablet_service.cc:1511] Processing CreateTablet for tablet fc3ac2eaa71249dc96238b05adbd6b9b (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:16.767118 26462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3ac2eaa71249dc96238b05adbd6b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.783807 26607 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce8bbdf417f47e7aabb967886d8c95a (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:16.785373 26607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce8bbdf417f47e7aabb967886d8c95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.746076 26458 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce8bbdf417f47e7aabb967886d8c95a (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:16.807367 26664 ts_tablet_manager.cc:1434] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.102s	user 0.015s	sys 0.012s
I20260709 12:09:16.810909 26664 tablet_bootstrap.cc:492] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:16.811205 26573 heartbeater.cc:499] Master 127.24.179.126:41797 was elected leader, sending a full tablet report...
I20260709 12:09:16.816359 26612 tablet_service.cc:1511] Processing CreateTablet for tablet fc3ac2eaa71249dc96238b05adbd6b9b (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:16.817898 26612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3ac2eaa71249dc96238b05adbd6b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.825800 26664 tablet_bootstrap.cc:654] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.816354 26538 tablet_service.cc:1511] Processing CreateTablet for tablet fc3ac2eaa71249dc96238b05adbd6b9b (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:16.831493 26534 tablet_service.cc:1511] Processing CreateTablet for tablet 799bbccef316451b8fb8dbd051728db0 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:16.832837 26662 ts_tablet_manager.cc:1434] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.147s	user 0.013s	sys 0.018s
I20260709 12:09:16.832978 26534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 799bbccef316451b8fb8dbd051728db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.835304 26647 heartbeater.cc:499] Master 127.24.179.126:41797 was elected leader, sending a full tablet report...
I20260709 12:09:16.834364 26605 tablet_service.cc:1511] Processing CreateTablet for tablet 799bbccef316451b8fb8dbd051728db0 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:16.836450 26605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 799bbccef316451b8fb8dbd051728db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.842219 26662 tablet_bootstrap.cc:492] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:16.850597 26538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3ac2eaa71249dc96238b05adbd6b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.855377 26603 tablet_service.cc:1511] Processing CreateTablet for tablet 72e7c4f1de5d4e28a4c1bf09d4fb099b (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:16.856927 26603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72e7c4f1de5d4e28a4c1bf09d4fb099b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.859485 26458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce8bbdf417f47e7aabb967886d8c95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.859948 26456 tablet_service.cc:1511] Processing CreateTablet for tablet 72e7c4f1de5d4e28a4c1bf09d4fb099b (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:16.860737 26609 tablet_service.cc:1511] Processing CreateTablet for tablet 34b9da257a1d4dadbbe3027844b5b140 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:16.861436 26456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72e7c4f1de5d4e28a4c1bf09d4fb099b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.862053 26609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b9da257a1d4dadbbe3027844b5b140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.863256 26662 tablet_bootstrap.cc:654] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.863458 26536 tablet_service.cc:1511] Processing CreateTablet for tablet 72e7c4f1de5d4e28a4c1bf09d4fb099b (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:16.864765 26536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72e7c4f1de5d4e28a4c1bf09d4fb099b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.865257 26457 tablet_service.cc:1511] Processing CreateTablet for tablet 78002f4d800445a3befddbc1cce2750d (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:16.872450 26463 tablet_service.cc:1511] Processing CreateTablet for tablet 34b9da257a1d4dadbbe3027844b5b140 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:16.872820 26669 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.873415 26669 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:16.873792 26604 tablet_service.cc:1511] Processing CreateTablet for tablet 78002f4d800445a3befddbc1cce2750d (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:16.875238 26604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78002f4d800445a3befddbc1cce2750d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.875588 26663 tablet_bootstrap.cc:654] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.876168 26669 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:16.880075 26457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78002f4d800445a3befddbc1cce2750d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.895321 26531 tablet_service.cc:1511] Processing CreateTablet for tablet 34b9da257a1d4dadbbe3027844b5b140 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:16.897276 26531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b9da257a1d4dadbbe3027844b5b140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.899354 26455 tablet_service.cc:1511] Processing CreateTablet for tablet 799bbccef316451b8fb8dbd051728db0 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:16.902859 26611 tablet_service.cc:1511] Processing CreateTablet for tablet 6d235a62666644668508e208ad8d21d3 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:16.904241 26611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d235a62666644668508e208ad8d21d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.908690 26668 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.909198 26668 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:16.900029 26662 tablet_bootstrap.cc:492] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:16.937497 26662 ts_tablet_manager.cc:1403] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.096s	user 0.016s	sys 0.000s
I20260709 12:09:16.943085 26463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b9da257a1d4dadbbe3027844b5b140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.949283 26664 tablet_bootstrap.cc:492] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:16.949839 26664 ts_tablet_manager.cc:1403] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.139s	user 0.011s	sys 0.020s
I20260709 12:09:16.915014 26668 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:16.881264 26532 tablet_service.cc:1511] Processing CreateTablet for tablet 78002f4d800445a3befddbc1cce2750d (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:16.964234 26610 tablet_service.cc:1511] Processing CreateTablet for tablet 012eaf6f22154b85929ab516a788db5f (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:16.965724 26610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 012eaf6f22154b85929ab516a788db5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.969239 26664 raft_consensus.cc:359] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:16.970175 26664 raft_consensus.cc:385] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.970598 26664 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.973136 26455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 799bbccef316451b8fb8dbd051728db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.973801 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:16.988080 26622 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 0.
I20260709 12:09:16.988445 26532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78002f4d800445a3befddbc1cce2750d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.993096 26662 raft_consensus.cc:359] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:16.995132 26662 raft_consensus.cc:385] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.998898 26439 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:17.010835 26662 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.011345 26668 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.011988 26668 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.012471 26668 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.013031 26662 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.004429 26663 tablet_bootstrap.cc:492] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:17.015888 26663 ts_tablet_manager.cc:1403] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.293s	user 0.019s	sys 0.054s
I20260709 12:09:16.978233 26664 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.025012 26458 tablet_service.cc:1511] Processing CreateTablet for tablet 012eaf6f22154b85929ab516a788db5f (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:17.026177 26538 tablet_service.cc:1511] Processing CreateTablet for tablet 6d235a62666644668508e208ad8d21d3 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:17.029417 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:17.035322 26529 tablet_service.cc:1511] Processing CreateTablet for tablet 012eaf6f22154b85929ab516a788db5f (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:17.037288 26538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d235a62666644668508e208ad8d21d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.038029 26529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 012eaf6f22154b85929ab516a788db5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.037751 26663 raft_consensus.cc:359] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.038527 26663 raft_consensus.cc:385] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.038825 26663 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.039593 26663 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.036211 26662 ts_tablet_manager.cc:1434] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.000s
I20260709 12:09:17.026491 26458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 012eaf6f22154b85929ab516a788db5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.026132 26664 ts_tablet_manager.cc:1434] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.076s	user 0.004s	sys 0.003s
I20260709 12:09:17.047731 26662 tablet_bootstrap.cc:492] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:17.048774 26457 tablet_service.cc:1511] Processing CreateTablet for tablet 6d235a62666644668508e208ad8d21d3 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:17.027516 26459 tablet_service.cc:1511] Processing CreateTablet for tablet 5fceaa32ed834cedaeb85b54a55fc4ed (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:17.054899 26662 tablet_bootstrap.cc:654] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.055470 26534 tablet_service.cc:1511] Processing CreateTablet for tablet 5fceaa32ed834cedaeb85b54a55fc4ed (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:17.057571 26459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fceaa32ed834cedaeb85b54a55fc4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.061177 26534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fceaa32ed834cedaeb85b54a55fc4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.067952 26457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d235a62666644668508e208ad8d21d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.070887 26670 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.071535 26664 tablet_bootstrap.cc:492] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:17.071404 26670 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.074292 26670 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:17.102798 26358 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 54479.8us
I20260709 12:09:17.075407 26603 tablet_service.cc:1511] Processing CreateTablet for tablet 5fceaa32ed834cedaeb85b54a55fc4ed (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:17.107625 26603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fceaa32ed834cedaeb85b54a55fc4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.107447 26604 tablet_service.cc:1511] Processing CreateTablet for tablet c22baf3ebbed46a6a23a4c6cfd24710b (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:17.108837 26604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c22baf3ebbed46a6a23a4c6cfd24710b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.109036 26463 tablet_service.cc:1511] Processing CreateTablet for tablet c22baf3ebbed46a6a23a4c6cfd24710b (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:17.110532 26463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c22baf3ebbed46a6a23a4c6cfd24710b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.112576 26664 tablet_bootstrap.cc:654] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.112670 26612 tablet_service.cc:1511] Processing CreateTablet for tablet 75c9184ee6b7472fb72209c9dfd651b6 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:17.114559 26612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c9184ee6b7472fb72209c9dfd651b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.121556 26455 tablet_service.cc:1511] Processing CreateTablet for tablet 75c9184ee6b7472fb72209c9dfd651b6 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:17.123898 26455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c9184ee6b7472fb72209c9dfd651b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.127890 26609 tablet_service.cc:1511] Processing CreateTablet for tablet 63a71194fb3446e6b7b3135fde882816 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:17.129369 26609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a71194fb3446e6b7b3135fde882816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.130719 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:09:17.155272 26587 leader_election.cc:343] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.158614 26607 tablet_service.cc:1511] Processing CreateTablet for tablet f3c1161f4dab4d0e9f9b0053e38dfe10 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:17.158941 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:17.160338 26607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3c1161f4dab4d0e9f9b0053e38dfe10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.168843 26608 tablet_service.cc:1511] Processing CreateTablet for tablet 2fc3920d73734952bc159eff19f3567d (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:17.170089 26608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fc3920d73734952bc159eff19f3567d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.173625 26458 tablet_service.cc:1511] Processing CreateTablet for tablet 63a71194fb3446e6b7b3135fde882816 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:17.175072 26458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a71194fb3446e6b7b3135fde882816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.175377 26605 tablet_service.cc:1511] Processing CreateTablet for tablet d6e6ed3d8ee44750a4d06294867e92bc (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:17.176729 26605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6e6ed3d8ee44750a4d06294867e92bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.205873 26662 tablet_bootstrap.cc:492] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:17.204342 26668 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.206460 26662 ts_tablet_manager.cc:1403] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.159s	user 0.024s	sys 0.005s
I20260709 12:09:17.206858 26473 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 1: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:09:17.210628 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:17.212160 26669 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.209919 26662 raft_consensus.cc:359] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.216595 26662 raft_consensus.cc:385] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.216928 26662 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.217826 26662 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.220880 26663 ts_tablet_manager.cc:1434] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.205s	user 0.020s	sys 0.025s
I20260709 12:09:17.221359 26669 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.221990 26663 tablet_bootstrap.cc:492] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:17.231783 26459 tablet_service.cc:1511] Processing CreateTablet for tablet f3c1161f4dab4d0e9f9b0053e38dfe10 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:17.232069 26457 tablet_service.cc:1511] Processing CreateTablet for tablet 2fc3920d73734952bc159eff19f3567d (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:17.232604 26456 tablet_service.cc:1511] Processing CreateTablet for tablet 3d83c4273cd74e768f756e0c8ba65432 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:17.233197 26459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3c1161f4dab4d0e9f9b0053e38dfe10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.233861 26456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d83c4273cd74e768f756e0c8ba65432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.234774 26457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fc3920d73734952bc159eff19f3567d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.236517 26605 tablet_service.cc:1511] Processing CreateTablet for tablet 3d83c4273cd74e768f756e0c8ba65432 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:17.237406 26663 tablet_bootstrap.cc:654] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.237774 26605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d83c4273cd74e768f756e0c8ba65432. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:17.259478 26513 leader_election.cc:343] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:17.260237 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 63252.8us
I20260709 12:09:17.267976 26532 tablet_service.cc:1511] Processing CreateTablet for tablet c22baf3ebbed46a6a23a4c6cfd24710b (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:17.268946 26538 tablet_service.cc:1511] Processing CreateTablet for tablet 63a71194fb3446e6b7b3135fde882816 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:17.269474 26532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c22baf3ebbed46a6a23a4c6cfd24710b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.270298 26538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a71194fb3446e6b7b3135fde882816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.270557 26669 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.271087 26669 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.273288 26669 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:17.275511 26531 tablet_service.cc:1511] Processing CreateTablet for tablet f3c1161f4dab4d0e9f9b0053e38dfe10 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:17.276913 26531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3c1161f4dab4d0e9f9b0053e38dfe10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.277005 26534 tablet_service.cc:1511] Processing CreateTablet for tablet d6e6ed3d8ee44750a4d06294867e92bc (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:17.279155 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:09:17.289305 26587 leader_election.cc:343] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.278805 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:17.281200 26529 tablet_service.cc:1511] Processing CreateTablet for tablet 75c9184ee6b7472fb72209c9dfd651b6 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
W20260709 12:09:17.291333 26587 leader_election.cc:343] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.279852 26668 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:17.291802 26587 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:17.278359 26534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6e6ed3d8ee44750a4d06294867e92bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.282305 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:17.280941 26530 tablet_service.cc:1511] Processing CreateTablet for tablet 3d83c4273cd74e768f756e0c8ba65432 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:17.293558 26530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d83c4273cd74e768f756e0c8ba65432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.294869 26529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c9184ee6b7472fb72209c9dfd651b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.291519 26537 tablet_service.cc:1511] Processing CreateTablet for tablet f9abba0c7cca40c4b2a9ffbcde803684 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:17.297729 26669 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.299484 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:17.299401 26460 tablet_service.cc:1511] Processing CreateTablet for tablet 78bbb48570954bf4ad1039abff47c036 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:17.300258 26621 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:17.300833 26460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78bbb48570954bf4ad1039abff47c036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.280182 26454 tablet_service.cc:1511] Processing CreateTablet for tablet f9abba0c7cca40c4b2a9ffbcde803684 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:17.302229 26454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9abba0c7cca40c4b2a9ffbcde803684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.283386 26611 tablet_service.cc:1511] Processing CreateTablet for tablet f9abba0c7cca40c4b2a9ffbcde803684 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:17.310277 26611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9abba0c7cca40c4b2a9ffbcde803684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.279470 26536 tablet_service.cc:1511] Processing CreateTablet for tablet 2fc3920d73734952bc159eff19f3567d (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:17.315658 26536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fc3920d73734952bc159eff19f3567d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.320307 26662 ts_tablet_manager.cc:1434] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.113s	user 0.021s	sys 0.019s
I20260709 12:09:17.322942 26537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9abba0c7cca40c4b2a9ffbcde803684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.323824 26662 tablet_bootstrap.cc:492] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:17.328352 26670 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.328927 26670 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.331110 26670 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:17.333153 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:09:17.335099 26513 leader_election.cc:343] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.343005 26458 tablet_service.cc:1511] Processing CreateTablet for tablet d6e6ed3d8ee44750a4d06294867e92bc (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:17.343962 26662 tablet_bootstrap.cc:654] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.344380 26458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6e6ed3d8ee44750a4d06294867e92bc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:17.353729 26357 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 46597.8us
I20260709 12:09:17.355051 26663 tablet_bootstrap.cc:492] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:17.355556 26663 ts_tablet_manager.cc:1403] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.134s	user 0.012s	sys 0.025s
I20260709 12:09:17.357646 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:17.358894 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:17.359028 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:17.359143 26514 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:09:17.360755 26438 leader_election.cc:343] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:17.360935 26514 leader_election.cc:343] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.361310 26670 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.361420 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:17.361701 26670 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:17.361774 26438 leader_election.cc:343] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.367766 26664 tablet_bootstrap.cc:492] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:17.368394 26664 ts_tablet_manager.cc:1403] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.297s	user 0.011s	sys 0.003s
W20260709 12:09:17.370462 26358 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 48545.5us
I20260709 12:09:17.371445 26530 tablet_service.cc:1511] Processing CreateTablet for tablet 78bbb48570954bf4ad1039abff47c036 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:17.372843 26664 raft_consensus.cc:359] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.373374 26530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78bbb48570954bf4ad1039abff47c036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.373620 26664 raft_consensus.cc:385] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.373997 26664 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.362109 26670 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.382037 26668 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.382601 26668 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.384797 26668 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:17.386143 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:17.364881 26663 raft_consensus.cc:359] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.387068 26663 raft_consensus.cc:385] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.387413 26663 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.387313 26622 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
W20260709 12:09:17.387709 26439 leader_election.cc:343] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.388490 26663 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.388962 26439 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:17.389839 26668 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.390307 26668 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:17.390862 26663 ts_tablet_manager.cc:1434] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:09:17.390372 26664 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.385888 26670 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.391218 26668 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.411044 26663 tablet_bootstrap.cc:492] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:17.412437 26607 tablet_service.cc:1511] Processing CreateTablet for tablet 78bbb48570954bf4ad1039abff47c036 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:17.413980 26607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78bbb48570954bf4ad1039abff47c036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.417162 26605 tablet_service.cc:1511] Processing CreateTablet for tablet b9bd8978cfc74b93bcc4755ec8254fa7 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:17.419013 26605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9bd8978cfc74b93bcc4755ec8254fa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.418668 26460 tablet_service.cc:1511] Processing CreateTablet for tablet b9bd8978cfc74b93bcc4755ec8254fa7 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:17.419960 26463 tablet_service.cc:1511] Processing CreateTablet for tablet d1ee0545deb746aeb5c1c14751b96826 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:17.421200 26460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9bd8978cfc74b93bcc4755ec8254fa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.425127 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:17.425957 26473 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.433377 26670 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:17.434029 26670 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.438761 26473 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:17.444136 26463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1ee0545deb746aeb5c1c14751b96826. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:17.451488 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 87887.1us
I20260709 12:09:17.456017 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:17.456588 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:17.457456 26622 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.457902 26609 tablet_service.cc:1511] Processing CreateTablet for tablet d1ee0545deb746aeb5c1c14751b96826 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:17.463418 26670 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.467051 26670 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:17.467888 26664 ts_tablet_manager.cc:1434] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.099s	user 0.012s	sys 0.011s
I20260709 12:09:17.469894 26664 tablet_bootstrap.cc:492] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:17.469508 26532 tablet_service.cc:1511] Processing CreateTablet for tablet d1ee0545deb746aeb5c1c14751b96826 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:17.471367 26532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1ee0545deb746aeb5c1c14751b96826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.474982 26609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1ee0545deb746aeb5c1c14751b96826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.475514 26456 tablet_service.cc:1511] Processing CreateTablet for tablet 366874f8c4424fa2a9f169e9c3d6e97e (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:17.476686 26664 tablet_bootstrap.cc:654] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.476938 26456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 366874f8c4424fa2a9f169e9c3d6e97e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.468020 26670 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.479601 26533 tablet_service.cc:1511] Processing CreateTablet for tablet 366874f8c4424fa2a9f169e9c3d6e97e (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:17.481527 26533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 366874f8c4424fa2a9f169e9c3d6e97e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.483433 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:09:17.488231 26438 leader_election.cc:343] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.488725 26438 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:17.495012 26538 tablet_service.cc:1511] Processing CreateTablet for tablet b9bd8978cfc74b93bcc4755ec8254fa7 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:17.496452 26538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9bd8978cfc74b93bcc4755ec8254fa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.497045 26668 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.493613 26371 catalog_manager.cc:5697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 0 to 1, leader changed from <none> to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.529438 26662 tablet_bootstrap.cc:492] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:17.530032 26662 ts_tablet_manager.cc:1403] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.206s	user 0.011s	sys 0.013s
I20260709 12:09:17.532287 26603 tablet_service.cc:1511] Processing CreateTablet for tablet 366874f8c4424fa2a9f169e9c3d6e97e (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:17.532660 26604 tablet_service.cc:1511] Processing CreateTablet for tablet 67d6a6aed08548acab4272e6f5f1480a (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:17.533805 26603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 366874f8c4424fa2a9f169e9c3d6e97e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.534451 26604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d6a6aed08548acab4272e6f5f1480a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.536052 26662 raft_consensus.cc:359] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.536866 26662 raft_consensus.cc:385] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.537204 26662 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.537703 26663 tablet_bootstrap.cc:654] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.538103 26662 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.544237 26537 tablet_service.cc:1511] Processing CreateTablet for tablet 67d6a6aed08548acab4272e6f5f1480a (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:17.544389 26531 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2747b6998c418ab70cbcbd2f2deeaa (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:17.545907 26537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d6a6aed08548acab4272e6f5f1480a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.551771 26454 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2747b6998c418ab70cbcbd2f2deeaa (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:17.553336 26454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2747b6998c418ab70cbcbd2f2deeaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.551761 26457 tablet_service.cc:1511] Processing CreateTablet for tablet 67d6a6aed08548acab4272e6f5f1480a (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:17.555559 26622 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:17.558744 26457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d6a6aed08548acab4272e6f5f1480a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.559232 26607 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2747b6998c418ab70cbcbd2f2deeaa (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:17.560557 26607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2747b6998c418ab70cbcbd2f2deeaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.572136 26664 tablet_bootstrap.cc:492] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:17.573123 26664 ts_tablet_manager.cc:1403] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.103s	user 0.023s	sys 0.032s
I20260709 12:09:17.572868 26455 tablet_service.cc:1511] Processing CreateTablet for tablet 3288c98248464af5b8f3227349002ec7 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:17.574235 26455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3288c98248464af5b8f3227349002ec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.593734 26536 tablet_service.cc:1511] Processing CreateTablet for tablet 3288c98248464af5b8f3227349002ec7 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:17.597553 26662 ts_tablet_manager.cc:1434] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.000s
I20260709 12:09:17.598737 26662 tablet_bootstrap.cc:492] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:17.599635 26664 raft_consensus.cc:359] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.600449 26664 raft_consensus.cc:385] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.600744 26664 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.578078 26531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2747b6998c418ab70cbcbd2f2deeaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.613511 26463 tablet_service.cc:1511] Processing CreateTablet for tablet ffdceca3c04a40cdba75f01fa9ded9f8 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:17.614511 26662 tablet_bootstrap.cc:654] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.615064 26463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffdceca3c04a40cdba75f01fa9ded9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.626650 26611 tablet_service.cc:1511] Processing CreateTablet for tablet 3288c98248464af5b8f3227349002ec7 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:17.636482 26536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3288c98248464af5b8f3227349002ec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.645730 26605 tablet_service.cc:1511] Processing CreateTablet for tablet ffdceca3c04a40cdba75f01fa9ded9f8 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20260709 12:09:17.646764 26419 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:17.649298 26535 tablet_service.cc:1511] Processing CreateTablet for tablet ffdceca3c04a40cdba75f01fa9ded9f8 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:17.651818 26459 tablet_service.cc:1511] Processing CreateTablet for tablet ceda449be0d044e0b465f42ed3047751 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:17.653772 26535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffdceca3c04a40cdba75f01fa9ded9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.657915 26611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3288c98248464af5b8f3227349002ec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.674845 26605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffdceca3c04a40cdba75f01fa9ded9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.682417 26534 tablet_service.cc:1511] Processing CreateTablet for tablet ceda449be0d044e0b465f42ed3047751 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:17.684084 26534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceda449be0d044e0b465f42ed3047751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.685658 26459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceda449be0d044e0b465f42ed3047751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.685531 26603 tablet_service.cc:1511] Processing CreateTablet for tablet ceda449be0d044e0b465f42ed3047751 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:17.608987 26664 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.698324 26604 tablet_service.cc:1511] Processing CreateTablet for tablet d2e173b367e6460b8f654b2de1aabfae (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:17.699996 26604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e173b367e6460b8f654b2de1aabfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.700672 26462 tablet_service.cc:1511] Processing CreateTablet for tablet 01f2ec42332f4afd97d2dbfac0d5ee00 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:17.701980 26462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f2ec42332f4afd97d2dbfac0d5ee00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.702668 26458 tablet_service.cc:1511] Processing CreateTablet for tablet d2e173b367e6460b8f654b2de1aabfae (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:17.703898 26461 tablet_service.cc:1511] Processing CreateTablet for tablet 0e9f2c921ba4426a8185f516aa2d8deb (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:17.704612 26458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e173b367e6460b8f654b2de1aabfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.706108 26610 tablet_service.cc:1511] Processing CreateTablet for tablet 0e9f2c921ba4426a8185f516aa2d8deb (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:17.707753 26610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e9f2c921ba4426a8185f516aa2d8deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.706108 26608 tablet_service.cc:1511] Processing CreateTablet for tablet 01f2ec42332f4afd97d2dbfac0d5ee00 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:17.711601 26608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f2ec42332f4afd97d2dbfac0d5ee00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.711867 26612 tablet_service.cc:1511] Processing CreateTablet for tablet 953d8c981a6c459f8b7f3dbbb66fda45 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:17.713306 26612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953d8c981a6c459f8b7f3dbbb66fda45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.714342 26461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e9f2c921ba4426a8185f516aa2d8deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.720414 26606 tablet_service.cc:1511] Processing CreateTablet for tablet 541724f47bb04d5185dd369750546cbf (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:17.721938 26606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541724f47bb04d5185dd369750546cbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.725431 26460 tablet_service.cc:1511] Processing CreateTablet for tablet 953d8c981a6c459f8b7f3dbbb66fda45 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:17.733515 26529 tablet_service.cc:1511] Processing CreateTablet for tablet 01f2ec42332f4afd97d2dbfac0d5ee00 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:17.736258 26663 tablet_bootstrap.cc:492] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:17.745190 26532 tablet_service.cc:1511] Processing CreateTablet for tablet 0e9f2c921ba4426a8185f516aa2d8deb (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:17.746723 26603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceda449be0d044e0b465f42ed3047751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.749402 26606 tablet_service.cc:1511] Processing CreateTablet for tablet f90484c8608940e99361799cdda3a0f7 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:17.754576 26663 ts_tablet_manager.cc:1403] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.358s	user 0.021s	sys 0.043s
I20260709 12:09:17.759348 26606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f90484c8608940e99361799cdda3a0f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.761495 26663 raft_consensus.cc:359] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.762328 26663 raft_consensus.cc:385] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.762661 26663 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.763590 26663 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.764348 26662 tablet_bootstrap.cc:492] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:17.764861 26662 ts_tablet_manager.cc:1403] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.166s	user 0.021s	sys 0.035s
I20260709 12:09:17.767900 26663 ts_tablet_manager.cc:1434] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:09:17.770262 26538 tablet_service.cc:1511] Processing CreateTablet for tablet 953d8c981a6c459f8b7f3dbbb66fda45 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:17.770676 26612 tablet_service.cc:1511] Processing CreateTablet for tablet 724bc8274ed84709a5b83825934b7f03 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:17.771461 26532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e9f2c921ba4426a8185f516aa2d8deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.771884 26612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724bc8274ed84709a5b83825934b7f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.774906 26460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953d8c981a6c459f8b7f3dbbb66fda45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.775611 26664 ts_tablet_manager.cc:1434] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.202s	user 0.008s	sys 0.003s
I20260709 12:09:17.776729 26664 tablet_bootstrap.cc:492] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:17.777717 26530 tablet_service.cc:1511] Processing CreateTablet for tablet d2e173b367e6460b8f654b2de1aabfae (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:17.779567 26529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f2ec42332f4afd97d2dbfac0d5ee00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.783880 26663 tablet_bootstrap.cc:492] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:17.785166 26668 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.770694 26662 raft_consensus.cc:359] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.788262 26662 raft_consensus.cc:385] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.788656 26662 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.788686 26456 tablet_service.cc:1511] Processing CreateTablet for tablet 724bc8274ed84709a5b83825934b7f03 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:17.790225 26456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724bc8274ed84709a5b83825934b7f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.793076 26538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953d8c981a6c459f8b7f3dbbb66fda45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.788715 26457 tablet_service.cc:1511] Processing CreateTablet for tablet 541724f47bb04d5185dd369750546cbf (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:17.795871 26457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541724f47bb04d5185dd369750546cbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.799207 26530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e173b367e6460b8f654b2de1aabfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.802146 26533 tablet_service.cc:1511] Processing CreateTablet for tablet 541724f47bb04d5185dd369750546cbf (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:17.807648 26533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541724f47bb04d5185dd369750546cbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.789701 26662 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.805825 26663 tablet_bootstrap.cc:654] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.810154 26662 ts_tablet_manager.cc:1434] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.045s	user 0.000s	sys 0.006s
I20260709 12:09:17.802217 26664 tablet_bootstrap.cc:654] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.811304 26662 tablet_bootstrap.cc:492] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:17.834769 26670 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.835317 26670 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.837489 26670 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:17.839267 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:09:17.840804 26513 leader_election.cc:343] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.842756 26662 tablet_bootstrap.cc:654] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.843772 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:17.844453 26621 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:17.846551 26514 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:09:17.847393 26670 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.847777 26670 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.848091 26670 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.852336 26605 tablet_service.cc:1511] Processing CreateTablet for tablet 12729361d003466aada20ab37328d285 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:17.856792 26670 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.854312 26604 tablet_service.cc:1511] Processing CreateTablet for tablet 69e1490de99a4232a6717e72242a0f00 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:17.858678 26609 tablet_service.cc:1511] Processing CreateTablet for tablet dee06ad5f38b42f99fdbc1d71eee680f (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:17.859709 26604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69e1490de99a4232a6717e72242a0f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.859625 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:09:17.861107 26513 leader_election.cc:343] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.862053 26670 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:17.882342 26670 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.883140 26670 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.884723 26536 tablet_service.cc:1511] Processing CreateTablet for tablet f90484c8608940e99361799cdda3a0f7 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:17.885375 26670 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:17.886219 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:09:17.887775 26513 leader_election.cc:343] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.887830 26535 tablet_service.cc:1511] Processing CreateTablet for tablet 724bc8274ed84709a5b83825934b7f03 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:17.886169 26536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f90484c8608940e99361799cdda3a0f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.901122 26455 tablet_service.cc:1511] Processing CreateTablet for tablet f90484c8608940e99361799cdda3a0f7 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:17.901737 26463 tablet_service.cc:1511] Processing CreateTablet for tablet 69e1490de99a4232a6717e72242a0f00 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:17.902928 26609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dee06ad5f38b42f99fdbc1d71eee680f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.905074 26603 tablet_service.cc:1511] Processing CreateTablet for tablet 02fc28e9bbd743569e5c7c101c4688fb (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:17.907581 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:17.908746 26534 tablet_service.cc:1511] Processing CreateTablet for tablet 69e1490de99a4232a6717e72242a0f00 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:17.911680 26456 tablet_service.cc:1511] Processing CreateTablet for tablet 12729361d003466aada20ab37328d285 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:17.915638 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:17.926003 26620 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:17.923710 26621 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.926347 26455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f90484c8608940e99361799cdda3a0f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.929401 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:09:17.932716 26670 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.938894 26670 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.939255 26670 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.935042 26605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12729361d003466aada20ab37328d285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.946738 26603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02fc28e9bbd743569e5c7c101c4688fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.946970 26454 tablet_service.cc:1511] Processing CreateTablet for tablet 02fc28e9bbd743569e5c7c101c4688fb (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:17.956725 26535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724bc8274ed84709a5b83825934b7f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.957340 26621 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:17.960832 26514 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:09:17.962240 26690 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.962901 26690 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:17.963937 26690 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:17.970109 26463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69e1490de99a4232a6717e72242a0f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.971772 26687 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:17.984272 26537 tablet_service.cc:1511] Processing CreateTablet for tablet 12729361d003466aada20ab37328d285 (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:17.987213 26456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12729361d003466aada20ab37328d285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.991906 26664 tablet_bootstrap.cc:492] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:17.992764 26664 ts_tablet_manager.cc:1403] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.216s	user 0.017s	sys 0.001s
I20260709 12:09:18.002202 26662 tablet_bootstrap.cc:492] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:18.002308 26454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02fc28e9bbd743569e5c7c101c4688fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.002975 26662 ts_tablet_manager.cc:1403] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.192s	user 0.004s	sys 0.026s
I20260709 12:09:18.004801 26532 tablet_service.cc:1511] Processing CreateTablet for tablet dee06ad5f38b42f99fdbc1d71eee680f (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:18.007540 26460 tablet_service.cc:1511] Processing CreateTablet for tablet dee06ad5f38b42f99fdbc1d71eee680f (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:18.021394 26537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12729361d003466aada20ab37328d285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.042996 26670 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.050884 26663 tablet_bootstrap.cc:492] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:18.051491 26663 ts_tablet_manager.cc:1403] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.268s	user 0.010s	sys 0.008s
W20260709 12:09:18.053864 26648 tablet.cc:2406] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:09:18.061602 26534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69e1490de99a4232a6717e72242a0f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.062228 26664 raft_consensus.cc:359] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.063066 26664 raft_consensus.cc:385] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.063428 26664 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.064260 26664 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:18.031411 26438 consensus_peers.cc:597] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:18.068284 26664 ts_tablet_manager.cc:1434] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.075s	user 0.010s	sys 0.000s
I20260709 12:09:18.069447 26664 tablet_bootstrap.cc:492] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
W20260709 12:09:18.068172 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 49810.7us
I20260709 12:09:18.073146 26460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dee06ad5f38b42f99fdbc1d71eee680f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.076480 26531 tablet_service.cc:1511] Processing CreateTablet for tablet 02fc28e9bbd743569e5c7c101c4688fb (DEFAULT_TABLE table=test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:18.087008 26663 raft_consensus.cc:359] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.088639 26663 raft_consensus.cc:385] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.089304 26663 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.090675 26663 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.094632 26532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dee06ad5f38b42f99fdbc1d71eee680f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.097043 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:18.097451 26531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02fc28e9bbd743569e5c7c101c4688fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.097765 26472 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.099761 26670 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:18.103000 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:18.104359 26621 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.103863 26663 ts_tablet_manager.cc:1434] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.052s	user 0.010s	sys 0.001s
I20260709 12:09:18.106758 26670 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.107453 26663 tablet_bootstrap.cc:492] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:18.112187 26621 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:18.113799 26472 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:18.048538 26662 raft_consensus.cc:359] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.116372 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:18.117417 26690 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.118158 26690 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:18.119155 26690 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.120060 26703 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.116567 26662 raft_consensus.cc:385] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.120645 26662 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.120647 26703 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.128427 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:18.131089 26439 leader_election.cc:343] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.132893 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:18.134893 26664 tablet_bootstrap.cc:654] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:18.135485 26438 leader_election.cc:343] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.136019 26438 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:18.137001 26705 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.137806 26703 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:18.143484 26662 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.147790 26662 ts_tablet_manager.cc:1434] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.144s	user 0.009s	sys 0.000s
I20260709 12:09:18.147339 26370 catalog_manager.cc:5697] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.150755 26662 tablet_bootstrap.cc:492] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:18.152086 26663 tablet_bootstrap.cc:654] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.162315 26684 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.165302 26684 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.168103 26684 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:18.170126 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:18.170871 26547 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 0.
I20260709 12:09:18.171877 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:18.172254 26662 tablet_bootstrap.cc:654] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.172281 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:09:18.177359 26587 leader_election.cc:343] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.178382 26684 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.178741 26664 tablet_bootstrap.cc:492] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:18.178892 26684 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.179266 26664 ts_tablet_manager.cc:1403] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.110s	user 0.015s	sys 0.017s
I20260709 12:09:18.179394 26684 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.184221 26664 raft_consensus.cc:359] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.185245 26664 raft_consensus.cc:385] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.202543 26664 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.201961 26684 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.205205 26664 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.208004 26664 ts_tablet_manager.cc:1434] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.002s
I20260709 12:09:18.215924 26664 tablet_bootstrap.cc:492] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:18.221120 26369 catalog_manager.cc:5697] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.222263 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:18.223058 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:18.226373 26547 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.227710 26664 tablet_bootstrap.cc:654] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.227636 26369 catalog_manager.cc:5697] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.223584 26684 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:09:18.234911 26587 leader_election.cc:343] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.235185 26547 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:18.224951 26663 tablet_bootstrap.cc:492] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:18.225347 26662 tablet_bootstrap.cc:492] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:18.236508 26662 ts_tablet_manager.cc:1403] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.088s	user 0.018s	sys 0.013s
I20260709 12:09:18.236531 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:09:18.237978 26684 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.238229 26664 tablet_bootstrap.cc:492] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:18.238768 26664 ts_tablet_manager.cc:1403] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.006s
I20260709 12:09:18.238806 26663 ts_tablet_manager.cc:1403] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.132s	user 0.020s	sys 0.032s
I20260709 12:09:18.239951 26662 raft_consensus.cc:359] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.240790 26662 raft_consensus.cc:385] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.241128 26662 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.241984 26663 raft_consensus.cc:359] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.242085 26662 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.242362 26664 raft_consensus.cc:359] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.242867 26663 raft_consensus.cc:385] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.243145 26664 raft_consensus.cc:385] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.243288 26663 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.243556 26664 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.244227 26663 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.244833 26662 ts_tablet_manager.cc:1434] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:09:18.244577 26664 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.246253 26684 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:18.247522 26664 ts_tablet_manager.cc:1434] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.006s
I20260709 12:09:18.247401 26684 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.248667 26664 tablet_bootstrap.cc:492] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:18.245965 26662 tablet_bootstrap.cc:492] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:18.253458 26663 ts_tablet_manager.cc:1434] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:09:18.254668 26663 tablet_bootstrap.cc:492] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:18.261106 26664 tablet_bootstrap.cc:654] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.261482 26663 tablet_bootstrap.cc:654] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.264219 26662 tablet_bootstrap.cc:654] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.271539 26663 tablet_bootstrap.cc:492] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:18.272085 26663 ts_tablet_manager.cc:1403] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.007s
I20260709 12:09:18.273473 26664 tablet_bootstrap.cc:492] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:18.274077 26664 ts_tablet_manager.cc:1403] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.008s
I20260709 12:09:18.275306 26663 raft_consensus.cc:359] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.276134 26663 raft_consensus.cc:385] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.276451 26663 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.275599 26369 catalog_manager.cc:5697] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.277403 26663 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.277796 26664 raft_consensus.cc:359] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.278755 26664 raft_consensus.cc:385] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.279168 26664 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.280066 26664 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.282490 26664 ts_tablet_manager.cc:1434] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:09:18.283687 26664 tablet_bootstrap.cc:492] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:18.288154 26663 ts_tablet_manager.cc:1434] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.005s
I20260709 12:09:18.290385 26664 tablet_bootstrap.cc:654] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.292990 26663 tablet_bootstrap.cc:492] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:18.300221 26663 tablet_bootstrap.cc:654] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.304188 26664 tablet_bootstrap.cc:492] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:18.305065 26664 ts_tablet_manager.cc:1403] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.011s
I20260709 12:09:18.308495 26662 tablet_bootstrap.cc:492] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:18.309020 26662 ts_tablet_manager.cc:1403] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.021s
I20260709 12:09:18.309418 26684 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.309973 26684 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.311856 26662 raft_consensus.cc:359] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.312273 26684 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:18.312593 26662 raft_consensus.cc:385] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.312877 26662 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.313910 26662 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.314896 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:18.315567 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:09:18.316407 26587 leader_election.cc:343] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.316447 26662 ts_tablet_manager.cc:1434] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:18.318126 26662 tablet_bootstrap.cc:492] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:18.318233 26664 raft_consensus.cc:359] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.319036 26664 raft_consensus.cc:385] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.319203 26663 tablet_bootstrap.cc:492] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:18.319489 26664 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.319737 26663 ts_tablet_manager.cc:1403] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.007s
I20260709 12:09:18.320418 26664 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.322088 26703 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.322942 26664 ts_tablet_manager.cc:1434] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:09:18.322633 26703 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.316437 26547 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 0.
I20260709 12:09:18.324347 26705 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.324481 26716 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.324951 26705 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.325003 26716 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.327405 26716 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:18.327613 26664 tablet_bootstrap.cc:492] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:18.327425 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:18.328811 26662 tablet_bootstrap.cc:654] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.328919 26621 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 1: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:18.329519 26587 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:09:18.330987 26716 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.331331 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:18.331647 26716 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.332290 26716 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.324898 26663 raft_consensus.cc:359] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.334854 26663 raft_consensus.cc:385] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.335146 26663 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.335855 26663 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.337947 26663 ts_tablet_manager.cc:1434] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.000s
W20260709 12:09:18.338222 26438 leader_election.cc:343] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.338595 26664 tablet_bootstrap.cc:654] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.340778 26663 tablet_bootstrap.cc:492] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:18.342885 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:18.343851 26473 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 0.
I20260709 12:09:18.345348 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:18.346369 26548 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 0.
I20260709 12:09:18.349447 26663 tablet_bootstrap.cc:654] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.349189 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:18.349916 26690 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.350414 26690 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:18.351038 26439 leader_election.cc:343] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.351519 26439 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:18.352357 26668 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.352669 26690 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:18.354279 26662 tablet_bootstrap.cc:492] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:18.354764 26662 ts_tablet_manager.cc:1403] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.005s
I20260709 12:09:18.355113 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:18.357450 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:18.360608 26668 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.365248 26707 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.365795 26707 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.327441 26705 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:18.367515 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:18.368017 26707 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:18.368480 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:18.369104 26473 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:18.369623 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:18.370183 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:18.325070 26703 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:18.371688 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:18.372628 26690 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.373001 26690 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.373327 26690 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.375887 26668 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.371596 26684 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.376770 26684 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.377143 26684 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.379859 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:18.380669 26547 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 1: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:09:18.381950 26438 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:18.357487 26662 raft_consensus.cc:359] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.382946 26662 raft_consensus.cc:385] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.383209 26662 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.383745 26716 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.386323 26687 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.387203 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:18.386641 26716 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:18.389365 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:18.389937 26548 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.393980 26690 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:18.395057 26587 leader_election.cc:343] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.399417 26668 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.401886 26690 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:18.402561 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:18.402701 26662 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.385919 26684 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.403595 26621 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:18.404775 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:18.409700 26684 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:18.398485 26664 tablet_bootstrap.cc:492] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:18.410055 26473 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.411397 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:18.412038 26664 ts_tablet_manager.cc:1403] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.085s	user 0.027s	sys 0.005s
I20260709 12:09:18.412066 26472 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.412925 26663 tablet_bootstrap.cc:492] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:18.413403 26663 ts_tablet_manager.cc:1403] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.073s	user 0.029s	sys 0.029s
I20260709 12:09:18.411402 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:18.414868 26547 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.416204 26663 raft_consensus.cc:359] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.416872 26663 raft_consensus.cc:385] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.417115 26663 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.407171 26548 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:18.415429 26664 raft_consensus.cc:359] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.418001 26663 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.418751 26664 raft_consensus.cc:385] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.418839 26587 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:09:18.419126 26664 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.420244 26663 ts_tablet_manager.cc:1434] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:09:18.419973 26664 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.421298 26663 tablet_bootstrap.cc:492] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:18.424612 26473 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:18.427304 26663 tablet_bootstrap.cc:654] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.427104 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:18.428867 26670 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.430017 26716 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.435380 26472 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:18.436194 26687 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.446233 26716 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:18.439934 26547 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:18.446470 26668 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.446905 26663 tablet_bootstrap.cc:492] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:18.477483 26663 ts_tablet_manager.cc:1403] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.007s
I20260709 12:09:18.478914 26664 ts_tablet_manager.cc:1434] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.066s	user 0.001s	sys 0.005s
I20260709 12:09:18.478960 26662 ts_tablet_manager.cc:1434] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.124s	user 0.008s	sys 0.010s
I20260709 12:09:18.479887 26664 tablet_bootstrap.cc:492] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:18.479904 26662 tablet_bootstrap.cc:492] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:18.481462 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:18.482525 26729 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.483048 26729 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:18.483933 26729 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.486308 26662 tablet_bootstrap.cc:654] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.488517 26664 tablet_bootstrap.cc:654] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.447350 26670 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:18.494303 26670 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.493696 26716 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.499711 26663 raft_consensus.cc:359] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.500514 26663 raft_consensus.cc:385] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.500809 26663 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.501842 26663 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.506287 26663 ts_tablet_manager.cc:1434] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.002s
I20260709 12:09:18.508162 26663 tablet_bootstrap.cc:492] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:18.515447 26662 tablet_bootstrap.cc:492] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:18.516158 26662 ts_tablet_manager.cc:1403] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.013s
I20260709 12:09:18.521124 26662 raft_consensus.cc:359] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.521901 26662 raft_consensus.cc:385] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.522230 26662 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.522276 26663 tablet_bootstrap.cc:654] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.523028 26662 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.526865 26662 ts_tablet_manager.cc:1434] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:09:18.527844 26662 tablet_bootstrap.cc:492] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:18.533048 26664 tablet_bootstrap.cc:492] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:18.533699 26664 ts_tablet_manager.cc:1403] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.009s
I20260709 12:09:18.539484 26687 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.540450 26728 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.541051 26728 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.544662 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:18.545481 26663 tablet_bootstrap.cc:492] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:18.545426 26622 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:18.546121 26663 ts_tablet_manager.cc:1403] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.038s	user 0.022s	sys 0.005s
I20260709 12:09:18.544704 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:18.546708 26472 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:18.548142 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:18.548514 26728 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:18.549072 26728 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.549439 26728 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.536648 26664 raft_consensus.cc:359] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.549801 26728 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.549993 26664 raft_consensus.cc:385] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.550287 26664 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.551018 26664 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.553215 26664 ts_tablet_manager.cc:1434] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 12:09:18.554164 26664 tablet_bootstrap.cc:492] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:18.553864 26369 catalog_manager.cc:5697] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.540549 26662 tablet_bootstrap.cc:654] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.560562 26663 raft_consensus.cc:359] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.561277 26663 raft_consensus.cc:385] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.561539 26663 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.562299 26663 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.563547 26664 tablet_bootstrap.cc:654] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.564555 26663 ts_tablet_manager.cc:1434] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 12:09:18.565485 26663 tablet_bootstrap.cc:492] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:18.569319 26728 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.574054 26663 tablet_bootstrap.cc:654] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.573964 26670 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.573755 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:18.575670 26471 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.582167 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:18.582880 26621 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.583607 26370 catalog_manager.cc:5697] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.580556 26728 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:18.599838 26621 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:18.602442 26514 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:18.603518 26670 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.604068 26670 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:18.604113 26728 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.606259 26670 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.616269 26471 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:18.611415 26728 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.623420 26728 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:18.626032 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:18.627554 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:18.630640 26547 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.630223 26370 catalog_manager.cc:5697] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.631162 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:18.634311 26662 tablet_bootstrap.cc:492] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:18.634541 26664 tablet_bootstrap.cc:492] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:18.634866 26662 ts_tablet_manager.cc:1403] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.107s	user 0.018s	sys 0.008s
I20260709 12:09:18.635221 26664 ts_tablet_manager.cc:1403] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.023s
I20260709 12:09:18.638381 26662 raft_consensus.cc:359] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.638679 26664 raft_consensus.cc:359] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.639174 26662 raft_consensus.cc:385] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.639643 26662 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.640427 26662 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.641597 26664 raft_consensus.cc:385] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.641971 26664 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.642716 26664 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.643893 26663 tablet_bootstrap.cc:492] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:18.645387 26663 ts_tablet_manager.cc:1403] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.080s	user 0.020s	sys 0.014s
I20260709 12:09:18.646755 26664 ts_tablet_manager.cc:1434] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:09:18.647987 26370 catalog_manager.cc:5697] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.648948 26663 raft_consensus.cc:359] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.649641 26663 raft_consensus.cc:385] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.649923 26663 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.644716 26662 ts_tablet_manager.cc:1434] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:09:18.651283 26662 tablet_bootstrap.cc:492] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
W20260709 12:09:18.651549 26419 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:18.652973 26664 tablet_bootstrap.cc:492] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:18.655754 26728 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.657637 26662 tablet_bootstrap.cc:654] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.659622 26664 tablet_bootstrap.cc:654] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.662058 26663 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.674422 26663 ts_tablet_manager.cc:1434] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 12:09:18.675942 26663 tablet_bootstrap.cc:492] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:18.693185 26663 tablet_bootstrap.cc:654] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.697495 26664 tablet_bootstrap.cc:492] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:18.697541 26662 tablet_bootstrap.cc:492] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:18.698004 26664 ts_tablet_manager.cc:1403] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.003s
I20260709 12:09:18.698081 26662 ts_tablet_manager.cc:1403] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.024s
I20260709 12:09:18.699270 26663 tablet_bootstrap.cc:492] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:18.699723 26663 ts_tablet_manager.cc:1403] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.003s
I20260709 12:09:18.700549 26662 raft_consensus.cc:359] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.701257 26662 raft_consensus.cc:385] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.701001 26664 raft_consensus.cc:359] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.701516 26662 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.701691 26664 raft_consensus.cc:385] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.702011 26664 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.702265 26663 raft_consensus.cc:359] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.702276 26662 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.703037 26663 raft_consensus.cc:385] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.702698 26664 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.703330 26663 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.704020 26663 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.706043 26663 ts_tablet_manager.cc:1434] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:18.704655 26662 ts_tablet_manager.cc:1434] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:18.707258 26664 ts_tablet_manager.cc:1434] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:09:18.707525 26662 tablet_bootstrap.cc:492] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:18.707924 26664 tablet_bootstrap.cc:492] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:18.711248 26663 tablet_bootstrap.cc:492] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:18.711850 26728 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.712358 26728 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.713662 26664 tablet_bootstrap.cc:654] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.716002 26662 tablet_bootstrap.cc:654] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.717386 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:18.721459 26663 tablet_bootstrap.cc:654] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.728969 26716 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.734319 26663 tablet_bootstrap.cc:492] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:18.734977 26663 ts_tablet_manager.cc:1403] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.024s	user 0.004s	sys 0.013s
I20260709 12:09:18.734695 26729 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.739319 26663 raft_consensus.cc:359] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.740092 26663 raft_consensus.cc:385] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.740397 26663 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.741294 26663 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.741812 26664 tablet_bootstrap.cc:492] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:18.742426 26664 ts_tablet_manager.cc:1403] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.035s	user 0.002s	sys 0.015s
I20260709 12:09:18.743953 26663 ts_tablet_manager.cc:1434] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 12:09:18.744908 26663 tablet_bootstrap.cc:492] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:18.745472 26664 raft_consensus.cc:359] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.746194 26664 raft_consensus.cc:385] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.746544 26664 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.747330 26728 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:18.747262 26664 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:18.748113 26513 leader_election.cc:343] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.748528 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:18.749209 26622 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:18.749976 26664 ts_tablet_manager.cc:1434] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:18.750584 26514 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:09:18.751442 26728 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.751852 26728 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.752288 26728 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.756358 26663 tablet_bootstrap.cc:654] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.760604 26728 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.762317 26664 tablet_bootstrap.cc:492] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:18.768349 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:18.769018 26471 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.768312 26663 tablet_bootstrap.cc:492] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:18.774902 26663 ts_tablet_manager.cc:1403] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.000s
I20260709 12:09:18.776491 26728 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:18.776710 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:18.777307 26622 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.777721 26664 tablet_bootstrap.cc:654] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.793521 26622 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:18.801373 26668 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.801962 26668 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.802309 26514 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:18.804272 26471 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:18.804500 26728 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.805002 26728 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:18.800719 26663 raft_consensus.cc:359] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.805461 26663 raft_consensus.cc:385] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.805739 26663 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.805899 26728 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.806468 26663 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.808876 26663 ts_tablet_manager.cc:1434] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:09:18.811417 26663 tablet_bootstrap.cc:492] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:18.815217 26668 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:18.816672 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:18.817422 26622 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 0.
I20260709 12:09:18.817744 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:18.818707 26547 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 0.
I20260709 12:09:18.819289 26439 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:18.822901 26664 tablet_bootstrap.cc:492] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:18.823153 26663 tablet_bootstrap.cc:654] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.823393 26664 ts_tablet_manager.cc:1403] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.061s	user 0.021s	sys 0.005s
I20260709 12:09:18.824116 26668 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.824561 26668 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.824978 26668 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.827419 26664 raft_consensus.cc:359] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.828114 26664 raft_consensus.cc:385] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.828512 26664 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.829309 26664 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.831470 26664 ts_tablet_manager.cc:1434] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:09:18.832397 26664 tablet_bootstrap.cc:492] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:18.838337 26664 tablet_bootstrap.cc:654] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.839509 26662 tablet_bootstrap.cc:492] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:18.839190 26668 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.840020 26662 ts_tablet_manager.cc:1403] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.133s	user 0.032s	sys 0.049s
I20260709 12:09:18.842799 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:18.842943 26662 raft_consensus.cc:359] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.843348 26668 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:18.843433 26547 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.843694 26662 raft_consensus.cc:385] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.844718 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:18.845075 26662 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.845625 26622 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.843703 26703 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.846639 26703 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.846800 26662 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.849037 26703 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:18.851130 26662 ts_tablet_manager.cc:1434] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:09:18.853255 26662 tablet_bootstrap.cc:492] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:18.854755 26716 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.855481 26716 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.851253 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:18.857349 26548 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 0.
I20260709 12:09:18.858731 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:18.859691 26664 tablet_bootstrap.cc:492] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:18.859817 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:18.860343 26664 ts_tablet_manager.cc:1403] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.003s
W20260709 12:09:18.861536 26587 leader_election.cc:343] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.862601 26668 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.862999 26668 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.863363 26668 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.863241 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:18.864318 26664 raft_consensus.cc:359] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.865816 26716 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:18.867396 26705 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.869361 26664 raft_consensus.cc:385] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.869877 26664 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.869974 26705 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.870700 26728 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.870700 26664 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.871392 26728 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.873322 26705 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:18.873540 26728 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:18.873646 26664 ts_tablet_manager.cc:1434] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:09:18.874917 26664 tablet_bootstrap.cc:492] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:18.880945 26664 tablet_bootstrap.cc:654] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.881999 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:18.882988 26546 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 1: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:09:18.885250 26439 leader_election.cc:343] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.890762 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:18.891520 26621 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:18.892690 26664 tablet_bootstrap.cc:492] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:18.893060 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:18.880699 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:18.893260 26664 ts_tablet_manager.cc:1403] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:09:18.894381 26514 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:18.869014 26662 tablet_bootstrap.cc:654] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.897032 26664 raft_consensus.cc:359] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.897266 26548 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 0.
I20260709 12:09:18.897341 26472 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.900804 26728 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.901213 26728 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.901571 26728 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.901425 26622 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:18.903582 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:09:18.904412 26439 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:18.905112 26729 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.905282 26705 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.905529 26729 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.905874 26705 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:18.906880 26705 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.907490 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:18.909356 26663 tablet_bootstrap.cc:492] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:18.909839 26663 ts_tablet_manager.cc:1403] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.099s	user 0.045s	sys 0.033s
I20260709 12:09:18.905963 26729 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.910633 26730 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.911684 26664 raft_consensus.cc:385] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.912075 26664 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.913623 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:18.912964 26664 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.921077 26729 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.921769 26371 catalog_manager.cc:5697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.923797 26664 ts_tablet_manager.cc:1434] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 12:09:18.925206 26664 tablet_bootstrap.cc:492] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:18.927191 26547 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:18.928512 26703 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.929706 26716 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.921789 26668 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.932124 26729 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:18.932538 26668 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:18.932713 26729 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.933398 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:18.934125 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:18.934633 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:18.952142 26546 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.934932 26662 tablet_bootstrap.cc:492] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
W20260709 12:09:18.937165 26513 leader_election.cc:343] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.939713 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:18.954483 26729 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:18.956185 26439 leader_election.cc:343] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.945879 26663 raft_consensus.cc:359] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.948570 26664 tablet_bootstrap.cc:654] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.957105 26663 raft_consensus.cc:385] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.957468 26663 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.958060 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:18.958256 26663 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.958811 26471 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 0.
I20260709 12:09:18.959766 26668 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.960237 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:18.960516 26663 ts_tablet_manager.cc:1434] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.050s	user 0.004s	sys 0.004s
I20260709 12:09:18.961408 26662 ts_tablet_manager.cc:1403] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.108s	user 0.008s	sys 0.005s
I20260709 12:09:18.961166 26728 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.961995 26663 tablet_bootstrap.cc:492] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:18.962136 26716 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.962419 26548 raft_consensus.cc:2393] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 1: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:18.962569 26716 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.962983 26716 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.967078 26729 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:18.968124 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:18.968655 26546 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:18.968807 26548 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 0.
I20260709 12:09:18.970155 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:18.971087 26703 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.960240 26668 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.971761 26703 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:18.971558 26662 raft_consensus.cc:359] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.972337 26470 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.972728 26703 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.976507 26668 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:18.977414 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:18.978364 26548 raft_consensus.cc:2393] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 1: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:18.979784 26663 tablet_bootstrap.cc:654] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.980334 26716 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.977600 26705 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.986740 26705 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.981011 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:18.988637 26622 raft_consensus.cc:2393] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 1: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:09:18.981254 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:18.989809 26621 raft_consensus.cc:2393] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 1: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:09:18.989974 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:18.991448 26716 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:18.994125 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:18.982756 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:18.972334 26662 raft_consensus.cc:385] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.995792 26662 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.996580 26662 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:18.999248 26662 ts_tablet_manager.cc:1434] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:09:18.999727 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:19.000492 26662 tablet_bootstrap.cc:492] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:19.000381 26730 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.002625 26621 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 0.
I20260709 12:09:19.005180 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:19.005927 26548 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.007792 26662 tablet_bootstrap.cc:654] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.992861 26705 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:19.000502 26473 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.992537 26470 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:19.011835 26514 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:19.012929 26621 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.022416 26690 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.025341 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:19.026273 26729 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.009753 26439 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:19.026904 26729 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:19.027419 26705 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.027830 26705 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.028252 26705 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.027995 26729 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.026933 26762 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.033016 26664 tablet_bootstrap.cc:492] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:19.033581 26664 ts_tablet_manager.cc:1403] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.109s	user 0.016s	sys 0.021s
I20260709 12:09:19.034556 26716 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.035063 26690 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.035604 26690 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.037914 26690 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:19.040133 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:18.981791 26728 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:19.037735 26664 raft_consensus.cc:359] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.044189 26664 raft_consensus.cc:385] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.044288 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:19.047544 26664 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
W20260709 12:09:19.048682 26514 leader_election.cc:343] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.049204 26687 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.050324 26664 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.055176 26546 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 0.
I20260709 12:09:19.056280 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:19.057091 26470 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:19.045558 26548 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:19.058821 26663 tablet_bootstrap.cc:492] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:19.051163 26687 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.059422 26663 ts_tablet_manager.cc:1403] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.098s	user 0.017s	sys 0.007s
I20260709 12:09:19.047161 26705 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.061112 26371 catalog_manager.cc:5697] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 0 to 1, leader changed from <none> to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.061926 26705 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:19.063954 26664 ts_tablet_manager.cc:1434] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:09:19.065845 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:19.066814 26687 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.067233 26687 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.052904 26690 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.067603 26687 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.072283 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:19.073166 26730 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.073683 26730 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:19.074954 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:19.075634 26621 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.075798 26687 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.078172 26687 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:19.064438 26663 raft_consensus.cc:359] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.078899 26663 raft_consensus.cc:385] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.075125 26730 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.079255 26663 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.079170 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:19.080588 26545 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.044734 26473 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:19.065841 26664 tablet_bootstrap.cc:492] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:19.081315 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:19.082998 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:19.085111 26470 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.080114 26663 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.093914 26662 tablet_bootstrap.cc:492] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:19.094825 26662 ts_tablet_manager.cc:1403] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.095s	user 0.016s	sys 0.001s
I20260709 12:09:19.097674 26662 raft_consensus.cc:359] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.098352 26662 raft_consensus.cc:385] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.098716 26662 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.104838 26663 ts_tablet_manager.cc:1434] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.002s
I20260709 12:09:19.106273 26663 tablet_bootstrap.cc:492] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:19.107969 26662 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.115520 26687 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.114621 26662 ts_tablet_manager.cc:1434] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.005s
W20260709 12:09:19.107574 26514 leader_election.cc:343] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.121623 26662 tablet_bootstrap.cc:492] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:19.120950 26687 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.122660 26687 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.127143 26687 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:19.131794 26687 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.132328 26687 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.129169 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:19.133878 26545 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
W20260709 12:09:19.140908 26513 leader_election.cc:343] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.147548 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:19.150508 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:19.156880 26621 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
W20260709 12:09:19.157214 26513 leader_election.cc:343] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.149818 26687 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:19.159015 26439 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:19.158368 26664 tablet_bootstrap.cc:654] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.162424 26705 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.163267 26705 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:19.161491 26470 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:19.164253 26705 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.168974 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:09:19.170265 26514 leader_election.cc:343] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.170596 26690 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.170943 26514 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:19.171193 26690 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:19.172246 26690 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.173447 26371 catalog_manager.cc:5697] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.174845 26670 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.175595 26371 catalog_manager.cc:5697] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.180773 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:19.197504 26514 leader_election.cc:343] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.197814 26663 tablet_bootstrap.cc:654] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.198094 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:19.201681 26690 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.206991 26662 tablet_bootstrap.cc:654] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.207667 26370 catalog_manager.cc:5697] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 0 to 1, leader changed from <none> to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.214365 26664 tablet_bootstrap.cc:492] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:19.215034 26664 ts_tablet_manager.cc:1403] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.149s	user 0.011s	sys 0.004s
I20260709 12:09:19.217909 26664 raft_consensus.cc:359] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.222462 26664 raft_consensus.cc:385] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.222823 26664 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.223688 26664 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.228227 26664 ts_tablet_manager.cc:1434] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:09:19.229338 26664 tablet_bootstrap.cc:492] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:19.229590 26690 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.235597 26664 tablet_bootstrap.cc:654] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.234477 26369 catalog_manager.cc:5697] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.252686 26368 catalog_manager.cc:5697] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 0 to 1, leader changed from <none> to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.259018 26690 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.266444 26664 tablet_bootstrap.cc:492] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:19.267037 26664 ts_tablet_manager.cc:1403] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.007s
I20260709 12:09:19.269826 26664 raft_consensus.cc:359] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.270574 26664 raft_consensus.cc:385] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.270869 26664 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.271890 26664 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.274523 26664 ts_tablet_manager.cc:1434] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:19.275496 26664 tablet_bootstrap.cc:492] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:19.284385 26664 tablet_bootstrap.cc:654] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.291448 26705 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.309911 26662 tablet_bootstrap.cc:492] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:19.314347 26662 ts_tablet_manager.cc:1403] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.195s	user 0.042s	sys 0.045s
I20260709 12:09:19.312290 26664 tablet_bootstrap.cc:492] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:19.318851 26664 ts_tablet_manager.cc:1403] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.017s
I20260709 12:09:19.312395 26663 tablet_bootstrap.cc:492] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:19.319941 26663 ts_tablet_manager.cc:1403] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.214s	user 0.016s	sys 0.031s
I20260709 12:09:19.319619 26668 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.322891 26663 raft_consensus.cc:359] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.323621 26663 raft_consensus.cc:385] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.323925 26663 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.324608 26663 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.324707 26662 raft_consensus.cc:359] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.325596 26662 raft_consensus.cc:385] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.325973 26662 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.327234 26663 ts_tablet_manager.cc:1434] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:19.326916 26662 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.329627 26662 ts_tablet_manager.cc:1434] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 12:09:19.331125 26662 tablet_bootstrap.cc:492] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:19.332878 26664 raft_consensus.cc:359] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.333781 26664 raft_consensus.cc:385] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.334519 26664 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.335337 26664 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.338548 26664 ts_tablet_manager.cc:1434] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 12:09:19.339826 26664 tablet_bootstrap.cc:492] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:19.328637 26663 tablet_bootstrap.cc:492] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:19.348966 26664 tablet_bootstrap.cc:654] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.350610 26662 tablet_bootstrap.cc:654] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.358285 26663 tablet_bootstrap.cc:654] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.367146 26664 tablet_bootstrap.cc:492] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:19.367719 26664 ts_tablet_manager.cc:1403] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.004s
I20260709 12:09:19.368924 26662 tablet_bootstrap.cc:492] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:19.369498 26662 ts_tablet_manager.cc:1403] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.003s
I20260709 12:09:19.370585 26664 raft_consensus.cc:359] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.371318 26664 raft_consensus.cc:385] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.371595 26664 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.372596 26662 raft_consensus.cc:359] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.372586 26664 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.373445 26662 raft_consensus.cc:385] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.373880 26662 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.374780 26662 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.375443 26664 ts_tablet_manager.cc:1434] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:19.375905 26663 tablet_bootstrap.cc:492] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:19.376375 26663 ts_tablet_manager.cc:1403] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.005s
I20260709 12:09:19.376446 26664 tablet_bootstrap.cc:492] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:19.379702 26663 raft_consensus.cc:359] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.380427 26663 raft_consensus.cc:385] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.380733 26663 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.381054 26662 ts_tablet_manager.cc:1434] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:09:19.382107 26662 tablet_bootstrap.cc:492] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:19.381635 26663 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.384389 26663 ts_tablet_manager.cc:1434] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:09:19.385322 26663 tablet_bootstrap.cc:492] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:19.386468 26664 tablet_bootstrap.cc:654] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.391510 26663 tablet_bootstrap.cc:654] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.391390 26621 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.405228 26662 tablet_bootstrap.cc:654] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.406039 26762 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.406790 26762 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.424688 26668 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.430380 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:19.431907 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:19.432898 26545 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 0.
I20260709 12:09:19.434463 26662 tablet_bootstrap.cc:492] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:19.434968 26662 ts_tablet_manager.cc:1403] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.014s
I20260709 12:09:19.434870 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:19.436760 26668 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.437273 26668 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.437718 26668 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.438285 26662 raft_consensus.cc:359] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.439070 26662 raft_consensus.cc:385] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.439347 26662 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.440308 26662 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.442734 26662 ts_tablet_manager.cc:1434] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:19.443280 26730 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.443794 26730 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.446045 26730 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:09:19.443919 26439 leader_election.cc:343] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.448215 26662 tablet_bootstrap.cc:492] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:19.448091 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:19.449043 26762 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:19.450572 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:19.453014 26663 tablet_bootstrap.cc:492] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:19.453738 26668 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.454918 26662 tablet_bootstrap.cc:654] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.454959 26545 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:19.459468 26664 tablet_bootstrap.cc:492] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:19.459992 26664 ts_tablet_manager.cc:1403] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.084s	user 0.032s	sys 0.035s
I20260709 12:09:19.459929 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:09:19.461261 26730 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:19.461643 26730 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:19.462015 26730 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:19.463068 26664 raft_consensus.cc:359] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.463766 26664 raft_consensus.cc:385] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.464043 26664 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.464779 26664 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.467013 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:19.467600 26545 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.456037 26663 ts_tablet_manager.cc:1403] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.002s
I20260709 12:09:19.471036 26664 ts_tablet_manager.cc:1434] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:09:19.472087 26664 tablet_bootstrap.cc:492] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:19.481806 26705 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.484337 26663 raft_consensus.cc:359] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.484169 26729 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.484925 26663 raft_consensus.cc:385] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.485224 26663 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.485843 26663 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.490875 26730 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.492118 26621 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:19.498469 26668 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:19.500208 26730 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:19.500795 26730 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.501327 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:19.505122 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:19.507800 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:19.508482 26664 tablet_bootstrap.cc:654] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.508567 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:09:19.509161 26439 leader_election.cc:343] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.510146 26762 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.510125 26705 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.511049 26703 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:19.510762 26762 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.511449 26703 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:19.512426 26703 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.513068 26762 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:19.513568 26703 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:19.514467 26729 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:19.514842 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:19.515444 26546 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 0.
I20260709 12:09:19.516855 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:19.517114 26545 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:19.517918 26705 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.518366 26705 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.518822 26705 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.521344 26663 ts_tablet_manager.cc:1434] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.000s
I20260709 12:09:19.522359 26663 tablet_bootstrap.cc:492] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:19.527173 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:19.528738 26663 tablet_bootstrap.cc:654] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.528924 26684 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.529937 26662 tablet_bootstrap.cc:492] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:19.530799 26662 ts_tablet_manager.cc:1403] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.035s
I20260709 12:09:19.531086 26762 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.531785 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:19.534850 26762 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:19.534857 26621 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 0.
I20260709 12:09:19.534106 26705 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.536366 26762 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.539742 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:19.539613 26684 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.540359 26545 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.546541 26730 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.547092 26730 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.554904 26662 raft_consensus.cc:359] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.558578 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:19.559289 26621 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.559412 26662 raft_consensus.cc:385] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.560792 26662 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.562443 26662 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.566354 26621 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:19.573318 26439 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:19.566502 26705 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:19.574659 26705 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.575348 26705 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:19.576172 26705 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.577387 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:19.567512 26730 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:19.578081 26544 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 0.
I20260709 12:09:19.568769 26545 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:19.579599 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:19.581707 26662 ts_tablet_manager.cc:1434] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 12:09:19.595659 26662 tablet_bootstrap.cc:492] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
W20260709 12:09:19.601543 26587 leader_election.cc:343] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.602438 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:09:19.603243 26730 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.603680 26730 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.604079 26730 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:19.604542 26796 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:09:19.610554 26703 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.632732 26703 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.635917 26690 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.636497 26690 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.638686 26690 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:19.647547 26662 tablet_bootstrap.cc:654] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.651484 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:19.652581 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:19.655763 26473 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:19.657336 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:19.658227 26690 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.658627 26690 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.659000 26690 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.654975 26663 tablet_bootstrap.cc:492] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:19.663194 26663 ts_tablet_manager.cc:1403] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.141s	user 0.028s	sys 0.049s
W20260709 12:09:19.668408 26514 leader_election.cc:343] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.671754 26663 raft_consensus.cc:359] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.672737 26670 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.673847 26663 raft_consensus.cc:385] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.674196 26663 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.674866 26663 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.675535 26670 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.676927 26663 ts_tablet_manager.cc:1434] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:09:19.678148 26670 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:19.681227 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:09:19.683063 26513 leader_election.cc:343] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.681674 26690 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.690013 26716 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.690611 26716 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.691391 26690 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:19.686622 26663 tablet_bootstrap.cc:492] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:19.692847 26716 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:09:19.687067 26419 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:19.689148 26664 tablet_bootstrap.cc:492] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:19.696465 26664 ts_tablet_manager.cc:1403] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.225s	user 0.014s	sys 0.022s
I20260709 12:09:19.697041 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:19.697652 26473 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.703022 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:19.704722 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:19.705560 26470 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 1: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:19.715236 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:19.717409 26473 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:19.721424 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:19.722231 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:19.699676 26371 catalog_manager.cc:5697] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 0 to 1, leader changed from <none> to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.726068 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:09:19.728505 26514 leader_election.cc:343] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.729266 26670 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.729811 26670 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:19.730840 26670 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.734651 26729 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:19.731220 26514 leader_election.cc:343] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.741138 26514 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:19.746013 26728 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:19.748149 26806 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:09:19.749697 26664 raft_consensus.cc:359] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:19.754371 26804 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:09:19.745898 26729 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.750245 26371 catalog_manager.cc:5697] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 0 to 1, leader changed from <none> to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.754782 26664 raft_consensus.cc:385] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.755861 26662 tablet_bootstrap.cc:492] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:19.757252 26662 ts_tablet_manager.cc:1403] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.162s	user 0.039s	sys 0.038s
I20260709 12:09:19.756902 26664 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.759310 26670 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.760003 26664 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.764286 26662 raft_consensus.cc:359] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.765041 26662 raft_consensus.cc:385] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.765321 26662 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.765345 26664 ts_tablet_manager.cc:1434] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.004s
I20260709 12:09:19.766497 26664 tablet_bootstrap.cc:492] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:19.766203 26662 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.768289 26662 ts_tablet_manager.cc:1434] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 12:09:19.769285 26662 tablet_bootstrap.cc:492] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:19.777371 26687 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.783458 26703 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.788158 26663 tablet_bootstrap.cc:654] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.787735 26703 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.791582 26703 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:19.792937 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:19.794795 26439 leader_election.cc:343] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.798002 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:19.798897 26548 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 0.
I20260709 12:09:19.800777 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:19.800971 26730 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.803993 26662 tablet_bootstrap.cc:654] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.807457 26664 tablet_bootstrap.cc:654] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.803658 26703 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.809374 26703 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.814980 26729 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.815507 26729 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.810783 26690 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.814947 26703 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.823738 26729 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:19.823849 26690 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.826288 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:19.826563 26690 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:19.827039 26548 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 0.
I20260709 12:09:19.831481 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:19.831990 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:19.832157 26620 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:19.833087 26729 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.833637 26729 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.834204 26729 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.834757 26514 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:19.835664 26670 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.836064 26670 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.836447 26670 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.836207 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:19.839574 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:09:19.842412 26513 leader_election.cc:343] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.838166 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:09:19.846001 26587 leader_election.cc:343] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:19.847290 26587 leader_election.cc:343] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.847436 26664 tablet_bootstrap.cc:492] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:19.847985 26664 ts_tablet_manager.cc:1403] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.082s	user 0.008s	sys 0.006s
I20260709 12:09:19.848095 26703 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.851455 26703 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:19.852638 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:19.852867 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:19.853813 26548 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:19.854067 26439 leader_election.cc:343] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.855541 26664 raft_consensus.cc:359] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.856102 26664 raft_consensus.cc:385] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.856345 26664 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.859804 26670 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.863137 26663 tablet_bootstrap.cc:492] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:19.858012 26664 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.863737 26663 ts_tablet_manager.cc:1403] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.177s	user 0.017s	sys 0.004s
I20260709 12:09:19.863245 26670 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:19.871733 26548 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:19.875963 26664 ts_tablet_manager.cc:1434] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:09:19.877354 26664 tablet_bootstrap.cc:492] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:19.879208 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:19.881042 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:19.881775 26663 raft_consensus.cc:359] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.882781 26663 raft_consensus.cc:385] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.883104 26663 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.885054 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:19.884184 26663 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.898641 26811 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.887008 26729 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.899183 26811 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:19.900107 26811 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.900655 26729 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:19.891176 26662 tablet_bootstrap.cc:492] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:19.901404 26662 ts_tablet_manager.cc:1403] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.132s	user 0.034s	sys 0.028s
I20260709 12:09:19.902978 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:19.903781 26545 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 1: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:19.904258 26662 raft_consensus.cc:359] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.904752 26620 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 1: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:09:19.904942 26662 raft_consensus.cc:385] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.905375 26662 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.905021 26663 ts_tablet_manager.cc:1434] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:09:19.906273 26662 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.907620 26663 tablet_bootstrap.cc:492] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:19.908453 26662 ts_tablet_manager.cc:1434] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:19.909251 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:19.909806 26662 tablet_bootstrap.cc:492] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:19.909904 26469 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.893595 26664 tablet_bootstrap.cc:654] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.895871 26370 catalog_manager.cc:5697] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.919653 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:19.920439 26548 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.925767 26762 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.926363 26762 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.914011 26730 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:19.931435 26762 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:19.934223 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:19.933246 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:09:19.935891 26439 leader_election.cc:343] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.935964 26545 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 0.
W20260709 12:09:19.936908 26513 leader_election.cc:343] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.937237 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:19.937378 26513 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:19.938091 26670 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.940528 26811 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.942983 26811 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.943532 26811 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.945055 26548 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:19.946823 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:09:19.948102 26730 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.948830 26663 tablet_bootstrap.cc:654] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.948777 26730 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:19.951798 26469 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:19.961853 26730 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.967635 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:19.968427 26762 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.968860 26716 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.971747 26716 raft_consensus.cc:697] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:19.972859 26716 consensus_queue.cc:237] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.949297 26729 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.979787 26729 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:19.986809 26662 tablet_bootstrap.cc:654] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.986845 26370 catalog_manager.cc:5697] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 0 to 1, leader changed from <none> to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.003599 26762 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.017256 26811 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.006094 26729 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:20.019214 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:20.042181 26664 tablet_bootstrap.cc:492] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:20.042924 26664 ts_tablet_manager.cc:1403] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.166s	user 0.017s	sys 0.013s
I20260709 12:09:20.044117 26663 tablet_bootstrap.cc:492] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:20.043919 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:20.044734 26811 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:20.045742 26439 leader_election.cc:343] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.046763 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:20.047713 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:20.048343 26545 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.048395 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:20.049988 26663 ts_tablet_manager.cc:1403] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.143s	user 0.007s	sys 0.015s
I20260709 12:09:20.051333 26730 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.052932 26663 raft_consensus.cc:359] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.053649 26663 raft_consensus.cc:385] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.053931 26663 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.054589 26762 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.054679 26663 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.055639 26664 raft_consensus.cc:359] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.056401 26664 raft_consensus.cc:385] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.056061 26370 catalog_manager.cc:5697] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.056732 26664 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.057957 26663 ts_tablet_manager.cc:1434] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:09:20.061738 26663 tablet_bootstrap.cc:492] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:20.062626 26545 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:20.057788 26664 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.065842 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:20.067157 26668 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.067622 26668 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:20.068460 26668 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.065435 26620 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.085275 26705 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.089794 26663 tablet_bootstrap.cc:654] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.094142 26664 ts_tablet_manager.cc:1434] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.051s	user 0.003s	sys 0.002s
I20260709 12:09:20.097925 26662 tablet_bootstrap.cc:492] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:20.099802 26662 ts_tablet_manager.cc:1403] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.190s	user 0.013s	sys 0.002s
I20260709 12:09:20.102895 26664 tablet_bootstrap.cc:492] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:20.102600 26662 raft_consensus.cc:359] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.103273 26662 raft_consensus.cc:385] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.102825 26369 catalog_manager.cc:5697] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 0 to 1, leader changed from <none> to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.103547 26662 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.104246 26662 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.106379 26662 ts_tablet_manager.cc:1434] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:09:20.107388 26662 tablet_bootstrap.cc:492] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:20.109573 26664 tablet_bootstrap.cc:654] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.113593 26662 tablet_bootstrap.cc:654] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.116041 26664 tablet_bootstrap.cc:492] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:20.116586 26664 ts_tablet_manager.cc:1403] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:09:20.119987 26664 raft_consensus.cc:359] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.121263 26664 raft_consensus.cc:385] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.121606 26664 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.122634 26664 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.124533 26664 ts_tablet_manager.cc:1434] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:09:20.124665 26663 tablet_bootstrap.cc:492] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:20.125169 26663 ts_tablet_manager.cc:1403] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.064s	user 0.006s	sys 0.010s
I20260709 12:09:20.125376 26662 tablet_bootstrap.cc:492] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:20.125469 26664 tablet_bootstrap.cc:492] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:20.125880 26662 ts_tablet_manager.cc:1403] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.019s	user 0.000s	sys 0.015s
I20260709 12:09:20.128589 26662 raft_consensus.cc:359] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.129451 26662 raft_consensus.cc:385] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.129709 26662 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.130631 26662 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.133164 26662 ts_tablet_manager.cc:1434] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:09:20.134065 26662 tablet_bootstrap.cc:492] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:20.134502 26664 tablet_bootstrap.cc:654] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.137101 26663 raft_consensus.cc:359] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.137823 26663 raft_consensus.cc:385] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.138082 26663 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.140291 26370 catalog_manager.cc:5697] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.140831 26662 tablet_bootstrap.cc:654] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.143671 26663 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.150429 26663 ts_tablet_manager.cc:1434] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 12:09:20.151572 26663 tablet_bootstrap.cc:492] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:20.155395 26664 tablet_bootstrap.cc:492] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:20.156102 26664 ts_tablet_manager.cc:1403] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.006s
I20260709 12:09:20.159204 26663 tablet_bootstrap.cc:654] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.164963 26664 raft_consensus.cc:359] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.166019 26664 raft_consensus.cc:385] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.166384 26664 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.168058 26664 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.175875 26664 ts_tablet_manager.cc:1434] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:09:20.176910 26664 tablet_bootstrap.cc:492] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:20.177194 26662 tablet_bootstrap.cc:492] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:20.177665 26662 ts_tablet_manager.cc:1403] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.044s	user 0.006s	sys 0.030s
I20260709 12:09:20.180852 26662 raft_consensus.cc:359] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.181622 26662 raft_consensus.cc:385] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.181905 26662 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.182667 26662 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.185215 26662 ts_tablet_manager.cc:1434] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:20.186338 26662 tablet_bootstrap.cc:492] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:20.192449 26662 tablet_bootstrap.cc:654] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.192901 26663 tablet_bootstrap.cc:492] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:20.193445 26663 ts_tablet_manager.cc:1403] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.015s
I20260709 12:09:20.196957 26663 raft_consensus.cc:359] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.197674 26663 raft_consensus.cc:385] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.198066 26664 tablet_bootstrap.cc:654] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.198002 26663 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.202095 26663 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.204965 26728 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.205508 26728 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.206039 26663 ts_tablet_manager.cc:1434] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:09:20.206260 26730 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.206794 26730 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.207383 26663 tablet_bootstrap.cc:492] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:20.207808 26728 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:20.209599 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:20.210688 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:09:20.211484 26513 leader_election.cc:343] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.211493 26470 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 1: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:20.214358 26670 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.214900 26670 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.216962 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:20.219671 26663 tablet_bootstrap.cc:654] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.219739 26670 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:20.220096 26664 tablet_bootstrap.cc:492] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:20.220602 26664 ts_tablet_manager.cc:1403] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.005s
I20260709 12:09:20.221268 26662 tablet_bootstrap.cc:492] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:20.221179 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:20.222275 26662 ts_tablet_manager.cc:1403] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.010s
W20260709 12:09:20.222901 26513 leader_election.cc:343] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.224359 26664 raft_consensus.cc:359] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.224962 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:20.225346 26664 raft_consensus.cc:385] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.225160 26662 raft_consensus.cc:359] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.225844 26664 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.226090 26662 raft_consensus.cc:385] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.226547 26662 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.226620 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:20.226974 26664 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:20.227770 26514 leader_election.cc:343] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.227468 26662 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.228257 26514 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:20.229060 26687 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.230074 26662 ts_tablet_manager.cc:1434] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:09:20.230630 26664 ts_tablet_manager.cc:1434] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:09:20.231192 26662 tablet_bootstrap.cc:492] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:20.232102 26687 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.232808 26687 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.236357 26687 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:20.237581 26587 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:20.237941 26662 tablet_bootstrap.cc:654] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.238515 26729 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.240193 26664 tablet_bootstrap.cc:492] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:20.247427 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:20.248556 26663 tablet_bootstrap.cc:492] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:20.249069 26663 ts_tablet_manager.cc:1403] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.013s
W20260709 12:09:20.249117 26513 leader_election.cc:343] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.250456 26664 tablet_bootstrap.cc:654] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.252086 26663 raft_consensus.cc:359] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.252835 26663 raft_consensus.cc:385] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.253165 26663 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.254115 26663 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.258219 26663 ts_tablet_manager.cc:1434] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 12:09:20.259528 26663 tablet_bootstrap.cc:492] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
W20260709 12:09:20.263716 26514 leader_election.cc:343] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.264430 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:20.266013 26687 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.267663 26663 tablet_bootstrap.cc:654] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.270147 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:20.208879 26730 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:20.280843 26663 tablet_bootstrap.cc:492] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:20.281610 26663 ts_tablet_manager.cc:1403] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 12:09:20.285432 26663 raft_consensus.cc:359] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.286577 26663 raft_consensus.cc:385] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.288976 26663 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.290081 26663 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.293118 26663 ts_tablet_manager.cc:1434] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:09:20.294430 26663 tablet_bootstrap.cc:492] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:20.302788 26663 tablet_bootstrap.cc:654] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.303288 26620 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:20.310063 26514 leader_election.cc:343] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.310782 26514 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:20.314850 26728 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.316862 26663 tablet_bootstrap.cc:492] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:20.317564 26663 ts_tablet_manager.cc:1403] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.011s
I20260709 12:09:20.321638 26663 raft_consensus.cc:359] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.323741 26730 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.324798 26730 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.322757 26663 raft_consensus.cc:385] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.327047 26663 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.328367 26663 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.329820 26762 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.330509 26762 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.333412 26762 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:20.335379 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:20.336318 26621 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 0.
I20260709 12:09:20.337862 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:20.338995 26705 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.339406 26705 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.339747 26705 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.340510 26663 ts_tablet_manager.cc:1434] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.001s
I20260709 12:09:20.341559 26663 tablet_bootstrap.cc:492] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:20.343053 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:20.344245 26548 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 1: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:09:20.338588 26690 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.346731 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:20.348395 26663 tablet_bootstrap.cc:654] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.349401 26705 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.352576 26705 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:20.353988 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:20.354859 26621 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.359211 26762 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.359906 26762 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.362948 26762 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:20.363646 26762 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.364214 26762 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.364490 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:20.366523 26439 leader_election.cc:343] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.368510 26762 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:20.370018 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:20.370222 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:20.371455 26716 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.372483 26729 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.380168 26690 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.380716 26690 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.382941 26690 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:20.384560 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:20.385170 26716 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.385267 26470 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:20.386546 26513 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:20.328404 26730 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:20.387426 26690 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.387812 26690 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.388145 26690 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.392233 26621 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:20.393689 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:20.394603 26668 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.395102 26668 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:20.395370 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:20.395360 26690 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.395993 26668 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.396294 26548 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 0.
I20260709 12:09:20.398451 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:20.399219 26473 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.411269 26473 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:20.413192 26513 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:20.414805 26728 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.415539 26728 raft_consensus.cc:697] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:20.416791 26728 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.419988 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:20.420951 26548 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.434140 26690 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:20.439625 26663 tablet_bootstrap.cc:492] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:20.440347 26663 ts_tablet_manager.cc:1403] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.099s	user 0.014s	sys 0.019s
I20260709 12:09:20.442929 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:20.443971 26663 raft_consensus.cc:359] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.444911 26663 raft_consensus.cc:385] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.445257 26663 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.445066 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:20.446295 26545 raft_consensus.cc:2393] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 1: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:09:20.449997 26663 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.452708 26663 ts_tablet_manager.cc:1434] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:09:20.453294 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:20.453805 26663 tablet_bootstrap.cc:492] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:20.453454 26716 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.453998 26621 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:20.457589 26729 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.460705 26663 tablet_bootstrap.cc:654] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:20.473335 26438 leader_election.cc:343] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.473904 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:20.475170 26663 tablet_bootstrap.cc:492] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:20.474898 26690 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.475374 26438 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:20.475881 26663 ts_tablet_manager.cc:1403] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 12:09:20.476191 26705 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.476923 26705 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.477378 26705 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.479045 26663 raft_consensus.cc:359] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.481616 26663 raft_consensus.cc:385] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.482406 26663 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.482585 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:20.479070 26762 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.483582 26663 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.485785 26548 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:20.487941 26663 ts_tablet_manager.cc:1434] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:20.490134 26663 tablet_bootstrap.cc:492] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
W20260709 12:09:20.491636 26439 leader_election.cc:343] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.492414 26705 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:20.496960 26762 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.505409 26663 tablet_bootstrap.cc:654] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.502959 26705 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.504935 26729 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:09:20.515162 26662 tablet_bootstrap.cc:492] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:20.515659 26662 ts_tablet_manager.cc:1403] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.285s	user 0.077s	sys 0.132s
I20260709 12:09:20.516784 26664 tablet_bootstrap.cc:492] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:20.517444 26664 ts_tablet_manager.cc:1403] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.286s	user 0.053s	sys 0.092s
I20260709 12:09:20.519359 26662 raft_consensus.cc:359] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.520260 26662 raft_consensus.cc:385] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.521689 26662 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.522544 26662 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.525002 26662 ts_tablet_manager.cc:1434] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:20.526095 26662 tablet_bootstrap.cc:492] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:20.530201 26664 raft_consensus.cc:359] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.531317 26664 raft_consensus.cc:385] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.531970 26664 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.536281 26716 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.536813 26716 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.533671 26664 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.539077 26716 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:20.539893 26664 ts_tablet_manager.cc:1434] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.002s
I20260709 12:09:20.540900 26664 tablet_bootstrap.cc:492] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:20.541668 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:20.542411 26548 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 0.
I20260709 12:09:20.542827 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:20.543615 26472 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 0.
I20260709 12:09:20.543864 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:20.543706 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:20.545035 26620 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.548600 26371 catalog_manager.cc:5697] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 0 to 1, leader changed from <none> to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.545560 26730 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.550066 26730 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.551913 26730 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.553802 26664 tablet_bootstrap.cc:654] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.521727 26370 catalog_manager.cc:5697] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.557879 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:20.558588 26548 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 0.
I20260709 12:09:20.559664 26728 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.560359 26728 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.563087 26728 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:20.566520 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:20.567325 26472 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:20.578074 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:20.579067 26728 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.585016 26728 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.602281 26663 tablet_bootstrap.cc:492] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:20.603077 26663 ts_tablet_manager.cc:1403] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.113s	user 0.025s	sys 0.034s
I20260709 12:09:20.585250 26729 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:09:20.606611 26664 tablet_bootstrap.cc:492] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:20.607301 26664 ts_tablet_manager.cc:1403] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.008s
I20260709 12:09:20.593273 26728 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.604887 26705 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:09:20.626286 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:20.638331 26664 raft_consensus.cc:359] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.639101 26664 raft_consensus.cc:385] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.639348 26664 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.622692 26438 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:20.667794 26664 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.748839 26705 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.749398 26705 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.749863 26705 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.751900 26663 raft_consensus.cc:359] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.752980 26663 raft_consensus.cc:385] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.753371 26663 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.754232 26663 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.639961 26703 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.118s
I20260709 12:09:20.765604 26664 ts_tablet_manager.cc:1434] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.158s	user 0.008s	sys 0.002s
I20260709 12:09:20.770812 26762 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.771510 26762 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.775197 26762 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:20.748276 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 106137us
I20260709 12:09:20.792456 26664 tablet_bootstrap.cc:492] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:20.783751 26762 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:20.790793 26514 leader_election.cc:343] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.878221 26662 tablet_bootstrap.cc:654] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.822507 26762 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:20.891053 26851 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.132s	user 0.001s	sys 0.001s
W20260709 12:09:20.879972 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 90499.6us
I20260709 12:09:20.903442 26663 ts_tablet_manager.cc:1434] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.300s	user 0.025s	sys 0.018s
I20260709 12:09:20.904673 26663 tablet_bootstrap.cc:492] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:20.927066 26705 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.931905 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:20.963195 26762 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:20.957587 26730 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.965551 26663 tablet_bootstrap.cc:654] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.965279 26728 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.966374 26730 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:20.993366 26861 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:20.968425 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:21.015359 26861 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:20.957110 26620 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
W20260709 12:09:21.036633 26419 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:21.037815 26545 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:20.973476 26439 leader_election.cc:343] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.044102 26728 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:21.044839 26861 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:21.047185 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:21.052726 26621 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 2: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:09:21.054563 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 81139.9us
I20260709 12:09:21.055918 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:09:21.032073 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 419494us
I20260709 12:09:21.056577 26472 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.041857 26664 tablet_bootstrap.cc:654] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.973110 26705 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:21.063625 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:21.064301 26546 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 0.
I20260709 12:09:21.076406 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:21.091594 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:21.092375 26544 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.105690 26662 tablet_bootstrap.cc:492] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:21.106174 26662 ts_tablet_manager.cc:1403] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.580s	user 0.016s	sys 0.031s
I20260709 12:09:21.109982 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:21.110762 26543 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:21.110678 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:21.111423 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:21.114764 26663 tablet_bootstrap.cc:492] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:21.115275 26663 ts_tablet_manager.cc:1403] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.211s	user 0.035s	sys 0.013s
I20260709 12:09:21.131497 26663 raft_consensus.cc:359] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.132236 26663 raft_consensus.cc:385] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.132534 26663 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.133672 26662 raft_consensus.cc:359] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.134533 26662 raft_consensus.cc:385] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.134842 26662 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.135582 26662 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.138682 26663 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.116434 26617 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:21.119309 26469 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.122895 26545 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:21.144948 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:21.169750 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:21.158290 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:21.167037 26858 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.176908 26863 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.177495 26863 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:21.178375 26863 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.180333 26472 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:21.182654 26473 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:09:21.187937 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:21.188988 26762 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.189445 26762 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.189842 26762 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:21.195456 26439 leader_election.cc:343] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.196347 26439 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:21.199620 26860 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:21.197672 26858 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:21.202873 26858 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.203384 26858 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:21.232508 26544 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:21.234611 26663 ts_tablet_manager.cc:1434] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.119s	user 0.014s	sys 0.031s
I20260709 12:09:21.235440 26662 ts_tablet_manager.cc:1434] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.129s	user 0.003s	sys 0.004s
I20260709 12:09:21.238082 26662 tablet_bootstrap.cc:492] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:21.240490 26663 tablet_bootstrap.cc:492] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:21.242035 26762 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.249291 26728 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.252344 26662 tablet_bootstrap.cc:654] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.255970 26469 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:21.257846 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:21.258248 26858 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.259696 26728 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:21.260104 26728 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:21.260489 26728 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:21.261216 26370 catalog_manager.cc:5697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:21.264734 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:21.274063 26762 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:21.274832 26514 leader_election.cc:343] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.275965 26861 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.288661 26662 tablet_bootstrap.cc:492] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:21.289414 26662 ts_tablet_manager.cc:1403] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.007s
I20260709 12:09:21.331931 26662 raft_consensus.cc:359] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.332974 26662 raft_consensus.cc:385] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.333326 26662 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.335127 26662 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.339663 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:21.340606 26548 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.356312 26687 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.356985 26687 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.358278 26664 tablet_bootstrap.cc:492] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:21.358848 26664 ts_tablet_manager.cc:1403] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.567s	user 0.046s	sys 0.062s
I20260709 12:09:21.360890 26438 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:21.353012 26854 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.362111 26854 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.368160 26662 ts_tablet_manager.cc:1434] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.007s
I20260709 12:09:21.467537 26663 tablet_bootstrap.cc:654] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.467808 26662 tablet_bootstrap.cc:492] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:21.458076 26664 raft_consensus.cc:359] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.470166 26664 raft_consensus.cc:385] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.470574 26664 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.369000 26668 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.434223 26705 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:21.389870 26439 leader_election.cc:343] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.363288 26858 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:21.369207 26854 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:21.472491 26664 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.476843 26856 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.478891 26705 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.491565 26705 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:21.496508 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:21.432197 26548 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:21.366865 26728 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.499891 26664 ts_tablet_manager.cc:1434] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.141s	user 0.014s	sys 0.004s
I20260709 12:09:21.500434 26728 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:21.496433 26687 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:21.488942 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 100357us
I20260709 12:09:21.511148 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:21.511889 26545 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 0.
I20260709 12:09:21.515627 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:21.497367 26469 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 0.
I20260709 12:09:21.517481 26877 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.518056 26877 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:21.519024 26877 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.509889 26668 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:21.526593 26664 tablet_bootstrap.cc:492] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:21.531049 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:21.531745 26617 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:21.538139 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:21.526825 26668 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.540143 26730 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.540645 26730 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.541039 26730 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.543758 26880 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.544348 26880 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.549906 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:21.552186 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:21.556527 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:21.557245 26545 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:21.558789 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:21.570847 26617 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:09:21.580921 26880 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:21.587610 26545 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
W20260709 12:09:21.588152 26439 leader_election.cc:343] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.589775 26663 tablet_bootstrap.cc:492] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:21.590142 26663 ts_tablet_manager.cc:1403] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.350s	user 0.013s	sys 0.004s
I20260709 12:09:21.591719 26439 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:21.594511 26705 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:21.595068 26705 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:21.595862 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:21.596004 26705 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.596563 26546 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 0.
I20260709 12:09:21.596740 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:21.587599 26730 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.591951 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:21.598992 26621 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 1: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:09:21.601231 26663 raft_consensus.cc:359] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.601938 26663 raft_consensus.cc:385] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.602258 26663 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.603514 26730 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:21.604303 26662 tablet_bootstrap.cc:654] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.606701 26664 tablet_bootstrap.cc:654] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:21.605863 26439 leader_election.cc:343] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.605621 26663 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.608258 26881 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.611292 26881 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:21.622949 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:21.612219 26881 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.629686 26663 ts_tablet_manager.cc:1434] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:09:21.630892 26663 tablet_bootstrap.cc:492] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:21.635244 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:09:21.645007 26438 leader_election.cc:343] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.646193 26762 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.646615 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:21.647511 26471 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.645661 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:21.650226 26880 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.652855 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:21.652750 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:21.653712 26543 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.646795 26762 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.656172 26762 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.675264 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:21.684798 26854 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:21.687279 26730 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.693333 26730 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.695698 26730 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:21.697132 26543 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:21.720249 26663 tablet_bootstrap.cc:654] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.728895 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:21.728000 26371 catalog_manager.cc:5697] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 0 to 1, leader changed from <none> to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.683382 26762 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.738260 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:21.739194 26854 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.739836 26854 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:21.740203 26877 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.740880 26854 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.742230 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:21.744292 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:21.734124 26762 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:21.745883 26544 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.748384 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:21.749186 26545 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 1: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:09:21.734237 26471 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:21.758266 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:21.758934 26662 tablet_bootstrap.cc:492] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:21.759625 26662 ts_tablet_manager.cc:1403] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.294s	user 0.011s	sys 0.009s
W20260709 12:09:21.762450 26439 leader_election.cc:343] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.768630 26662 raft_consensus.cc:359] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.769441 26662 raft_consensus.cc:385] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.769697 26662 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.770341 26662 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.775004 26730 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.776291 26730 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.777832 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:21.798954 26662 ts_tablet_manager.cc:1434] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.004s
I20260709 12:09:21.803978 26662 tablet_bootstrap.cc:492] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:21.786242 26544 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:21.775508 26587 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:21.809020 26716 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.811858 26664 tablet_bootstrap.cc:492] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:21.812364 26664 ts_tablet_manager.cc:1403] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.286s	user 0.029s	sys 0.018s
I20260709 12:09:21.805778 26690 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:09:21.816365 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 54634.2us
I20260709 12:09:21.816296 26664 raft_consensus.cc:359] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.820305 26664 raft_consensus.cc:385] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.820678 26664 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.821440 26664 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.824622 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:21.823817 26664 ts_tablet_manager.cc:1434] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:09:21.829094 26663 tablet_bootstrap.cc:492] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:21.819141 26716 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.830598 26762 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.832181 26663 ts_tablet_manager.cc:1403] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.202s	user 0.036s	sys 0.025s
I20260709 12:09:21.832715 26664 tablet_bootstrap.cc:492] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:21.838874 26762 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:21.839818 26762 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.834256 26705 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.841490 26705 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.845512 26663 raft_consensus.cc:359] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.846347 26663 raft_consensus.cc:385] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.846678 26663 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.847451 26663 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.852324 26663 ts_tablet_manager.cc:1434] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:09:21.853184 26663 tablet_bootstrap.cc:492] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:21.851737 26716 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:09:21.854018 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:21.855036 26468 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 0.
I20260709 12:09:21.861305 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:21.861325 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:21.864283 26729 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.864814 26729 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.865286 26729 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:21.867754 26438 leader_election.cc:343] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.868691 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:09:21.871253 26587 leader_election.cc:343] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.873160 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:21.875131 26439 leader_election.cc:343] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.877301 26439 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:21.878506 26860 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.882437 26705 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:21.890759 26690 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.860723 26730 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:21.892118 26690 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.895453 26662 tablet_bootstrap.cc:654] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.898373 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:21.898921 26664 tablet_bootstrap.cc:654] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.899761 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:21.900120 26513 leader_election.cc:343] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.902844 26514 leader_election.cc:343] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.904753 26514 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:21.905511 26728 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.905911 26663 tablet_bootstrap.cc:654] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.898736 26690 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:21.881312 26367 catalog_manager.cc:5697] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.910831 26690 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.911492 26690 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.914970 26690 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:21.916222 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:21.917513 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:21.933367 26729 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.917372 26367 catalog_manager.cc:5697] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 0 to 1, leader changed from <none> to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:21.931393 26514 leader_election.cc:343] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.938076 26513 leader_election.cc:343] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.945068 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:21.945993 26728 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.956346 26663 tablet_bootstrap.cc:492] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:21.956889 26663 ts_tablet_manager.cc:1403] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.104s	user 0.014s	sys 0.000s
I20260709 12:09:21.968079 26729 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:21.975409 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:09:21.977386 26587 leader_election.cc:343] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.986320 26881 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.989879 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:21.990671 26468 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.992532 26860 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.996749 26663 raft_consensus.cc:359] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:21.997551 26663 raft_consensus.cc:385] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.997879 26663 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.005013 26728 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.008504 26370 catalog_manager.cc:5697] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.013634 26663 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.020869 26663 ts_tablet_manager.cc:1434] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.064s	user 0.004s	sys 0.003s
I20260709 12:09:22.022733 26371 catalog_manager.cc:5697] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.017786 26664 tablet_bootstrap.cc:492] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:22.025609 26664 ts_tablet_manager.cc:1403] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.193s	user 0.023s	sys 0.042s
I20260709 12:09:22.031760 26663 tablet_bootstrap.cc:492] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:22.033102 26468 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:22.035601 26664 raft_consensus.cc:359] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.036327 26664 raft_consensus.cc:385] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.040887 26662 tablet_bootstrap.cc:492] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:22.041016 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:22.045776 26664 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.046844 26730 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.046654 26664 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.047416 26730 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:22.048379 26730 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.049283 26664 ts_tablet_manager.cc:1434] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.003s
I20260709 12:09:22.050426 26664 tablet_bootstrap.cc:492] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
W20260709 12:09:22.042604 26514 consensus_peers.cc:597] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:22.053802 26662 ts_tablet_manager.cc:1403] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.254s	user 0.006s	sys 0.024s
I20260709 12:09:22.045446 26663 tablet_bootstrap.cc:654] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.059273 26615 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:22.060890 26880 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.062143 26664 tablet_bootstrap.cc:654] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.072113 26663 tablet_bootstrap.cc:492] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:22.072674 26663 ts_tablet_manager.cc:1403] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.051s	user 0.001s	sys 0.013s
I20260709 12:09:22.078244 26664 tablet_bootstrap.cc:492] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:22.078878 26664 ts_tablet_manager.cc:1403] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.000s
I20260709 12:09:22.091305 26663 raft_consensus.cc:359] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.092109 26663 raft_consensus.cc:385] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.092413 26663 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.093164 26663 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.095772 26664 raft_consensus.cc:359] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.096520 26664 raft_consensus.cc:385] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.096817 26664 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.100863 26663 ts_tablet_manager.cc:1434] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:09:22.101960 26663 tablet_bootstrap.cc:492] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:22.102698 26545 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:22.105367 26856 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:22.107479 26664 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.109390 26664 ts_tablet_manager.cc:1434] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.002s
I20260709 12:09:22.110351 26664 tablet_bootstrap.cc:492] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:22.114924 26662 raft_consensus.cc:359] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.118126 26662 raft_consensus.cc:385] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.118456 26662 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
W20260709 12:09:22.119264 26439 consensus_peers.cc:597] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:22.119182 26662 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.101118 26371 catalog_manager.cc:5697] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 0 to 1, leader changed from <none> to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.121497 26662 ts_tablet_manager.cc:1434] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.000s
I20260709 12:09:22.130739 26663 tablet_bootstrap.cc:654] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.134776 26662 tablet_bootstrap.cc:492] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:22.140584 26664 tablet_bootstrap.cc:654] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.146263 26729 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.161171 26662 tablet_bootstrap.cc:654] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.162694 26729 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.166985 26729 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:22.181109 26419 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:22.184798 26729 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:22.186278 26663 tablet_bootstrap.cc:492] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:22.186853 26663 ts_tablet_manager.cc:1403] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.085s	user 0.013s	sys 0.005s
I20260709 12:09:22.191915 26663 raft_consensus.cc:359] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.192596 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:22.193485 26543 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 1: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:09:22.192652 26663 raft_consensus.cc:385] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.193934 26663 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.207006 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:22.208659 26663 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.211572 26668 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.212247 26668 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.213231 26663 ts_tablet_manager.cc:1434] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:09:22.214183 26663 tablet_bootstrap.cc:492] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:22.216856 26668 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:22.218209 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:22.221197 26439 leader_election.cc:343] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.224272 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:22.225204 26544 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 0.
I20260709 12:09:22.225536 26668 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.228366 26438 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:22.229450 26860 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.230010 26860 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.230507 26860 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.241410 26668 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:22.240921 26371 catalog_manager.cc:5697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.244215 26664 tablet_bootstrap.cc:492] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:22.244750 26664 ts_tablet_manager.cc:1403] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.135s	user 0.014s	sys 0.007s
I20260709 12:09:22.222069 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:22.250571 26860 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.252451 26716 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.248546 26664 raft_consensus.cc:359] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.253278 26863 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.253690 26664 raft_consensus.cc:385] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.254161 26664 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.261590 26664 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.265127 26664 ts_tablet_manager.cc:1434] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.006s
I20260709 12:09:22.266350 26664 tablet_bootstrap.cc:492] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:22.255756 26668 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.272332 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:22.273572 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:22.272773 26668 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:22.275765 26439 leader_election.cc:343] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.270973 26860 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:22.276973 26543 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.281649 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:22.282363 26548 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 0.
I20260709 12:09:22.282932 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:22.284040 26438 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:22.284930 26762 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.285301 26762 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.285650 26762 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.286134 26716 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.287918 26663 tablet_bootstrap.cc:654] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.279404 26668 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:22.295426 26439 leader_election.cc:343] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.298659 26439 consensus_peers.cc:597] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:22.300619 26762 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.303647 26662 tablet_bootstrap.cc:492] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:22.304184 26662 ts_tablet_manager.cc:1403] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.170s	user 0.018s	sys 0.005s
I20260709 12:09:22.307687 26861 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.308230 26861 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.287328 26543 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:22.314965 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:22.312904 26861 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:22.317330 26514 leader_election.cc:343] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.318876 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:22.319617 26468 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:22.320993 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:22.322569 26861 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.323036 26861 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.323472 26861 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.325383 26762 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:22.326889 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:22.327224 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:22.327556 26548 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:22.331096 26439 leader_election.cc:343] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.338136 26663 tablet_bootstrap.cc:492] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:22.338639 26663 ts_tablet_manager.cc:1403] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.016s
I20260709 12:09:22.341367 26664 tablet_bootstrap.cc:654] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.341509 26438 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:22.343324 26762 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.344144 26762 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:22.346964 26548 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:22.347214 26762 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.348335 26438 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:22.349536 26668 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.350742 26668 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:22.349357 26662 raft_consensus.cc:359] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.351641 26668 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.352303 26663 raft_consensus.cc:359] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.353631 26663 raft_consensus.cc:385] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.353996 26663 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.354743 26861 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.354902 26663 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.357391 26663 ts_tablet_manager.cc:1434] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:09:22.357640 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:22.358249 26468 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.358525 26664 tablet_bootstrap.cc:492] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:22.358698 26663 tablet_bootstrap.cc:492] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:22.351491 26662 raft_consensus.cc:385] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.359027 26664 ts_tablet_manager.cc:1403] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.093s	user 0.013s	sys 0.000s
I20260709 12:09:22.359194 26662 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.359982 26662 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.365559 26663 tablet_bootstrap.cc:654] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.365767 26468 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:22.366905 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:22.367892 26690 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.368391 26690 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:22.369530 26664 raft_consensus.cc:359] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.370281 26664 raft_consensus.cc:385] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.370582 26664 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.369400 26690 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.371755 26662 ts_tablet_manager.cc:1434] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 12:09:22.371717 26664 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.373735 26664 ts_tablet_manager.cc:1434] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:09:22.374707 26664 tablet_bootstrap.cc:492] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:22.386070 26662 tablet_bootstrap.cc:492] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:22.401839 26370 catalog_manager.cc:5697] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.405835 26664 tablet_bootstrap.cc:654] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.409914 26662 tablet_bootstrap.cc:654] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.414885 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:22.418287 26687 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.419027 26687 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.420146 26369 catalog_manager.cc:5697] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 0 to 1, leader changed from <none> to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.421766 26687 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:22.422143 26762 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.422694 26762 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.424809 26762 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:22.424862 26514 leader_election.cc:343] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.427040 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:22.427124 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:22.427875 26471 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:22.428258 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:22.429654 26439 leader_election.cc:343] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.433917 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:09:22.434116 26514 leader_election.cc:343] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.437731 26861 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:22.442314 26438 leader_election.cc:343] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.444115 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:22.447386 26690 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.447798 26690 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.448148 26690 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.443030 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:22.452991 26663 tablet_bootstrap.cc:492] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:22.452970 26668 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.454257 26663 ts_tablet_manager.cc:1403] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.096s	user 0.026s	sys 0.051s
I20260709 12:09:22.458101 26663 raft_consensus.cc:359] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.459193 26663 raft_consensus.cc:385] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.459625 26663 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.461681 26663 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.462304 26662 tablet_bootstrap.cc:492] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:22.462759 26664 tablet_bootstrap.cc:492] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:22.462821 26662 ts_tablet_manager.cc:1403] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.077s	user 0.024s	sys 0.007s
I20260709 12:09:22.463291 26664 ts_tablet_manager.cc:1403] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.089s	user 0.018s	sys 0.000s
I20260709 12:09:22.464166 26663 ts_tablet_manager.cc:1434] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:09:22.465198 26663 tablet_bootstrap.cc:492] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:22.469527 26664 raft_consensus.cc:359] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.470203 26664 raft_consensus.cc:385] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.470186 26369 catalog_manager.cc:5697] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 0 to 1, leader changed from <none> to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.471154 26663 tablet_bootstrap.cc:654] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.470693 26664 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.470604 26690 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.472950 26664 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.474690 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:22.475378 26664 ts_tablet_manager.cc:1434] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:09:22.482508 26664 tablet_bootstrap.cc:492] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:22.483089 26663 tablet_bootstrap.cc:492] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:22.483573 26663 ts_tablet_manager.cc:1403] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.002s
I20260709 12:09:22.483842 26716 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.484346 26716 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.486516 26716 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:22.486342 26663 raft_consensus.cc:359] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.487152 26663 raft_consensus.cc:385] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.487452 26663 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.488716 26664 tablet_bootstrap.cc:654] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.488276 26663 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.477130 26662 raft_consensus.cc:359] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.490316 26662 raft_consensus.cc:385] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.490648 26662 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.490782 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:22.491652 26663 ts_tablet_manager.cc:1434] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:09:22.492033 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:09:22.492214 26587 leader_election.cc:343] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.492698 26546 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 0.
I20260709 12:09:22.492921 26663 tablet_bootstrap.cc:492] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:22.500952 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:09:22.501292 26663 tablet_bootstrap.cc:654] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.501482 26664 tablet_bootstrap.cc:492] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:22.501513 26471 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.502066 26664 ts_tablet_manager.cc:1403] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:09:22.502095 26716 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.505766 26716 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.505577 26664 raft_consensus.cc:359] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.506668 26664 raft_consensus.cc:385] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.507053 26664 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.506224 26716 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.507927 26664 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.510653 26877 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.511307 26877 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.514297 26877 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:22.516073 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:22.518007 26514 leader_election.cc:343] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.518946 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:22.519731 26468 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:22.521006 26513 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:22.521163 26716 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.522105 26687 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.522647 26687 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.523131 26687 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.491497 26662 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.525023 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:09:22.529110 26587 leader_election.cc:343] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.530958 26662 ts_tablet_manager.cc:1434] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 12:09:22.532014 26662 tablet_bootstrap.cc:492] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:22.535426 26471 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:22.537506 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:22.538239 26664 ts_tablet_manager.cc:1434] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:09:22.540205 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:09:22.548908 26514 leader_election.cc:343] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.549206 26548 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.551913 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:22.552807 26877 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.553211 26877 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:22.553984 26877 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.555022 26762 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.555538 26762 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.558274 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:22.559278 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:22.560050 26438 leader_election.cc:343] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.560765 26439 leader_election.cc:343] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.561189 26439 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:22.562031 26668 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.563247 26762 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:22.566593 26548 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:22.567948 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:09:22.568727 26664 tablet_bootstrap.cc:492] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:22.569662 26863 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.570171 26863 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:22.533756 26687 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.540710 26716 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:22.543233 26663 tablet_bootstrap.cc:492] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:22.579710 26663 ts_tablet_manager.cc:1403] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.087s	user 0.027s	sys 0.023s
I20260709 12:09:22.580962 26664 tablet_bootstrap.cc:654] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.581516 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:22.582186 26468 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.583079 26663 raft_consensus.cc:359] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.583879 26663 raft_consensus.cc:385] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.584163 26663 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.584911 26663 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.587340 26663 ts_tablet_manager.cc:1434] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:22.588707 26663 tablet_bootstrap.cc:492] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:22.589578 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:09:22.593690 26514 leader_election.cc:343] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.544270 26690 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:22.599220 26468 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:22.600677 26513 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:22.600912 26663 tablet_bootstrap.cc:654] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.601679 26690 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.602192 26690 raft_consensus.cc:697] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:22.603009 26690 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.606966 26664 tablet_bootstrap.cc:492] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:22.607623 26664 ts_tablet_manager.cc:1403] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.039s	user 0.025s	sys 0.006s
I20260709 12:09:22.611224 26664 raft_consensus.cc:359] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.616149 26664 raft_consensus.cc:385] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.616576 26664 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.618157 26664 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.544644 26662 tablet_bootstrap.cc:654] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.573751 26863 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.577762 26687 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:22.626747 26664 ts_tablet_manager.cc:1434] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 12:09:22.627803 26664 tablet_bootstrap.cc:492] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:22.628064 26663 tablet_bootstrap.cc:492] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:22.628484 26663 ts_tablet_manager.cc:1403] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.012s
I20260709 12:09:22.631162 26663 raft_consensus.cc:359] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.631878 26663 raft_consensus.cc:385] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.618170 26369 catalog_manager.cc:5697] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.632193 26663 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.632910 26663 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.633690 26664 tablet_bootstrap.cc:654] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.635064 26663 ts_tablet_manager.cc:1434] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:09:22.635936 26546 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.636046 26663 tablet_bootstrap.cc:492] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:22.647683 26663 tablet_bootstrap.cc:654] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.660636 26863 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.656313 26371 catalog_manager.cc:5697] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.672385 26662 tablet_bootstrap.cc:492] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:22.673084 26662 ts_tablet_manager.cc:1403] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.141s	user 0.010s	sys 0.000s
I20260709 12:09:22.685657 26662 raft_consensus.cc:359] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.686367 26662 raft_consensus.cc:385] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.686658 26662 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.688575 26662 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.698542 26762 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.699141 26762 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.701344 26762 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:22.704377 26662 ts_tablet_manager.cc:1434] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.004s
I20260709 12:09:22.705662 26662 tablet_bootstrap.cc:492] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:22.706979 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:09:22.708473 26438 leader_election.cc:343] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.713411 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:22.715107 26439 leader_election.cc:343] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.715596 26439 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:22.716696 26860 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.728559 26664 tablet_bootstrap.cc:492] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:22.729131 26664 ts_tablet_manager.cc:1403] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.102s	user 0.037s	sys 0.026s
I20260709 12:09:22.731622 26663 tablet_bootstrap.cc:492] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:22.732239 26663 ts_tablet_manager.cc:1403] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.096s	user 0.019s	sys 0.019s
I20260709 12:09:22.736078 26663 raft_consensus.cc:359] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.736758 26663 raft_consensus.cc:385] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.737046 26663 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.739333 26663 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.741340 26664 raft_consensus.cc:359] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.742091 26664 raft_consensus.cc:385] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.742204 26663 ts_tablet_manager.cc:1434] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:09:22.742468 26664 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.743185 26663 tablet_bootstrap.cc:492] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:22.743170 26664 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.744714 26664 ts_tablet_manager.cc:1434] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:09:22.745601 26664 tablet_bootstrap.cc:492] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:22.748843 26690 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.748873 26369 catalog_manager.cc:5697] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.749464 26690 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.755842 26877 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.738210 26863 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:09:22.757994 26690 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:22.757977 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:22.757052 26877 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.758767 26468 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:22.759109 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:22.760743 26877 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:22.760239 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:09:22.762492 26514 leader_election.cc:343] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.763227 26664 tablet_bootstrap.cc:654] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.763260 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:22.765601 26690 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.765949 26690 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.766220 26690 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.764058 26468 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:22.768061 26513 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:22.768913 26687 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.769291 26687 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.769671 26687 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.771543 26663 tablet_bootstrap.cc:654] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.775135 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:22.777012 26514 leader_election.cc:343] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.790318 26687 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.818420 26860 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.797641 26662 tablet_bootstrap.cc:654] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.826350 26860 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.827914 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:22.828526 26468 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.830194 26687 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:22.808349 26663 tablet_bootstrap.cc:492] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:22.830971 26663 ts_tablet_manager.cc:1403] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.013s
I20260709 12:09:22.830930 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:22.832834 26439 leader_election.cc:343] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.833621 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:22.834129 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:22.794966 26762 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 12:09:22.833621 26860 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:22.837864 26468 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:22.833328 26690 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:22.834950 26514 leader_election.cc:343] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.839413 26513 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:22.840180 26690 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:22.840749 26690 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.841216 26690 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:22.834383 26663 raft_consensus.cc:359] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.841945 26690 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.842325 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:09:22.843781 26438 leader_election.cc:343] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.844193 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:22.813284 26664 tablet_bootstrap.cc:492] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:22.845427 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:22.846040 26471 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.842334 26663 raft_consensus.cc:385] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.847272 26663 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
W20260709 12:09:22.844277 26514 consensus_peers.cc:597] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:09:22.851152 26514 leader_election.cc:343] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.851763 26860 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.845417 26664 ts_tablet_manager.cc:1403] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.100s	user 0.015s	sys 0.002s
I20260709 12:09:22.855732 26668 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.856382 26668 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.858268 26471 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:22.858978 26668 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:22.863471 26439 consensus_peers.cc:597] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:22.859565 26664 raft_consensus.cc:359] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.860260 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:22.864471 26664 raft_consensus.cc:385] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.850626 26663 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.864603 26662 tablet_bootstrap.cc:492] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:22.865387 26662 ts_tablet_manager.cc:1403] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.160s	user 0.008s	sys 0.011s
I20260709 12:09:22.866536 26663 ts_tablet_manager.cc:1434] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:09:22.868676 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:22.868775 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:22.869313 26664 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.869544 26546 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 1: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:09:22.869796 26687 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.870745 26664 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.875063 26664 ts_tablet_manager.cc:1434] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260709 12:09:22.876068 26664 tablet_bootstrap.cc:492] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
W20260709 12:09:22.876128 26439 consensus_peers.cc:597] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:22.871178 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:22.871605 26716 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.869068 26662 raft_consensus.cc:359] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.879472 26662 raft_consensus.cc:385] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.879020 26716 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.879738 26662 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.880465 26662 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.880553 26369 catalog_manager.cc:5697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.881407 26716 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:22.881593 26668 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.883006 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:22.883877 26471 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 1: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:22.886586 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:22.872314 26663 tablet_bootstrap.cc:492] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:22.872395 26687 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:22.889734 26687 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.890609 26668 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.894268 26663 tablet_bootstrap.cc:654] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.899135 26662 ts_tablet_manager.cc:1434] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.033s	user 0.001s	sys 0.005s
I20260709 12:09:22.900489 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:22.902733 26730 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.904179 26690 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.909626 26762 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.910357 26662 tablet_bootstrap.cc:492] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:22.936866 26730 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.942472 26664 tablet_bootstrap.cc:654] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.951491 26662 tablet_bootstrap.cc:654] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.959408 26369 catalog_manager.cc:5697] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.965387 26662 tablet_bootstrap.cc:492] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:22.966017 26662 ts_tablet_manager.cc:1403] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.004s
I20260709 12:09:22.971125 26663 tablet_bootstrap.cc:492] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:22.971882 26663 ts_tablet_manager.cc:1403] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.100s	user 0.023s	sys 0.036s
I20260709 12:09:22.975932 26663 raft_consensus.cc:359] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.976989 26663 raft_consensus.cc:385] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.977316 26663 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.978008 26663 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.980504 26663 ts_tablet_manager.cc:1434] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:09:22.981501 26663 tablet_bootstrap.cc:492] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:22.982648 26615 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.986771 26687 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.987358 26687 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:22.988782 26663 tablet_bootstrap.cc:654] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.991299 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:22.993355 26514 leader_election.cc:343] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.998811 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:22.999603 26687 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:22.999595 26471 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:23.003726 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:23.005167 26687 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.005813 26687 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.006196 26687 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.010711 26662 raft_consensus.cc:359] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.012689 26716 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.011467 26662 raft_consensus.cc:385] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.016942 26662 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.017752 26662 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.021723 26664 tablet_bootstrap.cc:492] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:23.022687 26664 ts_tablet_manager.cc:1403] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.147s	user 0.013s	sys 0.009s
I20260709 12:09:23.025146 26662 ts_tablet_manager.cc:1434] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 12:09:23.026505 26662 tablet_bootstrap.cc:492] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:23.026539 26943 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.028334 26943 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.032199 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:23.034143 26439 leader_election.cc:343] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.036859 26943 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:23.038530 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:23.035496 26664 raft_consensus.cc:359] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.040577 26664 raft_consensus.cc:385] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.041033 26664 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
W20260709 12:09:23.041172 26438 leader_election.cc:343] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.041817 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:23.042351 26664 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.043092 26668 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.043330 26662 tablet_bootstrap.cc:654] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.057700 26687 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.058475 26730 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:23.059168 26730 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.062974 26728 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.069325 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:09:23.070726 26514 leader_election.cc:343] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.074323 26854 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.077716 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:23.078027 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:23.079774 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:23.080408 26468 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.081612 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:23.082808 26854 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:23.103375 26662 tablet_bootstrap.cc:492] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:23.106897 26662 ts_tablet_manager.cc:1403] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.000s
I20260709 12:09:23.110736 26662 raft_consensus.cc:359] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.104322 26687 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:23.113076 26730 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:23.113909 26663 tablet_bootstrap.cc:492] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:23.114847 26662 raft_consensus.cc:385] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.115489 26662 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.116024 26468 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:23.117791 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:23.118012 26662 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.119011 26861 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.120021 26861 raft_consensus.cc:697] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:23.119153 26663 ts_tablet_manager.cc:1403] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.138s	user 0.048s	sys 0.065s
W20260709 12:09:23.121219 26514 consensus_peers.cc:597] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:23.120837 26861 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.121901 26664 ts_tablet_manager.cc:1434] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.006s
I20260709 12:09:23.122524 26687 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.123003 26687 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.123876 26663 raft_consensus.cc:359] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.126564 26687 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:23.126609 26663 raft_consensus.cc:385] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.127188 26663 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.127951 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:23.127898 26663 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.131309 26663 ts_tablet_manager.cc:1434] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:09:23.132273 26663 tablet_bootstrap.cc:492] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:23.124850 26662 ts_tablet_manager.cc:1434] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:09:23.134341 26662 tablet_bootstrap.cc:492] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
W20260709 12:09:23.134210 26514 leader_election.cc:343] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.125859 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:23.135824 26468 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:23.136971 26513 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:23.138167 26690 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.138662 26690 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.139047 26690 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.147451 26690 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.150156 26664 tablet_bootstrap.cc:492] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:23.151175 26662 tablet_bootstrap.cc:654] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.151481 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:23.152088 26468 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.152906 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:09:23.154357 26514 leader_election.cc:343] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.154264 26728 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.155022 26690 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:23.156639 26664 tablet_bootstrap.cc:654] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.153645 26663 tablet_bootstrap.cc:654] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.159261 26943 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.159857 26943 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.164270 26468 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:23.171877 26367 catalog_manager.cc:5697] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.175433 26664 tablet_bootstrap.cc:492] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:23.175966 26664 ts_tablet_manager.cc:1403] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.026s	user 0.003s	sys 0.008s
I20260709 12:09:23.178236 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:23.178884 26664 raft_consensus.cc:359] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.179491 26664 raft_consensus.cc:385] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.179792 26664 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
W20260709 12:09:23.180011 26439 leader_election.cc:343] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.180567 26664 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.182962 26664 ts_tablet_manager.cc:1434] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:09:23.183993 26664 tablet_bootstrap.cc:492] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:23.192340 26664 tablet_bootstrap.cc:654] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.204205 26943 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:23.212302 26513 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:23.213783 26687 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.214848 26687 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:23.216122 26687 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.218325 26664 tablet_bootstrap.cc:492] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:23.218954 26664 ts_tablet_manager.cc:1403] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.014s
I20260709 12:09:23.222282 26664 raft_consensus.cc:359] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.223109 26664 raft_consensus.cc:385] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.223457 26664 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.246815 26664 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.247157 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:23.249274 26664 ts_tablet_manager.cc:1434] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.000s
I20260709 12:09:23.249214 26543 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 0.
I20260709 12:09:23.250427 26664 tablet_bootstrap.cc:492] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
W20260709 12:09:23.253624 26514 consensus_peers.cc:597] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:23.257496 26664 tablet_bootstrap.cc:654] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.264576 26730 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.265166 26730 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.267112 26730 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:23.268844 26438 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:23.271389 26728 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:23.280155 26419 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:23.281961 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:23.285836 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:23.287751 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:23.288722 26730 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.289391 26690 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.289727 26690 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.290629 26664 tablet_bootstrap.cc:492] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:23.291235 26664 ts_tablet_manager.cc:1403] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.041s	user 0.024s	sys 0.007s
I20260709 12:09:23.291589 26690 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:23.295753 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:23.298329 26514 leader_election.cc:343] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.304090 26943 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.304544 26943 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.304875 26943 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.313100 26663 tablet_bootstrap.cc:492] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:23.313774 26663 ts_tablet_manager.cc:1403] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.182s	user 0.031s	sys 0.016s
I20260709 12:09:23.316466 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:23.317284 26471 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:23.317529 26621 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.318440 26662 tablet_bootstrap.cc:492] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:23.318941 26662 ts_tablet_manager.cc:1403] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.185s	user 0.032s	sys 0.016s
I20260709 12:09:23.319149 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:23.320950 26728 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.320673 26664 raft_consensus.cc:359] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.321434 26664 raft_consensus.cc:385] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.321758 26664 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.326821 26664 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.321352 26728 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.333357 26728 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.332651 26663 raft_consensus.cc:359] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.334672 26663 raft_consensus.cc:385] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.335042 26663 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.333149 26367 catalog_manager.cc:5697] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.335762 26663 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.338222 26663 ts_tablet_manager.cc:1434] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.024s	user 0.001s	sys 0.005s
I20260709 12:09:23.339206 26663 tablet_bootstrap.cc:492] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:23.341931 26943 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.344839 26662 raft_consensus.cc:359] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.346500 26662 raft_consensus.cc:385] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.346558 26664 ts_tablet_manager.cc:1434] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 12:09:23.346804 26662 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.347641 26664 tablet_bootstrap.cc:492] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:23.347532 26662 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.351446 26662 ts_tablet_manager.cc:1434] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:09:23.352422 26662 tablet_bootstrap.cc:492] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:23.357185 26728 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.362764 26728 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:23.363754 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:09:23.365183 26514 consensus_peers.cc:597] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:23.365803 26663 tablet_bootstrap.cc:654] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:23.366197 26514 leader_election.cc:343] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.371162 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:23.374598 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:23.375236 26468 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.372349 26943 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:23.377622 26664 tablet_bootstrap.cc:654] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.374624 26854 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.380457 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:23.380218 26854 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.381074 26546 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:23.374614 26439 leader_election.cc:343] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.387442 26687 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.387969 26687 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.389609 26615 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.390565 26728 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.394781 26546 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:23.395718 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:23.406905 26438 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:23.407855 26943 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.399792 26854 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:23.408388 26943 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:23.409158 26662 tablet_bootstrap.cc:654] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.400904 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:23.422118 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:23.422827 26468 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:23.409828 26943 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.397699 26687 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:23.427556 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:23.406703 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:23.422854 26471 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:23.429454 26854 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:23.430698 26514 leader_election.cc:343] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.432076 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:23.433802 26513 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:23.435307 26728 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.435963 26728 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:23.440191 26690 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.440713 26690 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.441112 26690 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.437005 26728 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.455300 26690 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.455969 26663 tablet_bootstrap.cc:492] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:23.456478 26663 ts_tablet_manager.cc:1403] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.117s	user 0.012s	sys 0.017s
I20260709 12:09:23.465059 26662 tablet_bootstrap.cc:492] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:23.465463 26621 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.465801 26662 ts_tablet_manager.cc:1403] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.114s	user 0.017s	sys 0.012s
I20260709 12:09:23.438870 26687 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:09:23.473745 26664 tablet_bootstrap.cc:492] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:23.474368 26664 ts_tablet_manager.cc:1403] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.127s	user 0.018s	sys 0.024s
I20260709 12:09:23.477054 26618 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.477775 26664 raft_consensus.cc:359] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.478513 26664 raft_consensus.cc:385] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.478778 26664 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.479452 26664 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.481801 26664 ts_tablet_manager.cc:1434] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 12:09:23.482810 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:23.483508 26663 raft_consensus.cc:359] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.484187 26663 raft_consensus.cc:385] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:09:23.484227 26514 leader_election.cc:343] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.484535 26663 raft_consensus.cc:740] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.484830 26690 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:23.485210 26663 consensus_queue.cc:260] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.486604 26664 tablet_bootstrap.cc:492] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:23.495270 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:23.496263 26468 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.503268 26663 ts_tablet_manager.cc:1434] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.005s
I20260709 12:09:23.504343 26663 tablet_bootstrap.cc:492] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:23.511091 26468 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:23.512365 26513 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:23.513190 26690 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.513638 26690 raft_consensus.cc:697] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:23.514364 26690 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.515751 26662 raft_consensus.cc:359] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.516450 26662 raft_consensus.cc:385] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.516695 26662 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.517321 26662 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.524019 26662 ts_tablet_manager.cc:1434] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.002s
I20260709 12:09:23.525303 26662 tablet_bootstrap.cc:492] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:23.540995 26668 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.541664 26668 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.546168 26369 catalog_manager.cc:5697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 0 to 1, leader changed from <none> to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.549126 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:09:23.550711 26438 leader_election.cc:343] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.551683 26668 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:23.562290 26663 tablet_bootstrap.cc:654] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.550714 26877 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:09:23.593060 26861 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.593657 26861 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.595680 26664 tablet_bootstrap.cc:654] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.598846 26861 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:23.602464 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:23.602823 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:23.605705 26439 leader_election.cc:343] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.604890 26367 catalog_manager.cc:5697] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.613242 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:09:23.618846 26514 leader_election.cc:343] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:23.621744 26513 leader_election.cc:343] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.628602 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:23.633366 26662 tablet_bootstrap.cc:654] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.606307 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:23.648522 26663 tablet_bootstrap.cc:492] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:23.649078 26663 ts_tablet_manager.cc:1403] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.145s	user 0.021s	sys 0.019s
I20260709 12:09:23.639199 26976 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.663182 26762 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.663885 26762 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.676986 26662 tablet_bootstrap.cc:492] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:23.677721 26662 ts_tablet_manager.cc:1403] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.153s	user 0.013s	sys 0.002s
I20260709 12:09:23.681975 26762 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:23.682713 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 77083.3us
I20260709 12:09:23.685072 26663 raft_consensus.cc:359] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.685832 26663 raft_consensus.cc:385] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.686122 26663 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.669520 26978 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.691854 26663 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.692538 26687 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:09:23.694267 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:23.697476 26863 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.697623 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:23.698009 26863 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.699862 26663 ts_tablet_manager.cc:1434] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
W20260709 12:09:23.700659 26438 leader_election.cc:343] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.701426 26863 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:09:23.702206 26514 consensus_peers.cc:597] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:23.708632 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:23.700387 26662 raft_consensus.cc:359] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:23.713003 26514 consensus_peers.cc:597] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:23.713027 26662 raft_consensus.cc:385] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.714057 26662 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.716650 26663 tablet_bootstrap.cc:492] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
W20260709 12:09:23.711417 26439 leader_election.cc:343] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.756803 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:09:23.761780 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 50410.5us
I20260709 12:09:23.763027 26668 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.763761 26668 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.764182 26668 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.771947 26668 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:23.772818 26664 tablet_bootstrap.cc:492] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:23.773499 26664 ts_tablet_manager.cc:1403] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.287s	user 0.015s	sys 0.005s
I20260709 12:09:23.776907 26664 raft_consensus.cc:359] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.777801 26664 raft_consensus.cc:385] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.778093 26664 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.784040 26367 catalog_manager.cc:5697] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.786768 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:23.776207 26662 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.793977 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:23.794943 26662 ts_tablet_manager.cc:1434] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.117s	user 0.025s	sys 0.024s
I20260709 12:09:23.798261 26663 tablet_bootstrap.cc:654] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.801358 26662 tablet_bootstrap.cc:492] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:23.804245 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:09:23.812762 26438 leader_election.cc:343] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.813833 26664 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.810516 26854 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.825147 26622 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.826381 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:23.827385 26664 ts_tablet_manager.cc:1434] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.002s
I20260709 12:09:23.828393 26664 tablet_bootstrap.cc:492] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:23.829820 26662 tablet_bootstrap.cc:654] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:23.833482 26439 leader_election.cc:343] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.833997 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:23.834805 26978 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.844540 26663 tablet_bootstrap.cc:492] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:23.845144 26663 ts_tablet_manager.cc:1403] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.129s	user 0.020s	sys 0.004s
I20260709 12:09:23.848299 26663 raft_consensus.cc:359] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.849038 26663 raft_consensus.cc:385] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.849341 26663 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.850112 26663 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.851701 26663 ts_tablet_manager.cc:1434] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:23.852679 26663 tablet_bootstrap.cc:492] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:23.853768 26664 tablet_bootstrap.cc:654] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.859367 26663 tablet_bootstrap.cc:654] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.862042 26615 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.866118 26668 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.871043 26662 tablet_bootstrap.cc:492] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:23.871763 26662 ts_tablet_manager.cc:1403] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.001s
I20260709 12:09:23.878638 26662 raft_consensus.cc:359] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.879621 26662 raft_consensus.cc:385] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.880014 26662 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.881732 26664 tablet_bootstrap.cc:492] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:23.882436 26664 ts_tablet_manager.cc:1403] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.054s	user 0.004s	sys 0.009s
I20260709 12:09:23.885403 26664 raft_consensus.cc:359] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.886122 26664 raft_consensus.cc:385] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.889819 26662 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:23.893101 26439 consensus_peers.cc:597] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:23.897161 26662 ts_tablet_manager.cc:1434] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 12:09:23.897576 26664 raft_consensus.cc:740] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.898326 26664 consensus_queue.cc:260] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.900694 26664 ts_tablet_manager.cc:1434] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:09:23.901773 26664 tablet_bootstrap.cc:492] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:23.905514 26662 tablet_bootstrap.cc:492] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:23.906606 26687 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.907308 26687 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.911530 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:23.912374 26662 tablet_bootstrap.cc:654] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.912467 26470 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:23.914786 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:23.915802 26981 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.916157 26981 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.916476 26981 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.918794 26664 tablet_bootstrap.cc:654] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.922863 26663 tablet_bootstrap.cc:492] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:23.923323 26663 ts_tablet_manager.cc:1403] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.071s	user 0.016s	sys 0.024s
I20260709 12:09:23.925987 26663 raft_consensus.cc:359] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.926721 26663 raft_consensus.cc:385] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.926998 26863 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.927688 26863 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.930595 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:23.932042 26514 leader_election.cc:343] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.931797 26981 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.927012 26663 raft_consensus.cc:740] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.934588 26663 consensus_queue.cc:260] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:23.935156 26863 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:23.937125 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:23.943140 26877 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.944190 26981 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:23.943182 26663 ts_tablet_manager.cc:1434] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:09:23.945665 26663 tablet_bootstrap.cc:492] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:23.951841 26663 tablet_bootstrap.cc:654] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.946449 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:23.959623 26687 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:23.970863 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:23.984361 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:23.972613 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:23.987775 26469 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.994014 26662 tablet_bootstrap.cc:492] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:23.986858 26863 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.994606 26662 ts_tablet_manager.cc:1403] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.089s	user 0.010s	sys 0.028s
I20260709 12:09:23.998876 26687 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.000120 26664 tablet_bootstrap.cc:492] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
W20260709 12:09:24.000604 26514 leader_election.cc:343] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.000830 26981 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.000604 26664 ts_tablet_manager.cc:1403] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.099s	user 0.023s	sys 0.022s
I20260709 12:09:24.001279 26981 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.004030 26981 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:24.005434 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:24.005645 26662 raft_consensus.cc:359] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.007359 26662 raft_consensus.cc:385] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:09:24.007393 26514 leader_election.cc:343] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.007949 26662 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.006912 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:24.010151 26473 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:24.011759 26513 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:24.013275 26981 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.013650 26981 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.014009 26981 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.009027 26662 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.016788 26469 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:24.021329 26662 ts_tablet_manager.cc:1434] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 12:09:24.023870 26662 tablet_bootstrap.cc:492] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:24.022414 26982 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.025060 26982 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.027738 26982 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:24.028446 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:24.029142 26473 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:24.029699 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:24.030380 26513 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:09:24.031769 26514 leader_election.cc:343] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.032163 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:24.035512 26877 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.036718 26877 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:24.035591 26982 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.038147 26877 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.037653 26982 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.049750 26982 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.047775 26664 raft_consensus.cc:359] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.071545 26664 raft_consensus.cc:385] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.071892 26664 raft_consensus.cc:740] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
W20260709 12:09:24.072461 26514 consensus_peers.cc:597] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:24.072532 26664 consensus_queue.cc:260] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.077379 26730 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.077867 26730 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.079625 26730 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:24.080816 26663 tablet_bootstrap.cc:492] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:24.081317 26663 ts_tablet_manager.cc:1403] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.136s	user 0.028s	sys 0.003s
I20260709 12:09:24.082425 26664 ts_tablet_manager.cc:1434] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.081s	user 0.003s	sys 0.008s
I20260709 12:09:24.083391 26664 tablet_bootstrap.cc:492] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:24.084612 26663 raft_consensus.cc:359] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.085279 26663 raft_consensus.cc:385] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.085357 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:24.085557 26663 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.087935 26663 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.089319 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:24.092213 26982 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.093559 26662 tablet_bootstrap.cc:654] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.093938 26663 ts_tablet_manager.cc:1434] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.004s
I20260709 12:09:24.094991 26663 tablet_bootstrap.cc:492] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:24.095296 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:24.095886 26473 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.096921 26981 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.102144 26664 tablet_bootstrap.cc:654] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.103740 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:24.104497 26997 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.109184 26371 catalog_manager.cc:5697] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.111692 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:24.111966 26615 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.112355 26471 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.115134 26981 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:24.117637 26663 tablet_bootstrap.cc:654] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:24.122944 26514 consensus_peers.cc:597] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:24.123603 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:24.125631 26471 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:24.128530 26982 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:24.130383 26513 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:24.131604 26473 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:24.139160 26513 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:24.140223 26861 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.140132 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:24.140878 26861 raft_consensus.cc:697] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:09:24.142455 26514 leader_election.cc:343] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.143164 26861 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.141010 26687 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.146735 26687 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:24.139119 26662 tablet_bootstrap.cc:492] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:24.147730 26687 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.148926 26662 ts_tablet_manager.cc:1403] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.124s	user 0.010s	sys 0.014s
W20260709 12:09:24.148579 26514 leader_election.cc:343] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.152690 26663 tablet_bootstrap.cc:492] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:24.153180 26663 ts_tablet_manager.cc:1403] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.006s
I20260709 12:09:24.156139 26664 tablet_bootstrap.cc:492] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:24.155747 26663 raft_consensus.cc:359] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.156984 26663 raft_consensus.cc:385] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.157284 26663 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.157918 26662 raft_consensus.cc:359] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.158636 26662 raft_consensus.cc:385] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.158900 26662 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.157938 26663 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.161015 26663 ts_tablet_manager.cc:1434] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:09:24.161633 26690 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.164219 26662 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.164268 26690 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.161970 26663 tablet_bootstrap.cc:492] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:24.170620 26690 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:24.156643 26664 ts_tablet_manager.cc:1403] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.073s	user 0.016s	sys 0.004s
I20260709 12:09:24.177325 26664 raft_consensus.cc:359] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.178054 26664 raft_consensus.cc:385] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.178323 26664 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.178963 26664 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.166460 26662 ts_tablet_manager.cc:1434] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:09:24.181124 26662 tablet_bootstrap.cc:492] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:24.174208 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:24.183012 26473 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:24.184333 26513 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:24.185213 26687 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.186230 26687 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.186636 26687 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.184898 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:24.187907 26662 tablet_bootstrap.cc:654] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:24.191581 26514 leader_election.cc:343] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.197188 26687 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.198871 26662 tablet_bootstrap.cc:492] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:24.199102 26663 tablet_bootstrap.cc:654] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.199362 26662 ts_tablet_manager.cc:1403] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.001s
I20260709 12:09:24.200639 26664 ts_tablet_manager.cc:1434] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:09:24.200870 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:24.201421 26473 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.201653 26664 tablet_bootstrap.cc:492] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:24.204005 26662 raft_consensus.cc:359] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.204814 26662 raft_consensus.cc:385] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.205772 26662 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.206410 26662 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.207918 26664 tablet_bootstrap.cc:654] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.208478 26662 ts_tablet_manager.cc:1434] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:09:24.209369 26662 tablet_bootstrap.cc:492] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:24.215400 26662 tablet_bootstrap.cc:654] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.232666 26367 catalog_manager.cc:5697] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.234457 26367 catalog_manager.cc:5697] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.242348 26663 tablet_bootstrap.cc:492] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:24.242962 26663 ts_tablet_manager.cc:1403] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.010s
I20260709 12:09:24.246960 26978 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.247493 26978 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.250347 26663 raft_consensus.cc:359] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.251112 26663 raft_consensus.cc:385] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.251410 26663 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.252033 26663 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.258059 26687 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:24.242635 26473 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:24.261540 26663 ts_tablet_manager.cc:1434] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:09:24.262777 26513 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:24.263844 26687 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.264525 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:24.265311 26687 raft_consensus.cc:697] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:24.266546 26663 tablet_bootstrap.cc:492] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:24.266094 26687 consensus_queue.cc:237] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.269043 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:24.270453 26978 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:24.273356 26514 leader_election.cc:343] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.282004 26664 tablet_bootstrap.cc:492] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:24.282572 26664 ts_tablet_manager.cc:1403] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.081s	user 0.035s	sys 0.018s
I20260709 12:09:24.286634 26664 raft_consensus.cc:359] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.287328 26664 raft_consensus.cc:385] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.287595 26664 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.288151 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:24.288251 26664 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:24.289968 26439 leader_election.cc:343] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:24.291694 26438 leader_election.cc:343] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.292088 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:24.293536 26860 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.293839 26663 tablet_bootstrap.cc:654] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.294745 26662 tablet_bootstrap.cc:492] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:24.295753 26662 ts_tablet_manager.cc:1403] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.002s
I20260709 12:09:24.298703 26617 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.299253 26662 raft_consensus.cc:359] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.300215 26662 raft_consensus.cc:385] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.300566 26662 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.301460 26662 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.304446 26662 ts_tablet_manager.cc:1434] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:09:24.306674 26664 ts_tablet_manager.cc:1434] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.004s
I20260709 12:09:24.308017 26664 tablet_bootstrap.cc:492] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:24.316736 26664 tablet_bootstrap.cc:654] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.321465 26662 tablet_bootstrap.cc:492] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:24.337962 26662 tablet_bootstrap.cc:654] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.355525 26367 catalog_manager.cc:5697] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.359613 26663 tablet_bootstrap.cc:492] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:24.360410 26663 ts_tablet_manager.cc:1403] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.098s	user 0.031s	sys 0.027s
I20260709 12:09:24.361230 26662 tablet_bootstrap.cc:492] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:24.361791 26662 ts_tablet_manager.cc:1403] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.005s
I20260709 12:09:24.363617 26663 raft_consensus.cc:359] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.364418 26663 raft_consensus.cc:385] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.365003 26663 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.364940 26662 raft_consensus.cc:359] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.365712 26662 raft_consensus.cc:385] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.366252 26662 raft_consensus.cc:740] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.366065 26663 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.367173 26662 consensus_queue.cc:260] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.368813 26662 ts_tablet_manager.cc:1434] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:24.369232 26663 ts_tablet_manager.cc:1434] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:24.370448 26662 tablet_bootstrap.cc:492] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:24.370308 26663 tablet_bootstrap.cc:492] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:24.376363 26663 tablet_bootstrap.cc:654] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.377360 26662 tablet_bootstrap.cc:654] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.402503 26664 tablet_bootstrap.cc:492] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:24.403033 26664 ts_tablet_manager.cc:1403] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.095s	user 0.015s	sys 0.006s
I20260709 12:09:24.412122 26663 tablet_bootstrap.cc:492] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:24.412719 26663 ts_tablet_manager.cc:1403] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.043s	user 0.020s	sys 0.015s
I20260709 12:09:24.421759 26664 raft_consensus.cc:359] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.422643 26664 raft_consensus.cc:385] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.423005 26664 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
W20260709 12:09:24.423604 26419 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:24.423714 26664 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.426873 26662 tablet_bootstrap.cc:492] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:24.427433 26662 ts_tablet_manager.cc:1403] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.012s
I20260709 12:09:24.427101 26663 raft_consensus.cc:359] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.427922 26663 raft_consensus.cc:385] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.428222 26663 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.429055 26663 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.431135 26662 raft_consensus.cc:359] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.431947 26662 raft_consensus.cc:385] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.432199 26978 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.432713 26978 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.436197 26978 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:24.436071 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:24.437036 26543 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 0.
I20260709 12:09:24.437438 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:24.438673 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:09:24.439277 26439 leader_election.cc:343] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.439782 26978 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.440213 26978 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.440575 26978 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.432247 26662 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.441735 26662 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.443969 26662 ts_tablet_manager.cc:1434] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:09:24.445556 26663 ts_tablet_manager.cc:1434] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.006s
I20260709 12:09:24.446574 26663 tablet_bootstrap.cc:492] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:24.452618 26663 tablet_bootstrap.cc:654] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.452998 26662 tablet_bootstrap.cc:492] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:24.459983 26662 tablet_bootstrap.cc:654] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.426213 26664 ts_tablet_manager.cc:1434] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:09:24.467308 26664 tablet_bootstrap.cc:492] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:24.471125 26663 tablet_bootstrap.cc:492] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:24.471799 26663 ts_tablet_manager.cc:1403] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.000s
I20260709 12:09:24.473771 26687 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.474280 26687 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.476325 26687 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:24.476068 26978 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.475006 26663 raft_consensus.cc:359] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.477937 26663 raft_consensus.cc:385] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.478215 26663 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.488859 26663 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.478574 26978 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:24.479842 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:24.491047 26662 tablet_bootstrap.cc:492] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:24.491329 26615 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:24.491668 26662 ts_tablet_manager.cc:1403] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.009s
I20260709 12:09:24.482313 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:24.480659 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:24.482949 26664 tablet_bootstrap.cc:654] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.484086 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:24.492694 26514 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:24.493212 26663 ts_tablet_manager.cc:1434] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:09:24.493952 26473 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:24.494202 26687 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.494633 26687 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.493474 26543 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:24.495440 26439 leader_election.cc:343] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.494943 26687 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.496209 26662 raft_consensus.cc:359] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.496945 26662 raft_consensus.cc:385] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.497208 26662 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.498188 26663 tablet_bootstrap.cc:492] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:24.500013 26662 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.506639 26662 ts_tablet_manager.cc:1434] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:09:24.513108 26662 tablet_bootstrap.cc:492] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:24.521718 26543 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:24.528900 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:24.530056 26662 tablet_bootstrap.cc:654] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.530376 26978 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.531077 26978 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:24.531764 26663 tablet_bootstrap.cc:654] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.528381 26687 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.535573 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:24.536161 26473 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.540654 26617 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.546000 26983 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.550685 26663 tablet_bootstrap.cc:492] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:24.551580 26663 ts_tablet_manager.cc:1403] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.000s
I20260709 12:09:24.554510 26983 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.555228 26983 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.557989 26473 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:24.558851 26983 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:24.559192 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:24.559976 26471 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:24.559194 26513 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:24.562774 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:24.563071 26513 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:24.563522 26616 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:24.563843 26982 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.532876 26978 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.564632 26615 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.565390 26982 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.565966 26982 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:24.566879 26982 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.567466 26687 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:24.568011 26687 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.568296 26687 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.568562 26687 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.575358 26663 raft_consensus.cc:359] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.576246 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:24.576962 26622 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.578828 26662 tablet_bootstrap.cc:492] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:24.579324 26662 ts_tablet_manager.cc:1403] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.022s
I20260709 12:09:24.584769 26687 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.586704 26687 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:24.588110 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:24.588747 26617 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.592730 26662 raft_consensus.cc:359] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.593680 26662 raft_consensus.cc:385] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.593331 26370 catalog_manager.cc:5697] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 0 to 1, leader changed from <none> to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.594118 26662 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.594710 26668 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.595204 26668 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.597193 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:24.597839 26668 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:24.597906 26473 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.601905 26622 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:24.595888 26617 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:24.604656 26664 tablet_bootstrap.cc:492] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:24.604773 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:24.605413 26664 ts_tablet_manager.cc:1403] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.138s	user 0.012s	sys 0.004s
I20260709 12:09:24.606230 26514 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:09:24.606472 26439 leader_election.cc:343] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.608660 26981 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.609220 26981 raft_consensus.cc:697] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:24.610381 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:24.610531 26981 consensus_queue.cc:237] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.576288 26663 raft_consensus.cc:385] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.611783 26663 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
W20260709 12:09:24.613052 26438 leader_election.cc:343] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.595399 26662 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.616189 26438 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:24.626057 26662 ts_tablet_manager.cc:1434] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.001s
I20260709 12:09:24.628721 26943 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.630992 26978 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.631505 26978 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.615023 26473 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:24.614876 26663 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.640857 26663 ts_tablet_manager.cc:1434] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.000s
I20260709 12:09:24.641877 26663 tablet_bootstrap.cc:492] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b: Bootstrap starting.
I20260709 12:09:24.644402 26730 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.644937 26662 tablet_bootstrap.cc:492] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:24.644968 26730 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.651274 26664 raft_consensus.cc:359] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.652525 26664 raft_consensus.cc:385] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.652912 26664 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.664772 26664 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.675698 26730 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:24.707851 26662 tablet_bootstrap.cc:654] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.710188 26664 ts_tablet_manager.cc:1434] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.104s	user 0.006s	sys 0.005s
I20260709 12:09:24.712941 26668 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.713673 26668 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.715672 26690 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.717366 26690 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.728878 26668 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:24.751001 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:09:24.758553 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 54986.6us
I20260709 12:09:24.804991 26664 tablet_bootstrap.cc:492] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:24.806707 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:24.811175 26690 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:24.811751 26690 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:24.813462 26439 leader_election.cc:343] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.819214 26730 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.819722 26730 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.842629 26730 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:24.811029 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:09:24.845137 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 109999us
I20260709 12:09:24.843962 26367 catalog_manager.cc:5697] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.798137 27029 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260709 12:09:24.845009 26617 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.871830 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:24.872633 26473 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
W20260709 12:09:24.878991 27026 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:09:24.880153 26470 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 1: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:24.890741 26663 tablet_bootstrap.cc:654] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.854971 26978 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:24.956454 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:24.960172 26860 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.965060 26860 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.967962 26982 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.968658 26982 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:24.969453 26860 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:24.971095 26982 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:24.974146 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:25.026216 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:25.027814 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:25.043111 26615 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.047956 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:25.051288 26664 tablet_bootstrap.cc:654] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.053785 26587 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:25.064677 26730 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:25.072623 26514 consensus_peers.cc:597] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:25.081192 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:25.092295 26438 leader_election.cc:343] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.094357 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:25.096125 26668 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:25.096460 26438 leader_election.cc:343] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.100620 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:25.085065 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:25.111565 26663 tablet_bootstrap.cc:492] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b: No bootstrap required, opened a new log
I20260709 12:09:25.112124 26663 ts_tablet_manager.cc:1403] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b: Time spent bootstrapping tablet: real 0.470s	user 0.024s	sys 0.017s
W20260709 12:09:25.116477 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 49769.2us
W20260709 12:09:25.119917 26514 leader_election.cc:343] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:25.125047 26514 leader_election.cc:343] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:25.135916 26438 leader_election.cc:343] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.139782 26663 raft_consensus.cc:359] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.140497 26663 raft_consensus.cc:385] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.140790 26663 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.148674 26662 tablet_bootstrap.cc:492] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:25.149240 26662 ts_tablet_manager.cc:1403] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.505s	user 0.033s	sys 0.014s
I20260709 12:09:25.164824 27047 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:25.175107 26514 consensus_peers.cc:597] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:25.186777 27032 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.201498 26664 tablet_bootstrap.cc:492] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:25.202148 26664 ts_tablet_manager.cc:1403] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.397s	user 0.018s	sys 0.013s
I20260709 12:09:25.200527 26662 raft_consensus.cc:359] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.204448 26662 raft_consensus.cc:385] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.204867 26662 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.206887 26662 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.212186 26662 ts_tablet_manager.cc:1434] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.003s
I20260709 12:09:25.213176 26662 tablet_bootstrap.cc:492] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:25.213534 26664 raft_consensus.cc:359] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.214995 26664 raft_consensus.cc:385] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.215353 26664 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.216131 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:25.218163 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:25.216171 26664 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.220534 26664 ts_tablet_manager.cc:1434] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:09:25.221539 26664 tablet_bootstrap.cc:492] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:25.225381 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:25.227283 26662 tablet_bootstrap.cc:654] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.226087 26467 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:25.230950 26664 tablet_bootstrap.cc:654] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.236634 26616 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.218282 26620 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.244606 26663 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.244058 26861 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 12:09:25.236677 26439 leader_election.cc:343] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.249032 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:09:25.250787 26439 leader_election.cc:343] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.251209 26439 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:25.251888 27047 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.256469 26663 ts_tablet_manager.cc:1434] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b: Time spent starting tablet: real 0.144s	user 0.006s	sys 0.005s
I20260709 12:09:25.264210 26978 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.271257 26370 catalog_manager.cc:5697] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.275924 27037 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.290609 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:25.295166 27035 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.295725 27035 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.296209 27035 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:25.301163 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 57022.1us
I20260709 12:09:25.319344 27040 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.332885 26662 tablet_bootstrap.cc:492] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:25.333127 26664 tablet_bootstrap.cc:492] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:25.333580 26662 ts_tablet_manager.cc:1403] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.121s	user 0.025s	sys 0.065s
I20260709 12:09:25.333810 26664 ts_tablet_manager.cc:1403] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.112s	user 0.011s	sys 0.004s
I20260709 12:09:25.338619 26662 raft_consensus.cc:359] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.339345 26662 raft_consensus.cc:385] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.339633 26662 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.341260 26981 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.341372 26662 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.341792 26664 raft_consensus.cc:359] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.343062 26664 raft_consensus.cc:385] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.343401 26664 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.347050 26664 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.348920 27035 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.352013 27035 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:25.394966 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 54980.4us
W20260709 12:09:25.398998 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 103164us
I20260709 12:09:25.413668 26664 ts_tablet_manager.cc:1434] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.079s	user 0.005s	sys 0.004s
W20260709 12:09:25.415927 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 73369.6us
I20260709 12:09:25.418814 26662 ts_tablet_manager.cc:1434] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.082s	user 0.006s	sys 0.003s
I20260709 12:09:25.397939 26513 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:09:25.452381 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 54733.1us
I20260709 12:09:25.440307 26664 tablet_bootstrap.cc:492] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:25.459074 27029 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.459911 27029 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.460417 27029 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.448726 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:25.477701 26877 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.482291 26664 tablet_bootstrap.cc:654] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.484385 27052 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.485159 27052 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:25.492470 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 90291.9us
I20260709 12:09:25.494438 27052 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:25.495646 26978 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.504705 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:09:25.509150 26514 leader_election.cc:343] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.512626 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:25.514967 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:25.518298 26662 tablet_bootstrap.cc:492] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:25.518909 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:25.521272 27049 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.513592 26471 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.540568 27040 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.541000 26981 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.541154 27040 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.545193 27040 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:25.547528 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:25.584546 26514 leader_election.cc:343] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.586637 26471 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:25.620981 26877 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.621730 26877 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.625689 26877 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:25.632198 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:25.640949 27064 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.657200 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:25.662144 26662 tablet_bootstrap.cc:654] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.650882 27064 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.661495 27029 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:25.666293 26514 leader_election.cc:343] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.688253 27039 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:25.730413 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 54428.3us
W20260709 12:09:25.734943 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 60781.4us
I20260709 12:09:25.753448 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:25.754477 26467 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:25.765090 26513 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:25.766903 26982 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.743466 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:25.767344 26982 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.767748 26982 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.767817 26471 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:25.735739 27039 raft_consensus.cc:697] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:25.781575 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:25.781356 27064 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:25.806231 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:25.796262 27029 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:25.830344 26861 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.830892 26861 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:25.833312 26438 leader_election.cc:343] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.831264 26861 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:25.851894 27070 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:09:25.852105 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:25.850556 27039 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.865967 26664 tablet_bootstrap.cc:492] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
W20260709 12:09:25.865535 26439 leader_election.cc:343] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.895965 26664 ts_tablet_manager.cc:1403] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.456s	user 0.018s	sys 0.024s
I20260709 12:09:25.884043 26439 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:25.901723 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:25.902792 26464 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.901774 26860 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.907383 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:25.911468 26861 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.912985 26664 raft_consensus.cc:359] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.913759 26664 raft_consensus.cc:385] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.915791 26664 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
W20260709 12:09:25.917651 26419 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:25.919176 26621 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.913733 26861 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:25.924880 26662 tablet_bootstrap.cc:492] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:25.925431 26662 ts_tablet_manager.cc:1403] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.408s	user 0.021s	sys 0.008s
I20260709 12:09:25.933578 26664 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.936822 26664 ts_tablet_manager.cc:1434] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.002s
I20260709 12:09:25.937978 26664 tablet_bootstrap.cc:492] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:25.941380 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:09:25.942571 26514 leader_election.cc:343] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.955022 26982 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.955021 26662 raft_consensus.cc:359] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.958884 26662 raft_consensus.cc:385] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.959174 26662 raft_consensus.cc:740] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.959914 26662 consensus_queue.cc:260] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:25.961622 26662 ts_tablet_manager.cc:1434] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
W20260709 12:09:25.957242 26514 leader_election.cc:343] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.967972 26982 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:25.973541 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:25.973915 26662 tablet_bootstrap.cc:492] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:25.974252 26466 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.973532 26664 tablet_bootstrap.cc:654] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.978741 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:25.979461 26465 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.986038 26618 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.986192 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:25.987143 26464 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
W20260709 12:09:25.989763 26514 leader_election.cc:343] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.016144 26513 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:26.018977 26367 catalog_manager.cc:5697] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.017901 26466 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:26.023138 26513 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:26.024585 27039 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.025111 27039 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:26.026031 27039 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.026823 26662 tablet_bootstrap.cc:654] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.024398 26465 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:26.027200 26687 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.032820 26687 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:26.033824 26687 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.035724 26664 tablet_bootstrap.cc:492] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:26.036253 26664 ts_tablet_manager.cc:1403] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.099s	user 0.010s	sys 0.003s
I20260709 12:09:26.048806 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:26.056201 26982 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.061434 26982 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:26.060891 26664 raft_consensus.cc:359] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.062036 26664 raft_consensus.cc:385] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.062321 26664 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.062359 26982 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.064700 26662 tablet_bootstrap.cc:492] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:26.065896 26662 ts_tablet_manager.cc:1403] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.096s	user 0.020s	sys 0.006s
I20260709 12:09:26.071213 26664 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.104319 26664 ts_tablet_manager.cc:1434] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 12:09:26.107398 26662 raft_consensus.cc:359] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.108472 26662 raft_consensus.cc:385] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.108834 26662 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.109720 26662 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.114253 26662 ts_tablet_manager.cc:1434] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 12:09:26.115332 26662 tablet_bootstrap.cc:492] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:26.122745 26664 tablet_bootstrap.cc:492] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Bootstrap starting.
I20260709 12:09:26.139532 26662 tablet_bootstrap.cc:654] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.163203 26664 tablet_bootstrap.cc:654] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.171542 26664 tablet_bootstrap.cc:492] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: No bootstrap required, opened a new log
I20260709 12:09:26.172079 26664 ts_tablet_manager.cc:1403] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.002s
I20260709 12:09:26.174973 26664 raft_consensus.cc:359] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.175704 26664 raft_consensus.cc:385] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.176007 26664 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.176824 26664 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.179967 26664 ts_tablet_manager.cc:1434] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:09:26.181855 26662 tablet_bootstrap.cc:492] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:26.182418 26662 ts_tablet_manager.cc:1403] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.067s	user 0.008s	sys 0.013s
I20260709 12:09:26.186005 26662 raft_consensus.cc:359] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.186769 26662 raft_consensus.cc:385] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.187071 26662 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.187763 26662 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.190047 26687 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.191030 26687 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.192937 26687 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:26.194182 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:26.194871 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:26.190059 26662 ts_tablet_manager.cc:1434] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
W20260709 12:09:26.197065 26514 leader_election.cc:343] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.198017 26662 tablet_bootstrap.cc:492] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:26.195664 26465 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:26.199395 26513 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:26.200572 27039 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.200955 27039 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.201332 27039 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.204847 26662 tablet_bootstrap.cc:654] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.202322 26369 catalog_manager.cc:5697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.209594 26982 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.210155 26982 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.210630 26369 catalog_manager.cc:5697] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.213165 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:26.212921 26369 catalog_manager.cc:5697] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.213901 26465 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:26.215443 26513 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:26.216382 27075 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.216774 27075 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.217161 27075 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.227532 27039 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.226262 26982 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:26.225016 27075 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.229641 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:26.232044 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:26.232738 26465 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:26.232717 26514 leader_election.cc:343] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.243988 27049 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.244526 27049 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.246830 27049 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:26.247869 27039 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:26.248383 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:26.248919 27075 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:26.249048 26464 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.249101 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:26.249691 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:26.250041 26466 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 1: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:26.251672 26465 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:26.252492 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:26.253773 27051 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.255088 26513 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:26.255964 27075 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.256448 27075 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:26.256539 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:26.256762 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:26.257366 27075 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.261032 27051 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:26.263346 26514 leader_election.cc:343] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:26.264077 26514 leader_election.cc:343] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.266916 26662 tablet_bootstrap.cc:492] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:26.267491 26662 ts_tablet_manager.cc:1403] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.070s	user 0.027s	sys 0.013s
I20260709 12:09:26.272061 26662 raft_consensus.cc:359] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.272874 26662 raft_consensus.cc:385] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.273221 26662 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.274039 26662 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.274044 26464 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:26.276638 26662 ts_tablet_manager.cc:1434] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 12:09:26.278236 26662 tablet_bootstrap.cc:492] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:26.279314 26513 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:26.281306 27039 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.281850 27039 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:26.282816 27039 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.285040 26662 tablet_bootstrap.cc:654] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.297534 26662 tablet_bootstrap.cc:492] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:26.298153 26662 ts_tablet_manager.cc:1403] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:09:26.300971 26662 raft_consensus.cc:359] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.301870 26662 raft_consensus.cc:385] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.302210 26662 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.303275 26982 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.305001 26982 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.304340 26662 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.307852 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:26.308156 26662 ts_tablet_manager.cc:1434] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:09:26.308115 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:26.308525 26465 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:26.308840 26982 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:26.309618 26662 tablet_bootstrap.cc:492] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:26.309897 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:26.310670 26982 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.311093 26982 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.311411 26982 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.316987 26662 tablet_bootstrap.cc:654] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.318301 26620 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 0.
I20260709 12:09:26.313014 26370 catalog_manager.cc:5697] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.320474 26370 catalog_manager.cc:5697] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.322278 26982 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.324292 26982 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:26.325655 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:26.326242 26465 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.329181 26662 tablet_bootstrap.cc:492] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:26.329663 26662 ts_tablet_manager.cc:1403] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 12:09:26.334379 26465 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:26.332414 26662 raft_consensus.cc:359] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.335798 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:26.336839 26982 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.337317 26982 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:26.338049 26982 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.338760 26662 raft_consensus.cc:385] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.340121 26662 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.340816 26662 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.343503 27039 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.344326 26662 ts_tablet_manager.cc:1434] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:09:26.345369 26662 tablet_bootstrap.cc:492] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:26.353921 26662 tablet_bootstrap.cc:654] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.355387 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:26.356081 26620 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.361770 26662 tablet_bootstrap.cc:492] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:26.362296 26662 ts_tablet_manager.cc:1403] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.001s
W20260709 12:09:26.363807 26514 consensus_peers.cc:597] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:26.365123 26662 raft_consensus.cc:359] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.365823 26662 raft_consensus.cc:385] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.366086 26662 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.366868 26662 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.369231 26662 ts_tablet_manager.cc:1434] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:26.374115 26662 tablet_bootstrap.cc:492] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:26.378716 26620 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:26.380553 26662 tablet_bootstrap.cc:654] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.411489 26621 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.416641 26662 tablet_bootstrap.cc:492] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:26.417162 26662 ts_tablet_manager.cc:1403] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.043s	user 0.020s	sys 0.020s
I20260709 12:09:26.419922 26662 raft_consensus.cc:359] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.420639 26662 raft_consensus.cc:385] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.420894 26662 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.421514 26662 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.423736 26662 ts_tablet_manager.cc:1434] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:09:26.425493 26662 tablet_bootstrap.cc:492] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Bootstrap starting.
I20260709 12:09:26.431814 26662 tablet_bootstrap.cc:654] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.450209 26662 tablet_bootstrap.cc:492] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: No bootstrap required, opened a new log
I20260709 12:09:26.450820 26662 ts_tablet_manager.cc:1403] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.000s
I20260709 12:09:26.452703 26369 catalog_manager.cc:5697] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.455749 26662 raft_consensus.cc:359] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.456547 26662 raft_consensus.cc:385] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.456811 26662 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.457608 26662 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.463989 26662 ts_tablet_manager.cc:1434] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:09:26.534610 27039 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.545686 26621 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.559901 27035 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.615079 27049 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.615624 27049 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.617059 27035 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.617664 27049 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:26.618240 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:26.618883 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:26.619108 26466 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 1: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:26.620641 26587 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:26.621444 27049 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.629457 27049 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.634652 27039 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.647513 27039 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.659637 27039 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.661242 27039 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.667263 26620 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.679239 27051 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.679927 27051 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.698263 27075 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.702935 27051 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:26.704810 27049 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.705328 27049 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.708957 27049 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:26.713202 27035 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.725364 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:26.732178 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:26.734114 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:26.736080 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:26.748359 26621 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.755160 27115 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.755741 27115 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:26.758423 27115 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:26.762676 27035 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:26.769145 27113 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.072s	user 0.004s	sys 0.000s
I20260709 12:09:26.777027 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:26.777782 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:26.779099 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:26.779294 27049 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:26.789379 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:26.790252 27049 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.799023 26587 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:26.801007 27049 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.837378 26618 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.844316 27035 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.847296 27040 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.878132 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:26.936558 27122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:26.936775 27123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:26.938040 27125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:26.938346 25293 server_base.cc:1061] running on GCE node
I20260709 12:09:26.941812 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:26.942165 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:26.942457 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783598966942437 us; error 0 us; skew 500 ppm
I20260709 12:09:26.943346 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:26.963907 25293 webserver.cc:533] Webserver started at http://127.24.179.68:42975/ using document root <none> and password file <none>
I20260709 12:09:26.964730 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:26.965058 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:26.965572 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:26.967425 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-3-root/instance:
uuid: "3262bf0553e543eea76794fc529a9acc"
format_stamp: "Formatted at 2026-07-09 12:09:26 on dist-test-slave-tjfs"
I20260709 12:09:26.975278 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.001s	sys 0.004s
I20260709 12:09:26.979626 27130 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:26.981040 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:09:26.981405 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-3-root
uuid: "3262bf0553e543eea76794fc529a9acc"
format_stamp: "Formatted at 2026-07-09 12:09:26 on dist-test-slave-tjfs"
I20260709 12:09:26.981760 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:27.009444 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:27.010918 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:27.012709 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:27.015210 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:27.015417 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:27.015758 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:27.015944 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:27.133396 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.68:35069
I20260709 12:09:27.133504 27192 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.68:35069 every 8 connection(s)
I20260709 12:09:27.139384 25293 auto_leader_rebalancer-test.cc:439] add a tserver: 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:27.155088 27193 heartbeater.cc:344] Connected to a master server at 127.24.179.126:41797
I20260709 12:09:27.155588 27193 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:27.156572 27193 heartbeater.cc:507] Master 127.24.179.126:41797 requested a full tablet report, sending...
I20260709 12:09:27.160554 26367 ts_manager.cc:194] Registered new tserver with Master: 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:27.162285 26367 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39184
I20260709 12:09:28.065464 26620 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:28.074715 26465 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:28.074715 26543 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:28.077807 27115 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:28.079013 27049 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:28.093477 27115 raft_consensus.cc:2955] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:28.100247 26543 raft_consensus.cc:2955] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:28.108165 26468 raft_consensus.cc:2955] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
W20260709 12:09:28.113934 26588 consensus_peers.cc:597] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff21e283775e459c8757d4d1c245c531. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:28.135049 26367 catalog_manager.cc:5697] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.141897 26543 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:28.164816 27193 heartbeater.cc:499] Master 127.24.179.126:41797 was elected leader, sending a full tablet report...
I20260709 12:09:28.168021 26465 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:28.169576 27039 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:28.176126 26620 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:28.179809 27080 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:28.309509 26514 consensus_peers.cc:597] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8036dd24c55a4bc18661cc64c049a704. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:28.286953 27080 raft_consensus.cc:2955] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:28.341715 26613 raft_consensus.cc:2955] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:28.348722 26465 raft_consensus.cc:2955] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:28.356149 26370 catalog_manager.cc:5697] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.389039 26465 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:28.399757 26543 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:28.401317 27047 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:28.403026 26613 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:28.404904 27047 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:28.416326 26439 consensus_peers.cc:597] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 799bbccef316451b8fb8dbd051728db0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:28.418460 27221 raft_consensus.cc:2955] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:28.420307 26547 raft_consensus.cc:2955] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:28.421278 26613 raft_consensus.cc:2955] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:28.441576 26543 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:28.441576 26369 catalog_manager.cc:5697] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:28.473591 26465 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:28.474020 26514 consensus_peers.cc:597] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 94f480c16e1e4f31abd8773ea56f244b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:28.475689 27214 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:28.479691 26613 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:28.481985 27214 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:28.485157 27218 raft_consensus.cc:2955] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:28.487233 26464 raft_consensus.cc:2955] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:28.510931 26369 catalog_manager.cc:5697] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.495848 26613 raft_consensus.cc:2955] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:28.642578 27232 ts_tablet_manager.cc:933] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:28.645491 27232 tablet_copy_client.cc:323] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.66:40567
I20260709 12:09:28.680352 27236 ts_tablet_manager.cc:933] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:28.687071 27236 tablet_copy_client.cc:323] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.67:42217
I20260709 12:09:28.693060 26558 tablet_copy_service.cc:140] P ac3ac2181aa941229a758ccf6b5607cd: Received BeginTabletCopySession request for tablet 8036dd24c55a4bc18661cc64c049a704 from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:44706)
I20260709 12:09:28.693780 26558 tablet_copy_service.cc:161] P ac3ac2181aa941229a758ccf6b5607cd: Beginning new tablet copy session on tablet 8036dd24c55a4bc18661cc64c049a704 from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:44706: session id = 3262bf0553e543eea76794fc529a9acc-8036dd24c55a4bc18661cc64c049a704
I20260709 12:09:28.705550 26558 tablet_copy_source_session.cc:215] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:28.706923 26632 tablet_copy_service.cc:140] P aaadfdd9ca9f424c91505f9b43876233: Received BeginTabletCopySession request for tablet ff21e283775e459c8757d4d1c245c531 from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:48232)
I20260709 12:09:28.707628 26632 tablet_copy_service.cc:161] P aaadfdd9ca9f424c91505f9b43876233: Beginning new tablet copy session on tablet ff21e283775e459c8757d4d1c245c531 from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:48232: session id = 3262bf0553e543eea76794fc529a9acc-ff21e283775e459c8757d4d1c245c531
I20260709 12:09:28.711002 27232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8036dd24c55a4bc18661cc64c049a704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:28.716885 26632 tablet_copy_source_session.cc:215] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:28.721027 27236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff21e283775e459c8757d4d1c245c531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:28.744721 27232 tablet_copy_client.cc:806] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:28.747264 27232 tablet_copy_client.cc:670] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:28.747939 27236 tablet_copy_client.cc:806] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:28.748584 27236 tablet_copy_client.cc:670] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:28.753474 27236 tablet_copy_client.cc:538] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:28.760561 27232 tablet_copy_client.cc:538] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:28.763939 27236 tablet_bootstrap.cc:492] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:09:28.776659 27232 tablet_bootstrap.cc:492] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:09:28.814234 27236 tablet_bootstrap.cc:492] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:28.815824 27236 tablet_bootstrap.cc:492] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:09:28.816577 27236 ts_tablet_manager.cc:1403] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.011s
I20260709 12:09:28.820282 27236 raft_consensus.cc:359] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:28.821194 27236 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:09:28.821920 27236 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:28.823563 27232 tablet_bootstrap.cc:492] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:28.824788 27232 tablet_bootstrap.cc:492] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:09:28.825517 27232 ts_tablet_manager.cc:1403] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.049s	user 0.023s	sys 0.009s
I20260709 12:09:28.828609 27232 raft_consensus.cc:359] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:28.829438 27232 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:09:28.830053 27232 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:28.835856 27236 ts_tablet_manager.cc:1434] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 12:09:28.837949 26632 tablet_copy_service.cc:342] P aaadfdd9ca9f424c91505f9b43876233: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-ff21e283775e459c8757d4d1c245c531 received from {username='slave'} at 127.0.0.1:48232
I20260709 12:09:28.838575 26632 tablet_copy_service.cc:434] P aaadfdd9ca9f424c91505f9b43876233: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-ff21e283775e459c8757d4d1c245c531 on tablet ff21e283775e459c8757d4d1c245c531 with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:28.840425 27232 ts_tablet_manager.cc:1434] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:09:28.844098 26558 tablet_copy_service.cc:342] P ac3ac2181aa941229a758ccf6b5607cd: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-8036dd24c55a4bc18661cc64c049a704 received from {username='slave'} at 127.0.0.1:44706
I20260709 12:09:28.844645 26558 tablet_copy_service.cc:434] P ac3ac2181aa941229a758ccf6b5607cd: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-8036dd24c55a4bc18661cc64c049a704 on tablet 8036dd24c55a4bc18661cc64c049a704 with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:28.934911 27232 ts_tablet_manager.cc:933] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149)
I20260709 12:09:28.937244 27232 tablet_copy_client.cc:323] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.65:45149
I20260709 12:09:28.961887 26483 tablet_copy_service.cc:140] P 01a57027214a411e80874ac7febd628b: Received BeginTabletCopySession request for tablet 799bbccef316451b8fb8dbd051728db0 from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:54414)
I20260709 12:09:28.962574 26483 tablet_copy_service.cc:161] P 01a57027214a411e80874ac7febd628b: Beginning new tablet copy session on tablet 799bbccef316451b8fb8dbd051728db0 from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:54414: session id = 3262bf0553e543eea76794fc529a9acc-799bbccef316451b8fb8dbd051728db0
I20260709 12:09:28.970521 26483 tablet_copy_source_session.cc:215] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:28.973788 27232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 799bbccef316451b8fb8dbd051728db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:28.986539 27232 tablet_copy_client.cc:806] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:28.987159 27232 tablet_copy_client.cc:670] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:28.995230 27232 tablet_copy_client.cc:538] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:29.010685 27232 tablet_bootstrap.cc:492] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:09:29.027599 27232 tablet_bootstrap.cc:492] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:29.029383 27232 tablet_bootstrap.cc:492] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:09:29.030138 27232 ts_tablet_manager.cc:1403] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:09:29.033915 27232 raft_consensus.cc:359] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:29.034814 27232 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:09:29.035517 27232 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:29.037375 27232 ts_tablet_manager.cc:1434] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:09:29.048192 26483 tablet_copy_service.cc:342] P 01a57027214a411e80874ac7febd628b: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-799bbccef316451b8fb8dbd051728db0 received from {username='slave'} at 127.0.0.1:54414
I20260709 12:09:29.048732 26483 tablet_copy_service.cc:434] P 01a57027214a411e80874ac7febd628b: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-799bbccef316451b8fb8dbd051728db0 on tablet 799bbccef316451b8fb8dbd051728db0 with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:29.053973 27232 ts_tablet_manager.cc:933] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:29.057374 27232 tablet_copy_client.cc:323] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.66:40567
I20260709 12:09:29.059329 26558 tablet_copy_service.cc:140] P ac3ac2181aa941229a758ccf6b5607cd: Received BeginTabletCopySession request for tablet 94f480c16e1e4f31abd8773ea56f244b from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:44706)
I20260709 12:09:29.059934 26558 tablet_copy_service.cc:161] P ac3ac2181aa941229a758ccf6b5607cd: Beginning new tablet copy session on tablet 94f480c16e1e4f31abd8773ea56f244b from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:44706: session id = 3262bf0553e543eea76794fc529a9acc-94f480c16e1e4f31abd8773ea56f244b
I20260709 12:09:29.070209 26558 tablet_copy_source_session.cc:215] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:29.073868 27232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94f480c16e1e4f31abd8773ea56f244b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:29.092132 27232 tablet_copy_client.cc:806] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:29.092734 27232 tablet_copy_client.cc:670] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:29.096863 27232 tablet_copy_client.cc:538] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:29.105758 27232 tablet_bootstrap.cc:492] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:09:29.125288 27232 tablet_bootstrap.cc:492] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:29.126142 27232 tablet_bootstrap.cc:492] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:09:29.126819 27232 ts_tablet_manager.cc:1403] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.021s	user 0.022s	sys 0.000s
I20260709 12:09:29.129536 27232 raft_consensus.cc:359] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:29.130324 27232 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:09:29.130937 27232 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:29.133025 27232 ts_tablet_manager.cc:1434] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:29.134796 26558 tablet_copy_service.cc:342] P ac3ac2181aa941229a758ccf6b5607cd: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-94f480c16e1e4f31abd8773ea56f244b received from {username='slave'} at 127.0.0.1:44706
I20260709 12:09:29.135290 26558 tablet_copy_service.cc:434] P ac3ac2181aa941229a758ccf6b5607cd: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-94f480c16e1e4f31abd8773ea56f244b on tablet 94f480c16e1e4f31abd8773ea56f244b with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:29.178634 27168 raft_consensus.cc:1217] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:29.205430 27168 raft_consensus.cc:1217] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:29.492537 27168 raft_consensus.cc:1217] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:29.552069 27168 raft_consensus.cc:1217] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:29.649390 27220 raft_consensus.cc:1064] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:09:29.652190 27220 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:29.662108 27168 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.663156 26615 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.663856 27218 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:29.665463 26464 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.668026 27214 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:29.669935 27220 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:29.693640 27218 raft_consensus.cc:2955] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:29.696444 26615 raft_consensus.cc:2955] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:29.696444 26464 raft_consensus.cc:2955] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:29.708102 27168 raft_consensus.cc:2955] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:29.715829 26367 catalog_manager.cc:5697] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:29.759799 27200 raft_consensus.cc:1064] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:09:29.762825 27200 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:29.777595 26547 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:29.784399 26468 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.786422 27168 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.787719 27220 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:29.788738 27219 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:29.797199 27218 raft_consensus.cc:2955] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:29.800277 26468 raft_consensus.cc:2955] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:29.808077 27168 raft_consensus.cc:2955] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:29.827752 26357 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8036dd24c55a4bc18661cc64c049a704 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:29.835079 27167 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.836323 26371 catalog_manager.cc:5697] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b reported cstate change: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:29.836869 27248 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:29.841542 26468 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.844563 27260 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:29.851047 26547 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.855290 27248 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:29.862679 26609 tablet_service.cc:1558] Processing DeleteTablet for tablet 8036dd24c55a4bc18661cc64c049a704 with delete_type TABLET_DATA_TOMBSTONED (TS aaadfdd9ca9f424c91505f9b43876233 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54638
I20260709 12:09:29.883450 27248 raft_consensus.cc:2955] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:29.889675 27263 tablet_replica.cc:333] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:09:29.892061 27263 raft_consensus.cc:2243] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:29.894987 27263 raft_consensus.cc:2272] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:29.894412 26464 raft_consensus.cc:2955] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:29.906026 27263 ts_tablet_manager.cc:1916] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:29.915235 26544 raft_consensus.cc:2955] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:29.922837 27168 raft_consensus.cc:2955] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:29.931942 26371 catalog_manager.cc:5697] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:29.955017 27263 ts_tablet_manager.cc:1929] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:29.955641 27263 log.cc:1199] T 8036dd24c55a4bc18661cc64c049a704 P aaadfdd9ca9f424c91505f9b43876233: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-2-root/wals/8036dd24c55a4bc18661cc64c049a704
I20260709 12:09:29.957505 26358 catalog_manager.cc:5028] TS aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): tablet 8036dd24c55a4bc18661cc64c049a704 (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:09:29.960819 26613 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:29.962078 27220 raft_consensus.cc:1064] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:09:29.964708 27220 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:29.968948 27168 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.968983 26543 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.970652 27260 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:29.971899 27200 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:29.983753 27248 raft_consensus.cc:2955] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:29.985200 27168 raft_consensus.cc:2955] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:29.986497 26544 raft_consensus.cc:2955] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:29.998828 27221 raft_consensus.cc:1064] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:09:30.005105 26371 catalog_manager.cc:5697] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 3 to 4, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:30.007613 26358 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff21e283775e459c8757d4d1c245c531 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:30.001564 27221 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:30.020942 26455 tablet_service.cc:1558] Processing DeleteTablet for tablet ff21e283775e459c8757d4d1c245c531 with delete_type TABLET_DATA_TOMBSTONED (TS 01a57027214a411e80874ac7febd628b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43588
I20260709 12:09:30.022245 27168 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:30.023869 26468 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:30.025451 27219 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:30.026211 26615 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:30.029336 27219 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:30.031644 27214 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:30.064647 27267 tablet_replica.cc:333] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:09:30.070780 27267 raft_consensus.cc:2243] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:30.073607 27267 raft_consensus.cc:2272] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:30.078699 27267 ts_tablet_manager.cc:1916] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:30.094125 27214 raft_consensus.cc:2955] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:30.096026 26465 raft_consensus.cc:2955] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:30.100003 27168 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:30.101574 26618 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:30.102730 27221 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:30.103732 27249 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:30.114154 26613 raft_consensus.cc:2955] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:30.116539 27267 ts_tablet_manager.cc:1929] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:30.117041 27267 log.cc:1199] T ff21e283775e459c8757d4d1c245c531 P 01a57027214a411e80874ac7febd628b: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-0-root/wals/ff21e283775e459c8757d4d1c245c531
I20260709 12:09:30.124855 26367 catalog_manager.cc:5697] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b reported cstate change: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:30.131743 26544 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:30.142130 26357 catalog_manager.cc:5028] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): tablet ff21e283775e459c8757d4d1c245c531 (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:09:30.143625 27249 raft_consensus.cc:2955] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:30.150233 27047 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:30.156769 27168 raft_consensus.cc:2955] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:30.171271 26547 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:30.172681 26613 raft_consensus.cc:2955] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:30.185161 26544 raft_consensus.cc:2955] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:30.192205 26468 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:30.194558 27219 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:30.198357 27166 raft_consensus.cc:2955] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:30.205464 27218 raft_consensus.cc:2955] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:30.217684 26367 catalog_manager.cc:5697] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b reported cstate change: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:30.220278 26357 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 94f480c16e1e4f31abd8773ea56f244b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:30.226541 26369 catalog_manager.cc:5697] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:30.232580 26468 raft_consensus.cc:2955] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:30.236378 27167 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:30.240751 27219 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:30.258567 26609 tablet_service.cc:1558] Processing DeleteTablet for tablet 94f480c16e1e4f31abd8773ea56f244b with delete_type TABLET_DATA_TOMBSTONED (TS aaadfdd9ca9f424c91505f9b43876233 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54638
I20260709 12:09:30.259572 27263 tablet_replica.cc:333] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:09:30.260628 27263 raft_consensus.cc:2243] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:30.261337 27263 raft_consensus.cc:2272] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:30.265465 26465 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:30.274716 27166 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:30.277500 27263 ts_tablet_manager.cc:1916] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:30.295857 27168 raft_consensus.cc:2955] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:30.309708 26618 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:30.311787 27047 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:30.355368 27263 ts_tablet_manager.cc:1929] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:30.355970 27263 log.cc:1199] T 94f480c16e1e4f31abd8773ea56f244b P aaadfdd9ca9f424c91505f9b43876233: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-2-root/wals/94f480c16e1e4f31abd8773ea56f244b
I20260709 12:09:30.357890 26358 catalog_manager.cc:5028] TS aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): tablet 94f480c16e1e4f31abd8773ea56f244b (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:09:30.358031 27047 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:30.365482 27277 raft_consensus.cc:2955] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:30.367722 26618 raft_consensus.cc:2955] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:30.366724 27168 raft_consensus.cc:2955] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:30.383009 26370 catalog_manager.cc:5697] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 3 to 4, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:30.388659 26357 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 799bbccef316451b8fb8dbd051728db0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:30.396606 26532 tablet_service.cc:1558] Processing DeleteTablet for tablet 799bbccef316451b8fb8dbd051728db0 with delete_type TABLET_DATA_TOMBSTONED (TS ac3ac2181aa941229a758ccf6b5607cd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55084
I20260709 12:09:30.403568 27278 tablet_replica.cc:333] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:09:30.404717 27278 raft_consensus.cc:2243] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:30.405496 27278 raft_consensus.cc:2272] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:30.408353 27278 ts_tablet_manager.cc:1916] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:30.420357 27278 ts_tablet_manager.cc:1929] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:30.420728 27278 log.cc:1199] T 799bbccef316451b8fb8dbd051728db0 P ac3ac2181aa941229a758ccf6b5607cd: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-1-root/wals/799bbccef316451b8fb8dbd051728db0
I20260709 12:09:30.422686 26357 catalog_manager.cc:5028] TS ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): tablet 799bbccef316451b8fb8dbd051728db0 (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:09:32.291230 27249 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.292027 27249 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.295846 27249 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.408087 27249 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.409003 27249 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.412490 27249 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.587077 27249 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:32.589682 27249 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.588322 27279 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:32.592643 27279 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.595131 27279 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.595677 27279 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.596633 27249 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.597838 27279 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.599597 27249 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:32.600194 27249 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.600898 27279 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.602413 27249 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.604086 27249 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.609414 27249 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.607087 27281 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.611652 27281 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:32.614516 27281 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:32.617242 27249 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.621526 27249 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:32.622385 27249 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.623643 27281 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:32.624640 27281 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:32.625182 27249 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.627071 27281 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.627612 27279 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.627846 27280 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:32.628185 27279 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:32.628424 27280 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.630234 27279 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:32.630367 27249 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.630257 27283 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.631429 27249 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.635026 27282 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.635538 27282 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.637737 27282 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.631637 27283 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.630837 27279 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.638504 27279 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.638973 27280 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.640017 27283 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.642088 27279 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.648944 27285 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:32.649593 27285 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.653337 27283 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.654155 27283 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.656140 27279 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.656711 27279 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.657538 27283 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.653090 27285 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.658892 27279 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.661607 27283 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:32.664669 27283 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.639925 27249 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.666692 27280 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:32.708664 27280 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.712296 27280 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.668272 27283 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.719779 27285 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:32.720410 27285 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.671869 27290 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.694849 27281 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:32.722738 27249 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.702888 27282 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.703840 27286 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.724360 27218 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:32.723428 27281 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:32.734541 27218 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.737406 27296 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.738365 27296 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:32.737802 27218 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.741453 27288 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.741765 27286 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.742101 27288 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.743274 27297 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:32.744248 27296 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:32.747138 27290 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.753031 27285 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.733460 27283 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.762670 27283 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.763396 27281 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.751382 27290 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:32.735859 27282 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:32.723462 27249 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.793046 27294 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.792424 27047 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.793618 27294 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.771554 27283 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.766664 27280 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.803669 27218 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:32.805372 27218 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.795709 27047 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.759881 27297 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.816831 27218 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.797176 27291 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:32.822515 27282 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:32.823105 27282 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.823376 27249 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.823627 27282 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.842439 27047 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.843961 27299 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:32.844868 27299 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.816303 27280 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.849960 27288 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:32.856319 27301 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.861420 27292 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.858788 27290 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:32.824831 27291 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.858471 27286 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:32.863461 27292 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.867048 27290 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.868669 27299 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:32.872748 27293 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:32.873312 27293 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.870815 27308 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.872229 27294 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.877976 27306 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.879406 27306 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.873911 27290 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:32.881381 27284 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:32.877032 27282 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.865307 27301 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.882378 27291 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:32.885677 27280 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.889336 27289 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.878628 27292 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:32.889876 27289 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.891193 27284 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.881707 27308 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.897718 27308 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:32.898877 27306 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:32.895525 27293 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.894133 27288 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.900444 27288 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.901487 27297 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.903396 27288 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:32.907073 27291 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.914574 27304 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.915550 27309 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:32.914605 27291 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.924937 27282 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.925563 27282 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.926079 27289 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:32.927459 27301 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.928963 27291 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:32.929128 27282 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.941850 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:32.942806 26468 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:32.908332 27292 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:32.916234 27309 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.954550 27305 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:32.958740 27295 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:32.959225 27307 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:32.959437 27298 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:32.946537 27288 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:32.962231 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:32.953568 27279 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.953141 27292 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.915365 27304 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.965147 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:32.965243 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:32.968083 27300 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:32.969216 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:32.972069 27218 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:32.972792 27218 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.968873 27300 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.976473 27280 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.977310 27280 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.979872 27294 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.980713 27294 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.985450 27047 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:32.966789 27289 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.018203 27312 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.013017 27047 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.983139 27279 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.983850 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:32.983747 27293 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:32.964498 27288 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.983850 27301 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:32.962349 27295 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.026453 27302 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.034835 27047 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.035395 27047 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.035869 27047 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.037298 27291 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:33.022372 27218 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:32.987929 27249 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:32.987768 27298 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.037942 27299 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.045987 27291 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.049849 27249 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.050457 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:09:33.050527 27299 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.051201 27168 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:33.051865 27291 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.031386 27292 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.059845 27047 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.060702 27314 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.035847 27285 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:33.021116 27289 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.039319 27280 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.071592 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.086510 27300 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.042737 27306 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.087595 27295 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.052047 27249 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.077028 27285 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.046324 27308 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:33.089484 26468 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:33.018888 27312 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.038146 27293 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:32.970424 27305 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.059434 27290 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:33.042591 27301 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.088531 27218 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:33.097395 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:32.984455 27307 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:33.088310 27282 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.100383 27218 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.091099 27286 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.103207 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.093627 27291 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:33.098466 27287 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:33.094805 27297 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:33.106155 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:09:33.098126 27300 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:33.098798 27299 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.098706 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:09:33.099731 27292 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.047147 27302 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.095036 27306 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.109534 26547 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 1.
I20260709 12:09:33.114828 27218 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.098871 27308 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.157711 27218 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:33.091442 27314 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.099912 27295 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:33.159157 27218 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.166452 27298 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.167019 27312 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.167675 27317 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:33.167912 27218 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.102903 27282 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.102725 27290 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.164149 27319 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.102588 27286 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.117910 27313 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:33.103852 27303 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:33.164175 27315 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:33.108122 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.106917 27304 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.162791 27168 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:33.158432 27292 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.168226 27317 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.182265 27288 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.118487 27297 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.107409 27291 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.161378 27299 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:33.161046 27287 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.188125 27316 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:33.188436 27285 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.183323 27315 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.217669 27315 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.187384 27304 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.191287 27294 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.219933 27320 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.220319 27324 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.221035 27304 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.192783 27284 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.191578 27290 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.223104 27279 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.196203 26439 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:09:33.161393 27300 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.172726 27319 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.169699 27295 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.193890 27303 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.220979 27324 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.220760 27320 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.222496 27322 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:33.265559 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.193324 27286 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.202788 27317 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:33.222726 27315 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:33.194265 27309 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.212283 27288 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.264194 27292 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.252977 27283 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.267803 27288 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.268065 27283 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.269037 27295 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.269940 27288 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.214381 27299 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.186753 27313 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.246685 27294 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:33.246675 27290 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.271317 27309 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.264814 27307 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:33.247449 27316 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.277189 27309 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.230611 27304 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.267030 27306 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.279769 27308 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.271268 27286 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.284705 27291 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.274232 27294 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.254124 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:33.270228 27318 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.281757 27290 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.286932 27299 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.287446 27314 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.272464 27305 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.277639 27301 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.276185 27302 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.267802 27315 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.286527 27297 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.288127 27289 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.302868 27300 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.306087 27287 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.297627 27286 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.300930 27294 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:33.270215 27322 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.321903 27303 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.332129 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.303184 27293 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.357007 27283 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.359081 27286 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.309026 27318 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.365810 27286 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:09:33.370858 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 210011us
I20260709 12:09:33.368089 27319 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.371734 27325 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.378269 27286 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:33.385949 27315 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.386782 27290 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.382647 27325 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.388712 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.376549 27320 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.379616 27289 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.386169 27286 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:33.390998 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.383778 27319 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:33.400628 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.378499 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:33.402714 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.391896 27309 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.486847 27326 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:33.413120 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.393874 27289 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.479948 27327 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:33.407521 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.497159 27289 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.496165 27327 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.403015 27313 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.452306 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.493706 27326 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.423993 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.483830 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.478521 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.499598 27329 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:33.396854 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.412830 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.500808 27326 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.478134 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:09:33.424670 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.478827 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.479101 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.503273 26613 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 1.
I20260709 12:09:33.503542 27327 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.432775 27322 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.492842 26620 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
W20260709 12:09:33.500849 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 122456us
I20260709 12:09:33.505575 27134 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:33.403144 27319 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.506079 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.505551 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.508077 27319 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.511766 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.417776 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.504223 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.507947 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:09:33.513494 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.412546 27286 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:33.516148 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.516908 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.517436 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.518157 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.518752 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.461903 27325 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.464197 27318 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.519472 26548 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:33.416395 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.389788 27328 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:33.521317 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.521466 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.520534 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.486765 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.508226 27329 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:33.436463 27317 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:33.518814 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.519510 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.523118 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.524076 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.508961 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:33.411556 27282 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.526384 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.527017 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.525905 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.527662 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.527797 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.401628 27324 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.528542 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.529320 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.529582 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.454437 27316 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.530900 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.529628 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.529933 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.533448 26620 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:33.531551 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.533628 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.549441 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.742159 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.628878 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.532505 27329 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:33.720957 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.767906 27329 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:33.561328 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.768923 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.770041 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:09:33.741883 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 233006us
I20260709 12:09:33.771492 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.532030 27286 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.777999 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.772506 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:09:33.742384 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.795526 26465 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:33.796546 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.797669 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.539376 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.799626 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.799840 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.800683 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.801013 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.801628 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.802623 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.803359 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.805346 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.804487 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.807387 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.807909 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.808561 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.808805 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.809846 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.810930 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.811144 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.807935 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.811570 26548 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:09:33.812563 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.773061 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.560694 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.813618 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.814179 26617 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:33.814308 26545 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
W20260709 12:09:33.814889 26585 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54654 dropped due to backpressure: service queue is full with 50 items
I20260709 12:09:33.814827 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.815212 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.815445 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.816038 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.813690 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.816433 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.817090 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.817579 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.809871 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.818115 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.818725 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.818940 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.819339 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.819808 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.820384 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.821429 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.628749 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.773864 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.812557 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.598907 27328 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:33.709529 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.823249 27328 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:33.823697 27328 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:33.542569 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.816433 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.663923 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:09:33.663125 27189 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc060 after lost signal to thread 25296
W20260709 12:09:33.826362 27189 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc740 after lost signal to thread 26405
I20260709 12:09:33.827039 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.742444 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:33.827585 27189 debug-util.cc:398] Leaking SignalData structure 0x7b080030a700 after lost signal to thread 26497
I20260709 12:09:33.827778 26616 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:33.828132 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:09:33.828709 27189 debug-util.cc:398] Leaking SignalData structure 0x7b08000de240 after lost signal to thread 26572
I20260709 12:09:33.829182 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:09:33.829880 27189 debug-util.cc:398] Leaking SignalData structure 0x7b08002cddc0 after lost signal to thread 26646
I20260709 12:09:33.830185 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.830842 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:09:33.831293 27189 debug-util.cc:398] Leaking SignalData structure 0x7b08000e51c0 after lost signal to thread 27192
I20260709 12:09:33.831492 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.831952 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.832543 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.817608 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.774374 26621 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:33.610211 27294 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:33.815229 26585 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54654 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 444)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 680)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 678)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 672)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 449)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 671)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 433)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 414)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 428)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 420)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 417)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 429)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 418)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 450)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 670)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 677)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 674)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 679)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 441)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 666)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 432)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 431)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 675)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 409)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 662)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 421)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 423)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 425)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 426)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 664)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 427)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 665)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 446)
I20260709 12:09:33.815212 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.836632 26617 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:33.837069 27294 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:33.710420 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.837651 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.838330 26617 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:33.837244 26585 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:54654 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 680)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 678)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 672)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 449)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 671)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 433)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 414)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 428)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 420)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 417)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 429)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 418)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 450)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 670)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 677)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 674)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 679)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 441)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 666)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 432)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 431)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 675)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 409)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 662)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 421)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 423)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 425)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 426)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 664)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 427)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 665)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 446)
I20260709 12:09:33.774996 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.742026 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.842473 26620 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:33.775600 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.843385 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.843570 26613 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:33.844568 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.844647 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.845376 26613 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:33.845724 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.846243 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.847311 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.847848 26613 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:33.553150 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.757072 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:33.849216 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:09:33.849622 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 92691.1us
I20260709 12:09:33.551687 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.770128 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:33.850780 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.767959 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.851410 27313 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:33.851809 27313 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:33.852274 27313 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:33.852377 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.853777 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.779155 27286 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:33.521494 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.854954 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.773105 27317 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:33.856266 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.742026 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.780393 27329 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:33.859797 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.860625 27329 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.787171 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.861755 26614 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:33.862344 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.863854 27168 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:33.864356 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.864840 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.867332 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:33.848868 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:09:33.870636 27328 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:33.874250 27328 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:33.888288 27313 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:33.890738 27313 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:34.136905 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 303448us
I20260709 12:09:34.227332 26514 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:34.228080 27333 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.229941 27333 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:34.230477 27333 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.232590 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:34.233409 27332 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.233506 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:34.233850 27332 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:34.234464 26514 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:34.234587 27331 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.235041 27331 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:34.235455 27331 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.234333 27332 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.238615 27334 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.239127 27334 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:34.239557 27334 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.239600 27333 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.242010 27333 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.247203 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.248695 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.249023 27332 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.249873 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.251746 27332 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.249792 27334 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.252831 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.254061 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.251093 27331 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.255115 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.255955 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.256268 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.256413 27331 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.257454 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.256987 27334 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.258932 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.257404 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.260279 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.261044 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.261545 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.317984 26439 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:09:34.319193 26439 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54654 dropped due to backpressure: service queue is full with 50 items [suppressed 3 similar messages]
I20260709 12:09:34.320914 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:34.322966 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:34.325486 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:34.326179 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:34.326752 27336 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:34.327747 27336 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.330017 27336 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.330681 27336 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.331049 27336 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:34.331427 27336 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.336447 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.337960 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.339174 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:34.339308 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.339565 27336 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.340637 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.341951 27336 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.342375 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.342660 27336 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.341967 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.343101 27336 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:34.343504 27336 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.343974 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.344002 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.345070 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.345345 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.346073 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.346593 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.347019 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.347774 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.347954 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.348544 26617 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:09:34.348973 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.349272 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.350286 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:33.802146 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:34.351337 27336 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.350147 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.351935 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.352288 26614 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:34.353672 27336 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.353611 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.354092 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.354534 27336 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.354957 27336 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:34.355405 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.354929 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.355957 27336 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.355113 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.357184 26617 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:34.363793 27336 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.366649 27336 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.368764 26614 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:34.370782 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:34.370298 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:34.373350 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:34.380728 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.442752 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.444550 27336 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:34.445228 27336 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.447326 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.447573 27336 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.452232 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:34.453238 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:34.453953 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:34.454867 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:34.455439 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:34.456840 27336 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:34.457537 27336 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.462811 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.464823 27336 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.467293 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.468999 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:34.469260 27294 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.469060 26438 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.472151 27336 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.473620 26438 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.474547 27317 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.475046 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.476013 27317 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.476496 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.477703 27317 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.478832 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.479728 27317 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.484089 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.485009 27317 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.487392 26438 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.488323 27317 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.490769 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.491437 26438 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.492259 27317 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.494385 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.495002 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:34.495292 27317 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.497434 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.498237 26438 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.498996 27317 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.499670 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:34.501772 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.502857 27336 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.503321 27336 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:34.503747 27336 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.515079 26439 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.516554 26439 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.517810 26439 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.519109 27294 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.519903 27294 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.520588 27294 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.520687 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.521499 26439 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.522711 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.522771 27294 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.523627 27317 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.518043 27336 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.526479 26439 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.534287 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.535247 27294 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:34.529065 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 716382us
I20260709 12:09:34.529066 26514 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:34.523331 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.537307 26514 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:34.537523 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.532234 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.538893 27294 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:34.539304 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:34.540477 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.541618 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:34.542440 27294 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.543110 27282 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.543200 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:34.540923 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.522874 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.545501 26439 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.545612 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.546460 27317 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.546926 26439 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.547747 27336 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.548058 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.548461 27317 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.549710 26439 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.550810 27336 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.551052 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.552040 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.553277 27336 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.553755 27332 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.554179 27332 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:34.554301 27322 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.554627 27332 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.554804 27322 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:34.555305 27322 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.557176 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:34.561460 26513 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:34.563447 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:34.564225 27317 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:34.568100 27317 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.571496 27305 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.574115 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:34.575139 27331 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.575548 27331 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:34.575997 27331 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.581763 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.549628 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:34.584174 27340 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.585649 26439 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.585690 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.588519 27340 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.589375 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.588390 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.586637 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.590871 26615 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.590029 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.592522 26513 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:34.592670 27340 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.582681 27334 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.595804 27340 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:34.597298 27336 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:34.597672 27336 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:34.598701 27317 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.565752 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.598562 27336 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:34.599623 27286 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.600268 26587 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.601348 27336 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.601231 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.605475 27331 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.606504 27316 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.608623 27330 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.608899 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.617704 27330 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:34.610973 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.618454 27330 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.619822 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.610977 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.623139 27316 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.624730 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.609759 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.614442 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:34.627697 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:34.628567 27334 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:34.628996 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.629575 27334 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:34.630177 27334 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:34.631294 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.634702 27333 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.635565 27333 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:34.635998 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:34.636173 27333 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.637930 26439 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.640233 27336 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.642897 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.645040 26439 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.645617 27333 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.646579 27340 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.647969 27134 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:34.648344 26514 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:34.649142 27313 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.649510 27313 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:34.649888 27313 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.650033 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.658670 27322 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:34.659828 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 50650.1us
I20260709 12:09:34.634793 26615 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:34.668668 26620 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:34.672595 27331 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.672704 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:34.673808 27340 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:34.674377 27340 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:34.675464 27322 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.675379 27340 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.675549 27332 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.678737 27316 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:34.682926 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 58316.7us
I20260709 12:09:34.683961 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.690943 27342 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.692313 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:09:34.694270 27343 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.695163 27342 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.695631 27342 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:34.696014 27342 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:34.699288 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 51419.4us
W20260709 12:09:34.704756 26588 consensus_peers.cc:597] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86001e7eca0b4ca4aed965b7d7e5820c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:34.705657 27168 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:34.665863 27313 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.706312 26370 catalog_manager.cc:5697] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 2 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:34.707882 27316 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:34.709060 27286 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:34.709472 27286 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:09:34.710258 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 168277us
I20260709 12:09:34.710417 27286 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:34.711869 27286 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.712388 26438 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.713279 27294 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.714690 26438 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.715526 27294 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.716859 26438 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.717703 27294 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.719128 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.719920 27294 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.721295 26438 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.699543 26514 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:34.722134 27294 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.723177 27322 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.723276 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.723646 27322 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:34.724107 27322 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.724261 27294 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.723977 26514 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:34.724810 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.725651 27345 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.726030 27345 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:34.648010 27333 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.726439 27345 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.727950 27294 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.729466 26587 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.730728 27332 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.729816 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:09:34.734211 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 66601.5us
I20260709 12:09:34.708494 27313 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.733855 27316 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.735158 27294 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.738226 27322 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.744414 27330 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.745637 27342 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.744585 27322 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.745739 27345 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.734783 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.749370 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:34.746944 27330 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.751266 27344 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.753913 26438 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.754643 27286 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.758481 27294 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.747938 27334 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.755362 27316 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:34.760607 27316 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:34.761035 27316 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:34.761900 27334 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.762166 27345 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.756697 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.757778 27344 raft_consensus.cc:3055] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:34.762988 27344 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:34.763863 27344 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.765244 27344 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.759764 27342 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:34.759910 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.777423 27286 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.786610 26587 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.787495 27286 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.799230 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.800554 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.801828 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.803793 26548 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:34.804785 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.781793 27316 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.806087 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.807511 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:09:34.808674 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 67636.9us
I20260709 12:09:34.808974 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:34.810356 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:34.810739 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.817487 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.820745 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.829741 26547 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.807514 27316 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:34.833618 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.834960 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.835829 27340 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:34.836310 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.837142 27340 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.837193 27341 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.837945 27294 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:34.838660 27294 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:34.839272 26467 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:34.839672 27294 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.840898 27341 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.841291 27294 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.846117 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:34.842175 26470 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.848862 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:34.849221 26513 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:34.850075 27351 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.851011 26513 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:34.851795 27351 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.852185 27351 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:34.852591 26547 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:34.852591 27351 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.861013 26546 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:34.861166 26547 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:34.863284 27341 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:34.864500 27341 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:34.864939 27341 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:34.867548 27336 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:34.869714 27340 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:34.870198 27340 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:34.871224 27340 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.873328 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:34.873615 26546 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:34.876108 27340 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.877758 27351 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.881222 26622 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:34.883044 27317 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:34.883844 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:34.884294 27317 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:34.884773 27317 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:34.886643 26546 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:34.886579 27330 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.885728 27317 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.880260 27351 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:34.889024 27317 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.881927 27336 consensus_queue.cc:1059] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:09:34.890355 27282 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:34.890797 27282 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:34.865839 27341 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.892113 26546 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:34.892259 27341 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.891705 27282 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.893857 27282 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.900166 27336 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:34.888057 26513 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:34.903962 27286 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:34.905553 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:34.907135 27346 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.908591 27344 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.909329 27286 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.909922 26513 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:34.911319 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:34.914019 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.915500 26587 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.915500 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:34.916880 27286 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:34.912571 27345 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.919648 27346 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.914124 27344 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.921008 26513 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:34.921834 27346 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.924134 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:34.925932 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.926384 27286 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.926914 27342 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.927810 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.928565 27342 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.904532 27294 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:09:34.929831 27294 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:34.930207 27294 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:34.930367 26546 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:34.932921 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:34.931022 26547 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:34.935638 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.936898 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.933212 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:34.938877 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:34.931470 27344 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.939324 27342 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.931763 27317 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:34.940152 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:34.931066 27294 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.940419 27317 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:34.941047 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:34.915445 27355 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.945044 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.947644 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:34.941620 27317 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.954241 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.952212 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:34.952666 26547 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:34.963940 26547 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:34.971891 27356 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:34.973099 27356 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.973825 27358 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:34.977123 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:34.982326 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:34.985335 26464 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:09:34.953095 27342 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.974156 27356 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:34.974261 27358 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:34.974622 27286 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.968631 27316 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.037830 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:34.988739 27356 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:35.035079 26465 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:09:34.981675 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:35.083711 27356 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:35.085189 27356 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.982709 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:35.031870 27358 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:34.969769 27282 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
W20260709 12:09:35.098870 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 120942us
I20260709 12:09:35.101963 26547 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:35.028414 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:09:35.102538 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 120242us
I20260709 12:09:35.104146 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.105121 27342 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.105584 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.106348 27342 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.106815 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.033363 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:35.034962 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:34.968788 27336 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:09:35.039424 27355 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.079342 27317 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.082317 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:35.087787 26615 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:35.089757 26465 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:35.107878 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.144552 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.144742 27355 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.145540 27355 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.145743 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.110713 27294 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.147198 26587 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.112236 27342 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.149274 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.150477 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.150704 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:35.151285 26547 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.151599 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:35.153378 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.155979 27340 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:35.156415 27340 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:35.157313 27340 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:35.158638 27360 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.158833 27336 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:35.159329 27336 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:35.160144 27336 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:35.164973 26470 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:35.167811 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:35.169234 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:35.171494 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.161751 27357 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:35.173026 27360 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.149089 27338 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.172528 27359 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:09:35.179045 26587 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.180505 26587 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:35.177052 26473 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:09:35.186620 26547 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 2.
I20260709 12:09:35.178965 27338 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.188946 27364 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.189750 27364 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.153582 27286 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.190333 27364 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.191110 27342 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.191169 26466 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:09:35.175988 27359 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:35.195186 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.196391 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.197458 26587 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.152583 27355 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.202600 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.193912 27359 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:35.198139 27338 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.208958 27339 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.216014 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.198807 27358 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.210323 27316 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.207906 27286 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.209335 27360 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.211097 27340 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.209285 27336 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.243008 27338 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:35.230618 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 61529.8us
I20260709 12:09:35.257180 26547 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
W20260709 12:09:35.224489 26643 debug-util.cc:398] Leaking SignalData structure 0x7b080013be40 after lost signal to thread 25296
I20260709 12:09:35.262460 26513 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:09:35.264719 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 48803.2us
I20260709 12:09:35.266063 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.268471 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.270038 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.269899 26513 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:35.272609 26513 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:35.275506 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.276551 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.278003 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.268029 27360 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.282678 27366 ts_tablet_manager.cc:933] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:35.272964 27332 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.274128 27342 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.277928 27339 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.281297 27355 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:35.296332 26643 debug-util.cc:398] Leaking SignalData structure 0x7b08001c06c0 after lost signal to thread 26405
I20260709 12:09:35.265056 27359 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:35.295635 27344 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:35.278146 27338 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.295574 27286 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:35.322341 26643 debug-util.cc:398] Leaking SignalData structure 0x7b08000c8000 after lost signal to thread 26419
W20260709 12:09:35.344103 26643 debug-util.cc:398] Leaking SignalData structure 0x7b080030d6e0 after lost signal to thread 26497
I20260709 12:09:35.318631 27313 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:09:35.346132 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 46973.4us
I20260709 12:09:35.347052 27359 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:35.352138 27344 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:09:35.358559 26643 debug-util.cc:398] Leaking SignalData structure 0x7b080029c9a0 after lost signal to thread 26572
W20260709 12:09:35.365387 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 92828.8us
I20260709 12:09:35.368278 26621 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:35.371522 27357 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:35.374308 26643 debug-util.cc:398] Leaking SignalData structure 0x7b08001d42a0 after lost signal to thread 26646
W20260709 12:09:35.375590 26643 debug-util.cc:398] Leaking SignalData structure 0x7b080030bac0 after lost signal to thread 27192
I20260709 12:09:35.379079 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:35.382650 26513 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:35.395488 27364 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:35.396643 27373 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:35.397735 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:35.389962 27333 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.393752 26472 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:09:35.386274 27366 tablet_copy_client.cc:323] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.67:42217
I20260709 12:09:35.385874 27367 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:35.397034 27373 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:35.402856 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:35.403892 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:35.404634 27333 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:09:35.404786 27370 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.407397 26632 tablet_copy_service.cc:140] P aaadfdd9ca9f424c91505f9b43876233: Received BeginTabletCopySession request for tablet 86001e7eca0b4ca4aed965b7d7e5820c from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:48232)
W20260709 12:09:35.410089 27372 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
I20260709 12:09:35.412436 27373 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:35.415571 27367 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:35.416813 27367 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:35.421833 26467 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:09:35.427987 26632 tablet_copy_service.cc:161] P aaadfdd9ca9f424c91505f9b43876233: Beginning new tablet copy session on tablet 86001e7eca0b4ca4aed965b7d7e5820c from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:48232: session id = 3262bf0553e543eea76794fc529a9acc-86001e7eca0b4ca4aed965b7d7e5820c
I20260709 12:09:35.421038 27373 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.449759 26513 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:35.446339 27368 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.452561 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:35.447742 27349 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:35.456805 27363 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:09:35.491732 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 212596us
I20260709 12:09:35.443005 27344 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:35.490782 27363 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:35.512606 27363 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:35.515717 27339 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 12:09:35.559712 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44689.9us
W20260709 12:09:35.566834 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 114184us
I20260709 12:09:35.568571 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:35.568329 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:09:35.573378 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:35.576501 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:35.576970 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:35.577944 26548 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:35.578742 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.578765 26472 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:35.588857 26539 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:35.595263 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 73299.5us
I20260709 12:09:35.598621 27333 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:35.599423 27333 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:35.595050 27316 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:35.601008 27333 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:35.604389 27316 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:35.607090 27334 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:35.607882 27334 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:35.608084 27286 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.608978 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:35.609305 27334 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:35.613356 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:35.618249 26546 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:35.630836 27346 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:35.631541 27346 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:35.633280 27346 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:09:35.634042 27385 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:09:35.625634 27339 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:35.634797 27339 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:35.636397 27339 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:35.637115 27344 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:35.637813 27344 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:35.643729 27344 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:35.665122 27346 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.624027 26632 tablet_copy_source_session.cc:215] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:35.638270 27339 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.678797 26548 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:35.680366 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 71620.2us
I20260709 12:09:35.750036 27366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86001e7eca0b4ca4aed965b7d7e5820c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:35.751380 27369 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:09:35.746596 26370 catalog_manager.cc:5697] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 1 to 2, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 2 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:35.757416 27369 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:35.757961 27369 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:35.759403 27369 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:35.763305 27369 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.762697 26370 catalog_manager.cc:5697] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 1 to 2, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 2 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:35.763407 26469 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:35.768479 26469 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:35.345373 27294 consensus_queue.cc:1175] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac3ac2181aa941229a758ccf6b5607cd" responder_term: 4 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:09:35.792251 26465 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:35.794659 26467 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:09:35.799512 27286 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:35.800381 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.800679 27360 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:35.802877 27286 raft_consensus.cc:3055] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:35.803342 27286 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:35.803398 27377 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:35.803835 27377 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:35.807354 27377 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:35.814246 27286 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:35.815110 27360 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:35.815599 27360 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:35.815647 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:35.817272 27386 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:35.817850 27386 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:35.821064 27360 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.815857 27286 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.825940 27377 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.858006 27386 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:35.893200 27390 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.002s
I20260709 12:09:35.894846 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:35.895730 26546 raft_consensus.cc:2376] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 2. Re-sending same reply.
I20260709 12:09:35.910754 26619 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.920469 27369 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:35.921281 27369 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:35.940047 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:35.940910 26546 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:35.948951 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:35.945837 27322 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:09:35.948835 27334 consensus_queue.cc:1059] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:35.965075 26467 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:35.973697 27344 raft_consensus.cc:3055] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:35.974303 27344 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:35.975543 27344 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:35.977166 27344 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.977357 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:35.979292 27369 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:35.981199 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:09:35.982059 27168 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:35.985985 26467 raft_consensus.cc:2955] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:35.990065 27376 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:35.992065 27370 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:35.992558 27370 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:35.992641 27342 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:35.993177 27342 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:35.993665 27342 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:35.993103 27360 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:35.993508 27370 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:35.994689 26616 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:35.997615 27370 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.975442 27386 raft_consensus.cc:2955] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:36.000414 27360 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:36.001850 26619 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:36.019200 26465 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:36.021891 27313 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:36.028441 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 79667.5us
I20260709 12:09:36.011714 27366 tablet_copy_client.cc:806] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:36.042588 27366 tablet_copy_client.cc:670] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:36.043457 27376 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:36.044857 27364 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:36.045270 27364 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:36.046239 27364 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:36.055167 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 75931.2us
I20260709 12:09:36.067687 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:36.061679 27364 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:36.072893 27359 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:36.073563 27359 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:36.074738 27395 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:36.081014 26473 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:36.082441 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:09:36.083256 27168 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:36.084079 27342 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:36.080873 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:36.085011 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:09:36.058800 27322 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:09:36.088248 27313 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:36.091121 26621 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:36.092484 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:36.093355 27342 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:36.076042 27359 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:36.094301 27294 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:36.095244 27294 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:36.095798 27294 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:36.097136 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:09:36.098379 27366 tablet_copy_client.cc:538] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:36.093389 26619 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:36.110805 26371 catalog_manager.cc:5697] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 3 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 4 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:36.121263 26469 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:36.126991 26473 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:36.127974 27357 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:36.107290 27376 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:09:36.128532 27357 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:36.139053 27395 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 2 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:09:36.179177 26621 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:36.189862 26621 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:36.191727 27370 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:36.223704 27395 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:36.226979 27366 tablet_bootstrap.cc:492] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:09:36.233772 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:36.235884 26540 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:36.237682 27344 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:36.237978 27376 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:36.239249 27294 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:36.241503 27294 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:36.243959 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:09:36.247653 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 119642us
I20260709 12:09:36.178478 27386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48222 (request call id 1) took 2329 ms. Trace:
I20260709 12:09:36.249166 27359 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:36.272497 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:36.273267 26614 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:36.278913 27359 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:36.279462 27359 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:36.288259 27339 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:36.289064 27339 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:36.290786 26615 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:36.291667 26618 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:36.292133 27357 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:36.297410 27339 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:36.298648 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:09:36.259990 27386 rpcz_store.cc:276] 0709 12:09:33.841483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:34.367201 (+525718us) service_pool.cc:224] Handling call
0709 12:09:34.371942 (+  4741us) log.cc:844] Serialized 506 byte log entry
0709 12:09:36.162911 (+1790969us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6071,"raft.run_cpu_time_us":1764,"raft.run_wall_time_us":2079,"thread_start_us":3303,"threads_started":3,"wal-append.queue_time_us":1088,"wal-append.run_cpu_time_us":2030,"wal-append.run_wall_time_us":1002816}
I20260709 12:09:36.302306 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:36.303026 26546 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:36.303292 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:36.304128 26540 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 2: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:36.302632 26539 raft_consensus.cc:2955] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:36.315860 27357 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:36.318850 26466 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:36.318578 27357 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:36.304416 27167 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:36.321081 27357 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:36.330574 26546 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:09:36.335273 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:36.329936 27359 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:36.339016 26464 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:36.345432 27359 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:36.351369 26469 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:36.343142 27357 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:36.354983 27357 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:36.355729 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:36.357208 27357 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:36.357470 27397 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:36.361011 27338 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:36.358057 27397 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:36.362243 27397 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:36.364638 26616 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:36.366981 27401 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:36.367799 27401 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:36.372053 26547 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:36.363206 27294 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:36.373992 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:36.377980 26618 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:36.374627 27294 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:36.391862 26615 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:36.397850 26546 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:36.381662 27338 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:36.405187 27364 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:09:36.405682 27167 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:09:36.407644 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:09:36.401204 27339 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:09:36.411178 27334 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:36.413777 27339 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:36.414346 27339 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:36.420821 27338 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:36.405973 26618 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:36.436196 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:36.444531 26547 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 2.
I20260709 12:09:36.416337 27401 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:36.442195 27338 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:36.426798 27339 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:36.461709 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:36.462831 27401 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:36.463785 26616 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:36.446892 27294 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:36.459293 26614 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:09:36.470595 27401 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:36.490747 27401 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:36.490190 27294 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:36.520561 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:36.521371 26547 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:36.540763 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:36.554783 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:36.555588 26547 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:36.543596 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:09:36.562463 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 79685.6us
I20260709 12:09:36.563163 26544 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:36.569446 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:36.570050 27375 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:36.570297 26613 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:36.546278 27357 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:36.522708 27294 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:36.542239 27408 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:36.576124 27357 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:36.598594 27357 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:36.600832 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:36.593010 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:36.601974 26548 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:36.597497 27294 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:36.618883 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:09:36.620374 26613 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:36.627406 26547 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:09:36.620023 26438 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:36.691431 26371 catalog_manager.cc:5697] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 1 to 2, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 2 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:36.692939 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:09:36.637764 26370 catalog_manager.cc:5697] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:36.700481 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:36.701263 26617 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:36.701560 26370 catalog_manager.cc:5697] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 1 to 2, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 2 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:09:36.708626 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:36.726703 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:36.591827 27408 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:36.704064 27294 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:36.747685 27294 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:36.704221 27375 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:09:36.707326 27413 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:36.753948 27294 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:36.778093 26617 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
W20260709 12:09:36.782465 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 57062.7us
I20260709 12:09:36.783329 27412 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:36.783846 27412 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:36.784287 27412 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:36.783907 27397 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:36.788280 27422 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:09:36.789906 27408 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:36.792533 27397 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:09:36.799067 27423 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 12:09:36.801460 27417 log.cc:927] Time spent T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:09:36.775702 27413 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:36.828163 27408 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:36.854454 27401 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:36.855997 27168 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:36.857345 27401 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:09:36.857582 27410 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:09:36.859457 27428 log.cc:927] Time spent T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:09:36.864387 27357 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:36.865136 27408 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:36.865743 26464 raft_consensus.cc:2368] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 2. Current term is 3.
I20260709 12:09:36.867403 27408 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:36.864219 27413 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:36.870026 27366 tablet_bootstrap.cc:492] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:09:36.842080 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:36.889492 26472 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:36.878420 27357 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:36.893307 27366 tablet_bootstrap.cc:492] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:09:36.894359 27366 ts_tablet_manager.cc:1403] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.668s	user 0.022s	sys 0.020s
I20260709 12:09:36.916431 27412 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:36.917187 27416 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:36.919026 27412 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:36.921052 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 74105.6us
I20260709 12:09:36.925740 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:09:36.927008 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 94141.5us
W20260709 12:09:36.936444 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 199163us
I20260709 12:09:36.938058 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:36.939023 27425 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:36.939621 27425 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:36.940574 27425 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:36.941210 27412 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:36.941884 27412 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:36.941965 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:36.942931 27412 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:36.947163 26469 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:36.978188 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:36.918011 27416 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:36.986320 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:36.989225 26615 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:36.990451 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:36.991106 26615 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:36.993777 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:36.994513 26613 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:36.997758 27377 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:37.010953 26615 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:09:36.985895 27408 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:36.999089 27360 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:37.024778 27408 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:37.026583 27397 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:37.044116 27397 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.039263 27408 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:37.034663 27360 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:37.071223 27426 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:09:37.073338 27397 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:37.077569 27416 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:37.107108 27366 raft_consensus.cc:359] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.113247 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:09:37.115811 27395 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:37.116003 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:09:37.116604 27395 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:37.117775 27397 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:37.118325 27397 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.119071 27395 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:37.120728 27397 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:37.122738 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:37.123725 26619 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:37.124343 27366 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:09:37.125402 27366 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:37.129711 27168 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:37.165982 27338 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:37.186560 27340 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:37.168905 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:37.209357 27397 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:37.204746 27133 leader_election.cc:400] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 2. Current term is 3.
W20260709 12:09:37.244648 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 258418us
I20260709 12:09:37.257503 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:37.304333 27357 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:37.305110 27357 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.311578 27357 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:37.203914 27338 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.317539 27338 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:37.318686 27360 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:37.303296 27322 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:37.320777 27366 ts_tablet_manager.cc:1434] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.426s	user 0.009s	sys 0.003s
I20260709 12:09:37.322168 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:37.325904 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:37.327404 26547 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:37.322963 26546 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:37.328090 27322 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.331693 27373 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:37.332428 27373 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.335919 27416 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:37.336699 27416 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.213405 27340 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.341122 27340 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:37.341717 27416 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:37.323695 26472 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 2: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:09:37.353040 27360 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:37.358119 27360 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.360352 27360 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:37.313478 27397 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.376164 27397 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:09:37.326457 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 159382us
I20260709 12:09:37.379805 26544 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:37.318130 27408 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.385114 27408 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:37.341881 27340 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:37.398895 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:37.399947 26544 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:37.398177 27168 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:09:37.401965 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:37.434676 26546 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:37.393285 27413 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.000s	sys 0.024s
W20260709 12:09:37.412171 27339 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.083s	sys 0.204s
I20260709 12:09:37.426946 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:37.406900 27322 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:37.443837 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:37.463256 26544 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:37.463090 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:37.464380 26547 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 2: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:09:37.423157 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 445344us
W20260709 12:09:37.440919 27413 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.000s	sys 0.024s
I20260709 12:09:37.450590 26439 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:09:37.463122 26548 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:37.416742 27373 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:37.474236 27339 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.093s	sys 0.211s
I20260709 12:09:37.467983 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:37.410372 27340 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.507014 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:37.507786 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:37.512259 26548 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 2: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:37.518934 26544 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:09:37.511270 26464 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:37.501742 27413 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:37.530545 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:37.531210 26544 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:37.541800 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:09:37.541213 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 274418us
I20260709 12:09:37.542709 26464 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:37.544409 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:37.546438 26546 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:09:37.538561 27338 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:37.552301 26539 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 2: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:09:37.567270 27439 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 12:09:37.569051 27438 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:09:37.541532 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:37.572435 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:37.573328 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:37.574558 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:37.571437 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:37.576368 26469 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 2: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:09:37.574664 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:37.576530 26464 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:37.585858 26546 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:37.582312 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:37.590760 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:37.591898 26546 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 2: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:37.593179 26544 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
W20260709 12:09:37.584442 27334 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.017s	sys 0.042s
I20260709 12:09:37.599813 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:37.600541 26548 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:37.599423 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:37.595772 27451 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:37.572369 27338 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.618794 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:37.629869 26546 raft_consensus.cc:2368] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 2. Current term is 3.
I20260709 12:09:37.619181 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:09:37.600068 27334 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.018s	sys 0.042s
I20260709 12:09:37.600579 27416 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:09:37.608548 26585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.028s	sys 0.016s
I20260709 12:09:37.643134 27416 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:37.643430 27133 leader_election.cc:400] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 2. Current term is 3.
I20260709 12:09:37.643666 27416 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:37.620060 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:37.615300 26539 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 2: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:37.620327 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:09:37.645952 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 195494us
I20260709 12:09:37.617057 26544 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:37.608667 27342 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:09:37.643496 26585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.029s	sys 0.016s
I20260709 12:09:37.653049 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:37.653759 26546 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:37.655201 26548 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 2: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:37.644011 27133 leader_election.cc:403] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:09:37.646229 26465 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:37.656368 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:37.675674 26439 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:37.687924 26615 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:37.659029 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:37.607017 26588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.007s	sys 0.041s
I20260709 12:09:37.694041 26439 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:09:37.694321 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 150027us
I20260709 12:09:37.617405 27340 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:37.656950 27342 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:37.722340 27342 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:37.695626 27412 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:37.729012 27412 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:37.729513 27412 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:37.617463 26470 raft_consensus.cc:2368] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3.
W20260709 12:09:37.685349 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 103128us
I20260709 12:09:37.605255 27448 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:37.644837 27357 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:37.793781 27448 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:37.794207 27448 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:37.794013 27357 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:37.794471 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 151234us
I20260709 12:09:37.657909 26547 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:37.717041 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:37.717262 27441 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:09:37.752497 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 58523.6us
I20260709 12:09:37.761623 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:37.799358 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:37.631270 26540 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 2.
I20260709 12:09:37.800808 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:37.805203 26615 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:37.805701 26548 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 2: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:37.761942 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:37.619462 27451 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:37.796404 27357 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:37.804464 26439 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:37.621803 27338 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:37.793308 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:37.812551 27451 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:37.822132 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:37.822832 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:37.824108 27433 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 2. Current term is 3.
I20260709 12:09:37.809329 27413 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:37.816545 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:37.828362 26469 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
W20260709 12:09:37.693828 26588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.011s	sys 0.041s
I20260709 12:09:37.852685 27360 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:37.830997 27339 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:37.856570 26587 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:09:37.858120 27433 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:37.865111 26615 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:09:37.838904 27357 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:37.870509 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:37.842324 27459 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:37.850987 27338 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:37.845745 27340 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:37.848757 27408 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:37.827890 27441 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.883107 27360 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:37.922947 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:37.905951 27357 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.906001 27456 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:37.865159 27435 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 12:09:37.933230 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:37.926875 26620 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:37.924827 26614 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:37.874698 27339 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.926424 27360 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:09:37.954655 27457 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:09:37.859567 27413 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:37.924165 27408 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.954748 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:37.906636 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:09:37.937490 27455 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:37.964468 26473 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:09:37.911523 27338 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.926548 27340 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:37.955756 27444 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.185s	user 0.003s	sys 0.001s
I20260709 12:09:37.969873 27452 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:37.970520 27452 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:37.970966 27452 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:37.973953 27455 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.962256 27360 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:37.978902 27455 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:37.979166 26541 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:37.978160 27357 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:37.986898 27464 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:09:37.979172 27432 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:37.990836 27461 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:37.991551 27461 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:37.992512 26438 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:37.990972 27432 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:37.971868 27458 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:09:37.978940 27340 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.017041 27425 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:38.017692 27425 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:38.031172 27463 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:09:37.993870 27461 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.001163 27432 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:37.951619 27456 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:38.003448 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 120846us
I20260709 12:09:38.048296 27339 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:38.059070 27342 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.038836 27357 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:38.032589 27340 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:38.071980 26547 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:38.045168 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:38.077421 27462 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:38.082026 27340 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.088164 26621 raft_consensus.cc:2368] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3.
I20260709 12:09:38.078572 27425 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:38.152886 27473 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:38.093146 27462 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:38.153741 27473 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:38.139925 27340 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.177534 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 826) took 1195 ms. Trace:
I20260709 12:09:38.082423 27357 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.184444 27342 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:38.178135 26617 rpcz_store.cc:276] 0709 12:09:36.981643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:36.985320 (+  3677us) service_pool.cc:224] Handling call
0709 12:09:36.996191 (+ 10871us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:37.434077 (+437886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:37.435620 (+  1543us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:37.507910 (+ 72290us) log.cc:844] Serialized 26 byte log entry
0709 12:09:37.801815 (+293905us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:37.809041 (+  7226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:37.825014 (+ 15973us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:38.177210 (+352196us) raft_consensus.cc:1685] finished
0709 12:09:38.177229 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:38.177418 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29772,"raft.queue_time_us":94179,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":9415,"thread_start_us":585088,"threads_started":2,"wal-append.queue_time_us":610137}
I20260709 12:09:38.188935 27473 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:38.158761 27462 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:38.168618 27452 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.206473 27360 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.210376 27456 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:38.213928 27416 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.562s	user 0.006s	sys 0.006s
I20260709 12:09:38.231101 27441 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.166285 27475 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:38.238605 27475 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:38.239089 27475 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:38.237803 27468 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 0.269s	user 0.000s	sys 0.004s
W20260709 12:09:38.248862 27454 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.633s	user 0.004s	sys 0.001s
I20260709 12:09:38.252861 27167 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:38.253441 27167 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:09:38.254633 27167 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:38.256042 27167 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:38.209692 27360 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:38.193179 27412 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.265030 27408 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.267692 27357 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.200700 27451 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.215138 27448 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.278152 27448 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:38.278862 26616 raft_consensus.cc:2368] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3.
I20260709 12:09:38.279978 27452 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:38.281148 27338 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:38.240952 27416 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.300657 27416 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.288460 27412 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.276178 27451 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:09:38.320652 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 407952us
I20260709 12:09:38.322538 27357 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:38.324052 27357 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.326995 27357 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.323262 27412 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:38.328119 27412 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.330499 27459 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:38.330715 27412 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.334435 27459 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.319576 27167 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
W20260709 12:09:38.342962 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 349293us
I20260709 12:09:38.341363 27167 pending_rounds.cc:85] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 4
I20260709 12:09:38.344763 26438 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:38.341858 27363 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:38.359082 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 493981us
I20260709 12:09:38.348912 27413 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:38.363572 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:38.343734 27432 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.354615 27167 pending_rounds.cc:107] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:09:38.351837 27483 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:38.365352 27167 raft_consensus.cc:2889] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:09:38.354188 27363 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.377164 27363 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.388172 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:38.390614 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:38.387820 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:38.392045 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:38.378654 27483 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:38.381567 27433 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:09:38.431412 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:38.431173 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:09:38.432967 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 51011.5us
I20260709 12:09:38.384716 27489 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:38.433704 26620 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:38.356321 27462 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:38.436558 27462 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:38.378523 27482 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:38.432271 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:38.437458 27482 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.439834 27482 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:09:38.441610 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:38.443173 26620 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
W20260709 12:09:38.448253 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52797.9us
I20260709 12:09:38.447007 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:38.399616 27416 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:38.393199 27338 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:38.379671 27413 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.393446 27478 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:38.484143 26632 tablet_copy_service.cc:342] P aaadfdd9ca9f424c91505f9b43876233: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-86001e7eca0b4ca4aed965b7d7e5820c received from {username='slave'} at 127.0.0.1:48232
I20260709 12:09:38.487262 26616 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 2. Current term is 3. Ops: []
W20260709 12:09:38.488054 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 85827.8us
I20260709 12:09:38.432003 27483 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:38.434041 27489 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.497825 27489 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:38.402608 27408 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:38.451236 27340 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:38.505028 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:38.502535 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:38.503469 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:38.506714 26613 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 3: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:09:38.507000 27480 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:38.507704 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:38.508358 26544 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:38.507584 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:38.508545 26547 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:38.509020 26465 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:38.507723 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:38.490286 27482 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:38.513427 27481 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:38.491766 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:38.514910 26439 leader_election.cc:400] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3.
I20260709 12:09:38.521365 26439 leader_election.cc:403] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:09:38.524821 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:38.513293 27460 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:09:38.526450 27412 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:38.527067 27412 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.527725 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:38.529228 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:38.529311 27412 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.529747 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:38.503970 26632 tablet_copy_service.cc:434] P aaadfdd9ca9f424c91505f9b43876233: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-86001e7eca0b4ca4aed965b7d7e5820c on tablet 86001e7eca0b4ca4aed965b7d7e5820c with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:38.530745 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:38.531692 27484 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:38.532275 27484 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.533382 27413 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.493032 27338 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.535888 27484 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.537063 26439 leader_election.cc:400] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3.
I20260709 12:09:38.537289 26439 leader_election.cc:403] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:09:38.537216 27338 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:38.538640 27484 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:38.538993 26439 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:38.539134 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:38.539296 26622 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:38.538543 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:09:38.539801 27412 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:38.540033 27167 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:09:38.540344 27412 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:38.540512 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:38.544728 26544 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:09:38.504611 27408 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:38.510718 27482 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:38.546293 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:38.553416 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:38.557502 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:38.558135 26587 leader_election.cc:400] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3.
I20260709 12:09:38.558279 26547 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 2: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:38.558585 26587 leader_election.cc:403] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:09:38.559433 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:38.560037 26544 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:38.511500 27340 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.549568 27408 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:38.544109 26617 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:09:38.561254 26539 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:38.571870 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:38.573249 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:38.507544 27480 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.556598 27482 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:38.550318 26588 consensus_peers.cc:597] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 580883b917314b66883009ddb9259ac0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:38.580977 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:38.563599 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:38.583489 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:38.567883 27489 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3.
I20260709 12:09:38.574962 27432 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.568264 27475 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:38.514014 27478 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.586370 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:38.596812 26545 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 2: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:38.589920 26544 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:09:38.600008 26465 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:09:38.607421 26439 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:09:38.639220 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 54099.6us
I20260709 12:09:38.640410 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:38.579350 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:38.648375 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:09:38.616632 27479 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 12:09:38.592294 27340 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.651772 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:38.590988 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:09:38.595911 27475 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:38.615383 27461 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3.
I20260709 12:09:38.590826 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:38.656250 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:38.597790 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:38.727144 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:38.615679 27432 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:38.615473 27373 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:38.733385 26471 raft_consensus.cc:2368] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3.
I20260709 12:09:38.733567 27432 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:38.597788 27478 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:38.733767 27373 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.734067 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:38.734355 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:38.734089 27432 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:38.735540 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:38.735630 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:38.736191 26545 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:38.736321 27373 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.736750 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:38.737524 26471 raft_consensus.cc:2368] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 2. Current term is 3.
I20260709 12:09:38.738756 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:38.741039 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:09:38.641500 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 47533.7us
I20260709 12:09:38.642998 27481 raft_consensus.cc:697] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:38.575126 27412 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.759752 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:38.727151 27167 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:38.742743 27430 raft_consensus.cc:2764] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:09:38.654174 27466 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:38.742660 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:38.769622 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:38.643738 27377 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.117s
I20260709 12:09:38.619051 27483 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.776538 26513 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:38.779775 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:38.780166 27466 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.781255 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:38.785194 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:38.787971 27466 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:38.784049 26616 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:38.792403 26545 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:09:38.774024 27133 leader_election.cc:400] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 2. Current term is 3.
I20260709 12:09:38.798981 27429 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:38.792797 27338 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:38.805454 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:38.814937 27338 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.815660 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:38.816329 26545 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:38.818001 27338 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:38.819305 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:38.819566 27481 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.820535 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:38.821058 26548 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:38.818614 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:38.836728 26547 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:38.841127 26545 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:09:38.844517 27432 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.845252 26548 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:09:38.848219 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:38.849263 27432 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.807924 27133 leader_election.cc:403] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:09:38.857777 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 78575.1us
W20260709 12:09:38.863137 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 118118us
I20260709 12:09:38.856366 26467 raft_consensus.cc:2368] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3.
I20260709 12:09:38.871038 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:38.892463 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:38.892984 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:38.902426 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:09:38.906265 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44588.2us
I20260709 12:09:38.908051 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:38.907910 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:38.909075 26620 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:38.910877 27501 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:38.911918 27501 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:38.859860 27484 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3.
I20260709 12:09:38.879503 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:38.927829 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:38.865682 27482 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.928755 27506 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:38.944502 26547 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:09:38.945509 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:38.937896 26620 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:09:38.946983 26471 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:09:38.874193 26616 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:09:38.948297 26613 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 3: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:09:38.949982 27482 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:38.951413 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:38.953452 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:38.954216 27432 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:38.955024 26545 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:38.936281 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:38.942880 27506 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.960672 27408 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.961762 26469 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:09:38.964454 27167 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:09:38.965852 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:09:38.967032 27502 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:38.967213 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:38.967697 27502 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:38.967051 27408 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.970350 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:38.971623 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:38.972681 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:38.952255 27416 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:38.976353 27433 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 2. Current term is 3.
I20260709 12:09:38.977408 27459 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:38.982317 27502 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:38.985453 27459 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:38.986181 27459 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:38.961756 27506 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.987227 27459 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.989583 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:38.990435 27412 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:38.991549 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:38.991801 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:38.992625 27501 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:38.993149 27501 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:38.993628 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:38.994383 27501 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:38.995662 27483 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:38.996115 26542 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:38.993168 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:38.998526 26473 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:38.999639 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:39.004029 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:39.005873 26439 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:39.007409 27412 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.007973 26439 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:39.008793 27412 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.009284 27412 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:39.009735 27412 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.012951 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:38.976827 27484 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:39.022962 26513 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:39.035460 26469 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:39.025676 26539 raft_consensus.cc:2368] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 2. Current term is 3.
I20260709 12:09:39.025877 27363 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:39.053884 27443 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:39.072639 27133 leader_election.cc:400] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 2. Current term is 3.
I20260709 12:09:39.068176 27443 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:39.065616 27363 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.084672 27443 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:39.085620 27445 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:09:39.101524 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:39.107980 27445 raft_consensus.cc:3055] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:39.108654 27363 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:39.113209 27445 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:39.098656 27491 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:39.114229 27445 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.116401 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:39.190953 27431 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:39.107734 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:09:39.224119 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 107791us
I20260709 12:09:39.224905 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:39.223361 27431 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.227123 27478 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:39.227934 27489 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.132862 27377 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:39.217082 27466 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:39.217338 27452 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:39.231719 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:39.242779 26618 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:39.243245 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:39.116261 27482 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.114s
I20260709 12:09:39.134802 27412 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.240059 26370 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57052 (request call id 142) took 2776 ms. Trace:
I20260709 12:09:39.240218 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:39.241616 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:39.238715 27168 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:39.253518 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:39.244150 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:39.253422 26621 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:39.230451 27486 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:39.251987 26369 catalog_manager.cc:5697] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 1 to 2, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 2 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:39.228935 27431 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:39.232262 27445 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.237670 27443 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.264670 26469 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:39.265375 26621 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:09:39.271523 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:39.255465 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:39.258922 27451 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:39.265556 26616 raft_consensus.cc:2368] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3.
I20260709 12:09:39.278045 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:39.278236 27443 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:39.278719 26471 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:39.279925 26371 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39184 (request call id 24) took 2661 ms. Trace:
I20260709 12:09:39.246361 27466 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.274340 27486 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:39.256211 27462 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:09:39.242288 27452 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.275858 27167 raft_consensus.cc:1217] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:39.254312 27377 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.282629 26369 catalog_manager.cc:5697] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 1 to 2, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 2 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:39.286576 27413 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:09:39.299697 26369 catalog_manager.cc:5697] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 1 to 2, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 2 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:39.277246 27502 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:39.284613 27366 ts_tablet_manager.cc:933] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:39.290300 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:39.288516 26587 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:39.222793 27491 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:39.300428 27377 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:39.289872 26439 leader_election.cc:400] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3.
I20260709 12:09:39.304157 26439 leader_election.cc:403] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:09:39.303956 26471 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:09:39.305254 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:39.306689 27412 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:39.309229 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:39.255756 26370 rpcz_store.cc:276] 0709 12:09:36.454896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:36.459139 (+  4243us) service_pool.cc:224] Handling call
0709 12:09:39.230990 (+2771851us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:37.878574 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:37.955338 (+ 76764us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:37.955370 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:09:37.955382 (+    12us) tablet.cc:662] Decoding operations
0709 12:09:37.965369 (+  9987us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:37.966962 (+  1593us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:37.966994 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:09:37.969958 (+  2964us) tablet.cc:701] Row locks acquired
0709 12:09:37.969977 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:09:37.970157 (+   180us) write_op.cc:270] Start()
0709 12:09:37.970286 (+   129us) write_op.cc:276] Timestamp: P: 1783598977970102 usec, L: 0
0709 12:09:37.970306 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:09:37.971089 (+   783us) log.cc:844] Serialized 986 byte log entry
0709 12:09:38.448328 (+477239us) op_driver.cc:464] REPLICATION: finished
0709 12:09:38.565094 (+116766us) write_op.cc:301] APPLY: starting
0709 12:09:38.565212 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:38.565409 (+   197us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:38.565572 (+   163us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:38.566088 (+   516us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:38.566319 (+   231us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:09:38.566422 (+   103us) write_op.cc:312] APPLY: finished
0709 12:09:38.566726 (+   304us) log.cc:844] Serialized 28 byte log entry
0709 12:09:38.566953 (+   227us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:38.567079 (+   126us) write_op.cc:454] Released schema lock
0709 12:09:38.567134 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:38.639800 (+ 72666us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:38.641676 (+  1876us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":115245,"apply.run_cpu_time_us":2538,"apply.run_wall_time_us":16152,"num_ops":2,"prepare.queue_time_us":1117455,"prepare.run_cpu_time_us":3797,"prepare.run_wall_time_us":102760,"replication_time_us":429896,"thread_start_us":67531,"threads_started":1}]]}
I20260709 12:09:39.306918 27486 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.318107 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:39.313238 27413 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3.
I20260709 12:09:39.309350 27364 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:39.325407 26514 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:39.286273 27480 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:39.310904 27452 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:39.327008 27507 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:39.308038 27456 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:39.304364 27502 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:39.333536 27167 raft_consensus.cc:2955] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:39.318347 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:39.320993 27344 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.325784 27364 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:39.336736 27364 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:39.337589 27491 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:39.323787 27521 log.cc:927] Time spent T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:09:39.335389 27502 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.311151 27338 raft_consensus.cc:2764] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:09:39.342839 27338 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:39.275934 27360 raft_consensus.cc:2955] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:39.343644 27338 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.326014 27466 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:39.292753 27451 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:39.314162 26513 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:39.347000 27338 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:39.282930 26371 rpcz_store.cc:276] 0709 12:09:36.621448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:36.621625 (+   177us) service_pool.cc:224] Handling call
0709 12:09:39.279847 (+2658222us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:37.235594 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:37.343708 (+108114us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:37.343762 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:09:37.343790 (+    28us) tablet.cc:662] Decoding operations
0709 12:09:37.344249 (+   459us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:37.344328 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:37.344379 (+    51us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:09:37.344625 (+   246us) tablet.cc:701] Row locks acquired
0709 12:09:37.344654 (+    29us) write_op.cc:260] PREPARE: finished
0709 12:09:37.344850 (+   196us) write_op.cc:270] Start()
0709 12:09:37.345005 (+   155us) write_op.cc:276] Timestamp: P: 1783598977344792 usec, L: 0
0709 12:09:37.345037 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:09:37.346025 (+   988us) log.cc:844] Serialized 535 byte log entry
0709 12:09:37.644084 (+298059us) spinlock_profiling.cc:243] Waited 9.12 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5072fd00ac 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b
0709 12:09:38.221812 (+577728us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:09:38.325849 (+104037us) op_driver.cc:464] REPLICATION: finished
0709 12:09:38.512889 (+187040us) write_op.cc:301] APPLY: starting
0709 12:09:38.514702 (+  1813us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:38.545681 (+ 30979us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:38.548406 (+  2725us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:38.578253 (+ 29847us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:38.580281 (+  2028us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:09:38.580330 (+    49us) write_op.cc:312] APPLY: finished
0709 12:09:38.648540 (+ 68210us) log.cc:844] Serialized 22 byte log entry
0709 12:09:38.727143 (+ 78603us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:38.727283 (+   140us) write_op.cc:454] Released schema lock
0709 12:09:38.727351 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:38.727832 (+   481us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:38.727860 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":501545,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":167259,"apply.run_cpu_time_us":3115,"apply.run_wall_time_us":228157,"num_ops":1,"prepare.queue_time_us":468009,"prepare.run_cpu_time_us":47206,"prepare.run_wall_time_us":640416,"raft.queue_time_us":128232,"raft.run_cpu_time_us":40491,"raft.run_wall_time_us":230777,"replication_time_us":980651,"spinlock_wait_cycles":84110080,"thread_start_us":947248,"threads_started":4,"wal-append.queue_time_us":600594}]]}
I20260709 12:09:39.349288 26614 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:39.352246 27338 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.315353 27313 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:09:39.356180 26587 leader_election.cc:400] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3.
I20260709 12:09:39.356520 26587 leader_election.cc:403] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:09:39.357460 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:39.364574 27431 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:39.364889 26514 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:39.365947 27331 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.365532 27431 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.368758 27431 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:39.374377 27442 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:39.375031 27442 raft_consensus.cc:697] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:39.376065 27442 consensus_queue.cc:237] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:39.377463 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 63415us
I20260709 12:09:39.379230 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:39.385351 27451 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.364374 27443 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:39.390333 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:39.355779 27340 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:39.393584 27478 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:39.394008 27452 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.396167 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:39.394414 27523 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.381546 27462 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:39.382993 27338 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3.
I20260709 12:09:39.394764 27413 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:39.408629 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:39.389791 27466 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:39.394701 27460 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:39.391250 27443 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:39.398756 27478 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.418203 27507 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:39.439289 27478 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:39.439415 27507 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.440165 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:39.411034 27474 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:39.422595 27366 tablet_copy_client.cc:323] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.67:42217
I20260709 12:09:39.424345 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:39.420377 27413 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.432526 27466 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.400735 27340 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.426267 26587 leader_election.cc:400] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3.
I20260709 12:09:39.447268 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:39.398959 27482 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.418510 27462 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.450515 27478 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:09:39.425343 27501 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:09:39.456465 26632 tablet_copy_service.cc:140] P aaadfdd9ca9f424c91505f9b43876233: Received BeginTabletCopySession request for tablet 580883b917314b66883009ddb9259ac0 from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:48232)
I20260709 12:09:39.457124 26632 tablet_copy_service.cc:161] P aaadfdd9ca9f424c91505f9b43876233: Beginning new tablet copy session on tablet 580883b917314b66883009ddb9259ac0 from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:48232: session id = 3262bf0553e543eea76794fc529a9acc-580883b917314b66883009ddb9259ac0
I20260709 12:09:39.418023 27459 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:39.462533 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:39.420919 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:09:39.469826 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 49065.3us
I20260709 12:09:39.470757 26438 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:39.471571 27357 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.472355 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:39.472652 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:39.473065 26546 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:39.473804 26438 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:39.474575 27357 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.475898 26438 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:39.477428 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:39.480386 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:39.481703 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:39.480899 26471 raft_consensus.cc:2955] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:39.484905 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:39.485850 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:39.486578 26548 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:39.487636 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:39.488798 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:39.486696 26546 raft_consensus.cc:2955] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:39.489792 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:39.490748 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:39.492972 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:39.493306 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:39.490993 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:39.493811 27377 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:39.494225 27377 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:39.491528 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:39.492185 27489 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:39.494647 27377 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:39.495103 26468 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 3: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:39.495002 27489 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.496069 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:39.497282 27489 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:39.492213 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:39.495291 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:39.497992 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:39.499362 27486 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.499752 27486 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:39.500188 27486 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.469766 27461 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.509065 27413 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:39.509402 27377 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.511682 27377 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:39.514623 27466 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:39.517385 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:39.518038 26438 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:39.444420 27460 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.523470 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:39.526316 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:39.527778 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:39.451844 27523 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.532904 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:39.563262 26621 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:39.519563 27459 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.478590 27482 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.512773 27443 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.520256 27357 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:39.570636 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 47249us
I20260709 12:09:39.579634 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:39.579566 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:39.575186 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:39.584967 26622 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 3: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:09:39.589361 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:39.592868 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:39.569201 27432 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.601485 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:39.527238 26467 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 1.
I20260709 12:09:39.575531 27461 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:39.580941 27506 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:39.574762 27416 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:39.739656 27529 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:09:39.597759 27338 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.727677 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:39.715387 27482 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.720307 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:39.578755 27478 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.575205 27483 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:09:39.636196 27510 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:39.811106 27510 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.811815 27344 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:39.812413 27344 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:39.813591 27510 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:39.587764 27364 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:39.815707 27364 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:39.595361 27476 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.597512 27452 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:39.727180 27502 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:39.769055 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:39.817314 27502 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.818315 27507 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:39.807345 27460 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:39.808949 27459 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:39.816428 26548 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:39.783252 27461 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.836592 27502 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:39.787750 27506 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.830296 27344 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:09:39.838431 27530 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:09:39.839232 27506 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:39.853193 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:39.853928 26546 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:39.843253 27531 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 12:09:39.851056 27360 consensus_meta.cc:287] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.507s	user 0.006s	sys 0.006s
I20260709 12:09:39.865202 26546 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
W20260709 12:09:39.868494 27445 consensus_meta.cc:287] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.603s	user 0.007s	sys 0.005s
I20260709 12:09:39.878695 27510 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:09:39.875797 27340 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:39.899104 27166 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:39.893783 27461 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:39.867964 27527 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:09:39.911054 27510 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:39.906703 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:39.872430 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:39.892421 26619 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:39.902884 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:39.920310 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:39.923516 26621 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:39.926046 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:39.927888 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:39.935447 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:39.942858 26620 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:39.947253 27486 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:39.952409 26617 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:39.954921 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:39.958276 27486 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:39.968410 26465 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:39.969373 26466 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:39.971747 27443 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.008812 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:39.974967 27462 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:39.883140 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:39.978454 26369 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57048 (request call id 134) took 3514 ms. Trace:
I20260709 12:09:39.980515 26541 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:40.014806 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:39.980578 26548 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:40.016140 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:40.016618 26548 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:39.984022 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:40.020304 27340 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:40.021672 27481 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:39.984433 26367 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57044 (request call id 139) took 2637 ms. Trace:
I20260709 12:09:39.984628 26547 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:40.022358 27340 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:40.005460 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:40.010782 26369 rpcz_store.cc:276] 0709 12:09:36.463985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:36.464146 (+   161us) service_pool.cc:224] Handling call
0709 12:09:39.978359 (+3514213us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:39.528856 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:39.627243 (+ 98387us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:39.627300 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:09:39.627333 (+    33us) tablet.cc:662] Decoding operations
0709 12:09:39.628138 (+   805us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:39.628249 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:39.628292 (+    43us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:09:39.628751 (+   459us) tablet.cc:701] Row locks acquired
0709 12:09:39.628779 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:09:39.894447 (+265668us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b2c000307a8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e2a0a 00007f50749e2693 00007f50749e2631 00007f5076115902 00007f50761156dd 00007f5079b10243 00007f5079b0fd58 00007f5079b149f1 00007f5079b149a9 00007f5079b14939
0709 12:09:39.937318 (+ 42871us) write_op.cc:270] Start()
0709 12:09:39.937531 (+   213us) write_op.cc:276] Timestamp: P: 1783598979631896 usec, L: 0
0709 12:09:39.937555 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:09:39.938295 (+   740us) log.cc:844] Serialized 1316 byte log entry
0709 12:09:39.955426 (+ 17131us) op_driver.cc:464] REPLICATION: finished
0709 12:09:39.961402 (+  5976us) write_op.cc:301] APPLY: starting
0709 12:09:39.961492 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:39.961657 (+   165us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:39.961680 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:39.962237 (+   557us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:39.962450 (+   213us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:09:39.962497 (+    47us) write_op.cc:312] APPLY: finished
0709 12:09:39.962754 (+   257us) log.cc:844] Serialized 34 byte log entry
0709 12:09:39.966225 (+  3471us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:39.966340 (+   115us) write_op.cc:454] Released schema lock
0709 12:09:39.966413 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:39.985130 (+ 18717us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:39.985166 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":395115,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":5700,"apply.run_cpu_time_us":2243,"apply.run_wall_time_us":23661,"num_ops":3,"prepare.queue_time_us":159411,"prepare.run_cpu_time_us":21040,"prepare.run_wall_time_us":431837,"raft.queue_time_us":6960,"raft.run_cpu_time_us":1335,"raft.run_wall_time_us":8573,"replication_time_us":17705,"spinlock_wait_cycles":6784256,"thread_start_us":133567,"threads_started":4,"wal-append.queue_time_us":7780}]]}
I20260709 12:09:40.029280 26545 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:40.022809 26540 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:40.022960 26367 rpcz_store.cc:276] 0709 12:09:37.346988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:37.347237 (+   249us) service_pool.cc:224] Handling call
0709 12:09:38.217570 (+870333us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b540007d354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076044090 00007f50760e2f3a 00007f507be98e9c 00007f507bf9704e 00007f507a4582a4 00007f507a458232 00007f507a458161 00007f507a4580dc 00007f507a457392 00007f507441548c 00007f50744148c6
0709 12:09:39.984259 (+1766689us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3162,"reported_tablets":7,"spinlock_wait_cycles":1128912256}
I20260709 12:09:40.039564 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:09:40.034813 26613 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:40.041579 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:40.046202 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:40.018230 26539 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:40.062822 27313 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:40.063378 27313 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:40.063962 26514 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:40.065459 27313 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:40.076229 27460 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:40.076725 27491 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:40.077503 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:40.077802 27538 raft_consensus.cc:3055] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:40.076738 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:09:40.067427 27461 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:09:40.081140 27357 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:40.081578 27357 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:40.082564 27357 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:40.083747 27357 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.052831 27489 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:40.086246 27489 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:40.086844 27489 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.090818 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:40.094521 27360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48222 (request call id 2) took 3690 ms. Trace:
I20260709 12:09:40.097050 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:40.098446 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:40.095011 27360 rpcz_store.cc:276] 0709 12:09:36.381475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:36.381973 (+   498us) service_pool.cc:224] Handling call
0709 12:09:36.459644 (+ 77671us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b4c00433440. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50743a6a20 00007f50743b7a29 00007f507437d644 00007f50743a4f2d 00007f50743a4b93 00007f50760331af 00007f5076032f3e 00007f50760b8888 00007f50760d575c 00007f50760d676a 00007f50760d591b
0709 12:09:36.489373 (+ 29729us) log.cc:844] Serialized 506 byte log entry
0709 12:09:36.894858 (+405485us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b2c000c78e8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e2a0a 00007f50749e2693 00007f50749e2631 00007f5076116b52 00007f5076116cf5 00007f5076053691 00007f5076033eaa 00007f507603ad53 00007f507603acd9 00007f507603ac69
0709 12:09:37.125095 (+230237us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b1800047a60. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f5076116d01 00007f5076053691 00007f5076033eaa 00007f507603ad53 00007f507603acd9 00007f507603ac69 00007f507603ac31 00007f5076039dfd 0000000000388634 0000000000388479
0709 12:09:40.071496 (+2946401us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20599,"raft.queue_time_us":41600,"raft.run_cpu_time_us":6661,"raft.run_wall_time_us":602590,"spinlock_wait_cycles":390828416,"thread_start_us":577406,"threads_started":2,"wal-append.queue_time_us":334162,"wal-append.run_cpu_time_us":13116,"wal-append.run_wall_time_us":1024234}
I20260709 12:09:40.061142 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:40.142503 26514 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:40.078248 27538 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:40.147938 27538 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:40.149343 27538 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:40.149647 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:40.151075 26587 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:40.151181 26514 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:40.136560 27376 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.159268 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:40.144695 27507 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.158236 27445 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:40.152710 26632 tablet_copy_source_session.cc:215] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:40.143802 27476 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:09:40.145851 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:40.144673 27478 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:09:40.156672 27482 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.156847 27474 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.184423 27366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580883b917314b66883009ddb9259ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:40.199379 27536 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:09:40.186434 27556 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:09:40.161886 27377 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:09:40.207056 27377 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:40.207456 27377 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:09:40.208066 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 52756.9us
I20260709 12:09:40.208360 26514 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:40.221312 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:40.224462 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:09:40.225188 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:40.229094 27478 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:09:40.225582 27482 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.223155 27536 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.223292 27486 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:09:40.239354 26539 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:40.236533 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:40.235730 27476 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:40.247831 27476 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:40.246889 27456 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:09:40.258921 27545 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:09:40.268013 27489 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:40.225492 27377 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:40.297911 26367 catalog_manager.cc:5697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:40.300498 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:40.305994 26514 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:40.299330 27476 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:40.307842 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:40.310034 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:40.312300 27412 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.312901 27489 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:40.313031 27376 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:40.315984 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:40.316206 27459 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.315799 27340 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.319031 26438 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:40.323670 27459 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.325820 27377 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:40.327399 27340 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:40.332388 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:40.333446 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:40.333577 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:40.305303 26367 catalog_manager.cc:5697] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:40.335537 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:40.339190 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:40.339118 27506 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:09:40.339565 27489 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.342460 26367 catalog_manager.cc:5697] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 3, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:40.351192 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:09:40.356359 27559 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:09:40.360406 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:40.351182 26367 catalog_manager.cc:5697] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:40.369161 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:40.379582 26543 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:40.385015 26544 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:40.387295 26546 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:40.390198 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:40.392524 26367 catalog_manager.cc:5697] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 3, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:40.397715 26367 catalog_manager.cc:5697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 3, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:40.399747 26367 catalog_manager.cc:5697] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 2, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:09:40.408681 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:40.408591 26367 catalog_manager.cc:5697] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:40.413826 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:40.413920 26367 catalog_manager.cc:5697] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:40.386538 26541 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:40.419046 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:40.425041 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:40.410236 27340 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.432375 27357 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.434795 27412 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.423321 27459 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:09:40.444001 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:40.441572 26514 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:40.451274 26543 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:40.458520 27340 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:40.461651 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:40.459317 26367 catalog_manager.cc:5697] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 3, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:40.485440 27340 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.523025 27377 raft_consensus.cc:1064] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:09:40.491328 26367 catalog_manager.cc:5697] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 3, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:40.532605 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 62239.2us
I20260709 12:09:40.534746 26620 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:40.541651 27412 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:40.529111 26367 catalog_manager.cc:5697] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:09:40.532146 27377 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:40.552327 26367 catalog_manager.cc:5697] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b reported cstate change: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
W20260709 12:09:40.541126 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55913.2us
I20260709 12:09:40.567691 26438 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:40.586956 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:40.577200 27462 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.570724 27357 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:09:40.583798 27373 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:40.583566 27480 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:09:40.604689 27441 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:40.610173 27470 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:09:40.620998 27366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56886 (request call id 25) took 1335 ms. Trace:
I20260709 12:09:40.611755 27373 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:40.637184 27441 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:40.631453 27340 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:09:40.722296 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 63593.4us
W20260709 12:09:40.752478 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 144790us
W20260709 12:09:40.749344 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 162493us
I20260709 12:09:40.752784 27445 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:09:40.835199 27566 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 12:09:40.838934 27567 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
W20260709 12:09:40.839901 27568 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 12:09:40.830255 27573 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 12:09:40.852260 27344 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:40.855073 27576 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:09:40.854939 27344 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:40.857120 27569 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:09:40.857481 27344 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:40.854279 27571 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 12:09:40.657877 27366 rpcz_store.cc:276] 0709 12:09:39.277995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:39.280447 (+  2452us) service_pool.cc:224] Handling call
0709 12:09:39.309551 (+ 29104us) ts_tablet_manager.cc:934] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
0709 12:09:40.183052 (+873501us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:09:40.343427 (+160375us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:40.343580 (+   153us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:09:40.570288 (+226708us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:09:40.582783 (+ 12495us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:40.607186 (+ 24403us) ts_tablet_manager.cc:989] Replica registered.
0709 12:09:40.612908 (+  5722us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":431,"tablet-copy.queue_time_us":3446,"thread_start_us":93070,"threads_started":1}
W20260709 12:09:40.884464 27531 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.273s	user 0.002s	sys 0.000s
W20260709 12:09:40.892539 27577 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:09:40.896641 27366 tablet_copy_client.cc:806] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:40.897550 27366 tablet_copy_client.cc:670] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
W20260709 12:09:40.880327 27565 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:09:40.900539 27373 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:40.904928 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 116554us
I20260709 12:09:40.914631 26465 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:40.915387 27165 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.930145 27441 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:40.946918 27560 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:40.948083 26548 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.904686 27340 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:09:40.952186 27574 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.237s	user 0.003s	sys 0.011s
I20260709 12:09:40.954407 26465 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:09:40.953086 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 65268.3us
I20260709 12:09:40.955060 27366 tablet_copy_client.cc:538] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:09:40.959640 27575 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.123s	user 0.003s	sys 0.000s
I20260709 12:09:40.963284 27560 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:40.983315 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:40.984968 26621 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:40.990541 26548 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:40.997653 26465 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:41.000918 26615 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:41.006724 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:41.014153 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:41.015106 26464 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:09:40.986027 27340 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:41.066316 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:41.067149 26618 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
W20260709 12:09:41.067149 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48270.8us
I20260709 12:09:41.088029 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:41.051407 27338 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:09:41.124423 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:41.108963 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:09:41.091593 27377 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:41.157150 27364 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:41.180245 27364 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:41.192103 27364 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:41.192595 27366 tablet_bootstrap.cc:492] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:09:41.202816 27486 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:41.205288 27486 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:09:41.213706 27601 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.126s	user 0.002s	sys 0.000s
I20260709 12:09:41.222378 27592 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:41.222995 27592 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:41.225126 27592 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:41.136264 27506 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
W20260709 12:09:41.239279 26514 consensus_peers.cc:597] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2fc3920d73734952bc159eff19f3567d. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:09:41.274050 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 54978.5us
I20260709 12:09:41.182081 27377 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:41.286626 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 86403.2us
I20260709 12:09:41.301614 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:41.311864 27491 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:41.281104 27364 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:41.315414 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 153207us
I20260709 12:09:41.346788 27377 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:09:41.353886 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 58655.3us
W20260709 12:09:41.377326 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53948.7us
I20260709 12:09:41.389582 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:41.396307 27364 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:41.397918 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:41.398649 26466 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:41.399780 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:41.401180 27608 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.402024 27313 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:41.402750 27313 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.402595 27608 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.403106 27313 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:41.403944 27313 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:41.405346 27313 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.410317 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:41.412959 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:41.413753 26545 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 2: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:09:41.414753 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:09:41.417145 27602 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:09:41.438735 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:41.445742 27612 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.445986 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:09:41.447353 27595 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.261s	user 0.004s	sys 0.003s
I20260709 12:09:41.447628 27466 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.462836 27466 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.537286 26466 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:09:41.548693 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:41.548537 26369 catalog_manager.cc:5697] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 2 to 3, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 3 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:41.547799 26616 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:41.562819 26367 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57044 (request call id 140) took 1292 ms. Trace:
I20260709 12:09:41.560256 27617 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:41.567137 27617 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:41.569576 27617 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:41.560817 27608 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:41.571606 27608 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:41.572528 27608 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:41.574707 27443 raft_consensus.cc:2955] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:41.575682 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:41.576845 26616 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:09:41.578299 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:41.579784 26540 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:41.582602 27481 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:41.587471 27466 raft_consensus.cc:2955] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:41.593313 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:41.601037 26616 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:41.609251 27366 tablet_bootstrap.cc:492] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:09:41.610363 27366 tablet_bootstrap.cc:492] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:09:41.611135 27366 ts_tablet_manager.cc:1403] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.419s	user 0.025s	sys 0.011s
I20260709 12:09:41.603888 27166 raft_consensus.cc:2955] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:41.616487 26467 raft_consensus.cc:2955] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:41.563587 26367 rpcz_store.cc:276] 0709 12:09:40.264804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:40.265415 (+   611us) service_pool.cc:224] Handling call
0709 12:09:41.557422 (+1292007us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:40.902752 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:40.903557 (+   805us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:40.903606 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:09:40.903636 (+    30us) tablet.cc:662] Decoding operations
0709 12:09:40.937944 (+ 34308us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:40.945525 (+  7581us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:40.950143 (+  4618us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:09:40.956415 (+  6272us) tablet.cc:701] Row locks acquired
0709 12:09:40.956435 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:09:40.956585 (+   150us) write_op.cc:270] Start()
0709 12:09:40.956702 (+   117us) write_op.cc:276] Timestamp: P: 1783598980956541 usec, L: 0
0709 12:09:40.956717 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 12:09:40.957421 (+   704us) log.cc:844] Serialized 5236 byte log entry
0709 12:09:41.136440 (+179019us) op_driver.cc:464] REPLICATION: finished
0709 12:09:41.349776 (+213336us) write_op.cc:301] APPLY: starting
0709 12:09:41.349855 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:41.350116 (+   261us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:41.372989 (+ 22873us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:41.458765 (+ 85776us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5c0016490c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507c2cc331 00007f507c2cc221 00007f507c2c6f6c 00007f5079a2730b 00007f5079a26fd3 00007f5079b25e34 00007f5079b1197c 00007f5079b15d61 00007f5079b15d19 00007f5079b15ca9 00007f5079b15c71
0709 12:09:41.459950 (+  1185us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:41.460199 (+   249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:09:41.460243 (+    44us) write_op.cc:312] APPLY: finished
0709 12:09:41.460588 (+   345us) log.cc:844] Serialized 94 byte log entry
0709 12:09:41.474646 (+ 14058us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:41.485094 (+ 10448us) write_op.cc:454] Released schema lock
0709 12:09:41.487934 (+  2840us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:41.500191 (+ 12257us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:41.500230 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":532,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":189087,"apply.run_cpu_time_us":8269,"apply.run_wall_time_us":148008,"num_ops":13,"prepare.queue_time_us":169359,"prepare.run_cpu_time_us":5515,"prepare.run_wall_time_us":74092,"replication_time_us":133538,"spinlock_wait_cycles":23561600,"thread_start_us":253328,"threads_started":2}]]}
I20260709 12:09:41.607510 27134 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:41.626158 27443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:44692 (request call id 2) took 1477 ms. Trace:
I20260709 12:09:41.646888 27617 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:41.663697 27617 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:41.664400 27617 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:41.659186 27443 rpcz_store.cc:276] 0709 12:09:40.148422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:40.152534 (+  4112us) service_pool.cc:224] Handling call
0709 12:09:40.187835 (+ 35301us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b54001f0f20. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f5076057520 00007f50760e0b42 00007f50760df800 00007f507b0a0d29 00007f507461f1d4 00007f507461f162 00007f507461f091 00007f507461f00c 00007f507461e2c2 00007f507441548c
0709 12:09:40.251685 (+ 63850us) log.cc:844] Serialized 506 byte log entry
0709 12:09:40.885451 (+633766us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b4c001f2a40. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50743a6a20 00007f50743b7a29 00007f50743b813f 00007f507437c2ab 00007f50743a9f3c 00007f50743aa3fe 00007f507463750b 00007f5076036381 00007f507603426b 00007f507603ad53 00007f507603acd9
0709 12:09:40.886488 (+  1037us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b180021ae00. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f5076116d01 00007f5076053691 00007f5076033eaa 00007f507603ad53 00007f507603acd9 00007f507603ac69 00007f507603ac31 00007f5076039dfd 0000000000388634 0000000000388479
0709 12:09:40.966606 (+ 80118us) spinlock_profiling.cc:243] Waited 53.6 ms on lock 0x7b180018dcc0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fbb2a6 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f507605ab26 00007f507605449a 00007f5076053714
0709 12:09:41.059114 (+ 92508us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b54001f0f20. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f507605ab26 00007f507605449a 00007f5076053714 00007f5076033eaa 00007f507603ad53 00007f507603acd9 00007f507603ac69 00007f507603ac31 00007f5076039dfd 0000000000388634
0709 12:09:41.216551 (+157437us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b4c001f2c00. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50743a6a20 00007f50743b7a29 00007f50743b813f 00007f507437c2ab 00007f50743a9f3c 00007f50743aa3fe 00007f507463750b 00007f5076036381 00007f507603426b 00007f507603ad53 00007f507603acd9
0709 12:09:41.626028 (+409477us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105129,"raft.queue_time_us":9818,"raft.run_cpu_time_us":31709,"raft.run_wall_time_us":1059379,"spinlock_wait_cycles":249885824,"thread_start_us":361499,"threads_started":1,"wal-append.queue_time_us":375761}
I20260709 12:09:41.639022 26369 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39184 (request call id 25) took 1352 ms. Trace:
I20260709 12:09:41.689253 26369 rpcz_store.cc:276] 0709 12:09:40.286311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:40.286487 (+   176us) service_pool.cc:224] Handling call
0709 12:09:41.638951 (+1352464us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:41.620530 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:41.621397 (+   867us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:41.621435 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:09:41.621453 (+    18us) tablet.cc:662] Decoding operations
0709 12:09:41.621827 (+   374us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:41.621905 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:41.621935 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:09:41.623466 (+  1531us) tablet.cc:701] Row locks acquired
0709 12:09:41.623491 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:09:41.623655 (+   164us) write_op.cc:270] Start()
0709 12:09:41.623804 (+   149us) write_op.cc:276] Timestamp: P: 1783598981623609 usec, L: 0
0709 12:09:41.623827 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:09:41.624493 (+   666us) log.cc:844] Serialized 535 byte log entry
0709 12:09:41.626615 (+  2122us) op_driver.cc:464] REPLICATION: finished
0709 12:09:41.627107 (+   492us) write_op.cc:301] APPLY: starting
0709 12:09:41.627200 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:41.627307 (+   107us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:41.627404 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:41.627619 (+   215us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:41.627773 (+   154us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:09:41.627816 (+    43us) write_op.cc:312] APPLY: finished
0709 12:09:41.628000 (+   184us) log.cc:844] Serialized 22 byte log entry
0709 12:09:41.628185 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:41.628293 (+   108us) write_op.cc:454] Released schema lock
0709 12:09:41.628337 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:41.628698 (+   361us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:41.628729 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23636,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":247,"apply.run_cpu_time_us":1563,"apply.run_wall_time_us":1582,"num_ops":1,"prepare.queue_time_us":56653,"prepare.run_cpu_time_us":2873,"prepare.run_wall_time_us":4314,"replication_time_us":2634,"thread_start_us":55308,"threads_started":1}]]}
I20260709 12:09:41.746970 27617 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:41.749434 27617 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:41.751515 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:41.698532 26618 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:41.756062 27536 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:41.756690 27536 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:41.759083 27536 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:41.632330 26540 raft_consensus.cc:2955] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:41.633309 27366 raft_consensus.cc:359] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:41.760324 27366 raft_consensus.cc:886] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Ignoring setting pending config change with OpId 1.2 because the committed config has OpId index 2. The config change we are ignoring is: Old config: { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:41.761761 27366 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:09:41.762615 27366 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:41.636268 26370 catalog_manager.cc:5697] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:09:41.767081 26370 catalog_manager.cc:5697] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 1 to 3, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 3 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:41.768937 26370 catalog_manager.cc:5697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:09:41.644219 26473 raft_consensus.cc:2955] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:41.771247 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:41.772130 26545 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:09:41.649443 26616 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:09:41.752195 27624 ts_tablet_manager.cc:933] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:41.782449 27366 ts_tablet_manager.cc:1434] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.171s	user 0.007s	sys 0.004s
I20260709 12:09:41.782850 26545 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:41.784952 26632 tablet_copy_service.cc:342] P aaadfdd9ca9f424c91505f9b43876233: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-580883b917314b66883009ddb9259ac0 received from {username='slave'} at 127.0.0.1:48232
I20260709 12:09:41.785445 26632 tablet_copy_service.cc:434] P aaadfdd9ca9f424c91505f9b43876233: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-580883b917314b66883009ddb9259ac0 on tablet 580883b917314b66883009ddb9259ac0 with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:41.791896 26622 raft_consensus.cc:2955] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:41.804492 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:41.805228 26466 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:09:41.815205 26617 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:09:41.823570 27134 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:41.817704 27624 tablet_copy_client.cc:323] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.66:40567
I20260709 12:09:41.824505 27617 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:41.827657 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:41.830188 26558 tablet_copy_service.cc:140] P ac3ac2181aa941229a758ccf6b5607cd: Received BeginTabletCopySession request for tablet 2fc3920d73734952bc159eff19f3567d from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:44706)
I20260709 12:09:41.831084 26558 tablet_copy_service.cc:161] P ac3ac2181aa941229a758ccf6b5607cd: Beginning new tablet copy session on tablet 2fc3920d73734952bc159eff19f3567d from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:44706: session id = 3262bf0553e543eea76794fc529a9acc-2fc3920d73734952bc159eff19f3567d
I20260709 12:09:41.835662 26369 catalog_manager.cc:5697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:41.844378 27617 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:09:41.845543 27617 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:41.828771 26617 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 2: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:09:41.850311 27584 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:41.850885 26588 consensus_peers.cc:597] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3ce8bbdf417f47e7aabb967886d8c95a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:41.857247 26540 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:41.865978 27338 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:41.863395 26367 catalog_manager.cc:5697] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 2 to 3, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 3 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:09:41.884948 26465 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:41.886448 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:41.887081 27466 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:41.888381 26558 tablet_copy_source_session.cc:215] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:41.890864 27536 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:41.891366 27536 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:09:41.891793 27536 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.879849 26367 catalog_manager.cc:5697] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 2 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:41.914485 27624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fc3920d73734952bc159eff19f3567d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:41.959064 27591 raft_consensus.cc:2955] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:41.965682 27536 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:41.988216 26545 raft_consensus.cc:2955] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:41.996498 26370 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57048 (request call id 135) took 1031 ms. Trace:
W20260709 12:09:42.015369 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 71057.8us
I20260709 12:09:42.015007 26465 raft_consensus.cc:2955] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:41.997032 26370 rpcz_store.cc:276] 0709 12:09:40.965350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:40.965492 (+   142us) service_pool.cc:224] Handling call
0709 12:09:41.008300 (+ 42808us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b540007d354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076044090 00007f50760e2f3a 00007f507be98e9c 00007f507bf9704e 00007f507a4582a4 00007f507a458232 00007f507a458161 00007f507a4580dc 00007f507a457392 00007f507441548c 00007f50744148c6
0709 12:09:41.996414 (+988114us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:41.806549 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:41.807189 (+   640us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:41.807248 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:09:41.807270 (+    22us) tablet.cc:662] Decoding operations
0709 12:09:41.807826 (+   556us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:41.807906 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:41.807936 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:09:41.808272 (+   336us) tablet.cc:701] Row locks acquired
0709 12:09:41.808293 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:09:41.808439 (+   146us) write_op.cc:270] Start()
0709 12:09:41.808557 (+   118us) write_op.cc:276] Timestamp: P: 1783598981808392 usec, L: 0
0709 12:09:41.808581 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:09:41.809255 (+   674us) log.cc:844] Serialized 1316 byte log entry
0709 12:09:41.814164 (+  4909us) spinlock_profiling.cc:243] Waited 980 us on lock 0x7b540007d8a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076044090 00007f50760516b8 00007f50760512fa 00007f50760d5965 00007f50760d5e09 00007f5079b10581 00007f5079b0fd58 00007f5079b149f1 00007f5079b149a9 00007f5079b14939 00007f5079b14901
0709 12:09:41.814690 (+   526us) op_driver.cc:464] REPLICATION: finished
0709 12:09:41.817101 (+  2411us) write_op.cc:301] APPLY: starting
0709 12:09:41.817178 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:41.817323 (+   145us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:41.817343 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:41.817690 (+   347us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:41.817843 (+   153us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:09:41.817890 (+    47us) write_op.cc:312] APPLY: finished
0709 12:09:41.818088 (+   198us) log.cc:844] Serialized 34 byte log entry
0709 12:09:41.818244 (+   156us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:41.818346 (+   102us) write_op.cc:454] Released schema lock
0709 12:09:41.818418 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:41.818744 (+   326us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:41.818769 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10150,"reported_tablets":20,"spinlock_wait_cycles":11893120,"child_traces":[["op",{"apply.queue_time_us":2226,"apply.run_cpu_time_us":1620,"apply.run_wall_time_us":1620,"num_ops":3,"prepare.queue_time_us":473,"prepare.run_cpu_time_us":5805,"prepare.run_wall_time_us":7834,"replication_time_us":5980,"spinlock_wait_cycles":2253184}]]}
I20260709 12:09:42.047806 27536 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:42.083793 26369 catalog_manager.cc:5697] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 3 to 4, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 4 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:42.082798 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:42.097484 26468 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:09:42.099407 26367 catalog_manager.cc:5697] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b reported cstate change: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:42.131580 27165 raft_consensus.cc:1217] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:42.132580 27165 raft_consensus.cc:2962] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Ignoring commit of config change with OpId 1.2 because the committed config has OpId index 2. The config change we are ignoring is: Old config: { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:42.160828 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:42.165123 27633 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:42.165720 27633 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:09:42.166777 27631 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:09:42.166795 27633 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:42.175681 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:42.176607 26616 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 2: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:09:42.179587 26369 catalog_manager.cc:5697] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b reported cstate change: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:42.201133 27624 tablet_copy_client.cc:806] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:42.201929 27624 tablet_copy_client.cc:670] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:42.216406 26466 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:42.226500 27466 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:42.227954 27466 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:42.239949 27466 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:42.242832 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:42.243525 26545 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:42.246516 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:42.247931 27338 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:42.248440 27338 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:42.248873 27338 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:42.258701 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:42.262267 27366 ts_tablet_manager.cc:933] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:42.272933 26617 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:09:42.281868 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 47149.9us
I20260709 12:09:42.273842 27338 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:42.278542 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44127.2us
I20260709 12:09:42.285135 27366 tablet_copy_client.cc:323] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.67:42217
I20260709 12:09:42.292753 27608 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:42.295222 27624 tablet_copy_client.cc:538] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:42.299309 26632 tablet_copy_service.cc:140] P aaadfdd9ca9f424c91505f9b43876233: Received BeginTabletCopySession request for tablet 3ce8bbdf417f47e7aabb967886d8c95a from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:48232)
I20260709 12:09:42.299991 26632 tablet_copy_service.cc:161] P aaadfdd9ca9f424c91505f9b43876233: Beginning new tablet copy session on tablet 3ce8bbdf417f47e7aabb967886d8c95a from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:48232: session id = 3262bf0553e543eea76794fc529a9acc-3ce8bbdf417f47e7aabb967886d8c95a
I20260709 12:09:42.315994 27338 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:42.317689 26621 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:42.321501 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:42.321666 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:42.330418 26547 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:42.333266 27165 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.336830 27466 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.348606 26545 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:09:42.350471 27617 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:42.356626 26632 tablet_copy_source_session.cc:215] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:42.368063 27366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce8bbdf417f47e7aabb967886d8c95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:42.357641 27165 raft_consensus.cc:2955] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:42.353456 27338 raft_consensus.cc:2955] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:42.378345 26467 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:09:42.380049 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 66958.8us
I20260709 12:09:42.403244 26617 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:09:42.407647 27617 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:09:42.409101 26371 catalog_manager.cc:5697] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:42.423658 27466 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.361972 27624 tablet_bootstrap.cc:492] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:09:42.370106 26547 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
W20260709 12:09:42.370594 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 50240.7us
I20260709 12:09:42.429018 27582 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:42.445674 27591 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:42.446365 27591 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:42.448839 27591 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:42.465684 26358 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 86001e7eca0b4ca4aed965b7d7e5820c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:42.503793 27366 tablet_copy_client.cc:806] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:42.504980 27366 tablet_copy_client.cc:670] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:42.520967 27366 tablet_copy_client.cc:538] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:42.524121 27640 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:42.524953 27640 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:42.528570 27640 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:42.529337 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:42.530318 26622 raft_consensus.cc:2368] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3.
I20260709 12:09:42.532094 26439 leader_election.cc:400] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3.
I20260709 12:09:42.532481 26439 leader_election.cc:403] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:09:42.533272 27587 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:42.542446 27366 tablet_bootstrap.cc:492] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:09:42.568243 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:09:42.569876 27466 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:42.570427 27466 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:42.571349 27466 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:42.585732 26369 catalog_manager.cc:5697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 3 to 4, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:42.609722 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:42.610668 26473 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:42.613415 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:42.595904 26468 raft_consensus.cc:2955] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:42.638365 26621 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:42.615500 27587 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3.
I20260709 12:09:42.682314 27489 raft_consensus.cc:1064] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:09:42.685849 27489 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:42.689839 26466 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:42.719509 27366 tablet_bootstrap.cc:492] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:09:42.720230 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 81590.1us
W20260709 12:09:42.720395 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 48841.4us
I20260709 12:09:42.716598 27608 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:09:42.738173 27373 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:09:42.763139 27366 tablet_bootstrap.cc:492] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:09:42.764006 27366 ts_tablet_manager.cc:1403] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.222s	user 0.020s	sys 0.019s
W20260709 12:09:42.772648 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 50355.2us
I20260709 12:09:42.772891 27624 tablet_bootstrap.cc:492] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:42.773530 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:42.773530 27165 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.774636 27338 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:42.775056 27338 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:42.775442 27338 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:42.776491 27591 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:42.775396 27624 tablet_bootstrap.cc:492] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:09:42.786211 27624 ts_tablet_manager.cc:1403] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.424s	user 0.041s	sys 0.035s
I20260709 12:09:42.786985 27338 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:42.793991 26545 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.796954 26468 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.801247 26369 catalog_manager.cc:5697] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 1 to 3, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 3 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:42.804618 27366 raft_consensus.cc:359] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:42.806528 27366 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:09:42.807250 27366 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:42.809834 27366 ts_tablet_manager.cc:1434] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 12:09:42.810217 27338 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:42.811663 26632 tablet_copy_service.cc:342] P aaadfdd9ca9f424c91505f9b43876233: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-3ce8bbdf417f47e7aabb967886d8c95a received from {username='slave'} at 127.0.0.1:48232
I20260709 12:09:42.812148 26632 tablet_copy_service.cc:434] P aaadfdd9ca9f424c91505f9b43876233: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-3ce8bbdf417f47e7aabb967886d8c95a on tablet 3ce8bbdf417f47e7aabb967886d8c95a with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:42.816560 27624 raft_consensus.cc:359] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:42.817497 27624 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:09:42.827869 27624 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:42.832545 27624 ts_tablet_manager.cc:1434] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
W20260709 12:09:42.835245 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 106696us
I20260709 12:09:42.834699 26558 tablet_copy_service.cc:342] P ac3ac2181aa941229a758ccf6b5607cd: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-2fc3920d73734952bc159eff19f3567d received from {username='slave'} at 127.0.0.1:44706
I20260709 12:09:42.836434 26558 tablet_copy_service.cc:434] P ac3ac2181aa941229a758ccf6b5607cd: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-2fc3920d73734952bc159eff19f3567d on tablet 2fc3920d73734952bc159eff19f3567d with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:42.842769 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:42.843564 26545 raft_consensus.cc:2368] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3.
I20260709 12:09:42.863498 27466 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.867550 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:42.870033 27653 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:42.881531 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:42.916689 27165 raft_consensus.cc:1217] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:42.917464 26532 tablet_service.cc:1558] Processing DeleteTablet for tablet 86001e7eca0b4ca4aed965b7d7e5820c with delete_type TABLET_DATA_TOMBSTONED (TS ac3ac2181aa941229a758ccf6b5607cd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55084
I20260709 12:09:42.920569 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:42.921352 27656 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:42.925566 26622 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:09:42.927600 26438 leader_election.cc:400] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3.
I20260709 12:09:42.951198 27466 raft_consensus.cc:2955] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:42.962116 26467 raft_consensus.cc:2955] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:42.966600 27165 raft_consensus.cc:2955] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:42.970952 26545 raft_consensus.cc:2955] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:42.987998 26370 catalog_manager.cc:5697] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 1 to 2, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 2 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:43.009398 27661 tablet_replica.cc:333] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:09:43.010607 27661 raft_consensus.cc:2243] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:09:43.026325 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 97092.3us
I20260709 12:09:43.034726 26467 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:43.036656 27466 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:43.041976 26545 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:43.043720 27338 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:43.061174 27661 raft_consensus.cc:2272] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:43.067622 26371 catalog_manager.cc:5697] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:43.075160 27373 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:43.076223 27373 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:43.076752 27373 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:43.077785 27373 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:43.079900 27373 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.089306 26622 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:43.104159 27165 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.105976 27466 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:43.094122 27661 ts_tablet_manager.cc:1916] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:43.118256 27656 raft_consensus.cc:2955] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:43.143932 27165 raft_consensus.cc:2955] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:43.146641 27661 ts_tablet_manager.cc:1929] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:43.147197 27661 log.cc:1199] T 86001e7eca0b4ca4aed965b7d7e5820c P ac3ac2181aa941229a758ccf6b5607cd: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-1-root/wals/86001e7eca0b4ca4aed965b7d7e5820c
I20260709 12:09:43.153075 26540 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.157181 27655 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.159868 26357 catalog_manager.cc:5028] TS ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): tablet 86001e7eca0b4ca4aed965b7d7e5820c (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:09:43.167658 26540 raft_consensus.cc:2955] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:43.187775 26358 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 580883b917314b66883009ddb9259ac0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:43.212692 27506 raft_consensus.cc:1064] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:09:43.215760 27506 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:43.218242 26368 catalog_manager.cc:5697] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index 3 to 4, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:43.251513 26455 tablet_service.cc:1558] Processing DeleteTablet for tablet 580883b917314b66883009ddb9259ac0 with delete_type TABLET_DATA_TOMBSTONED (TS 01a57027214a411e80874ac7febd628b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43588
I20260709 12:09:43.260792 27165 raft_consensus.cc:1217] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:09:43.272917 27666 tablet_replica.cc:333] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:09:43.274562 27666 raft_consensus.cc:2243] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:43.276371 27666 raft_consensus.cc:2272] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:43.280580 27666 ts_tablet_manager.cc:1916] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:43.285472 27165 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.290416 26618 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.293924 27536 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.294860 27657 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.306066 26467 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.311028 27443 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:43.338191 27443 raft_consensus.cc:2955] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:43.343247 27666 ts_tablet_manager.cc:1929] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:43.363593 27666 log.cc:1199] T 580883b917314b66883009ddb9259ac0 P 01a57027214a411e80874ac7febd628b: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-0-root/wals/580883b917314b66883009ddb9259ac0
I20260709 12:09:43.350313 26473 raft_consensus.cc:2955] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:43.391808 26357 catalog_manager.cc:5028] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): tablet 580883b917314b66883009ddb9259ac0 (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:09:43.384708 26616 raft_consensus.cc:2955] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:43.379292 27165 raft_consensus.cc:2955] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:43.405108 26367 catalog_manager.cc:5697] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b reported cstate change: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:43.431063 26545 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:43.454012 27166 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.479789 27634 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:43.490079 27506 raft_consensus.cc:2955] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:43.498289 27166 raft_consensus.cc:2955] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:43.526011 26367 catalog_manager.cc:5697] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index 3 to 4, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:43.549957 26357 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2fc3920d73734952bc159eff19f3567d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:43.560899 26622 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.569446 26455 tablet_service.cc:1558] Processing DeleteTablet for tablet 2fc3920d73734952bc159eff19f3567d with delete_type TABLET_DATA_TOMBSTONED (TS 01a57027214a411e80874ac7febd628b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43588
I20260709 12:09:43.570521 27666 tablet_replica.cc:333] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:09:43.571617 27666 raft_consensus.cc:2243] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:43.572100 27506 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.572490 27666 raft_consensus.cc:2272] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:43.577000 27666 ts_tablet_manager.cc:1916] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:43.582194 26622 raft_consensus.cc:2955] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:43.620946 27666 ts_tablet_manager.cc:1929] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:43.629036 27666 log.cc:1199] T 2fc3920d73734952bc159eff19f3567d P 01a57027214a411e80874ac7febd628b: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-0-root/wals/2fc3920d73734952bc159eff19f3567d
I20260709 12:09:43.645491 26357 catalog_manager.cc:5028] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): tablet 2fc3920d73734952bc159eff19f3567d (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
W20260709 12:09:43.756814 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 43614.9us
I20260709 12:09:43.762208 27466 raft_consensus.cc:1064] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:09:43.765964 27466 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:43.803224 27166 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:43.812186 27466 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:43.823869 26466 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:43.836186 26547 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:43.843779 27338 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:43.865000 27466 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:43.957623 27466 raft_consensus.cc:2955] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:43.958664 27167 raft_consensus.cc:2955] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:43.983489 26545 raft_consensus.cc:2955] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:43.992825 26367 catalog_manager.cc:5697] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:44.008468 26468 raft_consensus.cc:2955] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:44.084694 26615 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:44.093036 27166 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:44.093676 26466 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:44.094897 27656 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:44.101866 27466 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:44.108665 27466 raft_consensus.cc:2955] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:44.111802 27167 raft_consensus.cc:2955] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:44.143270 26468 raft_consensus.cc:2955] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:44.185349 26371 catalog_manager.cc:5697] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 4 to 5, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:44.186872 26358 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3ce8bbdf417f47e7aabb967886d8c95a with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:44.339100 26532 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ce8bbdf417f47e7aabb967886d8c95a with delete_type TABLET_DATA_TOMBSTONED (TS ac3ac2181aa941229a758ccf6b5607cd not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:55084
I20260709 12:09:44.357360 27536 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:44.357987 27536 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:44.364053 27679 tablet_replica.cc:333] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:09:44.364914 27536 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:44.368803 27679 raft_consensus.cc:2243] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:44.369071 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:44.369757 26615 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:09:44.370373 27679 raft_consensus.cc:2272] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:44.378646 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:44.381743 27536 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:44.382223 27536 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:44.384032 27536 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:44.391515 27679 ts_tablet_manager.cc:1916] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:44.393296 27536 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:44.396723 27536 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:44.403040 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:44.414736 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:44.418593 27679 ts_tablet_manager.cc:1929] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:09:44.419238 27679 log.cc:1199] T 3ce8bbdf417f47e7aabb967886d8c95a P ac3ac2181aa941229a758ccf6b5607cd: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-1-root/wals/3ce8bbdf417f47e7aabb967886d8c95a
I20260709 12:09:44.421924 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:44.422624 26615 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:44.436731 26615 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:09:44.442085 26357 catalog_manager.cc:5028] TS ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): tablet 3ce8bbdf417f47e7aabb967886d8c95a (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:09:44.457520 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:09:44.458513 27506 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:44.459010 27506 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:44.459901 27506 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:44.493970 27662 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:44.494626 27662 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:44.499734 27662 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:44.500996 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:44.512698 26615 raft_consensus.cc:2368] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4.
I20260709 12:09:44.509425 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:44.515391 26439 leader_election.cc:400] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4.
I20260709 12:09:44.515749 26439 leader_election.cc:403] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:09:44.516404 27662 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:09:44.537314 26367 catalog_manager.cc:5697] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:44.539096 27662 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4.
I20260709 12:09:44.939162 26616 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:44.973160 27506 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:45.072909 26465 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:45.089490 27536 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.448220 26545 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:45.494966 26615 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.499934 26469 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.501108 27690 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:45.503175 27506 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:45.508862 26514 consensus_peers.cc:597] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f6ba7060b20a4d598344385607b29c70. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:45.559266 27678 raft_consensus.cc:2955] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:45.561792 26615 raft_consensus.cc:2955] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:45.564049 26469 raft_consensus.cc:2955] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:45.584311 26367 catalog_manager.cc:5697] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b reported cstate change: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:45.581220 26469 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
W20260709 12:09:45.626688 26439 consensus_peers.cc:597] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3d83c4273cd74e768f756e0c8ba65432. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:45.629060 26545 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.631433 26615 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.632478 27662 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:45.633715 27688 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.823912 26540 raft_consensus.cc:2955] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:45.821026 27703 raft_consensus.cc:2955] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
W20260709 12:09:45.904191 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 49374.8us
W20260709 12:09:45.931648 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 80238.2us
I20260709 12:09:45.921514 26615 raft_consensus.cc:2955] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:45.963181 26620 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:45.991729 26371 catalog_manager.cc:5697] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
W20260709 12:09:46.066076 26588 consensus_peers.cc:597] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 72e7c4f1de5d4e28a4c1bf09d4fb099b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:46.066371 26545 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:46.067256 26465 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:46.071255 27704 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.082588 27702 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.125063 27711 ts_tablet_manager.cc:933] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:46.129354 27710 ts_tablet_manager.cc:933] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149)
I20260709 12:09:46.143272 27711 tablet_copy_client.cc:323] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.66:40567
I20260709 12:09:46.146620 26558 tablet_copy_service.cc:140] P ac3ac2181aa941229a758ccf6b5607cd: Received BeginTabletCopySession request for tablet f6ba7060b20a4d598344385607b29c70 from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:44706)
I20260709 12:09:46.147389 26558 tablet_copy_service.cc:161] P ac3ac2181aa941229a758ccf6b5607cd: Beginning new tablet copy session on tablet f6ba7060b20a4d598344385607b29c70 from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:44706: session id = 3262bf0553e543eea76794fc529a9acc-f6ba7060b20a4d598344385607b29c70
I20260709 12:09:46.146129 27704 raft_consensus.cc:2955] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:46.161471 26558 tablet_copy_source_session.cc:215] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:46.160351 26468 raft_consensus.cc:2955] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:46.169051 27710 tablet_copy_client.cc:323] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.65:45149
I20260709 12:09:46.171588 26483 tablet_copy_service.cc:140] P 01a57027214a411e80874ac7febd628b: Received BeginTabletCopySession request for tablet 3d83c4273cd74e768f756e0c8ba65432 from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:54414)
I20260709 12:09:46.172621 26483 tablet_copy_service.cc:161] P 01a57027214a411e80874ac7febd628b: Beginning new tablet copy session on tablet 3d83c4273cd74e768f756e0c8ba65432 from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:54414: session id = 3262bf0553e543eea76794fc529a9acc-3d83c4273cd74e768f756e0c8ba65432
I20260709 12:09:46.180696 26540 raft_consensus.cc:2955] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:46.187188 26483 tablet_copy_source_session.cc:215] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:46.186628 26547 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:46.179689 27711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ba7060b20a4d598344385607b29c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:46.197991 27710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d83c4273cd74e768f756e0c8ba65432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:46.199082 26370 catalog_manager.cc:5697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 3 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:46.228366 26465 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:46.228828 26620 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:46.228857 26514 consensus_peers.cc:597] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 68aec546ef604f45adc4b6dedb13e41f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:46.232451 27691 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:46.235133 27691 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:46.253115 27711 tablet_copy_client.cc:806] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:46.254089 27711 tablet_copy_client.cc:670] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:46.266541 27710 tablet_copy_client.cc:806] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:46.267339 27710 tablet_copy_client.cc:670] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:46.273104 27711 tablet_copy_client.cc:538] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:46.279883 27536 raft_consensus.cc:2955] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:46.284648 27710 tablet_copy_client.cc:538] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:46.288369 26620 raft_consensus.cc:2955] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:46.296190 27711 tablet_bootstrap.cc:492] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:09:46.338526 27710 tablet_bootstrap.cc:492] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:09:46.355372 26468 raft_consensus.cc:2955] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:46.393674 26370 catalog_manager.cc:5697] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:46.463728 27710 tablet_bootstrap.cc:492] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:46.464787 27710 tablet_bootstrap.cc:492] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:09:46.466615 27710 ts_tablet_manager.cc:1403] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.128s	user 0.028s	sys 0.009s
I20260709 12:09:46.470229 27710 raft_consensus.cc:359] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:46.479382 27710 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:09:46.480315 27710 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
W20260709 12:09:46.488306 27711 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:09:46.501663 27710 ts_tablet_manager.cc:1434] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.001s
I20260709 12:09:46.504451 26483 tablet_copy_service.cc:342] P 01a57027214a411e80874ac7febd628b: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-3d83c4273cd74e768f756e0c8ba65432 received from {username='slave'} at 127.0.0.1:54414
I20260709 12:09:46.505046 26483 tablet_copy_service.cc:434] P 01a57027214a411e80874ac7febd628b: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-3d83c4273cd74e768f756e0c8ba65432 on tablet 3d83c4273cd74e768f756e0c8ba65432 with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:46.508595 27711 tablet_bootstrap.cc:492] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:46.510078 27711 tablet_bootstrap.cc:492] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:09:46.516690 27711 ts_tablet_manager.cc:1403] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.221s	user 0.021s	sys 0.012s
I20260709 12:09:46.522498 27711 raft_consensus.cc:359] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:46.523487 27711 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:09:46.524252 27711 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:46.554785 27711 ts_tablet_manager.cc:1434] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:09:46.567137 26558 tablet_copy_service.cc:342] P ac3ac2181aa941229a758ccf6b5607cd: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-f6ba7060b20a4d598344385607b29c70 received from {username='slave'} at 127.0.0.1:44706
I20260709 12:09:46.567655 26558 tablet_copy_service.cc:434] P ac3ac2181aa941229a758ccf6b5607cd: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-f6ba7060b20a4d598344385607b29c70 on tablet f6ba7060b20a4d598344385607b29c70 with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:46.572575 27710 ts_tablet_manager.cc:933] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:46.587509 27710 tablet_copy_client.cc:323] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.67:42217
I20260709 12:09:46.589907 26632 tablet_copy_service.cc:140] P aaadfdd9ca9f424c91505f9b43876233: Received BeginTabletCopySession request for tablet 72e7c4f1de5d4e28a4c1bf09d4fb099b from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:48232)
I20260709 12:09:46.590633 26632 tablet_copy_service.cc:161] P aaadfdd9ca9f424c91505f9b43876233: Beginning new tablet copy session on tablet 72e7c4f1de5d4e28a4c1bf09d4fb099b from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:48232: session id = 3262bf0553e543eea76794fc529a9acc-72e7c4f1de5d4e28a4c1bf09d4fb099b
I20260709 12:09:46.609262 26632 tablet_copy_source_session.cc:215] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:46.617122 27710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72e7c4f1de5d4e28a4c1bf09d4fb099b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:46.657687 27166 raft_consensus.cc:1217] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:46.682600 27710 tablet_copy_client.cc:806] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:46.684320 27710 tablet_copy_client.cc:670] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:46.690287 27710 tablet_copy_client.cc:538] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:46.703951 27710 tablet_bootstrap.cc:492] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:09:46.731874 27710 tablet_bootstrap.cc:492] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:46.733055 27710 tablet_bootstrap.cc:492] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:09:46.733961 27710 ts_tablet_manager.cc:1403] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.030s	user 0.029s	sys 0.000s
I20260709 12:09:46.737850 27710 raft_consensus.cc:359] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:46.739163 27710 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:09:46.739955 27710 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:46.750977 27710 ts_tablet_manager.cc:1434] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:09:46.762328 26632 tablet_copy_service.cc:342] P aaadfdd9ca9f424c91505f9b43876233: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-72e7c4f1de5d4e28a4c1bf09d4fb099b received from {username='slave'} at 127.0.0.1:48232
I20260709 12:09:46.763005 26632 tablet_copy_service.cc:434] P aaadfdd9ca9f424c91505f9b43876233: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-72e7c4f1de5d4e28a4c1bf09d4fb099b on tablet 72e7c4f1de5d4e28a4c1bf09d4fb099b with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:46.823167 27710 ts_tablet_manager.cc:933] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:46.833571 27710 tablet_copy_client.cc:323] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.66:40567
I20260709 12:09:46.835638 26558 tablet_copy_service.cc:140] P ac3ac2181aa941229a758ccf6b5607cd: Received BeginTabletCopySession request for tablet 68aec546ef604f45adc4b6dedb13e41f from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:44706)
I20260709 12:09:46.836295 26558 tablet_copy_service.cc:161] P ac3ac2181aa941229a758ccf6b5607cd: Beginning new tablet copy session on tablet 68aec546ef604f45adc4b6dedb13e41f from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:44706: session id = 3262bf0553e543eea76794fc529a9acc-68aec546ef604f45adc4b6dedb13e41f
I20260709 12:09:46.852306 26558 tablet_copy_source_session.cc:215] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:46.856019 27710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68aec546ef604f45adc4b6dedb13e41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:46.932080 27710 tablet_copy_client.cc:806] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:46.932783 27710 tablet_copy_client.cc:670] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:46.936836 27710 tablet_copy_client.cc:538] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:46.965116 27710 tablet_bootstrap.cc:492] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:09:47.007937 27706 raft_consensus.cc:1064] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:09:47.015689 27706 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:47.068524 27166 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:47.068974 26618 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:47.073056 27705 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:47.073943 26540 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:47.075282 27705 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:47.080967 27166 raft_consensus.cc:1217] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:47.114080 27727 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:47.132414 27166 raft_consensus.cc:1217] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:09:47.178741 27640 raft_consensus.cc:2955] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:47.189116 26620 raft_consensus.cc:2955] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:47.180996 27710 tablet_bootstrap.cc:492] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:47.251423 27710 tablet_bootstrap.cc:492] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:09:47.252426 27710 ts_tablet_manager.cc:1403] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.288s	user 0.033s	sys 0.030s
W20260709 12:09:47.276026 26586 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.24.179.126:41797, user_credentials={real_user=slave}} blocked reactor thread for 48922.9us
I20260709 12:09:47.299635 27710 raft_consensus.cc:359] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:47.300575 27710 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:09:47.302227 27167 raft_consensus.cc:2955] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:47.307778 27710 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:47.310170 27710 ts_tablet_manager.cc:1434] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.057s	user 0.004s	sys 0.000s
I20260709 12:09:47.315963 26540 raft_consensus.cc:2955] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:47.333848 26370 catalog_manager.cc:5697] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b reported cstate change: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:47.407343 26558 tablet_copy_service.cc:342] P ac3ac2181aa941229a758ccf6b5607cd: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-68aec546ef604f45adc4b6dedb13e41f received from {username='slave'} at 127.0.0.1:44706
I20260709 12:09:47.407903 26558 tablet_copy_service.cc:434] P ac3ac2181aa941229a758ccf6b5607cd: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-68aec546ef604f45adc4b6dedb13e41f on tablet 68aec546ef604f45adc4b6dedb13e41f with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:47.465826 26466 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:47.485888 26620 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:47.489024 27167 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:47.488878 27640 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:47.494141 27726 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:47.508008 27726 raft_consensus.cc:2955] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:47.519162 27506 raft_consensus.cc:1064] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:09:47.521941 27506 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:47.547044 26620 raft_consensus.cc:2955] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:47.510557 27167 raft_consensus.cc:2955] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:47.583195 27166 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:47.584100 27683 raft_consensus.cc:1064] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:09:47.586128 26615 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:47.587144 27683 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:47.589582 27690 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:47.590641 27536 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:47.632922 26368 catalog_manager.cc:5697] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index 3 to 4, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New cstate: current_term: 1 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:47.642644 26469 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:47.650509 27166 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 3 LEARNER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:47.657644 26357 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3d83c4273cd74e768f756e0c8ba65432 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:47.658013 27708 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:09:47.729322 27536 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:47.745023 26532 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d83c4273cd74e768f756e0c8ba65432 with delete_type TABLET_DATA_TOMBSTONED (TS ac3ac2181aa941229a758ccf6b5607cd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55084
I20260709 12:09:47.747129 26545 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:47.764225 27708 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:47.768893 27690 raft_consensus.cc:2955] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:47.820266 26620 raft_consensus.cc:2955] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:47.836930 27745 tablet_replica.cc:333] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:09:47.842878 27745 raft_consensus.cc:2243] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:47.843945 27745 raft_consensus.cc:2272] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:47.848352 27745 ts_tablet_manager.cc:1916] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:09:47.851346 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 99899.3us
I20260709 12:09:47.865923 26466 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:47.869560 27166 raft_consensus.cc:1217] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:47.872152 27745 ts_tablet_manager.cc:1929] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:47.872809 27745 log.cc:1199] T 3d83c4273cd74e768f756e0c8ba65432 P ac3ac2181aa941229a758ccf6b5607cd: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-1-root/wals/3d83c4273cd74e768f756e0c8ba65432
I20260709 12:09:47.878201 27743 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:47.885281 26469 raft_consensus.cc:2955] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:47.914599 26368 catalog_manager.cc:5697] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:47.919181 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:47.934899 27741 raft_consensus.cc:2955] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:47.944479 26468 raft_consensus.cc:2955] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:47.949657 26357 catalog_manager.cc:5028] TS ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): tablet 3d83c4273cd74e768f756e0c8ba65432 (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:09:47.955678 26545 raft_consensus.cc:2955] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:47.956007 27166 raft_consensus.cc:2955] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:47.983080 27167 raft_consensus.cc:2955] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:47.987963 26540 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:48.037614 26371 catalog_manager.cc:5697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:48.095023 26615 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:48.102161 26465 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.058348 27167 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.117093 27536 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:48.126137 27166 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:48.126272 26544 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:48.128307 27683 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:48.141217 27746 raft_consensus.cc:2955] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:48.151721 27166 raft_consensus.cc:2955] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:48.163465 27743 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:09:48.172480 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 50977.4us
I20260709 12:09:48.178649 27443 raft_consensus.cc:2955] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:48.184664 26544 raft_consensus.cc:2955] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:48.199596 27750 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:48.202636 26357 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f6ba7060b20a4d598344385607b29c70 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:48.208135 27166 raft_consensus.cc:2955] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:48.227345 26469 raft_consensus.cc:2955] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:48.226995 26369 catalog_manager.cc:5697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 4 to 5, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New cstate: current_term: 3 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:48.242311 26358 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 72e7c4f1de5d4e28a4c1bf09d4fb099b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:48.237855 26368 catalog_manager.cc:5697] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:48.319247 26455 tablet_service.cc:1558] Processing DeleteTablet for tablet 72e7c4f1de5d4e28a4c1bf09d4fb099b with delete_type TABLET_DATA_TOMBSTONED (TS 01a57027214a411e80874ac7febd628b not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:43588
I20260709 12:09:48.366374 26609 tablet_service.cc:1558] Processing DeleteTablet for tablet f6ba7060b20a4d598344385607b29c70 with delete_type TABLET_DATA_TOMBSTONED (TS aaadfdd9ca9f424c91505f9b43876233 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54638
I20260709 12:09:48.368805 27753 tablet_replica.cc:333] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:09:48.372809 27753 raft_consensus.cc:2243] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:48.373818 27753 raft_consensus.cc:2272] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:48.396312 27752 tablet_replica.cc:333] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:09:48.397385 27752 raft_consensus.cc:2243] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:48.399072 27752 raft_consensus.cc:2272] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:48.402694 27753 ts_tablet_manager.cc:1916] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:48.414038 27752 ts_tablet_manager.cc:1916] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:48.431588 27536 raft_consensus.cc:1064] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:09:48.438439 27536 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:48.439935 27753 ts_tablet_manager.cc:1929] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:48.440598 27753 log.cc:1199] T f6ba7060b20a4d598344385607b29c70 P aaadfdd9ca9f424c91505f9b43876233: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-2-root/wals/f6ba7060b20a4d598344385607b29c70
I20260709 12:09:48.443498 26358 catalog_manager.cc:5028] TS aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): tablet f6ba7060b20a4d598344385607b29c70 (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:09:48.551451 27167 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.561311 27735 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.599516 26473 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.601270 27729 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:48.608964 26620 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.648900 27690 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.657274 27752 ts_tablet_manager.cc:1929] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:09:48.659085 27752 log.cc:1199] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 01a57027214a411e80874ac7febd628b: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-0-root/wals/72e7c4f1de5d4e28a4c1bf09d4fb099b
I20260709 12:09:48.670449 26357 catalog_manager.cc:5028] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): tablet 72e7c4f1de5d4e28a4c1bf09d4fb099b (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:09:48.700937 27744 raft_consensus.cc:2955] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:48.714423 27167 raft_consensus.cc:2955] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:48.733861 26473 raft_consensus.cc:2955] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:48.746095 26371 catalog_manager.cc:5697] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:48.807368 26544 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:48.819149 27167 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.820068 26468 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.822005 27536 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:48.826304 27751 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:48.847793 27751 raft_consensus.cc:2955] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:48.850340 26473 raft_consensus.cc:2955] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:48.852690 26544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:09:48.853434 26544 raft_consensus.cc:606] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:48.858515 26544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:09:48.869226 26544 raft_consensus.cc:606] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:09:48.878321 26544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:09:48.879577 26357 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 68aec546ef604f45adc4b6dedb13e41f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:48.884390 26544 raft_consensus.cc:606] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:48.883883 27167 raft_consensus.cc:2955] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:48.886828 26367 catalog_manager.cc:5697] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:48.896741 26544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:09:48.897431 26544 raft_consensus.cc:606] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:09:48.900030 27736 raft_consensus.cc:993] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:48.900701 27536 raft_consensus.cc:1081] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:48.902635 26545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:09:48.903321 26545 raft_consensus.cc:606] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:48.902802 26473 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43606
I20260709 12:09:48.904008 26473 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:48.904363 26473 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.904721 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:48.906967 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:48.908802 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:48.922282 26609 tablet_service.cc:1558] Processing DeleteTablet for tablet 68aec546ef604f45adc4b6dedb13e41f with delete_type TABLET_DATA_TOMBSTONED (TS aaadfdd9ca9f424c91505f9b43876233 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54638
I20260709 12:09:48.923484 26473 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:48.926205 26473 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:48.926949 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:48.927762 26544 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:48.927000 27753 tablet_replica.cc:333] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:09:48.928119 26544 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:48.929409 27753 raft_consensus.cc:2243] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:48.929181 26544 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:48.931456 26544 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.935165 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:09:48.935885 27167 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.930235 27753 pending_rounds.cc:70] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233: Trying to abort 1 pending ops.
I20260709 12:09:48.943066 27753 pending_rounds.cc:77] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305621456620597248 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "68aec546ef604f45adc4b6dedb13e41f" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } } }
I20260709 12:09:48.945358 27753 raft_consensus.cc:2917] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:09:48.946009 27753 raft_consensus.cc:2889] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:09:48.959383 27753 raft_consensus.cc:2272] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:48.963871 27753 ts_tablet_manager.cc:1916] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:48.947263 27167 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:48.953962 26544 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:48.970012 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:48.971138 27640 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:48.971688 27640 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:48.972615 27640 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:48.976372 27729 raft_consensus.cc:993] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:48.986889 27751 raft_consensus.cc:1081] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:48.987907 26371 catalog_manager.cc:5697] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 2 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:48.992957 26620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:09:48.994076 26620 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:48.994588 26620 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:49.043812 26620 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:49.047797 26620 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:49.049263 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:49.050145 26545 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:49.049263 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:49.050480 26545 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:49.050812 26469 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:49.051347 26545 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:49.052713 26545 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:49.060962 27753 ts_tablet_manager.cc:1929] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:49.061585 27753 log.cc:1199] T 68aec546ef604f45adc4b6dedb13e41f P aaadfdd9ca9f424c91505f9b43876233: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-2-root/wals/68aec546ef604f45adc4b6dedb13e41f
I20260709 12:09:49.063611 26358 catalog_manager.cc:5028] TS aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): tablet 68aec546ef604f45adc4b6dedb13e41f (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:09:49.076403 26545 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:09:49.086547 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:49.089205 27746 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:49.089749 27746 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:49.090678 27746 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:49.107996 27751 raft_consensus.cc:993] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:49.108525 27751 raft_consensus.cc:1081] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:49.114549 26371 catalog_manager.cc:5697] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 2 to 3, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 3 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.122977 26469 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:09:49.153131 26620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:09:49.153738 26620 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.154134 26620 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:49.163489 26620 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:49.165591 26620 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:49.167151 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:49.167914 26468 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:49.169417 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:49.170763 26545 raft_consensus.cc:3055] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:49.171099 26545 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:49.172292 26545 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:49.173648 26545 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:49.176726 26468 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:09:49.178025 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:49.179087 27746 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:49.179595 27746 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:49.180446 27746 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:49.184623 26545 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:09:49.196406 26371 catalog_manager.cc:5697] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 3 to 4, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 4 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.421039 27536 raft_consensus.cc:993] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:49.421567 27536 raft_consensus.cc:1081] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:49.424719 27736 raft_consensus.cc:993] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:49.425249 27736 raft_consensus.cc:1081] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:49.428552 26620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:09:49.429230 26620 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.429625 26620 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.443747 26468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43606
I20260709 12:09:49.444613 26468 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.445101 26468 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.445185 26620 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:49.448967 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:49.449693 26469 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.461400 26468 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:49.469784 26468 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:49.471220 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:49.471989 26615 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.472832 27167 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.474947 27726 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:49.479781 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:49.480459 26545 raft_consensus.cc:3055] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.480747 26545 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:49.483091 26545 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:49.487608 26615 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:49.490491 26545 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.498764 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:49.500551 26545 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:49.507483 27706 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.516145 26544 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.519323 27726 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:49.522112 27706 raft_consensus.cc:697] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:49.523681 27706 consensus_queue.cc:237] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:49.542207 26469 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:49.543131 26465 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.543692 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:49.544813 27741 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.545344 27741 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:49.546308 27741 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:49.552389 27744 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:49.553629 27536 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.554077 27536 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:49.555049 27536 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:49.556417 27536 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.567683 26620 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:49.572008 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:49.637562 26545 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:49.633708 26371 catalog_manager.cc:5697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.677503 26469 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:49.701920 27769 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:49.707773 26367 catalog_manager.cc:5697] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 2 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:49.716028 26544 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:49.743031 27769 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:49.746448 26468 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:49.772212 27746 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:49.835523 26544 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:49.856207 27769 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:49.953109 26540 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:49.958623 27762 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:49.984143 26465 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:49.987780 27769 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.041551 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:50.052291 26545 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.057224 26616 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.063549 27762 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:50.073319 27708 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:50.127033 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 68523.9us
I20260709 12:09:50.305920 26616 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:50.318789 26545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:09:50.319496 26545 raft_consensus.cc:606] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:09:50.342131 26545 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.343180 26544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:09:50.343815 26544 raft_consensus.cc:606] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:09:50.343885 26469 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.346975 27741 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:50.362082 26588 consensus_peers.cc:597] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: de4e2c4be7474864b847ef2e617f6f49. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:50.365518 26544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:09:50.366250 26544 raft_consensus.cc:606] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:50.363055 27708 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:09:50.397948 27741 raft_consensus.cc:2955] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:50.407058 26465 raft_consensus.cc:2955] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:50.412402 26539 raft_consensus.cc:2955] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
W20260709 12:09:50.434310 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet ceda449be0d044e0b465f42ed3047751: Remote error: Service unavailable: leader transfer in progress
I20260709 12:09:50.440266 26544 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:50.441304 26616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:09:50.441960 26616 raft_consensus.cc:606] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:09:50.444914 26371 catalog_manager.cc:5697] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 1 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:50.460083 27736 raft_consensus.cc:993] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:50.461843 27781 raft_consensus.cc:1081] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
W20260709 12:09:50.466205 26514 consensus_peers.cc:597] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3c1161f4dab4d0e9f9b0053e38dfe10. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:50.468429 26622 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.472257 26616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:09:50.472947 26616 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.473343 26616 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:50.474658 27736 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:50.477213 26539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:09:50.477957 26539 raft_consensus.cc:606] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:50.481931 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:50.484207 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:50.485179 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:50.490331 26469 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.494884 26616 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:50.499663 26616 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:50.517386 27741 raft_consensus.cc:993] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:50.517982 27741 raft_consensus.cc:1081] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:50.526765 27781 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:50.569336 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:50.570076 26465 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:50.588901 26466 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43592
I20260709 12:09:50.589828 26466 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.590298 26466 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.608455 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:50.609457 26539 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:09:50.610085 26539 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:50.611141 26539 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:50.613628 26539 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:50.646028 26466 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:50.651738 27736 raft_consensus.cc:2955] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:50.654561 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:50.668906 26544 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.656388 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:50.658517 26618 raft_consensus.cc:2955] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:50.673259 26622 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.673648 26622 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:50.674535 26622 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:50.676087 26622 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.661899 26539 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:09:50.662441 26466 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:50.663631 26465 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:09:50.687011 26622 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:50.687142 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:50.689486 27746 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:50.690054 27746 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:50.691459 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:50.695055 27706 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.695583 27706 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:50.701782 26469 raft_consensus.cc:2955] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:50.705629 27706 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:50.691131 27746 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:50.721719 26620 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:50.731683 26544 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:50.729610 26368 catalog_manager.cc:5697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:50.749831 26588 consensus_peers.cc:597] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 541724f47bb04d5185dd369750546cbf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:50.751889 26544 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:50.753767 27746 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:50.753441 26367 catalog_manager.cc:5697] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 2, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 2 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:50.758958 26465 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:50.767239 26371 catalog_manager.cc:5697] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 4 to 5, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 5 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.779415 27746 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:50.802258 27778 raft_consensus.cc:993] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:50.802829 27729 raft_consensus.cc:1081] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:50.809221 26468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43606
I20260709 12:09:50.809851 26468 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.810264 26468 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.819407 26468 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:50.823540 26468 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:50.826438 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:50.832588 26545 raft_consensus.cc:3055] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.833788 26545 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:50.834184 27781 raft_consensus.cc:993] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:50.834803 27729 raft_consensus.cc:1081] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:50.834791 26545 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:50.837883 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:50.837977 26545 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.841652 26468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43606
I20260709 12:09:50.847524 26468 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.848026 26468 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.848542 26620 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.856711 27769 raft_consensus.cc:2955] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:50.860551 26465 raft_consensus.cc:2955] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:50.868795 26468 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:50.873452 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:50.874164 26548 raft_consensus.cc:3055] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.874506 26548 raft_consensus.cc:740] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:50.875365 26548 consensus_queue.cc:260] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:50.876735 26548 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.886826 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:50.888656 26539 raft_consensus.cc:2955] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:50.897619 26548 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:50.887673 26622 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.907321 27800 ts_tablet_manager.cc:933] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:50.910077 26468 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:50.934442 26371 catalog_manager.cc:5697] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:50.942332 26620 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:50.948541 26438 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:50.961899 26439 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:50.963231 27726 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.963769 27726 raft_consensus.cc:697] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:50.964720 27726 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:50.966586 27706 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.967178 27706 raft_consensus.cc:697] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:50.968144 27706 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:50.954233 26545 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:50.952430 26622 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:50.982957 27800 tablet_copy_client.cc:323] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.66:40567
I20260709 12:09:50.985376 26558 tablet_copy_service.cc:140] P ac3ac2181aa941229a758ccf6b5607cd: Received BeginTabletCopySession request for tablet f3c1161f4dab4d0e9f9b0053e38dfe10 from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:44706)
I20260709 12:09:50.986070 26558 tablet_copy_service.cc:161] P ac3ac2181aa941229a758ccf6b5607cd: Beginning new tablet copy session on tablet f3c1161f4dab4d0e9f9b0053e38dfe10 from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:44706: session id = 3262bf0553e543eea76794fc529a9acc-f3c1161f4dab4d0e9f9b0053e38dfe10
I20260709 12:09:51.005481 26558 tablet_copy_source_session.cc:215] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.012185 27729 raft_consensus.cc:993] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:51.012931 27798 raft_consensus.cc:1081] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:51.019675 26622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:09:51.020267 26622 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.020576 26622 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.021569 27800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3c1161f4dab4d0e9f9b0053e38dfe10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.027462 26622 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:51.027663 26368 catalog_manager.cc:5697] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 2 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:51.029289 26622 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:51.030412 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:51.030081 26368 catalog_manager.cc:5697] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 2 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:51.031075 26469 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.031611 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:51.032231 26545 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.032534 26545 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:51.033465 26545 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:51.034763 26545 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.042546 26545 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:51.044389 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:51.046288 27741 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.046921 27741 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:51.047906 27741 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:51.057852 26469 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:51.076265 26368 catalog_manager.cc:5697] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:51.080120 27800 tablet_copy_client.cc:806] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.081518 27800 tablet_copy_client.cc:670] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.094738 27800 tablet_copy_client.cc:538] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.111706 27800 tablet_bootstrap.cc:492] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:09:51.144201 27800 tablet_bootstrap.cc:492] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.145265 27800 tablet_bootstrap.cc:492] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:09:51.146050 27800 ts_tablet_manager.cc:1403] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.008s
I20260709 12:09:51.149161 27800 raft_consensus.cc:359] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:51.150372 27800 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:09:51.151098 27800 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:51.154438 27800 ts_tablet_manager.cc:1434] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:51.156575 26558 tablet_copy_service.cc:342] P ac3ac2181aa941229a758ccf6b5607cd: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-f3c1161f4dab4d0e9f9b0053e38dfe10 received from {username='slave'} at 127.0.0.1:44706
I20260709 12:09:51.157033 26558 tablet_copy_service.cc:434] P ac3ac2181aa941229a758ccf6b5607cd: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-f3c1161f4dab4d0e9f9b0053e38dfe10 on tablet f3c1161f4dab4d0e9f9b0053e38dfe10 with peer 3262bf0553e543eea76794fc529a9acc
W20260709 12:09:51.182448 26439 consensus_peers.cc:597] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: de4e2c4be7474864b847ef2e617f6f49. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:51.187870 27800 ts_tablet_manager.cc:933] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:51.192176 27800 tablet_copy_client.cc:323] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.67:42217
I20260709 12:09:51.194201 26632 tablet_copy_service.cc:140] P aaadfdd9ca9f424c91505f9b43876233: Received BeginTabletCopySession request for tablet 541724f47bb04d5185dd369750546cbf from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:48232)
I20260709 12:09:51.194818 26632 tablet_copy_service.cc:161] P aaadfdd9ca9f424c91505f9b43876233: Beginning new tablet copy session on tablet 541724f47bb04d5185dd369750546cbf from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:48232: session id = 3262bf0553e543eea76794fc529a9acc-541724f47bb04d5185dd369750546cbf
I20260709 12:09:51.204164 26632 tablet_copy_source_session.cc:215] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.207948 27800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541724f47bb04d5185dd369750546cbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.232329 27800 tablet_copy_client.cc:806] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.233101 27800 tablet_copy_client.cc:670] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.238592 26545 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:09:51.238765 27800 tablet_copy_client.cc:538] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.241318 27746 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:51.250789 27800 tablet_bootstrap.cc:492] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:09:51.310465 26465 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:09:51.313417 26620 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:51.315199 27706 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:51.316210 27800 tablet_bootstrap.cc:492] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.316854 26539 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:51.323441 27800 tablet_bootstrap.cc:492] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:09:51.348682 27800 ts_tablet_manager.cc:1403] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.098s	user 0.027s	sys 0.020s
I20260709 12:09:51.348933 27769 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:51.352157 27800 raft_consensus.cc:359] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:51.353148 27800 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:09:51.353847 27800 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:51.368330 27800 ts_tablet_manager.cc:1434] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:09:51.372500 26632 tablet_copy_service.cc:342] P aaadfdd9ca9f424c91505f9b43876233: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-541724f47bb04d5185dd369750546cbf received from {username='slave'} at 127.0.0.1:48232
I20260709 12:09:51.373061 26632 tablet_copy_service.cc:434] P aaadfdd9ca9f424c91505f9b43876233: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-541724f47bb04d5185dd369750546cbf on tablet 541724f47bb04d5185dd369750546cbf with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:51.426677 27726 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:51.467905 26539 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.469889 27706 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.486102 27166 raft_consensus.cc:1217] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:51.501586 26620 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.507079 27706 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:51.564190 26622 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.565843 27726 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.586774 26544 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.605732 27777 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.642799 26465 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.644714 27769 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.655200 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:51.668365 26539 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.673202 27746 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.687680 27166 raft_consensus.cc:1217] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:09:51.726459 27800 ts_tablet_manager.cc:933] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149)
I20260709 12:09:51.798468 27800 tablet_copy_client.cc:323] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.65:45149
I20260709 12:09:51.800585 26483 tablet_copy_service.cc:140] P 01a57027214a411e80874ac7febd628b: Received BeginTabletCopySession request for tablet de4e2c4be7474864b847ef2e617f6f49 from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:54414)
I20260709 12:09:51.801195 26483 tablet_copy_service.cc:161] P 01a57027214a411e80874ac7febd628b: Beginning new tablet copy session on tablet de4e2c4be7474864b847ef2e617f6f49 from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:54414: session id = 3262bf0553e543eea76794fc529a9acc-de4e2c4be7474864b847ef2e617f6f49
I20260709 12:09:51.809818 26483 tablet_copy_source_session.cc:215] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.814136 27800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de4e2c4be7474864b847ef2e617f6f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.835376 27800 tablet_copy_client.cc:806] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.836172 27800 tablet_copy_client.cc:670] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.860597 27800 tablet_copy_client.cc:538] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.893553 27800 tablet_bootstrap.cc:492] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:09:51.933102 27800 tablet_bootstrap.cc:492] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.934260 27800 tablet_bootstrap.cc:492] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:09:51.935081 27800 ts_tablet_manager.cc:1403] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.042s	user 0.028s	sys 0.002s
I20260709 12:09:51.935909 27779 raft_consensus.cc:1064] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:09:51.941788 27800 raft_consensus.cc:359] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:51.942863 27800 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:09:51.943621 27800 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:51.947290 27800 ts_tablet_manager.cc:1434] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:51.949432 26483 tablet_copy_service.cc:342] P 01a57027214a411e80874ac7febd628b: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-de4e2c4be7474864b847ef2e617f6f49 received from {username='slave'} at 127.0.0.1:54414
I20260709 12:09:51.949919 26483 tablet_copy_service.cc:434] P 01a57027214a411e80874ac7febd628b: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-de4e2c4be7474864b847ef2e617f6f49 on tablet de4e2c4be7474864b847ef2e617f6f49 with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:51.952945 27779 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:51.982462 26473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:09:51.983237 26473 raft_consensus.cc:606] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:51.987394 26539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:09:51.988209 26539 raft_consensus.cc:606] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:51.995854 26621 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:51.996701 27167 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:51.997175 26468 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:51.998687 27779 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.000125 26621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:09:52.000967 26621 raft_consensus.cc:606] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:09:52.002971 27798 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.003933 27729 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.007366 26473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "3262bf0553e543eea76794fc529a9acc"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:09:52.015146 26473 raft_consensus.cc:606] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Received request to transfer leadership to TS 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:52.022218 26473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "3262bf0553e543eea76794fc529a9acc"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:09:52.023552 26473 raft_consensus.cc:606] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Received request to transfer leadership to TS 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:52.027091 27798 raft_consensus.cc:2955] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:52.033857 26621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:09:52.034793 26621 raft_consensus.cc:606] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:09:52.039284 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:09:52.041389 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:52.042306 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:52.063776 26473 raft_consensus.cc:2955] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:09:52.066809 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44208.7us
I20260709 12:09:52.068984 27167 raft_consensus.cc:2955] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:52.072384 26367 catalog_manager.cc:5697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.072372 26622 raft_consensus.cc:2955] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:52.117336 27706 raft_consensus.cc:993] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:52.117936 27706 raft_consensus.cc:1081] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:52.119925 26620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54654
I20260709 12:09:52.120558 26620 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.120940 26620 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.197546 27769 raft_consensus.cc:1064] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:09:52.203266 26620 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:52.204535 27769 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:52.205458 26620 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:52.206648 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:52.211552 26473 raft_consensus.cc:3055] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:52.212006 26473 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:52.213008 26473 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:52.223043 26473 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.230322 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:52.231359 26545 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.258114 27726 raft_consensus.cc:993] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: : Instructing follower 3262bf0553e543eea76794fc529a9acc to start an election
I20260709 12:09:52.258934 27726 raft_consensus.cc:1081] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Signalling peer 3262bf0553e543eea76794fc529a9acc to start an election
I20260709 12:09:52.268352 26545 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:09:52.270247 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:09:52.274503 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 69534.8us
I20260709 12:09:52.279631 27167 raft_consensus.cc:1217] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:09:52.288143 27832 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:52.288492 27167 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
 from {username='slave'} at 127.0.0.1:56902
I20260709 12:09:52.289418 27167 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.295094 27167 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:52.296931 26544 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:52.297660 26473 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:09:52.331619 27832 raft_consensus.cc:697] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:52.331944 27167 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:52.333977 27166 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:52.335448 27832 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:52.338186 27167 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:52.344174 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:52.344959 26465 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:52.345373 26465 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:52.341569 27832 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:52.362676 26465 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:09:52.372433 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 59529.8us
I20260709 12:09:52.373541 26465 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:52.377292 26473 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:52.378054 26548 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:09:52.379127 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 57846.6us
W20260709 12:09:52.380692 27840 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:09:52.385886 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:52.386885 26544 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:52.384941 27842 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:09:52.391764 27778 raft_consensus.cc:993] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:52.392343 27778 raft_consensus.cc:1081] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:52.395156 26465 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:09:52.396680 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:09:52.397703 27642 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:52.404071 27708 raft_consensus.cc:993] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:52.404863 26544 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:09:52.405900 27708 raft_consensus.cc:1081] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:52.407997 26465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43592
I20260709 12:09:52.408816 26465 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.409291 26465 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.413062 27642 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:09:52.414247 27642 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:52.415781 27837 raft_consensus.cc:993] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:52.416357 27837 raft_consensus.cc:1081] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:52.424790 26468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43592
I20260709 12:09:52.425625 26468 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.426152 26468 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:52.435020 27833 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:52.419314 26465 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:52.459854 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 73948.9us
I20260709 12:09:52.508179 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:52.508853 26621 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.509155 26621 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:52.510244 26621 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:52.511861 27765 raft_consensus.cc:993] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: : Instructing follower 3262bf0553e543eea76794fc529a9acc to start an election
I20260709 12:09:52.512619 27765 raft_consensus.cc:1081] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Signalling peer 3262bf0553e543eea76794fc529a9acc to start an election
I20260709 12:09:52.512502 26369 catalog_manager.cc:5697] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 2 to 3, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 3 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.514568 27167 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
 from {username='slave'} at 127.0.0.1:56902
I20260709 12:09:52.515108 27167 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.515435 27167 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:52.512633 26621 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.525429 27167 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:52.528513 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:52.528667 27167 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:52.529192 26469 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:52.529543 26469 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:52.530488 26469 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:52.532114 26469 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:52.538725 26465 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:52.540577 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:52.540766 26468 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:52.541324 26548 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:52.543179 26468 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:52.562959 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 185406us
I20260709 12:09:52.565243 26548 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:09:52.568416 27849 raft_consensus.cc:2955] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:52.575649 26473 raft_consensus.cc:2955] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:52.579053 26622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:09:52.579752 26622 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.580358 26622 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.583213 26621 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:52.591924 26369 catalog_manager.cc:5697] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 3 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 4 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.593596 26469 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:09:52.594947 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:09:52.595875 27642 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:52.596180 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:52.596834 26621 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:52.598516 27642 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:09:52.601274 27167 raft_consensus.cc:2955] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:52.597141 26621 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:52.599642 27642 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:52.620651 26439 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:52.612099 26621 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:52.621717 27765 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.622320 27765 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:52.622668 26621 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:52.623313 27765 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:52.633003 26622 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:52.635288 26622 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:52.641458 26371 catalog_manager.cc:5697] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.643257 26621 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:09:52.644536 26439 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:52.645432 27726 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:52.645903 27726 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:52.646837 27726 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:52.654194 26544 raft_consensus.cc:2955] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:52.661154 26621 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:52.661731 26369 catalog_manager.cc:5697] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 2, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 2 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:52.672288 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:52.673133 26548 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.673288 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:52.673543 26548 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:52.674023 26469 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.676888 26548 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:52.678158 26371 catalog_manager.cc:5697] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 3 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 4 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.685549 26469 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:52.689036 26545 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:52.685225 26539 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:52.688676 27167 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:52.699499 27839 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:52.701010 26368 catalog_manager.cc:5697] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 3 to 4, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 4 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:52.702328 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:52.702759 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:52.703289 26539 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.703903 26469 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:52.707535 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:52.715605 26545 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:52.713025 27839 raft_consensus.cc:2955] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:52.709517 27849 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.719340 27849 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:52.720620 27849 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:52.722177 27832 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:52.734145 27167 raft_consensus.cc:2955] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:52.740034 26358 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 541724f47bb04d5185dd369750546cbf with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:52.744360 26473 raft_consensus.cc:2955] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:52.753189 26548 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.758144 26469 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:09:52.758782 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 91537us
I20260709 12:09:52.759794 27832 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:09:52.781241 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.806699 26545 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:09:52.829792 26368 catalog_manager.cc:5697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 4 to 5, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:52.848268 26368 catalog_manager.cc:5697] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.856077 26621 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.856431 27167 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.858451 26548 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:52.860530 26545 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:52.867535 27777 raft_consensus.cc:1064] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:09:52.817986 26539 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:52.884765 27777 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:52.894006 27832 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.912511 27167 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:52.915846 27765 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:52.933473 26621 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:52.935161 27726 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:52.959674 27726 raft_consensus.cc:2955] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:52.961314 27834 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:52.972936 27167 raft_consensus.cc:2955] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:52.983031 26468 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:09:52.984508 27642 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:52.988467 26548 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:09:52.991001 27642 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:52.999621 27729 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:52.999294 26621 raft_consensus.cc:2955] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:53.002271 26368 catalog_manager.cc:5697] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 2 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:53.042593 26548 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:09:53.044150 27642 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:53.052012 26542 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:53.052978 26532 tablet_service.cc:1558] Processing DeleteTablet for tablet 541724f47bb04d5185dd369750546cbf with delete_type TABLET_DATA_TOMBSTONED (TS ac3ac2181aa941229a758ccf6b5607cd not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:55084
I20260709 12:09:53.057639 27836 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:53.060292 26465 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:09:53.061355 27834 raft_consensus.cc:2955] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:53.062830 27642 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:53.078352 26469 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:53.082481 26357 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f3c1161f4dab4d0e9f9b0053e38dfe10 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:53.084249 27166 raft_consensus.cc:2955] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:53.083775 26620 raft_consensus.cc:2955] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:53.100871 27168 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.116492 27765 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:53.129685 26542 raft_consensus.cc:2955] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:53.177737 26539 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.179889 27849 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:53.149458 27167 raft_consensus.cc:2955] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:53.217758 26618 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:53.273649 27777 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:53.282752 26622 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.286473 26473 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.292150 27833 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:53.292974 27872 tablet_replica.cc:333] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:09:53.137310 27765 raft_consensus.cc:2955] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:53.445374 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:53.455314 27879 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:53.482570 26368 catalog_manager.cc:5697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 3 to 4, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:09:53.509361 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 407777us
W20260709 12:09:53.603744 26620 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.513s	user 0.012s	sys 0.000s
W20260709 12:09:53.605741 26532 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.012s	sys 0.008s
W20260709 12:09:53.606117 26532 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.012s	sys 0.008s
W20260709 12:09:53.649672 26548 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.009s	sys 0.008s
W20260709 12:09:53.650149 26548 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.010s	sys 0.008s
W20260709 12:09:53.684913 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:53.685822 27879 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:53.687031 27879 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:53.694475 27872 raft_consensus.cc:2243] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:53.695423 26545 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:53.695652 27872 raft_consensus.cc:2272] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:53.699642 27872 ts_tablet_manager.cc:1916] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:53.699775 26546 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.707486 27879 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:53.695755 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:09:53.718428 27167 consensus_meta.cc:287] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.512s	user 0.018s	sys 0.003s
W20260709 12:09:53.781255 26539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.010s	sys 0.001s
W20260709 12:09:53.781701 26539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.010s	sys 0.001s
I20260709 12:09:53.788134 27872 ts_tablet_manager.cc:1929] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:09:53.788786 27872 log.cc:1199] T 541724f47bb04d5185dd369750546cbf P ac3ac2181aa941229a758ccf6b5607cd: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-1-root/wals/541724f47bb04d5185dd369750546cbf
W20260709 12:09:53.796626 27850 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.016s	sys 0.009s
W20260709 12:09:53.797051 27850 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.016s	sys 0.010s
I20260709 12:09:53.798313 26468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "3262bf0553e543eea76794fc529a9acc"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:09:53.799002 26468 raft_consensus.cc:606] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Received request to transfer leadership to TS 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:53.807296 26468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:09:53.807982 26468 raft_consensus.cc:606] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:53.826337 26357 catalog_manager.cc:5028] TS ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): tablet 541724f47bb04d5185dd369750546cbf (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:09:53.834648 27777 raft_consensus.cc:993] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: : Instructing follower 3262bf0553e543eea76794fc529a9acc to start an election
I20260709 12:09:53.835253 27777 raft_consensus.cc:1081] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Signalling peer 3262bf0553e543eea76794fc529a9acc to start an election
I20260709 12:09:53.842633 26369 catalog_manager.cc:5697] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 4 to 5, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New cstate: current_term: 2 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:53.844908 27167 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
 from {username='slave'} at 127.0.0.1:56902
I20260709 12:09:53.845549 27167 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.845932 27167 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.851688 26621 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:09:53.873937 26542 consensus_meta.cc:287] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.741s	user 0.015s	sys 0.000s
I20260709 12:09:53.865196 26621 raft_consensus.cc:2955] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:53.897789 26532 tablet_service.cc:1558] Processing DeleteTablet for tablet de4e2c4be7474864b847ef2e617f6f49 with delete_type TABLET_DATA_TOMBSTONED (TS ac3ac2181aa941229a758ccf6b5607cd not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:55084
I20260709 12:09:53.899163 27872 tablet_replica.cc:333] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:09:53.900571 27872 raft_consensus.cc:2243] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:53.901562 27872 raft_consensus.cc:2272] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:53.919006 26357 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet de4e2c4be7474864b847ef2e617f6f49 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:53.923538 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:09:53.921360 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:53.912699 27872 ts_tablet_manager.cc:1916] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:53.961094 26548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:09:53.961779 26548 raft_consensus.cc:606] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:53.963737 26455 tablet_service.cc:1558] Processing DeleteTablet for tablet f3c1161f4dab4d0e9f9b0053e38dfe10 with delete_type TABLET_DATA_TOMBSTONED (TS 01a57027214a411e80874ac7febd628b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43588
I20260709 12:09:53.966854 27726 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:53.968075 27893 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:53.971865 26438 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:53.970368 27167 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:53.979034 27777 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:53.980629 27167 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:53.981102 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:53.982898 26621 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.986856 27893 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:53.988874 27726 raft_consensus.cc:993] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:53.989383 27726 raft_consensus.cc:1081] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:53.990909 26621 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 2.
I20260709 12:09:53.992319 27134 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:53.993098 27850 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.993595 27902 tablet_replica.cc:333] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:09:53.994679 27850 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 2 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:09:53.995952 27850 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:54.000274 26621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:09:54.000968 26621 raft_consensus.cc:606] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:09:54.006243 26620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:09:54.006918 26620 raft_consensus.cc:606] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:09:54.008545 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:54.010964 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:54.011269 27872 ts_tablet_manager.cc:1929] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:09:54.011772 27872 log.cc:1199] T de4e2c4be7474864b847ef2e617f6f49 P ac3ac2181aa941229a758ccf6b5607cd: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-1-root/wals/de4e2c4be7474864b847ef2e617f6f49
I20260709 12:09:54.011806 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:54.013751 26357 catalog_manager.cc:5028] TS ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): tablet de4e2c4be7474864b847ef2e617f6f49 (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:09:54.016530 26620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54654
I20260709 12:09:54.017143 26620 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.017524 26620 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:54.018316 26618 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:53.994719 27902 raft_consensus.cc:2243] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:54.028339 27902 raft_consensus.cc:2272] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:54.028718 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:54.029400 26469 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.029713 26469 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:54.030548 26469 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:54.032521 26620 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:54.044703 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:54.045674 26473 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:54.046073 26473 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:54.048899 26620 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:54.049543 26473 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:54.050923 26473 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:54.051911 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:54.052588 26539 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:54.064399 26367 catalog_manager.cc:5697] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 1 to 2, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 2 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.091005 26473 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:09:54.048722 27777 consensus_queue.cc:1059] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:09:54.092937 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:54.077265 27902 ts_tablet_manager.cc:1916] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:54.100339 26539 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:09:54.102937 27889 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:54.116025 27889 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:54.116973 27889 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:54.118750 26469 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:54.105819 27905 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:09:54.107478 27746 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:09:54.121357 27746 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:54.123654 27746 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:54.125166 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:09:54.127456 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:54.129204 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:09:54.130461 27901 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:54.134071 27892 raft_consensus.cc:993] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:54.134655 27892 raft_consensus.cc:1081] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:54.195884 26615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:09:54.196638 26615 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.197127 26615 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.202862 26469 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 2.
W20260709 12:09:54.256407 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 60195.5us
I20260709 12:09:54.259495 26615 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:54.265713 26615 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:09:54.338832 27909 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 12:09:54.342011 26402 debug-util.cc:398] Leaking SignalData structure 0x7b080003da20 after lost signal to thread 25296
W20260709 12:09:54.343319 26402 debug-util.cc:398] Leaking SignalData structure 0x7b0800039b40 after lost signal to thread 26405
W20260709 12:09:54.344764 26402 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5660 after lost signal to thread 26497
W20260709 12:09:54.346050 26402 debug-util.cc:398] Leaking SignalData structure 0x7b0800314560 after lost signal to thread 26572
W20260709 12:09:54.348875 27908 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 12:09:54.355224 26402 debug-util.cc:398] Leaking SignalData structure 0x7b08003388c0 after lost signal to thread 26646
W20260709 12:09:54.356748 26402 debug-util.cc:398] Leaking SignalData structure 0x7b0800324660 after lost signal to thread 27192
I20260709 12:09:54.399410 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:54.400135 26539 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:54.399500 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:54.400993 26473 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.400523 26539 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:54.403703 26539 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:54.404912 26539 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.408733 26473 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:09:54.411155 26617 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.412639 26539 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:09:54.417758 27850 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.439193 27902 ts_tablet_manager.cc:1929] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:54.439877 27902 log.cc:1199] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 01a57027214a411e80874ac7febd628b: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-0-root/wals/f3c1161f4dab4d0e9f9b0053e38dfe10
I20260709 12:09:54.444171 26622 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:54.446960 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:54.468878 27833 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:54.469578 27833 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:54.470767 27833 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:54.472661 27914 raft_consensus.cc:993] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:54.473320 27914 raft_consensus.cc:1081] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
W20260709 12:09:54.479944 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 49951.6us
I20260709 12:09:54.478726 26357 catalog_manager.cc:5028] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): tablet f3c1161f4dab4d0e9f9b0053e38dfe10 (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:09:54.525367 26369 catalog_manager.cc:5697] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 3 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 4 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.549893 26465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43592
I20260709 12:09:54.550637 26465 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.550963 26465 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.561249 27898 raft_consensus.cc:993] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:54.561825 27898 raft_consensus.cc:1081] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:54.597249 26467 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43592
I20260709 12:09:54.597864 26467 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.598210 26467 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:54.611274 26465 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:54.614465 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:54.614557 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:54.615366 26617 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.615775 26617 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:54.616074 26542 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.616670 26617 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:54.618470 26617 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.614609 26467 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:54.623842 26469 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:54.625532 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:54.626181 26548 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:54.630453 26465 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:54.630990 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:54.631650 26621 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:09:54.631976 26621 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:54.632766 26467 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:09:54.631181 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 97297.8us
I20260709 12:09:54.635927 27849 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:54.637178 26621 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:54.638893 26621 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:54.664774 26542 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:54.666275 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:54.671139 26621 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:09:54.671801 27836 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.672386 27836 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:54.673398 27836 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:54.681191 26439 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:54.670274 26368 catalog_manager.cc:5697] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 2 to 3, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 3 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.697710 26548 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:09:54.700743 26617 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:09:54.705106 26467 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.707180 27924 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:54.708292 27911 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:54.723548 26548 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:54.726987 27833 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:54.722734 27911 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:54.732492 27911 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:54.753000 26369 catalog_manager.cc:5697] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 2, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 2 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.893348 26367 catalog_manager.cc:5697] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 4 to 5, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 5 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.915098 26467 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:54.916674 27849 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:54.949630 26542 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:54.951725 27925 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:55.174158 26467 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:55.211700 26542 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:55.214036 26621 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:55.216653 27765 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:09:55.220062 26439 consensus_peers.cc:597] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9275c8cfbe54472fba36a4ef3bf770f7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:55.223095 27836 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:55.252274 26622 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.254561 27765 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:55.257752 27879 raft_consensus.cc:2955] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:55.259284 26542 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:09:55.261344 27836 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:55.292536 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:55.295547 26617 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:09:55.299728 27765 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:55.301558 26622 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:55.273330 26621 raft_consensus.cc:2955] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:55.329816 26367 catalog_manager.cc:5697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b reported cstate change: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.335575 26539 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.365870 27879 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
W20260709 12:09:55.405555 26588 consensus_peers.cc:597] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 34b9da257a1d4dadbbe3027844b5b140. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:55.431197 26539 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:55.437568 26469 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:55.444245 27746 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:55.455292 27849 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:55.509909 26548 raft_consensus.cc:2955] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:55.536401 27746 raft_consensus.cc:2955] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:55.538151 26469 raft_consensus.cc:2955] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:55.599421 26548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:09:55.600164 26548 raft_consensus.cc:606] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:55.609674 26469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "3262bf0553e543eea76794fc529a9acc"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:09:55.610349 26469 raft_consensus.cc:606] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Received request to transfer leadership to TS 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:55.613855 26469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:09:55.614492 26469 raft_consensus.cc:606] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:55.619633 26622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:09:55.620267 26622 raft_consensus.cc:606] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:09:55.615942 26548 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:55.623050 26622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:09:55.623610 26622 raft_consensus.cc:606] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:09:55.624878 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:55.607357 26367 catalog_manager.cc:5697] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b reported cstate change: config changed from index -1 to 4, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 3 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:55.626822 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:55.627638 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:55.633582 27951 raft_consensus.cc:993] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:55.634261 27833 raft_consensus.cc:1081] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:55.636225 26469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43592
I20260709 12:09:55.638581 26469 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.640625 26469 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.654309 26467 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:55.661073 26469 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:55.656666 26622 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:09:55.662869 26514 consensus_peers.cc:597] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ffdceca3c04a40cdba75f01fa9ded9f8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:55.663228 27911 raft_consensus.cc:993] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:55.663755 27911 raft_consensus.cc:1081] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:55.665493 27950 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:55.667601 27950 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:55.670676 26622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54654
I20260709 12:09:55.671305 26622 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.671669 26622 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.680258 26622 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:55.685930 26469 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:55.688410 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:55.700349 26468 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:55.700687 26468 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:55.690443 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:55.690140 26622 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:55.701572 26548 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.692266 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:55.702585 26615 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:55.703058 26615 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:55.699489 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:55.704020 26539 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.706116 26468 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:55.707643 26468 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.722289 26468 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:09:55.724062 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:55.730822 26615 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:55.737754 26539 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:09:55.739477 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:55.740841 26548 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:09:55.741074 27951 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:55.741778 27951 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:55.748665 26615 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.764437 26615 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:09:55.754818 27765 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:55.742699 27951 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:55.785271 26542 raft_consensus.cc:2955] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:55.794821 27955 ts_tablet_manager.cc:933] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149)
I20260709 12:09:55.794654 27765 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:55.822055 27765 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:55.822613 27883 raft_consensus.cc:2955] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:55.840456 26617 raft_consensus.cc:2955] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:55.917757 27955 tablet_copy_client.cc:323] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.65:45149
I20260709 12:09:55.926133 27836 raft_consensus.cc:993] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: : Instructing follower 3262bf0553e543eea76794fc529a9acc to start an election
I20260709 12:09:55.931488 27836 raft_consensus.cc:1081] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Signalling peer 3262bf0553e543eea76794fc529a9acc to start an election
I20260709 12:09:55.933954 27972 ts_tablet_manager.cc:933] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:55.942332 27972 tablet_copy_client.cc:323] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.67:42217
W20260709 12:09:55.987140 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 94481.7us
I20260709 12:09:55.992942 26369 catalog_manager.cc:5697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 3 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 4 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:55.998704 26367 catalog_manager.cc:5697] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 3 to 4, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 4 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:56.002312 26483 tablet_copy_service.cc:140] P 01a57027214a411e80874ac7febd628b: Received BeginTabletCopySession request for tablet 9275c8cfbe54472fba36a4ef3bf770f7 from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:54414)
I20260709 12:09:56.003535 26483 tablet_copy_service.cc:161] P 01a57027214a411e80874ac7febd628b: Beginning new tablet copy session on tablet 9275c8cfbe54472fba36a4ef3bf770f7 from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:54414: session id = 3262bf0553e543eea76794fc529a9acc-9275c8cfbe54472fba36a4ef3bf770f7
I20260709 12:09:56.017128 26632 tablet_copy_service.cc:140] P aaadfdd9ca9f424c91505f9b43876233: Received BeginTabletCopySession request for tablet 34b9da257a1d4dadbbe3027844b5b140 from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:48232)
I20260709 12:09:56.018081 26632 tablet_copy_service.cc:161] P aaadfdd9ca9f424c91505f9b43876233: Beginning new tablet copy session on tablet 34b9da257a1d4dadbbe3027844b5b140 from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:48232: session id = 3262bf0553e543eea76794fc529a9acc-34b9da257a1d4dadbbe3027844b5b140
I20260709 12:09:56.037845 27167 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
 from {username='slave'} at 127.0.0.1:56902
I20260709 12:09:56.039117 27167 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:56.039898 27167 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:56.046219 26632 tablet_copy_source_session.cc:215] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:56.077591 26483 tablet_copy_source_session.cc:215] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:56.086779 26473 raft_consensus.cc:2955] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:56.095464 27972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b9da257a1d4dadbbe3027844b5b140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:56.105655 27955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9275c8cfbe54472fba36a4ef3bf770f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:56.102113 26368 catalog_manager.cc:5697] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 2 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:56.134784 27167 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:56.148699 27167 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:56.149292 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:56.150275 26469 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:56.150700 26469 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:56.151715 26469 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:56.153359 26469 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:56.170953 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:56.171931 26621 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:56.253470 27741 raft_consensus.cc:993] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:56.256186 27741 raft_consensus.cc:1081] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:56.261438 26469 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:09:56.269421 27972 tablet_copy_client.cc:806] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:56.283125 26544 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:56.287933 27972 tablet_copy_client.cc:670] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:56.300856 26473 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43592
I20260709 12:09:56.301445 26473 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:56.301719 26473 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:09:56.310725 26465 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:56.315805 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:09:56.318346 27875 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:56.319001 27875 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:09:56.314163 27972 tablet_copy_client.cc:538] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:56.320137 27875 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:56.328646 26546 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:56.329017 27974 raft_consensus.cc:993] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:56.329712 27880 raft_consensus.cc:1081] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:56.341578 27976 ts_tablet_manager.cc:933] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:56.338296 27952 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:56.356339 26473 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:56.360435 27952 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:09:56.369776 26622 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:56.371212 26620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:09:56.371867 26620 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:56.372258 26620 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.377147 26473 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:56.418998 26621 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:09:56.432770 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:56.468650 26622 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:09:56.380986 27968 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:56.469130 26622 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:56.474941 26620 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:56.497309 26616 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:56.506832 26371 catalog_manager.cc:5697] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 3 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 4 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:56.521817 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:56.523571 26544 raft_consensus.cc:3055] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:56.523947 26544 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:56.495415 26622 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:56.538545 27976 tablet_copy_client.cc:323] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.66:40567
I20260709 12:09:56.531062 26544 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:56.548614 26622 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:09:56.557734 27972 tablet_bootstrap.cc:492] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:09:56.562853 27955 tablet_copy_client.cc:806] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:56.563668 27955 tablet_copy_client.cc:670] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:56.566357 26620 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:56.570555 26544 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:56.581964 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 85929.1us
I20260709 12:09:56.582654 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:09:56.583498 27165 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:56.581866 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 50381.6us
I20260709 12:09:56.591099 26539 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:56.591300 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:56.592047 26548 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:09:56.610679 26473 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:56.617765 27960 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:09:56.638990 27955 tablet_copy_client.cc:538] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:09:56.663751 27978 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 12:09:56.639261 26514 consensus_peers.cc:597] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 724bc8274ed84709a5b83825934b7f03. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:56.670670 26548 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:09:56.713704 26544 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:56.719058 27969 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:09:56.733610 27165 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:56.740329 26622 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
W20260709 12:09:56.740821 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 114611us
W20260709 12:09:56.744794 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 57789.7us
W20260709 12:09:56.745556 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 47034us
I20260709 12:09:56.750141 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:56.752740 27883 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:56.753139 27985 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:09:56.753880 27985 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:56.758859 27985 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:09:56.759924 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 68210.3us
I20260709 12:09:56.761051 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:56.762131 27952 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:56.768464 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:56.762871 27952 raft_consensus.cc:697] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:56.776139 26620 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:09:56.799109 27952 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:56.802241 27875 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:56.803648 27955 tablet_bootstrap.cc:492] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:09:56.822220 26558 tablet_copy_service.cc:140] P ac3ac2181aa941229a758ccf6b5607cd: Received BeginTabletCopySession request for tablet ffdceca3c04a40cdba75f01fa9ded9f8 from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:44706)
I20260709 12:09:56.823007 26558 tablet_copy_service.cc:161] P ac3ac2181aa941229a758ccf6b5607cd: Beginning new tablet copy session on tablet ffdceca3c04a40cdba75f01fa9ded9f8 from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:44706: session id = 3262bf0553e543eea76794fc529a9acc-ffdceca3c04a40cdba75f01fa9ded9f8
W20260709 12:09:56.827515 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 166964us
I20260709 12:09:56.932852 26558 tablet_copy_source_session.cc:215] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:56.955358 26473 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:09:56.973359 27991 raft_consensus.cc:2955] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:56.975382 26367 catalog_manager.cc:5697] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 5 to 6, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 6 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:56.990933 27927 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:09:57.038836 27999 ts_tablet_manager.cc:933] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:09:57.046547 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 60680.2us
W20260709 12:09:57.056442 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 152055us
I20260709 12:09:57.064494 27976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffdceca3c04a40cdba75f01fa9ded9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:57.087742 26617 raft_consensus.cc:2955] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:57.188251 26368 catalog_manager.cc:5697] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:57.287804 27999 tablet_copy_client.cc:323] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.66:40567
W20260709 12:09:57.333983 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 244783us
W20260709 12:09:57.478619 27995 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:09:57.486752 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 188281us
I20260709 12:09:57.563230 26548 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.522624 27991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:44692 (request call id 8) took 1227 ms. Trace:
I20260709 12:09:57.578922 27164 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.619117 26617 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:09:57.621203 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 77467.6us
I20260709 12:09:57.663590 26542 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:09:57.672988 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 52984.8us
I20260709 12:09:57.668138 26558 tablet_copy_service.cc:140] P ac3ac2181aa941229a758ccf6b5607cd: Received BeginTabletCopySession request for tablet 724bc8274ed84709a5b83825934b7f03 from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:44706)
I20260709 12:09:57.709887 26558 tablet_copy_service.cc:161] P ac3ac2181aa941229a758ccf6b5607cd: Beginning new tablet copy session on tablet 724bc8274ed84709a5b83825934b7f03 from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:44706: session id = 3262bf0553e543eea76794fc529a9acc-724bc8274ed84709a5b83825934b7f03
I20260709 12:09:57.800308 26464 raft_consensus.cc:2955] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:09:57.604517 27991 rpcz_store.cc:276] 0709 12:09:56.280086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.280325 (+   239us) service_pool.cc:224] Handling call
0709 12:09:56.335518 (+ 55193us) log.cc:844] Serialized 506 byte log entry
0709 12:09:57.500484 (+1164966us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3805,"raft.queue_time_us":11129,"raft.run_cpu_time_us":1907,"raft.run_wall_time_us":1904,"thread_start_us":25549,"threads_started":1,"wal-append.queue_time_us":198043}
W20260709 12:09:57.934731 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 135122us
I20260709 12:09:57.936674 27968 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:57.938167 27765 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:09:57.938344 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 141360us
W20260709 12:09:57.955169 26511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.003s	sys 0.008s
W20260709 12:09:57.955734 26511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.003s	sys 0.008s
I20260709 12:09:58.000739 27972 tablet_bootstrap.cc:492] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:09:58.020988 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 66576.8us
I20260709 12:09:58.026373 28025 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:09:58.044726 26558 tablet_copy_source_session.cc:215] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:58.078795 27976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56894 (request call id 116) took 1915 ms. Trace:
W20260709 12:09:58.091107 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 47973.4us
I20260709 12:09:58.083279 27972 tablet_bootstrap.cc:492] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:09:58.124881 27988 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:09:58.131037 26542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2251a6321412417a8079201067ae2d0d"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:09:58.131816 26542 raft_consensus.cc:606] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:09:58.151824 26368 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57052 (request call id 222) took 1101 ms. Trace:
I20260709 12:09:58.123339 27972 ts_tablet_manager.cc:1403] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 1.566s	user 0.030s	sys 0.020s
W20260709 12:09:58.161119 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 63305.5us
I20260709 12:09:58.197274 27972 raft_consensus.cc:359] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:58.199760 27999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724bc8274ed84709a5b83825934b7f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:58.152340 26368 rpcz_store.cc:276] 0709 12:09:57.050502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.050652 (+   150us) service_pool.cc:224] Handling call
0709 12:09:58.151721 (+1101069us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:57.509890 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:57.510519 (+   629us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:57.510566 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:09:57.510587 (+    21us) tablet.cc:662] Decoding operations
0709 12:09:57.510980 (+   393us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:57.511041 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:57.511067 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:09:57.522168 (+ 11101us) tablet.cc:701] Row locks acquired
0709 12:09:57.526110 (+  3942us) write_op.cc:260] PREPARE: finished
0709 12:09:57.526312 (+   202us) write_op.cc:270] Start()
0709 12:09:57.526468 (+   156us) write_op.cc:276] Timestamp: P: 1783598997526267 usec, L: 0
0709 12:09:57.526494 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:09:57.527171 (+   677us) log.cc:844] Serialized 536 byte log entry
0709 12:09:57.667277 (+140106us) op_driver.cc:464] REPLICATION: finished
0709 12:09:57.955851 (+288574us) write_op.cc:301] APPLY: starting
0709 12:09:57.955944 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:57.956019 (+    75us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:57.956170 (+   151us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:57.956384 (+   214us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:57.956497 (+   113us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:09:57.956531 (+    34us) write_op.cc:312] APPLY: finished
0709 12:09:57.956704 (+   173us) log.cc:844] Serialized 23 byte log entry
0709 12:09:57.956898 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:57.956984 (+    86us) write_op.cc:454] Released schema lock
0709 12:09:57.957015 (+    31us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:57.957358 (+   343us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:57.957382 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":101912,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":288260,"apply.run_cpu_time_us":1518,"apply.run_wall_time_us":1518,"num_ops":1,"prepare.queue_time_us":2513,"prepare.run_cpu_time_us":3024,"prepare.run_wall_time_us":20770,"replication_time_us":137266,"thread_start_us":288939,"threads_started":1}]]}
I20260709 12:09:58.207841 26615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:09:58.246153 26615 raft_consensus.cc:606] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:09:58.079501 27976 rpcz_store.cc:276] 0709 12:09:56.163343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.164227 (+   884us) service_pool.cc:224] Handling call
0709 12:09:56.354460 (+190233us) ts_tablet_manager.cc:934] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
0709 12:09:56.649801 (+295341us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b4c001157c0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50743a6a20 00007f50743b7a29 00007f50743b813f 00007f507437c2ab 00007f50743a9f3c 00007f50743aa461 00007f50743aa768 00007f507a1302eb 00007f507b055d3b 00007f507b050008 00007f507b04f405
0709 12:09:57.062589 (+412788us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:09:57.605519 (+542930us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:57.615971 (+ 10452us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:09:58.061017 (+445046us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:09:58.061351 (+   334us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:58.061696 (+   345us) ts_tablet_manager.cc:989] Replica registered.
0709 12:09:58.076926 (+ 15230us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":39970,"spinlock_wait_cycles":45116288,"tablet-copy.queue_time_us":176381,"thread_start_us":224441,"threads_started":2}
I20260709 12:09:58.247793 27976 tablet_copy_client.cc:806] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:58.248478 27976 tablet_copy_client.cc:670] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:58.218734 27972 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:09:58.253074 27972 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:58.259145 26542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:09:58.260066 26542 raft_consensus.cc:606] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:58.264283 26464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:09:58.265157 26464 raft_consensus.cc:606] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:58.268734 26542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:09:58.269443 26542 raft_consensus.cc:606] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:58.273085 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:58.273211 27976 tablet_copy_client.cc:538] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:58.275735 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:58.276966 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:58.285751 27976 tablet_bootstrap.cc:492] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:09:58.293678 27972 ts_tablet_manager.cc:1434] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.125s	user 0.006s	sys 0.001s
I20260709 12:09:58.313120 27955 tablet_bootstrap.cc:492] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:58.313416 26632 tablet_copy_service.cc:342] P aaadfdd9ca9f424c91505f9b43876233: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-34b9da257a1d4dadbbe3027844b5b140 received from {username='slave'} at 127.0.0.1:48232
I20260709 12:09:58.313946 26632 tablet_copy_service.cc:434] P aaadfdd9ca9f424c91505f9b43876233: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-34b9da257a1d4dadbbe3027844b5b140 on tablet 34b9da257a1d4dadbbe3027844b5b140 with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:58.314272 27911 raft_consensus.cc:993] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:58.314896 27911 raft_consensus.cc:1081] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:58.245096 26371 catalog_manager.cc:5697] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:58.364138 27955 tablet_bootstrap.cc:492] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:09:58.365231 27955 ts_tablet_manager.cc:1403] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 1.562s	user 0.042s	sys 0.062s
I20260709 12:09:58.368772 26615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54654
I20260709 12:09:58.369602 26615 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.370060 26615 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.380164 26615 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:58.399531 26615 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:58.407429 28020 raft_consensus.cc:993] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:58.407965 28020 raft_consensus.cc:1081] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:58.408005 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:58.408862 26468 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:58.409265 26468 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:58.414763 26464 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43592
I20260709 12:09:58.415535 26464 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.416007 26464 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.410166 26468 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:58.424021 27999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56894 (request call id 123) took 1582 ms. Trace:
I20260709 12:09:58.450598 27999 rpcz_store.cc:276] 0709 12:09:56.841126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.841302 (+   176us) service_pool.cc:224] Handling call
0709 12:09:57.039188 (+197886us) ts_tablet_manager.cc:934] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
0709 12:09:58.192522 (+1153334us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:09:58.319696 (+127174us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:58.319866 (+   170us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:09:58.423201 (+103335us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:09:58.423520 (+   319us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:58.423887 (+   367us) ts_tablet_manager.cc:989] Replica registered.
0709 12:09:58.423957 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":326,"tablet-copy.queue_time_us":171341,"thread_start_us":321223,"threads_started":2}
I20260709 12:09:58.453727 26468 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.456693 26464 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:58.452071 27999 tablet_copy_client.cc:806] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:58.463862 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:58.464680 26548 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.468756 27999 tablet_copy_client.cc:670] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:58.472033 27880 raft_consensus.cc:993] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:58.472327 28007 raft_consensus.cc:993] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:58.472620 27880 raft_consensus.cc:1081] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:58.472887 27883 raft_consensus.cc:1081] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:09:58.474997 27999 tablet_copy_client.cc:538] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:58.477360 27955 raft_consensus.cc:359] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:58.478282 27955 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:09:58.479031 27955 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:58.488737 27976 tablet_bootstrap.cc:492] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:58.489751 27976 tablet_bootstrap.cc:492] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:09:58.491319 26620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:09:58.492036 26620 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.492420 26620 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.494782 26464 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:58.491750 26613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:09:58.496493 26613 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.496886 26613 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.497591 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:58.498189 26621 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:58.495855 27955 ts_tablet_manager.cc:1434] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.126s	user 0.006s	sys 0.003s
I20260709 12:09:58.498507 26621 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:58.501466 27168 raft_consensus.cc:1217] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:09:58.508551 26621 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:58.510108 26621 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.495162 27976 ts_tablet_manager.cc:1403] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.210s	user 0.020s	sys 0.017s
I20260709 12:09:58.518414 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:58.521541 26545 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.519033 26483 tablet_copy_service.cc:342] P 01a57027214a411e80874ac7febd628b: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-9275c8cfbe54472fba36a4ef3bf770f7 received from {username='slave'} at 127.0.0.1:54414
I20260709 12:09:58.525106 26468 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:09:58.521736 26613 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:58.528877 26483 tablet_copy_service.cc:434] P 01a57027214a411e80874ac7febd628b: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-9275c8cfbe54472fba36a4ef3bf770f7 on tablet 9275c8cfbe54472fba36a4ef3bf770f7 with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:58.536636 26621 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:09:58.540441 27976 raft_consensus.cc:359] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:58.561975 27976 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:09:58.562124 26613 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:09:58.562666 26439 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:58.562898 27976 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:58.565583 27976 ts_tablet_manager.cc:1434] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 12:09:58.566898 27168 raft_consensus.cc:1217] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:09:58.522583 26620 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:58.569635 28024 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:58.570214 28024 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:09:58.571179 28024 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:58.572386 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:58.572992 26547 raft_consensus.cc:3055] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:58.573298 26547 raft_consensus.cc:740] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:58.573993 26547 consensus_queue.cc:260] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:58.575171 26547 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.583145 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:58.583889 26540 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:58.584223 26540 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:58.584940 26540 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:58.585402 26620 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:09:58.586128 26540 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.592383 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:09:58.593106 27168 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.596158 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:58.597867 26558 tablet_copy_service.cc:342] P ac3ac2181aa941229a758ccf6b5607cd: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-ffdceca3c04a40cdba75f01fa9ded9f8 received from {username='slave'} at 127.0.0.1:44706
I20260709 12:09:58.598426 26558 tablet_copy_service.cc:434] P ac3ac2181aa941229a758ccf6b5607cd: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-ffdceca3c04a40cdba75f01fa9ded9f8 on tablet ffdceca3c04a40cdba75f01fa9ded9f8 with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:58.599514 27974 raft_consensus.cc:993] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:58.599864 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:09:58.600152 27974 raft_consensus.cc:1081] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:09:58.600504 26468 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.603075 27833 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:58.603721 27833 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:58.605015 26547 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:58.604691 27833 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:58.606915 26465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2251a6321412417a8079201067ae2d0d"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43606
I20260709 12:09:58.607543 26465 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.607937 26465 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.616824 26468 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:58.621645 26540 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:58.542413 26545 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:09:58.550130 27999 tablet_bootstrap.cc:492] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:09:58.639330 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:09:58.637364 26465 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:58.642201 26548 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:09:58.650243 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:58.651551 26465 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:58.656845 27741 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:58.658072 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:09:58.659065 26613 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.662358 27741 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:58.670236 27741 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:58.679514 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:09:58.680274 26547 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:58.680554 26547 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:09:58.681363 28012 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:09:58.681981 28012 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:58.685916 28022 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:58.686551 28022 raft_consensus.cc:697] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:09:58.687450 28022 consensus_queue.cc:237] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:58.747452 26547 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:58.782943 27168 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:09:58.785447 26547 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.823745 26613 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:09:58.832851 26547 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:09:58.795768 27162 raft_consensus.cc:1217] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:09:58.938900 28012 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:09:58.945119 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:09:58.972297 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:09:58.971966 28054 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:09:58.994701 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 95734us
I20260709 12:09:59.037385 26371 catalog_manager.cc:5697] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 3 to 4, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 4 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:59.003090 28054 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:09:59.047241 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 68854us
I20260709 12:09:59.049773 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:09:59.102190 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 84159us
I20260709 12:09:59.097994 28054 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:09:59.111615 26620 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:59.116740 26547 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:59.126092 28039 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:59.134990 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:09:59.136268 27946 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:59.141928 27993 raft_consensus.cc:1064] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:09:59.142180 28057 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:59.144958 27993 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:09:59.152349 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 49256.6us
I20260709 12:09:59.169411 28027 raft_consensus.cc:1064] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:09:59.172504 28027 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:59.188252 26464 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:59.192772 26547 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:59.208130 26367 catalog_manager.cc:5697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:59.217657 27167 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 3 LEARNER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:59.214767 26367 catalog_manager.cc:5697] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 3 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 4 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:59.221648 26367 catalog_manager.cc:5697] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:59.230860 26620 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:59.241839 27167 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:59.242861 28055 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:59.231530 27993 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:09:59.248459 26547 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:59.252257 26371 catalog_manager.cc:5697] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 2 to 3, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:59.201835 28057 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:09:59.257068 28055 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:09:59.265853 28024 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:59.274457 26548 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:59.283427 27741 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:59.264338 27883 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:09:59.292857 27167 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:59.305151 27952 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:59.329073 27999 tablet_bootstrap.cc:492] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:59.342161 26621 raft_consensus.cc:2955] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:59.350415 27999 tablet_bootstrap.cc:492] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:09:59.351411 27999 ts_tablet_manager.cc:1403] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.802s	user 0.034s	sys 0.004s
I20260709 12:09:59.355755 27999 raft_consensus.cc:359] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:59.356881 27999 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:09:59.333355 28039 raft_consensus.cc:2955] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:59.359257 27999 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:09:59.370435 27999 ts_tablet_manager.cc:1434] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.002s
I20260709 12:09:59.371428 26547 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:59.373508 26464 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:59.375398 26541 raft_consensus.cc:2955] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:59.372705 26620 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:59.421765 28012 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:09:59.422806 28011 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:59.415614 28020 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:09:59.473067 26467 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:59.475555 27988 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:59.710691 27168 raft_consensus.cc:1217] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:59.748136 26558 tablet_copy_service.cc:342] P ac3ac2181aa941229a758ccf6b5607cd: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-724bc8274ed84709a5b83825934b7f03 received from {username='slave'} at 127.0.0.1:44706
I20260709 12:09:59.748675 26558 tablet_copy_service.cc:434] P ac3ac2181aa941229a758ccf6b5607cd: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-724bc8274ed84709a5b83825934b7f03 on tablet 724bc8274ed84709a5b83825934b7f03 with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:09:59.772192 28011 raft_consensus.cc:2955] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:59.779955 26613 raft_consensus.cc:2955] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:59.802258 27168 raft_consensus.cc:2955] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:09:59.826614 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 333096us
I20260709 12:09:59.867216 27167 raft_consensus.cc:2955] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:59.874640 28022 raft_consensus.cc:1064] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:09:59.884482 28022 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:09:59.885403 26621 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:59.891357 28097 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:59.902436 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:59.920719 26367 catalog_manager.cc:5697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:09:59.993685 26541 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:00.058373 27167 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 3 LEARNER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:00.058620 26547 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:00.060110 27741 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:00.062609 27741 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:00.066849 26465 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:00.097514 28022 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:00.107937 26370 catalog_manager.cc:5697] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:10:00.145735 28099 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:10:00.210845 28020 raft_consensus.cc:2955] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:00.234071 27167 raft_consensus.cc:2955] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:00.252089 26368 catalog_manager.cc:5697] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 4 to 5, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:00.298072 26465 raft_consensus.cc:2955] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:00.311288 26468 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:00.336870 28011 raft_consensus.cc:1064] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:10:00.340374 28011 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:00.347854 28054 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
W20260709 12:10:00.376870 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 60787.4us
I20260709 12:10:00.398761 26542 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:00.438153 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 61511.5us
I20260709 12:10:00.441980 27167 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:00.437487 26467 raft_consensus.cc:2955] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:00.438680 26547 raft_consensus.cc:2955] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:00.462266 26542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:00.462930 26542 raft_consensus.cc:606] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:00.477505 26620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:10:00.478338 26620 raft_consensus.cc:606] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:10:00.483381 28095 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:10:00.534730 28054 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:00.570525 28024 raft_consensus.cc:2955] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:00.584201 26613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:10:00.585161 26613 raft_consensus.cc:606] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:10:00.585950 27167 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:00.587389 26467 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:00.589964 26465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "3262bf0553e543eea76794fc529a9acc"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:00.590622 26465 raft_consensus.cc:606] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Received request to transfer leadership to TS 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:00.590962 27167 raft_consensus.cc:2955] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:00.594548 26620 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:00.594975 26465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:00.596834 26465 raft_consensus.cc:606] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:00.598197 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:00.600178 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:00.600780 26357 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9275c8cfbe54472fba36a4ef3bf770f7 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:00.601064 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:00.620916 28108 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:00.626192 27946 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:00.639279 26369 catalog_manager.cc:5697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b reported cstate change: config changed from index 4 to 5, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:00.646757 26613 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:00.647439 28056 raft_consensus.cc:993] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: : Instructing follower ac3ac2181aa941229a758ccf6b5607cd to start an election
I20260709 12:10:00.647991 28097 raft_consensus.cc:1081] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Signalling peer ac3ac2181aa941229a758ccf6b5607cd to start an election
I20260709 12:10:00.665266 26609 tablet_service.cc:1558] Processing DeleteTablet for tablet 9275c8cfbe54472fba36a4ef3bf770f7 with delete_type TABLET_DATA_TOMBSTONED (TS aaadfdd9ca9f424c91505f9b43876233 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54638
I20260709 12:10:00.667981 26542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:55088
I20260709 12:10:00.668819 26542 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:00.669302 26542 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:00.673848 28108 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:00.678048 27168 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:00.681149 26542 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:00.682646 28057 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:00.684444 28117 tablet_replica.cc:333] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:10:00.684347 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:00.723881 26467 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:00.724208 26467 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:00.719998 26540 raft_consensus.cc:2955] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:00.725231 26467 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:00.726580 26467 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:00.694088 26542 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:00.704893 27168 raft_consensus.cc:2955] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:00.709676 26547 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:00.719493 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:00.728788 26620 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:00.693182 28093 raft_consensus.cc:2955] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:00.731249 26547 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:00.740917 28016 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:10:00.750355 28117 raft_consensus.cc:2243] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:00.752060 28117 raft_consensus.cc:2272] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:00.754161 26620 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:00.756402 26467 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:00.783525 26542 raft_consensus.cc:2955] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:00.816315 28117 ts_tablet_manager.cc:1916] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:00.877282 26368 catalog_manager.cc:5697] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 5 to 6, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New cstate: current_term: 3 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:00.900527 26358 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 34b9da257a1d4dadbbe3027844b5b140 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:10:00.907572 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 137974us
W20260709 12:10:00.909173 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 139144us
I20260709 12:10:00.910619 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:10:00.930130 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 86574.1us
I20260709 12:10:00.935084 27167 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:00.957998 28012 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:00.979127 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44619us
I20260709 12:10:00.979611 28012 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:01.008842 26469 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:01.027737 28012 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:01.044816 28097 raft_consensus.cc:993] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: : Instructing follower 3262bf0553e543eea76794fc529a9acc to start an election
I20260709 12:10:01.045444 28097 raft_consensus.cc:1081] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Signalling peer 3262bf0553e543eea76794fc529a9acc to start an election
I20260709 12:10:01.054885 28117 ts_tablet_manager.cc:1929] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:10:01.055455 28117 log.cc:1199] T 9275c8cfbe54472fba36a4ef3bf770f7 P aaadfdd9ca9f424c91505f9b43876233: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-2-root/wals/9275c8cfbe54472fba36a4ef3bf770f7
I20260709 12:10:01.058063 27162 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
 from {username='slave'} at 127.0.0.1:56902
I20260709 12:10:01.058959 27162 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:01.059473 27162 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.070544 28057 raft_consensus.cc:993] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:01.071112 28057 raft_consensus.cc:1081] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:01.072548 28063 raft_consensus.cc:993] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:01.073213 28108 raft_consensus.cc:1081] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
W20260709 12:10:01.075744 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 81079.2us
I20260709 12:10:01.078055 28137 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:01.079644 26358 catalog_manager.cc:5028] TS aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): tablet 9275c8cfbe54472fba36a4ef3bf770f7 (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:10:01.079116 28129 raft_consensus.cc:2955] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:01.081120 28125 raft_consensus.cc:993] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:01.083411 28125 raft_consensus.cc:1081] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:01.090705 26469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43592
I20260709 12:10:01.091460 26469 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:01.091888 26469 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.104497 26455 tablet_service.cc:1558] Processing DeleteTablet for tablet 34b9da257a1d4dadbbe3027844b5b140 with delete_type TABLET_DATA_TOMBSTONED (TS 01a57027214a411e80874ac7febd628b not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:43588
I20260709 12:10:01.108666 26468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43592
I20260709 12:10:01.109325 26468 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:01.109714 26468 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.111716 28132 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:01.133478 26468 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:01.142288 27167 raft_consensus.cc:2955] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:01.150134 26469 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:01.173892 27162 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:01.157617 26369 catalog_manager.cc:5697] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 6 to 7, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 7 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:01.192312 26613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:10:01.193012 26613 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:01.193549 26613 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.195154 26468 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:01.203395 26469 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:01.195883 26618 raft_consensus.cc:2955] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:01.211098 26613 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:01.212028 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:01.212684 26540 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.226832 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:01.227555 26621 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:01.227902 26621 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:01.235306 27162 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:01.239981 26540 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:01.241981 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:01.242686 26469 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:01.240005 26613 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:01.243006 26469 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:01.245637 26469 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:01.247040 26469 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.248672 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:01.249279 26617 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:01.249571 26617 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:01.250255 26617 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:01.252699 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:01.253280 26540 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:01.253566 26540 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:01.254282 26540 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:01.255040 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:01.255662 26545 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.259418 26617 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.259819 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:01.260483 26541 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.250787 26621 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:01.262925 26621 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.251722 26370 catalog_manager.cc:5697] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:01.252312 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:01.268671 26473 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.226892 28141 tablet_replica.cc:333] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:10:01.279075 28141 raft_consensus.cc:2243] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:01.290498 26617 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:01.319058 26439 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:01.286770 28063 raft_consensus.cc:2955] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:01.320912 28122 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:01.321645 28122 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:01.298120 26540 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.323722 28122 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:01.300283 26621 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:01.307192 26468 raft_consensus.cc:2955] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:01.295188 28141 raft_consensus.cc:2272] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:01.334086 26540 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:10:01.286340 26473 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:10:01.335729 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:01.342994 28141 ts_tablet_manager.cc:1916] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:01.352069 27168 raft_consensus.cc:2955] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:01.353380 26369 catalog_manager.cc:5697] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 2 to 3, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:01.362160 28133 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:01.365837 28133 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:01.310349 26541 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 3.
I20260709 12:10:01.367033 26357 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ffdceca3c04a40cdba75f01fa9ded9f8 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:01.366899 28133 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:01.312743 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:10:01.368621 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55982.8us
I20260709 12:10:01.369856 28138 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:01.316979 26542 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:01.370337 28138 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:01.371220 28138 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:01.375021 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 47423.5us
I20260709 12:10:01.310812 26465 raft_consensus.cc:2955] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:01.383551 27162 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:01.384588 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:01.384727 26369 catalog_manager.cc:5697] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index 4 to 5, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New cstate: current_term: 2 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:01.386186 28130 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:01.386761 28130 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 3 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:01.317271 26545 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:01.387673 28130 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:01.374881 26469 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 3.
I20260709 12:10:01.422209 26464 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:01.423870 28063 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:10:01.438575 28012 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:01.441670 26609 tablet_service.cc:1558] Processing DeleteTablet for tablet ffdceca3c04a40cdba75f01fa9ded9f8 with delete_type TABLET_DATA_TOMBSTONED (TS aaadfdd9ca9f424c91505f9b43876233 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54638
I20260709 12:10:01.442768 28117 tablet_replica.cc:333] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:10:01.452113 28117 raft_consensus.cc:2243] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:01.453102 28117 raft_consensus.cc:2272] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:01.453888 26369 catalog_manager.cc:5697] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 2 to 3, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 3 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:01.458052 28117 ts_tablet_manager.cc:1916] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:01.464254 28140 raft_consensus.cc:2955] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:01.483402 27162 raft_consensus.cc:2955] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:01.484301 26368 catalog_manager.cc:5697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 2 to 3, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:01.497421 26464 raft_consensus.cc:2955] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:01.536689 26370 catalog_manager.cc:5697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:01.552212 26464 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:01.554319 28108 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:01.601523 26357 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 724bc8274ed84709a5b83825934b7f03 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:01.633028 26621 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:01.637161 28063 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:01.656684 28117 ts_tablet_manager.cc:1929] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:10:01.657238 28117 log.cc:1199] T ffdceca3c04a40cdba75f01fa9ded9f8 P aaadfdd9ca9f424c91505f9b43876233: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-2-root/wals/ffdceca3c04a40cdba75f01fa9ded9f8
I20260709 12:10:01.662228 28141 ts_tablet_manager.cc:1929] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:10:01.662843 28141 log.cc:1199] T 34b9da257a1d4dadbbe3027844b5b140 P 01a57027214a411e80874ac7febd628b: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-0-root/wals/34b9da257a1d4dadbbe3027844b5b140
I20260709 12:10:01.665040 26358 catalog_manager.cc:5028] TS aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): tablet ffdceca3c04a40cdba75f01fa9ded9f8 (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:10:01.666826 26357 catalog_manager.cc:5028] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): tablet 34b9da257a1d4dadbbe3027844b5b140 (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:10:01.674904 26369 catalog_manager.cc:5697] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:01.714125 26609 tablet_service.cc:1558] Processing DeleteTablet for tablet 724bc8274ed84709a5b83825934b7f03 with delete_type TABLET_DATA_TOMBSTONED (TS aaadfdd9ca9f424c91505f9b43876233 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54638
I20260709 12:10:01.715663 28117 tablet_replica.cc:333] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:10:01.717232 28117 raft_consensus.cc:2243] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:01.718506 28117 raft_consensus.cc:2272] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:01.734745 28117 ts_tablet_manager.cc:1916] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:01.788365 26617 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:01.792412 28054 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:01.794934 28117 ts_tablet_manager.cc:1929] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:10:01.795464 28117 log.cc:1199] T 724bc8274ed84709a5b83825934b7f03 P aaadfdd9ca9f424c91505f9b43876233: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-2-root/wals/724bc8274ed84709a5b83825934b7f03
I20260709 12:10:01.797530 26468 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:01.799315 28125 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:01.798702 26358 catalog_manager.cc:5028] TS aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): tablet 724bc8274ed84709a5b83825934b7f03 (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:10:01.811249 26468 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:01.819723 26542 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:01.821645 28130 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:01.822774 27927 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:01.830655 26541 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:01.834690 28133 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:01.899233 26616 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:01.933097 28138 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:01.952788 26542 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:01.967741 28109 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:01.981912 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:01.992740 26541 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:01.995616 28109 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:02.093680 26464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:02.094343 26464 raft_consensus.cc:606] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:02.100885 26621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:10:02.101529 26621 raft_consensus.cc:606] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:10:02.108562 26468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "3262bf0553e543eea76794fc529a9acc"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:02.109158 26468 raft_consensus.cc:606] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Received request to transfer leadership to TS 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:02.112075 26542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:02.112668 26542 raft_consensus.cc:606] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:02.116315 26621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:10:02.116977 26621 raft_consensus.cc:606] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:10:02.118130 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:02.120191 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:02.121058 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:02.127247 28037 raft_consensus.cc:993] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:02.127862 28063 raft_consensus.cc:1081] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:02.141386 26621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:10:02.142347 26621 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:02.142853 26621 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.149997 26621 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:02.152024 26621 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:02.152838 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:02.153515 26464 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.158710 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:02.159323 26542 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:02.159668 26542 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:02.160264 26464 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:10:02.161031 26542 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:02.161902 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:02.162380 26542 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.162812 28133 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:02.163326 28133 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:02.164201 28133 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:02.193682 26542 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:10:02.205412 26369 catalog_manager.cc:5697] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:02.239156 28125 raft_consensus.cc:993] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:02.239711 28133 raft_consensus.cc:1081] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:02.241628 26464 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43592
I20260709 12:10:02.242218 26464 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:02.242609 26464 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.247412 26464 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:02.249158 26464 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:02.250608 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:02.250620 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:02.251271 27162 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.251601 26621 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:02.251920 26621 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:02.254067 26621 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:02.256299 26621 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.261139 27162 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:10:02.262607 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:02.263636 28095 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:02.264170 28095 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:02.265084 28095 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:02.267952 26621 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:10:02.287954 26369 catalog_manager.cc:5697] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 2, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 2 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:02.305501 28133 raft_consensus.cc:993] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:02.306072 28136 raft_consensus.cc:1081] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:02.309552 26468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43592
I20260709 12:10:02.310235 26468 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:02.310652 26468 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.318365 26468 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:02.324095 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:02.324756 26621 raft_consensus.cc:3055] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:02.325409 26621 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:02.325098 26468 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:02.327733 26621 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:02.328672 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:02.328959 26621 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.329412 26542 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.340750 26621 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:10:02.341120 26542 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:10:02.342235 26439 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:02.343250 28109 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:02.343854 28109 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:02.344936 28109 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:02.360677 26369 catalog_manager.cc:5697] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 2, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 2 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:02.554837 28138 raft_consensus.cc:993] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: : Instructing follower ac3ac2181aa941229a758ccf6b5607cd to start an election
I20260709 12:10:02.555374 28095 raft_consensus.cc:1081] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Signalling peer ac3ac2181aa941229a758ccf6b5607cd to start an election
I20260709 12:10:02.556975 26542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:55088
I20260709 12:10:02.557476 26542 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:02.557804 26542 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.563490 28138 raft_consensus.cc:993] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: : Instructing follower 3262bf0553e543eea76794fc529a9acc to start an election
I20260709 12:10:02.564388 28095 raft_consensus.cc:1081] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Signalling peer 3262bf0553e543eea76794fc529a9acc to start an election
I20260709 12:10:02.566337 27164 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
 from {username='slave'} at 127.0.0.1:56902
I20260709 12:10:02.567113 27164 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:02.567108 26542 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:02.567828 27164 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:02.570689 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:02.570752 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:02.571420 26621 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.571506 26469 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:02.571981 26469 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:02.572930 26469 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:02.574064 26469 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.576721 26542 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:02.583259 26469 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:02.587702 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:02.588820 28037 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:02.589392 28037 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:02.590351 28037 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:02.596096 26621 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:02.601863 26468 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:02.606770 28125 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:02.615003 27164 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:02.623014 26369 catalog_manager.cc:5697] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 2 to 3, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 3 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:02.625571 27164 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:02.627715 26541 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:02.629179 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:02.647239 26468 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:02.647652 26468 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:02.647431 28136 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:02.648569 26468 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:02.638003 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 50405.4us
I20260709 12:10:02.650027 26468 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:02.655840 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:02.656551 26547 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:02.671030 26547 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:02.672400 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:02.674307 28159 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:02.674863 28159 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:02.675745 28159 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:02.721928 27164 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:02.724189 28095 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:02.755005 26468 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:02.758249 26547 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:02.761327 28095 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:02.845412 26616 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:02.860430 28187 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:02.907938 26368 catalog_manager.cc:5697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 3 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 4 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:02.956099 26622 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:02.986614 28109 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:10:02.994166 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 104056us
I20260709 12:10:03.033006 26621 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:03.034646 28171 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.075409 26468 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:03.087705 26541 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:03.082243 28063 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:10:03.099210 26468 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:03.101426 28159 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:03.127481 26547 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:03.131008 28174 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:03.139514 26622 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:10:03.141623 26514 consensus_peers.cc:597] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dee06ad5f38b42f99fdbc1d71eee680f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:03.142306 28194 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:03.145941 26464 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:10:03.148818 28063 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:03.181409 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:03.180678 28171 raft_consensus.cc:2955] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:10:03.183575 26622 raft_consensus.cc:2955] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:10:03.200441 26464 raft_consensus.cc:2955] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:10:03.210656 26367 catalog_manager.cc:5697] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:10:03.246151 26465 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
W20260709 12:10:03.262126 26439 consensus_peers.cc:597] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e9f2c921ba4426a8185f516aa2d8deb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:03.265729 26622 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:03.269522 28189 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.280046 26541 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:03.284427 28185 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:03.301543 26541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:03.302845 28109 raft_consensus.cc:2955] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:10:03.302314 26541 raft_consensus.cc:606] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:03.304430 26622 raft_consensus.cc:2955] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:10:03.309810 26545 raft_consensus.cc:2955] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:10:03.310935 26465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d235a62666644668508e208ad8d21d3"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:03.311640 26465 raft_consensus.cc:606] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:03.317317 26621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:10:03.317982 26621 raft_consensus.cc:606] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:10:03.324131 26547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:03.324776 26547 raft_consensus.cc:606] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:10:03.326102 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:10:03.328038 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:03.328851 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:03.343847 26465 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:03.331868 26368 catalog_manager.cc:5697] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 2 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
W20260709 12:10:03.383457 26439 consensus_peers.cc:597] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1ee0545deb746aeb5c1c14751b96826. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:03.383699 26621 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:03.385890 28109 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:03.410434 26541 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:03.412272 28109 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.427263 28185 raft_consensus.cc:2955] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:10:03.440665 26622 raft_consensus.cc:2955] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
W20260709 12:10:03.449774 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 14b3fc9b208642ffb7dbc462c4032c67: Remote error: Service unavailable: leader transfer in progress
I20260709 12:10:03.458777 26370 catalog_manager.cc:5697] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b reported cstate change: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:03.486918 26542 raft_consensus.cc:2955] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:10:03.549238 28191 raft_consensus.cc:993] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: : Instructing follower ac3ac2181aa941229a758ccf6b5607cd to start an election
I20260709 12:10:03.549822 28185 raft_consensus.cc:1081] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Signalling peer ac3ac2181aa941229a758ccf6b5607cd to start an election
I20260709 12:10:03.551819 26545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d235a62666644668508e208ad8d21d3"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:55088
I20260709 12:10:03.552438 26545 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:03.552788 26545 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:03.563431 26545 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:03.569494 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:03.570218 26464 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:03.570647 26464 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:03.571647 26464 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:03.573024 26464 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:03.576519 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:03.577200 26622 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:03.574956 26545 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:03.581952 26464 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:03.583235 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:03.584574 28171 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:03.585860 26622 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:03.587729 28171 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:03.591447 28171 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:03.616670 26370 catalog_manager.cc:5697] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 3 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 4 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:03.666843 28171 raft_consensus.cc:993] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:03.667455 28171 raft_consensus.cc:1081] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:03.669641 26464 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43606
I20260709 12:10:03.670316 26464 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:03.670763 26464 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.680503 26464 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:03.683529 26464 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:03.683614 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:03.684393 26542 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:03.684758 26542 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:03.685606 26542 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:03.686360 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:03.687057 26542 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.687799 27168 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.696738 26542 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:10:03.696921 27168 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:10:03.698509 26438 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:03.699587 28185 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:03.700165 28185 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:03.704325 28185 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:03.718699 28133 raft_consensus.cc:993] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:03.719226 28133 raft_consensus.cc:1081] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:03.721380 26465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43592
I20260709 12:10:03.722007 26465 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:03.722420 26465 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:03.726112 28208 ts_tablet_manager.cc:933] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:03.747932 28171 raft_consensus.cc:993] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:03.748524 28171 raft_consensus.cc:1081] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:03.750492 26616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:10:03.751151 26616 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:03.751525 26616 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.761190 26616 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:03.772178 28208 tablet_copy_client.cc:323] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.66:40567
I20260709 12:10:03.777527 26558 tablet_copy_service.cc:140] P ac3ac2181aa941229a758ccf6b5607cd: Received BeginTabletCopySession request for tablet dee06ad5f38b42f99fdbc1d71eee680f from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:44706)
I20260709 12:10:03.778187 26558 tablet_copy_service.cc:161] P ac3ac2181aa941229a758ccf6b5607cd: Beginning new tablet copy session on tablet dee06ad5f38b42f99fdbc1d71eee680f from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:44706: session id = 3262bf0553e543eea76794fc529a9acc-dee06ad5f38b42f99fdbc1d71eee680f
I20260709 12:10:03.794462 26558 tablet_copy_source_session.cc:215] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:03.798058 26616 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:03.800001 28208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dee06ad5f38b42f99fdbc1d71eee680f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:03.808269 28210 ts_tablet_manager.cc:933] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149)
I20260709 12:10:03.811826 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:03.812657 26542 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:03.813140 26542 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:03.814064 26542 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:03.826941 26542 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.854581 28210 tablet_copy_client.cc:323] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.65:45149
I20260709 12:10:03.865346 26483 tablet_copy_service.cc:140] P 01a57027214a411e80874ac7febd628b: Received BeginTabletCopySession request for tablet 0e9f2c921ba4426a8185f516aa2d8deb from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:54414)
I20260709 12:10:03.909541 28208 tablet_copy_client.cc:806] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:03.910377 28208 tablet_copy_client.cc:670] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:03.933231 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:03.934024 26470 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.936049 26483 tablet_copy_service.cc:161] P 01a57027214a411e80874ac7febd628b: Beginning new tablet copy session on tablet 0e9f2c921ba4426a8185f516aa2d8deb from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:54414: session id = 3262bf0553e543eea76794fc529a9acc-0e9f2c921ba4426a8185f516aa2d8deb
I20260709 12:10:03.942494 28208 tablet_copy_client.cc:538] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:03.943874 28213 ts_tablet_manager.cc:933] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149)
I20260709 12:10:03.949131 26483 tablet_copy_source_session.cc:215] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:03.954844 28213 tablet_copy_client.cc:323] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.65:45149
I20260709 12:10:03.959561 26470 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:10:03.964139 28208 tablet_bootstrap.cc:492] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:10:03.965950 26465 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:03.998759 28210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e9f2c921ba4426a8185f516aa2d8deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:04.012382 26465 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:04.020565 28208 tablet_bootstrap.cc:492] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:04.029590 28208 tablet_bootstrap.cc:492] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:10:04.030660 28208 ts_tablet_manager.cc:1403] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.067s	user 0.031s	sys 0.012s
I20260709 12:10:04.034435 28208 raft_consensus.cc:359] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:04.020821 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:04.035797 26616 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:04.036216 26616 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:04.037181 26616 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:04.038751 26616 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:04.028285 28210 tablet_copy_client.cc:806] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:04.046979 28210 tablet_copy_client.cc:670] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:04.047431 28208 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:10:04.049571 28208 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:04.051000 26616 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:04.051991 26370 catalog_manager.cc:5697] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 2 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:04.063211 26483 tablet_copy_service.cc:140] P 01a57027214a411e80874ac7febd628b: Received BeginTabletCopySession request for tablet d1ee0545deb746aeb5c1c14751b96826 from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:54414)
I20260709 12:10:04.063876 26483 tablet_copy_service.cc:161] P 01a57027214a411e80874ac7febd628b: Beginning new tablet copy session on tablet d1ee0545deb746aeb5c1c14751b96826 from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:54414: session id = 3262bf0553e543eea76794fc529a9acc-d1ee0545deb746aeb5c1c14751b96826
I20260709 12:10:04.065879 26439 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:04.066965 28189 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:04.069579 28189 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:04.036599 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:04.072665 28208 ts_tablet_manager.cc:1434] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.001s
I20260709 12:10:04.074177 28136 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:04.074848 28136 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:04.074193 26483 tablet_copy_source_session.cc:215] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:04.075845 28136 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:04.082082 26616 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:04.070581 28189 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:04.086505 28037 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:04.090721 26558 tablet_copy_service.cc:342] P ac3ac2181aa941229a758ccf6b5607cd: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-dee06ad5f38b42f99fdbc1d71eee680f received from {username='slave'} at 127.0.0.1:44706
I20260709 12:10:04.091327 26558 tablet_copy_service.cc:434] P ac3ac2181aa941229a758ccf6b5607cd: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-dee06ad5f38b42f99fdbc1d71eee680f on tablet dee06ad5f38b42f99fdbc1d71eee680f with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:04.070598 26542 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:10:04.109206 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:04.109889 26545 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:04.125946 28210 tablet_copy_client.cc:538] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:04.126672 28213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1ee0545deb746aeb5c1c14751b96826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:04.139887 28210 tablet_bootstrap.cc:492] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:10:04.153483 28213 tablet_copy_client.cc:806] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:04.165052 28213 tablet_copy_client.cc:670] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:04.171203 28213 tablet_copy_client.cc:538] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:04.174664 26370 catalog_manager.cc:5697] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:04.178505 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 75196.4us
I20260709 12:10:04.192960 28213 tablet_bootstrap.cc:492] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:10:04.200910 26370 catalog_manager.cc:5697] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 4 to 5, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 5 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:04.214709 27164 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:04.216585 28191 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:04.224696 26468 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:04.239267 28012 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:04.239519 26545 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:04.317562 28213 tablet_bootstrap.cc:492] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:04.318749 28213 tablet_bootstrap.cc:492] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:10:04.319759 28213 ts_tablet_manager.cc:1403] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.127s	user 0.027s	sys 0.007s
I20260709 12:10:04.326313 28213 raft_consensus.cc:359] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:04.327262 28213 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:10:04.327987 28213 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:04.332847 27168 raft_consensus.cc:1217] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:10:04.341765 28213 ts_tablet_manager.cc:1434] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:10:04.344282 26483 tablet_copy_service.cc:342] P 01a57027214a411e80874ac7febd628b: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-d1ee0545deb746aeb5c1c14751b96826 received from {username='slave'} at 127.0.0.1:54414
I20260709 12:10:04.344799 26483 tablet_copy_service.cc:434] P 01a57027214a411e80874ac7febd628b: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-d1ee0545deb746aeb5c1c14751b96826 on tablet d1ee0545deb746aeb5c1c14751b96826 with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:04.377053 26542 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:04.379779 28210 tablet_bootstrap.cc:492] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:04.380959 28210 tablet_bootstrap.cc:492] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:10:04.381831 28210 ts_tablet_manager.cc:1403] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.242s	user 0.024s	sys 0.008s
I20260709 12:10:04.393270 28210 raft_consensus.cc:359] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:04.394253 28210 raft_consensus.cc:740] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:10:04.395051 28210 consensus_queue.cc:260] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:04.397081 27164 raft_consensus.cc:1217] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:10:04.398340 28210 ts_tablet_manager.cc:1434] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 12:10:04.400420 26483 tablet_copy_service.cc:342] P 01a57027214a411e80874ac7febd628b: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-0e9f2c921ba4426a8185f516aa2d8deb received from {username='slave'} at 127.0.0.1:54414
I20260709 12:10:04.400926 26483 tablet_copy_service.cc:434] P 01a57027214a411e80874ac7febd628b: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-0e9f2c921ba4426a8185f516aa2d8deb on tablet 0e9f2c921ba4426a8185f516aa2d8deb with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:04.409227 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:04.425546 28109 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:04.501077 26622 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:04.513258 28185 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:04.554769 26545 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:04.556392 28189 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:04.557672 27168 raft_consensus.cc:1217] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:10:04.597397 26622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:10:04.598198 26622 raft_consensus.cc:606] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:10:04.601854 26465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:04.602506 26465 raft_consensus.cc:606] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:04.606196 26465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:04.606797 26465 raft_consensus.cc:606] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:04.610029 26545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:04.610667 26545 raft_consensus.cc:606] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:04.611994 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:10:04.613763 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:04.614539 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:04.616518 28227 raft_consensus.cc:993] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:04.617095 28229 raft_consensus.cc:1081] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:04.618901 26616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:10:04.619513 26616 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:04.619890 26616 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.642069 26616 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:04.652000 26616 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:04.652906 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:04.653735 26468 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.655249 26540 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:04.652994 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:04.660202 26545 raft_consensus.cc:3055] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:04.660570 26545 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:04.661368 26545 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:04.663049 26545 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.663337 28224 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:04.676589 26468 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:10:04.678012 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:04.678984 28136 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:04.679518 28136 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:04.680411 28136 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:04.685914 26468 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:04.686609 26545 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:10:04.687608 28224 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:04.742183 28224 raft_consensus.cc:993] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:04.742791 28224 raft_consensus.cc:1081] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:04.746088 26470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43592
I20260709 12:10:04.746757 26470 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:04.747133 26470 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.763847 26470 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:04.767246 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:04.767989 26616 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:04.768368 26616 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:04.783538 26616 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:04.784958 26616 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.787734 26470 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:04.791635 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:04.792315 27168 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.814810 26367 catalog_manager.cc:5697] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:04.825091 26616 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:04.836021 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:04.845171 28189 raft_consensus.cc:993] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: : Instructing follower ac3ac2181aa941229a758ccf6b5607cd to start an election
I20260709 12:10:04.847595 28189 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:04.848066 28191 raft_consensus.cc:1081] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Signalling peer ac3ac2181aa941229a758ccf6b5607cd to start an election
I20260709 12:10:04.848100 28189 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:04.852473 26540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:55088
I20260709 12:10:04.853207 26540 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:04.853794 26540 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.853281 28189 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:04.868460 27168 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:04.896829 26540 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:04.908004 26540 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:04.910315 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:04.911019 26622 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.921530 26622 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:04.922780 26514 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:04.923734 28229 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:04.924338 28229 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:04.909667 26368 catalog_manager.cc:5697] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 2 to 3, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:04.926826 28229 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:04.929497 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:04.930142 26470 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:04.930473 26470 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:04.935484 26470 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:04.936831 26470 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.945858 28189 raft_consensus.cc:1064] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
W20260709 12:10:04.946417 28189 raft_consensus.cc:1068] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Unable to promote non-voter 3262bf0553e543eea76794fc529a9acc: Service unavailable: leader transfer in progress
I20260709 12:10:04.955482 26470 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:04.959098 28109 raft_consensus.cc:993] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: : Instructing follower ac3ac2181aa941229a758ccf6b5607cd to start an election
I20260709 12:10:04.959616 28109 raft_consensus.cc:1081] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Signalling peer ac3ac2181aa941229a758ccf6b5607cd to start an election
I20260709 12:10:04.971662 26540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:55088
I20260709 12:10:04.972429 26540 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:04.973299 26540 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.979075 26368 catalog_manager.cc:5697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 3 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 4 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:04.985038 26540 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:04.988112 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:04.988760 26470 raft_consensus.cc:3055] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:04.989068 26470 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:04.991670 26540 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:04.991763 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:04.992576 26622 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.989864 26470 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:05.002360 26470 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.007030 26622 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:05.008425 26514 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:05.009317 28229 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:05.009862 28229 raft_consensus.cc:697] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:05.010828 28229 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:05.017127 26470 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:05.035756 26368 catalog_manager.cc:5697] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 3 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 4 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:05.038172 28185 raft_consensus.cc:1064] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:10:05.041456 28185 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:05.057447 27168 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:05.061813 26616 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:05.063091 28109 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:05.069990 26545 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:05.073257 28187 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:05.074718 28191 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:05.171797 28191 raft_consensus.cc:2955] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:05.190018 26470 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:05.197427 27168 raft_consensus.cc:2955] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:05.198465 28180 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:05.230160 26616 raft_consensus.cc:2955] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:05.237627 26542 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:05.241106 26368 catalog_manager.cc:5697] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b reported cstate change: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:05.242913 27164 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Advancing to term 2
I20260709 12:10:05.253152 27164 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:05.255192 28180 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:05.258037 28180 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:05.278676 26540 raft_consensus.cc:2955] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:05.285310 26470 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:05.292642 26622 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:05.292665 27164 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:05.296020 28187 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:05.296960 28249 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:05.307006 27168 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:05.350558 28191 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:10:05.399995 28185 raft_consensus.cc:2955] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:05.406700 27164 raft_consensus.cc:2955] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:05.416597 26616 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:05.416844 26622 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:05.422950 28227 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:05.423519 28222 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:05.430343 28133 raft_consensus.cc:1064] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:10:05.433823 28133 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:05.464723 26357 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0e9f2c921ba4426a8185f516aa2d8deb with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:05.470173 27167 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:05.480023 26540 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:05.484222 28258 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:10:05.504387 26470 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:05.501991 28136 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:10:05.542572 28220 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:10:05.569974 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 85047.1us
I20260709 12:10:05.571300 28133 raft_consensus.cc:2955] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:05.580741 26470 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:05.596737 26368 catalog_manager.cc:5697] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 4 to 5, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New cstate: current_term: 2 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:05.606292 28222 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:05.609993 26468 raft_consensus.cc:2955] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:05.644703 26470 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:05.659855 26532 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e9f2c921ba4426a8185f516aa2d8deb with delete_type TABLET_DATA_TOMBSTONED (TS ac3ac2181aa941229a758ccf6b5607cd not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:55084
I20260709 12:10:05.616170 27162 raft_consensus.cc:2955] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:05.621577 26545 raft_consensus.cc:2955] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:05.699652 28229 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:05.699846 26616 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:05.704422 26621 raft_consensus.cc:2955] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:05.711532 28269 tablet_replica.cc:333] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:10:05.724104 28269 raft_consensus.cc:2243] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:05.727782 27162 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 3 LEARNER]: Advancing to term 4
I20260709 12:10:05.764274 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:05.791553 28189 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:05.752409 28269 raft_consensus.cc:2272] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:05.805362 28269 ts_tablet_manager.cc:1916] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:05.817674 27162 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 4 LEARNER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:10:05.841012 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 91244.5us
I20260709 12:10:05.859161 26367 catalog_manager.cc:5697] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 2 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:05.885540 28269 ts_tablet_manager.cc:1929] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:10:05.887606 28269 log.cc:1199] T 0e9f2c921ba4426a8185f516aa2d8deb P ac3ac2181aa941229a758ccf6b5607cd: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-1-root/wals/0e9f2c921ba4426a8185f516aa2d8deb
I20260709 12:10:05.902680 28171 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:05.941138 26357 catalog_manager.cc:5028] TS ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): tablet 0e9f2c921ba4426a8185f516aa2d8deb (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:10:06.007159 26617 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:06.015496 27162 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:06.018122 28220 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:06.027518 28265 raft_consensus.cc:2955] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:06.040649 27162 raft_consensus.cc:2955] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:06.047420 26545 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:06.065286 28265 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:06.064522 26545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:06.066008 26358 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dee06ad5f38b42f99fdbc1d71eee680f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:06.066206 26545 raft_consensus.cc:606] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:06.069857 26616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:10:06.070596 26616 raft_consensus.cc:606] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:10:06.073838 26542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:06.074513 26542 raft_consensus.cc:606] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:06.077766 26468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:06.078377 26468 raft_consensus.cc:606] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:06.079795 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:10:06.080240 26370 catalog_manager.cc:5697] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index 4 to 5, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:06.081689 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:06.082813 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:06.098719 26455 tablet_service.cc:1558] Processing DeleteTablet for tablet dee06ad5f38b42f99fdbc1d71eee680f with delete_type TABLET_DATA_TOMBSTONED (TS 01a57027214a411e80874ac7febd628b not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:43588
I20260709 12:10:06.102519 28283 tablet_replica.cc:333] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:10:06.106880 26542 raft_consensus.cc:2955] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:06.109709 28283 raft_consensus.cc:2243] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:06.112991 28283 raft_consensus.cc:2272] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:10:06.116102 28280 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:10:06.119797 28283 ts_tablet_manager.cc:1916] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:06.119978 28267 raft_consensus.cc:1064] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:10:06.133858 28267 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:06.154762 28275 raft_consensus.cc:993] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:06.155398 28270 raft_consensus.cc:1081] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:06.163626 26617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:10:06.164346 26617 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:06.164836 26617 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.175132 28283 ts_tablet_manager.cc:1929] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:10:06.216970 26468 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:06.231969 26616 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:06.237485 28227 raft_consensus.cc:993] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:06.240609 28227 raft_consensus.cc:1081] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:06.234311 28229 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:10:06.248469 28270 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:06.254280 28283 log.cc:1199] T dee06ad5f38b42f99fdbc1d71eee680f P 01a57027214a411e80874ac7febd628b: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-0-root/wals/dee06ad5f38b42f99fdbc1d71eee680f
I20260709 12:10:06.272043 27162 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 4 LEARNER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:06.282577 26622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:10:06.283655 26622 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:06.284206 26622 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.301844 26357 catalog_manager.cc:5028] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): tablet dee06ad5f38b42f99fdbc1d71eee680f (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:10:06.291738 28270 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:10:06.356562 26621 raft_consensus.cc:2955] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:06.394134 26622 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:06.404676 26622 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:06.410332 27167 raft_consensus.cc:2955] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:06.457068 26617 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:06.459635 26617 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:06.398891 28227 raft_consensus.cc:2955] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:06.483139 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:06.484123 26544 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:06.484472 26544 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:06.485446 26544 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:06.486326 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:06.487092 26464 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.487028 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:06.488031 26540 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:06.489398 26540 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:06.490471 26540 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:06.492220 26540 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.488842 26544 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.504974 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:06.506171 26470 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:06.526739 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 55520.6us
I20260709 12:10:06.534032 28276 raft_consensus.cc:993] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: : Instructing follower ac3ac2181aa941229a758ccf6b5607cd to start an election
I20260709 12:10:06.535187 28189 raft_consensus.cc:1081] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Signalling peer ac3ac2181aa941229a758ccf6b5607cd to start an election
I20260709 12:10:06.551573 26464 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:10:06.554808 26540 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:10:06.586558 26544 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:10:06.597121 26470 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
W20260709 12:10:06.637444 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 52244us
I20260709 12:10:06.647056 26370 catalog_manager.cc:5697] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index 3 to 5, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:06.648823 26541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:55088
I20260709 12:10:06.649477 26541 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:06.649626 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:06.649914 26541 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.651782 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:06.653759 28265 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:06.654335 28265 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:06.655422 28265 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:06.657189 28133 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:06.657730 28133 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:06.658849 28133 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:06.671767 26471 raft_consensus.cc:2955] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:06.711813 26541 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:06.718593 28259 raft_consensus.cc:993] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:06.719201 28259 raft_consensus.cc:1081] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:06.724284 26464 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43592
I20260709 12:10:06.724905 26464 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:06.725271 26464 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.743896 26464 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:06.746462 26464 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:06.757161 26541 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:06.760931 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:06.761579 27167 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.765880 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:06.766963 26541 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.773344 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:06.774066 26621 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:06.774363 26621 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:06.775463 26621 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:06.776678 26621 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.783855 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:06.784583 26464 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:06.784891 26464 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:06.785772 26464 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:06.788312 26464 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.803049 26541 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:06.806304 27167 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:06.806977 26621 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:06.810428 26464 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:06.812043 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:06.837984 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:06.823098 28276 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:06.839828 28276 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:06.849833 28276 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:06.868551 28171 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:06.869204 28171 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:06.873206 28171 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:06.917627 26545 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:06.931097 26371 catalog_manager.cc:5697] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:06.935031 26371 catalog_manager.cc:5697] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:06.965257 26470 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:06.967346 27167 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:06.975051 28268 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:10:06.982995 28171 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:06.991842 28227 raft_consensus.cc:2955] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:07.002178 26370 catalog_manager.cc:5697] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 2 to 3, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 3 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:07.010733 26470 raft_consensus.cc:2955] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:07.012085 26368 catalog_manager.cc:5697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 4 to 5, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 5 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:07.034701 27167 raft_consensus.cc:2955] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:07.044849 26357 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d1ee0545deb746aeb5c1c14751b96826 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:07.053155 26471 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:07.054140 26370 catalog_manager.cc:5697] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index 5 to 6, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New cstate: current_term: 4 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:07.059038 28133 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:07.060319 26545 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:07.066494 28133 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:07.103108 26609 tablet_service.cc:1558] Processing DeleteTablet for tablet d1ee0545deb746aeb5c1c14751b96826 with delete_type TABLET_DATA_TOMBSTONED (TS aaadfdd9ca9f424c91505f9b43876233 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:54638
I20260709 12:10:07.164222 26470 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:07.167042 28259 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:07.200058 26545 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:07.200207 28304 tablet_replica.cc:333] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:10:07.202201 28304 raft_consensus.cc:2243] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:07.204126 28304 raft_consensus.cc:2272] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:07.211580 28133 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:07.217352 28304 ts_tablet_manager.cc:1916] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:07.237856 26616 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:07.247066 28189 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:07.269778 28304 ts_tablet_manager.cc:1929] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:10:07.270584 28304 log.cc:1199] T d1ee0545deb746aeb5c1c14751b96826 P aaadfdd9ca9f424c91505f9b43876233: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-2-root/wals/d1ee0545deb746aeb5c1c14751b96826
I20260709 12:10:07.273131 26358 catalog_manager.cc:5028] TS aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): tablet d1ee0545deb746aeb5c1c14751b96826 (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:10:07.308107 27167 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:07.309805 28229 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:07.348884 26545 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:07.350667 28296 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:07.366935 26470 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:07.369158 28171 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:07.956385 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:08.058705 26616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:10:08.062495 26616 raft_consensus.cc:606] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:10:08.072708 26471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:08.073307 26471 raft_consensus.cc:606] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:08.076768 26545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:08.077504 26545 raft_consensus.cc:606] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:08.081159 26616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "3262bf0553e543eea76794fc529a9acc"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:10:08.081913 26616 raft_consensus.cc:606] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Received request to transfer leadership to TS 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:08.085701 26471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:08.086344 26471 raft_consensus.cc:606] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:08.087723 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:08.089918 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:08.091282 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:08.244714 26471 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:08.247054 28133 raft_consensus.cc:993] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 3262bf0553e543eea76794fc529a9acc to start an election
I20260709 12:10:08.247717 28259 raft_consensus.cc:1081] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Signalling peer 3262bf0553e543eea76794fc529a9acc to start an election
I20260709 12:10:08.249603 27167 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
 from {username='slave'} at 127.0.0.1:56886
I20260709 12:10:08.250253 27167 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:08.250685 27167 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:08.256054 26439 consensus_peers.cc:597] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 69e1490de99a4232a6717e72242a0f00. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:08.257624 26616 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:08.257624 26545 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:08.259039 27167 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:08.259835 28109 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:08.260834 28286 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:08.262681 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:08.263127 27167 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:08.263337 26545 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.265558 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:08.266155 26616 raft_consensus.cc:3055] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:08.266475 26616 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:08.267268 26616 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:08.282745 26616 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.295769 26616 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 3.
I20260709 12:10:08.297816 27134 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:08.298920 28284 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.299373 28171 raft_consensus.cc:993] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:08.299887 28171 raft_consensus.cc:1081] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:08.299468 28284 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 3 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:08.301900 28133 raft_consensus.cc:993] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:08.302446 28133 raft_consensus.cc:1081] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:08.302206 28284 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:08.304466 26471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43592
I20260709 12:10:08.306017 26471 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:08.306514 26471 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.311708 26616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:10:08.313006 26616 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:08.313467 26616 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.318778 28109 raft_consensus.cc:2955] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:10:08.326233 26471 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:08.327013 26371 catalog_manager.cc:5697] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 2 to 3, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 3 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:08.330881 26616 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:08.340077 26471 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:08.341886 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:08.342707 26622 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:08.343132 26622 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:08.343506 26616 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:08.343741 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:08.344444 26540 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:08.344836 26540 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:08.345677 26540 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:08.347258 26540 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.345041 26622 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:08.348181 26622 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.403728 26541 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:08.413219 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:08.407241 26540 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:08.414115 26542 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.415777 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:08.416667 28290 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:08.417223 28290 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:08.418177 28290 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:08.423251 26542 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:08.448072 26545 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 3.
W20260709 12:10:08.459407 26514 consensus_peers.cc:597] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a2747b6998c418ab70cbcbd2f2deeaa. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:08.464855 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:08.465579 26471 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:08.467826 28329 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:10:08.475540 26613 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:10:08.479333 28316 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:10:08.488124 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 146248us
I20260709 12:10:08.488951 26471 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:08.499609 28315 raft_consensus.cc:2955] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:10:08.442099 26622 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:08.512058 26439 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:08.519240 28324 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.519992 28324 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:08.521509 28324 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:08.526788 26617 raft_consensus.cc:2955] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:10:08.552075 26368 catalog_manager.cc:5697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 3 to 4, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 4 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:08.554586 26616 raft_consensus.cc:2955] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:10:08.558947 26366 catalog_manager.cc:5697] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.566080 26545 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:08.558595 26370 catalog_manager.cc:5697] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b reported cstate change: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:08.582541 26514 consensus_peers.cc:597] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 366874f8c4424fa2a9f169e9c3d6e97e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:08.584376 26464 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:10:08.587495 26613 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:10:08.589030 28316 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:08.597930 26541 raft_consensus.cc:2955] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:10:08.621146 28316 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:08.630276 26464 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:10:08.641528 28315 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:08.646348 28323 raft_consensus.cc:993] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: : Instructing follower ac3ac2181aa941229a758ccf6b5607cd to start an election
I20260709 12:10:08.647004 28323 raft_consensus.cc:1081] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Signalling peer ac3ac2181aa941229a758ccf6b5607cd to start an election
I20260709 12:10:08.653626 26464 raft_consensus.cc:2955] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:10:08.656378 28327 raft_consensus.cc:993] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b: : Instructing follower ac3ac2181aa941229a758ccf6b5607cd to start an election
I20260709 12:10:08.657080 28325 raft_consensus.cc:1081] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Signalling peer ac3ac2181aa941229a758ccf6b5607cd to start an election
I20260709 12:10:08.667647 26541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:55088
I20260709 12:10:08.668390 26541 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:08.668808 26541 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.696174 28229 raft_consensus.cc:2955] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:10:08.700846 26613 raft_consensus.cc:2955] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:10:08.728588 26368 catalog_manager.cc:5697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 2 to 3, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.735297 26542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:55088
I20260709 12:10:08.735970 26542 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:08.736382 26542 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.736610 26541 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:08.739073 26541 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:08.740571 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:08.747402 26616 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:08.751736 28331 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:08.754457 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 5c23e0d03a4d457fa50856e09fe2f649: Remote error: Service unavailable: leader transfer in progress
I20260709 12:10:08.757117 26370 catalog_manager.cc:5697] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.747144 26542 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:08.777388 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:08.779430 26470 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:08.779778 26470 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:08.780591 26470 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:08.781792 26470 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.766620 26617 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.795637 26470 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:10:08.785964 26542 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:08.791530 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:08.799330 26613 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.809135 26470 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:08.810743 28133 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:10:08.817837 26617 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:10:08.832118 26613 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:08.833390 26514 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:08.834313 28229 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:08.834969 28229 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 5 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:08.836084 28229 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:08.841060 26542 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:08.844388 28285 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:08.851257 26514 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:08.855625 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:08.856359 26468 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:08.856701 28171 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:08.857313 28171 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:08.860518 28171 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:08.856671 26468 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:08.865063 26468 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:08.870606 26468 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.899302 28349 ts_tablet_manager.cc:933] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149)
I20260709 12:10:08.944954 26545 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:08.993561 26468 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
W20260709 12:10:09.001746 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 125026us
I20260709 12:10:09.004501 28341 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:10:09.012701 28349 tablet_copy_client.cc:323] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.65:45149
I20260709 12:10:09.038717 26483 tablet_copy_service.cc:140] P 01a57027214a411e80874ac7febd628b: Received BeginTabletCopySession request for tablet 69e1490de99a4232a6717e72242a0f00 from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:54414)
I20260709 12:10:09.039412 26483 tablet_copy_service.cc:161] P 01a57027214a411e80874ac7febd628b: Beginning new tablet copy session on tablet 69e1490de99a4232a6717e72242a0f00 from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:54414: session id = 3262bf0553e543eea76794fc529a9acc-69e1490de99a4232a6717e72242a0f00
I20260709 12:10:09.042706 26622 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:09.048249 28286 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:09.033995 26366 catalog_manager.cc:5697] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 4 to 5, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 5 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:09.112237 26544 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:09.123163 26483 tablet_copy_source_session.cc:215] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:09.160087 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:09.138942 28325 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
W20260709 12:10:09.270100 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 118786us
I20260709 12:10:09.286141 28367 ts_tablet_manager.cc:933] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:09.293164 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 189812us
I20260709 12:10:09.306051 28349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69e1490de99a4232a6717e72242a0f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:09.323854 26613 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:09.313259 26464 raft_consensus.cc:2955] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
W20260709 12:10:09.327546 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 50035.3us
I20260709 12:10:09.344990 26470 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:09.345121 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55760.7us
I20260709 12:10:09.300416 28371 ts_tablet_manager.cc:933] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:09.354732 28358 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:09.383872 26468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2251a6321412417a8079201067ae2d0d"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:09.384605 26468 raft_consensus.cc:606] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:09.418690 26617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:10:09.419494 26617 raft_consensus.cc:606] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:10:09.419785 26366 catalog_manager.cc:5697] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 1 to 2, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 2 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:09.426308 26468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:09.427026 26468 raft_consensus.cc:606] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:09.426077 28315 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:10:09.432206 26544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:09.432832 26544 raft_consensus.cc:606] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:09.442009 26622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:10:09.442679 26622 raft_consensus.cc:606] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:10:09.453756 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:09.455804 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:09.456692 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:09.453822 26613 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:09.472441 28321 raft_consensus.cc:993] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:09.472987 28321 raft_consensus.cc:1081] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:09.478780 28349 tablet_copy_client.cc:806] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:09.464027 28229 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:10:09.479494 28349 tablet_copy_client.cc:670] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:09.481961 28367 tablet_copy_client.cc:323] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.66:40567
I20260709 12:10:09.500553 26558 tablet_copy_service.cc:140] P ac3ac2181aa941229a758ccf6b5607cd: Received BeginTabletCopySession request for tablet 1a2747b6998c418ab70cbcbd2f2deeaa from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:44706)
I20260709 12:10:09.501154 26558 tablet_copy_service.cc:161] P ac3ac2181aa941229a758ccf6b5607cd: Beginning new tablet copy session on tablet 1a2747b6998c418ab70cbcbd2f2deeaa from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:44706: session id = 3262bf0553e543eea76794fc529a9acc-1a2747b6998c418ab70cbcbd2f2deeaa
I20260709 12:10:09.507916 26616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54654
I20260709 12:10:09.508540 26616 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:09.508919 26616 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.519645 26464 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:09.522630 26558 tablet_copy_source_session.cc:215] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:09.525702 28371 tablet_copy_client.cc:323] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.66:40567
I20260709 12:10:09.530624 26616 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:09.533393 28352 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:09.535214 28366 raft_consensus.cc:993] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: : Instructing follower ac3ac2181aa941229a758ccf6b5607cd to start an election
I20260709 12:10:09.535771 28366 raft_consensus.cc:1081] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Signalling peer ac3ac2181aa941229a758ccf6b5607cd to start an election
I20260709 12:10:09.558502 26558 tablet_copy_service.cc:140] P ac3ac2181aa941229a758ccf6b5607cd: Received BeginTabletCopySession request for tablet 366874f8c4424fa2a9f169e9c3d6e97e from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:44706)
I20260709 12:10:09.559172 26558 tablet_copy_service.cc:161] P ac3ac2181aa941229a758ccf6b5607cd: Beginning new tablet copy session on tablet 366874f8c4424fa2a9f169e9c3d6e97e from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:44706: session id = 3262bf0553e543eea76794fc529a9acc-366874f8c4424fa2a9f169e9c3d6e97e
I20260709 12:10:09.562927 28367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2747b6998c418ab70cbcbd2f2deeaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:09.571296 26558 tablet_copy_source_session.cc:215] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:09.577234 26616 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:09.577600 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:09.578292 26471 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:09.578752 26471 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:09.580629 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:09.581274 27162 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.585184 28349 tablet_copy_client.cc:538] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:09.594810 28371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 366874f8c4424fa2a9f169e9c3d6e97e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:10:09.590030 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 61757.1us
I20260709 12:10:09.601125 26544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2251a6321412417a8079201067ae2d0d"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:55088
I20260709 12:10:09.601752 26544 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:09.602140 26544 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.605489 27162 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:09.621768 26588 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:09.622069 26471 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:09.623618 26471 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.625312 28367 tablet_copy_client.cc:806] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:09.625974 28367 tablet_copy_client.cc:670] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:09.628221 28372 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:09.628825 28372 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:09.629751 28372 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:09.644435 28367 tablet_copy_client.cc:538] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:09.672442 26471 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:09.665309 28349 tablet_bootstrap.cc:492] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:10:09.676869 26544 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:09.688604 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:09.689239 26471 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:09.689604 26471 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:09.698002 26544 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:09.702795 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:09.703437 26622 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.694849 26471 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:09.712257 26471 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.725579 26622 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:09.727005 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:09.738049 26471 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:09.743197 28352 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.744078 28352 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:09.752357 28352 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:09.765115 28367 tablet_bootstrap.cc:492] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:10:09.795480 28362 raft_consensus.cc:993] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:09.796038 28362 raft_consensus.cc:1081] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:09.799062 28371 tablet_copy_client.cc:806] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:09.799732 28371 tablet_copy_client.cc:670] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:09.805593 26471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43592
I20260709 12:10:09.806259 26471 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:09.806668 26471 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.818158 28371 tablet_copy_client.cc:538] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:09.817324 26368 catalog_manager.cc:5697] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 2 to 3, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 3 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:09.827164 26366 catalog_manager.cc:5697] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 3 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 4 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:09.836843 26471 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:09.844604 26471 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:09.844482 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:09.845182 26540 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.855444 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:09.856115 26613 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:09.856418 26613 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:09.857180 26613 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:09.858523 26613 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.845103 28229 raft_consensus.cc:993] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:09.867025 28229 raft_consensus.cc:1081] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:09.868716 26617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:10:09.869292 26617 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:09.869674 26617 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:09.877277 28349 tablet_bootstrap.cc:492] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:09.880599 28349 tablet_bootstrap.cc:492] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:10:09.853183 26540 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:09.881985 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:09.882995 28325 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.883572 28325 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:09.884766 28325 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:09.879451 28371 tablet_bootstrap.cc:492] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:10:09.898211 28349 ts_tablet_manager.cc:1403] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.246s	user 0.025s	sys 0.009s
I20260709 12:10:09.904906 26617 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:09.907881 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:09.908567 26471 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:09.916782 26471 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:10:09.918111 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:09.918967 28372 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:09.919513 28372 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:09.920612 26613 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:09.920432 28372 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:09.923779 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:09.924396 26540 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:09.924719 26540 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:09.925446 26540 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:09.926647 26540 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:09.933981 26540 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:10:09.934517 26617 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:09.956830 26370 catalog_manager.cc:5697] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 3 to 4, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 4 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:09.959657 28349 raft_consensus.cc:359] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:09.960647 28349 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:10:09.970613 28364 raft_consensus.cc:993] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:09.971222 28364 raft_consensus.cc:1081] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:09.975929 28367 tablet_bootstrap.cc:492] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:09.977104 28367 tablet_bootstrap.cc:492] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:10:09.977916 28367 ts_tablet_manager.cc:1403] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.213s	user 0.020s	sys 0.009s
I20260709 12:10:09.961378 28349 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:09.981871 28349 ts_tablet_manager.cc:1434] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.000s
I20260709 12:10:09.990818 26465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43592
I20260709 12:10:09.991545 26465 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:09.991926 26465 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.009196 26483 tablet_copy_service.cc:342] P 01a57027214a411e80874ac7febd628b: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-69e1490de99a4232a6717e72242a0f00 received from {username='slave'} at 127.0.0.1:54414
I20260709 12:10:10.009786 26483 tablet_copy_service.cc:434] P 01a57027214a411e80874ac7febd628b: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-69e1490de99a4232a6717e72242a0f00 on tablet 69e1490de99a4232a6717e72242a0f00 with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:09.997798 28367 raft_consensus.cc:359] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:10.025475 28367 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:10:10.019377 26465 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:10.027410 28371 tablet_bootstrap.cc:492] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:10.027987 26465 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:10.028633 28371 tablet_bootstrap.cc:492] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:10:10.028801 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:10.029517 26540 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.029735 28371 ts_tablet_manager.cc:1403] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.151s	user 0.022s	sys 0.007s
I20260709 12:10:10.033284 28371 raft_consensus.cc:359] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:10.034312 28371 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:10:10.035115 28371 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:10.037073 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:10.037442 28371 ts_tablet_manager.cc:1434] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:10:10.037792 26617 raft_consensus.cc:3055] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:10.038190 26617 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:10.040622 26617 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:10.026310 28367 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:10.042738 26617 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.055438 28367 ts_tablet_manager.cc:1434] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.002s
I20260709 12:10:10.056730 26540 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:10.060331 26558 tablet_copy_service.cc:342] P ac3ac2181aa941229a758ccf6b5607cd: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-366874f8c4424fa2a9f169e9c3d6e97e received from {username='slave'} at 127.0.0.1:44706
I20260709 12:10:10.056571 26370 catalog_manager.cc:5697] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 7 to 8, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 8 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:10.060873 26558 tablet_copy_service.cc:434] P ac3ac2181aa941229a758ccf6b5607cd: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-366874f8c4424fa2a9f169e9c3d6e97e on tablet 366874f8c4424fa2a9f169e9c3d6e97e with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:10.068503 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:10.069391 28109 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:10.069522 26617 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:10.069932 28109 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:10.076258 28109 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:10.082451 27162 raft_consensus.cc:1217] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:10:10.084095 26558 tablet_copy_service.cc:342] P ac3ac2181aa941229a758ccf6b5607cd: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-1a2747b6998c418ab70cbcbd2f2deeaa received from {username='slave'} at 127.0.0.1:44706
I20260709 12:10:10.084619 26558 tablet_copy_service.cc:434] P ac3ac2181aa941229a758ccf6b5607cd: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-1a2747b6998c418ab70cbcbd2f2deeaa on tablet 1a2747b6998c418ab70cbcbd2f2deeaa with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:10.088898 27162 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:10.091593 28341 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:10.112794 26465 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:10.120236 28372 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:10.134361 26370 catalog_manager.cc:5697] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 4 to 5, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 5 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:10.184422 27167 raft_consensus.cc:1217] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:10:10.326757 26617 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:10.330413 28229 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:10.354775 26465 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:10.369081 26540 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:10.371201 28359 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:10.372536 28259 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:10.378986 26471 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:10.385257 28341 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:10:10.437273 27167 raft_consensus.cc:1217] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:10:10.493104 28359 raft_consensus.cc:1064] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:10:10.495889 28359 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:10.516029 27167 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:10.516276 26613 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:10.518190 28315 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:10.519711 28229 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:10.529201 26613 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:10.530874 28325 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:10.532472 26540 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:10.544991 28352 raft_consensus.cc:2955] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:10.559267 26468 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:10.559119 27167 raft_consensus.cc:2955] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:10.582243 28327 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:10.586585 28171 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:10:10.592371 26613 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:10.592644 26617 raft_consensus.cc:2955] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:10.596695 28286 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:10.600397 26545 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:10.638299 28327 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:10.643173 26366 catalog_manager.cc:5697] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:10.711455 26468 raft_consensus.cc:2955] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:10:10.710569 28405 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:10:10.723093 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:10.720541 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53045.4us
W20260709 12:10:10.763960 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 68718.4us
I20260709 12:10:10.819006 28315 raft_consensus.cc:1064] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:10:10.825410 28315 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:10.877151 26465 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:10.880265 28229 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:10.894220 27167 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 1 LEARNER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:10.904206 26540 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:10.914032 26613 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:10.915686 28359 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:10.923964 28411 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:10.942423 26613 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:10.952673 27162 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:10.963060 28315 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:10.967371 28315 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:10.976668 28315 raft_consensus.cc:2955] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:10.980803 26622 raft_consensus.cc:2955] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:10.992635 27162 raft_consensus.cc:2955] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:11.008319 26371 catalog_manager.cc:5697] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index 3 to 4, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:11.013551 26622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "541724f47bb04d5185dd369750546cbf"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:10:11.014200 26622 raft_consensus.cc:606] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:10:11.021049 26465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:11.021708 26465 raft_consensus.cc:606] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:11.023087 28109 raft_consensus.cc:1064] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:10:11.029474 26540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:11.025787 28109 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:11.034495 27164 raft_consensus.cc:2955] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:11.032505 28409 raft_consensus.cc:2955] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:11.036185 26540 raft_consensus.cc:606] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:11.030253 26357 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1a2747b6998c418ab70cbcbd2f2deeaa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:11.065038 26540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:11.065930 26540 raft_consensus.cc:606] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:10:11.066342 26455 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a2747b6998c418ab70cbcbd2f2deeaa with delete_type TABLET_DATA_TOMBSTONED (TS 01a57027214a411e80874ac7febd628b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43588
I20260709 12:10:11.067930 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:10:11.070806 28286 raft_consensus.cc:993] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: : Instructing follower ac3ac2181aa941229a758ccf6b5607cd to start an election
I20260709 12:10:11.071544 28365 raft_consensus.cc:1081] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Signalling peer ac3ac2181aa941229a758ccf6b5607cd to start an election
I20260709 12:10:11.086504 26540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:55088
I20260709 12:10:11.087329 26540 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:11.087832 26540 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.111603 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:11.112555 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:11.036181 26613 raft_consensus.cc:2955] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:11.130690 26540 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:11.173508 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:11.174173 26613 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.186414 26540 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:11.187713 26613 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:11.230468 27162 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 3 LEARNER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:11.243235 26617 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:11.244535 26514 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:11.245869 28359 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:11.246551 28359 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 5 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:11.247699 28359 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:11.266177 28286 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:11.268993 28286 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:11.293218 26370 catalog_manager.cc:5697] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:10:11.355937 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 195192us
I20260709 12:10:11.370096 26545 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:11.511869 28422 tablet_replica.cc:333] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:10:11.548692 28433 raft_consensus.cc:993] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
W20260709 12:10:11.549120 28431 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:10:11.549273 28433 raft_consensus.cc:1081] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:11.553051 26368 catalog_manager.cc:5697] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 4 to 5, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 5 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:11.554585 28422 raft_consensus.cc:2243] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:11.562767 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:11.563472 26468 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:11.563781 26468 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:11.578877 26468 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:11.586941 26468 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.589735 28422 raft_consensus.cc:2272] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:11.593583 26471 raft_consensus.cc:2955] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:11.598141 26468 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:11.602771 28432 raft_consensus.cc:2955] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:10:11.613037 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 88724.6us
I20260709 12:10:11.618661 28414 raft_consensus.cc:993] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:11.622793 28422 ts_tablet_manager.cc:1916] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:11.652557 28414 raft_consensus.cc:1081] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:11.674584 26622 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:11.674923 26617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:10:11.675590 26617 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:11.676469 28409 raft_consensus.cc:993] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:11.677033 28315 raft_consensus.cc:1081] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:10:11.676880 26617 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.686702 28424 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:11.692034 28315 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:11.697486 26622 raft_consensus.cc:2955] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:11.711025 26471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43606
I20260709 12:10:11.711712 26471 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:11.712175 26471 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.715821 26617 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:11.715550 27162 raft_consensus.cc:2955] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:11.729216 26368 catalog_manager.cc:5697] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b reported cstate change: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:11.732322 26540 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:11.743480 27167 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:10:11.747579 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 141789us
I20260709 12:10:11.753768 26617 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:11.772524 26468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "541724f47bb04d5185dd369750546cbf"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43592
I20260709 12:10:11.773120 26468 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:11.773475 26468 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.778541 26471 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:11.775563 26542 raft_consensus.cc:2955] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:11.791007 26468 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:11.796509 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:11.797199 26464 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.779814 28409 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:10:11.808768 26471 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:11.810848 26464 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:11.829779 26465 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:11.830739 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:11.831097 26470 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:11.831611 26540 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:11.832093 26540 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:11.837774 28229 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:11.837815 26471 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:11.850244 26540 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:11.851711 26466 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:11.860836 28441 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:11.866149 26540 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.867058 26468 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:11.865968 26470 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:11.878870 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:11.879582 26616 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:11.879920 26616 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:11.881731 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:11.881731 26621 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:11.882459 27162 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.883621 26540 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:11.894870 27162 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:11.903465 26616 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:11.904834 26616 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.905800 27162 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:11.875125 28411 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:10:11.912110 28426 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:10:11.913962 28422 ts_tablet_manager.cc:1929] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:10:11.914572 28422 log.cc:1199] T 1a2747b6998c418ab70cbcbd2f2deeaa P 01a57027214a411e80874ac7febd628b: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-0-root/wals/1a2747b6998c418ab70cbcbd2f2deeaa
I20260709 12:10:11.919813 28441 raft_consensus.cc:2955] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:11.923983 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:11.924846 27167 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.930069 27164 raft_consensus.cc:2955] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:11.949865 26357 catalog_manager.cc:5028] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): tablet 1a2747b6998c418ab70cbcbd2f2deeaa (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:10:11.954828 26465 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:11.956171 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:11.956808 26542 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:11.956941 27167 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:11.957160 26542 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:11.952874 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:11.959658 26542 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:11.961058 26542 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.977419 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:11.981240 28442 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:11.993048 28446 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:11.994059 28446 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:11.995421 28446 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:12.013986 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 61200.3us
I20260709 12:10:12.023101 26470 raft_consensus.cc:2955] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:12.047665 26357 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 366874f8c4424fa2a9f169e9c3d6e97e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:12.056360 26542 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:12.048629 26368 catalog_manager.cc:5697] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 3 to 4, VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) evicted. New cstate: current_term: 1 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:10:12.089011 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 84874.1us
I20260709 12:10:12.080979 26616 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:12.218282 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:12.057152 28171 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:10:12.070649 28442 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:12.066918 28446 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:13.009819 28439 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.086180 28453 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.088636 28454 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.769347 28439 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.198004 28456 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:13.770566 28456 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.771035 28513 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.772138 28513 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.773838 28456 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:13.233119 28459 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.781100 28459 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.781663 28439 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:13.782225 28439 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.782752 28439 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.783628 28459 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:13.784758 28459 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:13.784876 28439 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:13.785418 28439 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.785305 28459 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.238927 28455 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:13.241827 28458 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.261098 28461 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:13.786679 28455 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.786932 28458 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.787367 28461 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.789690 28458 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:13.262027 26370 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57044 (request call id 308) took 1214 ms. Trace:
I20260709 12:10:13.273950 28457 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:13.281062 28470 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:13.283238 28469 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.283994 28463 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.286181 28468 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.287627 28460 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.301586 28467 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.334517 28473 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:13.339798 28472 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.325810 28474 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.380947 28479 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.381788 28471 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.391122 28462 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.391875 28476 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:13.388280 28466 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.392907 28481 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:13.397975 28477 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.448794 28475 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.785959 28439 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.458935 28478 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.542781 28483 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.579229 28485 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.580787 28487 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.582213 28484 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:13.583601 28490 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:13.584776 28434 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.584873 28486 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:13.609463 28495 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.609860 28498 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.617995 28496 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:13.621954 28482 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:10:13.622659 26616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 1515) took 1733 ms (client timeout 2013 ms). Trace:
I20260709 12:10:13.629232 28497 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:13.630679 28502 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:10:13.639201 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 115300us
I20260709 12:10:13.647487 28488 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.648821 28493 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.651768 28494 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:13.656452 28504 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:13.663004 28503 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.677162 28507 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.693354 28509 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.698506 28505 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:13.700733 26368 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39184 (request call id 150) took 1668 ms. Trace:
I20260709 12:10:13.705616 28501 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.666455 28499 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.720711 28500 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:13.722347 28171 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:13.724126 28512 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.729439 28511 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:13.708833 28506 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.709323 28515 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:13.743510 28510 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.745034 28516 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:13.755014 28508 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.760952 28442 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.764380 28519 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.769618 28454 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:12.066370 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:13.212678 26371 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57048 (request call id 296) took 1162 ms. Trace:
I20260709 12:10:13.769351 28453 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.775775 28513 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:13.778103 28518 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:13.780049 28446 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:13.789705 28455 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:13.267189 28465 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:13.450942 28464 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.911162 28513 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.910935 28494 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.802284 28523 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.910920 28465 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.911798 28513 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.912186 28523 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.913506 28494 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:13.913678 28465 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:13.914515 28523 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:13.911191 28464 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.914582 28446 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.914788 28478 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.914275 28513 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:13.914582 28506 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.915650 28515 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.915958 28525 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.916219 28496 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.916754 28455 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:13.916486 28499 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:13.917155 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 1.85074e+06us
I20260709 12:10:13.969630 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:13.917099 28487 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.917569 28508 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.917824 28475 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.917941 28467 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.918177 28490 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.918486 28501 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.918718 28518 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.918872 28507 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.919056 28495 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.919345 28511 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.919540 28505 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.919770 28503 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.919917 28468 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.920259 28493 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.920379 28504 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.920755 28470 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.922035 28171 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.914069 28494 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.922281 26371 rpcz_store.cc:276] 0709 12:10:12.050684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.050883 (+   199us) service_pool.cc:224] Handling call
0709 12:10:13.212539 (+1161656us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:10:13.921985 26370 rpcz_store.cc:276] 0709 12:10:12.047333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.047672 (+   339us) service_pool.cc:224] Handling call
0709 12:10:13.261926 (+1214254us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:10:13.792562 28459 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:13.931640 26616 rpcz_store.cc:269] 0709 12:10:11.878475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.878616 (+   141us) service_pool.cc:224] Handling call
0709 12:10:13.611891 (+1733275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:13.940022 28471 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:13.940523 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 122261us
I20260709 12:10:13.940912 28481 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.941874 28482 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.942842 28477 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.943687 28463 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.945751 28453 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:13.817024 28461 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:13.857139 28521 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.921669 28460 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.921209 28516 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.815320 28456 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:13.955466 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:13.915297 28486 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.857823 28522 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:13.961145 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:13.793460 28524 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:13.945930 28473 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.921142 26368 rpcz_store.cc:276] 0709 12:10:12.032667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.038522 (+  5855us) service_pool.cc:224] Handling call
0709 12:10:13.700638 (+1662116us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:13.387010 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:13.393846 (+  6836us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:13.393882 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:10:13.393919 (+    37us) tablet.cc:662] Decoding operations
0709 12:10:13.394338 (+   419us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:13.394457 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:13.394491 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:13.394719 (+   228us) tablet.cc:701] Row locks acquired
0709 12:10:13.394740 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:10:13.394921 (+   181us) write_op.cc:270] Start()
0709 12:10:13.395069 (+   148us) write_op.cc:276] Timestamp: P: 1783599013394843 usec, L: 0
0709 12:10:13.395095 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:10:13.395856 (+   761us) log.cc:844] Serialized 536 byte log entry
0709 12:10:13.532335 (+136479us) op_driver.cc:464] REPLICATION: finished
0709 12:10:13.548371 (+ 16036us) write_op.cc:301] APPLY: starting
0709 12:10:13.548466 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:13.548584 (+   118us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:13.548714 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:13.548953 (+   239us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:13.549127 (+   174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:13.549186 (+    59us) write_op.cc:312] APPLY: finished
0709 12:10:13.549418 (+   232us) log.cc:844] Serialized 23 byte log entry
0709 12:10:13.550289 (+   871us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:13.550404 (+   115us) write_op.cc:454] Released schema lock
0709 12:10:13.550452 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:13.557056 (+  6604us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:13.557103 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":3968,"child_traces":[["op",{"apply.queue_time_us":15759,"apply.run_cpu_time_us":1890,"apply.run_wall_time_us":8644,"num_ops":1,"prepare.queue_time_us":63732,"prepare.run_cpu_time_us":7903,"prepare.run_wall_time_us":125630,"raft.queue_time_us":22866,"raft.run_cpu_time_us":1729,"raft.run_wall_time_us":19627,"replication_time_us":137065,"spinlock_wait_cycles":2432,"thread_start_us":213487,"threads_started":4,"wal-append.queue_time_us":111046}]]}
I20260709 12:10:13.953754 28479 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.937023 28462 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.910935 28434 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.937301 28485 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.938938 28509 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.938836 28466 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.953687 28476 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.917320 28483 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:14.023177 28465 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:13.939056 28472 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.946992 28457 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.938179 28498 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.937350 28502 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.937561 28500 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.949198 28469 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.939591 28519 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.938161 28474 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.937204 28497 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:14.075503 28455 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:13.937255 28488 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.986115 28525 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.939175 28484 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:14.252355 28465 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:13.966090 28454 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.056866 28513 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:13.934501 28512 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:13.937610 28510 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:14.043357 28494 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:14.182528 28171 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:14.223737 28439 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.255368 26540 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:14.083513 28453 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:14.158896 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:14.240355 25298 debug-util.cc:398] Leaking SignalData structure 0x7b080000f140 after lost signal to thread 26439
W20260709 12:10:14.240547 26643 debug-util.cc:398] Leaking SignalData structure 0x7b08001510e0 after lost signal to thread 25296
I20260709 12:10:14.241868 28511 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.254848 28458 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:14.336285 28516 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:14.338006 28488 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.338421 28469 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:14.340557 28476 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:14.365505 28469 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:14.345805 26643 debug-util.cc:398] Leaking SignalData structure 0x7b08002cc400 after lost signal to thread 26405
I20260709 12:10:14.242465 28464 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:14.238700 28536 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:14.243212 28515 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:14.367534 28468 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.234411 28532 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:10:14.368005 26643 debug-util.cc:398] Leaking SignalData structure 0x7b08000c83c0 after lost signal to thread 26497
W20260709 12:10:14.369068 26643 debug-util.cc:398] Leaking SignalData structure 0x7b08000d0080 after lost signal to thread 26572
W20260709 12:10:14.369268 26643 debug-util.cc:398] Leaking SignalData structure 0x7b08000d8e20 after lost signal to thread 26573
I20260709 12:10:14.194000 28514 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.353294 28526 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.169332 28528 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:14.264035 28523 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:14.085892 28456 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:14.324198 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:14.171667 28530 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:14.358134 28466 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.360698 28472 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.170785 28531 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:14.385447 28486 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.341076 28484 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.392011 28486 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:14.382043 28523 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:14.392669 28486 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:14.393414 28471 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.368062 28485 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.365708 28476 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:14.350097 28496 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:14.367564 28483 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.378317 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:14.128952 28524 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:14.328783 28513 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:14.379628 28506 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:14.365137 28516 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:10:14.370074 26643 debug-util.cc:398] Leaking SignalData structure 0x7b08000eb640 after lost signal to thread 26646
I20260709 12:10:14.160017 28522 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:14.392150 28484 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:14.372522 28467 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.400545 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:14.438663 26545 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:14.375347 28446 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.348955 28453 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:14.362362 28458 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:14.366560 28536 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:14.240649 28529 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.383204 28475 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.125893 28521 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:14.459899 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:14.429491 28477 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.402458 28526 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:14.437335 26643 debug-util.cc:398] Leaking SignalData structure 0x7b0800295c40 after lost signal to thread 27192
I20260709 12:10:14.441991 28473 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:14.442435 28516 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:14.390185 28532 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:14.418150 28482 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:14.408129 28476 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:14.404829 28499 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.395722 28508 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.391341 28528 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:14.454209 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:14.496330 26540 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:10:14.456298 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:14.497385 26465 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:14.409307 28495 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:14.404357 28490 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:14.410224 28460 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.460620 26471 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:14.370790 28469 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:14.170176 28533 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:14.407732 28531 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:14.472460 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:14.451701 28518 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:14.475339 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:14.476480 28171 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:14.501356 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:14.386329 28455 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:14.490020 28545 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.456163 28481 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:14.491928 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:14.450148 28484 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:14.402868 28530 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:14.468101 28462 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.553699 26540 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 2.
I20260709 12:10:14.525305 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:14.560225 28446 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:14.551991 26544 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 3.
I20260709 12:10:14.560388 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:14.579654 28171 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:14.497956 28463 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.491325 28483 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:14.509879 28519 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.511051 28512 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.591917 28533 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:14.402242 28514 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:14.510032 28434 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:14.600819 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:14.516520 28473 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:14.606477 28171 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.543502 28502 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:14.607317 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:14.601413 28470 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:14.601246 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:14.587864 28482 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:14.493129 28529 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:14.615082 28534 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:14.615306 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:14.615556 28516 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:14.591477 28523 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:14.602528 28548 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:10:14.590840 28442 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:14.609491 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:14.609511 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:14.545447 28532 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:14.640041 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:14.641085 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:14.540974 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:14.599864 28486 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.606587 28513 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:14.605482 28545 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:14.742724 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 100467us
I20260709 12:10:14.918300 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:14.807219 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:14.952433 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:14.831866 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:14.983610 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:14.985460 28484 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:14.849928 28457 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:14.986491 28521 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.987564 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:14.952939 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:14.988260 26547 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:10:14.610837 28465 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.810765 26609 tablet_service.cc:1558] Processing DeleteTablet for tablet 366874f8c4424fa2a9f169e9c3d6e97e with delete_type TABLET_DATA_TOMBSTONED (TS aaadfdd9ca9f424c91505f9b43876233 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54638
I20260709 12:10:14.599781 28546 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:14.609715 28456 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.955749 28476 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.856084 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.022135 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.008579 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1345) took 1064 ms. Trace:
I20260709 12:10:14.643528 28505 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.611778 28483 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:14.770076 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:14.610425 28525 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:15.056505 26546 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:14.901171 28497 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:14.623374 28473 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:14.615896 28540 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.222s	user 0.002s	sys 0.000s
I20260709 12:10:14.788102 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:14.665132 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:14.757387 28534 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:14.811221 28458 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.602355 28479 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:14.787912 28453 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:15.067215 26469 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
W20260709 12:10:15.069550 26643 debug-util.cc:398] Leaking SignalData structure 0x7b080031d200 after lost signal to thread 28418
I20260709 12:10:15.069821 28536 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:15.026521 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.029438 28514 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:15.030215 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.031061 28533 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:15.057467 28487 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:15.036010 28493 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:15.036209 28530 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.810571 28494 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:15.037578 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:14.992420 28528 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:15.043219 28545 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:15.004393 27161 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:14.992020 28526 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.646332 28482 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:15.095208 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.096935 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.097564 28482 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:15.048508 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.099685 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.101449 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.023844 26468 rpcz_store.cc:276] 0709 12:10:13.927832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.927970 (+   138us) service_pool.cc:224] Handling call
0709 12:10:13.928215 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.327211 (+398996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.327245 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:14.327290 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:14.327324 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.983392 (+656068us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b540027abd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:14.983459 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.992459 (+  9000us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":917086976}
I20260709 12:10:14.790629 28510 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:14.640149 28446 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:15.010310 28442 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:15.081864 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 53425.7us
I20260709 12:10:15.083703 28469 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:15.084677 28478 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:15.090359 28505 raft_consensus.cc:2955] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:15.128423 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.128866 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.097675 26465 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:10:15.050019 27165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 305) took 1077 ms. Trace:
I20260709 12:10:14.602061 28524 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:15.110275 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.107924 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1346) took 1173 ms. Trace:
I20260709 12:10:15.111644 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1343) took 1187 ms. Trace:
I20260709 12:10:15.119765 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.120781 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.121625 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.121866 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.125619 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.021546 28546 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:15.145124 28529 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:15.145207 26546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:15.159487 26546 raft_consensus.cc:606] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:15.146124 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:15.147262 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 143586us
I20260709 12:10:15.147599 26618 raft_consensus.cc:2410] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:10:15.148699 26470 rpcz_store.cc:276] 0709 12:10:13.924740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.924887 (+   147us) service_pool.cc:224] Handling call
0709 12:10:13.925246 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.094470 (+169224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.094520 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:14.094585 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:14.094635 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.111360 (+1016725us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54002599d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:15.111420 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.111565 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388449024}
I20260709 12:10:15.162667 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.163831 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.148994 27162 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:15.146327 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.147163 28534 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:15.173484 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.173434 26621 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:15.171995 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.175179 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.162923 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.178308 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.182459 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.183274 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.184949 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.184875 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.179126 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.185923 27167 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:15.185626 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.148586 26466 rpcz_store.cc:276] 0709 12:10:13.934993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.935163 (+   170us) service_pool.cc:224] Handling call
0709 12:10:13.935576 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.399731 (+464155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.399762 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:14.399805 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:14.399841 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.107676 (+707835us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b540006a4d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:15.107728 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.107860 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1067019008}
I20260709 12:10:15.187378 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.191491 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.192026 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.192421 26548 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:15.188107 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.249289 28531 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:15.246886 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.261363 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.193727 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.261422 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:15.262238 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 142385us
I20260709 12:10:15.254140 26368 catalog_manager.cc:5697] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 2 to 3, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 3 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:15.219230 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 95889.7us
I20260709 12:10:15.264536 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.197753 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.244966 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.249744 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:15.263051 27168 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:10:15.286149 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:15.224146 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.312443 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.223021 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.264015 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.203135 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.327746 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.314911 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.194062 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.315255 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:15.362737 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 113073us
I20260709 12:10:15.319386 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.333298 28547 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.329422 28500 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:15.364429 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.316751 28498 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:15.315538 28509 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:15.365691 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.319449 28504 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:15.335168 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 69062us
W20260709 12:10:15.365741 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 79687.7us
I20260709 12:10:15.317724 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.248921 28442 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:15.245776 28552 tablet_replica.cc:333] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:10:15.250494 28522 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:15.319099 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.253032 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.243584 28503 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:15.316233 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.318732 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.366122 28455 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.357636 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.359391 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.366357 26545 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 3.
I20260709 12:10:15.315701 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.378464 26619 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 3.
I20260709 12:10:15.316831 28497 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:10:15.379007 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.367700 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.252853 28483 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:15.252209 28546 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:15.311618 26467 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:15.380471 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.143980 27165 rpcz_store.cc:276] 0709 12:10:13.972708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.977402 (+  4694us) service_pool.cc:224] Handling call
0709 12:10:14.254451 (+277049us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.369573 (+115122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.371493 (+  1920us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:14.372845 (+  1352us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:14.377913 (+  5068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.049618 (+671705us) spinlock_profiling.cc:243] Waited 96.3 ms on lock 0x7b540071c5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:15.049671 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.049819 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221416192}
I20260709 12:10:15.381332 26545 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 3.
I20260709 12:10:15.377660 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:15.362202 26541 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 3.
I20260709 12:10:15.382723 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:15.384464 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.316695 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.321805 28501 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:15.392073 28474 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:15.399385 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:15.398854 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:15.400723 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:15.401111 28483 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.401548 28483 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:15.401947 28483 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.249873 28551 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:15.407817 28551 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:15.411118 28551 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:15.249562 28536 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:15.413821 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.444000 28536 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:15.414592 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.444900 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.445499 26616 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:10:15.445979 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.447681 28505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43588 (request call id 72) took 3620 ms. Trace:
I20260709 12:10:15.414839 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.448395 26617 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:15.252048 28510 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:15.449440 28510 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:15.449651 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.415329 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:15.452632 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:15.316394 28507 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:15.249744 28528 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:15.455919 28528 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:15.245388 27163 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:15.459007 27163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 306) took 1476 ms. Trace:
I20260709 12:10:15.459486 27163 rpcz_store.cc:276] 0709 12:10:13.982805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.007286 (+ 24481us) service_pool.cc:224] Handling call
0709 12:10:15.191274 (+1183988us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:10:15.244904 (+ 53630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.458605 (+213701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.458911 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14728064}
I20260709 12:10:15.460781 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.317158 28473 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:15.415911 28474 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.417793 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.420326 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:15.462656 27162 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:15.464318 28474 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.413139 28483 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:15.464872 28474 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:15.465410 28474 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.465728 26543 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:15.466796 28483 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:15.422573 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.467420 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.423161 28514 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.468112 26545 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:15.468318 28514 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:15.423385 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.468796 28514 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.424772 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.425369 28465 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.470378 28465 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.470780 28465 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.472324 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.426025 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.427623 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.428104 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:15.428172 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45525.4us
I20260709 12:10:15.428874 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.477293 26620 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:15.371045 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.478978 26548 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:10:15.371290 28455 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:15.479803 28455 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.371591 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.371929 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.370517 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:10:15.483659 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 113213us
I20260709 12:10:15.483919 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.484630 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:15.485446 28501 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.485895 28501 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:15.367705 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:10:15.486878 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 119244us
I20260709 12:10:15.488569 28484 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.489064 28484 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:15.489517 28484 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.490653 28547 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.491104 28546 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:15.430540 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.491777 28546 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:15.372213 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.377388 28446 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:15.371415 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.368397 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.369678 27164 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:10:15.439237 28552 raft_consensus.cc:2243] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:15.441936 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:15.443580 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.497170 28526 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.497964 28552 raft_consensus.cc:2272] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:10:15.498610 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 56765.6us
I20260709 12:10:15.499948 28507 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.500155 28526 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:15.500432 28507 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:15.454641 28493 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.455103 28530 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:15.469141 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.491228 28547 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:15.428514 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.489807 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:15.500941 28507 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.570782 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.616324 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.616782 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.617254 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.617506 26617 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:10:15.617872 26542 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:10:15.517711 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.618731 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.505898 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:15.619127 26548 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:10:15.571003 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.567653 28552 ts_tablet_manager.cc:1916] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:15.620491 26617 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:10:15.568046 28551 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:15.620085 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.621912 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.570700 28510 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:15.518222 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.623651 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.612274 28514 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:15.624856 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.625412 28530 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:15.516187 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.554298 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.622334 26618 raft_consensus.cc:1813] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Handling vote request from an unknown peer ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:15.626775 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.627038 27162 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:10:15.618635 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.535737 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.627435 26615 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:15.636291 26588 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:15.637027 26588 raft_consensus.cc:2686] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:10:15.637004 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.638526 28530 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.638571 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.638870 26588 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:15.641038 28481 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.641492 28481 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:15.641966 28481 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.641714 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.645820 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.648638 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.627944 27168 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:10:15.652395 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.500895 28526 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.654851 28465 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:15.656298 27159 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:15.657387 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:15.627455 26618 raft_consensus.cc:2410] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 12:10:15.572793 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 107812us
I20260709 12:10:15.665832 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.666649 26439 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:15.667587 28486 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.667995 28486 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:15.668393 28486 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.486414 28501 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.667028 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.675724 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.676414 26618 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:15.677521 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.629179 28493 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:15.551754 28502 consensus_queue.cc:1059] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:10:15.679448 28550 raft_consensus.cc:3055] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:15.679852 28550 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:15.680770 28550 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:15.681993 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 192267us
I20260709 12:10:15.682611 28497 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.683523 28497 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:15.622135 28551 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:15.684203 28497 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.684273 28560 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.685730 28551 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:15.630534 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.686271 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.687099 26618 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:15.687500 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.687929 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.688601 26618 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:10:15.688843 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.689406 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:15.691265 26619 raft_consensus.cc:2955] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:15.631278 28455 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:15.606119 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:15.455950 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.566829 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.589213 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.532418 28528 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:15.709349 28455 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:15.615600 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.632889 28514 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:15.576970 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.710812 26614 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:10:15.634021 26613 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:10:15.634049 28474 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:15.634557 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.634742 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.715973 28474 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:15.716454 28481 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:15.617620 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.621440 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.594688 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.725510 26541 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:15.531282 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.631623 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.732368 26616 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:10:15.733791 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.615319 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.567312 28546 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:15.744809 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.654072 27168 raft_consensus.cc:2955] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:15.628248 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.448105 28505 rpcz_store.cc:276] 0709 12:10:11.827725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.827866 (+   141us) service_pool.cc:224] Handling call
0709 12:10:11.848373 (+ 20507us) log.cc:844] Serialized 501 byte log entry
0709 12:10:15.447591 (+3599218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11254,"raft.run_cpu_time_us":1068,"raft.run_wall_time_us":1066}
I20260709 12:10:15.659296 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.729462 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:15.661675 28465 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:15.585697 28536 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:15.664283 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.683494 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:15.756170 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 72759us
I20260709 12:10:15.692102 28530 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:15.681654 28486 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:15.682245 28550 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.569167 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.698267 26439 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:15.699745 26588 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:15.762125 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 62475.4us
I20260709 12:10:15.763351 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:15.755334 28475 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.765225 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:15.701337 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 195570us
I20260709 12:10:15.707453 28527 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.707535 28551 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.771234 28546 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.678334 28493 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.633563 28547 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.578881 28484 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:15.777761 28484 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:15.724225 28507 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:15.614883 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:15.778623 27167 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:15.735445 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.779430 26468 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:15.743165 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.756937 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:15.781184 28559 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.781620 28486 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:15.781709 27133 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:15.758817 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.782675 28559 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.765775 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:15.783123 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:15.783690 26617 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.784302 27133 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:15.784879 28493 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:15.785504 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:15.766597 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:15.703194 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 97236.4us
I20260709 12:10:15.767290 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.759127 28514 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.786883 26469 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:10:15.768918 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.770643 28527 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:15.787864 28527 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.788177 28493 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:15.772729 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 74711.4us
I20260709 12:10:15.789695 26439 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:15.780433 28530 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:15.789631 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.786926 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:15.792325 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:15.793869 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.795015 28510 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.795168 28536 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.795485 28530 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.795775 28514 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.797801 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.799355 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:15.800391 26469 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:15.800920 26513 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:15.801689 28483 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.802063 28483 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:15.802429 28483 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.805702 28521 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.806118 28521 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:15.806516 28521 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.806701 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.808213 26439 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:15.808264 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.808895 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.795600 28536 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:15.814606 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.814844 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.807705 26469 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:15.810477 26468 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:15.810992 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.810081 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:15.811630 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 46496.3us
I20260709 12:10:15.826493 28536 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.812139 26617 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:15.827307 26546 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.827585 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:15.833675 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:15.830077 28486 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.837572 28486 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:15.837745 28484 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.838004 28486 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.838315 28484 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:15.813642 26472 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:15.815878 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.838667 28530 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.871917 28507 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:15.819247 26439 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:15.761627 28497 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:15.873169 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 54001.9us
I20260709 12:10:15.874377 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:15.874907 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.783138 28534 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.877208 26439 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:15.878423 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.878369 26439 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:15.879628 26544 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:15.868530 28481 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:15.882735 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:15.883607 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:15.888350 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 54752.4us
I20260709 12:10:15.889209 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:15.889364 28442 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.890933 28493 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:15.892422 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.838795 28484 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.873404 28473 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.839927 28514 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.890458 26514 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:15.896487 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:15.930579 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:15.872684 28475 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.909713 26464 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 3: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:15.931416 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:15.911087 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:15.911535 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.933947 26471 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:10:15.918063 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.934963 26467 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:15.938720 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:15.939705 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.913048 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.877311 28504 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:15.885453 28446 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:15.885255 28505 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.923089 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:15.882490 28534 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:15.941068 26541 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:15.908977 28455 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:15.942157 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:15.944020 26514 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:15.967830 26514 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:15.968992 28507 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.969475 28507 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:15.931921 28473 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:15.963340 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.969901 26514 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:15.970273 28473 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.971000 28530 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.972008 28530 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.972479 28530 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:15.972949 28530 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.965323 28534 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.936882 28551 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.975844 26514 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:15.977198 28171 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.977747 28171 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:15.978228 28171 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.940845 28493 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:15.969883 28507 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.941155 28559 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.941326 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.948885 28528 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.949172 28532 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:15.941316 28546 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.947386 28504 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:15.994375 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:15.950923 28446 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:15.993880 28442 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.982311 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:16.023814 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:16.024906 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:15.936584 28526 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:16.004536 27133 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:15.965580 28455 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:16.008797 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:16.013967 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 118819us
I20260709 12:10:15.960063 28505 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:16.033042 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:16.037694 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:16.038512 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:16.039912 28564 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.040625 28564 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.041273 28564 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:16.041703 28564 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:16.042866 28564 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:16.038865 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:16.045531 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:16.046541 27133 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:16.021273 28504 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:16.057148 28552 ts_tablet_manager.cc:1929] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:10:16.051165 28505 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.022114 28446 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:16.032223 28522 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:16.090735 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 55772.3us
W20260709 12:10:16.092979 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 46511.3us
W20260709 12:10:16.084690 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 59865.1us
I20260709 12:10:16.035872 28455 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:16.053459 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:16.031303 28528 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.036206 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:16.101712 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:16.106606 28497 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:16.107312 28565 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.107852 28565 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.108206 28565 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.094172 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:16.030234 28527 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:16.114425 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:16.113551 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:16.117213 26470 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:16.118821 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 80436.9us
I20260709 12:10:16.103400 27165 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.122864 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:16.079077 28552 log.cc:1199] T 366874f8c4424fa2a9f169e9c3d6e97e P aaadfdd9ca9f424c91505f9b43876233: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-2-root/wals/366874f8c4424fa2a9f169e9c3d6e97e
I20260709 12:10:16.126585 26547 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:15.993587 28501 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:16.115955 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:16.094668 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 91562.2us
I20260709 12:10:16.049603 28546 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.126225 27166 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.126803 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:16.114110 28522 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.127792 26587 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:16.132098 28546 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:16.122356 28514 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.137636 26357 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 69e1490de99a4232a6717e72242a0f00 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:16.137809 26513 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:16.139635 28522 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.141597 28502 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:16.125149 28487 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:16.142748 28487 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:16.143247 28502 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:16.143714 28502 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:16.144579 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:16.144951 28487 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:16.144657 28502 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:16.146557 26587 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:16.148969 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:16.149575 26470 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:16.158083 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:16.135515 28552 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54638 (request call id 75) took 1328 ms. Trace:
I20260709 12:10:16.162461 28171 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:16.124680 28569 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.164469 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:16.165993 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 72683.6us
I20260709 12:10:16.166280 28171 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:16.166630 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:16.167243 28171 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.167620 28171 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:16.167954 28171 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.167954 26513 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:16.171124 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:16.175526 28171 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:16.177575 28171 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:16.178294 28171 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.179050 28171 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:16.179426 28171 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:16.179827 28171 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.180159 28527 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:16.180815 28527 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.132314 28528 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.158681 28487 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.150512 28566 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.191179 28566 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:16.191690 28566 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.192008 28532 raft_consensus.cc:993] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:16.194370 28171 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:16.198760 28532 raft_consensus.cc:1081] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:16.152931 28502 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.125780 28521 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:16.150607 28546 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.161165 28562 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.188102 28442 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:16.241580 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 109013us
I20260709 12:10:16.160106 28486 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:16.188578 28564 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:16.246620 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 78897us
I20260709 12:10:16.250248 26514 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:10:16.251443 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 80406.5us
I20260709 12:10:16.252296 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:16.195632 28550 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:10:16.254928 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:16.205407 28563 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.259313 28501 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:16.264065 28484 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:16.264384 28505 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:16.205101 28481 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:10:16.240209 28562 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:16.205353 28504 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:16.268663 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:16.271246 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:16.297168 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:16.295677 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:16.303084 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:16.304378 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:16.255745 28568 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:16.309754 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:16.307268 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:16.310585 26545 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:16.307693 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:16.309031 28575 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:16.202373 28534 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:16.244045 28514 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:10:16.324352 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:16.314075 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:16.268561 28526 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:16.314441 26469 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:16.296701 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:16.295696 26467 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:16.375340 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:16.312187 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:16.376231 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 79606.6us
W20260709 12:10:16.376480 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 64385.1us
I20260709 12:10:16.377427 26513 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:16.317500 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:16.378234 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:16.319017 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:10:16.297749 28547 consensus_meta.cc:287] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.000s
I20260709 12:10:16.320904 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:16.300254 28562 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.348629 28171 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:16.352978 26468 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.314579 28568 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:16.254794 28536 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:16.388491 28536 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:16.325253 28532 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.389846 28532 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.390432 28532 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.321583 28575 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:16.361933 26540 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.363610 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:16.393849 26618 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:16.364596 26514 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:16.364635 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:16.324226 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:16.298297 28577 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:16.366272 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 99899.3us
I20260709 12:10:16.367991 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:16.298184 28570 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 12:10:16.373584 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 173974us
I20260709 12:10:16.324823 26465 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:16.317020 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:16.164680 28552 rpcz_store.cc:276] 0709 12:10:14.807066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.810525 (+  3459us) service_pool.cc:224] Handling call
0709 12:10:15.245271 (+434746us) ts_tablet_manager.cc:1151] Deleting tablet 366874f8c4424fa2a9f169e9c3d6e97e
0709 12:10:15.245358 (+    87us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:15.718240 (+472882us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:16.056987 (+338747us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:16.135427 (+ 78440us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69907,"tablet-delete.queue_time_us":228512,"thread_start_us":168845,"threads_started":1}
I20260709 12:10:16.402741 26439 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:16.381129 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:16.319126 28530 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:16.358415 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:16.381722 28576 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:16.420586 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 56139.5us
I20260709 12:10:16.391750 28568 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.425638 28171 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.425760 26514 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:16.431584 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:16.425945 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44910.5us
I20260709 12:10:16.383963 28475 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.434908 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:16.438515 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:16.440060 28586 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.400725 28575 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:16.405205 28577 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:16.386548 28547 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:16.443024 28171 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.450614 28469 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:16.791571 28573 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.542s	user 0.003s	sys 0.009s
I20260709 12:10:16.792560 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:10:16.743639 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 340788us
W20260709 12:10:16.753827 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 310976us
W20260709 12:10:16.755332 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 318416us
I20260709 12:10:16.776120 26614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "3262bf0553e543eea76794fc529a9acc"
 from {username='slave'} at 127.0.0.1:60224
W20260709 12:10:16.779672 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 401338us
W20260709 12:10:16.500545 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 288862us
W20260709 12:10:16.819804 28527 consensus_meta.cc:287] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.638s	user 0.012s	sys 0.008s
I20260709 12:10:16.820555 28527 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.438550 28487 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.495079 28486 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:16.442068 28503 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:16.824893 28503 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:16.825145 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:16.825678 28503 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.455267 28577 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.484145 28521 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:16.440564 28586 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.482656 28585 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:16.832422 28586 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.442512 28522 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:10:16.436004 28581 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.837069 28484 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:16.838807 28534 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:16.839581 28547 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:16.840765 28547 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:16.841288 28547 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:16.842268 26614 raft_consensus.cc:606] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Received request to transfer leadership to TS 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:16.787205 28551 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:16.844144 28551 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:16.802747 28465 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:16.805032 28589 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:16.818565 28483 consensus_meta.cc:287] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.016s	user 0.016s	sys 0.005s
I20260709 12:10:16.428036 28497 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:16.836287 28486 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:16.849292 28497 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:16.846629 28465 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:16.850374 28501 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:16.838282 28504 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:16.849846 28589 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:16.849695 28486 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:16.855469 28501 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:16.859019 28530 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:16.854341 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2283) took 1231 ms. Trace:
I20260709 12:10:16.856986 28497 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:16.865999 26546 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.851585 28483 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:16.872232 28501 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:16.864462 26618 rpcz_store.cc:276] 0709 12:10:15.613152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.689174 (+ 76022us) service_pool.cc:224] Handling call
0709 12:10:16.844255 (+1155081us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b5400268254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:16.844503 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085524864}
W20260709 12:10:16.875145 28546 consensus_meta.cc:287] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.012s
I20260709 12:10:16.862004 28486 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:16.885025 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:16.885677 26614 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:16.885924 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:16.882983 28547 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:16.862004 28589 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:16.892793 26539 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:16.895740 28547 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.896919 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1383) took 1093 ms. Trace:
I20260709 12:10:16.897434 26539 rpcz_store.cc:276] 0709 12:10:15.803703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.807769 (+  4066us) service_pool.cc:224] Handling call
0709 12:10:15.813909 (+  6140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.895622 (+1081713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.896576 (+   954us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400140354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:16.896811 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2477619456}
I20260709 12:10:16.899042 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:16.903990 28483 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:16.868410 28465 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:16.908785 28465 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.910619 28501 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:16.917210 28507 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.918s	user 0.021s	sys 0.007s
I20260709 12:10:16.919705 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:16.888983 28551 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:16.892227 28546 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:16.924707 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:16.927675 26468 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.927721 28527 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:16.925072 28551 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.936372 28568 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:16.937541 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:10:16.938525 28502 consensus_meta.cc:287] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.698s	user 0.002s	sys 0.017s
I20260709 12:10:16.945154 28546 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:16.948719 28505 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:16.960743 27165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 400) took 1543 ms. Trace:
I20260709 12:10:16.961288 27165 rpcz_store.cc:276] 0709 12:10:15.416905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.429007 (+ 12102us) service_pool.cc:224] Handling call
0709 12:10:15.500811 (+ 71804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.129479 (+628668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.570429 (+440950us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b5400438854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:16.960229 (+389800us) spinlock_profiling.cc:243] Waited 71.4 ms on lock 0x7b5400438850. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:16.960522 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497236992}
I20260709 12:10:16.962724 28572 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:16.969373 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:10:16.969554 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 144717us
I20260709 12:10:16.971231 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:16.972354 26467 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.973424 28587 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.917879 28507 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:16.974519 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:16.975214 28473 consensus_meta.cc:287] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.963s	user 0.016s	sys 0.013s
I20260709 12:10:16.975718 28473 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:16.976241 26439 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:16.977205 26472 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:16.978657 28566 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.786s	user 0.005s	sys 0.026s
I20260709 12:10:16.979318 28566 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:16.974244 28565 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.865s	user 0.012s	sys 0.015s
I20260709 12:10:16.985258 28565 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:16.982419 28473 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:16.932430 28527 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:16.991014 26366 catalog_manager.cc:5697] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 4 to 5, VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) evicted. New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:16.993604 26368 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57052 (request call id 299) took 1991 ms. Trace:
I20260709 12:10:16.882651 26358 catalog_manager.cc:5028] TS aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): tablet 366874f8c4424fa2a9f169e9c3d6e97e (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
W20260709 12:10:16.995606 26358 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 199358us
I20260709 12:10:16.996174 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:10:16.996476 28575 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.008s
I20260709 12:10:16.997169 28575 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:16.999404 26545 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:16.999915 28575 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:16.986020 26622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:10:17.002995 26622 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:17.003321 28568 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:17.004093 26370 catalog_manager.cc:5697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 2 to 3, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:17.005927 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.010200 28505 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.010870 26439 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:17.011269 28532 consensus_meta.cc:287] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.620s	user 0.006s	sys 0.014s
I20260709 12:10:17.011790 28532 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.012105 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:17.012543 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:17.013885 26541 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.013988 28532 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:16.992136 28527 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.008991 28481 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:17.003428 26622 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.995373 28486 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.007385 26370 catalog_manager.cc:5697] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 2 to 3, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:16.987634 28566 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:17.028553 26617 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:17.033241 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:17.050662 28568 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:17.052253 28522 raft_consensus.cc:3055] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.052542 28592 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.053054 28592 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:17.052781 28522 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:17.055653 28522 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.016491 28546 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:17.056655 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:17.054111 28592 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.021492 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:10:17.057544 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 46820.1us
I20260709 12:10:17.058154 28592 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.976261 28507 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:17.059592 26471 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:17.061159 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:17.028546 28536 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:10:17.064038 28565 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:17.027678 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.065483 28563 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:17.017035 28562 consensus_meta.cc:287] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.622s	user 0.004s	sys 0.014s
I20260709 12:10:17.064353 28536 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:17.033705 28593 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.028801 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.018141 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:17.024926 26371 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57048 (request call id 297) took 2036 ms. Trace:
W20260709 12:10:16.969410 28446 consensus_meta.cc:287] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.865s	user 0.009s	sys 0.017s
W20260709 12:10:17.033996 28455 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.874s	user 0.016s	sys 0.014s
I20260709 12:10:17.069278 26371 rpcz_store.cc:276] 0709 12:10:14.966149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.987139 (+ 20990us) service_pool.cc:224] Handling call
0709 12:10:17.002287 (+2015148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":273707,"reported_tablets":2}
I20260709 12:10:17.072615 26467 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.073139 28455 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.057139 28522 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.074170 26469 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:17.076797 26622 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.080830 28455 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:17.081611 26465 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:17.082734 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:17.040692 28475 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:10:17.086150 28475 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:17.086714 28475 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:17.088052 28475 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.055673 28586 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.089784 28475 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.090487 28446 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.091976 26464 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:17.093230 28446 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:17.093699 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2352) took 1007 ms. Trace:
I20260709 12:10:17.020176 28505 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.067863 28536 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:17.101806 26622 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:17.099411 26439 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.094200 26464 rpcz_store.cc:276] 0709 12:10:16.086084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.088731 (+  2647us) service_pool.cc:224] Handling call
0709 12:10:16.089010 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:17.092535 (+1003525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.093348 (+   813us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54002db754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:17.093622 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2305694592}
I20260709 12:10:17.073380 28503 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.057188 28546 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.057155 28497 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.116139 28481 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.126665 26468 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.115989 28575 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:17.131635 28575 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:17.132251 28575 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:17.134804 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:17.142757 28546 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:17.143748 28486 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:17.117444 28536 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.149142 26468 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:17.151149 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:16.994117 26368 rpcz_store.cc:276] 0709 12:10:15.001749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.001886 (+   137us) service_pool.cc:224] Handling call
0709 12:10:16.993337 (+1991451us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:15.425759 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:15.426298 (+   539us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:15.426334 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:10:15.426351 (+    17us) tablet.cc:662] Decoding operations
0709 12:10:15.426696 (+   345us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:15.426768 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:15.426800 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:15.426992 (+   192us) tablet.cc:701] Row locks acquired
0709 12:10:15.427011 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:10:15.427146 (+   135us) write_op.cc:270] Start()
0709 12:10:15.427260 (+   114us) write_op.cc:276] Timestamp: P: 1783599015427105 usec, L: 0
0709 12:10:15.427283 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:10:15.430317 (+  3034us) log.cc:844] Serialized 541 byte log entry
0709 12:10:15.826767 (+396450us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b18002a1360. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:10:15.830362 (+  3595us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b540007d354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d5e28 00007f5079b10581 00007f5079b0fd58 00007f5079b149f1 00007f5079b149a9 00007f5079b14939 00007f5079b14901 00007f5079b13b2d 0000000000388634 0000000000388479
0709 12:10:16.196240 (+365878us) op_driver.cc:464] REPLICATION: finished
0709 12:10:16.424909 (+228669us) write_op.cc:301] APPLY: starting
0709 12:10:16.433988 (+  9079us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:16.451324 (+ 17336us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:16.455851 (+  4527us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:16.799584 (+343733us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:16.800087 (+   503us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:16.800223 (+   136us) write_op.cc:312] APPLY: finished
0709 12:10:16.800947 (+   724us) log.cc:844] Serialized 23 byte log entry
0709 12:10:16.801453 (+   506us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:16.801711 (+   258us) write_op.cc:454] Released schema lock
0709 12:10:16.801802 (+    91us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:16.852355 (+ 50553us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:16.853879 (+  1524us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":2816,"child_traces":[["op",{"apply.queue_time_us":188034,"apply.run_cpu_time_us":15513,"apply.run_wall_time_us":406260,"num_ops":1,"prepare.queue_time_us":138581,"prepare.run_cpu_time_us":14050,"prepare.run_wall_time_us":404798,"raft.queue_time_us":216847,"raft.run_cpu_time_us":26337,"raft.run_wall_time_us":214591,"replication_time_us":719431,"spinlock_wait_cycles":23007360,"thread_start_us":626759,"threads_started":4,"wal-append.queue_time_us":313108}]]}
I20260709 12:10:17.153108 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.074285 28562 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.155797 26467 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:17.157534 28507 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:17.159624 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:17.113302 28586 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:17.163937 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 97690.1us
I20260709 12:10:17.165055 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.166646 26542 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.167457 26470 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:17.170110 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.172852 26616 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:17.147051 28446 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.173301 28577 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.182003 28503 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:17.183672 28536 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.184196 28577 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:17.179594 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 151089us
I20260709 12:10:17.185518 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.187069 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:17.133771 28575 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.180222 28465 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:17.189348 28465 consensus_queue.cc:1243] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:17.190001 28465 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:17.190376 28465 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:17.191355 28465 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.192638 28465 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.195423 28481 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.195688 26616 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.196465 28481 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:17.196879 28481 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:17.197293 28481 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.197438 28572 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:17.198087 28572 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.200549 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:17.202253 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:17.202836 26470 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:17.203052 26464 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:17.203754 28572 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:17.204772 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:17.205762 26616 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 4: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:17.216603 28562 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:17.217471 28505 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:17.217968 28505 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:17.218374 28505 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.218951 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:17.219889 26542 raft_consensus.cc:2393] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:17.220793 28522 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:17.221472 28522 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.223016 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.228978 26617 raft_consensus.cc:2393] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:17.224889 28522 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:17.225600 28501 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:17.232890 28501 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.235146 28501 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:17.235348 28592 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:17.236999 28589 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.238158 26470 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:17.240926 28589 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:17.227991 28575 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.245276 28503 raft_consensus.cc:3055] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:17.245744 28503 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:17.246738 28503 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.248076 28503 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.225591 28527 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:17.248601 28527 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:17.235013 28497 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:17.249653 28527 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.250681 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.251291 28527 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.253191 26614 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:17.254513 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:17.258706 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.259855 27159 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.262461 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.262894 27134 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.263643 28501 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.265900 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:17.266814 28595 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.119s	user 0.003s	sys 0.001s
I20260709 12:10:17.266976 28562 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.268610 26618 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.286970 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.287670 26618 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.289321 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:17.289728 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.290238 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.286993 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.290676 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.291149 28522 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:17.292066 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.292341 28522 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.292871 28547 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.294059 28547 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:17.295146 28501 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:17.295501 28501 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:17.300899 26616 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:17.296407 28501 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.332938 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.333590 26617 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.324806 28502 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:10:17.337128 27159 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:17.332794 28507 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:10:17.341068 28507 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:17.341586 28507 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:17.347641 26615 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:17.349622 26618 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:17.352782 26470 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.352833 26617 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:17.312067 28530 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:10:17.329319 28481 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.358621 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:17.359484 26468 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:17.322294 28592 consensus_queue.cc:1059] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:10:17.365729 26366 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39184 (request call id 151) took 1336 ms. Trace:
I20260709 12:10:17.369174 26622 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:17.373064 26464 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:17.373601 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.374302 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:17.375483 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:17.376008 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:17.376662 26467 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.371937 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:17.375018 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:17.375108 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:17.384456 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:17.386562 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:17.386673 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:17.387600 26545 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 3: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:17.387946 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:17.388177 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.391619 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:17.358304 28522 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:17.394871 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:17.397531 26541 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:17.399820 26468 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 5: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:17.400527 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.401329 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.401575 26513 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:17.401723 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.402632 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.403491 26622 raft_consensus.cc:2368] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 4. Current term is 5.
I20260709 12:10:17.405774 28592 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:17.406230 28522 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:17.406083 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.406714 28522 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:17.407814 28522 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.409052 28522 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.413934 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.415609 26467 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:17.393025 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:17.399390 28501 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.420651 26617 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.428329 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:17.366230 26366 rpcz_store.cc:276] 0709 12:10:16.029193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.029694 (+   501us) service_pool.cc:224] Handling call
0709 12:10:16.140866 (+111172us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b54002600b8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507be98e43 00007f507bf9704e 00007f507a4582a4 00007f507a458232 00007f507a458161 00007f507a4580dc 00007f507a457392 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:16.847380 (+706514us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540007d354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076044090 00007f50760e2f3a 00007f507be98e9c 00007f507bf9704e 00007f507a4582a4 00007f507a458232 00007f507a458161 00007f507a4580dc 00007f507a457392 00007f507441548c 00007f50744148c6
0709 12:10:17.365659 (+518279us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:17.193800 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:17.199496 (+  5696us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:17.199547 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:10:17.199568 (+    21us) tablet.cc:662] Decoding operations
0709 12:10:17.200005 (+   437us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:17.200121 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:17.200153 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:17.200476 (+   323us) tablet.cc:701] Row locks acquired
0709 12:10:17.200527 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:10:17.200693 (+   166us) write_op.cc:270] Start()
0709 12:10:17.200860 (+   167us) write_op.cc:276] Timestamp: P: 1783599017200632 usec, L: 0
0709 12:10:17.200888 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:10:17.201665 (+   777us) log.cc:844] Serialized 536 byte log entry
0709 12:10:17.314811 (+113146us) op_driver.cc:464] REPLICATION: finished
0709 12:10:17.315262 (+   451us) write_op.cc:301] APPLY: starting
0709 12:10:17.315386 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:17.315520 (+   134us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:17.315654 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:17.318311 (+  2657us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:17.323110 (+  4799us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:17.323200 (+    90us) write_op.cc:312] APPLY: finished
0709 12:10:17.324580 (+  1380us) log.cc:844] Serialized 23 byte log entry
0709 12:10:17.325546 (+   966us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:17.325629 (+    83us) write_op.cc:454] Released schema lock
0709 12:10:17.325686 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:17.334818 (+  9132us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:17.334880 (+    62us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":126858,"reported_tablets":1,"spinlock_wait_cycles":472749312,"child_traces":[["op",{"apply.queue_time_us":157,"apply.run_cpu_time_us":2140,"apply.run_wall_time_us":15362,"num_ops":1,"prepare.queue_time_us":165329,"prepare.run_cpu_time_us":3615,"prepare.run_wall_time_us":29897,"replication_time_us":113718,"spinlock_wait_cycles":63744,"thread_start_us":108870,"threads_started":1}]]}
I20260709 12:10:17.424193 28532 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:10:17.403338 28530 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:10:17.430912 28532 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.431164 28483 raft_consensus.cc:3055] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:17.420917 28592 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 5 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:17.431299 28532 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:17.388830 28507 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.445822 26542 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.446221 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.448585 28481 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:17.431195 28530 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:17.449472 28530 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:17.450448 28530 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.450804 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.452674 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:17.453655 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.428329 28575 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:17.454478 28575 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:17.451880 28530 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.455802 28446 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.455700 28575 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.457532 28575 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.431862 28483 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:17.458492 28585 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:17.459064 28585 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:17.459625 28483 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.460938 26514 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:17.461251 28483 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:17.461944 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.462113 28568 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.443499 28592 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.452695 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:17.425558 28486 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.464241 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:17.426810 28475 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:17.466580 26514 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:17.452734 28507 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.470585 28497 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:17.471109 28497 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:17.471580 28497 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.471884 28532 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.473217 28532 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.477790 28546 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.477939 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.478729 28546 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:17.480250 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.481228 28551 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.482051 28551 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.485553 28546 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:17.489058 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.494666 28585 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.495905 28502 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:17.496209 28551 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:17.486027 28546 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:10:17.465868 28558 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 12:10:17.503031 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 79999.7us
W20260709 12:10:17.504926 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.505468 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.497567 28536 raft_consensus.cc:3055] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:17.507441 28530 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.507702 28536 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:17.508728 28536 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.509697 28536 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.510082 28585 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:17.512559 28475 raft_consensus.cc:697] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:17.513388 26465 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:17.513722 26465 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:17.513619 28475 consensus_queue.cc:237] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.514832 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:17.514657 26465 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.506203 26547 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:17.515637 26465 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.524521 26465 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:17.524711 26472 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:17.525108 26465 pending_rounds.cc:85] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 5
I20260709 12:10:17.525492 26465 pending_rounds.cc:107] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:17.525872 26465 raft_consensus.cc:2889] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:17.530824 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:17.537251 28505 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:17.538636 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.539780 28505 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:17.552968 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 100393us
I20260709 12:10:17.554332 26617 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:10:17.554565 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:17.557780 26368 catalog_manager.cc:5697] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 3 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 4 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:10:17.560720 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 94229.9us
I20260709 12:10:17.564599 26467 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.567901 26370 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57044 (request call id 309) took 2141 ms. Trace:
I20260709 12:10:17.559275 28486 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:10:17.574618 28589 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:17.575958 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:17.568341 26370 rpcz_store.cc:276] 0709 12:10:15.426002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.426171 (+   169us) service_pool.cc:224] Handling call
0709 12:10:15.431016 (+  4845us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b540007d354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076044090 00007f50760e2f3a 00007f507be98e9c 00007f507bf9704e 00007f507a4582a4 00007f507a458232 00007f507a458161 00007f507a4580dc 00007f507a457392 00007f507441548c 00007f50744148c6
0709 12:10:17.567807 (+2136791us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:17.202248 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:17.278941 (+ 76693us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:17.278988 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:10:17.279010 (+    22us) tablet.cc:662] Decoding operations
0709 12:10:17.279846 (+   836us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:17.279923 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:17.279964 (+    41us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:17.280392 (+   428us) tablet.cc:701] Row locks acquired
0709 12:10:17.280414 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:10:17.280556 (+   142us) write_op.cc:270] Start()
0709 12:10:17.280672 (+   116us) write_op.cc:276] Timestamp: P: 1783599017280509 usec, L: 0
0709 12:10:17.280692 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:10:17.287410 (+  6718us) log.cc:844] Serialized 919 byte log entry
0709 12:10:17.541393 (+253983us) op_driver.cc:464] REPLICATION: finished
0709 12:10:17.541955 (+   562us) write_op.cc:301] APPLY: starting
0709 12:10:17.542060 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:17.542212 (+   152us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:17.542330 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:17.542719 (+   389us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:17.542929 (+   210us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:17.542981 (+    52us) write_op.cc:312] APPLY: finished
0709 12:10:17.543209 (+   228us) log.cc:844] Serialized 29 byte log entry
0709 12:10:17.543409 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:17.543508 (+    99us) write_op.cc:454] Released schema lock
0709 12:10:17.543550 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:17.543933 (+   383us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:17.543960 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"spinlock_wait_cycles":5280640,"child_traces":[["op",{"apply.queue_time_us":290,"apply.run_cpu_time_us":1937,"apply.run_wall_time_us":1936,"num_ops":2,"prepare.queue_time_us":105089,"prepare.run_cpu_time_us":3500,"prepare.run_wall_time_us":85565,"replication_time_us":260502}]]}
I20260709 12:10:17.578996 26514 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:17.585012 28486 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:17.585525 28486 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:17.586560 28486 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.596222 26465 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:17.601769 26542 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:17.602064 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:17.601897 26545 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:17.604693 26470 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:17.604987 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:17.605261 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 43508.2us
I20260709 12:10:17.606587 26622 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.608166 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.609185 28486 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.609509 28577 raft_consensus.cc:3055] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.609906 28577 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:17.612236 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:17.597210 28522 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:17.615118 26613 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:17.590930 28600 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.613792 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:17.616789 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.617619 28481 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.618024 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.614678 28585 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.611649 28446 consensus_queue.cc:1059] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:10:17.619540 28585 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.619886 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:17.616626 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.622494 28501 raft_consensus.cc:2764] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:17.622201 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:17.624425 28522 raft_consensus.cc:697] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:17.624552 26617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:10:17.625175 26617 raft_consensus.cc:606] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:10:17.625541 26617 raft_consensus.cc:614] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:17.625471 28522 consensus_queue.cc:237] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.619766 28586 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:17.629495 28501 consensus_queue.cc:1059] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:17.630067 28586 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:17.588438 28505 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:10:17.636456 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:17.637885 28586 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.639461 28586 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.641072 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:17.646703 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:17.647384 28577 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.648824 28577 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.650100 26439 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:17.655838 26542 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:17.655499 28589 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:17.653414 28600 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:17.659437 28551 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:17.660658 28563 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:17.660931 26619 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:10:17.661504 28563 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.664776 28563 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:17.665220 28589 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:17.667938 28589 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.665282 28505 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:17.668720 28501 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.665654 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:17.679908 26541 raft_consensus.cc:2393] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 2: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:17.675554 28501 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:17.681710 26542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:17.682317 26542 raft_consensus.cc:606] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:17.682549 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:17.682231 28501 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.682945 26542 raft_consensus.cc:614] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:17.683756 28501 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.684773 26514 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:17.684988 28592 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:17.685546 28592 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:17.686970 28486 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:17.687093 28575 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.687964 28486 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:17.688773 28446 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:17.687870 28592 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.689463 28486 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.687184 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:10:17.689221 28446 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:17.655417 28475 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:17.693018 26514 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:17.606262 28546 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:17.693917 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 61241.7us
I20260709 12:10:17.692130 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.656217 28603 raft_consensus.cc:3055] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.693867 28585 raft_consensus.cc:2764] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Leader election decision vote started in defunct term 4: won
W20260709 12:10:17.706188 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 56210.6us
I20260709 12:10:17.698163 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:17.707497 26619 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 2.
I20260709 12:10:17.701313 28522 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.707648 28446 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.708918 27134 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.709753 28446 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.710152 26439 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:17.711099 28600 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.711575 26439 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:17.711961 28563 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:17.712409 28563 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:17.712800 28563 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.697561 28505 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:10:17.717469 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.722535 28546 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.726359 28608 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:17.700675 28603 raft_consensus.cc:740] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:17.734311 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.735266 26618 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 3: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:17.735426 26617 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:17.706585 28475 raft_consensus.cc:697] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:17.738703 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.741628 26613 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 9: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:17.743371 26622 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:17.738379 28600 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:17.745674 28600 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.746104 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.747047 26619 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 4: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:17.747646 26618 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:17.751525 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:17.752676 27165 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 3: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:17.753062 27159 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:17.754886 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.755735 26615 raft_consensus.cc:2410] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:17.756564 26368 catalog_manager.cc:5697] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 3 to 5, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 5 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:17.733484 28606 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:17.765717 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:17.718873 28522 consensus_queue.cc:1059] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
W20260709 12:10:17.785388 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 83915.3us
I20260709 12:10:17.771986 26532 tablet_service.cc:1558] Processing DeleteTablet for tablet 69e1490de99a4232a6717e72242a0f00 with delete_type TABLET_DATA_TOMBSTONED (TS ac3ac2181aa941229a758ccf6b5607cd not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:55084
I20260709 12:10:17.772673 28547 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:17.776111 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:17.776829 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:17.777352 26539 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:17.778337 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:17.779073 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:17.778887 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:17.778416 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:17.779722 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:17.789865 26543 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 4: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:17.790755 26544 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:17.779908 26619 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 3. Current term is 5. Ops: []
I20260709 12:10:17.780625 28475 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.781805 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:17.782531 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.783529 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:17.789686 28547 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.803627 28575 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:17.804271 28575 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.805280 28547 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:17.806941 28575 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:17.807484 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:17.808476 26539 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:17.817317 26546 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:17.821066 26547 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:17.821403 26540 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:10:17.824400 26541 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:17.834110 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:17.835737 26547 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 3: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:17.833359 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:17.796335 28522 consensus_queue.cc:1243] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:17.841399 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:17.795024 28606 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:17.843657 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:17.842571 28505 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.849718 26545 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:17.852330 26615 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:17.859385 26542 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:17.842607 28600 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:17.870055 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.872553 28611 tablet_replica.cc:333] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:10:17.830863 28563 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.876991 28603 consensus_queue.cc:260] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.877950 28563 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:17.881471 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:17.883242 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:17.883873 26543 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:10:17.884068 26547 raft_consensus.cc:2393] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 2: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:17.886715 28606 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.887709 28568 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:17.888396 28568 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.891137 28568 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:17.893383 28497 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.895429 28481 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.864828 28575 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:17.897019 28575 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.899665 28575 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:17.864209 28532 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:17.900695 28532 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.901466 26615 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 2.
I20260709 12:10:17.903672 27134 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.908291 26514 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:17.908360 28563 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:17.910722 26464 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:17.911150 28563 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.913995 28563 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:17.915568 28577 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:10:17.916805 28532 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:17.917470 28532 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:17.925235 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55261.3us
I20260709 12:10:17.927050 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.927996 28586 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.928875 28586 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.930166 28465 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:17.930301 28473 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.930967 28473 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:17.931005 28465 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 2 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:17.929069 26438 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:17.937700 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:17.954860 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.955730 28608 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:17.960147 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:17.957242 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 243436us
I20260709 12:10:17.961440 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:17.959097 28530 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:10:17.932451 28465 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:17.932294 28473 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:17.967563 28473 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.971606 28603 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.975775 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:17.976311 28611 raft_consensus.cc:2243] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:17.977309 28611 raft_consensus.cc:2272] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:17.959483 28577 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.983300 28497 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:17.986917 28611 ts_tablet_manager.cc:1916] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:10:17.993237 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 64310.7us
I20260709 12:10:18.000937 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:18.005514 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 298444us
I20260709 12:10:18.001902 26539 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:10:18.009641 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:18.010378 26514 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:18.010887 26543 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 6: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:18.014256 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:18.015528 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:18.018054 28568 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:18.021329 28563 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.022775 26439 leader_election.cc:400] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 4. Current term is 5.
I20260709 12:10:18.023180 26439 leader_election.cc:403] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:18.023213 28563 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:18.023855 28486 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 4. Current term is 5.
I20260709 12:10:18.018965 28503 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.012316 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:18.025072 26619 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 5: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:18.026252 26439 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:18.026780 26467 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 6: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:18.028208 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:18.031411 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.040006 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:18.042104 26514 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:18.041302 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:18.036298 28563 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:18.052280 28592 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.050374 28481 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.037489 28536 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:18.073378 28536 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:18.077927 28536 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:18.048527 28586 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:18.047695 26619 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:18.068293 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:18.051474 28486 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:10:18.079751 28614 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:18.079959 27134 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:18.080137 28614 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:18.081139 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:18.081072 28614 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:18.082696 28607 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.083297 28486 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.084008 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:18.087380 28563 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:18.091540 28563 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.071938 26368 catalog_manager.cc:5697] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 1 to 2, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 2 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:18.072449 26539 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.071003 28577 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:10:18.078765 28586 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:18.082612 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:18.103822 28577 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:18.104441 28577 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:18.104799 28486 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:18.105667 28577 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:18.097559 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:18.105858 28486 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:18.094854 28614 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.107661 28486 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:18.108871 28577 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.027477 28608 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:18.103906 28586 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:18.111608 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:18.069114 26514 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:18.105908 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:18.114679 28616 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:18.115556 28616 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:18.116439 28536 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:18.117022 28616 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:18.099139 28563 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.121658 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:18.131736 28606 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:18.132372 28606 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:18.133276 28606 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:18.134327 28592 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:18.134553 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 65575.1us
I20260709 12:10:18.134986 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:18.135946 28607 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:18.136086 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:18.136598 28611 ts_tablet_manager.cc:1929] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:10:18.137418 28592 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:18.137645 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:18.127211 28481 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:18.136502 28607 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:18.071483 26439 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:18.140239 26366 catalog_manager.cc:5697] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 4 to 5, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 5 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:18.155699 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:18.155778 26539 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:18.157409 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 86022.7us
I20260709 12:10:18.158730 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:18.154590 28611 log.cc:1199] T 69e1490de99a4232a6717e72242a0f00 P ac3ac2181aa941229a758ccf6b5607cd: Deleting WAL directory at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0/minicluster-data/ts-1-root/wals/69e1490de99a4232a6717e72242a0f00
I20260709 12:10:18.174355 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:18.155951 26366 catalog_manager.cc:5697] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 2 to 3, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 3 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:18.177240 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.154428 28592 raft_consensus.cc:697] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:18.175993 26366 catalog_manager.cc:5697] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 3 to 4, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 4 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:18.179456 26615 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:18.177945 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:18.186228 26618 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:18.186249 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:18.181555 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:18.187005 26546 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:18.177738 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.179939 26542 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:18.188278 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.188853 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:18.191926 26539 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 9: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:18.189067 28565 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:10:18.203011 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:18.203771 28565 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.204516 28592 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:18.206439 28527 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:18.206903 28568 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:18.206985 28527 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:18.172441 28473 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:18.170195 28497 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.186764 26366 catalog_manager.cc:5697] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 3 to 4, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 4 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:18.172102 28465 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.214458 26366 catalog_manager.cc:5697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 3 to 4, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 4 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:18.232062 26357 catalog_manager.cc:5028] TS ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): tablet 69e1490de99a4232a6717e72242a0f00 (table test-workload [id=6170ed1136df498ea0b9d60b07f1d70c]) successfully deleted
I20260709 12:10:18.233125 28563 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:18.189059 28589 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:18.240005 28589 raft_consensus.cc:697] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:18.241040 28589 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:18.235146 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:18.236923 27164 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:18.243481 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:18.237176 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:18.171654 28536 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:10:18.237380 28473 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 9 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:10:18.237882 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 44767.5us
I20260709 12:10:18.184259 28446 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:18.245048 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:18.245903 26470 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:18.246104 26464 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.245813 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:18.250504 26615 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:18.252705 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:18.253710 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:18.254551 26467 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:18.255196 26469 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:18.256026 28575 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:18.258153 26543 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:18.263644 28475 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:10:18.264132 26465 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:18.263676 28446 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:18.265365 28446 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:18.269305 28607 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:18.271535 28563 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:18.277453 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:18.277680 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:18.278208 26618 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.281700 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:18.280094 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:18.296113 28505 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:18.297812 28565 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.302958 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:18.303138 28497 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:10:18.304236 28497 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.304894 28616 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:18.305362 28616 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:18.306231 28616 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:18.307567 28600 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:18.307583 28616 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:18.307875 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.311465 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 129978us
I20260709 12:10:18.282473 28475 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:18.335644 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:18.347800 26617 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:18.350548 28600 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:18.354269 28603 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.355118 28603 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:18.359472 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:18.291844 28575 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:10:18.379127 26618 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:18.378995 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:18.380403 27134 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:18.357887 28505 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:18.369383 28606 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:18.408275 26616 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:18.370496 28610 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:10:18.371253 28562 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:10:18.429405 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:18.418604 28629 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:10:18.419859 28527 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:18.400295 28568 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:18.362744 28473 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:18.431160 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 55994.9us
I20260709 12:10:18.399734 26619 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:18.433728 28562 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:18.421273 28565 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.440757 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:18.443791 28465 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:18.431464 28563 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:18.445029 28563 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:18.399539 28600 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:10:18.446142 28563 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:18.441486 28630 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:10:18.447460 28565 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:18.450569 28562 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:18.451977 28562 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:18.453200 28634 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.060s	user 0.003s	sys 0.000s
I20260709 12:10:18.454005 28562 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:18.463506 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 72153.9us
I20260709 12:10:18.468571 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:18.468788 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:18.469470 26468 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:18.440593 28568 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:18.450301 28565 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:18.475953 26513 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:18.475001 27160 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:18.483263 27159 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:18.490080 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:18.496611 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:18.471798 28575 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:18.473875 28568 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.498530 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:18.472551 28532 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:10:18.495147 28565 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:18.512393 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 132063us
I20260709 12:10:18.502636 28627 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.518651 28565 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.525552 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:18.539544 28565 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.543350 28641 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:18.544269 28641 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:18.548324 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:18.550243 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:18.550331 28641 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:18.551093 26617 raft_consensus.cc:2393] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:18.551613 28530 raft_consensus.cc:3055] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:18.552060 28530 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:18.552536 27134 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:18.552923 28530 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:18.553392 28641 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:18.559274 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 73417.9us
I20260709 12:10:18.520045 28483 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:10:18.554245 28530 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:18.572232 26617 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:18.575992 28644 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:10:18.569228 28600 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:10:18.577123 28503 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:18.577497 28600 consensus_queue.cc:1243] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:18.577667 28503 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:18.578146 28644 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:18.578572 28644 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:18.578696 28503 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:18.579444 28644 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:18.580823 28644 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.583415 26617 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:18.595701 28565 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:18.580206 28503 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.638239 26544 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.638084 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:18.639508 26464 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.598347 26619 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:18.648517 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:18.668215 26542 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:18.578720 28628 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:10:18.713368 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:18.710906 28657 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.714344 28657 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:18.720835 28657 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:18.722469 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:18.723224 26622 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:18.724723 26514 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:18.656847 28536 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:18.728223 28636 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:10:18.692476 28565 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:18.728757 28654 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:18.738897 28657 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.758373 26548 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:18.747262 28536 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:18.758598 28657 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.791509 28657 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.791754 26619 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.805241 28568 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:18.776784 28643 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:18.782230 26621 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:18.783195 26622 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.770413 28536 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:18.788744 28607 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:18.789376 28609 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:10:18.851220 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:18.790728 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:18.823227 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:18.853461 26543 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 3: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:18.854285 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:18.825762 26464 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:10:18.827343 26544 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:18.858333 28600 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:18.828181 28643 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:18.873771 26469 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:18.884863 28657 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:18.886443 26542 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.883543 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:18.869065 28641 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.866091 28568 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:18.892118 26621 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 5: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:18.866242 28643 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:18.902999 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 167151us
I20260709 12:10:18.891714 28615 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:18.927778 26622 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:18.929067 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:18.929494 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:18.931828 26542 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:18.930150 28615 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:18.934072 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:18.934572 28615 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:18.934675 28657 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:18.934931 27161 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 4: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:18.935123 28486 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:18.935860 26546 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:18.936973 28616 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:18.938014 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:18.938769 26472 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:18.940795 28660 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:18.941466 28660 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:18.944124 28660 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:18.949021 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:18.949781 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:18.908144 28536 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:10:18.967271 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:18.970232 26622 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.974061 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:18.974071 26545 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:18.977569 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:18.980924 26468 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:18.954330 28585 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.983225 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:18.983464 26546 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 3: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:18.986471 26547 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:18.987360 26547 pending_rounds.cc:85] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 5
I20260709 12:10:18.987578 26547 pending_rounds.cc:107] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:18.987776 26547 raft_consensus.cc:2889] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:18.986811 26472 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:18.985808 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:18.986210 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 220951us
I20260709 12:10:18.995645 26541 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:19.013139 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:18.988664 26622 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:19.026521 26615 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:18.963188 28610 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:10:18.971464 28505 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:10:19.030900 26617 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.986580 28657 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.989349 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:19.046244 26547 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:19.047662 28586 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:10:19.054312 26616 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:19.054518 28671 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:19.033067 27163 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:19.031680 27160 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:19.056192 28603 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:19.056383 28628 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:19.036859 28446 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:19.057024 28628 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:19.057094 28446 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:19.057713 26613 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:19.058032 28628 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:19.058142 28446 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:19.059592 28446 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.059725 27161 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:19.034343 28649 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.337s	user 0.002s	sys 0.000s
I20260709 12:10:19.023648 28503 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:19.074776 28585 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.075659 28585 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:19.081813 26617 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:19.044682 28657 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:19.094246 26547 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:19.095959 26541 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:19.036708 28610 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:10:19.076774 28483 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:19.078110 28503 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 5 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:19.030843 28669 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:10:19.098097 28657 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:19.109203 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.113013 26613 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:19.122777 28637 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:10:19.123790 28637 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:19.124146 28637 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:19.125032 28637 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:19.125828 26464 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:19.101440 28505 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:10:19.126189 28637 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:19.139660 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 3288c98248464af5b8f3227349002ec7: Illegal state: Replica 01a57027214a411e80874ac7febd628b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:10:19.142932 28661 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:19.115774 28483 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:19.148844 28503 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:19.151582 28651 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.461s	user 0.002s	sys 0.000s
I20260709 12:10:19.158665 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:19.158990 26621 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:19.159441 26465 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 3: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:19.156875 26588 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:10:19.177637 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 84793.3us
I20260709 12:10:19.210143 28483 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:19.169066 28660 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:19.268018 26619 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:19.238941 28481 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.275111 28481 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:19.277920 28481 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:19.278644 28685 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.084s	user 0.008s	sys 0.002s
I20260709 12:10:19.162415 28671 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 12:10:19.168184 28505 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:10:19.237928 28670 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.119s
I20260709 12:10:19.349676 28615 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.359047 28473 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:19.444830 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 5c23e0d03a4d457fa50856e09fe2f649: Illegal state: Replica ac3ac2181aa941229a758ccf6b5607cd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:10:19.404680 28676 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.419207 28486 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.469887 26539 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:10:19.489750 28683 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:10:19.440619 28473 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:19.502281 28687 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:10:19.504581 28483 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.505200 28483 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:19.505910 28668 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.507850 28483 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:19.509527 27161 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:19.511260 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.513677 28636 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.511754 28609 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.424724 28615 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:19.514907 28609 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:19.516723 28615 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:19.517419 28609 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:19.470062 28676 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:19.476089 28486 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:19.519994 28676 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:19.520627 28486 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:19.439618 28585 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:19.539562 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:19.540531 26470 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:19.542150 28654 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.506671 28668 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:19.542740 28654 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:19.543627 26513 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:19.544613 28668 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:19.544862 28654 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:19.545225 28530 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.545708 28530 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.546083 28530 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.514376 28636 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:19.549893 28615 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.550489 28615 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:19.551183 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:19.552627 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:19.553323 28615 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:19.553468 26545 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:19.554824 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:19.555672 26541 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:19.557726 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:19.558533 26470 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:19.560253 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:19.601594 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:19.602502 26539 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:19.612501 28654 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.616969 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:19.617864 26539 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:19.607554 28600 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.607527 28668 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:19.635196 28682 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.142s	user 0.001s	sys 0.004s
I20260709 12:10:19.635543 28668 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.624891 28654 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:19.679786 28446 consensus_meta.cc:287] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.620s	user 0.007s	sys 0.003s
I20260709 12:10:19.679870 28530 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:19.684357 28650 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.955s	user 0.005s	sys 0.018s
I20260709 12:10:19.685787 27165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 289) took 1538 ms. Trace:
W20260709 12:10:19.694126 26547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.011s	sys 0.015s
W20260709 12:10:19.694741 26547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.011s	sys 0.015s
I20260709 12:10:19.672977 28668 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.640141 28600 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:19.692963 28628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.000s	sys 0.026s
W20260709 12:10:19.703132 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.696308 28503 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:19.744693 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:19.707696 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:19.909152 26539 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:19.686373 27165 rpcz_store.cc:276] 0709 12:10:18.147760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.154674 (+  6914us) service_pool.cc:224] Handling call
0709 12:10:18.492032 (+337358us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:10:18.499229 (+  7197us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:18.520316 (+ 21087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.522458 (+  2142us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:18.573247 (+ 50789us) log.cc:844] Serialized 26 byte log entry
0709 12:10:18.663265 (+ 90018us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:18.663314 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.663395 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:19.683757 (+1020362us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:10:19.685428 (+  1671us) raft_consensus.cc:1685] finished
0709 12:10:19.685476 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:19.685694 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2461,"raft.queue_time_us":714,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":10266,"spinlock_wait_cycles":76800256,"thread_start_us":85622,"threads_started":1,"wal-append.queue_time_us":91804}
I20260709 12:10:19.707849 28585 raft_consensus.cc:476] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 12:10:19.929199 28694 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:19.910698 28527 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.708854 28654 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:19.913985 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:19.706240 28673 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.930678 26545 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:19.930769 28673 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:19.930678 28585 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.933367 28673 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:19.933984 28673 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:19.702641 28628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.002s	sys 0.026s
W20260709 12:10:19.917622 28657 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.787s	user 0.014s	sys 0.000s
I20260709 12:10:19.932185 28585 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:19.913899 28503 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:19.909291 28603 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.925254 26514 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:19.720794 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:19.929903 28527 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:19.930860 28694 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:19.909049 28536 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:19.872100 28658 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.155s	user 0.000s	sys 0.026s
I20260709 12:10:20.015250 26548 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:19.934091 28668 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.018725 28536 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:19.921427 28632 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:19.949649 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.751523 28600 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:19.747376 28615 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.978845 28644 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.191809 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:20.029104 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 103988us
W20260709 12:10:20.063971 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 319387us
I20260709 12:10:20.065142 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:20.021412 26366 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57052 (request call id 302) took 1356 ms. Trace:
I20260709 12:10:19.934738 28657 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:19.978240 28673 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.066282 26366 rpcz_store.cc:276] 0709 12:10:18.664847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.691374 (+ 26527us) service_pool.cc:224] Handling call
0709 12:10:20.021330 (+1329956us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
W20260709 12:10:20.017159 28658 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.301s	user 0.000s	sys 0.030s
I20260709 12:10:19.976234 28663 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:20.107939 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.028653 28637 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:20.060766 28592 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.027880 28527 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:20.021936 28694 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:20.020377 28668 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:20.020247 28503 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:20.021822 28563 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:20.028455 28536 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:20.086303 28600 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.022578 28646 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:20.089156 28585 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:20.016175 28603 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.122205 28575 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:20.022296 28669 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:20.061973 28644 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.060655 28615 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.132273 28637 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:20.155591 28585 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:20.162606 28703 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:20.162786 28585 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.163151 28703 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.163494 28585 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.163595 28703 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:20.152160 28655 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.130434 28592 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.090802 26614 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:20.147392 28563 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:20.163259 28644 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:20.159684 28536 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:10:20.179013 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 113931us
I20260709 12:10:20.151572 28600 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.182444 28527 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:20.152540 28575 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:20.167341 28661 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.151284 28646 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.187704 28656 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.153441 28669 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:20.143359 28663 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.191201 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:20.065855 28632 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.194749 26539 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:20.184985 28658 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.196832 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:20.183676 28702 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.196504 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:20.202893 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:20.202263 26548 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:10:20.203565 26541 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:20.204445 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:20.174901 28655 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.212894 27166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56886 (request call id 425) took 1145 ms. Trace:
I20260709 12:10:20.213335 27166 rpcz_store.cc:276] 0709 12:10:19.067222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.067384 (+   162us) service_pool.cc:224] Handling call
0709 12:10:20.197030 (+1129646us) spinlock_profiling.cc:243] Waited 8.65 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:10:20.212797 (+ 15767us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19904384}
I20260709 12:10:20.189545 28536 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.203594 28708 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.225189 28706 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.225699 28473 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:20.225804 28706 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.231102 28563 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:20.226323 28473 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.192488 28527 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:20.232682 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:20.245440 26464 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:20.250113 28708 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.251039 28670 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.251632 28670 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:20.253134 28708 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:20.253815 28670 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:20.254218 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:20.254704 28606 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:20.255064 26470 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:20.251077 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:20.255302 28606 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.256037 28473 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.257810 28606 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:20.258715 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:20.259399 26545 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
W20260709 12:10:20.260520 28652 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.557s	user 0.006s	sys 0.016s
I20260709 12:10:20.260902 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:20.261650 28575 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:20.227913 26368 catalog_manager.cc:5697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 4 to 5, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 5 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:20.262885 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:20.263162 28704 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:10:20.264045 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:20.262141 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:20.266374 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:20.267230 26464 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:20.208629 28673 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:20.264644 26471 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:20.265609 26465 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:20.275377 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1530) took 1804 ms. Trace:
I20260709 12:10:20.258128 28473 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:20.221240 28694 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.197575 28661 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:20.275940 26540 rpcz_store.cc:276] 0709 12:10:18.470926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.471128 (+   202us) service_pool.cc:224] Handling call
0709 12:10:18.480198 (+  9070us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:18.560837 (+ 80639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.560873 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:18.564037 (+  3164us) log.cc:844] Serialized 26 byte log entry
0709 12:10:18.646967 (+ 82930us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:18.647004 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.647092 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:20.259875 (+1612783us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:10:20.264029 (+  4154us) raft_consensus.cc:1685] finished
0709 12:10:20.264054 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.275294 (+ 11240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6253,"raft.queue_time_us":24018,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":3538,"spinlock_wait_cycles":66033024,"thread_start_us":108719,"threads_started":2,"wal-append.queue_time_us":133450}
I20260709 12:10:20.224236 28657 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:20.263792 28532 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:20.253849 28708 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:20.202944 28658 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:20.260948 28600 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:20.304939 28706 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:20.282987 28673 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:20.305652 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:20.285876 28606 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:10:20.307309 28610 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:20.197763 28656 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:20.204800 28702 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.314028 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:20.209038 28637 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.316887 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:20.320741 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:20.332711 26464 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:20.326607 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:20.291584 28603 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:20.327005 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:20.318107 28709 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.278172 28654 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:10:20.284674 28671 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:10:20.334829 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:20.335242 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:20.336915 26467 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:20.350868 26545 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:20.329897 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:20.352149 26470 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:20.339136 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:20.353272 26547 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:10:20.325227 28706 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.350085 26540 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:10:20.324908 28615 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:20.294606 28694 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.316143 28532 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.321655 28708 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.358696 27161 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 4: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:20.339519 28473 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:20.393020 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:20.393973 26616 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:20.332568 28610 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:20.416779 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:20.339929 28673 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:20.362730 28706 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.461741 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:20.471396 26618 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
W20260709 12:10:20.417008 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 161555us
I20260709 12:10:20.350526 28709 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:20.425482 26540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:20.370962 28575 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:10:20.578552 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.596290 28610 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:20.451491 28646 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:20.578733 28715 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:20.781664 28709 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:20.781976 28715 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:20.765815 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:20.765790 28636 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:20.600682 28713 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:20.577883 28655 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:20.784129 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 464912us
I20260709 12:10:20.581022 28536 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:20.784756 28715 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:20.571506 28654 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:20.783365 26617 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:10:20.571225 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:20.786943 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:20.786160 28720 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:20.591703 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:20.787812 26617 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:20.787889 28720 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.583431 28673 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:20.726333 28532 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:20.788419 28575 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.789160 28673 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:20.789731 28673 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:20.730432 28641 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:20.576301 28701 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:20.712958 28669 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:20.570869 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:20.580044 28694 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:20.710072 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:20.634284 28643 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:20.581666 26616 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:20.579156 28658 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:20.581655 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:20.730300 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:20.834895 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 243323us
I20260709 12:10:20.428058 28473 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.427896 28585 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:20.579674 28705 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
I20260709 12:10:20.581437 28706 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:20.564466 28644 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:20.671551 26615 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:20.447266 28663 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:20.783752 28713 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:20.807492 26613 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:20.819622 28726 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:20.575990 28614 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.834235 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:20.791873 26620 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 5: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:20.837108 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:20.836661 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:20.646431 28659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.928s	user 0.017s	sys 0.049s
I20260709 12:10:20.775252 28607 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.778123 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:20.791817 28673 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:20.686251 28475 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:20.744242 28592 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:20.579140 28708 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:20.853863 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:20.447846 28527 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:20.832054 28654 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.764824 28657 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:20.710939 28615 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:20.440590 28661 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:20.849745 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 64833.1us
I20260709 12:10:20.921154 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:20.863435 28610 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:20.863405 28536 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:20.854045 26588 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:20.790367 28720 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:20.857995 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 52982.7us
I20260709 12:10:20.836912 28709 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:20.860239 28728 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.792578 28694 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:20.794739 28662 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:20.875200 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:20.842581 28681 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:20.842253 28628 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:20.790990 28641 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:20.864154 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:20.992424 26617 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:20.846264 28719 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.790992 28575 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:20.558667 28600 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:20.845467 26614 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:21.019440 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:21.020009 28673 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:20.865800 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:20.892702 28475 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.889634 28592 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:20.883108 27159 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:20.890671 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1631) took 1697 ms. Trace:
I20260709 12:10:20.953003 28709 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:20.836630 28643 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.857486 28706 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:10:20.882884 28703 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.711s	user 0.008s	sys 0.006s
I20260709 12:10:20.919559 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:21.014571 28720 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.426667 28656 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:20.854385 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:20.791376 28701 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:20.846781 28655 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:10:20.921537 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:20.948911 28610 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:21.060191 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 138753us
I20260709 12:10:20.857685 28715 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:20.874863 28670 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:10:20.890650 28473 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:21.050238 28709 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.983086 26613 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
W20260709 12:10:20.951979 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 98020.3us
I20260709 12:10:20.995682 28694 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:20.903957 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:20.988821 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 96661.4us
I20260709 12:10:20.865316 28614 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:20.883034 28607 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.921039 28730 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:20.888196 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:20.864456 28659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.147s	user 0.024s	sys 0.073s
I20260709 12:10:20.904006 28505 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:10:20.875213 28726 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:20.857905 28589 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:20.994908 28681 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:21.033449 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 167718us
I20260709 12:10:20.921259 28657 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:21.032990 26621 rpcz_store.cc:276] 0709 12:10:19.193309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.193485 (+   176us) service_pool.cc:224] Handling call
0709 12:10:19.193905 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:19.198744 (+  4839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.198777 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:19.199767 (+   990us) log.cc:844] Serialized 26 byte log entry
0709 12:10:20.060375 (+860608us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b18002799a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:10:20.166176 (+105801us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:20.166204 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.166251 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:20.890342 (+724091us) raft_consensus.cc:1685] finished
0709 12:10:20.890360 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.890585 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":141,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":44753,"spinlock_wait_cycles":11547008,"thread_start_us":105630,"threads_started":1,"wal-append.queue_time_us":990692}
I20260709 12:10:21.014562 28719 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:21.048295 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:20.935467 28615 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:21.008309 28708 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:20.948338 28536 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:21.052891 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:21.060695 28703 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:21.058979 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 105302us
I20260709 12:10:20.855545 28644 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:21.069447 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:21.177604 26547 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 2.
I20260709 12:10:21.021426 28661 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:10:20.951346 26467 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:21.184669 28725 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.184456 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:21.008026 28628 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:21.080524 26543 pending_rounds.cc:85] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 6
I20260709 12:10:21.030655 28600 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:21.143971 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:20.988124 28728 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:21.144701 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:21.141260 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 62544.4us
I20260709 12:10:20.991058 28662 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:21.152927 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:21.203418 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 50562.3us
I20260709 12:10:21.204784 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:21.073208 28563 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.053471 28592 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:21.057382 28706 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:21.065464 28715 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:21.221277 28563 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:21.057336 26615 raft_consensus.cc:2410] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:21.147841 28656 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:21.224011 28563 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:21.223853 28656 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:21.165400 28731 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:10:21.232547 28656 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:21.185276 28725 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:21.182814 28732 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:21.162369 28585 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:21.195461 26543 pending_rounds.cc:107] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:21.162900 28616 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:10:21.236403 26540 raft_consensus.cc:606] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:10:21.259250 26540 raft_consensus.cc:614] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:21.182427 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:21.241566 26548 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 2.
W20260709 12:10:21.239524 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 79543.5us
I20260709 12:10:21.162689 28589 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:21.246868 26617 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:21.247637 26543 raft_consensus.cc:2889] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:21.256992 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:21.263743 27162 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:10:21.201220 27161 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:21.261507 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:21.268422 26541 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:21.280674 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:21.175984 28708 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:21.240943 28654 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:21.219177 28723 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:21.292589 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:21.239676 28725 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:21.294034 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 89311.1us
I20260709 12:10:21.294786 26542 raft_consensus.cc:2410] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:21.296603 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:21.267429 28724 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.170153 28730 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:21.304672 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:21.289026 28656 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.289794 28585 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.309957 28715 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:21.282294 28713 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:21.291009 28641 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:21.306632 28724 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:21.318982 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 479921us
I20260709 12:10:21.300470 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:21.323263 28747 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.326243 28747 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:21.326521 28714 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:10:21.327077 28603 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.327579 28603 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.311103 28656 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.322783 28694 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:21.293422 28669 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:10:21.256987 28732 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:21.321694 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:21.315448 28585 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.329114 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1556) took 1098 ms. Trace:
I20260709 12:10:21.327939 28603 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.349085 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:21.362102 26465 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:21.350126 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:21.364105 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:21.360153 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:21.368412 26467 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 2: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:21.360841 26544 rpcz_store.cc:276] 0709 12:10:20.230408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.234871 (+  4463us) service_pool.cc:224] Handling call
0709 12:10:20.274920 (+ 40049us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.404203 (+129283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.404233 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:20.404274 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:20.404305 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.328771 (+924466us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400104fd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:21.328836 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.329016 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296806656}
I20260709 12:10:21.323920 28610 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:21.325131 28713 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:21.324259 28724 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.376495 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:21.377650 28715 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:21.387732 28715 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.388223 28715 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.388262 28703 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:21.341226 28734 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.378875 28681 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:21.379904 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:21.329453 28644 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:21.374159 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:21.384367 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:21.332895 28614 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:21.343192 28656 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.298488 28723 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:21.367556 28585 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.413805 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:21.427451 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:21.428448 26544 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 2.
I20260709 12:10:21.391450 28657 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:21.393306 28658 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.432734 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:21.380970 28729 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:21.396644 28615 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:21.434993 28628 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:21.423969 28730 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:21.392387 28713 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:21.405406 28734 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:21.443792 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:21.489348 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 130864us
I20260709 12:10:21.558521 27162 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:10:21.559106 26514 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:21.578771 26514 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:10:21.479513 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 183001us
I20260709 12:10:21.586354 26471 raft_consensus.cc:2410] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:21.591785 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:21.593058 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:21.504501 28662 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:21.438728 28726 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:21.439231 28600 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:21.505662 28745 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:21.512703 28708 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:21.447856 28729 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:21.563684 26588 consensus_peers.cc:597] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4646c5ce9a9467da50e9f3587b11ad5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:21.508988 28723 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:21.582310 28657 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:21.442190 28706 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:21.594610 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:21.592012 26439 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:21.438905 28658 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:21.506263 28732 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:21.596467 28730 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.582077 28752 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:21.611402 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 80520.8us
I20260709 12:10:21.530470 28728 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:21.590590 28610 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:21.619889 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:10:21.616688 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 439562us
I20260709 12:10:21.599826 28615 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.622079 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:21.598912 28745 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.612495 28729 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.614338 28726 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.634373 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:21.615792 28730 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.639392 26620 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 2.
I20260709 12:10:21.644076 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:21.616870 28658 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.617404 28752 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.639361 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:21.624154 28671 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.631953 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:21.655570 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:21.656949 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:21.658018 28734 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:21.615281 28657 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:21.641921 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:21.625033 28723 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:21.637411 28745 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.637596 28703 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:21.641858 28730 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.671692 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:21.660764 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:21.630889 28615 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:21.659971 26539 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:21.659271 28671 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.638978 28726 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.680696 28726 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.639567 28530 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:21.626662 28610 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:21.660624 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:21.670157 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:21.656193 28708 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.658707 28728 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:21.626673 28706 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:21.673254 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:21.673532 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:21.673959 28636 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.674379 28615 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.674536 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:21.676043 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:21.674198 28734 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.674230 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:21.659518 28752 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.683074 28673 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.850525 28673 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.711774 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:21.856717 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 183614us
I20260709 12:10:21.857846 26544 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:21.663204 28757 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.866662 26617 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:21.867419 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:10:21.715301 28709 consensus_meta.cc:287] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.625s	user 0.012s	sys 0.002s
W20260709 12:10:21.826421 26513 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.520s (SENT) [suppressed 2 similar messages]
I20260709 12:10:21.908413 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:21.909812 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:21.683943 28671 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.732367 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:21.912608 27134 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:21.913607 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:21.825577 28669 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:21.713873 28713 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:21.685338 28703 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:21.831715 28736 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:21.856156 26542 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:21.774163 28603 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:21.866216 26539 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:21.856673 28636 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:21.913872 26546 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:10:21.961035 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:21.866149 28473 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:21.979368 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 66849.7us
I20260709 12:10:21.981175 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:21.937925 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:21.915853 28614 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.865919 28757 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.858457 28734 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.987587 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2350) took 1149 ms. Trace:
W20260709 12:10:21.981941 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 403253us
I20260709 12:10:21.868101 28706 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:21.962692 28715 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.574s	user 0.010s	sys 0.002s
I20260709 12:10:21.991050 26622 rpcz_store.cc:276] 0709 12:10:20.838001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.913218 (+1075217us) service_pool.cc:224] Handling call
0709 12:10:21.987514 (+ 74296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.993554 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:21.991755 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:10:21.993923 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 82981.6us
I20260709 12:10:21.908479 28657 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:21.995929 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:21.979605 28662 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.867833 28585 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.005478 28662 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:22.006013 28662 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:22.007334 28722 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 1.165s	user 0.005s	sys 0.000s
I20260709 12:10:21.987479 28473 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.979619 28636 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.012575 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1419) took 1760 ms. Trace:
I20260709 12:10:21.942658 28536 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:21.914994 28530 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:21.997571 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:21.999168 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:22.003865 26542 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.004544 28707 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:21.885604 28728 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:21.991958 28614 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.012987 26472 rpcz_store.cc:276] 0709 12:10:20.251674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.259640 (+  7966us) service_pool.cc:224] Handling call
0709 12:10:20.259994 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:20.384392 (+124398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.384430 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:20.448244 (+ 63814us) log.cc:844] Serialized 26 byte log entry
0709 12:10:20.814342 (+366098us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:21.079816 (+265474us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.140988 (+ 61172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.141079 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:22.006735 (+865656us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:10:22.008519 (+  1784us) raft_consensus.cc:1685] finished
0709 12:10:22.012326 (+  3807us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.012506 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":130525,"prepare.queue_time_us":425301,"prepare.run_wall_time_us":56,"raft.queue_time_us":148467,"raft.run_cpu_time_us":401,"raft.run_wall_time_us":31745,"spinlock_wait_cycles":85414528,"thread_start_us":712872,"threads_started":3,"wal-append.queue_time_us":286842}
W20260709 12:10:22.014884 28762 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:10:22.016160 28702 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:21.997102 28715 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:22.018309 28729 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.018864 28610 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.021370 28701 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:22.020761 28730 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:22.023512 28656 consensus_meta.cc:287] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.600s	user 0.008s	sys 0.002s
W20260709 12:10:22.024000 28725 consensus_meta.cc:287] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.715s	user 0.004s	sys 0.008s
W20260709 12:10:22.025254 28724 consensus_meta.cc:287] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.000s
I20260709 12:10:21.993696 28734 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.993772 28706 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:21.912487 28709 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:21.867935 28708 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:10:22.035085 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 208719us
I20260709 12:10:21.977341 28745 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:22.101178 28745 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:22.105605 28658 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.108115 28709 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:22.108812 28724 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:22.111223 28724 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:21.991029 28757 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.044373 28530 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.050441 28632 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.050608 28603 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:22.050770 28719 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.123199 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:22.048980 28614 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.124639 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.054800 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:22.057129 28728 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.126686 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.057493 28636 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:22.059128 28657 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:22.062347 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:21.987421 28736 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:22.047783 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 48706.7us
I20260709 12:10:22.070336 28737 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:22.072250 28767 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:21.987409 28669 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:21.984019 28703 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.013418 28473 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.078159 28585 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:22.010282 28575 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:10:22.047698 28707 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:22.092859 28708 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.113240 28730 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:22.113044 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:22.089481 28656 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:22.118777 27161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 342) took 1305 ms. Trace:
I20260709 12:10:22.120301 28530 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.121577 28643 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.046079 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:22.123556 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.050885 28673 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.123865 26468 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.131749 26547 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.091113 28725 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:22.120301 28715 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:22.122910 28726 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.277218 26368 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39184 (request call id 155) took 2619 ms. Trace:
I20260709 12:10:22.309197 27162 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.309365 26465 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:22.311079 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.137881 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.137382 26618 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:22.311046 26546 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:22.312423 26622 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:22.312098 26616 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:10:22.138334 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.291519 26542 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:22.314479 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 297) took 1246 ms. Trace:
I20260709 12:10:22.310649 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.138514 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.123231 28610 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.321498 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:22.274359 26541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 295) took 1207 ms (client timeout 1549 ms). Trace:
I20260709 12:10:22.314971 26548 rpcz_store.cc:276] 0709 12:10:21.068263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.069056 (+   793us) service_pool.cc:224] Handling call
0709 12:10:22.307925 (+1238869us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b540018bfd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:22.314407 (+  6482us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108532480}
I20260709 12:10:22.313836 26617 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:22.207262 27167 raft_consensus.cc:2410] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:22.344468 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:22.345537 26546 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.317523 26615 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:10:22.316291 26465 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:22.201161 28729 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:22.199532 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:22.343814 26541 rpcz_store.cc:269] 0709 12:10:21.067411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.068954 (+  1543us) service_pool.cc:224] Handling call
0709 12:10:22.274141 (+1205187us) spinlock_profiling.cc:243] Waited 69 ms on lock 0x7b54002364d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:22.274273 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158719872}
I20260709 12:10:22.203006 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.354581 26468 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:22.356309 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.357599 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.355175 26473 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:22.132627 28657 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:22.314958 28707 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.207568 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1639) took 1354 ms. Trace:
I20260709 12:10:22.205672 28636 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.309508 26368 rpcz_store.cc:276] 0709 12:10:19.658111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.658273 (+   162us) service_pool.cc:224] Handling call
0709 12:10:22.277139 (+2618866us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:20.904761 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:21.160578 (+255817us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:21.163835 (+  3257us) write_op.cc:435] Acquired schema lock
0709 12:10:21.166290 (+  2455us) tablet.cc:662] Decoding operations
0709 12:10:21.183429 (+ 17139us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:21.183489 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:21.183523 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:21.183746 (+   223us) tablet.cc:701] Row locks acquired
0709 12:10:21.183777 (+    31us) write_op.cc:260] PREPARE: finished
0709 12:10:21.183944 (+   167us) write_op.cc:270] Start()
0709 12:10:21.184092 (+   148us) write_op.cc:276] Timestamp: P: 1783599021183892 usec, L: 0
0709 12:10:21.184119 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:10:21.184940 (+   821us) log.cc:844] Serialized 536 byte log entry
0709 12:10:21.252058 (+ 67118us) op_driver.cc:464] REPLICATION: finished
0709 12:10:21.403339 (+151281us) write_op.cc:301] APPLY: starting
0709 12:10:21.416445 (+ 13106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:21.425527 (+  9082us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:21.441248 (+ 15721us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:21.492705 (+ 51457us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:21.506518 (+ 13813us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:21.506595 (+    77us) write_op.cc:312] APPLY: finished
0709 12:10:21.506881 (+   286us) log.cc:844] Serialized 23 byte log entry
0709 12:10:21.507137 (+   256us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:21.507282 (+   145us) write_op.cc:454] Released schema lock
0709 12:10:21.507336 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:21.507759 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:21.507785 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":361255,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":119212,"apply.run_cpu_time_us":2755,"apply.run_wall_time_us":116104,"num_ops":1,"prepare.queue_time_us":597288,"prepare.run_cpu_time_us":9213,"prepare.run_wall_time_us":363255,"raft.queue_time_us":1078,"raft.run_cpu_time_us":47232,"raft.run_wall_time_us":59033,"replication_time_us":67739,"spinlock_wait_cycles":6400,"thread_start_us":241142,"threads_started":4,"wal-append.queue_time_us":63675}]]}
I20260709 12:10:22.361665 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:22.298030 28658 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.375615 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.376286 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:22.377051 26468 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 6: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:22.200121 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.378692 28585 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:22.379375 28585 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.379766 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:22.380595 27163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56886 (request call id 432) took 1095 ms. Trace:
I20260709 12:10:22.380687 26513 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:22.380990 27163 rpcz_store.cc:276] 0709 12:10:21.284988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.293754 (+  8766us) service_pool.cc:224] Handling call
0709 12:10:22.379599 (+1085845us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:10:22.380526 (+   927us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8166784}
I20260709 12:10:22.381613 28585 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:22.382067 26513 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:22.301764 28671 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:22.364398 26548 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:22.335397 28728 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.365303 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:22.319857 28603 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:22.335568 28632 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.369199 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.396261 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:22.374662 26547 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:22.348898 28610 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.397651 26548 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:22.199404 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:22.363054 28657 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.314515 27161 rpcz_store.cc:276] 0709 12:10:20.813080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.831290 (+ 18210us) service_pool.cc:224] Handling call
0709 12:10:22.118539 (+1287249us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54006054d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:22.118706 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":664075520}
I20260709 12:10:22.321942 28767 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:22.392010 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:22.390105 26619 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
W20260709 12:10:22.388622 28615 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.003s
I20260709 12:10:22.395884 26546 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:10:22.365869 27160 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:22.366613 26614 rpcz_store.cc:276] 0709 12:10:20.852941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.047985 (+195044us) service_pool.cc:224] Handling call
0709 12:10:21.048460 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.312985 (+264525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.315465 (+  2480us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.319665 (+  4200us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:21.322443 (+  2778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.207208 (+884765us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400033254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:22.207275 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.207479 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589957888}
I20260709 12:10:22.406426 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.399500 28636 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:22.399619 28728 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.398684 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:22.431193 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.431521 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:22.432464 26547 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:22.433792 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:22.417078 28734 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.435021 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.404184 28632 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.435879 26619 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 6: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:22.436946 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.437493 28632 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.437605 26619 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:22.320552 28737 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.368446 28736 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.382510 28646 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:22.439764 28646 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:22.412813 26542 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:10:22.382952 28530 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:22.386816 27164 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:22.382362 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:22.418938 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:22.460852 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:22.462080 26546 raft_consensus.cc:2410] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:22.419651 27162 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:22.420461 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.421443 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:22.425993 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.436937 26466 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:22.465121 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.442147 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 229) took 1370 ms. Trace:
I20260709 12:10:22.466580 26613 rpcz_store.cc:276] 0709 12:10:21.071902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.172973 (+101071us) service_pool.cc:224] Handling call
0709 12:10:21.269544 (+ 96571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.317521 (+ 47977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.317561 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.317606 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:21.317639 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.441877 (+1124238us) spinlock_profiling.cc:243] Waited 47.8 ms on lock 0x7b54001f63d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:22.441924 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.442069 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109840640}
I20260709 12:10:22.473480 26468 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:22.457726 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:22.475371 26541 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:10:22.476835 26621 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 5: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:22.477813 26547 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
W20260709 12:10:22.438941 28752 consensus_meta.cc:287] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.000s
I20260709 12:10:22.455008 27165 raft_consensus.cc:2368] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 5. Current term is 6.
I20260709 12:10:22.481072 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.409360 28603 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.429090 28615 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.441180 28636 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:22.537492 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 146001us
I20260709 12:10:22.538682 27166 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:22.559118 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.582346 27166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 341) took 1770 ms. Trace:
I20260709 12:10:22.582557 26619 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:22.496627 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:22.585191 26548 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 2.
I20260709 12:10:22.585564 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.492604 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.562636 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.584822 27166 rpcz_store.cc:276] 0709 12:10:20.811570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.835514 (+ 23944us) service_pool.cc:224] Handling call
0709 12:10:22.538074 (+1702560us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:10:22.538376 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.581986 (+ 43610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.582265 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13008768}
I20260709 12:10:22.498219 26541 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:22.594471 26619 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 5: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:22.588620 28615 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:22.587589 28738 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.366s	user 0.004s	sys 0.000s
I20260709 12:10:22.597208 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.598608 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.599620 26619 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 5: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:22.600205 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:22.600205 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.601884 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.602116 26613 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:22.602381 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:22.603116 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.604202 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.604584 28505 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.604821 26468 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:22.605255 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 267) took 1248 ms. Trace:
I20260709 12:10:22.605964 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:22.486572 27163 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:10:22.606739 28673 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:22.608341 26613 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:22.615178 28728 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.615489 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:22.616143 26473 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.609112 26439 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:22.609848 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:22.605679 26471 rpcz_store.cc:276] 0709 12:10:21.357298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.357437 (+   139us) service_pool.cc:224] Handling call
0709 12:10:22.605039 (+1247602us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54000a50d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:22.605192 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458547072}
I20260709 12:10:22.590150 28737 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.619088 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:22.557320 28669 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:22.619438 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.491861 28703 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:22.561709 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.626531 28747 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:22.627343 26619 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:22.628075 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:22.628772 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:22.629068 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:22.628364 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.630584 28737 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.630677 26619 raft_consensus.cc:2410] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:22.631035 28737 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:22.631453 28737 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.631754 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.632510 26619 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 5: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:10:22.633306 28614 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.000s
I20260709 12:10:22.607342 28726 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.635111 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.635082 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.637468 26619 raft_consensus.cc:2368] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6.
I20260709 12:10:22.490664 28752 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.637478 26468 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:10:22.637451 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.639184 26439 leader_election.cc:400] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6.
I20260709 12:10:22.639379 26613 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 4: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:22.639513 26439 leader_election.cc:403] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:22.537274 28646 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.640686 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.637861 28607 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:22.623272 28757 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.500s	user 0.011s	sys 0.000s
I20260709 12:10:22.620435 28728 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:22.628867 26614 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.646843 28610 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.624416 28772 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:22.649261 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45356 (request call id 28) took 2224 ms. Trace:
I20260709 12:10:22.651290 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.647707 26366 catalog_manager.cc:5697] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 2 to 3, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 3 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:22.657089 26468 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:10:22.659960 26366 catalog_manager.cc:5697] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 4 to 5, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 5 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:10:22.656754 26540 rpcz_store.cc:276] 0709 12:10:20.425084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.425301 (+   217us) service_pool.cc:224] Handling call
0709 12:10:22.649069 (+2223768us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54001126d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d4853 00007f507b0a260a 00007f50746287d4 00007f5074628762 00007f5074628691 00007f507462860c 00007f50746278c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:22.649193 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1036245376}
W20260709 12:10:22.647533 28706 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.002s
I20260709 12:10:22.667251 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.670836 26514 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:10:22.672415 28662 consensus_meta.cc:287] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.001s
I20260709 12:10:22.672842 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.672904 28662 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:22.674149 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:22.678467 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:22.682688 26466 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:22.686208 26438 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:22.689072 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:22.684123 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.638712 28614 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.692020 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:22.692613 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.698719 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:22.701346 26514 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:22.666587 28772 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:22.697860 28773 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.691133 28527 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:22.703449 26540 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:22.703418 26471 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:22.708417 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:22.708545 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.709251 26540 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:22.676649 28610 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:22.647415 28757 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.693543 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:22.711512 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.714182 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:22.715339 26466 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 5: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:22.699951 28728 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.715498 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:22.717346 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:22.718999 28614 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.719194 28752 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.719563 28769 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:22.723062 26540 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 6: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:22.723119 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:22.707585 28527 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.720356 28475 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.700156 28607 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.728240 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:22.717109 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:22.727357 28532 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:22.727720 28741 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:22.728228 28636 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.711472 28603 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:22.707031 28575 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:10:22.710417 28772 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.707425 28773 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.737843 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:22.677390 28706 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.741104 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:22.804340 26615 raft_consensus.cc:2368] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 3. Current term is 4.
I20260709 12:10:22.726416 28769 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:22.805478 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.735569 28662 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.734437 28607 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.735114 28527 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.806310 26615 raft_consensus.cc:2410] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:22.740975 28670 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:22.742594 28532 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:22.734890 28714 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.807024 28769 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:22.813896 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 76159.9us
W20260709 12:10:22.806177 28780 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
W20260709 12:10:22.807273 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 106017us
I20260709 12:10:22.830868 26514 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:22.819988 26613 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:10:22.805660 28773 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.716084 28610 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:22.816038 28607 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.839807 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 262) took 1949 ms. Trace:
I20260709 12:10:22.840297 26470 rpcz_store.cc:276] 0709 12:10:20.890315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.893949 (+  3634us) service_pool.cc:224] Handling call
0709 12:10:20.920331 (+ 26382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.292058 (+371727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.292089 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.292131 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:21.292167 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.839572 (+1547405us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b54001c2354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:22.839618 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.839741 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":854374144}
I20260709 12:10:22.841620 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.838902 26514 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:22.845091 26514 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:22.817086 28741 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.851261 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:22.823944 28532 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.819061 28670 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:22.855254 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:22.741938 28739 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 12:10:22.856699 26470 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:22.836067 28662 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:22.870625 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:22.850953 28475 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.851691 28741 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.873060 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:22.852480 28726 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:22.876467 26514 leader_election.cc:400] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 3. Current term is 4.
I20260709 12:10:22.878717 26514 leader_election.cc:403] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:22.860049 28670 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.869088 28752 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.856438 28785 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:22.852576 28708 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.878072 28643 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:22.884690 28752 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:22.889634 28656 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:22.890766 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.877512 28741 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.967135 26622 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:22.967336 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.968169 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.968561 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.968761 26622 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 3.
I20260709 12:10:22.969703 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:22.970484 27160 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 345) took 2130 ms (client timeout 1799 ms). Trace:
I20260709 12:10:22.891769 28757 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.892017 28657 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.892774 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.981962 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.877810 28726 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:22.893869 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.880877 28789 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.874796 28575 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:22.875598 28475 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:22.879961 28646 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:22.913753 28589 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:22.905939 28592 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:22.916298 28708 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:22.917184 26617 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 3: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:22.933995 28527 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:22.907929 28643 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:22.921662 28725 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:22.922091 28734 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:22.923324 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.875141 28662 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:22.927667 28610 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:22.930619 28603 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:22.930871 28706 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:22.931782 28703 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:22.937551 28532 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.938918 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.939067 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.939908 27163 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:22.940526 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:22.940828 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:22.941001 28773 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:22.944855 28614 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:22.908524 28707 consensus_meta.cc:287] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.003s
I20260709 12:10:22.945683 26588 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:22.948511 26614 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 3.
W20260709 12:10:22.949087 28473 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.000s
I20260709 12:10:22.949867 28752 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.950693 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:22.952692 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:22.955470 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:22.956665 28671 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:22.971710 26622 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 6: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:22.971894 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:22.952713 26473 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:22.973362 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:22.916688 28607 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:22.992250 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:23.097613 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:23.358979 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 413372us
W20260709 12:10:23.359251 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 387823us
W20260709 12:10:23.203433 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 214748us
I20260709 12:10:23.360589 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:23.361562 26465 raft_consensus.cc:2368] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 5. Current term is 6.
I20260709 12:10:23.362377 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:23.357817 26619 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:23.363234 26465 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:23.363571 27162 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 6: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:23.363957 26615 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:23.218057 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 242729us
I20260709 12:10:23.362577 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:23.356756 27166 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
W20260709 12:10:22.970956 27160 rpcz_store.cc:269] 0709 12:10:20.839637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.842077 (+  2440us) service_pool.cc:224] Handling call
0709 12:10:22.970247 (+2128170us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400530a54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:22.970357 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2795674368}
I20260709 12:10:23.368427 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:23.359547 26466 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:23.360103 26621 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:23.370199 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:23.369246 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:23.370985 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:23.371035 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:23.371537 26622 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.371690 26621 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:23.372689 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:23.373270 26621 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
I20260709 12:10:23.374712 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:23.375735 28720 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:23.368073 28505 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6.
I20260709 12:10:23.377029 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 300) took 2297 ms. Trace:
I20260709 12:10:23.374730 26472 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:23.360297 27165 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:23.374063 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:23.381647 26621 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.378419 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:23.383319 26622 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:23.384570 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:23.384545 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:23.352654 28769 consensus_meta.cc:287] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.000s
I20260709 12:10:23.379571 26543 rpcz_store.cc:276] 0709 12:10:21.079602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.080054 (+   452us) service_pool.cc:224] Handling call
0709 12:10:21.080367 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:21.263003 (+182636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.263059 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:22.840172 (+1577113us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b2c0005b0f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:10:22.840599 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 12:10:23.032690 (+192091us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:23.032749 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.032832 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:23.367070 (+334238us) raft_consensus.cc:1685] finished
0709 12:10:23.367085 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.376948 (+  9863us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9239296,"thread_start_us":191711,"threads_started":1,"wal-append.queue_time_us":524895}
W20260709 12:10:23.333477 28772 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.000s
I20260709 12:10:23.390822 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:10:23.307142 28793 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:10:23.387022 26439 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:23.385511 26467 raft_consensus.cc:2410] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:10:23.219311 28737 consensus_meta.cc:287] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.003s
I20260709 12:10:23.395028 26439 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:23.369874 28643 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.382669 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:23.386857 27134 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:23.389277 26548 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:23.389503 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:23.401654 26542 raft_consensus.cc:2368] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6.
I20260709 12:10:23.388819 26619 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 5: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:23.392308 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:23.392827 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:23.393149 26546 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:23.391404 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:23.059377 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:22.991464 28726 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.360070 28646 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.368988 28475 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.357148 28614 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:23.427587 28798 ts_tablet_manager.cc:933] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:23.339838 28657 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:23.407228 27161 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 5: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:23.388177 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:23.430071 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:23.397809 26439 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:23.398492 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:23.402550 28768 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.356372 28575 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:23.399163 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:23.434165 27168 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.395942 28734 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.399888 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:23.435150 26618 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 5: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:23.064988 28656 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:23.376470 28632 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:23.402480 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:23.410159 28725 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:23.410869 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1558) took 1062 ms. Trace:
I20260709 12:10:23.444041 26542 rpcz_store.cc:276] 0709 12:10:22.348197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.362508 (+1014311us) service_pool.cc:224] Handling call
0709 12:10:23.410799 (+ 48291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:23.428419 28728 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:23.391378 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:23.445798 26622 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 5: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:23.416180 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:23.358206 28670 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:23.333798 28741 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:23.369814 28703 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:23.426440 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:23.370078 28473 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:23.395975 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:23.316402 27164 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 349) took 1944 ms. Trace:
I20260709 12:10:23.456321 26464 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:23.385855 28589 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:10:23.431565 26439 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:23.377103 28707 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:23.460542 28757 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:23.461006 28757 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:23.461292 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:23.461586 28532 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:23.462579 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:23.409315 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:23.448033 28725 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:23.463374 28725 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.463795 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:23.464572 26470 raft_consensus.cc:2368] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 3. Current term is 4.
I20260709 12:10:23.465158 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2411) took 1340 ms. Trace:
I20260709 12:10:23.465360 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:23.465596 26469 rpcz_store.cc:276] 0709 12:10:22.124978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.125116 (+   138us) service_pool.cc:224] Handling call
0709 12:10:22.125434 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.439578 (+314144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.439608 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:22.440121 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 12:10:22.596055 (+155934us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:22.596086 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.464741 (+868655us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54003151d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:23.464788 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:23.464836 (+    48us) raft_consensus.cc:1685] finished
0709 12:10:23.464851 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.465094 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":721901440,"thread_start_us":155567,"threads_started":1,"wal-append.queue_time_us":155962}
I20260709 12:10:23.466893 26547 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.467643 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:23.468490 26466 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:23.469007 28739 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:23.469523 28767 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:23.469817 28739 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.470376 28739 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.471494 28725 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:23.428577 28646 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.474505 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:23.425379 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:23.475253 26548 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:23.475569 26614 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.456597 27164 rpcz_store.cc:276] 0709 12:10:21.372068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.388352 (+ 16284us) service_pool.cc:224] Handling call
0709 12:10:21.388747 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.476784 (+1088037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.309009 (+832225us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b5400547ed4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:23.316280 (+  7271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2230949248}
I20260709 12:10:23.463703 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:23.479736 26546 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:23.412215 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:23.446894 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:23.480471 26541 raft_consensus.cc:2368] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 3. Current term is 4.
I20260709 12:10:23.480654 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:23.481361 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:23.482600 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:23.483228 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1434) took 1351 ms. Trace:
I20260709 12:10:23.445312 28728 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:23.407397 28592 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:23.434587 28575 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.402818 28737 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:23.428184 28614 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:23.448875 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:23.450258 26619 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.437726 28768 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.397598 28772 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:23.442646 28656 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:23.539853 28768 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.452494 28785 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:23.452843 28773 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:23.446463 28636 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:23.455137 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:23.455185 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:23.377745 28603 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:23.551249 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 138584us
I20260709 12:10:23.462090 28757 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:23.469949 28741 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:23.474912 28725 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:23.440529 28632 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:23.479491 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:23.538313 28706 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:23.486340 28767 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:23.486701 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1645) took 1228 ms. Trace:
W20260709 12:10:23.486910 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 55439.6us
I20260709 12:10:23.483639 26464 rpcz_store.cc:276] 0709 12:10:22.131462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.361884 (+1230422us) service_pool.cc:224] Handling call
0709 12:10:23.362203 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.458896 (+ 96693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.482992 (+ 24096us) spinlock_profiling.cc:243] Waited 93.9 ms on lock 0x7b540035edd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:23.483168 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215977344}
I20260709 12:10:23.447525 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:23.428606 28708 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:23.487418 27168 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:23.445326 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:23.488243 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:23.519934 28592 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:23.488667 26469 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 5: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:23.538082 28747 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:23.487967 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:23.489547 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:23.490167 26546 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:23.493942 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1648) took 1220 ms. Trace:
I20260709 12:10:23.493747 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:23.396130 28769 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:23.551815 28614 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.483330 26541 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 3: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:10:23.496312 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 84377.3us
I20260709 12:10:23.557968 26472 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.558265 26539 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:23.579855 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1575) took 1146 ms. Trace:
I20260709 12:10:23.580175 26539 rpcz_store.cc:276] 0709 12:10:22.433701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.454974 (+1021273us) service_pool.cc:224] Handling call
0709 12:10:23.579791 (+124817us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:23.486222 26547 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:23.542194 28720 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:23.485792 28728 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:23.461624 28707 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:23.476270 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:23.562000 26618 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:23.593456 26471 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:23.563180 26613 rpcz_store.cc:276] 0709 12:10:22.257850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.672996 (+415146us) service_pool.cc:224] Handling call
0709 12:10:22.673333 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.838340 (+165007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.486450 (+648110us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400196254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:23.486642 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336651520}
I20260709 12:10:23.563611 26439 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:23.594235 26468 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 6: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:23.568082 26467 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 3: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:23.581444 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:23.595095 26539 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 3: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:23.569824 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:23.595374 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:23.570252 26616 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.569037 26466 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:23.596575 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:23.596992 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:23.574041 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:23.597718 26541 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.564328 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:23.575003 26587 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:23.570487 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:23.600339 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:23.600858 26469 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 5: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:23.582113 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:23.602870 26547 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.536664 26465 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:23.551246 28527 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:23.569967 26615 rpcz_store.cc:276] 0709 12:10:22.273599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.824618 (+551019us) service_pool.cc:224] Handling call
0709 12:10:23.363774 (+539156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.364397 (+   623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.493724 (+129327us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b5400345650. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:23.493878 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1239146752}
I20260709 12:10:23.619263 26467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:23.649520 26467 raft_consensus.cc:606] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:23.650064 26467 raft_consensus.cc:614] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:23.601379 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:23.651616 26469 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:10:23.621035 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 57524.6us
I20260709 12:10:23.642975 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 272) took 1410 ms. Trace:
I20260709 12:10:23.660537 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 273) took 1412 ms. Trace:
I20260709 12:10:23.663872 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 274) took 1405 ms. Trace:
I20260709 12:10:23.683561 26469 rpcz_store.cc:276] 0709 12:10:22.258539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.662779 (+1404240us) service_pool.cc:224] Handling call
0709 12:10:23.663229 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.663471 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.663510 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:23.663572 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:23.663613 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.663662 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.663793 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:23.658427 26465 rpcz_store.cc:276] 0709 12:10:22.232178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.641586 (+1409408us) service_pool.cc:224] Handling call
0709 12:10:23.642017 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.642493 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.642537 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:23.642600 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:23.642649 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.642729 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.642887 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:23.661307 26467 rpcz_store.cc:276] 0709 12:10:22.248554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.659377 (+1410823us) service_pool.cc:224] Handling call
0709 12:10:23.659806 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.660078 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.660118 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:23.660182 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:23.660228 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.660304 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.660452 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:23.560539 28757 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.561352 28632 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.559855 28473 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:23.554329 28703 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:23.685456 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2426) took 1349 ms. Trace:
I20260709 12:10:23.719691 26469 rpcz_store.cc:276] 0709 12:10:22.335968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.684613 (+1348645us) service_pool.cc:224] Handling call
0709 12:10:23.684958 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.685144 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.685167 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:23.685206 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:23.685237 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.685286 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.685399 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:23.556849 28785 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.552896 28670 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:23.572113 28769 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:23.567068 28708 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:23.740818 28708 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.554340 28789 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 3. Current term is 4.
I20260709 12:10:23.559798 28603 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:23.562585 28767 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:23.744168 28767 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.568432 28747 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:23.745273 28747 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.570118 28656 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:23.751273 28720 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:23.661649 28773 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:23.753127 28773 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:23.753625 28773 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:23.730999 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1439) took 1095 ms. Trace:
I20260709 12:10:23.755009 26468 rpcz_store.cc:276] 0709 12:10:22.635561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.658328 (+ 22767us) service_pool.cc:224] Handling call
0709 12:10:23.730779 (+1072451us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b54001c0f54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:23.730928 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2054439808}
I20260709 12:10:23.735853 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1650) took 1461 ms. Trace:
I20260709 12:10:23.757757 26366 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57048 (request call id 299) took 2701 ms. Trace:
I20260709 12:10:23.740916 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2373) took 1029 ms. Trace:
I20260709 12:10:23.758670 26617 rpcz_store.cc:276] 0709 12:10:22.711503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.716788 (+  5285us) service_pool.cc:224] Handling call
0709 12:10:23.740688 (+1023900us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b540037ad54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:23.740851 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410570112}
I20260709 12:10:23.759886 28737 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:23.572474 28592 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:23.733397 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2420) took 1562 ms. Trace:
I20260709 12:10:23.562541 28706 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:23.813675 26471 rpcz_store.cc:276] 0709 12:10:22.170969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.709983 (+539014us) service_pool.cc:224] Handling call
0709 12:10:22.721022 (+ 11039us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.593980 (+872958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.733084 (+139104us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b54002dc154. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:23.733310 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2005964032}
I20260709 12:10:23.758253 26366 rpcz_store.cc:276] 0709 12:10:21.056009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.056164 (+   155us) service_pool.cc:224] Handling call
0709 12:10:23.757684 (+2701520us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:22.693529 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:22.694350 (+   821us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:22.694435 (+    85us) write_op.cc:435] Acquired schema lock
0709 12:10:22.694465 (+    30us) tablet.cc:662] Decoding operations
0709 12:10:22.695025 (+   560us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:22.695139 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:22.695181 (+    42us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:22.695635 (+   454us) tablet.cc:701] Row locks acquired
0709 12:10:22.695663 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:10:22.695866 (+   203us) write_op.cc:270] Start()
0709 12:10:22.696022 (+   156us) write_op.cc:276] Timestamp: P: 1783599022695803 usec, L: 0
0709 12:10:22.696054 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:10:22.697019 (+   965us) log.cc:844] Serialized 924 byte log entry
0709 12:10:22.925725 (+228706us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b1800330580. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5075c824bc 00007f5072fd048b 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1
0709 12:10:22.944047 (+ 18322us) op_driver.cc:464] REPLICATION: finished
0709 12:10:23.427835 (+483788us) write_op.cc:301] APPLY: starting
0709 12:10:23.427925 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:23.428052 (+   127us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:23.428078 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:23.470741 (+ 42663us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:23.470943 (+   202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:23.470994 (+    51us) write_op.cc:312] APPLY: finished
0709 12:10:23.471220 (+   226us) log.cc:844] Serialized 29 byte log entry
0709 12:10:23.471404 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:23.471493 (+    89us) write_op.cc:454] Released schema lock
0709 12:10:23.471539 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:23.471958 (+   419us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:23.472027 (+    69us) write_op.cc:454] Released schema lock
0709 12:10:23.483903 (+ 11876us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b540007d354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d732a 00007f507605cf14 00007f507605cec3 00007f507605ce38 00007f507605cdf3 00007f507605c0dc 00007f5076085e16 00007f507606dcbb 00007f507605839d 00007f507605bd75
Metrics: {"mutex_wait_us":3046,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":483510,"apply.run_cpu_time_us":2532,"apply.run_wall_time_us":44101,"num_ops":2,"prepare.queue_time_us":25559,"prepare.run_cpu_time_us":7385,"prepare.run_wall_time_us":232602,"raft.queue_time_us":1419,"raft.run_cpu_time_us":20272,"raft.run_wall_time_us":726306,"replication_time_us":247798,"spinlock_wait_cycles":436154368,"thread_start_us":453864,"threads_started":4,"wal-append.queue_time_us":1308}]]}
I20260709 12:10:23.875870 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:23.876817 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 301895us
I20260709 12:10:23.755527 26368 catalog_manager.cc:5697] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 4 to 5, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 5 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:10:23.879051 28739 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:23.880330 26466 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:23.880501 28726 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:23.880409 26368 catalog_manager.cc:5697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 4 to 5, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 5 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:10:23.757632 26618 rpcz_store.cc:276] 0709 12:10:22.274199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.709209 (+1435010us) service_pool.cc:224] Handling call
0709 12:10:23.735151 (+ 25942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.735408 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.735446 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:23.735504 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:23.735550 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.735622 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.735762 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:23.884307 28592 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:23.886358 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:23.888681 26547 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:23.890648 26587 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:23.888188 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:23.892683 26464 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 5: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:10:23.893182 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:23.893819 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.894230 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:23.890733 26547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:23.895344 26547 raft_consensus.cc:606] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 5 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:10:23.882759 26368 catalog_manager.cc:5697] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 3 to 4, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 4 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:23.900732 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:23.901530 26513 leader_election.cc:400] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 5. Current term is 6.
I20260709 12:10:23.902079 26513 leader_election.cc:403] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:23.902120 26469 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:23.902313 26368 catalog_manager.cc:5697] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 2 to 3, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:10:23.903079 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2440) took 1055 ms. Trace:
I20260709 12:10:23.904727 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:23.905743 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:23.906998 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:23.906622 26368 catalog_manager.cc:5697] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 5 to 6, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 6 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:10:23.905267 26469 rpcz_store.cc:276] 0709 12:10:22.847358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.721163 (+873805us) service_pool.cc:224] Handling call
0709 12:10:23.901732 (+180569us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b5800011198. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:10:23.901944 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.902759 (+   815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.903001 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376363904}
I20260709 12:10:23.908596 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:23.917768 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:23.919502 26466 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 3: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:23.911547 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2433) took 1078 ms. Trace:
I20260709 12:10:23.920068 26467 rpcz_store.cc:276] 0709 12:10:22.832663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.686528 (+853865us) service_pool.cc:224] Handling call
0709 12:10:23.910834 (+224306us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5800011198. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:10:23.911030 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.911216 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.911240 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:23.911296 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:23.911328 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.911382 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.911490 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409138944}
W20260709 12:10:23.923564 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.924407 26438 leader_election.cc:400] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6.
I20260709 12:10:23.911777 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1585) took 1265 ms. Trace:
I20260709 12:10:23.916143 26542 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:23.926322 26619 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:23.927587 27134 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:23.926007 26547 rpcz_store.cc:276] 0709 12:10:22.646625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.911035 (+1264410us) service_pool.cc:224] Handling call
0709 12:10:23.911313 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.911475 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.911497 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:23.911534 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:23.911560 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.911619 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.911711 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:23.929160 26613 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:23.929891 26541 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:23.929662 26547 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:23.932212 26471 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:23.933456 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1587) took 1286 ms. Trace:
I20260709 12:10:23.933810 26547 rpcz_store.cc:276] 0709 12:10:22.647193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.929162 (+1281969us) service_pool.cc:224] Handling call
0709 12:10:23.929483 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.933208 (+  3725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.933400 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:23.934358 26368 catalog_manager.cc:5697] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 2 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:10:23.931133 26438 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:10:23.935142 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 289303us
I20260709 12:10:23.937520 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:23.938223 26468 raft_consensus.cc:2376] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4. Re-sending same reply.
I20260709 12:10:23.939831 27133 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:23.942775 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:23.944094 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:23.950912 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:23.951745 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:23.951783 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:23.954577 26616 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:23.955583 26622 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:23.910602 28606 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.963435 26467 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:23.911062 28789 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.912403 28707 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 5. Current term is 6.
I20260709 12:10:23.965993 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:23.966607 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:23.918735 28728 raft_consensus.cc:2764] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:23.900430 28527 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.981321 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:23.985879 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:23.910087 28741 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:10:23.987803 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 1470) took 1054 ms. Trace:
I20260709 12:10:23.988430 26542 rpcz_store.cc:276] 0709 12:10:22.933517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.445020 (+511503us) service_pool.cc:224] Handling call
0709 12:10:23.987546 (+542526us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54003cfd54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:23.987714 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404043520}
W20260709 12:10:23.990378 26620 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.011s	sys 0.037s
W20260709 12:10:23.991138 26620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.012s	sys 0.037s
I20260709 12:10:23.964314 28656 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.966277 28725 raft_consensus.cc:2764] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:23.911582 28636 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 3 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:23.860917 28798 tablet_copy_client.cc:323] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.67:42217
I20260709 12:10:23.959564 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:24.009116 26467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:23.967458 26514 leader_election.cc:400] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 5. Current term is 6.
I20260709 12:10:24.009791 26467 raft_consensus.cc:606] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:24.010159 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 45049.9us
I20260709 12:10:24.011188 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:24.012259 26514 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:23.962374 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:23.968938 28658 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:23.963708 28606 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:24.017556 27134 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:24.017808 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:23.969723 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:24.018847 26547 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:24.018942 26619 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:10:24.003017 28670 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.970484 28805 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:23.965689 28809 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:24.027803 28809 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:10:23.975528 28646 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.502s	user 0.028s	sys 0.000s
I20260709 12:10:24.027652 28805 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:24.028470 28646 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:24.028770 28809 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:24.029512 28811 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.145s	user 0.002s	sys 0.000s
I20260709 12:10:24.030884 28646 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:23.976706 28475 consensus_meta.cc:287] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.542s	user 0.015s	sys 0.004s
I20260709 12:10:24.031945 28475 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:24.033283 28607 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:24.019737 28606 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.034619 28475 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:24.035501 26545 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:24.038306 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1578) took 1437 ms. Trace:
I20260709 12:10:24.038760 26545 rpcz_store.cc:276] 0709 12:10:22.600884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.883562 (+282678us) service_pool.cc:224] Handling call
0709 12:10:22.883837 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.036025 (+1152188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.037987 (+  1962us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002f7bd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:24.038223 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2648074112}
W20260709 12:10:24.039863 28752 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.000s
I20260709 12:10:24.040293 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:23.978603 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:24.042658 28726 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:24.043227 26468 raft_consensus.cc:2368] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5.
I20260709 12:10:23.996861 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1649) took 1722 ms. Trace:
I20260709 12:10:24.044257 26622 rpcz_store.cc:276] 0709 12:10:22.273943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.575119 (+1301176us) service_pool.cc:224] Handling call
0709 12:10:23.955357 (+380238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.956152 (+   795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.996617 (+ 40465us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54003d9850. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:23.996769 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":873556224}
I20260709 12:10:23.957247 28703 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.957566 28769 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.919126 28662 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:23.950675 28804 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:24.047088 28804 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:24.048130 28804 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:24.049096 28575 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.511s	user 0.006s	sys 0.001s
I20260709 12:10:23.964005 28737 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:24.049585 28575 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:24.050361 28737 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:24.052634 28737 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:24.053143 28643 consensus_meta.cc:287] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.634s	user 0.006s	sys 0.002s
I20260709 12:10:23.967056 28616 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:23.963171 28739 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:23.958978 26614 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:24.059912 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:24.060846 26614 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 4: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:24.061796 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:23.933729 28505 consensus_queue.cc:1059] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:10:24.062641 26539 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:24.062873 28505 raft_consensus.cc:3055] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:24.063248 28505 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:24.064087 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1582) took 1418 ms. Trace:
I20260709 12:10:24.064049 28505 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:23.937583 28473 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:10:24.064533 26539 rpcz_store.cc:276] 0709 12:10:22.645679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.622097 (+976418us) service_pool.cc:224] Handling call
0709 12:10:23.622491 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.063076 (+440585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.063852 (+   776us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54003971d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:24.064027 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011822336}
I20260709 12:10:24.065677 28473 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:24.065757 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:24.066119 28473 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:24.067001 28473 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:24.068044 28575 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:24.068205 28473 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.964136 28810 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.967238 27166 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:24.069252 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:24.069528 28810 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:10:23.968351 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 61426us
I20260709 12:10:24.069999 28810 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.014498 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1657) took 1738 ms. Trace:
I20260709 12:10:24.070551 26613 rpcz_store.cc:276] 0709 12:10:22.276245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.743996 (+1467751us) service_pool.cc:224] Handling call
0709 12:10:23.926929 (+182933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.929861 (+  2932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.014288 (+ 84427us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54003d7a50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:24.014439 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419797760}
I20260709 12:10:24.016494 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:24.071285 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:24.072479 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:23.998024 28589 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:10:24.020279 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:24.020677 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:24.010223 26467 raft_consensus.cc:614] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:23.884936 28592 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:24.081637 28592 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:24.024596 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1480) took 1054 ms. Trace:
I20260709 12:10:24.082376 26541 rpcz_store.cc:276] 0709 12:10:22.969998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.930704 (+960706us) service_pool.cc:224] Handling call
0709 12:10:23.962072 (+ 31368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.004156 (+ 42084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.004186 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:24.004227 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:24.004262 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.024345 (+ 20083us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b54002369d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:24.024398 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.024534 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96170240}
I20260709 12:10:24.083846 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:24.084540 26541 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 5: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:24.085305 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:24.085806 26541 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.053620 28643 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:24.019362 28728 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:24.090741 28728 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.091071 26540 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:24.026686 28789 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:24.092106 28789 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:24.092720 28772 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:24.093031 28789 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:24.093772 28706 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:24.041709 26546 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:10:24.040355 28752 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:24.046475 28769 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.057358 28725 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:24.057927 28726 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:10:23.977945 26621 consensus_meta.cc:287] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.594s	user 0.022s	sys 0.036s
I20260709 12:10:24.022063 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:24.074201 26513 leader_election.cc:400] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 3. Current term is 4.
I20260709 12:10:24.079530 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:24.081205 28636 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:24.086861 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:24.086927 26632 tablet_copy_service.cc:140] P aaadfdd9ca9f424c91505f9b43876233: Received BeginTabletCopySession request for tablet c4646c5ce9a9467da50e9f3587b11ad5 from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:48232)
I20260709 12:10:24.088987 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:24.091146 28728 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.070082 26539 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 5: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:24.092774 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1580) took 1477 ms. Trace:
I20260709 12:10:24.105443 26540 rpcz_store.cc:276] 0709 12:10:22.614884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.890894 (+276010us) service_pool.cc:224] Handling call
0709 12:10:22.891190 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.091787 (+1200597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.092465 (+   678us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400105ed4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:24.092697 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2758951808}
W20260709 12:10:24.108796 26472 consensus_meta.cc:287] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.008s
I20260709 12:10:24.109279 26472 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:24.109994 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1451) took 1166 ms. Trace:
I20260709 12:10:24.110374 26472 rpcz_store.cc:276] 0709 12:10:22.943207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.454853 (+511646us) service_pool.cc:224] Handling call
0709 12:10:24.109913 (+655060us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:24.025877 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:24.095546 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1581) took 1456 ms. Trace:
W20260709 12:10:24.097368 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 75426.2us
I20260709 12:10:24.097496 26621 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:24.119807 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:24.121506 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:24.098479 26613 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:24.030241 28805 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:24.115375 26546 rpcz_store.cc:276] 0709 12:10:22.639303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.595985 (+956682us) service_pool.cc:224] Handling call
0709 12:10:23.664275 (+ 68290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.094695 (+430420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.095242 (+   547us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b540037e1d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:24.095474 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":867168000}
I20260709 12:10:24.124435 26545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:24.104101 26622 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 1.
I20260709 12:10:24.150290 26621 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.095734 26548 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:24.075568 28734 consensus_meta.cc:287] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.002s
I20260709 12:10:24.124197 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:24.146517 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:10:24.094882 28614 consensus_meta.cc:287] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.524s	user 0.014s	sys 0.015s
I20260709 12:10:24.100368 26513 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:24.156457 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:24.169493 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:24.171586 26542 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 4: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:24.171594 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:24.173076 26616 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:24.174420 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 74137.9us
I20260709 12:10:24.176560 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1583) took 1530 ms. Trace:
I20260709 12:10:24.177170 26548 rpcz_store.cc:276] 0709 12:10:22.646033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.662940 (+1016907us) service_pool.cc:224] Handling call
0709 12:10:23.711379 (+ 48439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.153166 (+441787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.176239 (+ 23073us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b5400140854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:24.176477 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":883479936}
I20260709 12:10:24.073264 26614 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.179306 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:24.180171 27168 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:24.180356 26546 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:24.179373 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:24.181664 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:24.182930 26539 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.096382 28725 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:24.096019 28769 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:24.183427 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 60714us
I20260709 12:10:24.201474 26613 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 4: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:24.209484 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:24.097842 28475 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:24.199285 26540 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 4: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:24.210361 26622 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.210964 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1659) took 1934 ms. Trace:
I20260709 12:10:24.211360 26615 rpcz_store.cc:276] 0709 12:10:22.276809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.760414 (+1483605us) service_pool.cc:224] Handling call
0709 12:10:23.760720 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.760928 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:23.942977 (+182049us) log.cc:844] Serialized 14 byte log entry
0709 12:10:24.210621 (+267644us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:24.210678 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:24.210718 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.210779 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.210903 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":391755,"thread_start_us":380329,"threads_started":2}
I20260709 12:10:24.212423 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:24.183756 26621 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:24.198982 26470 raft_consensus.cc:2410] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:24.206552 26541 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:24.123450 28663 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.094383 28643 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:24.151747 28646 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:24.124677 28575 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:24.092113 28662 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.157425 28772 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:24.096764 28752 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:24.215911 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 315230us
I20260709 12:10:24.103696 28703 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:24.218688 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:24.221287 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 45692us
I20260709 12:10:24.305521 26621 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.076433 28768 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:24.218036 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:24.225216 28646 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:24.123724 28607 consensus_queue.cc:1059] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 12:10:24.227841 28773 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:24.218549 28527 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.230201 28725 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:24.096797 28726 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:24.231390 28606 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:24.224583 28708 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:24.168802 26632 tablet_copy_service.cc:161] P aaadfdd9ca9f424c91505f9b43876233: Beginning new tablet copy session on tablet c4646c5ce9a9467da50e9f3587b11ad5 from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:48232: session id = 3262bf0553e543eea76794fc529a9acc-c4646c5ce9a9467da50e9f3587b11ad5
I20260709 12:10:24.216812 28475 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:24.242470 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:24.369458 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 409952us
I20260709 12:10:24.370258 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:24.247417 28757 consensus_meta.cc:287] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.001s
I20260709 12:10:24.249217 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:24.381814 26615 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.198691 28805 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:24.207463 28658 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:24.388950 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2363) took 2084 ms. Trace:
I20260709 12:10:24.393393 26613 rpcz_store.cc:276] 0709 12:10:22.304743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.387832 (+2083089us) service_pool.cc:224] Handling call
0709 12:10:24.388226 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.388491 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.388530 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:24.388587 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:24.388628 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.388701 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.388871 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:24.395716 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2366) took 2059 ms. Trace:
I20260709 12:10:24.396188 26613 rpcz_store.cc:276] 0709 12:10:22.336034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.394645 (+2058611us) service_pool.cc:224] Handling call
0709 12:10:24.395050 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.395282 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.395319 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:24.395377 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:24.395420 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.395491 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.395644 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:24.182317 28734 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.311159 28703 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:24.291658 26622 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:24.301204 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:24.304190 26614 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:24.307698 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:24.314525 26621 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:24.319788 26545 raft_consensus.cc:606] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:24.420977 26545 raft_consensus.cc:614] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:24.301522 28785 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.008s
W20260709 12:10:24.342759 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 127627us
I20260709 12:10:24.387933 28805 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:10:24.302188 28632 consensus_meta.cc:287] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.575s	user 0.005s	sys 0.005s
I20260709 12:10:24.297350 28772 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:24.364149 26465 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:24.262179 28810 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:24.376734 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.402858 28662 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:10:24.381649 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 390862us
W20260709 12:10:24.432173 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 262788us
I20260709 12:10:24.432633 26439 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:24.433367 26588 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:24.259650 28767 consensus_meta.cc:287] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.515s	user 0.018s	sys 0.001s
I20260709 12:10:24.359220 28752 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:24.404832 28658 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:24.360682 28527 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:24.336042 28707 consensus_queue.cc:1059] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:10:24.399958 26619 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 4: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:24.372519 28475 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:24.415944 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 114826us
W20260709 12:10:24.440878 26617 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.008s	sys 0.009s
W20260709 12:10:24.423528 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 115929us
I20260709 12:10:24.348058 26616 raft_consensus.cc:2410] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:24.429167 26613 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:24.391371 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.433898 26439 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:24.437657 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 242) took 2024 ms. Trace:
I20260709 12:10:24.418995 26615 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
W20260709 12:10:24.487444 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:24.489715 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.487231 26622 rpcz_store.cc:276] 0709 12:10:22.412921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.413505 (+2000584us) service_pool.cc:224] Handling call
0709 12:10:24.437121 (+ 23616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.437314 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.437344 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:24.437392 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:24.437426 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.437478 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.437596 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:24.358505 26539 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:24.429232 28805 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.494258 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2375) took 1761 ms. Trace:
I20260709 12:10:24.490324 26514 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:24.496904 26622 rpcz_store.cc:276] 0709 12:10:22.732911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.493093 (+1760182us) service_pool.cc:224] Handling call
0709 12:10:24.493530 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.493798 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.493838 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:24.493902 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:24.493952 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.494026 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.494177 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:24.498122 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:24.426307 28643 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:24.424202 28814 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:24.483760 26473 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
W20260709 12:10:24.509547 26617 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.009s	sys 0.009s
I20260709 12:10:24.436064 28662 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.437716 28734 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:24.530957 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 239) took 2880 ms. Trace:
W20260709 12:10:24.477317 28720 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.000s	sys 0.023s
I20260709 12:10:24.439193 28706 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:24.532985 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 99190us
I20260709 12:10:24.533617 28706 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:24.534243 28706 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.536706 28820 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.537384 28820 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:24.537806 28820 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.540133 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:24.540133 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:24.542063 27168 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.549165 28706 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:24.549841 27168 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:24.550424 26622 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:24.531996 26620 rpcz_store.cc:276] 0709 12:10:21.641226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.641388 (+   162us) service_pool.cc:224] Handling call
0709 12:10:21.660705 (+ 19317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:21.671515 (+ 10810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.671547 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:21.679912 (+  8365us) log.cc:844] Serialized 26 byte log entry
0709 12:10:23.436869 (+1756957us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b18002e2f40. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:10:23.991643 (+554774us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:24.439530 (+447887us) log.cc:844] Serialized 14 byte log entry
0709 12:10:24.443828 (+  4298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.443906 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:24.443948 (+    42us) raft_consensus.cc:1685] finished
0709 12:10:24.521135 (+ 77187us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.521740 (+   605us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23627,"prepare.queue_time_us":259062,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":15206,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":28384,"spinlock_wait_cycles":4159872,"thread_start_us":869179,"threads_started":2,"wal-append.queue_time_us":2548561}
I20260709 12:10:24.439787 28527 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:24.559764 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 65620us
I20260709 12:10:24.429859 28785 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:24.505867 28644 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.593906 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1661) took 2316 ms. Trace:
I20260709 12:10:24.598896 26618 rpcz_store.cc:276] 0709 12:10:22.277423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.911470 (+1634047us) service_pool.cc:224] Handling call
0709 12:10:23.944132 (+ 32662us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.944359 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:24.440048 (+495689us) log.cc:844] Serialized 14 byte log entry
0709 12:10:24.593494 (+153446us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:24.593554 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:24.593606 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.593680 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.593822 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":273886,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"thread_start_us":613975,"threads_started":2}
I20260709 12:10:24.436834 28632 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:24.437939 28767 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:24.522846 28803 raft_consensus.cc:2764] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
W20260709 12:10:24.597289 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 111380us
I20260709 12:10:24.617465 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:24.606714 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 234911us
I20260709 12:10:24.529834 28636 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:24.623917 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 176739us
I20260709 12:10:24.625044 26546 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:24.599977 28806 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:10:24.585172 28734 raft_consensus.cc:697] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:24.636191 26544 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:24.529564 28603 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 12:10:24.529162 28643 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:24.641218 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:24.647682 28707 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:24.688397 26616 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:24.696241 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:24.690007 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2428) took 2319 ms. Trace:
W20260709 12:10:24.625535 28747 consensus_meta.cc:287] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.880s	user 0.010s	sys 0.011s
I20260709 12:10:24.692099 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1664) took 2319 ms. Trace:
I20260709 12:10:24.698236 26465 rpcz_store.cc:276] 0709 12:10:22.371092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.685247 (+1314155us) service_pool.cc:224] Handling call
0709 12:10:23.913520 (+228273us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b5800011198. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:10:23.913767 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.434893 (+521126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.689801 (+254908us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54000dcfd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:24.689952 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1494761600}
I20260709 12:10:24.698697 26613 rpcz_store.cc:276] 0709 12:10:22.372564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.397338 (+2024774us) service_pool.cc:224] Handling call
0709 12:10:24.428841 (+ 31503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.486582 (+ 57741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.691856 (+205274us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b5400346050. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:24.692031 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71508736}
W20260709 12:10:24.699996 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 58860.9us
I20260709 12:10:24.621769 28636 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:24.704386 26514 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:24.705221 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:24.709210 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 68418.1us
I20260709 12:10:24.710878 26618 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:24.685730 28752 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:24.613854 28473 consensus_queue.cc:1059] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 12:10:24.688858 28768 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:24.731001 26439 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:24.592562 28772 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:24.689254 28646 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:24.733207 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2371) took 2030 ms. Trace:
I20260709 12:10:24.737083 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:10:24.814489 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 83607us
I20260709 12:10:24.696291 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 245) took 2282 ms. Trace:
W20260709 12:10:24.819324 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 66912.7us
I20260709 12:10:24.761677 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1658) took 2485 ms. Trace:
I20260709 12:10:24.824215 26617 rpcz_store.cc:276] 0709 12:10:22.276519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.759870 (+1483351us) service_pool.cc:224] Handling call
0709 12:10:23.760212 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.760432 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:24.517925 (+757493us) log.cc:844] Serialized 14 byte log entry
0709 12:10:24.761139 (+243214us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:24.761221 (+    82us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:24.761289 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.761403 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.761590 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104159,"prepare.queue_time_us":240672,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"thread_start_us":999798,"threads_started":3}
I20260709 12:10:24.738888 26616 rpcz_store.cc:276] 0709 12:10:22.703145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.491044 (+1787899us) service_pool.cc:224] Handling call
0709 12:10:24.688197 (+197153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.695320 (+  7123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.732959 (+ 37639us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b540003cd50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:24.733128 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452615936}
I20260709 12:10:24.827559 26617 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:24.828016 26616 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:24.828747 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1669) took 1926 ms. Trace:
I20260709 12:10:24.825778 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:24.829260 26616 rpcz_store.cc:276] 0709 12:10:22.902176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.827334 (+1925158us) service_pool.cc:224] Handling call
0709 12:10:24.827790 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.828473 (+   683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.828681 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:24.706961 28726 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:24.704389 28636 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:24.834213 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:24.635728 28658 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:24.706430 28606 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:24.733604 28815 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 12:10:24.708773 28708 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:24.835450 26616 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:24.730046 28670 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.117s
W20260709 12:10:24.845098 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.847600 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:24.841609 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1668) took 1939 ms. Trace:
I20260709 12:10:24.820926 28768 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:24.855055 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1670) took 1952 ms. Trace:
I20260709 12:10:24.808058 28837 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:24.857301 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:24.704493 28747 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:24.856273 26617 rpcz_store.cc:276] 0709 12:10:22.901668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.827019 (+1925351us) service_pool.cc:224] Handling call
0709 12:10:24.827374 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.835513 (+  8139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.841226 (+  5713us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:24.856098 26616 rpcz_store.cc:276] 0709 12:10:22.902558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.830208 (+1927650us) service_pool.cc:224] Handling call
0709 12:10:24.830525 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.854547 (+ 24022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.854939 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:24.860005 26617 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:10:24.858379 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:24.860616 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 248) took 1915 ms. Trace:
I20260709 12:10:24.861240 26616 rpcz_store.cc:276] 0709 12:10:22.944809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.859607 (+1914798us) service_pool.cc:224] Handling call
0709 12:10:24.860092 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.860283 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.860308 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:24.860347 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:24.860378 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.860424 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.860542 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:24.863729 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1678) took 1765 ms. Trace:
I20260709 12:10:24.864252 26616 rpcz_store.cc:276] 0709 12:10:23.098014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.862583 (+1764569us) service_pool.cc:224] Handling call
0709 12:10:24.863007 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.863269 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.863309 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:24.863367 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:24.863415 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.863493 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.863647 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:24.865592 26616 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:24.866796 28854 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:24.867064 28837 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:24.867493 28854 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:24.868625 28854 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:24.868772 28752 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:24.870898 28825 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
W20260709 12:10:24.871309 28828 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
W20260709 12:10:24.873047 28817 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.343s	user 0.001s	sys 0.000s
I20260709 12:10:24.867283 28845 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:24.814136 28851 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 12:10:24.847716 28703 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:24.874117 28845 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:24.875003 28851 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:24.875465 28851 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:24.875248 28845 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:24.876444 28851 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:24.877849 28851 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:24.839485 28827 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:10:24.879547 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1673) took 1976 ms. Trace:
I20260709 12:10:24.808475 28822 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 12:10:24.882017 26617 rpcz_store.cc:276] 0709 12:10:22.903496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.859412 (+1955916us) service_pool.cc:224] Handling call
0709 12:10:24.859770 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.860417 (+   647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.879486 (+ 19069us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:24.839375 28505 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:24.844769 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 107813us
I20260709 12:10:24.816507 28757 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:10:24.883385 26617 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:24.894526 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 374862us
I20260709 12:10:24.883759 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1679) took 1778 ms. Trace:
I20260709 12:10:24.901222 26621 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:24.826889 28741 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:10:24.911739 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:24.912451 27166 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.913070 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:24.905511 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:24.908212 28747 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:24.909466 28822 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:24.910717 28646 consensus_queue.cc:1059] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:24.911083 28643 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:24.913239 28741 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:24.823796 26614 rpcz_store.cc:276] 0709 12:10:22.413417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.440864 (+2027447us) service_pool.cc:224] Handling call
0709 12:10:24.581319 (+140455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.600434 (+ 19115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.606103 (+  5669us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:24.616185 (+ 10082us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:24.627335 (+ 11150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.635589 (+  8254us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.692835 (+ 57246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:24.920221 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1680) took 1752 ms. Trace:
I20260709 12:10:24.839851 28847 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
I20260709 12:10:24.901278 26616 rpcz_store.cc:276] 0709 12:10:23.105747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.865128 (+1759381us) service_pool.cc:224] Handling call
0709 12:10:24.865411 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.865966 (+   555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.883687 (+ 17721us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:24.879173 28810 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:24.879807 28606 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:24.914265 28769 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.692s	user 0.007s	sys 0.000s
I20260709 12:10:24.937631 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2370) took 2238 ms. Trace:
I20260709 12:10:24.931388 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:24.943523 26617 rpcz_store.cc:276] 0709 12:10:23.167842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.882912 (+1715070us) service_pool.cc:224] Handling call
0709 12:10:24.883214 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.902067 (+ 18853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.920112 (+ 18045us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:24.905570 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:24.898702 28837 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:24.903645 28670 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:24.944273 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 422484us
I20260709 12:10:24.848070 28734 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:24.950878 26548 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.951436 26539 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:24.927037 28822 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:10:24.957564 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 139216us
I20260709 12:10:24.954953 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:24.945614 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 324967us
I20260709 12:10:24.938195 28741 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:24.955502 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:24.953233 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:24.944267 28757 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:25.089023 26542 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:25.066668 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2380) took 2168 ms. Trace:
I20260709 12:10:25.054134 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1605) took 1092 ms. Trace:
W20260709 12:10:25.054077 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 434682us
I20260709 12:10:24.949254 26615 rpcz_store.cc:276] 0709 12:10:22.699354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.487999 (+1788645us) service_pool.cc:224] Handling call
0709 12:10:24.488379 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.488782 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.488820 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:24.489361 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 12:10:24.683022 (+193661us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:24.683103 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.683263 (+   160us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:24.937370 (+254107us) raft_consensus.cc:1685] finished
0709 12:10:24.937394 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.937562 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2104,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"thread_start_us":193049,"threads_started":1,"wal-append.queue_time_us":446197}
I20260709 12:10:25.094602 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2378) took 2210 ms. Trace:
W20260709 12:10:25.086467 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 253300us
W20260709 12:10:25.095420 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 140156us
I20260709 12:10:25.096005 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:25.087323 26617 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:25.045969 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:25.097086 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:25.095028 26622 rpcz_store.cc:276] 0709 12:10:22.884269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.508997 (+1624728us) service_pool.cc:224] Handling call
0709 12:10:24.509328 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.550850 (+ 41522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.094276 (+543426us) spinlock_profiling.cc:243] Waited 40.9 ms on lock 0x7b5400268254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:25.094527 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94008704}
I20260709 12:10:25.100898 26622 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:25.101753 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 251) took 1720 ms. Trace:
I20260709 12:10:25.102892 26622 rpcz_store.cc:276] 0709 12:10:23.381156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.100200 (+1719044us) service_pool.cc:224] Handling call
0709 12:10:25.100636 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.101433 (+   797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.101680 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.092237 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:25.106320 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:25.106163 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1682) took 1781 ms. Trace:
I20260709 12:10:25.089469 26616 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:25.024128 28707 raft_consensus.cc:697] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:25.113600 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:25.090162 28767 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:25.090719 26613 rpcz_store.cc:276] 0709 12:10:22.897918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.700175 (+1802257us) service_pool.cc:224] Handling call
0709 12:10:24.701916 (+  1741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.702147 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:24.733343 (+ 31196us) log.cc:844] Serialized 14 byte log entry
0709 12:10:25.066150 (+332807us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.066312 (+   162us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:25.066370 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.066462 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.066603 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2817,"prepare.queue_time_us":32056,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":7688,"raft.queue_time_us":98,"raft.run_cpu_time_us":561,"raft.run_wall_time_us":5417,"thread_start_us":332369,"threads_started":1}
I20260709 12:10:25.105527 27133 leader_election.cc:400] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5.
I20260709 12:10:25.111730 26438 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:25.111130 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1685) took 1732 ms. Trace:
I20260709 12:10:25.091517 28853 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.091691 26541 rpcz_store.cc:276] 0709 12:10:23.961275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.214095 (+252820us) service_pool.cc:224] Handling call
0709 12:10:24.246750 (+ 32655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.246987 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:24.485955 (+238968us) log.cc:844] Serialized 14 byte log entry
0709 12:10:25.053664 (+567709us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.053745 (+    81us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:25.053819 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.053915 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.054055 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48270,"prepare.queue_time_us":490812,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":199483,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":11842,"thread_start_us":746892,"threads_started":3,"wal-append.queue_time_us":320920}
I20260709 12:10:25.118598 26615 rpcz_store.cc:276] 0709 12:10:23.376570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.093595 (+1717025us) service_pool.cc:224] Handling call
0709 12:10:25.106607 (+ 13012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.108330 (+  1723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.108357 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.108402 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:25.108433 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.108495 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.108626 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96128}
I20260709 12:10:25.121714 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:25.124068 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1666) took 2223 ms. Trace:
I20260709 12:10:25.090647 28757 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:25.110971 26617 rpcz_store.cc:276] 0709 12:10:23.324689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.951041 (+1626352us) service_pool.cc:224] Handling call
0709 12:10:25.087071 (+136030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.105901 (+ 18830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.106105 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.108026 28810 raft_consensus.cc:2764] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:25.117725 27133 leader_election.cc:403] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:25.110127 28861 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:25.111534 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2381) took 1750 ms. Trace:
I20260709 12:10:25.228329 26616 rpcz_store.cc:276] 0709 12:10:23.360925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.088752 (+1727827us) service_pool.cc:224] Handling call
0709 12:10:25.089047 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.111290 (+ 22243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.111478 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.114981 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:25.121722 28820 consensus_meta.cc:287] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.581s	user 0.011s	sys 0.007s
I20260709 12:10:25.126907 28853 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:25.122073 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:25.121703 28837 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:25.374893 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 259971us
I20260709 12:10:25.213114 28767 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.121274 28835 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
W20260709 12:10:25.205483 28805 consensus_meta.cc:287] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.710s	user 0.008s	sys 0.004s
I20260709 12:10:25.116982 28768 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:25.106844 28670 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:10:25.206524 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:25.206924 28607 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:25.207391 28850 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:10:25.138914 28858 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:25.202347 28707 consensus_queue.cc:237] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:25.207468 26615 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 12:10:25.327589 28728 consensus_meta.cc:287] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.170s	user 0.013s	sys 0.000s
I20260709 12:10:25.142900 28741 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:25.111930 26614 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:25.115751 28603 raft_consensus.cc:2764] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:25.230185 27166 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
W20260709 12:10:25.332266 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 226838us
W20260709 12:10:25.370369 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 258751us
I20260709 12:10:24.957360 28769 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:25.375789 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:25.419358 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 43644.8us
I20260709 12:10:25.420471 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:25.116595 28646 consensus_queue.cc:1059] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 12:10:25.326498 28863 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
W20260709 12:10:25.381714 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 175293us
W20260709 12:10:25.371236 28866 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 0.279s	user 0.002s	sys 0.000s
W20260709 12:10:25.387657 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 265648us
I20260709 12:10:25.116204 28747 raft_consensus.cc:2764] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:25.220335 28589 raft_consensus.cc:3055] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:25.381886 26632 tablet_copy_source_session.cc:215] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:25.382437 28708 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.423748 28703 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.427706 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:25.433853 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:25.394989 28592 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.471127 27164 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:25.417877 28726 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:25.443758 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:25.445483 26588 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:25.397476 28606 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 12:10:25.447997 28725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.054s	sys 0.075s
I20260709 12:10:25.469178 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:25.484359 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:25.426731 28861 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:25.478325 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44625us
I20260709 12:10:25.389359 28805 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:25.427277 28868 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.411613 28858 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:25.486480 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:25.490303 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:25.444820 28737 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:25.492110 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:25.383102 28820 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:25.494588 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:25.441756 28589 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:25.422009 28728 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:25.502379 27167 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 3: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:25.506991 26615 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:25.439330 28871 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:25.485246 28725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.055s	sys 0.076s
I20260709 12:10:25.477783 28747 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.479713 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:25.491364 28670 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.485041 28603 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:25.489076 28646 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.525321 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:25.493186 28708 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.495436 28767 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:10:25.497222 28859 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.543596 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:25.546069 26547 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 3: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:25.482144 28607 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:10:25.518096 28703 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:25.518265 28643 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.502157 28737 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:25.483873 28726 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:25.556742 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:25.480598 28768 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:25.567478 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:25.563352 28873 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:10:25.574687 28869 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:10:25.575054 28820 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:25.597075 28870 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:10:25.597499 28820 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:25.598027 28820 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:25.599128 28820 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:25.600786 28820 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.562490 28603 raft_consensus.cc:697] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:10:25.578356 28857 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 12:10:25.583582 28527 consensus_meta.cc:287] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.988s	user 0.012s	sys 0.005s
I20260709 12:10:25.564771 28861 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:10:25.579257 28860 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.580101 28807 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5.
I20260709 12:10:25.514750 28868 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:25.564519 28589 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:25.581885 28851 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.004s
I20260709 12:10:25.576758 28703 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:10:25.595351 28475 consensus_meta.cc:287] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.082s	user 0.011s	sys 0.003s
W20260709 12:10:25.593825 28662 consensus_meta.cc:287] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.008s	user 0.010s	sys 0.006s
I20260709 12:10:25.616930 28726 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:25.619375 28603 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:25.621779 28752 raft_consensus.cc:3055] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:25.596591 28708 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:25.625433 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:25.604315 28767 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:25.586856 28643 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:25.609760 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:25.627005 26632 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:48232 (request call id 255) took 1525 ms. Trace:
W20260709 12:10:25.633219 26548 consensus_meta.cc:287] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.000s
I20260709 12:10:25.658118 27133 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:25.676102 28726 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.676770 28726 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:25.631479 28703 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:25.680652 28636 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.828s	user 0.011s	sys 0.000s
I20260709 12:10:25.681977 28728 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:25.636226 28662 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:25.683455 28864 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 12:10:25.684774 27166 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:25.571823 28859 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:25.670751 26548 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:25.697423 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:25.682888 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:25.613704 28527 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:25.667465 26545 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:25.638646 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:25.667493 28853 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:25.687687 28662 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:25.688454 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2379) took 2803 ms. Trace:
I20260709 12:10:25.714831 26619 rpcz_store.cc:276] 0709 12:10:22.884658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.697349 (+1812691us) service_pool.cc:224] Handling call
0709 12:10:24.697697 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.698198 (+   501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.698231 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:24.705254 (+  7023us) log.cc:844] Serialized 26 byte log entry
0709 12:10:25.012062 (+306808us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:25.012128 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.012234 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:25.688165 (+675931us) raft_consensus.cc:1685] finished
0709 12:10:25.688194 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.688367 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":150381,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":29565,"thread_start_us":197901,"threads_started":1,"wal-append.queue_time_us":636470}
I20260709 12:10:25.669466 28767 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:25.635684 28752 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:25.663467 28860 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.662644 28589 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:25.702426 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 63850.8us
I20260709 12:10:25.636165 28475 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:25.630935 28737 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:25.663956 28769 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:25.668177 28708 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:25.724740 28876 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.726475 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1597) took 1766 ms. Trace:
I20260709 12:10:25.696483 28865 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:25.681241 28636 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:25.669697 26632 rpcz_store.cc:276] 0709 12:10:24.086132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.086670 (+   538us) service_pool.cc:224] Handling call
0709 12:10:25.609558 (+1522888us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.747849 26542 rpcz_store.cc:276] 0709 12:10:23.959966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.172222 (+212256us) service_pool.cc:224] Handling call
0709 12:10:24.212056 (+ 39834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.090454 (+878398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.726146 (+635692us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b5400104fd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:25.726364 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2016417664}
I20260709 12:10:25.724399 28803 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:25.721519 28852 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.736582 28662 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.736246 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:25.602730 28873 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:25.757956 28752 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:25.824548 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:25.792662 26473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1453) took 2839 ms (client timeout 1856 ms). Trace:
W20260709 12:10:25.831123 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:25.831920 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 95794us
I20260709 12:10:25.749603 28737 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:25.832778 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:10:25.741686 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 44384.4us
I20260709 12:10:25.838280 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:25.831063 26473 rpcz_store.cc:269] 0709 12:10:22.953565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.431178 (+477613us) service_pool.cc:224] Handling call
0709 12:10:25.792486 (+2361308us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b5400069ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:25.792596 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1962368256}
I20260709 12:10:25.791224 28636 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:25.845907 28872 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 12:10:25.791513 28868 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:25.757907 28803 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:25.764333 28860 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.835354 28820 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.754868 28859 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:25.794656 27161 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:25.603016 28858 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:25.865844 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:25.747325 28708 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:25.856211 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 369816us
W20260709 12:10:25.852646 28505 consensus_meta.cc:287] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.942s	user 0.013s	sys 0.001s
I20260709 12:10:25.879328 26587 leader_election.cc:400] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 3. Current term is 4.
I20260709 12:10:25.766345 28726 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:25.873051 28868 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.902756 28868 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:25.753207 28865 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:25.797080 28769 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:25.909862 28803 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:25.910964 28873 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:25.883273 28860 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.855378 28752 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.874377 28861 raft_consensus.cc:2764] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:25.873888 28636 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:25.879204 28527 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:25.918165 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 447177us
I20260709 12:10:25.872926 28820 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:25.795089 28767 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:25.926911 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 66980.6us
I20260709 12:10:25.913079 28643 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:25.885299 28871 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:25.933408 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:25.884784 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:25.939538 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 54851.1us
I20260709 12:10:25.940555 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:25.943197 28505 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:25.950232 28505 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:25.950862 28820 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:25.922698 28636 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:25.913698 28769 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:25.894915 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:25.951373 28505 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:25.937475 28803 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:26.026441 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 92222us
I20260709 12:10:25.990969 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:26.000495 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:26.028406 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 83095.6us
W20260709 12:10:26.031528 26439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.008s	sys 0.010s
I20260709 12:10:25.989789 26616 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 12:10:25.956858 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 62056.4us
W20260709 12:10:26.032526 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 99258.9us
I20260709 12:10:26.064173 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:26.065239 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:26.067538 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:25.943172 28873 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.990789 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:26.072589 26619 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 5: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:26.030819 28616 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:10:25.956442 28636 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.003049 28772 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:26.035174 26439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.008s	sys 0.010s
I20260709 12:10:26.030963 28879 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:10:26.059679 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:25.987671 28861 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.959975 28860 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.992358 28805 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:26.036301 26512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.009s	sys 0.034s
I20260709 12:10:25.969887 28865 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:25.996592 28703 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:25.969640 28747 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.995318 28868 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:26.085901 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:26.066367 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:26.051784 28878 raft_consensus.cc:2764] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:10:26.049971 28871 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:26.107586 26619 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:25.987330 28822 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:26.110146 28822 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:26.093364 26512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.012s	sys 0.034s
I20260709 12:10:26.094182 28876 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:26.114228 28876 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:26.115278 28876 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:26.094831 28861 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:26.070919 28882 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:26.088158 28810 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:26.111076 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.111726 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:25.991243 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:26.121201 28882 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:26.122227 28810 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:26.107859 28860 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:25.130257 26618 rpcz_store.cc:276] 0709 12:10:22.900465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.818820 (+1918355us) service_pool.cc:224] Handling call
0709 12:10:24.840270 (+ 21450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.840510 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:24.882867 (+ 42357us) log.cc:844] Serialized 14 byte log entry
0709 12:10:25.123480 (+240613us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.123560 (+    80us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:25.123666 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.123789 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.123981 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":42545,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":2082,"thread_start_us":239840,"threads_started":1}
I20260709 12:10:26.144522 28885 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:26.145128 28885 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:26.145346 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:26.146119 26618 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:26.147114 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:26.147698 26618 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:26.148510 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:26.123100 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:26.150174 26620 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
W20260709 12:10:26.127326 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 61075us
I20260709 12:10:26.124281 26439 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:26.124984 28883 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:26.125525 28805 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.145573 28885 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.130923 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:26.117800 28703 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:26.126989 28616 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:26.128770 28752 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.128609 28589 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:26.165052 26543 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:26.165020 26544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 1475) took 3201 ms (client timeout 1660 ms). Trace:
I20260709 12:10:26.165627 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:26.141479 28747 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:26.169891 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:26.168213 26544 rpcz_store.cc:269] 0709 12:10:22.963770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.368161 (+404391us) service_pool.cc:224] Handling call
0709 12:10:26.164710 (+2796549us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540018bad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:26.164926 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2913309440}
I20260709 12:10:26.156893 28706 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:26.166682 28873 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.164552 28663 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:10:26.175107 28882 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:26.173434 28798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4646c5ce9a9467da50e9f3587b11ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:26.182384 28773 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:26.199291 26617 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.008s	sys 0.026s
I20260709 12:10:26.179097 28708 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:26.168697 28752 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:26.199815 26617 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.008s	sys 0.026s
I20260709 12:10:26.169456 28860 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.166440 28805 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:26.178315 28769 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:26.169433 28589 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:26.168735 28616 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:26.166850 28859 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
W20260709 12:10:26.199906 28607 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.018s	sys 0.026s
I20260709 12:10:26.216017 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:26.189040 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:26.224713 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:26.229205 26439 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:26.219970 28607 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.019s	sys 0.026s
I20260709 12:10:26.232342 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:26.168627 28883 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:26.216939 28708 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:10:26.248344 26514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.012s	sys 0.040s
W20260709 12:10:26.248804 26514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.012s	sys 0.040s
I20260709 12:10:26.274534 28706 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:26.275328 28706 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:26.276085 28607 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:26.277089 28888 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:26.277676 28888 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.277240 28607 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.278200 28888 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.278782 28607 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.279438 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:26.281754 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:26.283741 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:26.284492 26548 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:26.283797 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:26.285449 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.285632 26542 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:26.283826 26544 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:26.281767 28703 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.296806 28607 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:26.302178 28607 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:26.304487 28703 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:26.276268 28706 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:26.312338 26618 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:26.377458 28892 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:10:26.318352 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:26.323266 26544 raft_consensus.cc:2410] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:10:26.228820 28473 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.225805 28861 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:26.230165 28860 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:26.333988 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:26.243427 28707 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.004s	sys 0.025s
W20260709 12:10:26.340807 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.342760 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:26.440809 28707 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.004s	sys 0.025s
I20260709 12:10:26.344732 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:26.441448 26539 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 3: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:26.346065 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:26.442704 26619 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 2.
I20260709 12:10:26.349442 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:26.350792 26540 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 12:10:26.351698 26546 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:26.211887 28810 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:26.374961 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 147854us
I20260709 12:10:26.375391 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:26.453826 27164 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.382138 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:26.348657 28814 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.332086 28820 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:10:26.275599 28708 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:26.423794 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:26.425485 28589 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:26.425941 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:26.463753 28902 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:10:26.427171 28616 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:26.475282 28805 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:26.428611 28907 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:10:26.428789 28632 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:26.430696 27160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 316) took 1016 ms. Trace:
I20260709 12:10:26.431571 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:26.370422 28883 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:26.467258 26544 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.476891 27160 rpcz_store.cc:276] 0709 12:10:25.414646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.417384 (+  2738us) service_pool.cc:224] Handling call
0709 12:10:25.417799 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.418067 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:25.937673 (+519606us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.384723 (+447050us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:26.388079 (+  3356us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:26.392836 (+  4757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.430444 (+ 37608us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.430620 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":911335,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":81517,"thread_start_us":919007,"threads_started":2,"wal-append.queue_time_us":483156}
I20260709 12:10:26.421077 28835 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.503404 28814 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:26.503654 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.507247 28752 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:26.509198 28757 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:26.510515 28814 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:26.513590 28475 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:26.466157 28860 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:10:26.521196 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 448128us
I20260709 12:10:26.492668 26548 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:26.556154 26539 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:26.560086 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:26.567250 27164 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:26.571111 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:26.572093 26465 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:26.572571 26472 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:26.575047 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:26.626461 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:26.665192 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 509228us
W20260709 12:10:26.673724 28885 consensus_meta.cc:287] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.006s
I20260709 12:10:26.674284 28885 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:26.679132 28885 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:26.678966 26470 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:26.678912 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:26.551739 28757 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:26.690610 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 385286us
I20260709 12:10:26.692698 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1686) took 3311 ms. Trace:
I20260709 12:10:26.693394 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:26.636266 28876 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:26.695415 28909 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.696473 28909 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:26.710964 28785 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:26.712682 27161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 320) took 1272 ms. Trace:
I20260709 12:10:26.713145 28475 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:26.713497 28575 raft_consensus.cc:3055] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:26.713755 28475 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:26.713994 28575 raft_consensus.cc:740] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:26.720861 26618 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:26.714413 28475 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.714241 28853 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:26.744423 26619 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:26.746089 26544 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
W20260709 12:10:26.746536 26547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1592) took 2788 ms (client timeout 1725 ms). Trace:
W20260709 12:10:26.747129 26547 rpcz_store.cc:269] 0709 12:10:23.958350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.025513 (+ 67163us) service_pool.cc:224] Handling call
0709 12:10:26.746190 (+2720677us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b540018bfd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:26.746432 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3295973120}
I20260709 12:10:26.752144 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:26.759647 28888 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:26.760491 28908 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:10:26.760694 28575 consensus_queue.cc:260] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:26.762007 28900 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:10:26.713217 27161 rpcz_store.cc:276] 0709 12:10:25.440491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.441785 (+  1294us) service_pool.cc:224] Handling call
0709 12:10:25.513221 (+ 71436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.880984 (+367763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.712312 (+831328us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b540056bb54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:26.712585 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":577292032}
I20260709 12:10:26.763747 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:26.765033 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:26.766917 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:26.767658 26614 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:26.761958 28575 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:26.689477 26438 connection.cc:256] RPC call timeout handler was delayed by -1.4916831860000457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
I20260709 12:10:26.766292 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:26.768085 28888 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:26.753998 28772 consensus_meta.cc:287] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.661s	user 0.011s	sys 0.002s
I20260709 12:10:26.816988 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:26.822456 28473 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.818060 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:26.826587 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:26.818384 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:26.818815 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:26.811324 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:26.819865 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:26.829583 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:26.829653 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:26.832294 26542 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:26.833871 26464 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:26.834370 26466 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:26.835038 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:26.835453 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:26.835743 26464 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.830317 26472 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:26.836727 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:26.837458 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:26.838373 26472 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 3: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:26.836712 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:26.839318 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:26.840651 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:26.841835 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:26.842955 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:26.843710 26618 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:10:26.844050 26438 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.725s (SENT) [suppressed 14 similar messages]
I20260709 12:10:26.845374 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:26.844126 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:26.844843 26618 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:26.847555 26618 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:26.847740 26472 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:26.844811 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:26.848575 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:26.850355 26466 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:26.851517 26466 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:26.851826 26466 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:26.852425 26472 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:26.748812 28726 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 12:10:26.862290 26464 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:26.852836 26466 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:26.854743 26514 connection.cc:256] RPC call timeout handler was delayed by -1.1976312580000013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
I20260709 12:10:26.864292 26464 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:10:26.855163 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 461222us
I20260709 12:10:26.864411 26466 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.855919 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:26.865984 26464 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:26.870142 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:26.871901 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:26.872854 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.874269 27167 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:26.833709 28822 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:26.879614 27132 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.023s	sys 0.007s
I20260709 12:10:26.883414 26465 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:26.849985 28879 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:26.859767 28785 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.891393 26466 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:10:26.892084 26466 pending_rounds.cc:85] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 4
I20260709 12:10:26.825068 28473 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:26.892498 26466 pending_rounds.cc:107] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:10:26.892904 26466 raft_consensus.cc:2889] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:26.867560 28636 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.775s	user 0.011s	sys 0.001s
I20260709 12:10:26.891302 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:26.890077 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:26.899634 27134 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:26.724670 28860 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:26.866647 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:26.850160 28862 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 12:10:26.913012 26436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.094s	sys 0.179s
W20260709 12:10:26.920070 26436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.094s	sys 0.179s
I20260709 12:10:26.868933 28772 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:10:26.899024 28879 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:26.898589 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:10:26.931002 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.930615 26467 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
W20260709 12:10:26.942967 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 78535.3us
I20260709 12:10:26.893000 28822 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:26.943514 26514 connection.cc:256] RPC call timeout handler was delayed by -1.0180723460000536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
W20260709 12:10:26.944756 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 249349us
I20260709 12:10:26.946862 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:26.947103 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:26.905889 28785 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:26.904466 28636 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:26.952932 26544 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:26.954627 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:26.955026 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:26.954708 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:26.956159 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:26.956779 26541 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:26.956830 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:26.957733 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:26.957948 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:26.920531 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:26.933528 28879 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.959136 26548 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:26.959353 26541 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:26.936936 28868 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.985126 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:26.942658 28772 consensus_queue.cc:1243] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:26.937054 28821 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:26.990221 27162 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:26.960439 28901 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:27.003852 28901 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:26.955332 28726 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.999953 28821 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:26.995399 28868 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:27.014652 28862 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:27.031262 28821 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:27.041920 28913 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.081s	user 0.001s	sys 0.001s
I20260709 12:10:27.043591 28909 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:27.047124 28901 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:27.044342 28862 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:27.048607 28901 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.048727 28879 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:27.048480 28873 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:27.050230 28873 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:27.047747 28868 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:27.051188 28873 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.052501 28873 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.052793 28879 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:27.054663 28867 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:27.055146 28867 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:27.055920 28867 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.056716 28867 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:27.085484 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.108556 26540 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:27.111270 26540 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:27.112428 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.988219 26541 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:26.961443 26547 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:27.115094 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:26.994102 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:27.117383 26547 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:10:27.117362 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:27.119385 26542 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:27.119764 26540 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:27.120000 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1584) took 4473 ms. Trace:
I20260709 12:10:27.120591 26543 rpcz_store.cc:276] 0709 12:10:22.646310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.724483 (+1078173us) service_pool.cc:224] Handling call
0709 12:10:26.164873 (+2440390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.167701 (+  2828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.119597 (+951896us) spinlock_profiling.cc:243] Waited 2.44 s on lock 0x7b540018bad0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:27.119818 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5611416832}
I20260709 12:10:26.963713 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:27.133641 26545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1612) took 2228 ms (client timeout 2079 ms). Trace:
I20260709 12:10:26.993177 26548 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:27.134232 26545 rpcz_store.cc:269] 0709 12:10:24.904989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.905132 (+   143us) service_pool.cc:224] Handling call
0709 12:10:27.133086 (+2227954us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b54002373d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:27.133350 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1647116672}
I20260709 12:10:27.123623 26542 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:27.133646 26620 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:27.127357 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:27.130456 26615 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:26.990137 27161 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 3: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:27.163668 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 244) took 4750 ms. Trace:
I20260709 12:10:27.177866 27162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 451) took 1147 ms. Trace:
I20260709 12:10:27.181013 27162 rpcz_store.cc:276] 0709 12:10:26.029793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.029929 (+   136us) service_pool.cc:224] Handling call
0709 12:10:26.042407 (+ 12478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:27.000059 (+957652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.177025 (+176966us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b540071acd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:27.177512 (+   487us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2179314944}
I20260709 12:10:27.180368 27166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 315) took 1766 ms. Trace:
I20260709 12:10:27.010174 28473 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:27.039934 28785 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:27.199380 28606 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:10:27.200662 28734 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:27.031085 28726 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.206072 28636 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:27.207518 27166 rpcz_store.cc:276] 0709 12:10:25.414163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.427734 (+ 13571us) service_pool.cc:224] Handling call
0709 12:10:25.437222 (+  9488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.685306 (+248084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.179632 (+1494326us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54006cfcd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:27.180117 (+   485us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568727936}
I20260709 12:10:27.170061 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:27.171866 26621 rpcz_store.cc:276] 0709 12:10:22.413271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.421101 (+2007830us) service_pool.cc:224] Handling call
0709 12:10:24.421512 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.901706 (+480194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.162956 (+2261250us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b540009f1d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:27.163413 (+   457us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1102717184}
I20260709 12:10:27.235526 28734 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:27.264781 28706 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:27.266094 28706 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:27.274688 28475 consensus_meta.cc:287] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.006s
I20260709 12:10:27.275249 28725 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:27.275954 28725 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:27.275584 28475 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:27.276824 28769 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:27.277364 28725 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:27.280553 28862 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:27.278720 28475 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:27.282577 28820 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.283443 28820 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:27.284621 28726 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:27.288614 28734 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.290222 28734 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:27.286307 28820 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:27.277390 28769 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:10:27.315795 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.316252 28706 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:27.315569 28725 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.304243 28930 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.319247 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 253) took 3756 ms. Trace:
W20260709 12:10:27.319279 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.319489 28930 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.319880 26613 rpcz_store.cc:276] 0709 12:10:23.562968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.117030 (+1554062us) service_pool.cc:224] Handling call
0709 12:10:25.409756 (+292726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.409986 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.410027 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.410097 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:25.410146 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.410233 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.318782 (+1908549us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b5400267850. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:27.319065 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672272256}
I20260709 12:10:26.693197 26622 rpcz_store.cc:276] 0709 12:10:23.381209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.105201 (+1723992us) service_pool.cc:224] Handling call
0709 12:10:26.103173 (+997972us) spinlock_profiling.cc:243] Waited 976 us on lock 0x7b5800049298. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:10:26.103398 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.103615 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:26.346644 (+243029us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.692152 (+345508us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:26.692211 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:26.692262 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.692464 (+   202us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.692626 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":178434,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":1916,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"spinlock_wait_cycles":2245376,"thread_start_us":584340,"threads_started":2}
I20260709 12:10:27.306257 28720 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.311901 26514 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:27.331414 28720 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.342124 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:27.342597 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:27.341229 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:27.338564 28720 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:27.347862 28527 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:27.345203 28930 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:27.351019 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:27.352157 28741 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.353670 26614 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:27.353819 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:27.354595 26465 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:27.354979 26464 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:27.355168 28769 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.355810 26470 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:27.356531 26469 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.528s	user 0.014s	sys 0.005s
I20260709 12:10:27.358162 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:27.359695 26466 raft_consensus.cc:2376] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6. Re-sending same reply.
W20260709 12:10:27.359855 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 48257.3us
I20260709 12:10:27.360447 26613 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:27.360998 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:27.362218 26469 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
W20260709 12:10:27.366184 28575 consensus_meta.cc:287] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.543s	user 0.006s	sys 0.009s
I20260709 12:10:27.367522 28575 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.369937 28821 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:27.373733 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:27.378103 28726 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:27.378911 26541 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:27.374109 27165 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:27.357089 26471 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:27.388183 28914 consensus_queue.cc:1059] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:27.389619 28656 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:27.390077 28656 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:27.391309 28656 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:27.396399 26617 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:27.381677 27163 raft_consensus.cc:2410] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:10:27.397424 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 82483.6us
I20260709 12:10:27.403237 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:27.404642 28616 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:27.405333 28616 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:27.406631 28616 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:27.408352 26368 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57052 (request call id 303) took 4499 ms. Trace:
I20260709 12:10:27.413090 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1493) took 1086 ms. Trace:
I20260709 12:10:27.413748 28720 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:27.413722 26539 rpcz_store.cc:276] 0709 12:10:26.326646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.441948 (+115302us) service_pool.cc:224] Handling call
0709 12:10:26.555650 (+113702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.556704 (+  1054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.412621 (+855917us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54001117d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:27.412850 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260560768}
I20260709 12:10:27.414727 28720 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:27.415130 28852 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:27.415875 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.416640 26587 connection.cc:256] RPC call timeout handler was delayed by -1.683018046999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
I20260709 12:10:27.417367 28720 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:27.417778 28706 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:27.420200 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:27.423017 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:27.424324 26469 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:27.426208 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:27.413195 28934 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.418345 28706 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:27.427335 26466 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:27.429389 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:27.429394 26465 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:27.430685 26619 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:27.403331 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:27.446347 26618 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.431560 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:27.428638 26470 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:27.429965 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:27.430591 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:27.431905 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.397027 28821 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:27.433560 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:27.441495 26540 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:27.453727 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:27.432580 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:27.434667 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:27.463902 26464 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:27.465209 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:27.465881 28769 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.442251 28656 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:27.426338 28822 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:27.478895 26547 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:27.478735 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:27.480423 27163 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 2: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:27.431573 28706 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:27.481743 28575 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:27.482475 28706 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:27.482880 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:27.483013 28575 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:27.483500 28575 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:27.483814 26466 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:27.484988 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:27.484625 28575 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:27.427903 28934 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.484874 26366 catalog_manager.cc:5697] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 5 to 6, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 6 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:27.486444 28575 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:27.487303 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:27.488662 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:27.489630 26468 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 6: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:27.408800 26368 rpcz_store.cc:276] 0709 12:10:22.909254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.909416 (+   162us) service_pool.cc:224] Handling call
0709 12:10:22.929491 (+ 20075us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b540007d354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076044090 00007f50760e2f3a 00007f507be98e9c 00007f507bf9704e 00007f507a4582a4 00007f507a458232 00007f507a458161 00007f507a4580dc 00007f507a457392 00007f507441548c 00007f50744148c6
0709 12:10:27.408082 (+4478591us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:24.434714 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:24.704300 (+269586us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:24.709633 (+  5333us) write_op.cc:435] Acquired schema lock
0709 12:10:24.720875 (+ 11242us) tablet.cc:662] Decoding operations
0709 12:10:24.876192 (+155317us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:24.876257 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:24.876282 (+    25us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:10:24.876839 (+   557us) tablet.cc:701] Row locks acquired
0709 12:10:24.876858 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:10:24.877036 (+   178us) write_op.cc:270] Start()
0709 12:10:24.877159 (+   123us) write_op.cc:276] Timestamp: P: 1783599024876974 usec, L: 0
0709 12:10:24.877184 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:10:24.877929 (+   745us) log.cc:844] Serialized 2473 byte log entry
0709 12:10:26.136333 (+1258404us) op_driver.cc:464] REPLICATION: finished
0709 12:10:26.307401 (+171068us) write_op.cc:301] APPLY: starting
0709 12:10:26.307517 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:26.307763 (+   246us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:26.307980 (+   217us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:26.308911 (+   931us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:26.309178 (+   267us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:10:26.309229 (+    51us) write_op.cc:312] APPLY: finished
0709 12:10:26.309567 (+   338us) log.cc:844] Serialized 53 byte log entry
0709 12:10:26.309789 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:26.309967 (+   178us) write_op.cc:454] Released schema lock
0709 12:10:26.310039 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:26.373401 (+ 63362us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:26.376093 (+  2692us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12337,"reported_tablets":12,"spinlock_wait_cycles":39471488,"child_traces":[["op",{"apply.queue_time_us":170740,"apply.run_cpu_time_us":3099,"apply.run_wall_time_us":26137,"num_ops":6,"prepare.queue_time_us":446052,"prepare.run_cpu_time_us":13271,"prepare.run_wall_time_us":511987,"raft.queue_time_us":608334,"raft.run_cpu_time_us":10633,"raft.run_wall_time_us":178798,"replication_time_us":1258943,"thread_start_us":891680,"threads_started":4,"wal-append.queue_time_us":136296,"wal-append.run_cpu_time_us":95307,"wal-append.run_wall_time_us":2289184}]]}
I20260709 12:10:27.491917 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:27.494884 26541 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:27.497377 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:27.501019 26622 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 3: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:27.502941 28720 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.503634 28720 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.504406 28860 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:27.504889 28860 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:27.505297 28860 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.505923 28720 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:27.506304 26467 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 5: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:27.503031 28852 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.507498 28852 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.473488 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:27.476593 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:27.507896 26467 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:27.510188 26469 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:27.511310 27163 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:27.511662 28852 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:27.520664 28934 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:27.521100 28860 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.526418 28860 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:27.533812 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:27.534775 26539 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:10:27.538554 26464 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:27.499778 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:27.540743 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:27.541178 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.542309 28644 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:27.543124 28644 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.545456 28644 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:27.493079 26465 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:27.566931 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:27.567025 28860 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
W20260709 12:10:27.580955 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 121251us
I20260709 12:10:27.575816 26618 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:27.587790 26614 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:27.586136 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:27.591059 26614 pending_rounds.cc:85] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 2
I20260709 12:10:27.602113 26469 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:27.586351 28860 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:27.596887 26614 pending_rounds.cc:107] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:10:27.605283 26614 raft_consensus.cc:2889] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:27.584262 28856 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.604735 26472 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:27.584594 28893 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.586020 28644 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:10:27.585383 28798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56886 (request call id 441) took 4648 ms. Trace:
W20260709 12:10:27.612704 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.616613 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:27.617904 28644 consensus_queue.cc:1243] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:27.618837 28644 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:27.619280 28644 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:27.620433 28644 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.586807 28527 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:10:27.607204 28860 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:27.622169 28644 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.610625 28934 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:10:27.641249 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55300.1us
I20260709 12:10:27.632230 28860 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.636106 28726 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:27.638945 28734 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.649571 26473 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
W20260709 12:10:27.649501 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.622617 28893 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.653091 28589 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.667342 28589 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:27.671005 28852 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:27.666579 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.676817 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:27.681083 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.687446 26513 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:27.631735 28856 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.675419 28934 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:27.714210 26466 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:27.654879 28734 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.727437 28847 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.728564 28893 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:27.689908 28852 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.729539 28852 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.730628 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 283) took 1160 ms. Trace:
I20260709 12:10:27.731066 26473 rpcz_store.cc:276] 0709 12:10:26.570177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.570303 (+   126us) service_pool.cc:224] Handling call
0709 12:10:27.713939 (+1143636us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b54000a4e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:27.730520 (+ 16581us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1956245376}
I20260709 12:10:27.731977 28852 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:27.734907 28734 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:27.735459 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.736141 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:27.737598 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:27.743256 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:27.744171 26473 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 5: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:27.749832 26469 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:27.755712 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 54534.6us
I20260709 12:10:27.764004 26471 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:27.711109 28934 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.746942 28852 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:27.615041 28798 rpcz_store.cc:276] 0709 12:10:22.936676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.943584 (+  6908us) service_pool.cc:224] Handling call
0709 12:10:23.427968 (+484384us) ts_tablet_manager.cc:934] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
0709 12:10:26.047247 (+2619279us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:10:27.329705 (+1282458us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:27.346414 (+ 16709us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:10:27.584076 (+237662us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:10:27.584545 (+   469us) tablet_replica.cc:206] Creating consensus instance
0709 12:10:27.584966 (+   421us) ts_tablet_manager.cc:989] Replica registered.
0709 12:10:27.585102 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":183147,"tablet-copy.queue_time_us":458183,"thread_start_us":189500,"threads_started":2}
W20260709 12:10:27.774701 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 123960us
W20260709 12:10:27.779717 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 144445us
W20260709 12:10:27.781741 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.785761 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:27.783936 28893 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.754050 28741 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:10:27.772771 28706 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:27.778996 28734 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.799667 28814 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.799885 28662 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.800266 28575 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:27.800899 28575 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:27.800657 28662 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:27.800405 28814 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:27.805372 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:27.810307 26469 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:27.811677 28720 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:27.813381 28662 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:27.813855 28883 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:27.814483 28893 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.845599 28893 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:27.814921 28734 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.815651 28589 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:27.816347 26473 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:27.816753 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:27.816944 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:27.817912 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:27.822093 26621 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:27.822201 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:27.823263 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:27.824379 26615 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:27.827343 26616 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:27.827489 26471 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:27.828173 28708 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:10:27.803452 28575 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:27.811726 28803 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:10:27.861588 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:27.862203 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:27.862805 28810 raft_consensus.cc:3055] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:27.863209 28810 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:27.864091 28734 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:27.864580 28575 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.864171 28810 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.865749 28810 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.839288 28720 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:27.803781 28726 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.866546 28883 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.839687 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:27.816356 28934 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:27.840014 28706 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:27.840536 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:27.841059 28798 tablet_copy_client.cc:806] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:27.842583 27168 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:27.843146 28856 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:27.792620 28852 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:27.835355 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:27.834266 26439 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:27.857955 26614 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:27.858789 27162 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:27.878088 26621 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 12:10:27.859822 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:27.878536 26621 pending_rounds.cc:85] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 2
I20260709 12:10:27.860200 28814 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:27.834643 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.871114 26613 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 3.
W20260709 12:10:27.880615 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.881093 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:27.879648 27164 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
W20260709 12:10:27.884479 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.885046 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.884619 28706 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:27.885459 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.885799 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.886269 28852 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:27.886535 28856 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:27.887013 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:27.891350 26614 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:27.892356 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 58232.1us
I20260709 12:10:27.887920 28856 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:27.897642 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:27.898429 26615 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:10:27.850435 28860 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.878810 26621 pending_rounds.cc:107] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.3
W20260709 12:10:27.904287 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 101279us
I20260709 12:10:27.884521 28798 tablet_copy_client.cc:670] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:27.872138 28893 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:10:27.902451 26621 raft_consensus.cc:2917] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Aborting config change with OpId 2.3: Aborted: Op aborted by new leader
I20260709 12:10:27.903779 28883 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:27.893268 28856 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:27.912155 28804 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:10:27.913096 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:27.914538 28893 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:27.914983 28893 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:27.915216 28734 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.916033 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:27.916556 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:27.917390 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:27.910193 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:27.916164 28883 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.927229 28847 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:27.927845 28847 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.928288 28847 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.928941 28589 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:27.929407 28589 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.929760 28589 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:27.906467 28726 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.925915 26621 raft_consensus.cc:2889] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:27.938736 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 123954us
W20260709 12:10:27.941054 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.941056 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:27.924698 28883 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:27.946118 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.938735 28726 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.948487 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48222 (request call id 8) took 7884 ms. Trace:
I20260709 12:10:27.952426 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:27.959898 26616 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
W20260709 12:10:27.965684 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 137700us
I20260709 12:10:27.938903 28734 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:10:27.923060 28893 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:27.949077 26621 rpcz_store.cc:276] 0709 12:10:20.088086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.088282 (+   196us) service_pool.cc:224] Handling call
0709 12:10:20.217438 (+129156us) log.cc:844] Serialized 506 byte log entry
0709 12:10:22.103358 (+1885920us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b18003695e0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:10:22.399360 (+296002us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b18003695e0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:10:27.948301 (+5548941us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":349,"raft.queue_time_us":245115,"raft.run_cpu_time_us":2651,"raft.run_wall_time_us":353723,"spinlock_wait_cycles":44000000,"thread_start_us":118129,"threads_started":1,"wal-append.queue_time_us":209397,"wal-append.run_cpu_time_us":2080,"wal-append.run_wall_time_us":1014143}
W20260709 12:10:27.968739 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.961716 28726 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:27.985764 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:27.987102 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:27.986364 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:28.000133 28883 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.004602 26620 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 4: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:28.003456 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:28.016055 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:28.016760 26471 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:28.019361 26467 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:10:28.021261 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 55428.5us
I20260709 12:10:28.010555 28852 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:28.024451 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:28.022491 27134 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:28.024201 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:27.985383 28644 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:10:28.024246 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:28.023208 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:28.027040 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:28.015185 28893 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.969766 28856 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.026602 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:28.028532 26473 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:28.028277 26539 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
W20260709 12:10:28.030246 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 86724us
I20260709 12:10:28.031595 26468 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:28.026710 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:28.032147 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:28.031656 26543 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:28.027184 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:28.026364 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:28.026993 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:28.039237 26438 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:28.040143 28616 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:28.040618 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:10:28.041803 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet c4646c5ce9a9467da50e9f3587b11ad5: Aborted: Op aborted by new leader
I20260709 12:10:28.042707 28741 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:28.043133 28741 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:28.044162 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:28.044030 28741 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.044672 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:28.045397 28741 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:28.048158 26470 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:28.049436 28798 tablet_copy_client.cc:538] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:28.052340 26466 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:28.026362 28821 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:28.055384 28821 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:28.049923 26548 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:28.051642 28804 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:28.057344 28804 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 3 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:28.024777 28860 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:28.056536 28944 log.cc:927] Time spent T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.198s	user 0.005s	sys 0.000s
I20260709 12:10:28.024974 28852 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:28.072180 28616 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:28.058200 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:28.079845 26548 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:28.056614 28821 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:28.065582 26513 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:28.081528 28821 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:28.082181 28575 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:28.082505 28726 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:28.058286 28804 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:28.079450 28616 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:28.073923 28769 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:10:28.066357 28901 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:10:28.064561 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:28.088049 28734 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:28.079351 28852 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:28.089049 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:28.065966 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:28.086716 28616 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.089955 26542 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 5: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:28.065874 27162 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:28.058590 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:28.103317 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 63386.8us
I20260709 12:10:28.048738 28847 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:28.078035 28946 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:10:28.099231 26543 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:28.066421 28856 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:28.123966 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:28.129307 28883 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:28.131467 28847 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:28.137456 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 123068us
W20260709 12:10:28.146507 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.150720 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.123413 28948 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:10:28.155200 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.154951 28708 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.156075 28708 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.158303 28708 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:28.154971 28948 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.167479 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:28.168474 28883 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:28.169237 28948 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:28.115577 28726 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:28.182936 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 71442.7us
I20260709 12:10:28.189265 28883 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:28.184633 28726 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:28.191565 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 67666.7us
I20260709 12:10:28.185824 26513 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:28.198084 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:28.191107 28726 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:28.202560 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 77419.9us
I20260709 12:10:28.204463 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:28.192345 28734 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:28.208019 28527 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:28.213630 26514 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:10:28.215920 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.208449 28575 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:28.215062 28847 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:28.221482 28847 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.221983 28847 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:28.222478 28847 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.217376 28644 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:10:28.223138 28527 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:28.223677 28527 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:28.212837 28883 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:28.233458 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:28.236629 28769 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:10:28.240082 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:28.241467 27133 leader_election.cc:336] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.549s (SENT)
I20260709 12:10:28.241595 28644 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:28.242599 28644 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:28.242974 28644 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:28.243700 28734 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:28.243891 28644 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.245249 28644 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.246150 28769 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:28.246562 28769 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:28.247478 28769 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.248821 28769 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.251541 28616 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:28.255034 28616 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:28.253017 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:10:28.263391 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.262969 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:28.264112 28822 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:28.264708 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.264634 28883 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:28.259670 28798 tablet_bootstrap.cc:492] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:10:28.267338 28883 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.267870 28883 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.268296 28883 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.268409 28741 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:28.278054 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.216363 28852 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:28.284273 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 51361.5us
I20260709 12:10:28.288694 28575 raft_consensus.cc:697] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:10:28.289007 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.290874 28644 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:10:28.290042 28575 consensus_queue.cc:237] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.298853 28948 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:28.299762 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:28.300362 28708 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:28.300695 28948 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:28.300858 28708 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:28.301208 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:28.302091 28948 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:28.301844 28708 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.303603 28708 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:28.287106 28847 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.312486 28847 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:28.313127 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.286332 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 72793.1us
I20260709 12:10:28.317345 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:28.293769 28589 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.321738 26513 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:28.269337 28734 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:28.283644 28860 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:28.329062 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 66208.9us
I20260709 12:10:28.334520 26514 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:28.286660 28822 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:28.335872 26472 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:28.325604 28948 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.338793 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:28.331310 28662 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:28.345044 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53310.4us
I20260709 12:10:28.333770 28847 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:28.352864 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 88449.6us
I20260709 12:10:28.349321 26587 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:28.338470 28734 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.355484 28616 raft_consensus.cc:3055] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:28.347499 28856 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:28.358162 26439 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:28.346326 28527 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.359915 28962 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:28.360549 28962 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:28.361866 28527 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:28.362160 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.361681 28962 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:28.362443 28822 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:28.355182 28662 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:28.380947 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:28.381120 28662 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:28.359555 28734 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:28.381886 26513 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:28.357048 28847 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:28.383432 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:28.384099 28893 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:28.384552 28893 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:28.384984 28893 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:28.385339 28644 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:28.385787 28644 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.386152 28644 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:28.387389 28589 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:28.364573 28947 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:28.390090 28734 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:28.367959 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:28.391121 27163 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 2: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:28.358834 28616 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:28.378728 28527 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:28.383147 28847 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.344036 28883 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.366272 28852 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:28.394008 28616 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.402103 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:28.402364 28616 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.403383 28741 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:28.405622 28575 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:28.406188 28575 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:28.406903 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:28.407630 26616 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:28.409277 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:28.398524 28893 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.400516 28957 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:28.401084 28883 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:28.407158 28575 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.366434 28726 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.424628 28893 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:28.414650 28662 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:28.415408 26366 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39184 (request call id 156) took 4397 ms. Trace:
I20260709 12:10:28.416465 28948 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:28.417147 28958 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:28.426739 28662 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.427350 28662 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.427986 28958 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:28.417601 26368 catalog_manager.cc:5697] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 4 to 5, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 5 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:28.420585 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 86971.5us
I20260709 12:10:28.425398 28726 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:28.421509 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 63659us
I20260709 12:10:28.422921 28965 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.422786 28957 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:28.437198 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.439584 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:28.442277 26439 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:28.440711 28852 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:10:28.440611 28965 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.443046 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:28.444796 28965 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:28.440868 28957 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.450644 28947 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:28.451610 28948 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:28.453823 28852 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:28.454370 28852 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:28.454813 28852 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:28.426479 26366 rpcz_store.cc:276] 0709 12:10:24.056228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.082669 (+ 26441us) service_pool.cc:224] Handling call
0709 12:10:28.415328 (+4332659us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:27.777978 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:27.812291 (+ 34313us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:27.812351 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:10:27.812371 (+    20us) tablet.cc:662] Decoding operations
0709 12:10:27.812824 (+   453us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:27.812911 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:27.812937 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:27.813249 (+   312us) tablet.cc:701] Row locks acquired
0709 12:10:27.813298 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:10:27.813494 (+   196us) write_op.cc:270] Start()
0709 12:10:27.813668 (+   174us) write_op.cc:276] Timestamp: P: 1783599027813425 usec, L: 0
0709 12:10:27.813692 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:10:27.868278 (+ 54586us) log.cc:844] Serialized 536 byte log entry
0709 12:10:28.287791 (+419513us) op_driver.cc:464] REPLICATION: finished
0709 12:10:28.399479 (+111688us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b18003627a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:10:28.399713 (+   234us) write_op.cc:301] APPLY: starting
0709 12:10:28.399802 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:28.399996 (+   194us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:28.400042 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:28.400386 (+   344us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:28.400713 (+   327us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:28.400781 (+    68us) write_op.cc:312] APPLY: finished
0709 12:10:28.401078 (+   297us) log.cc:844] Serialized 23 byte log entry
0709 12:10:28.401315 (+   237us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:28.401414 (+    99us) write_op.cc:454] Released schema lock
0709 12:10:28.401474 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:28.402077 (+   603us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:28.402109 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":99,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":75089,"apply.run_cpu_time_us":2308,"apply.run_wall_time_us":2309,"num_ops":1,"prepare.queue_time_us":248520,"prepare.run_cpu_time_us":31704,"prepare.run_wall_time_us":255506,"raft.queue_time_us":137335,"raft.run_cpu_time_us":17703,"raft.run_wall_time_us":70445,"replication_time_us":473900,"spinlock_wait_cycles":9831680,"thread_start_us":384721,"threads_started":4,"wal-append.queue_time_us":222827}]]}
I20260709 12:10:28.459040 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:28.459952 28947 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:28.460386 28947 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.460738 28947 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:28.465659 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:28.470057 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:28.470999 28708 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:28.471463 28708 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.471870 28708 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.472043 28616 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:28.472638 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:28.473923 26439 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:28.439893 26368 catalog_manager.cc:5697] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 2 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:28.476871 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:28.489202 28965 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:28.490077 26368 catalog_manager.cc:5697] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 2 to 3, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:28.489696 28965 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.495374 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:28.497790 26368 catalog_manager.cc:5697] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 8 to 9, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 9 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:28.477070 28616 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:28.476051 28856 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:28.512326 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:28.515187 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:28.504869 26368 catalog_manager.cc:5697] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 2, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 2 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:28.516041 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 95890.2us
I20260709 12:10:28.509316 28720 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:10:28.566581 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:28.564935 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:28.518666 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:28.584507 26615 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.566929 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:28.563638 26542 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:28.564335 26539 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:28.585325 26614 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:28.517181 27164 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:28.563967 27166 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:28.563583 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:28.525974 26368 catalog_manager.cc:5697] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 4 to 5, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 5 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:10:28.588647 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:28.491811 28883 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:10:28.590236 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:28.591184 26541 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:28.594295 26470 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:28.518478 28948 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:28.594915 28948 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.595299 28948 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:28.563345 28706 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:10:28.602088 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:28.507439 28965 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.617962 28948 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.476706 28644 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:28.602270 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 184242us
I20260709 12:10:28.621794 26472 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:28.621836 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:28.610203 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:28.611078 26465 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:28.603286 26617 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:28.533493 28957 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.636075 26546 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:28.519793 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:28.641947 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 123958us
I20260709 12:10:28.646121 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:28.504293 28814 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:28.650159 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.659497 26619 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:28.516398 28616 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.661799 26618 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:28.514957 28810 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.662621 28914 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:28.664813 28957 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:28.649730 28934 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.597371 28947 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.675688 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:28.635447 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:10:28.710084 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53143.9us
I20260709 12:10:28.712391 27133 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:28.587352 28925 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.164s
I20260709 12:10:28.579448 28662 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:28.718622 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:28.535508 28852 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.660966 28856 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.661940 28814 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:28.676483 28616 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:28.726531 28835 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:10:28.725924 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:28.683861 28769 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:28.730784 26514 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:28.739235 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:28.741067 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:28.742906 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:28.666810 28969 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:10:28.744215 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:28.747272 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:28.701990 28575 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:10:28.730561 28814 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.667390 28708 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.755859 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:28.730325 28856 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:28.764554 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.763666 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.714798 28810 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.716792 28934 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.769136 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:28.843143 28979 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:28.750321 28734 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:28.840005 26472 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:28.844942 28934 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:28.840848 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.840864 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 126122us
I20260709 12:10:28.838248 26614 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:28.858729 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.846084 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:28.846333 26616 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 5: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:28.759502 28821 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:28.845184 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:28.762539 28741 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.869030 28741 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.758786 28803 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:28.740891 28962 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.859935 26542 raft_consensus.cc:2368] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7.
W20260709 12:10:28.870702 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.772562 28969 consensus_queue.cc:1243] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:28.772330 28856 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.750569 28883 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
W20260709 12:10:28.883235 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet d2e173b367e6460b8f654b2de1aabfae: Illegal state: Replica 01a57027214a411e80874ac7febd628b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
W20260709 12:10:28.880762 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.836508 28957 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:28.874821 28741 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.886494 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:28.890218 28527 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:28.892732 28966 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:10:28.893658 28971 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 12:10:28.894791 26438 leader_election.cc:336] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.725s (SENT)
I20260709 12:10:28.868520 28734 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:28.908131 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.905690 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:28.911269 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 153142us
I20260709 12:10:28.912616 26439 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:28.912810 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:28.880308 28962 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.895495 28708 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:28.884173 28934 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:28.941110 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:28.880738 28925 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:10:28.869804 28979 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:10:28.943004 28948 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:28.942652 28957 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:28.918327 28893 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:10:28.955379 26542 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:28.955653 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:28.925890 28962 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:28.962719 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 236895us
I20260709 12:10:28.887562 28803 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.980681 26618 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:28.983773 28860 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.984129 26541 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:28.984565 28860 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.982405 28957 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:10:28.880090 28961 consensus_queue.cc:1059] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.332s
I20260709 12:10:28.989756 26548 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
W20260709 12:10:28.992317 28973 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:10:28.994439 28970 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:10:28.996272 26539 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:28.998358 26540 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:28.999857 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:29.004350 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:29.005410 26547 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 2: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:29.006459 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:29.007362 26545 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 2: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:29.010378 26615 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
W20260709 12:10:29.010740 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 116075us
I20260709 12:10:29.011580 26540 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:29.018158 28662 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:29.018894 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:29.019340 28852 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:29.020032 28575 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:29.010120 28720 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:29.020608 28575 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:29.020850 28720 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:29.021584 28575 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:29.026448 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 68529.8us
I20260709 12:10:29.021695 28720 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:29.019773 26539 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:29.025014 28965 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:28.945269 28644 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:29.010792 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:29.049561 26543 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:29.049733 26548 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:28.918563 28734 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:29.029098 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:29.052248 26616 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:29.011875 28967 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 12:10:29.053918 28985 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:29.054723 28985 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:29.065176 26546 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:29.071369 28814 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:29.073673 28814 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:29.075845 28803 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:29.078274 28883 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.078871 28883 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.079293 28883 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.081668 28810 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:29.082559 28734 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:29.084995 28985 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:29.086551 28947 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:29.082625 28720 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.090651 26616 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:29.092269 26542 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:29.092932 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:29.095240 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 183198us
I20260709 12:10:29.101555 26439 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:29.130563 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:29.134884 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:10:29.140836 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 396693us
I20260709 12:10:29.143970 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:29.148293 26542 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 3: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:29.102128 28980 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:29.149870 26546 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:29.155987 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:29.157353 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:29.157954 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:29.158048 26540 raft_consensus.cc:2376] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6. Re-sending same reply.
I20260709 12:10:29.134369 28527 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.131747 28589 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:10:29.177502 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.165254 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:29.193666 26546 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:29.194641 26540 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 7: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:29.063040 28616 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:29.161067 28852 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.198618 28980 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:29.199746 26542 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:29.199661 28980 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:29.200470 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:29.200935 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:29.201543 26539 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:29.201929 26547 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:29.202275 26547 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:29.195102 28986 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.195747 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:29.148837 28925 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:29.232556 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:29.157040 28814 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.237764 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:10:29.239189 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 219748us
I20260709 12:10:29.242538 28978 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:29.242424 26547 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:29.243184 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 141725us
I20260709 12:10:29.243386 28995 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:10:29.243948 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:29.244417 28991 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:29.244961 28991 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:29.246682 28987 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:29.247252 28987 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:29.247442 28860 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:29.248251 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:29.243682 26547 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.248921 26616 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:10:29.251106 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:29.252713 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:29.253360 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:29.151347 28803 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
W20260709 12:10:29.231828 28973 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:10:29.245889 28991 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:29.248178 28987 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:29.146078 28975 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.265121 28706 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.787s
I20260709 12:10:30.053031 28810 raft_consensus.cc:3055] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:30.053553 28810 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:30.053682 28975 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:30.054503 28810 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:30.055574 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:30.055599 28810 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.406471 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:30.059196 26546 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:10:30.060173 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:29.287832 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:30.061174 26617 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:30.061951 26616 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 6: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:29.678618 26547 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:10:29.306566 26620 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 12:10:29.285743 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45658.6us
W20260709 12:10:29.429592 26511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.000s	sys 0.008s
W20260709 12:10:29.439882 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.428378 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:10:29.991784 26468 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.726s	user 0.011s	sys 0.001s
W20260709 12:10:29.610913 26543 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.001s
I20260709 12:10:30.065310 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:30.065558 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.054173 28975 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.353816 26543 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 3.
I20260709 12:10:30.178231 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:30.354816 26464 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.302170 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:29.304149 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:30.355834 26472 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.354990 26548 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:29.193410 28822 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:29.427395 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:29.408656 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 120662us
I20260709 12:10:30.362890 26618 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
W20260709 12:10:29.992169 26438 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.000s	sys 0.010s
I20260709 12:10:30.062827 26547 pending_rounds.cc:85] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 6
I20260709 12:10:29.233897 28986 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:30.169531 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:10:30.380132 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.439769 26470 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.440336 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:30.440730 26619 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:30.158632 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:29.598706 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1729) took 1096 ms. Trace:
W20260709 12:10:30.373035 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 147734us
I20260709 12:10:30.450606 26622 rpcz_store.cc:276] 0709 12:10:28.502104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.502273 (+   169us) service_pool.cc:224] Handling call
0709 12:10:28.565789 (+ 63516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.649851 (+ 84062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.649873 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.678792 (+ 28919us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.138538 (+459746us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:29.138623 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.138745 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.598324 (+459579us) raft_consensus.cc:1685] finished
0709 12:10:29.598352 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.598596 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44903,"raft.queue_time_us":130122,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":8296,"thread_start_us":410675,"threads_started":1,"wal-append.queue_time_us":861932}
I20260709 12:10:29.303790 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:30.158632 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:30.360392 26468 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
W20260709 12:10:29.305637 28989 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:10:30.469568 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2435) took 1197 ms. Trace:
I20260709 12:10:30.470299 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2433) took 1188 ms. Trace:
W20260709 12:10:30.064567 26511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.167s	user 0.006s	sys 0.019s
I20260709 12:10:29.626519 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:29.881578 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:10:29.941255 28741 consensus_meta.cc:287] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.017s	user 0.011s	sys 0.000s
I20260709 12:10:29.743712 28814 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:30.373716 26438 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.182s	user 0.000s	sys 0.018s
W20260709 12:10:30.459151 26468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1501) took 1208 ms (client timeout 1599 ms). Trace:
I20260709 12:10:30.459177 26473 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:30.459343 26466 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:30.480559 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 1.3297e+06us
I20260709 12:10:30.459096 26547 pending_rounds.cc:107] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:10:30.480834 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1503) took 1229 ms. Trace:
I20260709 12:10:30.481168 26547 raft_consensus.cc:2889] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:30.360245 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:29.745091 28852 consensus_meta.cc:287] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.000s
W20260709 12:10:29.876768 28708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.000s	sys 0.019s
W20260709 12:10:30.172297 28644 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.006s	sys 0.013s
W20260709 12:10:30.372715 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 310653us
I20260709 12:10:29.860487 28985 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.744235 27163 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:30.212596 27162 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:30.222303 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:10:29.306301 28972 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.395s	user 0.004s	sys 0.000s
W20260709 12:10:29.544723 28962 consensus_meta.cc:287] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.000s
I20260709 12:10:30.524734 26622 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:29.531260 28860 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:29.861199 28983 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.694875 28734 raft_consensus.cc:3055] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:30.470286 26614 rpcz_store.cc:276] 0709 12:10:29.257635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.303528 (+ 45893us) service_pool.cc:224] Handling call
0709 12:10:30.454857 (+1151329us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:30.371594 26543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 326) took 1353 ms (client timeout 1506 ms). Trace:
I20260709 12:10:29.308212 28948 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:10:30.471832 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 263919us
I20260709 12:10:29.662369 28999 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:29.937053 28720 consensus_meta.cc:287] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.842s	user 0.009s	sys 0.000s
I20260709 12:10:29.265698 28977 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:29.943447 28883 consensus_meta.cc:287] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.864s	user 0.011s	sys 0.000s
I20260709 12:10:30.474453 27168 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:30.473873 26618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 1739) took 1204 ms (client timeout 1556 ms). Trace:
I20260709 12:10:30.481206 26473 rpcz_store.cc:276] 0709 12:10:29.251327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.251793 (+   466us) service_pool.cc:224] Handling call
0709 12:10:30.480773 (+1228980us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.475931 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:29.288290 28616 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:29.917079 28856 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.001s	user 0.010s	sys 0.002s
I20260709 12:10:30.488108 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:30.358525 28575 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.444446 28961 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.207355 29003 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.471429 26619 rpcz_store.cc:276] 0709 12:10:29.252543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.287272 (+ 34729us) service_pool.cc:224] Handling call
0709 12:10:30.441171 (+1153899us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:30.480559 26468 rpcz_store.cc:269] 0709 12:10:29.250713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.250870 (+   157us) service_pool.cc:224] Handling call
0709 12:10:30.459077 (+1208207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.254796 28726 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.360416 28706 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.372160 28969 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.538632 28965 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:30.490696 26544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1654) took 1246 ms (client timeout 1520 ms). Trace:
I20260709 12:10:30.112413 28958 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.179819 28914 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:30.165508 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:31.202773 26546 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:31.203488 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1658) took 1958 ms. Trace:
I20260709 12:10:29.235816 28589 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:30.475364 28949 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 12:10:31.202247 26544 rpcz_store.cc:269] 0709 12:10:29.243768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.286074 (+ 42306us) service_pool.cc:224] Handling call
0709 12:10:30.490594 (+1204520us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.499117 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1649) took 1292 ms. Trace:
I20260709 12:10:30.670477 28734 raft_consensus.cc:740] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:30.460006 28986 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.211299 28979 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.302343 28984 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 1.387s
I20260709 12:10:30.567358 29014 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:30.528517 28985 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:30.492865 28708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.186s	user 0.002s	sys 0.033s
W20260709 12:10:30.494748 28644 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.049s	user 0.010s	sys 0.013s
I20260709 12:10:29.260578 28527 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:30.521162 28968 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
W20260709 12:10:30.670037 26543 rpcz_store.cc:269] 0709 12:10:29.001773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.010492 (+  8719us) service_pool.cc:224] Handling call
0709 12:10:30.354664 (+1344172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:31.244804 26467 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:31.245819 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:30.644014 26466 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
W20260709 12:10:30.731197 26438 connection.cc:256] RPC call timeout handler was delayed by -1.6828885049999371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
I20260709 12:10:30.534253 26620 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:30.677946 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 331) took 1621 ms. Trace:
W20260709 12:10:31.247517 26466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1499) took 2007 ms (client timeout 2165 ms). Trace:
I20260709 12:10:31.247897 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2442) took 1191 ms. Trace:
W20260709 12:10:30.669798 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.040946 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.880864 26615 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:30.680130 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1731) took 2175 ms. Trace:
I20260709 12:10:30.725327 26614 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:30.688398 26470 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
W20260709 12:10:31.263465 26470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1502) took 2012 ms (client timeout 1632 ms). Trace:
I20260709 12:10:30.694083 26539 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 7: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:10:30.741544 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 370075us
W20260709 12:10:31.264052 26470 rpcz_store.cc:269] 0709 12:10:29.251018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.251504 (+   486us) service_pool.cc:224] Handling call
0709 12:10:30.169309 (+917805us) spinlock_profiling.cc:243] Waited 7.34 ms on lock 0x7b5800011198. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:10:31.263346 (+1094037us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16888192}
I20260709 12:10:31.266305 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1656) took 2021 ms. Trace:
I20260709 12:10:31.266773 26539 rpcz_store.cc:276] 0709 12:10:29.244427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.371859 (+1127432us) service_pool.cc:224] Handling call
0709 12:10:31.266243 (+894384us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:30.798799 26471 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.002s	sys 0.017s
W20260709 12:10:31.267633 26471 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.086s	user 0.007s	sys 0.022s
I20260709 12:10:30.648263 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1738) took 1880 ms. Trace:
I20260709 12:10:30.550145 28860 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.268491 26613 rpcz_store.cc:276] 0709 12:10:28.768151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.768363 (+   212us) service_pool.cc:224] Handling call
0709 12:10:28.847402 (+ 79039us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.847782 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.847814 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.848300 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.041569 (+193269us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:29.041636 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.041758 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.304902 (+263144us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:10:30.627850 (+1322948us) raft_consensus.cc:1685] finished
0709 12:10:30.627888 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.648158 (+ 20270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":712,"raft.queue_time_us":35896,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":17257,"spinlock_wait_cycles":7184640,"thread_start_us":145238,"threads_started":1,"wal-append.queue_time_us":264375}
W20260709 12:10:30.671175 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 200749us
W20260709 12:10:31.021286 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.130623 26618 rpcz_store.cc:269] 0709 12:10:29.249497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.286274 (+ 36777us) service_pool.cc:224] Handling call
0709 12:10:30.454126 (+1167852us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.522697 28852 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:31.281694 28965 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.282496 28852 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:31.282701 29019 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.283305 28852 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:31.145358 26464 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.707s	user 0.012s	sys 0.000s
W20260709 12:10:30.539088 28798 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.427s	user 0.000s	sys 0.000s
I20260709 12:10:31.157727 29046 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:31.159051 29039 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.159994 29041 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:31.161106 29027 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.162158 29023 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.163112 29024 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.164057 29037 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.165158 29017 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.258129 28985 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:31.156399 29020 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:30.522641 28893 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.194051 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1652) took 1950 ms. Trace:
I20260709 12:10:31.195004 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2443) took 1138 ms. Trace:
W20260709 12:10:31.335637 26438 connection.cc:256] RPC call timeout handler was delayed by -1.6360885050000888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
W20260709 12:10:30.744338 28769 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.002s	sys 0.033s
W20260709 12:10:31.121223 28810 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.065s	user 0.010s	sys 0.001s
W20260709 12:10:30.797660 27131 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.006s	sys 0.015s
W20260709 12:10:30.772298 29012 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:10:30.529157 28980 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.203897 26546 rpcz_store.cc:276] 0709 12:10:29.244977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.165152 (+920175us) service_pool.cc:224] Handling call
0709 12:10:31.203408 (+1038256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.741989 28814 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.745625 28720 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.569011 27163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 389) took 1239 ms. Trace:
I20260709 12:10:31.286898 29044 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:30.486934 28741 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:30.670758 28977 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:31.227648 28914 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:30.772571 29018 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:31.225490 26547 rpcz_store.cc:276] 0709 12:10:29.200097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.201506 (+  1409us) service_pool.cc:224] Handling call
0709 12:10:29.201815 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.492399 (+1290584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.492613 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:31.197608 28999 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:30.564955 29015 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.200958 28948 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:29.286729 28934 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 1.209s
I20260709 12:10:30.471298 29007 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.239439 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:31.246206 28979 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:31.248392 26620 rpcz_store.cc:276] 0709 12:10:30.056681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.497531 (+440850us) service_pool.cc:224] Handling call
0709 12:10:30.533957 (+ 36426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:31.247625 (+713668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.247837 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:31.249213 26621 rpcz_store.cc:276] 0709 12:10:28.504473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.505731 (+  1258us) service_pool.cc:224] Handling call
0709 12:10:28.506177 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.510072 (+  3895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.510121 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.510823 (+   702us) log.cc:844] Serialized 26 byte log entry
0709 12:10:28.716087 (+205264us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:28.716127 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.716200 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.232087 (+515887us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:10:30.679742 (+1447655us) raft_consensus.cc:1685] finished
0709 12:10:30.679771 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.680043 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89260,"raft.queue_time_us":8646,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":44764,"spinlock_wait_cycles":14179200,"thread_start_us":151661,"threads_started":1,"wal-append.queue_time_us":202153}
I20260709 12:10:31.243858 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 305) took 1574 ms. Trace:
I20260709 12:10:31.252858 28527 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:31.253844 28708 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:31.227952 28958 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.224486 28822 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:31.247987 26466 rpcz_store.cc:269] 0709 12:10:29.240601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.240731 (+   130us) service_pool.cc:224] Handling call
0709 12:10:30.158424 (+917693us) spinlock_profiling.cc:243] Waited 8.88 ms on lock 0x7b5800011198. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:10:31.247462 (+1089038us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20434816}
I20260709 12:10:31.255633 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:30.539250 29013 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.704s
I20260709 12:10:30.540889 28962 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:31.338871 29041 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:31.202421 28616 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:30.694182 28883 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.374502 29043 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:31.387881 29043 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:31.388154 28883 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:31.249964 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:31.389240 26544 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 3: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:31.389025 29043 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.390272 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:31.391495 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:31.001978 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:31.265486 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2445) took 1207 ms. Trace:
I20260709 12:10:31.375996 26469 rpcz_store.cc:276] 0709 12:10:29.669192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.173118 (+503926us) service_pool.cc:224] Handling call
0709 12:10:30.173592 (+   474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.665356 (+491764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.665405 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.666133 (+   728us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.740084 (+ 73951us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:31.194968 (+454884us) log.cc:844] Serialized 14 byte log entry
0709 12:10:31.243453 (+ 48485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.243533 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.243578 (+    45us) raft_consensus.cc:1685] finished
0709 12:10:31.243588 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.243756 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9539,"prepare.queue_time_us":416320,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":692547,"raft.run_cpu_time_us":496,"raft.run_wall_time_us":80631,"thread_start_us":971696,"threads_started":4,"wal-append.queue_time_us":494412}
I20260709 12:10:31.392414 26614 rpcz_store.cc:276] 0709 12:10:30.057599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.693640 (+636041us) service_pool.cc:224] Handling call
0709 12:10:30.724966 (+ 31326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:31.265097 (+540131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.265419 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:31.334319 29024 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:31.267251 28984 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.394124 28984 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.395033 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2437) took 1340 ms. Trace:
I20260709 12:10:31.395637 29024 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:31.396210 28589 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:31.339797 29037 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.398576 29037 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:31.306583 26464 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:31.398855 28741 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:31.399459 26464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1504) took 2113 ms (client timeout 1937 ms). Trace:
W20260709 12:10:31.399974 26464 rpcz_store.cc:269] 0709 12:10:29.286480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.290042 (+  3562us) service_pool.cc:224] Handling call
0709 12:10:30.178019 (+887977us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b5800011198. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:10:31.399336 (+1221317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7871360}
I20260709 12:10:31.298310 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:31.401681 28852 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:31.402202 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:31.398428 29032 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:10:31.403934 26539 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:31.404405 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1650) took 2162 ms. Trace:
I20260709 12:10:31.404747 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1655) took 2160 ms. Trace:
I20260709 12:10:31.337456 29039 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.405333 26539 rpcz_store.cc:276] 0709 12:10:29.244100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.403382 (+2159282us) service_pool.cc:224] Handling call
0709 12:10:31.403759 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.404429 (+   670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.404666 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:31.285132 26618 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:31.308507 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 178509us
I20260709 12:10:30.772024 29021 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.474s
I20260709 12:10:31.407202 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:31.407313 29021 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:31.407591 28934 raft_consensus.cc:3055] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:31.408054 28934 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:31.191490 28856 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.408871 28934 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.409998 28856 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:31.337762 29046 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:31.411422 29024 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:31.412614 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:31.413151 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 411299us
W20260709 12:10:31.165818 26472 consensus_meta.cc:287] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.696s	user 0.010s	sys 0.002s
I20260709 12:10:30.706671 28983 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.202229 28726 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.360409 28977 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.207741 28706 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.339803 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:31.201543 29003 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.340866 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:31.247471 29033 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.334808 26622 rpcz_store.cc:276] 0709 12:10:30.056945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.565181 (+508236us) service_pool.cc:224] Handling call
0709 12:10:30.568091 (+  2910us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.648214 (+ 80123us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:30.648249 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.719604 (+ 71355us) log.cc:844] Serialized 26 byte log entry
0709 12:10:31.004632 (+285028us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:31.004695 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.004806 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.192981 (+188175us) raft_consensus.cc:1685] finished
0709 12:10:31.193008 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.194896 (+  1888us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113716,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":18002,"spinlock_wait_cycles":912256,"thread_start_us":217961,"threads_started":1,"wal-append.queue_time_us":404080}
I20260709 12:10:31.287424 28901 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.289832 29028 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:31.347137 28644 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.334342 26545 rpcz_store.cc:276] 0709 12:10:29.243116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.246503 (+  3387us) service_pool.cc:224] Handling call
0709 12:10:29.246878 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:29.286602 (+ 39724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.286634 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.210095 (+923461us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.800379 (+590284us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:30.800443 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.800545 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.193717 (+393172us) raft_consensus.cc:1685] finished
0709 12:10:31.193761 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.193957 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":764735,"raft.queue_time_us":39407,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":108583,"thread_start_us":473602,"threads_started":1,"wal-append.queue_time_us":848526}
I20260709 12:10:31.350366 26617 raft_consensus.cc:2410] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:29.253031 28925 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.225423 28961 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.352061 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:31.382097 28958 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:31.062886 28988 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:10:31.358825 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.224267 28969 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.360917 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:31.472553 26547 raft_consensus.cc:2376] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5. Re-sending same reply.
I20260709 12:10:30.959039 28803 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:31.298969 29014 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:31.477618 28883 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:31.282541 28965 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.351313 28985 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.368042 26619 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:31.247733 26548 rpcz_store.cc:276] 0709 12:10:29.056657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.056817 (+   160us) service_pool.cc:224] Handling call
0709 12:10:30.354658 (+1297841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.356413 (+  1755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.677613 (+321200us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400111cd0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:30.677851 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2955169152}
I20260709 12:10:31.369343 29050 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.486613 28969 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:31.486886 29014 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:31.487267 28969 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:31.487507 29035 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.487814 28969 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.488104 28925 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:31.371058 28999 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:31.488171 29035 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.373051 28860 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:31.489671 29030 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:31.490003 29016 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 12:10:31.374485 29038 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:10:31.346107 29020 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:31.343291 28893 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.502877 29021 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:31.503314 29021 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:31.503720 29061 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:31.283452 29019 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.504297 29020 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:31.504189 29021 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:31.505088 29035 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:31.505589 29021 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.506084 29019 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:31.284607 28734 consensus_queue.cc:260] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:31.358750 29044 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.507578 29003 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:31.508106 28988 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:31.508555 29044 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:31.338905 29023 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:31.367740 29018 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:31.396440 28984 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:31.288194 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:31.450057 29033 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.381140 27166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 388) took 2130 ms. Trace:
I20260709 12:10:31.413029 29007 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.414316 26472 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
W20260709 12:10:31.390130 29022 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.499s	user 0.003s	sys 0.010s
W20260709 12:10:31.332429 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 104924us
W20260709 12:10:31.415858 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.383925 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:31.417483 26621 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:31.395442 26615 rpcz_store.cc:276] 0709 12:10:30.055118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.055265 (+   147us) service_pool.cc:224] Handling call
0709 12:10:31.394849 (+1339584us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b540003c854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:31.394961 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1517302656}
I20260709 12:10:31.412439 29046 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:31.431435 26539 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:31.404850 26540 rpcz_store.cc:276] 0709 12:10:29.242428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.247857 (+  5429us) service_pool.cc:224] Handling call
0709 12:10:29.248129 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:29.749072 (+500943us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.749115 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.273272 (+524157us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.804439 (+531167us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:30.804500 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.804598 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.404176 (+599578us) raft_consensus.cc:1685] finished
0709 12:10:31.404198 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.404341 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":897689,"raft.queue_time_us":314,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":41573,"thread_start_us":365554,"threads_started":1,"wal-append.queue_time_us":1062921}
I20260709 12:10:31.410092 28934 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.207449 28575 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.449342 26466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:39418
W20260709 12:10:31.440483 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 106651us
W20260709 12:10:31.442540 26467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1497) took 2202 ms (client timeout 2737 ms). Trace:
I20260709 12:10:31.353920 28814 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.357460 28720 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:31.585008 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 172511us
I20260709 12:10:31.374861 29029 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:31.445309 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 105670us
I20260709 12:10:31.441432 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:31.521955 26613 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.703677 27168 raft_consensus.cc:2393] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 3: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:31.354490 28980 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:31.351075 27163 rpcz_store.cc:276] 0709 12:10:29.314050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.406369 (+ 92319us) service_pool.cc:224] Handling call
0709 12:10:29.581992 (+175623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.498907 (+916915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.552763 (+ 53856us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:31.407752 29039 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:31.334069 29017 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:31.342921 28769 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.577s	user 0.007s	sys 0.042s
I20260709 12:10:31.437520 28852 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:31.446619 28975 consensus_meta.cc:287] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.977s	user 0.010s	sys 0.004s
I20260709 12:10:31.380067 29049 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.380545 28979 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:31.379647 28914 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:31.482138 28883 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.387217 29041 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:31.440207 29043 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.344945 28987 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.447922 29024 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.479552 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2439) took 1423 ms. Trace:
I20260709 12:10:31.386474 28616 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:31.380105 28708 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:31.483718 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 69795.6us
I20260709 12:10:31.382463 28822 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.485363 28985 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.486265 29050 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:31.369829 29052 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:10:31.488888 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.373539 29034 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.490121 29030 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:31.482427 28803 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:31.339305 29027 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.501236 29051 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:31.486650 28965 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:31.504113 29061 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:31.510051 26619 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:10:31.464026 28901 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:31.368116 29015 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:31.467576 29028 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:31.386121 28962 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:31.699208 26472 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1500) took 2458 ms (client timeout 1672 ms). Trace:
W20260709 12:10:31.699952 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.655649 26368 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57044 (request call id 310) took 3569 ms. Trace:
I20260709 12:10:31.700145 26543 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:31.510771 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:31.633496 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.608230 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:31.702010 26466 raft_consensus.cc:606] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:31.475467 28958 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.705094 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:31.673885 26544 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
W20260709 12:10:31.702600 26467 rpcz_store.cc:269] 0709 12:10:29.239939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.240066 (+   127us) service_pool.cc:224] Handling call
0709 12:10:31.442315 (+2202249us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b54001c1454. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:31.442487 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2039802112}
I20260709 12:10:31.504329 28893 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:31.708527 26439 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:31.742295 29048 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:31.637250 26366 catalog_manager.cc:5697] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 5 to 6, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 6 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:31.693722 29047 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
I20260709 12:10:31.750761 26613 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:31.701356 27166 rpcz_store.cc:276] 0709 12:10:29.250289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.253266 (+  2977us) service_pool.cc:224] Handling call
0709 12:10:29.429969 (+176703us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.689138 (+1259169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.689191 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.689914 (+   723us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.880680 (+190766us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:30.880722 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.880800 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.380934 (+500134us) raft_consensus.cc:1685] finished
0709 12:10:31.380953 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.381080 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":762729,"raft.queue_time_us":930776,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":99845,"thread_start_us":685984,"threads_started":2,"wal-append.queue_time_us":539361}
I20260709 12:10:31.754760 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:31.608210 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.609385 28968 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.471493 28644 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:31.482095 29036 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.306s
I20260709 12:10:31.468627 26545 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:31.510875 29026 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.446s
I20260709 12:10:31.513820 28948 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:31.788173 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1653) took 2544 ms. Trace:
W20260709 12:10:32.364583 26513 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.900s (SENT) [suppressed 14 similar messages]
I20260709 12:10:31.916528 29018 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:31.928707 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 304) took 2260 ms. Trace:
W20260709 12:10:32.365090 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.704434 28726 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:31.510315 28988 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:31.510790 29023 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:31.511871 28983 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:32.114426 28798 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 12:10:32.387025 26465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.007s	sys 0.007s
W20260709 12:10:32.423497 26465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.008s	sys 0.007s
W20260709 12:10:32.286149 28986 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.040s	user 0.009s	sys 0.002s
W20260709 12:10:32.373620 26546 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.001s	sys 0.013s
I20260709 12:10:32.365636 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:31.758481 26541 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.853452 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:32.393714 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:32.403129 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.823319 29029 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:32.400206 26542 rpcz_store.cc:276] 0709 12:10:29.243453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.248579 (+  5126us) service_pool.cc:224] Handling call
0709 12:10:29.248880 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.156850 (+907970us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.156885 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.174564 (+ 17679us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.477463 (+302899us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:30.477502 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.477567 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.787906 (+1310339us) raft_consensus.cc:1685] finished
0709 12:10:31.787926 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.788102 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65384,"raft.queue_time_us":815469,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":52136,"thread_start_us":138186,"threads_started":1,"wal-append.queue_time_us":1066811}
I20260709 12:10:31.931779 28575 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:31.809240 28706 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:32.321811 28720 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:32.375061 29033 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:31.986487 29069 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:32.408097 26472 rpcz_store.cc:269] 0709 12:10:29.240899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.241075 (+   176us) service_pool.cc:224] Handling call
0709 12:10:31.699123 (+2458048us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.401309 26466 raft_consensus.cc:614] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:32.420414 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:32.377388 28734 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:31.899935 28814 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:31.929283 28969 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:32.409201 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 1743) took 1529 ms. Trace:
W20260709 12:10:32.419162 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 664467us
W20260709 12:10:32.401660 26619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 1741) took 1521 ms (client timeout 1983 ms). Trace:
I20260709 12:10:32.167142 28991 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:32.418655 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:32.399573 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 691087us
I20260709 12:10:32.402149 26471 rpcz_store.cc:276] 0709 12:10:29.668792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.669027 (+   235us) service_pool.cc:224] Handling call
0709 12:10:30.180845 (+511818us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:31.268100 (+1087255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:31.268147 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:31.322916 (+ 54769us) log.cc:844] Serialized 26 byte log entry
0709 12:10:31.473846 (+150930us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:31.474208 (+   362us) log.cc:844] Serialized 14 byte log entry
0709 12:10:31.477127 (+  2919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.477213 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.928309 (+451096us) raft_consensus.cc:1685] finished
0709 12:10:31.928348 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.928568 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2641,"prepare.queue_time_us":349,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":707939,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":13512,"thread_start_us":1201944,"threads_started":2,"wal-append.queue_time_us":351783}
I20260709 12:10:32.398588 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 1528) took 1594 ms. Trace:
I20260709 12:10:32.398357 26617 rpcz_store.cc:276] 0709 12:10:30.055820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.487756 (+431936us) service_pool.cc:224] Handling call
0709 12:10:31.479339 (+991583us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54002602d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:31.479489 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471074688}
I20260709 12:10:32.396800 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 305) took 1081 ms. Trace:
I20260709 12:10:32.393975 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:32.399106 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1531) took 1412 ms. Trace:
I20260709 12:10:32.467432 26540 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:31.582726 29054 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:32.468549 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 642169us
I20260709 12:10:32.400911 27165 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
W20260709 12:10:32.467104 26546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.001s	sys 0.019s
I20260709 12:10:32.466290 26622 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
W20260709 12:10:32.545380 27164 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.003s	sys 0.013s
I20260709 12:10:32.385426 28980 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:32.546484 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:32.519989 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:32.540707 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 304) took 1271 ms. Trace:
W20260709 12:10:32.038897 29032 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.005s	sys 0.008s
I20260709 12:10:32.410306 26366 catalog_manager.cc:5697] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 5 to 6, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 6 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:32.401073 29018 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.401180 29034 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:32.464910 28979 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.415138 28968 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:32.427466 28987 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:32.405918 29024 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:32.418361 29017 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:32.447966 28986 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:32.406448 28975 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:32.416993 29051 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:32.416476 29049 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:32.491159 28962 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:32.779824 27168 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
W20260709 12:10:32.748808 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 1.25156e+06us
I20260709 12:10:32.634799 26470 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 5: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:32.780602 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:32.780241 26366 catalog_manager.cc:5697] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 2 to 3, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 3 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:32.781318 26621 rpcz_store.cc:276] 0709 12:10:31.315685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.382499 (+ 66814us) service_pool.cc:224] Handling call
0709 12:10:31.417116 (+ 34617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.699444 (+282328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.396515 (+697071us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b5400345650. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:32.396721 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78906624}
I20260709 12:10:32.512579 28726 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:32.397239 28961 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:32.554312 28965 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.402649 26368 rpcz_store.cc:276] 0709 12:10:28.043654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.045886 (+  2232us) service_pool.cc:224] Handling call
0709 12:10:31.613168 (+3567282us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:28.952098 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:28.969103 (+ 17005us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:28.969160 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:10:28.969177 (+    17us) tablet.cc:662] Decoding operations
0709 12:10:28.986882 (+ 17705us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:28.986981 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:28.987033 (+    52us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:10:28.987804 (+   771us) tablet.cc:701] Row locks acquired
0709 12:10:28.987830 (+    26us) write_op.cc:260] PREPARE: finished
0709 12:10:28.988038 (+   208us) write_op.cc:270] Start()
0709 12:10:28.988198 (+   160us) write_op.cc:276] Timestamp: P: 1783599028987971 usec, L: 0
0709 12:10:28.988231 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:10:28.989091 (+   860us) log.cc:844] Serialized 2477 byte log entry
0709 12:10:29.415914 (+426823us) op_driver.cc:464] REPLICATION: finished
0709 12:10:30.153336 (+737422us) write_op.cc:301] APPLY: starting
0709 12:10:30.153452 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:30.153695 (+   243us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:30.153844 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:30.154893 (+  1049us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:30.155188 (+   295us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:10:30.155267 (+    79us) write_op.cc:312] APPLY: finished
0709 12:10:30.155573 (+   306us) log.cc:844] Serialized 53 byte log entry
0709 12:10:30.155810 (+   237us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:30.155967 (+   157us) write_op.cc:454] Released schema lock
0709 12:10:30.156029 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:30.339841 (+183812us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:30.345033 (+  5192us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3339,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":711688,"apply.run_cpu_time_us":3416,"apply.run_wall_time_us":101911,"num_ops":6,"prepare.queue_time_us":305722,"prepare.run_cpu_time_us":7193,"prepare.run_wall_time_us":37362,"replication_time_us":276946,"thread_start_us":331028,"threads_started":2,"wal-append.queue_time_us":99280,"wal-append.run_cpu_time_us":2144,"wal-append.run_wall_time_us":1963636}]]}
W20260709 12:10:32.732590 28934 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.983s	user 0.013s	sys 0.000s
I20260709 12:10:32.780843 26615 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:32.779476 26613 rpcz_store.cc:276] 0709 12:10:30.880190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.287843 (+407653us) service_pool.cc:224] Handling call
0709 12:10:32.409156 (+1121313us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.616035 26541 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
W20260709 12:10:32.548447 29021 consensus_meta.cc:287] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.042s	user 0.010s	sys 0.005s
W20260709 12:10:32.568199 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.779136 27164 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.007s	sys 0.017s
W20260709 12:10:32.784672 26619 rpcz_store.cc:269] 0709 12:10:30.879672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.205019 (+325347us) service_pool.cc:224] Handling call
0709 12:10:32.401470 (+1196451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.511816 29074 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.781519 26620 rpcz_store.cc:276] 0709 12:10:31.269706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.380766 (+111060us) service_pool.cc:224] Handling call
0709 12:10:31.381100 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.755994 (+374894us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:31.756031 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:31.756087 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:31.756134 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.540357 (+784223us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54003d9854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:32.540426 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.540622 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":861632384}
I20260709 12:10:32.560313 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:32.785759 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:32.562162 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39418 (request call id 23) took 1166 ms. Trace:
I20260709 12:10:32.859217 26548 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.859421 26466 rpcz_store.cc:276] 0709 12:10:31.392122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.432067 (+ 39945us) service_pool.cc:224] Handling call
0709 12:10:32.558785 (+1126718us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:32.832626 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 428532us
I20260709 12:10:32.860271 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:32.783144 26543 rpcz_store.cc:276] 0709 12:10:30.804111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.383603 (+579492us) service_pool.cc:224] Handling call
0709 12:10:32.398524 (+1014921us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:32.861058 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 75369.9us
I20260709 12:10:32.780395 27165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56886 (request call id 467) took 1075 ms. Trace:
I20260709 12:10:32.514717 28616 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:32.474776 29007 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:32.861799 27165 rpcz_store.cc:276] 0709 12:10:31.704644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.704830 (+   186us) service_pool.cc:224] Handling call
0709 12:10:32.780257 (+1075427us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.812954 26366 catalog_manager.cc:5697] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 3 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 4 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:32.871897 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:10:32.872654 26615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2450) took 1456 ms (client timeout 1751 ms). Trace:
I20260709 12:10:32.821729 28726 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:32.573211 28977 consensus_meta.cc:287] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.124s	user 0.005s	sys 0.006s
I20260709 12:10:32.615947 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2444) took 2558 ms. Trace:
I20260709 12:10:32.821650 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:32.822058 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:32.824180 26547 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:10:32.685659 26544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 1529) took 1812 ms (client timeout 2330 ms). Trace:
W20260709 12:10:32.783483 29032 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.310s	user 0.025s	sys 0.033s
I20260709 12:10:32.409655 29041 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.206s
I20260709 12:10:32.883232 29029 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:32.570420 28644 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:32.782429 29054 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:32.567535 29027 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:32.717170 28803 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:32.779134 26545 rpcz_store.cc:276] 0709 12:10:30.986795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.464803 (+478008us) service_pool.cc:224] Handling call
0709 12:10:31.465181 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.398843 (+933662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.399049 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:31.892247 29064 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.716s
I20260709 12:10:32.405866 29055 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:32.863050 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:32.883908 29007 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:10:32.422206 29052 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:32.838011 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 57487us
I20260709 12:10:32.933488 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:10:32.934626 28852 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.528s	user 0.000s	sys 0.011s
I20260709 12:10:32.935083 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:32.935809 28988 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:32.936203 29051 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:32.860972 27168 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:32.410725 28958 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:32.869189 29074 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:32.865813 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:32.866914 26619 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:32.868273 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:32.422307 28999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.000s	sys 0.017s
I20260709 12:10:32.788911 29018 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:32.873332 26366 catalog_manager.cc:5697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 5 to 6, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 6 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:32.945683 29051 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:32.946306 28999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.202s	user 0.004s	sys 0.021s
I20260709 12:10:32.936880 29062 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:32.947041 29062 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:32.947448 29062 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.948180 28985 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:32.911108 29054 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.950322 29018 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:32.951505 26366 catalog_manager.cc:5697] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 2 to 4, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 4 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:32.955379 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:32.955825 26613 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:32.957518 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:32.958242 26613 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:32.958725 29074 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:32.873056 26615 rpcz_store.cc:269] 0709 12:10:31.416526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.401562 (+985036us) service_pool.cc:224] Handling call
0709 12:10:32.872588 (+471026us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.959260 29024 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:32.959293 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:32.960144 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:32.575376 28798 tablet_bootstrap.cc:492] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
W20260709 12:10:32.972034 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 109072us
I20260709 12:10:32.890934 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:32.972878 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:32.973224 27165 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 5: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:32.569190 28883 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:32.892951 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 309) took 1185 ms. Trace:
I20260709 12:10:32.568449 29061 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:32.885851 26616 rpcz_store.cc:276] 0709 12:10:30.057291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.675645 (+618354us) service_pool.cc:224] Handling call
0709 12:10:30.676177 (+   532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:31.032014 (+355837us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:31.032068 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:31.032818 (+   750us) log.cc:844] Serialized 26 byte log entry
0709 12:10:31.157410 (+124592us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:31.157471 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.157581 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:32.615712 (+1458131us) raft_consensus.cc:1685] finished
0709 12:10:32.615734 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.615878 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111283,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":69631,"thread_start_us":479225,"threads_started":2,"wal-append.queue_time_us":330575}
I20260709 12:10:32.665041 29069 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:32.896795 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 74810.3us
I20260709 12:10:32.791138 28893 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 12:10:32.829993 28962 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:32.874818 28979 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:32.890084 28822 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:32.880254 28726 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:32.903268 28968 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:32.857658 29023 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:10:32.829082 28983 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:10:32.819057 28969 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:10:32.790469 28991 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:32.826822 29035 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:32.906488 28708 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:32.918951 26548 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:32.668929 29030 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:32.853879 28965 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:32.927270 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:32.930377 28901 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:32.905946 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:32.933550 29052 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:32.945840 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2447) took 1530 ms. Trace:
I20260709 12:10:32.956184 27167 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:32.958990 29064 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:32.888144 26544 rpcz_store.cc:269] 0709 12:10:30.873292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.391229 (+517937us) service_pool.cc:224] Handling call
0709 12:10:32.685385 (+1294156us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54002373d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:32.685548 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647931264}
I20260709 12:10:32.938822 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:32.961092 26615 raft_consensus.cc:2410] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:32.827448 29026 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.955389 26366 catalog_manager.cc:5697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 3 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 4 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:32.962088 26617 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:10:32.791671 29033 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.973799 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:32.889246 28977 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:33.394284 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 306) took 2067 ms. Trace:
I20260709 12:10:33.097025 26466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:33.417555 26619 rpcz_store.cc:276] 0709 12:10:31.415707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.866187 (+1450480us) service_pool.cc:224] Handling call
0709 12:10:32.866645 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.945557 (+ 78912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.945775 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:33.404999 26541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1657) took 4160 ms (client timeout 1798 ms). Trace:
I20260709 12:10:33.416922 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:33.372190 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:33.407852 26622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2449) took 1991 ms (client timeout 1750 ms). Trace:
I20260709 12:10:33.420508 26620 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:33.417882 26614 rpcz_store.cc:276] 0709 12:10:31.326838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.393356 (+ 66518us) service_pool.cc:224] Handling call
0709 12:10:31.393691 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.422640 (+1028949us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:32.820825 (+398185us) log.cc:844] Serialized 14 byte log entry
0709 12:10:32.971958 (+151133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:32.972015 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:32.972073 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.394019 (+421946us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540037a854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:33.394067 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.394219 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":448326,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":46350,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":125,"spinlock_wait_cycles":2365585280,"thread_start_us":458941,"threads_started":2,"wal-append.queue_time_us":298111}
W20260709 12:10:33.420861 26622 rpcz_store.cc:269] 0709 12:10:31.416261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.472311 (+ 56050us) service_pool.cc:224] Handling call
0709 12:10:33.407610 (+1935299us) spinlock_profiling.cc:243] Waited 63.7 ms on lock 0x7b5400195354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:33.407765 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146573184}
I20260709 12:10:33.367633 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1662) took 1542 ms. Trace:
I20260709 12:10:33.286196 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:33.423008 26613 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:33.005586 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 143815us
W20260709 12:10:33.263422 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.006662 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:33.250981 26513 leader_election.cc:336] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.539s (SENT)
W20260709 12:10:33.162519 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.422684 26547 rpcz_store.cc:276] 0709 12:10:31.825133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.825290 (+   157us) service_pool.cc:224] Handling call
0709 12:10:32.517081 (+691791us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:10:32.517353 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.887343 (+369990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.367257 (+479914us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b540018b5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:33.367540 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":708963072}
I20260709 12:10:33.422019 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1664) took 1596 ms. Trace:
W20260709 12:10:33.418903 26617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2451) took 2002 ms (client timeout 2039 ms). Trace:
I20260709 12:10:33.426638 26548 rpcz_store.cc:276] 0709 12:10:31.825789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.559950 (+734161us) service_pool.cc:224] Handling call
0709 12:10:33.421955 (+862005us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.427814 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:32.984071 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:33.419204 26621 rpcz_store.cc:276] 0709 12:10:31.707803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.821360 (+1113557us) service_pool.cc:224] Handling call
0709 12:10:32.892846 (+ 71486us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:33.419695 26541 rpcz_store.cc:269] 0709 12:10:29.244706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.880481 (+635775us) service_pool.cc:224] Handling call
0709 12:10:33.404695 (+3524214us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54003386d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:33.404877 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2955066112}
W20260709 12:10:33.419736 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 445982us
I20260709 12:10:32.907245 29081 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.432857 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:32.935119 28852 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.431991 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:33.437580 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 498788us
I20260709 12:10:33.423754 26366 catalog_manager.cc:5697] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 2 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 4 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:33.480741 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 56508us
I20260709 12:10:33.280884 29032 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:33.390530 29028 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:33.469754 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:33.385046 28814 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.978252 29027 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:33.479650 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 51972.9us
W20260709 12:10:33.482102 28948 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.032s	sys 0.041s
W20260709 12:10:33.492208 28948 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.033s	sys 0.041s
I20260709 12:10:33.470211 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:33.492421 28962 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:32.978899 29021 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.507s
I20260709 12:10:33.493331 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:33.494616 29018 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:33.494765 28720 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:33.495203 29018 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:33.495260 28720 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:33.495846 28720 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.496265 29018 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:33.497488 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:33.498201 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:33.494282 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:33.499058 28814 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:33.501127 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:33.413734 29029 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:10:32.977092 28803 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:33.503669 28803 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.503567 28883 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:10:33.479159 28901 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:33.504247 28803 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.484401 28822 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.504501 28883 consensus_queue.cc:1243] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:33.433919 29026 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:33.507786 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:33.508082 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:33.488154 29007 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:10:33.510730 26472 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 2: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:33.511234 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:33.512346 26469 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:33.513803 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:33.276134 29075 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.903s	user 0.000s	sys 0.003s
I20260709 12:10:33.375294 28798 tablet_bootstrap.cc:492] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:10:32.944418 29049 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:32.946264 29051 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:10:33.427419 26617 rpcz_store.cc:269] 0709 12:10:31.416759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.819231 (+1402472us) service_pool.cc:224] Handling call
0709 12:10:33.418822 (+599591us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.483517 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:33.483099 26366 catalog_manager.cc:5697] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 5 to 6, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 6 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:33.401921 28986 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:33.000375 28644 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:33.365430 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:33.154016 28987 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:33.484560 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 233636us
I20260709 12:10:33.417198 29064 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:33.435009 27160 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.434844 27161 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.937245 28988 consensus_queue.cc:1059] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.534s
I20260709 12:10:33.025614 29024 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:33.425448 29039 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.617s	user 0.015s	sys 0.013s
I20260709 12:10:33.430295 28575 raft_consensus.cc:2764] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:33.484401 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:32.979717 29050 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:33.193945 29034 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:33.488029 26618 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:33.440302 28706 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:33.490013 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:33.490424 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:33.517463 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:33.492007 26438 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:33.501298 28814 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:33.391515 29076 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.020s	user 0.003s	sys 0.002s
I20260709 12:10:32.926960 29055 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.433441 29033 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:33.481137 28980 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
W20260709 12:10:33.706348 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 213485us
I20260709 12:10:33.482897 29030 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:33.488513 29054 consensus_meta.cc:287] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.005s
I20260709 12:10:33.481024 28708 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:33.485957 29032 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:33.509438 26621 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:33.683560 29024 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:33.684680 26614 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:33.535133 28901 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:33.775269 28901 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:33.776516 28803 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:33.777173 28734 consensus_meta.cc:287] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.988s	user 0.007s	sys 0.003s
I20260709 12:10:33.777684 26466 raft_consensus.cc:606] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:33.778141 26466 raft_consensus.cc:614] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:33.685876 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:33.778863 28803 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:33.779104 26545 raft_consensus.cc:2393] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:33.779978 26471 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:33.780329 26471 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:33.780383 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:33.781065 26545 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:10:33.781227 26471 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:33.782361 26469 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:33.654642 28893 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:33.605141 28958 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:33.513397 29074 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.604987 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:33.790912 26547 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:33.792631 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:33.793272 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.793480 26547 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:33.688975 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:33.795409 28977 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:33.689831 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:33.796566 26542 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:33.797226 29033 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:33.797928 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:33.689492 26366 catalog_manager.cc:5697] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 5 to 6, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 6 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:33.800681 29024 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:33.802037 29043 consensus_meta.cc:287] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.395s	user 0.008s	sys 0.003s
I20260709 12:10:33.690713 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:33.691156 28644 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:33.691079 29051 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:33.804255 29051 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.805423 28720 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:33.807003 29069 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:33.808358 29085 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:33.808876 29085 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:33.809413 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:33.805477 28644 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:33.810070 26545 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.810863 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2446) took 2395 ms. Trace:
I20260709 12:10:33.811398 26618 rpcz_store.cc:276] 0709 12:10:31.415358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.416887 (+  1529us) service_pool.cc:224] Handling call
0709 12:10:31.447931 (+ 31044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.693129 (+2245198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.810537 (+117408us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b54001f5ed4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:33.810782 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4691074944}
I20260709 12:10:33.813220 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:33.813905 26618 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:33.522547 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:33.814713 26541 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 2.
I20260709 12:10:33.631301 26613 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:33.715662 28948 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:33.652374 26548 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:33.612169 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:33.692920 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:33.820971 26620 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
W20260709 12:10:33.696529 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 204618us
I20260709 12:10:33.639276 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:33.821940 26473 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:33.529004 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:33.823060 26622 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
W20260709 12:10:33.703995 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 222457us
I20260709 12:10:33.823923 26514 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:33.615068 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:33.694685 29039 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.886s	user 0.015s	sys 0.020s
I20260709 12:10:33.712925 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:33.709084 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1496) took 4463 ms. Trace:
I20260709 12:10:33.827723 26468 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 5: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:33.748324 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:33.753232 27133 connection.cc:256] RPC call timeout handler was delayed by -1.2889072929999656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.223s for a response
I20260709 12:10:33.696461 29061 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.595548 28852 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:33.887997 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:33.888918 26472 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 6: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:33.890003 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:33.703154 29084 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.427s	user 0.001s	sys 0.000s
I20260709 12:10:33.485431 29035 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:33.657483 28991 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:33.604846 29027 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:33.702479 29055 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.764322 29041 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.764618 28814 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:33.772310 28822 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.768972 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:34.090130 27161 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:33.706327 28987 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.706869 28706 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:33.770067 28726 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:33.816067 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:33.922209 29032 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:33.774134 29026 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:34.128613 26464 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:33.750563 28986 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.820750 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:33.821887 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:33.527927 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:34.130640 26616 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:33.685870 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:33.822969 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:34.132942 26543 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 3.
I20260709 12:10:33.529661 28968 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:33.824270 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:34.136471 26542 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:33.692528 27160 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:33.825201 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:33.826005 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 211057us
I20260709 12:10:33.828667 26467 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:33.771169 28975 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:33.829526 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:33.885931 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:34.136284 26588 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:34.141072 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 307) took 2434 ms. Trace:
I20260709 12:10:34.142803 26616 rpcz_store.cc:276] 0709 12:10:31.707161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.140426 (+2433265us) service_pool.cc:224] Handling call
0709 12:10:34.140720 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.140855 (+   135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.140871 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.140900 (+    29us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:34.140919 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.140954 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.141025 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:34.143590 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 321791us
I20260709 12:10:34.144398 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 308) took 2436 ms. Trace:
I20260709 12:10:34.144747 26616 rpcz_store.cc:276] 0709 12:10:31.707503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.143618 (+2436115us) service_pool.cc:224] Handling call
0709 12:10:34.143924 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.144091 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.144116 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.144153 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:34.144180 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.144233 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.144345 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.887074 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:34.141556 26540 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:34.140511 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:34.147234 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:33.888144 28852 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:10:33.761353 26587 connection.cc:256] RPC call timeout handler was delayed by -2.8211808940000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
W20260709 12:10:34.149013 26587 connection.cc:256] RPC call timeout handler was delayed by -2.7914808939999602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
W20260709 12:10:34.149386 26587 connection.cc:256] RPC call timeout handler was delayed by -2.7554808940001294s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
I20260709 12:10:33.891276 26472 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:34.149700 26540 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:33.836412 26514 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:34.149925 26439 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:34.150724 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 314391us
I20260709 12:10:34.151266 26540 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.151336 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:34.149744 26587 connection.cc:256] RPC call timeout handler was delayed by -2.5169808939999712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260709 12:10:34.152356 26587 connection.cc:256] RPC call timeout handler was delayed by -2.32168089400011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
W20260709 12:10:34.152644 26587 connection.cc:256] RPC call timeout handler was delayed by -2.32168089400011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
W20260709 12:10:34.152905 26587 connection.cc:256] RPC call timeout handler was delayed by -2.3117808940000941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
W20260709 12:10:34.153061 26587 connection.cc:256] RPC call timeout handler was delayed by -2.1632808940000814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.233s for a response
W20260709 12:10:34.153205 26587 connection.cc:256] RPC call timeout handler was delayed by -1.7969808940001712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2737s for a response
I20260709 12:10:33.894814 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:33.788932 28708 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:33.788280 28893 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:33.763231 29054 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:34.163820 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:34.098321 27164 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 391) took 3941 ms. Trace:
I20260709 12:10:33.828217 28948 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:34.075304 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 186211us
W20260709 12:10:34.094556 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.051838 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1532) took 3032 ms. Trace:
I20260709 12:10:33.841678 29024 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:34.107633 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 214555us
I20260709 12:10:33.827056 29043 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:33.809798 29085 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:33.827538 26465 rpcz_store.cc:276] 0709 12:10:29.239562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.264682 (+ 25120us) service_pool.cc:224] Handling call
0709 12:10:30.163743 (+899061us) spinlock_profiling.cc:243] Waited 7.99 ms on lock 0x7b5800011198. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:10:30.164022 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:31.614514 (+1450492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:31.614568 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:31.704143 (+ 89575us) log.cc:844] Serialized 26 byte log entry
0709 12:10:32.423879 (+719736us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:32.423905 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.548670 (+124765us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400069ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:32.548729 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:32.934170 (+385441us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:10:33.702519 (+768349us) raft_consensus.cc:1685] finished
0709 12:10:33.702540 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.702658 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104963,"raft.queue_time_us":106413,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":59182,"spinlock_wait_cycles":3164557184,"thread_start_us":613901,"threads_started":1,"wal-append.queue_time_us":616385}
I20260709 12:10:34.142647 29032 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.136080 28968 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:34.180833 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:34.180922 28968 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:34.170248 28852 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:34.182155 28968 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.182503 28822 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:34.182941 28822 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.183288 28822 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.161486 29039 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:34.174913 29026 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.185483 29026 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.185860 29026 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.169438 28893 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:34.187039 29043 raft_consensus.cc:697] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:34.186734 28706 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:34.188072 29043 consensus_queue.cc:237] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:34.189201 28948 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:34.170809 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:34.090651 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:33.924916 29062 consensus_meta.cc:287] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.977s	user 0.009s	sys 0.004s
I20260709 12:10:34.078716 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:34.006718 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.182233 28987 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.190884 26468 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 11: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:34.088478 26545 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:34.169561 28708 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:34.163396 29097 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.164736 29051 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:34.119967 26544 raft_consensus.cc:2376] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 3. Re-sending same reply.
I20260709 12:10:34.125252 28814 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:34.169517 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:34.193497 29051 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.194522 29051 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.194945 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:34.195487 28814 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:34.140069 28986 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:34.196215 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:34.196919 26467 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.197886 28986 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:34.198470 26614 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.190454 29062 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:34.200100 29024 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:34.200840 29062 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:34.201021 29024 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:34.202751 28720 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:34.124262 26470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1505) took 2784 ms (client timeout 2154 ms). Trace:
I20260709 12:10:34.125430 26613 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:33.692664 28798 ts_tablet_manager.cc:1403] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 5.433s	user 0.070s	sys 0.078s
I20260709 12:10:34.135067 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:34.203799 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.204281 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 1746) took 1341 ms. Trace:
I20260709 12:10:34.193499 29035 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:34.186472 26546 rpcz_store.cc:276] 0709 12:10:31.019939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.467057 (+447118us) service_pool.cc:224] Handling call
0709 12:10:31.467369 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.517496 (+ 50127us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:31.776206 (+258710us) log.cc:844] Serialized 14 byte log entry
0709 12:10:32.789116 (+1012910us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:32.789180 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:32.789228 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.390940 (+601712us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:10:34.051538 (+660598us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b54001117d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:34.051608 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.051771 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6577,"prepare.queue_time_us":883346,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":23864,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4573,"spinlock_wait_cycles":199271168,"thread_start_us":1173910,"threads_started":2,"wal-append.queue_time_us":594641}
I20260709 12:10:34.204717 26613 rpcz_store.cc:276] 0709 12:10:32.862655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.815739 (+953084us) service_pool.cc:224] Handling call
0709 12:10:34.204218 (+388479us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.132234 26617 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 1.
W20260709 12:10:34.203684 26470 rpcz_store.cc:269] 0709 12:10:31.339616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.340519 (+   903us) service_pool.cc:224] Handling call
0709 12:10:34.124023 (+2783504us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54000dcfd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:34.124186 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2733916928}
I20260709 12:10:34.207163 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:34.137820 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:34.102576 28988 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:34.142207 26541 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 3.
I20260709 12:10:33.886669 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:34.222945 26618 raft_consensus.cc:2410] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:34.166205 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:34.147936 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 310) took 1521 ms. Trace:
I20260709 12:10:34.224159 26616 rpcz_store.cc:276] 0709 12:10:32.624937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.145680 (+1520743us) service_pool.cc:224] Handling call
0709 12:10:34.145966 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.146128 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.146151 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.146190 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:34.146222 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.146273 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.146372 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.225499 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:34.227695 26614 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:33.885442 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:34.228641 26473 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:34.161075 26540 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:10:34.127312 27161 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 394) took 1255 ms (client timeout 1668 ms). Trace:
I20260709 12:10:34.230762 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:34.231539 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:34.124361 29041 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:34.234520 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 71853.3us
I20260709 12:10:34.148823 27160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 395) took 1261 ms. Trace:
I20260709 12:10:34.192077 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:34.192955 29097 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.239770 26468 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 6: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:33.890872 29064 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:33.784689 26471 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:34.243422 26514 connection.cc:256] RPC call timeout handler was delayed by -1.1679093440000088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
I20260709 12:10:34.139293 26619 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:10:34.244017 26514 connection.cc:256] RPC call timeout handler was delayed by -1.1679093440000088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
I20260709 12:10:34.244583 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2448) took 2828 ms. Trace:
I20260709 12:10:34.245095 26619 rpcz_store.cc:276] 0709 12:10:31.415992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.122158 (+2706166us) service_pool.cc:224] Handling call
0709 12:10:34.138967 (+ 16809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.244285 (+105318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.244517 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.079944 28965 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:34.118465 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:34.247151 26620 raft_consensus.cc:2410] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:34.205876 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:34.247877 26613 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:34.166036 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:34.165717 26439 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:34.221405 26542 raft_consensus.cc:2410] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:34.221434 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:34.250921 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 85001.6us
I20260709 12:10:34.251207 26470 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:34.148555 26539 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:34.228788 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:34.231717 26618 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 6: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:34.232277 26621 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 1.
I20260709 12:10:34.253676 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:34.223735 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:34.258956 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:34.190945 28987 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:34.235456 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 51847.2us
I20260709 12:10:34.263715 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 1754) took 1338 ms. Trace:
I20260709 12:10:34.264410 26620 rpcz_store.cc:276] 0709 12:10:32.925764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.102143 (+1176379us) service_pool.cc:224] Handling call
0709 12:10:34.263622 (+161479us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:34.266069 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.202894 27164 rpcz_store.cc:276] 0709 12:10:30.157111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.158107 (+   996us) service_pool.cc:224] Handling call
0709 12:10:30.204374 (+ 46267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.375296 (+1170922us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:31.888154 (+512858us) log.cc:844] Serialized 14 byte log entry
0709 12:10:32.862361 (+974207us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:32.862460 (+    99us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:32.862531 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.496018 (+633487us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b48000cc3d8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507b003aa1 00007f507affab37 00007f507affa9ca 00007f507b0f226f 00007f507b0f1f37 00007f507b10655c 00007f507b106508 00007f507b106488 00007f507b106443 00007f507b1056ec 00007f507a02fa96
0709 12:10:34.098069 (+602051us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540014fad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:34.098118 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.098261 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46927,"prepare.queue_time_us":326111,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":63,"raft.queue_time_us":3956,"raft.run_cpu_time_us":3538,"raft.run_wall_time_us":627464,"spinlock_wait_cycles":2700944512,"thread_start_us":1381813,"threads_started":2,"wal-append.queue_time_us":820536,"wal-append.run_cpu_time_us":1684,"wal-append.run_wall_time_us":1044521}
W20260709 12:10:34.268280 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.117422 29027 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:34.177518 29054 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:34.250036 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1745) took 1423 ms. Trace:
I20260709 12:10:34.255008 26621 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:34.187285 28893 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.239226 27160 rpcz_store.cc:276] 0709 12:10:32.887022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.890131 (+  3109us) service_pool.cc:224] Handling call
0709 12:10:34.141768 (+1251637us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:34.256085 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 90446.4us
I20260709 12:10:34.283519 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:34.283757 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:34.233268 28901 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.237671 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:34.245038 28969 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.161172 28991 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:10:34.275213 26542 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:34.256630 28644 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:34.232765 28988 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:34.283649 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:34.280011 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1750) took 1385 ms. Trace:
I20260709 12:10:34.260440 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:34.288404 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:34.223057 29018 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:10:34.263131 27133 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:34.243481 29097 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.276554 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:34.230959 27161 rpcz_store.cc:269] 0709 12:10:32.872071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.877018 (+  4947us) service_pool.cc:224] Handling call
0709 12:10:34.125631 (+1248613us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:34.348148 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 85111.2us
W20260709 12:10:34.348825 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 95244.2us
I20260709 12:10:34.349917 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:34.274917 28987 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.280543 26613 rpcz_store.cc:276] 0709 12:10:32.826718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.248785 (+1422067us) service_pool.cc:224] Handling call
0709 12:10:34.249233 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.249436 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.249475 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.249661 (+   186us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:34.249725 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.249807 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.249960 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.264151 29035 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:34.315415 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:34.315503 26540 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:34.277782 28979 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:34.293637 26620 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 6: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:10:34.344544 26513 leader_election.cc:336] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.616s (SENT)
I20260709 12:10:34.369025 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:34.344412 26621 rpcz_store.cc:276] 0709 12:10:32.894298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.254081 (+1359783us) service_pool.cc:224] Handling call
0709 12:10:34.254531 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.279665 (+ 25134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.279931 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.346347 26619 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:34.264418 28948 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.350585 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:34.307531 28980 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.353080 26471 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:34.378458 26621 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:34.354141 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:34.352703 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:34.263468 29051 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:34.358970 29021 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:34.362200 26618 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:10:34.359632 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 84989.9us
I20260709 12:10:34.273178 28803 consensus_queue.cc:1059] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:10:34.285035 29064 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:34.351195 26439 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:34.372781 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:34.291112 28962 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:34.375358 27167 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:34.284695 29069 consensus_queue.cc:1059] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 12:10:34.361356 29035 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.382786 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1758) took 1002 ms. Trace:
I20260709 12:10:34.387368 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:34.388118 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:34.389709 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 311) took 1456 ms. Trace:
I20260709 12:10:34.284276 28958 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 12:10:34.353668 29054 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.368582 28934 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.380314 26617 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:10:34.399049 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 49164.8us
I20260709 12:10:34.403718 26619 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:34.372524 28948 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:34.319135 28901 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:34.348012 28644 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:34.313010 28969 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:34.447454 26543 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 7: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:10:34.502977 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.484138 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 139624us
I20260709 12:10:34.467011 26616 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:34.476578 26539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1665) took 2650 ms (client timeout 1578 ms). Trace:
I20260709 12:10:34.579205 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1760) took 1189 ms. Trace:
W20260709 12:10:34.571125 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 220015us
I20260709 12:10:34.580062 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:34.582858 26619 rpcz_store.cc:276] 0709 12:10:33.389993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.371081 (+981088us) service_pool.cc:224] Handling call
0709 12:10:34.397733 (+ 26652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.578929 (+181196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.579143 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.470928 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 1747) took 1594 ms. Trace:
W20260709 12:10:34.581012 26539 rpcz_store.cc:269] 0709 12:10:31.826112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.519699 (+693587us) service_pool.cc:224] Handling call
0709 12:10:34.476283 (+1956584us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540037fad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:34.476480 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3125603200}
I20260709 12:10:34.584470 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:34.584436 26614 rpcz_store.cc:276] 0709 12:10:32.876782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.814689 (+937907us) service_pool.cc:224] Handling call
0709 12:10:34.470617 (+655928us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x7b5400345b54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:34.470788 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157704960}
I20260709 12:10:34.587373 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39418 (request call id 24) took 1600 ms. Trace:
I20260709 12:10:34.407562 26621 rpcz_store.cc:276] 0709 12:10:33.380894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.377900 (+997006us) service_pool.cc:224] Handling call
0709 12:10:34.378242 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.382412 (+  4170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.382702 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:34.392920 29052 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
W20260709 12:10:34.582219 26513 leader_election.cc:336] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.627s (SENT)
W20260709 12:10:34.578770 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 228232us
W20260709 12:10:34.601454 26513 leader_election.cc:336] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.733s (SENT)
I20260709 12:10:34.410065 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:34.601996 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:34.408264 26471 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 7: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:34.377463 28980 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:34.475447 26613 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:34.587841 26466 rpcz_store.cc:276] 0709 12:10:32.987506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.987683 (+   177us) service_pool.cc:224] Handling call
0709 12:10:34.587189 (+1599506us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b540035f7d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d4853 00007f507b0a260a 00007f50746287d4 00007f5074628762 00007f5074628691 00007f507462860c 00007f50746278c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:34.587302 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825819008}
I20260709 12:10:34.475019 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:34.588578 29113 raft_consensus.cc:2764] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:10:34.524108 29103 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.293s	user 0.001s	sys 0.001s
I20260709 12:10:34.375536 28979 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:34.584760 29054 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:34.475765 28988 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:34.625515 28979 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:34.628831 26513 leader_election.cc:336] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.734s (SENT)
W20260709 12:10:34.629711 26513 leader_election.cc:336] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.770s (SENT)
I20260709 12:10:34.629922 28988 consensus_queue.cc:1059] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:34.471974 29051 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:34.590521 28975 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.593514 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:34.623461 29041 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:34.632948 28969 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:34.633103 26619 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:34.633972 28644 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:34.610584 28814 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.588797 26621 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:34.634747 28814 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:34.635185 28814 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.635980 26621 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:34.457366 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:34.603724 26614 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:34.587625 28948 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.567430 26467 raft_consensus.cc:2410] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:10:34.639425 29055 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.002s
I20260709 12:10:34.639849 29055 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:34.604156 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:34.606279 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:34.640825 26471 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.640975 26472 raft_consensus.cc:2368] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5.
I20260709 12:10:34.607404 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1763) took 1191 ms. Trace:
I20260709 12:10:34.642267 26613 rpcz_store.cc:276] 0709 12:10:33.416501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.397942 (+981441us) service_pool.cc:224] Handling call
0709 12:10:34.475257 (+ 77315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.607015 (+131758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.607338 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.643304 26619 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:34.392450 29021 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:10:34.458149 29030 consensus_meta.cc:287] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.695s	user 0.010s	sys 0.000s
I20260709 12:10:34.613529 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:34.602522 28720 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.612020 28980 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.434720 28706 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:34.482977 28708 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.463964 29018 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:34.533561 29023 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:34.631373 29051 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.626616 29111 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:34.640105 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:34.685669 29062 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.709520 26467 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.709825 29062 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:34.608291 26622 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:34.579136 26620 rpcz_store.cc:276] 0709 12:10:32.933667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.368488 (+1434821us) service_pool.cc:224] Handling call
0709 12:10:34.388990 (+ 20502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.389242 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.389283 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.389344 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:34.389403 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.389481 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.389633 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:34.643357 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.666287 29041 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:34.581158 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1769) took 1086 ms. Trace:
I20260709 12:10:34.719075 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:34.719336 26616 rpcz_store.cc:276] 0709 12:10:33.495170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.409494 (+914324us) service_pool.cc:224] Handling call
0709 12:10:34.466816 (+ 57322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.580833 (+114017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.581084 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.719789 26547 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:34.655666 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:34.657729 28720 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:34.411108 29035 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.665055 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:10:34.729844 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.652415 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:34.670140 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:34.686873 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 76729.2us
W20260709 12:10:34.690548 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 302338us
I20260709 12:10:34.731163 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:34.731478 26540 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.594818 29114 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.706197 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:34.705482 26471 raft_consensus.cc:2410] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:34.658221 29021 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:34.713760 26513 leader_election.cc:336] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.900s (SENT)
I20260709 12:10:34.740747 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:34.717288 26467 raft_consensus.cc:2410] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:10:34.713485 29120 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:10:34.720412 26542 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:34.661794 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:34.742672 26546 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.742834 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:10:34.692824 29032 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.001s
I20260709 12:10:34.686436 28706 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:34.694358 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 1542) took 1009 ms. Trace:
I20260709 12:10:34.748189 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:34.748061 26543 rpcz_store.cc:276] 0709 12:10:33.685424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.133883 (+448459us) service_pool.cc:224] Handling call
0709 12:10:34.694147 (+560264us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54001059d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:34.694292 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558758784}
I20260709 12:10:34.694754 29023 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.751071 29023 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.729703 28720 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.694502 29018 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:34.648836 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:34.757032 26539 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:34.685111 28803 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:10:34.762975 28803 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:34.763365 28803 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:34.717016 29111 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:34.690832 28822 consensus_meta.cc:287] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.002s
I20260709 12:10:34.764333 29111 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.764210 28803 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:34.705847 28708 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:34.744395 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:34.746308 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:34.746001 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:34.749437 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:34.746194 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 73494.9us
I20260709 12:10:34.750497 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:34.722014 29041 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:34.738112 26514 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:34.722224 27159 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:34.766001 28901 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:34.758577 28706 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:34.759915 29109 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:10:34.756786 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:34.761952 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 311) took 1272 ms. Trace:
I20260709 12:10:34.851029 26464 rpcz_store.cc:276] 0709 12:10:33.489253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.489411 (+   158us) service_pool.cc:224] Handling call
0709 12:10:33.489714 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.129132 (+639418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.761722 (+632590us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b54001c0554. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:34.761892 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1468751232}
I20260709 12:10:34.834532 26467 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:34.742098 28958 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.835148 26471 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:34.858055 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:34.766485 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:34.745299 29015 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:34.857981 28958 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.847365 29119 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:34.872035 26471 raft_consensus.cc:2393] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:34.872411 28958 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.873284 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:34.873900 26471 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.840246 29041 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:34.850262 29121 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:10:34.871424 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:34.745615 29051 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.110s
I20260709 12:10:34.896279 26466 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:10:34.901170 29106 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.435s	user 0.004s	sys 0.004s
I20260709 12:10:34.900516 28798 raft_consensus.cc:359] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc [term 2 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:34.903782 26472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:34.936590 26472 raft_consensus.cc:606] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:34.937106 26472 raft_consensus.cc:614] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:34.909346 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:34.938202 26464 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:34.765925 29018 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:34.886734 28706 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.913350 29055 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:34.877753 29017 raft_consensus.cc:3055] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:34.982487 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:34.982270 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:34.984162 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.983618 27166 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
W20260709 12:10:34.986845 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 272673us
I20260709 12:10:34.986980 26540 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:34.988632 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:34.890827 28726 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:35.012109 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1520) took 1225 ms. Trace:
I20260709 12:10:35.023190 26464 rpcz_store.cc:276] 0709 12:10:33.787102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.966674 (+1179572us) service_pool.cc:224] Handling call
0709 12:10:35.011592 (+ 44918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.011781 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.011806 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:35.011847 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:35.011877 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.011951 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.012051 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:35.012717 26466 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.024724 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:35.025099 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1523) took 1129 ms. Trace:
I20260709 12:10:35.025449 26466 rpcz_store.cc:276] 0709 12:10:33.896202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.012137 (+1115935us) service_pool.cc:224] Handling call
0709 12:10:35.012519 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.024848 (+ 12329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.025046 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:35.014642 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.014927 28962 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.006s	sys 0.016s
W20260709 12:10:35.020344 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.027917 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:35.028860 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.033179 28934 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.034708 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:35.028228 28962 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.006s	sys 0.016s
I20260709 12:10:35.035802 28962 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:35.036401 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:35.036780 28962 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:35.037185 28948 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:34.966416 29017 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:35.040122 29017 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:35.041067 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.041613 29017 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.041810 28934 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.043517 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:35.044936 26466 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:35.047549 26466 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 12:10:35.049504 26513 leader_election.cc:336] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 2.076s (SENT)
I20260709 12:10:35.050697 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:34.743525 28969 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.273s
I20260709 12:10:35.000385 28803 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.051565 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:35.055578 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:35.064348 26617 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:35.056830 29015 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:35.057837 26464 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:35.059712 26466 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:35.021050 26546 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:35.061930 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:35.022903 29113 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.069926 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:35.042469 28934 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:35.094890 26587 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:35.098733 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:35.100019 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:35.100728 26613 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.093806 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:35.083492 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.095423 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:35.069000 26622 raft_consensus.cc:2376] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11. Re-sending same reply.
I20260709 12:10:35.000223 28822 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:35.051858 29027 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:35.096637 29026 consensus_meta.cc:287] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.907s	user 0.000s	sys 0.036s
I20260709 12:10:35.104720 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:35.052680 28798 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:10:35.058743 28708 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:35.112562 26466 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:35.140811 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:35.142705 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:35.105722 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:35.068863 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:35.150813 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:35.127913 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:35.152699 26620 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.151563 26464 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:35.103677 29113 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:35.128321 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 98769.6us
I20260709 12:10:35.157810 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:35.161550 26544 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.129455 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:35.133016 26469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1508) took 1619 ms (client timeout 2052 ms). Trace:
I20260709 12:10:35.133478 26587 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:10:35.101194 28977 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.007s	sys 0.022s
I20260709 12:10:35.138876 26471 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:35.141583 26466 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 2.
I20260709 12:10:35.170818 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:10:35.163023 26469 rpcz_store.cc:269] 0709 12:10:33.513283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.513494 (+   211us) service_pool.cc:224] Handling call
0709 12:10:35.132834 (+1619340us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b540035f7d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:35.132953 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615630080}
I20260709 12:10:35.134572 29131 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:35.187458 29131 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.187887 29131 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:35.190480 28977 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.007s	sys 0.023s
I20260709 12:10:35.167145 29128 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:35.194703 26466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:35.195415 26466 raft_consensus.cc:606] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:35.195767 26466 raft_consensus.cc:614] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:35.143465 29054 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:35.199816 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.201015 26469 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:10:35.194913 29128 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:10:35.205317 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 71927.4us
I20260709 12:10:35.206326 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:35.138490 29015 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:35.204686 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:35.203516 26466 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:35.208253 26613 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:35.208477 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:35.209096 26466 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:35.211308 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:35.212729 26466 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:35.217164 26471 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 12:10:35.215775 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 58067us
I20260709 12:10:35.219796 26466 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:35.220296 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:35.102648 28979 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:35.156176 28708 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:35.214809 29097 consensus_meta.cc:287] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.847s	user 0.010s	sys 0.005s
I20260709 12:10:35.226744 29054 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:35.215039 29061 consensus_meta.cc:287] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.296s	user 0.010s	sys 0.007s
I20260709 12:10:35.138315 29027 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:35.215754 29015 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:35.246060 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.245738 27165 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:35.140210 29026 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:35.214514 29128 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.255718 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:35.259917 27166 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:35.231382 29114 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.226519 28798 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:35.362819 26439 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:35.237233 29130 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.239419 29054 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:35.253650 29015 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.264503 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:35.356204 29140 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 12:10:35.410794 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 48107us
W20260709 12:10:35.269731 28893 consensus_meta.cc:287] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.979s	user 0.009s	sys 0.004s
W20260709 12:10:35.262537 28968 consensus_meta.cc:287] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.080s	user 0.015s	sys 0.003s
W20260709 12:10:35.356791 29126 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
W20260709 12:10:35.355482 29138 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:10:35.450084 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:35.281841 28948 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:35.396097 26471 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:35.245745 29097 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:35.410624 28985 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:35.482963 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.328982 29142 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:10:35.293032 29143 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:35.487449 29143 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.439175 29052 raft_consensus.cc:2764] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:35.474520 26439 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:35.487788 29136 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.158s	user 0.001s	sys 0.001s
I20260709 12:10:35.257004 29093 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.488472 29093 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:35.489107 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1515) took 1800 ms. Trace:
I20260709 12:10:35.489471 26470 rpcz_store.cc:276] 0709 12:10:33.688215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.641275 (+953060us) service_pool.cc:224] Handling call
0709 12:10:34.641640 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:34.642009 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.642037 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:34.657934 (+ 15897us) log.cc:844] Serialized 26 byte log entry
0709 12:10:35.102661 (+444727us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:35.102717 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.102812 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:35.488898 (+386086us) raft_consensus.cc:1685] finished
0709 12:10:35.488919 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.489051 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":270389,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":132,"thread_start_us":380655,"threads_started":1,"wal-append.queue_time_us":537828}
I20260709 12:10:35.490679 29093 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:35.491523 29052 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:35.492182 29052 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.492561 29052 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.493301 28798 ts_tablet_manager.cc:1434] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 1.272s	user 0.016s	sys 0.019s
W20260709 12:10:35.493983 28798 ts_tablet_manager.cc:1467] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc: Tablet startup took 1284ms
I20260709 12:10:35.442821 28934 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:35.487864 29143 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.488845 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1521) took 1668 ms. Trace:
I20260709 12:10:35.491518 26439 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:35.476230 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 265047us
I20260709 12:10:35.497771 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:35.496238 26472 rpcz_store.cc:276] 0709 12:10:33.821102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.963777 (+1142675us) service_pool.cc:224] Handling call
0709 12:10:34.964274 (+   497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:34.964792 (+   518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.964834 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:34.965491 (+   657us) log.cc:844] Serialized 26 byte log entry
0709 12:10:35.048356 (+ 82865us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:35.048399 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.053662 (+  5263us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:35.488625 (+434963us) raft_consensus.cc:1685] finished
0709 12:10:35.488645 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.488780 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1490,"raft.queue_time_us":64435,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":13320,"thread_start_us":82386,"threads_started":1,"wal-append.queue_time_us":133248}
I20260709 12:10:35.446794 29054 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.501832 26439 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:35.239869 28708 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:35.503880 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:35.510758 26464 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:35.507599 28822 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:35.511251 26473 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:35.477083 28991 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:35.523960 29041 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.616s	user 0.016s	sys 0.000s
I20260709 12:10:35.530762 28991 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.531248 28991 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.530942 29041 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:35.526438 29021 consensus_meta.cc:287] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.773s	user 0.018s	sys 0.004s
W20260709 12:10:35.528185 28814 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.893s	user 0.025s	sys 0.016s
I20260709 12:10:35.534945 28814 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:35.536275 28987 consensus_meta.cc:287] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.163s	user 0.010s	sys 0.017s
I20260709 12:10:35.536751 28987 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:35.537622 28979 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:35.538726 26469 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.541723 29097 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:35.541357 29021 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:35.496306 28985 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:35.528321 28708 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:35.544431 28985 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:35.546952 29021 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:35.516206 28962 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:35.549139 28962 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.549515 28962 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:35.551771 28720 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.711s	user 0.012s	sys 0.018s
I20260709 12:10:35.552356 28720 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:35.553668 26618 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 4: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:35.513209 29135 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:35.555080 29135 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.555461 29135 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.513311 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:35.556933 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 43692.9us
I20260709 12:10:35.514036 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:35.532783 26544 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
W20260709 12:10:35.566484 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52480.9us
W20260709 12:10:35.516245 29141 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 12:10:35.570541 26620 raft_consensus.cc:2410] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:35.567585 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:35.515057 29026 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:35.574533 28852 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:35.546954 29111 consensus_meta.cc:287] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.782s	user 0.018s	sys 0.010s
I20260709 12:10:35.532872 28934 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:35.578090 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:35.578437 26439 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:35.565774 29129 raft_consensus.cc:2764] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:35.581857 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:35.575485 28708 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:35.588109 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:35.531963 29015 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:35.575001 28852 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.584828 29144 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:35.580277 28934 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:35.582233 29097 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:10:35.586982 28708 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.603462 29127 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
W20260709 12:10:35.604099 29150 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:10:35.581105 28985 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:10:35.604238 29149 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:35.606083 29036 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:35.597189 28822 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:35.608258 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:35.602430 29144 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:35.602902 28852 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.627943 28720 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:35.628692 29023 consensus_meta.cc:287] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.877s	user 0.009s	sys 0.001s
I20260709 12:10:35.619053 28708 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:35.600219 29115 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:10:35.668668 29115 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:35.669044 29115 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:35.669862 29115 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:35.671155 29115 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.671856 29119 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:35.672333 29119 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.672674 29119 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:35.633975 29017 consensus_meta.cc:287] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.011s
I20260709 12:10:35.634864 29131 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:35.499876 28798 ts_tablet_manager.cc:1469] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc: Trace:
0709 12:10:22.936676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.943584 (+  6908us) service_pool.cc:224] Handling call
0709 12:10:23.427968 (+484384us) ts_tablet_manager.cc:934] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
0709 12:10:26.047247 (+2619279us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:10:27.329705 (+1282458us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:27.346414 (+ 16709us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:10:27.584076 (+237662us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:10:27.584545 (+   469us) tablet_replica.cc:206] Creating consensus instance
0709 12:10:27.584966 (+   421us) ts_tablet_manager.cc:989] Replica registered.
0709 12:10:27.585102 (+   136us) inbound_call.cc:177] Queueing success response
0709 12:10:28.259263 (+674161us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:10:34.223409 (+5964146us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:10:34.382052 (+158643us) tablet_replica.cc:261] Starting instrumentation
0709 12:10:34.602750 (+220698us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":183147,"mutex_wait_us":9860,"raft.queue_time_us":27424,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":126,"tablet-copy.queue_time_us":458183,"tablet-download-pool.queue_time_us":7852,"tablet-download-pool.run_cpu_time_us":1526,"tablet-download-pool.run_wall_time_us":134617,"thread_start_us":189500,"threads_started":2}
I20260709 12:10:35.607385 29093 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.636458 26466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:39418
W20260709 12:10:35.638459 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.606618 28934 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:35.667910 28958 consensus_meta.cc:287] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.795s	user 0.013s	sys 0.011s
I20260709 12:10:35.641536 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:35.629985 28962 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:35.689095 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 47680.6us
I20260709 12:10:35.652616 29144 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:35.603494 29129 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:10:35.667080 28822 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:35.643730 29015 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:35.645139 27167 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56886 (request call id 477) took 1597 ms (client timeout 1869 ms). Trace:
W20260709 12:10:35.645669 28803 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.576s	user 0.003s	sys 0.012s
I20260709 12:10:35.616937 29061 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.633663 28975 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.705619 28975 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:35.667402 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 617889us
I20260709 12:10:35.620419 29027 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:35.674149 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 86088.4us
W20260709 12:10:35.676046 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.640074 28980 consensus_meta.cc:287] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.934s	user 0.018s	sys 0.019s
W20260709 12:10:35.680743 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 85288.2us
I20260709 12:10:35.691085 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:35.580785 29111 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:35.718791 28708 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:35.719437 29111 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:35.680795 26466 raft_consensus.cc:606] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:35.679641 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.640831 29036 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:35.648965 29127 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:35.621722 29052 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:35.655385 28979 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:35.678962 29064 consensus_meta.cc:287] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.275s	user 0.012s	sys 0.010s
I20260709 12:10:35.628983 29149 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:35.675190 28726 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.674023 29041 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:35.689260 28706 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.708s	user 0.006s	sys 0.005s
I20260709 12:10:35.737326 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:35.782852 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.824390 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:35.699755 27167 rpcz_store.cc:269] 0709 12:10:34.047767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.048556 (+   789us) service_pool.cc:224] Handling call
0709 12:10:35.644937 (+1596381us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400438854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:35.645071 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":425252608}
I20260709 12:10:35.678835 28969 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.704738 29061 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:35.711282 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:35.834581 26470 raft_consensus.cc:2410] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:35.835455 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:35.711047 26513 leader_election.cc:336] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 2.089s (SENT)
I20260709 12:10:35.712121 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:35.714779 26439 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:35.839087 26471 raft_consensus.cc:2410] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:35.694017 29093 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:35.695379 28958 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:35.841507 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:35.841745 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:35.842178 26539 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:35.842433 26471 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 11: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:35.841526 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:35.843538 26615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 1761) took 2431 ms (client timeout 1753 ms). Trace:
W20260709 12:10:35.843892 26615 rpcz_store.cc:269] 0709 12:10:33.401387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.424832 (+ 23445us) service_pool.cc:224] Handling call
0709 12:10:35.832250 (+2407418us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b540020a154. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:35.832403 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2269386112}
I20260709 12:10:35.845090 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:35.845237 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:35.845804 26547 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:35.724399 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:35.825322 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 96023.7us
I20260709 12:10:35.840960 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:35.853540 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:35.725008 26546 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:35.724929 28980 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:35.736933 29074 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.861080 29074 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:35.863875 29074 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:35.829303 26543 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:35.676452 29023 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:35.756070 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 1.01793e+06us
I20260709 12:10:35.828318 29127 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:10:35.831183 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.858222 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:35.876385 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:10:35.852550 29035 consensus_meta.cc:287] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.110s	user 0.011s	sys 0.007s
I20260709 12:10:35.736719 29036 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.863797 29093 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:35.833137 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:35.833509 26545 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:10:35.838932 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 127920us
I20260709 12:10:35.697190 29151 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:35.839152 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 124431us
I20260709 12:10:35.772316 29085 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.737066 28988 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.864037 28975 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:35.827777 29128 consensus_meta.cc:287] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.539s	user 0.006s	sys 0.011s
I20260709 12:10:35.865958 26514 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:35.827471 28822 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:35.900924 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:35.794875 28708 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:35.713457 29129 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:35.867923 29061 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:35.871105 29143 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:35.872020 29023 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:35.872720 26470 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 6: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:35.861985 28958 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:35.876722 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:35.755493 29017 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.152s
I20260709 12:10:35.877645 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:35.713502 29130 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.878788 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:35.833297 26472 raft_consensus.cc:2368] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5.
I20260709 12:10:35.880558 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:35.880813 27168 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 4: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:35.844515 27163 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:35.858613 28985 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:35.898384 26439 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:35.900096 26548 raft_consensus.cc:2410] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 12:10:35.947382 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 49092.5us
I20260709 12:10:35.948006 29023 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:35.948668 29023 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:35.949795 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:35.949707 29023 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:35.864881 29149 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:35.913641 29131 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:35.954495 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:35.902446 26514 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:10:35.955591 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 53248.1us
I20260709 12:10:35.878724 28979 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.906004 29128 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:35.967680 28980 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:35.843227 28969 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:35.971127 26622 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:35.971450 29143 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:35.934796 29021 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:35.911319 26513 leader_election.cc:336] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 2.275s (SENT)
I20260709 12:10:35.897324 29151 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:35.915136 26543 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.934221 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:35.905077 29129 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:35.881383 29035 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:35.977367 29151 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.939621 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:35.897054 29054 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:35.914992 29017 consensus_queue.cc:1243] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:35.945456 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:35.906219 29074 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:35.901881 26464 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:35.973028 29021 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:35.960625 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:36.007025 26619 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 4: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:36.008055 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:36.008747 26619 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 11: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:36.009541 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:36.010064 26619 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:35.961452 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:35.962572 28958 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:35.899477 28965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.989s	user 0.011s	sys 0.032s
W20260709 12:10:36.015594 28965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.106s	user 0.011s	sys 0.033s
I20260709 12:10:35.910255 29135 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:35.974670 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:35.973486 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:36.019706 26615 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
W20260709 12:10:36.019841 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 108553us
W20260709 12:10:36.020491 26513 leader_election.cc:336] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 2.493s (SENT)
I20260709 12:10:36.020884 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:36.020913 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:35.980643 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:36.022266 26543 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:35.913798 29127 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:35.988226 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:35.981578 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:35.991210 29111 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:10:35.994933 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:35.995663 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:35.997285 26468 raft_consensus.cc:2368] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7.
I20260709 12:10:35.998150 26620 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:35.951202 28962 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:35.972209 28985 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:36.005839 29074 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.024611 26613 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:10:36.001174 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47963us
I20260709 12:10:35.963253 28979 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:36.004705 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:35.974737 29154 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.960399 29052 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:36.012295 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:36.016283 28958 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.022358 29035 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:36.024164 27164 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 342) took 1281 ms. Trace:
I20260709 12:10:36.048502 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:36.050190 26548 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.969497 29144 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:36.002941 29158 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 12:10:36.051287 26438 connection.cc:256] RPC call timeout handler was delayed by -3.8166333830001804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
I20260709 12:10:36.033435 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:36.049871 27164 rpcz_store.cc:276] 0709 12:10:34.742301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.743271 (+   970us) service_pool.cc:224] Handling call
0709 12:10:35.647881 (+904610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.648116 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.648141 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:35.648183 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:35.648224 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.648283 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.023986 (+375703us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b5400438850. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:36.024103 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2030799232}
I20260709 12:10:36.053118 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:36.053247 26472 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.033257 26464 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
W20260709 12:10:36.054301 26438 connection.cc:256] RPC call timeout handler was delayed by -3.7968333830001484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260709 12:10:35.997630 28934 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:35.999233 26622 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:36.048913 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:36.048326 28975 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:36.052055 26617 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:36.032687 28644 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.063463 29135 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:36.063691 26541 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:36.059486 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:36.064839 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:36.065732 26541 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.037622 26546 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:36.049290 26471 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 7: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:10:35.989236 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.054785 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:36.051780 29127 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:36.056059 26438 connection.cc:256] RPC call timeout handler was delayed by -3.4323333830002412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
I20260709 12:10:36.060566 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:36.020660 28726 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.065991 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:36.073546 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:36.074066 26467 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 5: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:36.074115 26615 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:36.067629 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:36.028993 27167 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 6: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:36.034379 29074 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:36.069605 26622 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:36.064793 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:36.080611 26617 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:10:36.071089 26438 connection.cc:256] RPC call timeout handler was delayed by -3.4116333830002077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
W20260709 12:10:36.081604 26438 connection.cc:256] RPC call timeout handler was delayed by -2.7411333830002604s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2751s for a response
I20260709 12:10:36.071105 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:36.071278 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:36.072557 27165 raft_consensus.cc:2410] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:36.067888 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:36.078265 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:36.084779 26467 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 7: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:36.085777 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:36.086687 26467 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 5: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:36.091037 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:36.079510 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:36.082980 26619 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 5: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:36.083477 26545 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:36.091948 26543 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.103520 26546 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:36.055425 28958 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.024037 28969 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:36.076553 29017 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.067324 29114 consensus_queue.cc:1059] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 12:10:36.073457 28644 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:10:36.028005 28991 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:36.030164 28985 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:36.029801 29129 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:36.462193 29144 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:36.147102 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:36.106593 28575 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.387s
I20260709 12:10:36.439568 28720 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.299835 26548 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:10:36.475965 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:36.196786 26614 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:36.218963 29054 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:36.188439 26541 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
W20260709 12:10:36.477003 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 330003us
I20260709 12:10:36.477821 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:36.479156 26541 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:36.144948 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:36.154979 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:36.394219 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.480916 26513 leader_election.cc:336] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.732s (SENT)
I20260709 12:10:36.464403 26472 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:36.700410 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:36.701234 26472 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:10:36.701488 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.214576 28979 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:36.461584 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:36.335381 26473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1514) took 2647 ms (client timeout 3211 ms). Trace:
W20260709 12:10:36.463114 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 318361us
W20260709 12:10:36.704658 26473 rpcz_store.cc:269] 0709 12:10:33.687911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.239072 (+551161us) service_pool.cc:224] Handling call
0709 12:10:36.335151 (+2096079us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400165654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:36.335298 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2677105408}
I20260709 12:10:36.337527 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:36.355305 26617 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:36.707024 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:36.707674 26617 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.347841 26615 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:36.325321 26545 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
W20260709 12:10:36.438199 28852 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.746s	user 0.010s	sys 0.002s
I20260709 12:10:36.206357 26543 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:36.171989 29111 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.412s
I20260709 12:10:36.170936 28893 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.357s
I20260709 12:10:36.523454 28720 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:36.145486 29051 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:36.334127 29119 consensus_meta.cc:287] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.661s	user 0.007s	sys 0.005s
I20260709 12:10:36.214975 28934 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:36.746404 26617 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:36.186986 29128 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:36.692586 26467 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:10:36.459704 29085 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.002s
I20260709 12:10:36.692921 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:36.187778 29050 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.282s
I20260709 12:10:36.482561 26464 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 5: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:10:36.695556 29127 consensus_meta.cc:287] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.001s
W20260709 12:10:36.748423 28958 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.570s	user 0.008s	sys 0.005s
W20260709 12:10:36.702518 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 221619us
I20260709 12:10:36.216830 29036 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:36.711728 26439 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:36.716418 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:36.772369 26546 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:36.725531 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:36.773600 26543 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 5: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:36.774792 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:36.775790 26543 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:36.776849 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:36.726691 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:36.778903 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:36.779994 26545 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 7: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:36.781018 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:36.730293 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:36.739444 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:36.744606 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:36.745420 28893 raft_consensus.cc:3055] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:36.745621 28720 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:36.336388 29115 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.001s
I20260709 12:10:36.783070 26472 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 3: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:36.785264 29115 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:36.785835 29115 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.784329 28893 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:36.786382 29115 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.787389 28893 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:36.747568 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:36.789150 26617 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.789443 26473 raft_consensus.cc:2410] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:36.784125 26615 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:36.791373 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:36.792357 26615 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:36.793812 26615 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:36.785843 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:36.796934 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:36.798277 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:36.799405 26472 raft_consensus.cc:2410] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:36.799898 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2539) took 1090 ms. Trace:
I20260709 12:10:36.800297 26472 rpcz_store.cc:276] 0709 12:10:35.709260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.797963 (+1088703us) service_pool.cc:224] Handling call
0709 12:10:36.799831 (+  1868us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.801424 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:36.782366 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:36.803414 26617 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:36.803647 26545 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:36.805114 26617 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:36.805943 28893 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.811224 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:36.812668 29115 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:36.819078 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:36.820412 26472 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:36.821092 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2548) took 1052 ms. Trace:
I20260709 12:10:36.753285 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:36.826783 26467 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:36.828063 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:36.829026 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2544) took 1073 ms. Trace:
I20260709 12:10:36.758561 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1538) took 1035 ms. Trace:
I20260709 12:10:36.769811 29127 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:10:36.829651 26464 rpcz_store.cc:276] 0709 12:10:35.723153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.115387 (+392234us) service_pool.cc:224] Handling call
0709 12:10:36.758470 (+643083us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.830767 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:36.754165 29094 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.696543 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:36.831904 26541 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.724617 28852 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:36.772989 29112 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:36.823000 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:36.828878 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:36.707140 29054 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
W20260709 12:10:36.771579 26513 leader_election.cc:336] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 3.248s (SENT)
I20260709 12:10:36.703603 29024 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.835443 26472 rpcz_store.cc:276] 0709 12:10:35.768326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.818650 (+1050324us) service_pool.cc:224] Handling call
0709 12:10:36.821002 (+  2352us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.746047 29051 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:36.832845 26467 rpcz_store.cc:276] 0709 12:10:35.755768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.827699 (+1071931us) service_pool.cc:224] Handling call
0709 12:10:36.828969 (+  1270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.845685 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:36.846915 26467 raft_consensus.cc:2410] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:36.747967 29119 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:36.851591 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2540) took 1142 ms. Trace:
I20260709 12:10:36.852013 26467 rpcz_store.cc:276] 0709 12:10:35.709550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.845255 (+1135705us) service_pool.cc:224] Handling call
0709 12:10:36.851525 (+  6270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.839537 26548 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 7: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:36.841112 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:36.853921 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 82376us
I20260709 12:10:36.833045 26464 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 7: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:10:36.832544 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 133296us
I20260709 12:10:36.859043 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1540) took 1135 ms. Trace:
I20260709 12:10:36.859288 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:36.859591 26464 rpcz_store.cc:276] 0709 12:10:35.724001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.830489 (+1106488us) service_pool.cc:224] Handling call
0709 12:10:36.858960 (+ 28471us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.860671 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:36.860918 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:36.858050 26513 leader_election.cc:336] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.524s (SENT)
I20260709 12:10:36.861797 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:36.862483 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:36.821744 28958 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:36.837417 29117 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:36.861796 26464 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:36.867666 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2543) took 1146 ms. Trace:
I20260709 12:10:36.838943 29112 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:36.866600 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:36.868813 26464 rpcz_store.cc:276] 0709 12:10:35.723613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.860577 (+1136964us) service_pool.cc:224] Handling call
0709 12:10:36.867601 (+  7024us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.870276 26464 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:36.870920 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1534) took 1149 ms. Trace:
W20260709 12:10:36.871827 26513 leader_election.cc:336] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.751s (SENT)
I20260709 12:10:36.872714 26541 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:10:36.873986 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1537) took 1151 ms. Trace:
I20260709 12:10:36.874454 26467 rpcz_store.cc:276] 0709 12:10:35.722705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.852725 (+1130020us) service_pool.cc:224] Handling call
0709 12:10:36.873913 (+ 21188us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:36.865991 29043 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.472s	user 0.022s	sys 0.034s
W20260709 12:10:36.886719 29043 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.499s	user 0.023s	sys 0.034s
I20260709 12:10:36.865707 29085 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:36.888473 26540 raft_consensus.cc:2368] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6.
I20260709 12:10:36.888943 26467 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:36.890200 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:36.889652 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1535) took 1167 ms. Trace:
I20260709 12:10:36.891040 26472 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 3.
I20260709 12:10:36.891219 26467 rpcz_store.cc:276] 0709 12:10:35.722051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.875243 (+1153192us) service_pool.cc:224] Handling call
0709 12:10:36.875563 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.889385 (+ 13822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.889593 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.894287 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:36.895187 26548 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:36.836565 29094 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:36.898187 26467 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:36.866888 29054 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:36.904053 29115 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:36.898200 28991 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:36.888322 29111 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:36.899545 29054 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:36.906713 29054 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:36.907506 28852 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:36.907727 29054 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.908856 29036 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:36.851788 29017 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:10:36.912953 29017 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:36.913386 29017 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.913720 29017 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:36.916656 27159 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56886 (request call id 472) took 3939 ms (client timeout 2115 ms). Trace:
I20260709 12:10:36.916846 28958 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:36.917186 27159 rpcz_store.cc:269] 0709 12:10:32.977199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.001597 (+ 24398us) service_pool.cc:224] Handling call
0709 12:10:36.916425 (+3914828us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54006cf054. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:36.916566 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2369265920}
I20260709 12:10:36.919349 26617 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:36.920816 26588 leader_election.cc:336] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Timed out: RequestConsensusVote RPC to 127.24.179.68:35069 timed out after 1.869s (SENT)
I20260709 12:10:36.922474 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:36.924636 26545 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:10:36.926287 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.932858 26464 rpcz_store.cc:276] 0709 12:10:35.721736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.869601 (+1147865us) service_pool.cc:224] Handling call
0709 12:10:36.869907 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.870685 (+   778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.870868 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.934926 26464 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:36.941448 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:36.945472 29074 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.779s	user 0.008s	sys 0.003s
I20260709 12:10:36.946184 29074 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:36.953090 29112 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:36.955123 29112 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:36.958612 29151 consensus_meta.cc:287] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.953s	user 0.012s	sys 0.003s
I20260709 12:10:36.958818 29113 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:36.959793 29113 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:36.892405 29117 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:36.960609 29113 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:36.962813 26539 raft_consensus.cc:2368] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3.
I20260709 12:10:36.962988 29117 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:36.963903 29117 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:36.964495 26546 raft_consensus.cc:2410] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:36.949194 29074 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:36.961934 29113 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:36.952795 29024 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.959362 29151 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:36.936296 28977 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.936472 29159 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.980167 26472 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:36.981184 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1536) took 1258 ms. Trace:
I20260709 12:10:36.981616 26472 rpcz_store.cc:276] 0709 12:10:35.722364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.891841 (+1169477us) service_pool.cc:224] Handling call
0709 12:10:36.979662 (+ 87821us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.980810 (+  1148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.981101 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.985124 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:36.964515 29117 raft_consensus.cc:697] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:10:36.995607 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 275410us
I20260709 12:10:36.997427 26543 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:37.001315 26464 pending_rounds.cc:85] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 5
I20260709 12:10:37.001789 26464 pending_rounds.cc:107] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:37.002050 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:37.002527 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:37.002863 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:37.003355 26464 raft_consensus.cc:2889] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:37.005167 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:37.006719 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 295088us
I20260709 12:10:37.007202 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:37.008293 26514 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:37.009683 26439 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:36.984290 29159 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:37.011765 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.017493 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:37.018368 26472 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:37.015508 26439 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:37.023303 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:37.024045 26548 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 5: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:37.014219 28977 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.008579 29118 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.008731 29024 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.014338 29174 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:10:37.031704 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:37.021440 29151 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:37.025316 29173 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:37.025228 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:37.011464 29074 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:37.046710 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 180423us
I20260709 12:10:37.029664 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:37.022104 29054 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:37.047665 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:37.017016 29085 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.034562 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:37.032123 28977 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:37.040879 28987 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:37.035359 28893 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:37.044932 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2477) took 1061 ms. Trace:
I20260709 12:10:37.052325 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:37.052608 26622 rpcz_store.cc:276] 0709 12:10:35.983519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.107917 (+124398us) service_pool.cc:224] Handling call
0709 12:10:36.108342 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.174925 (+ 66583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.174979 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:36.546976 (+371997us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.000507 (+453531us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:37.000552 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.000636 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.044667 (+ 44031us) raft_consensus.cc:1685] finished
0709 12:10:37.044699 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.044860 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20659,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5007,"thread_start_us":253756,"threads_started":1,"wal-append.queue_time_us":321128}
W20260709 12:10:37.046891 26513 leader_election.cc:336] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.820s (SENT)
I20260709 12:10:37.055240 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:37.047672 26548 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:37.027593 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:37.012545 28958 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.049645 27133 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:10:37.057273 26513 leader_election.cc:336] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.996s (SENT)
I20260709 12:10:37.057835 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:37.059075 26513 leader_election.cc:336] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 2.026s (SENT)
I20260709 12:10:37.061596 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:37.062565 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:37.056568 29118 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:37.063051 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:37.064045 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:37.064428 26617 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.064700 26548 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.064042 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:37.066692 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:37.067425 26615 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 5: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:37.068397 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:37.052175 29168 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:37.051465 29085 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.070659 29036 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.059957 29074 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:37.071264 29036 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:37.070515 28893 consensus_queue.cc:1059] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:37.073469 26617 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:37.074199 27165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 351) took 1094 ms. Trace:
I20260709 12:10:37.074621 27165 rpcz_store.cc:276] 0709 12:10:35.980117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.981280 (+  1163us) service_pool.cc:224] Handling call
0709 12:10:37.074003 (+1092723us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b540060de54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:37.074138 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91405568}
W20260709 12:10:37.075825 27163 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 339) took 3187 ms (client timeout 2039 ms). Trace:
I20260709 12:10:37.077494 27133 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:37.078245 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.081409 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:37.078590 26548 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:37.073454 28977 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:37.078958 29151 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.058025 28958 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:37.052698 29173 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:37.092283 29176 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:37.093261 29062 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:37.093652 28958 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.078557 29168 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:10:37.076289 27163 rpcz_store.cc:269] 0709 12:10:33.888772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.894576 (+  5804us) service_pool.cc:224] Handling call
0709 12:10:37.075612 (+3181036us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b5400604854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:37.075739 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3781354240}
I20260709 12:10:37.052973 29054 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:37.054507 29111 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:37.060235 29115 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:37.089092 28987 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.109619 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2478) took 1125 ms. Trace:
I20260709 12:10:37.110056 26619 rpcz_store.cc:276] 0709 12:10:35.984086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.191420 (+207334us) service_pool.cc:224] Handling call
0709 12:10:36.437607 (+246187us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.449918 (+ 12311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.449951 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:36.476356 (+ 26405us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.006825 (+530469us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:37.006881 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.006950 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.109385 (+102435us) raft_consensus.cc:1685] finished
0709 12:10:37.109404 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.109548 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11711,"raft.queue_time_us":20329,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":169,"thread_start_us":300654,"threads_started":1,"wal-append.queue_time_us":507845}
I20260709 12:10:37.048928 29117 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:37.100579 29151 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:10:37.114562 29151 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:37.114938 29151 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:37.089551 29113 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:37.105814 29167 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:10:37.118290 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:37.099285 29176 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.126747 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:37.108822 29111 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.115799 29151 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:37.150353 29176 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.120354 29115 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:37.151799 29050 raft_consensus.cc:2764] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:37.166471 29054 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.119745 28987 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:37.168458 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:37.198583 27162 raft_consensus.cc:2410] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:37.152629 29113 raft_consensus.cc:697] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:10:37.206885 27162 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 346) took 2139 ms (client timeout 1777 ms). Trace:
W20260709 12:10:37.207051 29178 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 12:10:37.207366 27162 rpcz_store.cc:269] 0709 12:10:35.067377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.067540 (+   163us) service_pool.cc:224] Handling call
0709 12:10:37.168220 (+2100680us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:10:37.206794 (+ 38574us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5312896}
I20260709 12:10:37.207309 29113 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:37.210250 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:37.214923 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:37.214087 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:37.215744 26617 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 3: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:37.216601 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:37.197063 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:37.217170 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:37.155196 29111 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.220604 26622 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:37.221071 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:37.221256 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:37.221634 26464 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.222036 26622 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:37.225641 29069 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.742s	user 0.016s	sys 0.047s
W20260709 12:10:37.226114 29069 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.750s	user 0.016s	sys 0.047s
I20260709 12:10:37.227887 28893 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:37.197191 29159 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:37.162477 29173 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.236450 26619 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:37.238782 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:37.238608 29115 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:37.239508 26615 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.244232 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:37.245534 26541 raft_consensus.cc:2410] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:37.248596 26472 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 5: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:37.250269 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:37.251272 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:37.224540 28814 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:37.255985 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:37.223690 29118 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:37.256492 29039 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.234031 28575 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:37.235427 29024 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.234700 29151 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.265519 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:37.259720 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:37.261719 29039 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.255209 29097 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.279565 26464 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:37.256706 28822 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:37.264982 29127 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:37.292074 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:37.271231 28575 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.294883 29036 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:37.295857 26620 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:37.183477 29168 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:37.278366 29118 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:37.304875 27162 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:37.304965 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:37.307766 27165 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.292380 29112 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:37.289147 29085 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:37.292222 29043 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:37.301158 29117 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.301276 28575 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:37.318636 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:37.289804 29097 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.346240 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:37.344373 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:37.349792 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:37.352586 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:37.353170 28987 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:37.353315 27163 raft_consensus.cc:2376] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4. Re-sending same reply.
I20260709 12:10:37.351409 27161 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:37.352325 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:37.350040 29129 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.317150 29021 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:37.361460 29111 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.363160 29110 raft_consensus.cc:3055] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:37.363969 29110 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:37.368412 29039 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:37.314337 29112 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:37.369611 29112 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.369781 29017 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:37.373010 29097 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:37.365281 29110 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:37.304733 29113 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:10:37.354445 29043 raft_consensus.cc:697] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:37.391571 29018 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.404709 29158 raft_consensus.cc:3055] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:37.405318 29158 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:37.406378 29158 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.373606 29118 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:37.411329 29043 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:37.386307 29185 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:10:37.393981 29114 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:37.395131 29113 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:37.414744 29114 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:37.414918 29113 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:37.415730 29114 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.417115 29114 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.416420 29113 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:37.417624 29158 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.418249 29113 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.387609 29176 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:37.397635 29111 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:37.398149 29094 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:37.399768 29051 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:37.395385 29171 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:37.427297 29171 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:37.428965 29171 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:37.431334 29171 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.426131 29176 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:37.346485 29117 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:37.409652 29119 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:37.392740 29110 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.440980 29117 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:37.288321 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:37.474296 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:37.475907 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 249538us
I20260709 12:10:37.476329 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:37.477453 26542 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:37.477710 26464 raft_consensus.cc:2368] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7.
I20260709 12:10:37.477890 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:37.479952 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:37.481842 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:37.483089 26464 raft_consensus.cc:2368] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5.
I20260709 12:10:37.484344 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:37.490489 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.486063 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:37.495335 26464 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.500509 26615 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:37.500670 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:37.501739 26620 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:37.502174 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:37.503217 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:37.503293 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:37.503840 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:37.504585 26620 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 7: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:37.504724 26615 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.505039 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:37.505579 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.394646 28958 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:37.394299 29017 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:37.514040 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:37.567866 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:37.567539 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.576771 29051 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:37.578214 29119 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:37.579806 29151 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.580132 29119 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:37.580744 29119 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:37.580864 29151 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:37.582649 29129 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.583566 29129 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.593638 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:37.530444 26632 tablet_copy_service.cc:342] P aaadfdd9ca9f424c91505f9b43876233: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-c4646c5ce9a9467da50e9f3587b11ad5 received from {username='slave'} at 127.0.0.1:48232
I20260709 12:10:37.599169 26632 tablet_copy_service.cc:434] P aaadfdd9ca9f424c91505f9b43876233: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-c4646c5ce9a9467da50e9f3587b11ad5 on tablet c4646c5ce9a9467da50e9f3587b11ad5 with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:37.600098 29129 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:37.595667 27159 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 6: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:37.615691 28986 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:37.627207 28986 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:37.629534 28958 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:37.615175 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:37.591981 26514 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:10:37.632790 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 104956us
I20260709 12:10:37.633956 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:37.641197 26622 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 2.
W20260709 12:10:37.617281 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 356607us
W20260709 12:10:37.651474 26466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2532) took 1944 ms (client timeout 1734 ms). Trace:
W20260709 12:10:37.653318 26470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2545) took 1885 ms (client timeout 1628 ms). Trace:
I20260709 12:10:37.648273 29119 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:37.655479 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.655556 29119 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:37.651515 26468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2505) took 3388 ms (client timeout 2076 ms). Trace:
W20260709 12:10:37.656315 26468 rpcz_store.cc:269] 0709 12:10:34.262924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.382681 (+119757us) service_pool.cc:224] Handling call
0709 12:10:37.650966 (+3268285us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54001fead4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:37.651188 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3206995840}
W20260709 12:10:37.656778 26542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 1563) took 1827 ms (client timeout 1533 ms). Trace:
I20260709 12:10:37.616535 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:10:37.657302 26542 rpcz_store.cc:269] 0709 12:10:35.829602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.830733 (+  1131us) service_pool.cc:224] Handling call
0709 12:10:37.196854 (+1366121us) spinlock_profiling.cc:243] Waited 9.2 ms on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:10:37.656448 (+459594us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b5400106dd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:37.656614 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616280320}
I20260709 12:10:37.657908 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:37.659404 26544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 1551) took 2995 ms (client timeout 1527 ms). Trace:
W20260709 12:10:37.651975 26466 rpcz_store.cc:269] 0709 12:10:35.707346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.845761 (+138415us) service_pool.cc:224] Handling call
0709 12:10:37.650997 (+1805236us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b540006a4d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:37.651274 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2221843712}
W20260709 12:10:37.659922 26544 rpcz_store.cc:269] 0709 12:10:34.663838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.663989 (+   151us) service_pool.cc:224] Handling call
0709 12:10:37.658992 (+2995003us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b54001054d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:37.659193 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":976190336}
I20260709 12:10:37.661909 26466 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:37.662667 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1668) took 1580 ms. Trace:
I20260709 12:10:37.663185 26543 rpcz_store.cc:276] 0709 12:10:36.082373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.776510 (+694137us) service_pool.cc:224] Handling call
0709 12:10:37.662197 (+885687us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54002369d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:37.662470 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":473984384}
I20260709 12:10:37.664038 26466 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 12:10:37.665386 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.665908 26465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2500) took 3519 ms (client timeout 1770 ms). Trace:
I20260709 12:10:37.666574 26468 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
W20260709 12:10:37.653851 26470 rpcz_store.cc:269] 0709 12:10:35.767320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.844896 (+ 77576us) service_pool.cc:224] Handling call
0709 12:10:37.652754 (+1807858us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b54001fefd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:37.653066 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60850944}
I20260709 12:10:37.655325 26467 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:37.668675 26539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 1567) took 1792 ms (client timeout 2175 ms). Trace:
W20260709 12:10:37.669158 26539 rpcz_store.cc:269] 0709 12:10:35.876277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.876451 (+   174us) service_pool.cc:224] Handling call
0709 12:10:37.668213 (+1791762us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002f8ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:37.668476 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2413074176}
W20260709 12:10:37.670555 26465 rpcz_store.cc:269] 0709 12:10:34.146274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.180545 (+ 34271us) service_pool.cc:224] Handling call
0709 12:10:37.665434 (+3484889us) spinlock_profiling.cc:243] Waited 2.71 s on lock 0x7b54002dc154. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:37.665705 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6226315520}
I20260709 12:10:37.664808 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:37.673748 26543 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 3.
I20260709 12:10:37.675544 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:37.676522 26543 raft_consensus.cc:2376] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4. Re-sending same reply.
I20260709 12:10:37.676843 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2472) took 1698 ms. Trace:
I20260709 12:10:37.677367 26614 rpcz_store.cc:276] 0709 12:10:35.978706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.979542 (+   836us) service_pool.cc:224] Handling call
0709 12:10:35.991425 (+ 11883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.476948 (+485523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.676211 (+1199263us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400346054. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:37.676628 (+   417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471679872}
W20260709 12:10:37.664446 26540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 1560) took 1940 ms (client timeout 2096 ms). Trace:
I20260709 12:10:37.664004 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:10:37.678649 26540 rpcz_store.cc:269] 0709 12:10:35.723615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.723761 (+   146us) service_pool.cc:224] Handling call
0709 12:10:36.337306 (+613545us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:10:37.626382 (+1289076us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b5400398ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:37.664242 (+ 37860us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":427902080}
I20260709 12:10:37.679400 27159 raft_consensus.cc:2368] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 3. Current term is 4.
I20260709 12:10:37.680233 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:37.680604 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:37.680987 26540 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.681910 27159 raft_consensus.cc:2410] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:10:37.682109 26618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2466) took 3305 ms (client timeout 1738 ms). Trace:
W20260709 12:10:37.682585 26618 rpcz_store.cc:269] 0709 12:10:34.376159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.392965 (+ 16806us) service_pool.cc:224] Handling call
0709 12:10:37.681715 (+3288750us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b540037a854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:37.681911 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2106891136}
W20260709 12:10:37.684100 26471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2552) took 1844 ms (client timeout 1751 ms). Trace:
W20260709 12:10:37.684540 26471 rpcz_store.cc:269] 0709 12:10:35.769750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.913783 (+144033us) service_pool.cc:224] Handling call
0709 12:10:37.613457 (+1699674us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b54003151d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:37.613877 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86539648}
I20260709 12:10:37.688488 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48222 (request call id 9) took 4979 ms. Trace:
W20260709 12:10:37.688906 26514 leader_election.cc:336] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Timed out: RequestConsensusVote RPC to 127.24.179.68:35069 timed out after 1.627s (SENT)
I20260709 12:10:37.689155 26621 rpcz_store.cc:276] 0709 12:10:32.709337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.636775 (+1927438us) service_pool.cc:224] Handling call
0709 12:10:37.687824 (+3051049us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b540009f6d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760e0735 00007f507b0a0d29 00007f507461f1d4 00007f507461f162 00007f507461f091 00007f507461f00c 00007f507461e2c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:37.688191 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2070843648}
I20260709 12:10:37.689733 26514 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:37.692163 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:37.693864 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:37.697103 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:37.697722 26464 raft_consensus.cc:2410] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:37.698885 28986 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:37.700012 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:10:37.617089 26473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2538) took 1908 ms (client timeout 2275 ms). Trace:
W20260709 12:10:37.703626 26473 rpcz_store.cc:269] 0709 12:10:35.708972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.715391 (+1006419us) service_pool.cc:224] Handling call
0709 12:10:37.616485 (+901094us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b540035edd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:37.616841 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12546816}
W20260709 12:10:37.704303 27168 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 349) took 2534 ms (client timeout 1793 ms). Trace:
W20260709 12:10:37.704945 27168 rpcz_store.cc:269] 0709 12:10:35.169907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.203008 (+ 33101us) service_pool.cc:224] Handling call
0709 12:10:37.703706 (+2500698us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b540014fad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:37.704028 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1548001024}
W20260709 12:10:37.706808 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47917.9us
I20260709 12:10:37.709606 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:37.649814 29023 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.711011 27164 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:37.672278 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:37.712423 26539 raft_consensus.cc:2410] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:10:37.712007 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 61454us
I20260709 12:10:37.711216 29023 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.714311 27159 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:37.716576 29023 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:37.716341 28575 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.711169 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:37.717579 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:37.717990 26541 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 8: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:37.718325 26622 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.724222 28575 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:37.718637 26539 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 3: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:37.683038 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:37.665992 26466 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:37.729647 26615 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:37.731215 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:10:37.732682 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.678071 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:37.734524 26619 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:37.736159 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:37.725010 26439 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:37.737936 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:37.737046 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2515) took 3016 ms. Trace:
I20260709 12:10:37.749951 27163 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
W20260709 12:10:37.742291 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet b9bd8978cfc74b93bcc4755ec8254fa7: Illegal state: Replica aaadfdd9ca9f424c91505f9b43876233 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:10:37.742902 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:10:37.743872 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 46094us
I20260709 12:10:37.744613 29171 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:37.745436 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:37.747668 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:37.780018 26614 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:37.750737 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.751725 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:37.753598 29118 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:37.755223 26542 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 7: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:37.698017 27162 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
W20260709 12:10:37.759524 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 70737.8us
I20260709 12:10:37.762504 26468 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:37.764046 29069 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:37.722601 29023 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.772280 26541 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:10:37.741870 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1674) took 1542 ms. Trace:
I20260709 12:10:37.741935 26540 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:37.741892 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:37.722374 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:37.765933 27165 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:37.776851 26469 rpcz_store.cc:276] 0709 12:10:34.719125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.201950 (+482825us) service_pool.cc:224] Handling call
0709 12:10:35.202432 (+   482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.539289 (+336857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.733446 (+2194157us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54001a8954. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:37.735848 (+  2402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":772792704}
I20260709 12:10:37.796977 26622 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:37.799075 26543 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.789091 26545 rpcz_store.cc:276] 0709 12:10:36.198969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.810856 (+611887us) service_pool.cc:224] Handling call
0709 12:10:37.741342 (+930486us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54001068d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:37.741634 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257279232}
W20260709 12:10:37.799016 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 74194.1us
I20260709 12:10:37.798748 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 322) took 1730 ms. Trace:
I20260709 12:10:37.809194 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1681) took 1037 ms. Trace:
I20260709 12:10:37.812633 26541 rpcz_store.cc:276] 0709 12:10:36.756230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.771281 (+1015051us) service_pool.cc:224] Handling call
0709 12:10:37.771946 (+   665us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.793213 (+ 21267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.793560 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:37.814057 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:37.807173 26467 rpcz_store.cc:276] 0709 12:10:36.052243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.900157 (+847914us) service_pool.cc:224] Handling call
0709 12:10:37.654727 (+754570us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:37.669106 (+ 14379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.779185 (+110079us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54001fefd0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:37.782569 (+  3384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1732368640}
I20260709 12:10:37.808926 29118 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:10:37.822117 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.823079 26542 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:37.823541 29113 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.824146 29113 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:37.824679 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 79769.8us
I20260709 12:10:37.825759 26542 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:37.826862 29113 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:37.827829 29173 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.828266 29198 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.828487 29173 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.829264 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:37.829494 29115 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:37.830153 29115 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:37.830330 26464 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:37.830683 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:37.831615 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:37.826879 26539 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.832973 26469 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:37.833050 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:37.834004 26471 raft_consensus.cc:2368] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6.
I20260709 12:10:37.834213 26621 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:37.834793 29112 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:37.835381 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:37.837932 28852 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.838728 28852 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.840215 26548 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:37.840991 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1685) took 1003 ms. Trace:
I20260709 12:10:37.841508 26548 rpcz_store.cc:276] 0709 12:10:36.837883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.737374 (+899491us) service_pool.cc:224] Handling call
0709 12:10:37.840898 (+103524us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:37.809228 29171 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:37.851552 26468 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:37.852252 29171 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:37.854902 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:37.856389 26613 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 4: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:37.857128 27134 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:37.822024 26547 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:37.865331 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:37.826956 28986 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.867576 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:37.868309 29118 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.829216 29198 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.871296 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:37.872393 26545 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:10:37.875245 26540 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:37.873797 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:37.832110 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:37.878885 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:37.882936 26547 raft_consensus.cc:2393] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:10:37.885241 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.889310 26514 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:37.887480 27134 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:37.895884 26470 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 7: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:37.899478 29054 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.900894 29198 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:37.903124 29069 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:37.903891 29069 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:37.897256 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:37.905184 26548 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:37.905212 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:37.896876 26545 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 2.
I20260709 12:10:37.907877 26615 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.892268 29171 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:37.909446 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:37.914225 29069 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.916241 29110 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:37.916873 29110 raft_consensus.cc:697] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:37.917007 29151 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:37.911674 29113 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.919440 29110 consensus_queue.cc:237] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.938362 29113 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.938858 29113 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.943079 29157 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.943817 29157 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.944671 29054 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.923696 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:37.912011 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:37.938870 26544 raft_consensus.cc:2410] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:37.924378 27160 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
W20260709 12:10:37.926573 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 204496us
I20260709 12:10:37.921108 27134 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:37.929150 26615 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:37.912408 29171 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.936872 28893 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.945075 26546 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:37.920367 26545 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:10:37.948248 26540 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:37.831507 29115 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.952687 28893 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:37.954293 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:37.951683 26545 pending_rounds.cc:85] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 4
I20260709 12:10:37.956774 26547 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.956468 29173 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:37.840369 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:37.958329 29151 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:37.955279 26545 pending_rounds.cc:107] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:10:37.951377 29171 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.961149 26545 raft_consensus.cc:2889] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:37.970047 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:37.972250 26546 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:37.965749 28986 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:37.980480 26540 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:37.987738 26614 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
W20260709 12:10:37.995404 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 71764.9us
W20260709 12:10:38.001188 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 119944us
I20260709 12:10:37.997225 26542 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:37.999090 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 78163.3us
I20260709 12:10:38.004370 26615 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:38.005328 26545 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:10:38.007335 26540 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:38.011449 26371 catalog_manager.cc:5697] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 4 to 5, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 5 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:38.021149 26543 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:38.022068 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1694) took 1110 ms. Trace:
I20260709 12:10:38.022887 26543 rpcz_store.cc:276] 0709 12:10:36.911429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.677553 (+766124us) service_pool.cc:224] Handling call
0709 12:10:38.021864 (+344311us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:38.028748 26514 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:38.008579 28986 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:38.032183 28986 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:38.035526 26371 catalog_manager.cc:5697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 4 to 5, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 5 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:38.038971 28893 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:38.042708 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 79432.5us
I20260709 12:10:38.014575 29119 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:38.037845 26371 catalog_manager.cc:5697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 2 to 3, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 3 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:38.019381 29157 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:38.050799 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:38.054873 26539 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:38.055708 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:38.056763 26547 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:10:38.064278 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:38.068339 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 115085us
W20260709 12:10:38.070636 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 61393.6us
I20260709 12:10:38.071457 28814 raft_consensus.cc:2764] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:38.072057 26544 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:38.062728 29094 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.054621 27161 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:38.093415 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:38.071517 29168 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:38.094619 29168 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.095167 29168 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.096093 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:38.065438 26371 catalog_manager.cc:5697] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 2 to 5, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 5 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:38.099354 28852 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:38.100052 26615 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:38.100833 26588 leader_election.cc:400] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 3. Current term is 4.
I20260709 12:10:38.104977 26588 leader_election.cc:403] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:38.105355 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1785) took 2142 ms. Trace:
I20260709 12:10:38.111065 26614 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:38.112373 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 56806.5us
I20260709 12:10:38.114647 26615 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:10:38.115482 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 51392.4us
I20260709 12:10:38.083096 29157 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:38.105615 29151 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:38.103879 29118 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:38.122349 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.122553 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:38.128697 29118 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:38.129621 29117 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.132108 28814 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:38.132330 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:38.133747 26615 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:38.121479 28852 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 3. Current term is 4.
W20260709 12:10:38.135892 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.141681 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 95311.4us
I20260709 12:10:38.142652 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:38.145107 29018 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:38.147912 29018 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:38.149065 29018 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:38.150741 28852 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:38.152706 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:38.152938 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1696) took 1158 ms. Trace:
I20260709 12:10:38.153966 26548 rpcz_store.cc:276] 0709 12:10:36.994526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.908249 (+913723us) service_pool.cc:224] Handling call
0709 12:10:37.925404 (+ 17155us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.925985 (+   581us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:37.926018 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:37.934761 (+  8743us) log.cc:844] Serialized 26 byte log entry
0709 12:10:38.044844 (+110083us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:38.044900 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.045082 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:38.152567 (+107485us) raft_consensus.cc:1685] finished
0709 12:10:38.152600 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.152823 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1325,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"thread_start_us":109508,"threads_started":1,"wal-append.queue_time_us":185043}
I20260709 12:10:38.156697 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:38.165393 26514 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:38.107407 26616 rpcz_store.cc:276] 0709 12:10:35.958992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.975611 (+ 16619us) service_pool.cc:224] Handling call
0709 12:10:35.977476 (+  1865us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:35.977878 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.977925 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:35.992015 (+ 14090us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.680916 (+1688901us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b18002bf960. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:10:37.912548 (+231632us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:37.912607 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.928037 (+ 15430us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:38.101136 (+173099us) raft_consensus.cc:1685] finished
0709 12:10:38.101165 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.101475 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1153,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":6995,"spinlock_wait_cycles":10276096,"thread_start_us":199631,"threads_started":1,"wal-append.queue_time_us":2049240}
W20260709 12:10:38.201078 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 44532.3us
I20260709 12:10:38.221596 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:38.221886 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:38.222453 27165 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:38.225800 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:38.198091 28575 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:38.237686 27162 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:38.238655 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.242347 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 96453us
I20260709 12:10:38.216754 29018 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.267473 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:38.268800 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:38.269469 26618 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:38.245645 28814 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:38.247743 26588 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:38.246897 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.270964 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:38.270803 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:38.272306 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:38.249745 29210 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:38.243153 28575 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:38.254630 29204 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:10:38.255025 29024 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:10:38.255823 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:38.257584 29151 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:38.282620 29151 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:38.283794 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:38.283964 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:38.284754 26466 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.285336 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:38.286041 26471 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.285965 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:38.259646 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.264062 26371 catalog_manager.cc:5697] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 3 to 5, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 5 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:38.287492 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:38.288175 26470 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:10:38.287676 26371 catalog_manager.cc:5697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:38.259073 27163 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:38.278213 28575 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.266676 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:38.267007 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 50761.4us
I20260709 12:10:38.289398 26371 catalog_manager.cc:5697] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 3 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 4 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:38.291666 26371 catalog_manager.cc:5697] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 1 to 3, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:38.293023 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:38.294027 29157 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.247640 29113 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:38.274920 26622 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 8: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:38.296249 29113 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:38.296954 29113 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:38.297363 29113 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:38.299173 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:38.284088 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:38.266234 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:38.275128 26614 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:38.270903 26541 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:38.306157 26620 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:38.309336 26467 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:38.280201 29117 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:38.314951 26471 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:38.316044 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1695) took 1327 ms. Trace:
I20260709 12:10:38.317015 26541 rpcz_store.cc:276] 0709 12:10:36.983251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.913232 (+929981us) service_pool.cc:224] Handling call
0709 12:10:37.915656 (+  2424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.304113 (+388457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.310523 (+  6410us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b5400106dd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:38.310675 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":816519424}
I20260709 12:10:38.323240 28948 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:38.323664 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:38.324437 28948 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:38.324795 29198 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:38.324978 28948 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.325409 29198 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:38.326550 29157 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:38.326634 29198 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:38.327652 29054 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:38.328147 29054 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:38.321137 28986 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:38.329262 29054 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:38.336835 29168 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:38.337817 28852 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:38.338245 27166 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 8: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
W20260709 12:10:38.337860 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.338481 28852 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:38.338335 29054 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.339702 28852 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:38.342335 29168 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:38.351198 29115 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:38.352857 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:38.353071 29115 consensus_queue.cc:1243] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:38.356201 29157 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:38.356815 29157 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:38.358613 29157 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:38.360260 29157 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.298345 29113 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:38.369583 29118 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:38.369843 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:38.371372 26619 raft_consensus.cc:2410] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:38.371825 29171 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:38.375002 29171 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:38.376170 26466 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:10:38.378844 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:38.379951 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 132344us
W20260709 12:10:38.404855 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 52082.8us
W20260709 12:10:38.409498 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.409193 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 171953us
I20260709 12:10:38.413475 27134 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:38.415812 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 319816us
I20260709 12:10:38.416908 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:38.409206 29173 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:38.421800 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 90751.1us
I20260709 12:10:38.397271 29115 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.412796 28986 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:38.426239 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:38.433068 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:38.435444 28575 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:38.426232 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 170590us
I20260709 12:10:38.433136 27134 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:38.423884 28814 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:38.434320 29171 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:38.433837 29168 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:38.449154 26366 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57048 (request call id 300) took 9937 ms. Trace:
I20260709 12:10:38.449446 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:38.450095 26622 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.449581 26366 rpcz_store.cc:276] 0709 12:10:28.474944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.487838 (+ 12894us) service_pool.cc:224] Handling call
0709 12:10:38.409125 (+9921287us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:34.393769 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:34.589871 (+196102us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:34.589909 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:10:34.589931 (+    22us) tablet.cc:662] Decoding operations
0709 12:10:34.860518 (+270587us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:34.860662 (+   144us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:34.860711 (+    49us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:10:34.861955 (+  1244us) tablet.cc:701] Row locks acquired
0709 12:10:34.861986 (+    31us) write_op.cc:260] PREPARE: finished
0709 12:10:34.862207 (+   221us) write_op.cc:270] Start()
0709 12:10:34.862857 (+   650us) write_op.cc:276] Timestamp: P: 1783599034862135 usec, L: 0
0709 12:10:34.862913 (+    56us) op_driver.cc:348] REPLICATION: starting
0709 12:10:34.864173 (+  1260us) log.cc:844] Serialized 4025 byte log entry
0709 12:10:35.540061 (+675888us) op_driver.cc:464] REPLICATION: finished
0709 12:10:36.977636 (+1437575us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b1800330fa0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:10:36.977875 (+   239us) write_op.cc:301] APPLY: starting
0709 12:10:36.977989 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:36.978315 (+   326us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:36.978350 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:37.092543 (+114193us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:37.092888 (+   345us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:10:37.092939 (+    51us) write_op.cc:312] APPLY: finished
0709 12:10:37.093246 (+   307us) log.cc:844] Serialized 77 byte log entry
0709 12:10:37.151335 (+ 58089us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:37.154870 (+  3535us) write_op.cc:454] Released schema lock
0709 12:10:37.154949 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:37.206599 (+ 51650us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:37.212522 (+  5923us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5917,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":55754,"apply.run_cpu_time_us":17479,"apply.run_wall_time_us":195555,"num_ops":10,"prepare.queue_time_us":251533,"prepare.run_cpu_time_us":23741,"prepare.run_wall_time_us":686603,"raft.queue_time_us":327938,"raft.run_cpu_time_us":5222,"raft.run_wall_time_us":101945,"replication_time_us":649855,"spinlock_wait_cycles":11514624,"thread_start_us":598835,"threads_started":5,"wal-append.queue_time_us":364972,"wal-append.run_cpu_time_us":27284,"wal-append.run_wall_time_us":2310050}]]}
I20260709 12:10:38.455240 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:38.456039 26614 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.448323 29173 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:38.463366 26620 raft_consensus.cc:3055] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:38.463593 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:38.464862 28575 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:38.463953 26620 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:38.463506 29168 raft_consensus.cc:697] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:38.448253 29117 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:38.468130 29117 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.468559 29117 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.468457 29168 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:38.449164 29043 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:10:38.470896 29215 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:38.462944 29211 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:38.474737 26622 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
W20260709 12:10:38.475841 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 51800.5us
I20260709 12:10:38.448433 29171 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.478027 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:38.480672 26588 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:38.482471 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 44311.6us
I20260709 12:10:38.480355 29171 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.471819 29018 consensus_queue.cc:1059] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:10:38.491600 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:38.491478 29151 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:38.492516 26513 leader_election.cc:336] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 2.004s (SENT)
I20260709 12:10:38.479238 29221 raft_consensus.cc:2764] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:38.480535 29211 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:38.497871 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:38.499637 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.499667 27134 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:38.502902 28814 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:38.503427 29211 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:38.504364 28948 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:38.506196 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:38.508216 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:38.509740 29210 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:38.511541 29215 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:38.511816 29151 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:38.512264 29215 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:38.513361 29215 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:38.514367 29115 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.515316 29115 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:38.516140 29115 consensus_queue.cc:1243] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:38.516602 29115 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:38.517071 29115 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:38.518481 29198 raft_consensus.cc:3055] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:38.518908 29198 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:38.521267 29217 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:38.521973 29217 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:38.526019 26614 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:38.527838 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:38.522419 29018 consensus_queue.cc:1243] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 6.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:10:38.530580 26619 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.495783 29054 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:38.522336 29117 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:38.541949 29219 raft_consensus.cc:2764] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:38.542088 28948 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:38.543238 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:38.508239 29113 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.553995 26614 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:38.557024 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 57442.4us
I20260709 12:10:38.540079 29173 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:38.560854 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 63070.6us
I20260709 12:10:38.559937 27134 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:38.543512 29054 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.519889 29198 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:38.562083 29054 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.562803 29198 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.572052 29227 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:38.572803 29227 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:10:38.573750 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 79603us
I20260709 12:10:38.518026 29115 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:38.576603 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:38.578616 28575 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:38.581868 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:38.582855 27160 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:38.586979 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 78888.4us
I20260709 12:10:38.589800 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:38.553886 28852 raft_consensus.cc:2764] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:10:38.593668 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.543190 29221 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:10:38.599705 26619 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:10:38.603670 26616 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:38.602836 29043 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:38.526089 28986 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:38.621196 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:38.622182 26539 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:38.622462 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:38.623353 26548 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.607983 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:38.627918 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:38.628372 28575 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.592469 29117 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:38.629148 26547 raft_consensus.cc:2393] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:10:38.632556 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 89497.3us
I20260709 12:10:38.628966 28575 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:38.636055 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.637404 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:38.638017 26544 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.634953 26514 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:38.640297 26514 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:38.618858 29043 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:38.634707 26513 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.617s (SENT) [suppressed 36 similar messages]
I20260709 12:10:38.641513 26541 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:10:38.556713 29217 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:38.614164 29215 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:10:38.593953 29226 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:10:38.624876 29173 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:10:38.642864 29118 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:38.652107 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 58838.6us
I20260709 12:10:38.644376 29043 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.634159 29054 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:38.650671 29069 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:38.657766 27166 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:38.643810 29227 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:38.670316 29235 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:38.692514 26548 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:38.645247 29094 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:10:38.695391 26544 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
W20260709 12:10:38.714108 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 79425.3us
I20260709 12:10:38.783111 26539 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 3.
W20260709 12:10:38.784992 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 69453.9us
W20260709 12:10:38.790174 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.805542 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:38.813912 26544 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:38.817605 29117 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:38.818228 29117 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:38.824422 29117 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:38.831298 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 158325us
W20260709 12:10:38.832028 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 56839us
W20260709 12:10:38.834283 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 145509us
W20260709 12:10:38.836895 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.704922 29211 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 12:10:38.840584 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:38.840950 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:38.841353 26539 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:38.842957 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.854314 29054 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:38.871080 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:38.817842 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:38.879020 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 61350.3us
I20260709 12:10:38.869534 28893 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:38.921731 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 279276us
I20260709 12:10:38.773380 28852 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 12:10:38.830964 29215 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:10:38.869607 29221 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:38.985426 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.992946 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:38.993824 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 157858us
I20260709 12:10:38.986771 29118 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:39.005234 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:38.963949 29210 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:38.988672 26539 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
W20260709 12:10:38.996730 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 144661us
I20260709 12:10:38.976563 27160 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:39.017565 26614 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:39.018599 26618 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:39.018994 26619 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:10:38.992899 29069 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 5 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:38.977366 28893 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:38.989547 29171 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:39.016597 29234 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:39.051244 29242 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.052134 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:39.052548 29171 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:39.052205 29242 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:39.054131 29233 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.228s	user 0.000s	sys 0.010s
W20260709 12:10:39.026669 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.051123 29234 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:39.051400 29241 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.007073 29221 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:38.996045 29157 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:39.057410 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.023789 26616 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:39.075460 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 111005us
I20260709 12:10:39.089880 29112 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.110598 29221 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:39.023315 29117 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 12:10:39.123147 26587 leader_election.cc:400] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3.
I20260709 12:10:39.216214 29232 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:39.304463 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.098928 27163 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:39.304090 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.507483 26587 leader_election.cc:403] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:10:39.529418 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 506483us
W20260709 12:10:39.273224 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.112190 29094 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.504135 29157 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:39.453395 29115 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.000s	sys 0.024s
W20260709 12:10:39.117676 29198 consensus_meta.cc:287] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.006s
W20260709 12:10:39.139171 29236 log.cc:927] Time spent T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
W20260709 12:10:39.369729 29245 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
W20260709 12:10:39.546559 26513 leader_election.cc:336] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 2.048s (SENT)
I20260709 12:10:39.547183 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:39.543593 29211 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.548904 29211 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:39.539822 27166 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:10:39.450871 29113 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.897s	user 0.009s	sys 0.004s
I20260709 12:10:39.135043 28893 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:39.107905 29241 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:39.125590 29240 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.215977 29243 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.137087 29237 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:39.541143 29115 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.004s	sys 0.024s
I20260709 12:10:39.505012 29242 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:39.568636 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 545439us
W20260709 12:10:39.551365 29043 consensus_meta.cc:287] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.849s	user 0.010s	sys 0.003s
I20260709 12:10:39.527249 29250 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.535185 27163 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:39.578985 28986 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3.
I20260709 12:10:39.590876 29247 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.591418 29247 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:39.591322 27163 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:39.593228 27163 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.593541 29247 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:39.594156 29247 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:39.581314 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.580507 26620 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:39.538868 29112 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:39.599861 26587 leader_election.cc:400] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6.
I20260709 12:10:39.554282 29054 consensus_queue.cc:1059] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:10:39.601162 26587 leader_election.cc:403] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:39.544004 29094 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:39.602643 26620 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.540761 29232 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:39.606508 26439 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:39.608781 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 62279.5us
W20260709 12:10:39.609539 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.610065 29094 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:39.610605 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 56135.4us
I20260709 12:10:39.611531 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:39.612712 29112 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:39.612846 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:39.613807 29198 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.613951 29157 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:39.616492 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.125128 29069 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:39.555075 29246 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:10:39.589799 29043 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:39.625957 29246 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:39.626477 29246 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:39.627480 29246 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:39.628156 29043 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:39.628957 29246 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:39.625845 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.599139 29234 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:39.623785 29054 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:39.605700 29242 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:39.639180 26439 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:39.122635 29118 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:39.573218 29243 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:39.641139 26620 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:10:39.641572 29198 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.622049 29211 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:39.622412 29157 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.665099 29157 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.667585 26471 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:39.659869 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 337) took 1215 ms. Trace:
I20260709 12:10:39.600977 29247 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:39.669406 26467 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:39.622128 28986 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6.
I20260709 12:10:39.670585 29247 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:39.670761 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:39.671372 26465 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:39.671407 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 58640.3us
I20260709 12:10:39.602449 29250 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:39.673339 27163 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:10:39.674837 27163 pending_rounds.cc:85] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 7
I20260709 12:10:39.675684 27163 pending_rounds.cc:107] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:10:39.676569 27163 raft_consensus.cc:2889] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:39.671161 26620 rpcz_store.cc:276] 0709 12:10:38.444811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.444962 (+   151us) service_pool.cc:224] Handling call
0709 12:10:38.463140 (+ 18178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:39.573257 (+1110117us) spinlock_profiling.cc:243] Waited 66 ms on lock 0x7b540005e9a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f507605806f 00007f50760d0f60 00007f50760d27de 00007f50760dcb49 00007f50760dd416 00007f50760d9d8f 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62
0709 12:10:39.659479 (+ 86222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.659791 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151741184}
I20260709 12:10:39.673285 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:39.680946 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2509) took 1076 ms. Trace:
I20260709 12:10:39.681442 26622 rpcz_store.cc:276] 0709 12:10:38.604818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.604988 (+   170us) service_pool.cc:224] Handling call
0709 12:10:38.605427 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:38.605868 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:38.605901 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:38.606351 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 12:10:38.621163 (+ 14812us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:38.621220 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.621291 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:39.680701 (+1059410us) raft_consensus.cc:1685] finished
0709 12:10:39.680734 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:39.680883 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":160,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"thread_start_us":14395,"threads_started":1,"wal-append.queue_time_us":98878}
I20260709 12:10:39.587297 29240 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:39.687434 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:39.689091 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:39.689853 29241 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:39.690186 29249 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.690640 29241 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:39.690799 29249 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:39.691293 29241 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:39.692745 29043 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:39.695036 29168 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:10:39.697242 29232 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:39.698181 29249 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:39.662544 29198 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.699031 29198 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.709905 26620 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:39.711187 26467 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:39.714603 26544 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:39.712455 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:39.717394 27166 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 6: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:39.717531 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:39.718238 26543 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:39.718817 26614 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:39.718734 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45611us
I20260709 12:10:39.719774 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:39.711125 29024 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.743353 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:39.717288 29234 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:39.703296 29157 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:39.731281 29263 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.731707 29232 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:39.770876 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 51728.1us
W20260709 12:10:39.768791 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 86507us
W20260709 12:10:39.772737 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 78bbb48570954bf4ad1039abff47c036: Illegal state: Replica 01a57027214a411e80874ac7febd628b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:10:39.776906 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:39.777113 26466 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:39.777586 26467 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.779534 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:39.780494 26543 raft_consensus.cc:2410] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:39.780627 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:39.781211 26546 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.782080 26545 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:10:39.782474 26545 pending_rounds.cc:85] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 4
I20260709 12:10:39.782737 26545 pending_rounds.cc:107] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:10:39.782961 26545 raft_consensus.cc:2889] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:39.803858 26467 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
W20260709 12:10:39.805845 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.805516 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 89221.9us
I20260709 12:10:39.807240 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:39.808341 26471 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 7: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:39.818971 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:39.819823 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:39.821062 26470 raft_consensus.cc:2410] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:39.821683 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:39.838920 26466 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 7: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:39.736033 29250 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:39.843693 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 124055us
I20260709 12:10:39.846251 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:39.847419 26467 raft_consensus.cc:2368] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 3. Current term is 4.
I20260709 12:10:39.837894 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:39.850591 26540 raft_consensus.cc:2410] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:39.744987 29024 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:39.862538 26469 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 5: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:10:39.862710 29261 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:10:39.864089 29237 raft_consensus.cc:3055] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:39.864575 29237 raft_consensus.cc:740] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:39.865424 29237 consensus_queue.cc:260] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:39.804973 29263 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:39.868574 29263 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:39.868985 29243 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:39.869306 29259 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.826716 27163 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 12:10:39.880925 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:39.881958 26542 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 7: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:39.839859 29043 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:39.902580 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 118058us
I20260709 12:10:39.905001 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:39.906004 26465 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:10:39.906968 26539 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:39.909525 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:10:39.909585 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.910228 26470 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.842931 29234 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:39.915364 26539 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:10:39.916999 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.917438 26513 leader_election.cc:336] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.925s (SENT)
I20260709 12:10:39.918057 26513 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:39.919232 26545 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:10:39.898610 29241 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:39.909428 29115 raft_consensus.cc:2764] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:10:39.928301 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:39.928932 26546 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:39.929273 26471 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 6: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:39.929446 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:39.931115 27166 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:39.869997 29259 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:39.932675 26622 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:39.932221 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:39.920941 29263 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.922241 29237 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.937394 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:39.921316 29168 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:39.925431 29171 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.925257 29043 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:10:39.939949 29251 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:39.940531 29251 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:39.941692 29251 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:39.935480 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:39.922029 29250 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.938042 26473 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:39.940590 29157 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:39.935118 29269 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:10:39.938382 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:39.954314 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:39.959318 27160 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:39.960398 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:39.960696 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:39.961098 26473 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.961791 29234 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:39.962582 29227 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:39.964628 29117 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:39.965878 29267 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:10:39.966547 29269 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:39.966951 29269 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:39.967788 29269 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:39.969128 29269 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.970181 29024 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:39.970697 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.973049 29240 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:39.973671 29240 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.974184 29240 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:39.974942 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:39.975589 29216 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.975700 26615 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:39.976419 29240 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:39.976197 29216 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:39.978751 26545 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:39.979760 26546 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:39.950867 29263 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:39.981921 26619 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:39.984712 26621 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:39.986578 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:39.955756 29171 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:39.988842 29235 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.989121 29263 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:39.989418 29235 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:39.989785 29171 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:39.990985 26470 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:39.991693 29235 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:39.992082 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:39.992566 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:39.993398 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:39.993551 26539 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:39.989715 29263 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:39.994792 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:39.994668 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:39.998538 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:40.000389 26613 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:40.001005 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:40.000427 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:40.003569 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:40.004751 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 46828.6us
I20260709 12:10:40.006083 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:40.007731 26543 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:40.008533 28575 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:40.006093 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:40.009096 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:40.009450 26472 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:39.934259 29198 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:40.011072 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.013651 26471 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:40.014335 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:10:40.014824 26513 leader_election.cc:336] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 2.505s (SENT)
I20260709 12:10:40.016197 26546 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.016197 26513 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:39.982246 29267 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.019614 28852 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:40.023586 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:40.024247 26472 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:39.983554 29240 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:10:40.026621 29054 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:40.028767 29216 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:40.031597 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 71024.8us
I20260709 12:10:40.033336 26545 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:40.023000 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:40.034032 26473 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:40.034451 26614 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:40.035722 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:40.018967 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:39.958529 29215 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:10:40.055166 26615 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:40.054908 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:40.034735 26539 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:40.043104 28575 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:40.060009 28575 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:40.058743 26622 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:10:40.066937 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:40.059856 26539 pending_rounds.cc:85] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 2
I20260709 12:10:40.071270 26539 pending_rounds.cc:107] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:40.071339 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:40.071656 26539 raft_consensus.cc:2889] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:40.072060 26621 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:40.072147 28575 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:40.081398 26546 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:40.017691 29117 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.984229 29168 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:10:40.087831 26545 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:40.038885 29226 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:40.062868 26587 connection.cc:256] RPC call timeout handler was delayed by -3.3857625160001135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3211s for a response
I20260709 12:10:40.017781 29171 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.083185 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:40.039773 29216 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.059331 29113 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:40.091235 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:40.090167 26587 connection.cc:256] RPC call timeout handler was delayed by -2.6742975910001405s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260709 12:10:40.090773 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.110431 26587 connection.cc:256] RPC call timeout handler was delayed by -2.1675975910000034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
W20260709 12:10:40.111006 26587 connection.cc:256] RPC call timeout handler was delayed by -2.1612975909999932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
I20260709 12:10:40.112145 26622 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:40.106384 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:40.072351 29198 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:40.061522 29250 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.089051 26539 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:40.113300 26614 raft_consensus.cc:2410] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:40.033493 29227 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:10:40.114205 26473 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:40.014816 29246 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.079s
W20260709 12:10:40.175015 26587 connection.cc:256] RPC call timeout handler was delayed by -2.1189975910001522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
I20260709 12:10:40.175324 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:40.073506 29240 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.115211 28575 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.058404 29267 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:40.058816 29054 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:10:40.062629 29235 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:10:40.088459 29117 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.177747 29157 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:40.359135 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 268865us
I20260709 12:10:40.203855 26472 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:10:40.360442 26472 pending_rounds.cc:85] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 4
I20260709 12:10:40.360785 26472 pending_rounds.cc:107] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:10:40.361037 26472 raft_consensus.cc:2889] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:40.362438 29240 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:40.364831 29240 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:40.357170 29168 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:40.221441 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 45577.7us
I20260709 12:10:40.365768 29168 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:40.175679 29171 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:40.368192 29168 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:40.368657 29171 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:40.358803 29259 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:40.359639 29157 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:40.371256 26587 connection.cc:256] RPC call timeout handler was delayed by -2.1153975910001463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
W20260709 12:10:40.375293 26587 connection.cc:256] RPC call timeout handler was delayed by -2.0964975910001158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
W20260709 12:10:40.375982 26587 connection.cc:256] RPC call timeout handler was delayed by -1.7310975910002071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2581s for a response
W20260709 12:10:40.376478 26587 connection.cc:256] RPC call timeout handler was delayed by -1.6842975910001314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26330000000000003s for a response
W20260709 12:10:40.376967 26587 connection.cc:256] RPC call timeout handler was delayed by -1.130797591000146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32480000000000003s for a response
I20260709 12:10:40.264226 26622 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:40.092834 28986 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:40.203823 26471 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:40.390648 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 375849us
I20260709 12:10:40.092180 28852 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:40.391777 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 375) took 1571 ms. Trace:
I20260709 12:10:40.088958 29069 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.428273 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:40.407536 26548 rpcz_store.cc:276] 0709 12:10:38.801800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.813592 (+ 11792us) service_pool.cc:224] Handling call
0709 12:10:38.814061 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:39.650195 (+836134us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b1800361180. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:10:39.678724 (+ 28529us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b1800361180. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5075c824bc 00007f5072fd048b 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f50760d2060 00007f50760d2bfb 00007f50760dd64b
0709 12:10:39.678923 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:39.679349 (+   426us) log.cc:844] Serialized 14 byte log entry
0709 12:10:39.919983 (+240634us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:39.930343 (+ 10360us) log.cc:844] Serialized 26 byte log entry
0709 12:10:39.933151 (+  2808us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:39.933175 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.933225 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:40.372832 (+439607us) raft_consensus.cc:1685] finished
0709 12:10:40.372856 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:40.372974 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12172,"prepare.queue_time_us":518,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":2269,"raft.queue_time_us":205050,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":6921,"spinlock_wait_cycles":70079616,"thread_start_us":434684,"threads_started":2,"wal-append.queue_time_us":323198}
I20260709 12:10:40.462626 26465 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 7: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:10:40.352825 29276 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 12:10:40.357957 29255 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.763s	user 0.000s	sys 0.003s
I20260709 12:10:40.375037 29117 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.224575 29224 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:10:40.471169 26513 leader_election.cc:336] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 2.526s (SENT)
I20260709 12:10:40.182852 29113 raft_consensus.cc:697] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:40.177812 29024 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.331296 29263 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.144s
I20260709 12:10:40.410697 29234 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.410283 29282 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:40.466562 29280 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:10:40.108201 29226 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:40.479035 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 388627us
I20260709 12:10:40.479667 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:10:40.480036 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 113553us
I20260709 12:10:40.324488 29215 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.149s
W20260709 12:10:40.472599 29210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.451s	user 0.006s	sys 0.038s
I20260709 12:10:40.482317 26371 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39184 (request call id 157) took 9985 ms. Trace:
I20260709 12:10:40.405272 29115 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.410975 29243 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:10:40.182099 29216 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:40.510049 26439 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:40.489614 28575 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.495131 26514 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:40.426302 29250 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:40.497704 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:40.481774 29024 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:40.526219 29226 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:40.479770 29224 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:40.526760 29250 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:40.527421 29024 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:40.460356 28986 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:40.528138 29224 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:40.527824 29113 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:40.528332 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:40.500933 29237 consensus_meta.cc:287] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.000s
I20260709 12:10:40.225387 29270 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.396s
W20260709 12:10:40.532910 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 50307.1us
I20260709 12:10:40.511245 28575 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:40.512291 29246 consensus_queue.cc:1059] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:40.512841 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:40.490490 29282 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:40.487937 29234 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:40.514212 29157 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:40.543118 27166 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:40.515725 29267 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:40.207806 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 172165us
I20260709 12:10:40.501729 26471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3288c98248464af5b8f3227349002ec7"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:40.546237 26471 raft_consensus.cc:606] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:40.546660 26471 raft_consensus.cc:614] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:40.518919 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.520646 29240 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:40.509495 29115 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:40.523518 26514 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:40.548271 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:40.548907 26617 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.524504 29259 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.549243 26514 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:40.526855 28852 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:40.509778 26543 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:40.505551 29210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.487s	user 0.006s	sys 0.039s
I20260709 12:10:40.471946 29069 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:40.538273 29234 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:40.535434 29221 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.539145 29246 raft_consensus.cc:3055] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:40.551285 26514 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:40.562319 28575 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:40.569727 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet ea50d3c1de374dff938c733fb02faf8c: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:40.549510 29115 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:40.571410 29246 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:40.571825 29221 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:40.572431 29246 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:40.574376 28575 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:40.543757 29043 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.574888 28575 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.582026 28575 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.577559 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:40.578727 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:40.578948 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:40.543162 28986 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:40.585882 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:40.496810 26371 rpcz_store.cc:276] 0709 12:10:30.528302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.532227 (+  3925us) service_pool.cc:224] Handling call
0709 12:10:40.482247 (+9950020us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:38.448243 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:38.455240 (+  6997us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:38.455300 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:10:38.455326 (+    26us) tablet.cc:662] Decoding operations
0709 12:10:38.456488 (+  1162us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:38.456592 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:38.456637 (+    45us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:10:38.457479 (+   842us) tablet.cc:701] Row locks acquired
0709 12:10:38.457535 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:10:38.457730 (+   195us) write_op.cc:270] Start()
0709 12:10:38.457901 (+   171us) write_op.cc:276] Timestamp: P: 1783599038457657 usec, L: 0
0709 12:10:38.457933 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:10:38.498366 (+ 40433us) log.cc:844] Serialized 3218 byte log entry
0709 12:10:39.134954 (+636588us) op_driver.cc:464] REPLICATION: finished
0709 12:10:39.634111 (+499157us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5072fd00ac 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5079b10ef0
0709 12:10:39.865404 (+231293us) write_op.cc:301] APPLY: starting
0709 12:10:39.865523 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:39.865809 (+   286us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:39.865845 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:39.867064 (+  1219us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:39.867386 (+   322us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:10:39.867436 (+    50us) write_op.cc:312] APPLY: finished
0709 12:10:39.867795 (+   359us) log.cc:844] Serialized 65 byte log entry
0709 12:10:39.867989 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:39.868130 (+   141us) write_op.cc:454] Released schema lock
0709 12:10:39.868235 (+   105us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:39.874870 (+  6635us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:39.874904 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1000467,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":683462,"apply.run_cpu_time_us":3341,"apply.run_wall_time_us":16929,"num_ops":8,"prepare.queue_time_us":126712,"prepare.run_cpu_time_us":38502,"prepare.run_wall_time_us":195986,"raft.queue_time_us":239331,"raft.run_cpu_time_us":33667,"raft.run_wall_time_us":652826,"replication_time_us":659081,"spinlock_wait_cycles":2437888,"thread_start_us":735323,"threads_started":4,"wal-append.queue_time_us":129293}]]}
I20260709 12:10:40.585855 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:40.585909 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:40.588613 26622 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:40.589850 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:40.590072 29246 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.590515 26622 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:10:40.590981 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:40.591269 29282 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:40.591463 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:40.592110 26622 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:40.550148 29024 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:40.592674 29024 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.549602 29259 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:40.586488 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 115367us
W20260709 12:10:40.593503 26513 leader_election.cc:336] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 2.561s (SENT)
I20260709 12:10:40.594012 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:40.592159 29282 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:40.599731 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:40.560187 29250 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:40.603526 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:40.612597 26548 raft_consensus.cc:2410] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:40.602236 26620 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:40.560555 29210 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 3 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:40.555713 29054 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.607076 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:40.617475 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:40.616915 26514 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:40.614593 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:40.615882 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:40.621009 27165 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:40.587747 29043 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.620394 26618 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:40.622534 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:40.627424 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:40.623606 26547 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:10:40.623662 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:40.594036 29211 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.602591 29259 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.574654 29171 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:10:40.597720 29024 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.597888 29251 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:40.627522 26540 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:40.619730 29240 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:40.631006 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 121043us
I20260709 12:10:40.555505 29288 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:10:40.632725 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:40.616803 29250 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.628038 26546 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:40.628975 29043 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.652141 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:40.658188 26472 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:10:40.627310 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:40.604336 28986 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:10:40.672191 26473 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:40.664547 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:40.671139 28575 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:40.676198 26471 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:40.679574 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:40.642884 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:40.687980 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.628401 29054 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:40.630512 29282 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:10:40.656047 29250 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:40.697156 26466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:40.702446 26466 raft_consensus.cc:606] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:40.698014 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:40.706532 29281 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.139s
I20260709 12:10:40.709386 29284 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.129s
I20260709 12:10:40.698269 28575 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:40.653172 29249 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:40.701669 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.683686 29211 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:40.696605 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:40.723539 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:40.691862 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:40.696244 29094 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:40.654500 29290 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:10:40.706565 26467 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:40.735693 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:40.755328 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:40.738741 26466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:40.756841 26466 raft_consensus.cc:606] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:40.757313 26466 raft_consensus.cc:614] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:40.747061 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.732321 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 138828us
I20260709 12:10:40.747426 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:40.739596 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:40.750629 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:40.763439 26470 raft_consensus.cc:2410] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:40.764693 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:40.765616 26470 raft_consensus.cc:2368] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 5. Current term is 6.
I20260709 12:10:40.691582 27161 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
W20260709 12:10:40.750813 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 118222us
I20260709 12:10:40.737323 27168 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:40.767786 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:40.768047 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:40.769061 29301 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:40.769162 26470 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:40.769662 29301 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.770540 29301 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.771370 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:40.772439 26470 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:40.773799 26514 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:40.778923 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:40.788522 28575 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:40.789101 28575 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.789481 28575 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.724188 29267 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.792965 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:40.793749 26466 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.797333 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:40.806740 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:40.797681 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:40.793860 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:40.808312 26615 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:40.753002 29094 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.751708 29221 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:40.739223 29211 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.733819 29227 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:10:40.825253 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:40.827106 26467 raft_consensus.cc:2410] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:10:40.828632 26513 leader_election.cc:336] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 2.571s (SENT)
I20260709 12:10:40.787082 29216 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:40.799093 29243 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.839789 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:40.732566 29289 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.267s
I20260709 12:10:40.793419 29297 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.820940 29094 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:40.821360 29281 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.851399 26473 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:40.854115 28575 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:40.843613 26514 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:40.716868 29210 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:40.861697 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:40.827816 29211 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.859822 26471 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:40.862422 26467 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:40.865585 26470 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:40.837384 29118 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.009s	sys 0.009s
I20260709 12:10:40.811823 29267 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:40.870927 28575 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:40.845909 29069 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:40.877180 26466 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:10:40.878744 29300 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
W20260709 12:10:40.880191 29291 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 12:10:40.881050 29293 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 12:10:40.882717 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 77158.5us
W20260709 12:10:40.883074 29294 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:10:40.863524 26514 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:40.879015 29303 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:40.861177 29281 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.857633 29297 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.885210 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:40.849514 29243 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:40.983454 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 100107us
W20260709 12:10:40.983136 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.025724 26467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:41.031837 26467 raft_consensus.cc:606] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:41.030678 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:41.032267 26467 raft_consensus.cc:614] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:41.032738 26471 raft_consensus.cc:2376] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6. Re-sending same reply.
I20260709 12:10:41.022091 26617 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
W20260709 12:10:41.029268 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 436435us
I20260709 12:10:41.034917 26619 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:41.036723 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:41.037588 26619 raft_consensus.cc:2410] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:10:40.927156 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.869009 29118 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.009s	sys 0.009s
I20260709 12:10:41.051187 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:41.061213 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:41.062080 26471 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:41.063932 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:41.063197 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:40.934643 29069 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:41.065304 26471 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:41.066709 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:40.885468 29269 consensus_meta.cc:287] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.905s	user 0.013s	sys 0.004s
I20260709 12:10:41.075421 26544 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 8. Ops: []
I20260709 12:10:41.004537 29054 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:41.035538 29281 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:41.063984 29117 consensus_meta.cc:287] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.581s	user 0.012s	sys 0.001s
I20260709 12:10:41.079775 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:41.080812 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:41.083048 26468 raft_consensus.cc:2410] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:41.038026 29297 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.084076 26471 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:40.930977 29299 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:41.065549 29069 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.097918 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:41.118707 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.071035 29303 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:41.078660 29282 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:41.142967 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 59499.5us
I20260709 12:10:41.132102 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:40.912727 29296 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.093003 29299 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:41.131078 26513 leader_election.cc:336] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 3.160s (SENT)
W20260709 12:10:41.142153 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 73284.6us
I20260709 12:10:41.143211 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:41.146380 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:41.154311 26473 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
W20260709 12:10:41.133015 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.142271 29303 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:41.152380 26439 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:41.160203 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:41.165812 26615 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:10:41.165741 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 302279us
I20260709 12:10:41.159014 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:41.161873 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:41.161597 29221 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.131692 29069 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.169710 26548 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:41.092861 29117 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:41.172425 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:41.172907 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:41.175776 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.158603 29299 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.176276 26541 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:41.179286 27160 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 3 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:41.174659 26587 leader_election.cc:400] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6.
I20260709 12:10:41.180097 26587 leader_election.cc:403] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:41.180974 29221 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6.
I20260709 12:10:41.181715 29316 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:41.183254 26542 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:41.183687 26548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
W20260709 12:10:41.185060 29307 log.cc:927] Time spent T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:10:41.185245 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:41.185541 29315 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:10:41.185954 26465 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:10:41.172756 26469 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:41.187052 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:41.187227 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:41.187834 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:41.188540 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:41.189567 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:41.190256 26547 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:41.190851 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:41.191684 26540 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:10:41.199774 29311 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:10:41.200047 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1583) took 1207 ms. Trace:
I20260709 12:10:41.207405 26543 rpcz_store.cc:276] 0709 12:10:39.992857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.019532 (+ 26675us) service_pool.cc:224] Handling call
0709 12:10:40.509591 (+490059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:40.556460 (+ 46869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.199800 (+643340us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54001117d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:41.199981 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1126098688}
I20260709 12:10:41.181893 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:41.200160 29323 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.214761 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:41.201115 29246 consensus_meta.cc:287] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.610s	user 0.005s	sys 0.007s
W20260709 12:10:41.202984 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 107595us
I20260709 12:10:41.163986 28852 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:10:41.162712 29303 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.204675 26469 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 6: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:41.206197 26539 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:41.212837 29321 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.213578 29252 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:41.216405 26472 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
W20260709 12:10:41.215075 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 62819.5us
W20260709 12:10:41.206492 29259 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.563s	user 0.000s	sys 0.012s
I20260709 12:10:41.242913 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:10:41.238317 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.242334 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.213572 29283 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.645s	user 0.003s	sys 0.002s
W20260709 12:10:41.223579 29043 consensus_meta.cc:287] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.003s
W20260709 12:10:41.246827 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 65087.8us
I20260709 12:10:41.206969 29267 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:41.157928 29296 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:41.264501 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.256716 26543 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:41.263573 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:41.279980 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet d2e173b367e6460b8f654b2de1aabfae: Illegal state: Replica ac3ac2181aa941229a758ccf6b5607cd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:10:41.300899 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:41.302126 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:41.303227 26622 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:41.300655 26513 leader_election.cc:336] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 3.286s (SENT)
W20260709 12:10:41.304193 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 48365.8us
I20260709 12:10:41.305101 26513 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:41.238986 29325 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:41.310002 29306 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:10:41.310618 29316 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:41.311254 29316 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:41.250490 29221 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:10:41.243096 29151 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:10:41.312350 29316 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:41.313736 29243 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:41.254280 29171 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:10:41.214473 29323 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:41.254482 29216 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.267225 29321 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:41.327445 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:41.300745 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:41.253226 29259 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:41.345037 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:41.348330 26539 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.355917 26471 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:41.255641 29043 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:41.269610 29094 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:41.360569 29094 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:41.369601 29259 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:41.371932 26473 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 6: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:10:41.375290 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 121637us
I20260709 12:10:41.389551 26539 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:41.391901 29043 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:41.326792 29325 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:10:41.396647 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 116048us
I20260709 12:10:41.402127 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:41.403156 26547 raft_consensus.cc:2410] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:41.404768 26587 leader_election.cc:400] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 3 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 3. Current term is 4.
W20260709 12:10:41.379963 29024 consensus_meta.cc:287] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.726s	user 0.012s	sys 0.000s
I20260709 12:10:41.413584 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:41.415349 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:41.415448 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:41.416402 26547 raft_consensus.cc:2410] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:41.362090 29211 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:41.420279 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 176441us
I20260709 12:10:41.420503 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:41.425493 26542 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:41.428632 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:41.430595 26464 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 12:10:41.431170 26464 pending_rounds.cc:85] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 4
I20260709 12:10:41.431522 26464 pending_rounds.cc:107] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:10:41.431783 26464 raft_consensus.cc:2889] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:41.432163 26464 pending_rounds.cc:107] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260709 12:10:41.440898 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.433351 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:41.445502 27168 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:41.446079 26470 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:41.445189 26464 raft_consensus.cc:2889] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:41.447748 29308 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.576s	user 0.001s	sys 0.000s
I20260709 12:10:41.448899 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:41.434430 26547 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:10:41.427947 29250 consensus_meta.cc:287] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.703s	user 0.012s	sys 0.001s
I20260709 12:10:41.451776 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:41.445150 26622 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:10:41.452471 26542 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.424636 29246 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:41.468230 29326 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.348670 29321 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:41.451354 29301 consensus_meta.cc:287] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.680s	user 0.013s	sys 0.000s
I20260709 12:10:41.411738 29281 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:41.505465 29303 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:41.506078 29321 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:41.507203 28852 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:41.507689 29336 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.419819 29024 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:41.459492 29250 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:41.626746 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.603582 27162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 364) took 1007 ms. Trace:
I20260709 12:10:41.604089 26548 raft_consensus.cc:606] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:10:41.630256 26548 raft_consensus.cc:614] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:41.593279 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.629601 27162 rpcz_store.cc:276] 0709 12:10:40.595764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.595895 (+   131us) service_pool.cc:224] Handling call
0709 12:10:40.614754 (+ 18859us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:40.676678 (+ 61924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:40.676754 (+    76us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:40.700903 (+ 24149us) log.cc:844] Serialized 26 byte log entry
0709 12:10:40.797861 (+ 96958us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:40.862162 (+ 64301us) log.cc:844] Serialized 14 byte log entry
0709 12:10:40.862484 (+   322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.862556 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:41.447045 (+584489us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:10:41.594586 (+147541us) raft_consensus.cc:1685] finished
0709 12:10:41.603279 (+  8693us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:41.603490 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18573,"prepare.queue_time_us":191678,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":26355,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":5687,"spinlock_wait_cycles":10304896,"thread_start_us":196537,"threads_started":3,"wal-append.queue_time_us":130410}
W20260709 12:10:41.591071 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 168273us
W20260709 12:10:41.632522 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 203971us
I20260709 12:10:41.498189 29216 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:41.471969 29314 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:41.603209 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 347488us
W20260709 12:10:41.642717 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 192779us
I20260709 12:10:41.622287 29069 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:41.550282 26542 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:41.638971 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:41.641690 26546 raft_consensus.cc:2368] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9.
I20260709 12:10:41.634442 29211 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:41.637270 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.643544 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:41.519022 29323 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:41.652148 29303 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:41.652365 29284 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:41.652530 29250 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:41.653220 29340 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:10:41.653580 29237 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:41.638595 29043 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.656883 29296 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:41.657331 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1577) took 1666 ms. Trace:
I20260709 12:10:41.660956 29024 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:41.663341 29249 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.681762 29235 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.665143 26619 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:41.669020 26620 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:41.721215 26620 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:41.638557 29216 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.669297 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:41.499864 29246 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:41.566303 29297 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:41.730975 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:41.729766 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:41.733613 27162 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.670845 29211 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:41.650835 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:41.679744 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:41.752543 26470 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.474778 29299 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:41.762598 26619 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:41.684901 26543 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:41.702708 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:41.536898 29301 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:41.705739 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:41.804109 26472 raft_consensus.cc:2376] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6. Re-sending same reply.
I20260709 12:10:41.682806 26544 rpcz_store.cc:276] 0709 12:10:39.990935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.999980 (+  9045us) service_pool.cc:224] Handling call
0709 12:10:40.020565 (+ 20585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:41.075973 (+1055408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.657058 (+581085us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540037f0d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:41.657264 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2425492224}
I20260709 12:10:41.673507 29316 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.670883 29333 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:41.697660 29043 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:41.715096 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:41.663406 29281 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:41.637890 28852 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:41.721464 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:41.814503 26465 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:41.814941 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:41.739781 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:41.701612 29287 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.750303 27161 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:41.648998 29314 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:41.753212 26620 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:41.752091 29216 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.720662 29249 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.722467 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:41.593192 29325 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:41.821318 26620 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:41.802805 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 152031us
I20260709 12:10:41.828418 26545 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:41.839092 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:41.812515 29303 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.806720 29333 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.817610 29282 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:41.846577 26464 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:10:41.856986 26464 pending_rounds.cc:85] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 3
I20260709 12:10:41.857419 26464 pending_rounds.cc:107] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:10:41.857749 26464 raft_consensus.cc:2889] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:41.846573 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:41.728443 29250 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 12:10:41.724436 29235 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:41.881924 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:41.863619 26470 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:10:41.881857 26620 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:41.892577 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:41.893457 26470 raft_consensus.cc:2376] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8. Re-sending same reply.
W20260709 12:10:41.926723 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 73709.8us
I20260709 12:10:41.929167 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:41.812492 29024 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:10:41.936596 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:41.937768 26470 raft_consensus.cc:2368] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 5. Current term is 6.
I20260709 12:10:41.940723 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:41.941231 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 134128us
I20260709 12:10:41.855157 29333 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.943267 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:41.856496 29282 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:41.947564 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.951471 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:41.968453 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:41.976950 26470 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:41.829474 29287 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:42.010777 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.865690 29303 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:41.957259 29282 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:42.057901 29305 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:10:42.039916 29311 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 12:10:42.056785 29350 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:10:41.953454 29321 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.112s
I20260709 12:10:42.054754 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:41.968314 29118 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:41.981504 29113 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:42.059147 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:42.106773 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:42.128206 26470 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:41.954437 29250 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.058198 28893 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:42.149093 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.068223 27159 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:42.067408 29334 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.055006 29316 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.117s
I20260709 12:10:42.069706 29217 raft_consensus.cc:2764] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:10:42.216688 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:42.152401 29342 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.429s	user 0.000s	sys 0.000s
W20260709 12:10:42.150254 29346 log.cc:927] Time spent T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.326s	user 0.000s	sys 0.002s
I20260709 12:10:42.222543 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:42.126881 29069 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:42.231202 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:42.235831 26467 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 6: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:42.153565 29118 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:10:42.258766 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.267549 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:42.278558 26466 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 7: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:10:42.300218 29357 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:10:42.303031 29252 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:42.303877 29252 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:42.265630 29115 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.259516 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:42.331084 26467 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:42.269807 29297 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:42.340731 29069 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.354143 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45356 (request call id 31) took 1175 ms. Trace:
I20260709 12:10:42.354737 26548 rpcz_store.cc:276] 0709 12:10:41.171501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.183510 (+ 12009us) service_pool.cc:224] Handling call
0709 12:10:42.343763 (+1160253us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54000b4d54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d4853 00007f507b0a260a 00007f50746287d4 00007f5074628762 00007f5074628691 00007f507462860c 00007f50746278c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:42.343928 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965439744}
I20260709 12:10:42.295568 29299 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:42.374670 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.377306 28986 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:10:42.379268 26616 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.006s	sys 0.003s
I20260709 12:10:42.277331 29348 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:10:42.318946 29043 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:42.224144 29334 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:42.382334 26616 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.006s	sys 0.003s
W20260709 12:10:42.387511 26621 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.000s	sys 0.021s
W20260709 12:10:42.390053 26621 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.000s	sys 0.021s
W20260709 12:10:42.388074 26587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.004s	sys 0.010s
I20260709 12:10:42.377578 29069 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:42.392745 26587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.004s	sys 0.010s
W20260709 12:10:42.405169 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 566162us
I20260709 12:10:42.427384 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1727) took 1123 ms. Trace:
I20260709 12:10:42.428015 26543 rpcz_store.cc:276] 0709 12:10:41.304189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.304326 (+   137us) service_pool.cc:224] Handling call
0709 12:10:42.427071 (+1122745us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b5400237dd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:42.427286 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":819234048}
I20260709 12:10:42.344640 29115 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:42.380533 29335 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.005s	sys 0.007s
I20260709 12:10:42.406242 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:42.448766 26470 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
W20260709 12:10:42.472319 27162 consensus_meta.cc:287] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.738s	user 0.012s	sys 0.000s
I20260709 12:10:42.478447 27162 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
W20260709 12:10:42.483819 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 543154us
W20260709 12:10:42.496584 26438 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.006s	sys 0.016s
W20260709 12:10:42.497040 26438 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.006s	sys 0.016s
W20260709 12:10:42.497370 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 565362us
W20260709 12:10:42.504535 26439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.005s	sys 0.025s
I20260709 12:10:42.430523 29362 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:10:42.474053 29335 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.006s	sys 0.008s
I20260709 12:10:42.517982 29252 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:42.506412 29269 raft_consensus.cc:993] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
W20260709 12:10:42.432133 29323 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.018s	sys 0.006s
W20260709 12:10:42.633278 26439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.006s	sys 0.025s
W20260709 12:10:42.496184 29366 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:10:42.643179 29117 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:42.643991 29248 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.667207 29248 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:42.669795 26465 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:42.461196 29113 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:10:42.663667 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 947518us
I20260709 12:10:42.666424 27160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 495) took 2657 ms. Trace:
I20260709 12:10:42.644726 29115 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:42.665457 29323 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.019s	sys 0.006s
I20260709 12:10:42.519228 29287 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:42.708316 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:42.710891 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 304742us
I20260709 12:10:42.673633 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:42.665288 29355 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.546s	user 0.000s	sys 0.001s
I20260709 12:10:42.727681 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:42.728420 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:42.743140 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 69607.9us
I20260709 12:10:42.737499 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:42.676030 29301 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:42.750945 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:42.785132 26620 raft_consensus.cc:2410] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:42.676177 29316 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:42.747886 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:10:42.805361 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 132726us
W20260709 12:10:42.807163 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 69001.3us
I20260709 12:10:42.753125 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:42.809885 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 65689.3us
I20260709 12:10:42.838300 26548 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:42.843372 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:42.846804 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1559) took 2890 ms. Trace:
I20260709 12:10:42.847333 26468 rpcz_store.cc:276] 0709 12:10:39.956166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.956305 (+   139us) service_pool.cc:224] Handling call
0709 12:10:42.837415 (+2881110us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000dc0d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:42.846720 (+  9305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2483660672}
I20260709 12:10:42.745339 28986 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:42.849334 26541 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:42.853354 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:42.663558 29362 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:42.858202 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:42.744737 29269 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.783819 29321 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.863399 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:42.859300 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:42.868667 26541 raft_consensus.cc:2410] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 7 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:10:42.867122 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:42.859324 26614 raft_consensus.cc:2410] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:42.851068 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:42.837363 29117 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:42.879624 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:42.885308 26465 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 5: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:42.857681 29287 raft_consensus.cc:1081] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:10:42.881735 29157 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.880602 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:42.890056 26467 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:42.890159 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:42.860008 29301 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:42.891947 26513 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:42.861294 29235 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:42.906034 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:42.703042 27160 rpcz_store.cc:276] 0709 12:10:40.008721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.020172 (+ 11451us) service_pool.cc:224] Handling call
0709 12:10:40.020516 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:41.180010 (+1159494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.647294 (+1467284us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540056bb54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:42.666293 (+ 18999us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2664256384}
I20260709 12:10:43.023507 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:42.840485 29316 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:43.024782 26467 raft_consensus.cc:2410] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:43.018808 29157 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:43.027858 29362 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:43.028700 29157 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:43.028817 29362 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:43.006856 29321 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:42.884012 28986 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:43.029592 29362 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:43.039631 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 392) took 1608 ms. Trace:
I20260709 12:10:43.039928 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 388) took 1636 ms. Trace:
I20260709 12:10:43.056130 26545 rpcz_store.cc:276] 0709 12:10:41.403863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.404179 (+   316us) service_pool.cc:224] Handling call
0709 12:10:41.420537 (+ 16358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.846057 (+425520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.038177 (+1192120us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b540037df54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:43.039856 (+  1679us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":937308032}
I20260709 12:10:43.013585 29301 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.868960 29217 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.155s
I20260709 12:10:42.871245 29269 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:43.059230 26466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.032s	sys 0.041s
I20260709 12:10:43.054548 26547 rpcz_store.cc:276] 0709 12:10:41.430941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.467062 (+ 36121us) service_pool.cc:224] Handling call
0709 12:10:41.519926 (+ 52864us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.627832 (+107906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.627886 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:41.628579 (+   693us) log.cc:844] Serialized 26 byte log entry
0709 12:10:41.849084 (+220505us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:41.849142 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.849244 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:43.039355 (+1190111us) raft_consensus.cc:1685] finished
0709 12:10:43.039382 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.039539 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43932,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":151,"thread_start_us":181906,"threads_started":1,"wal-append.queue_time_us":321063}
W20260709 12:10:43.061131 26466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.032s	sys 0.041s
I20260709 12:10:43.064206 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 358) took 1357 ms. Trace:
I20260709 12:10:43.067551 26466 rpcz_store.cc:276] 0709 12:10:41.706945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.294077 (+587132us) service_pool.cc:224] Handling call
0709 12:10:42.294458 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:42.294686 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:42.377729 (+ 83043us) log.cc:844] Serialized 14 byte log entry
0709 12:10:43.063621 (+685892us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:43.063705 (+    84us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:43.063781 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.063889 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.064083 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":315490,"prepare.queue_time_us":85361,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":749,"thread_start_us":684653,"threads_started":1}
I20260709 12:10:43.070928 26467 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:43.067839 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:43.023344 29069 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:43.034121 29321 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.030954 29377 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:43.068946 29054 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.017s	sys 0.033s
I20260709 12:10:43.034415 29323 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:43.033654 29235 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:43.099448 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:42.893409 29117 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:43.101253 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:43.111516 26547 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 8: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:43.069202 29301 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.110426 26545 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 5: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:43.083734 29248 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:42.892984 29113 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:43.125475 26439 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:10:43.123827 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 217914us
I20260709 12:10:43.126832 26465 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:43.103988 29054 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.018s	sys 0.034s
I20260709 12:10:43.131819 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:43.103147 29321 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.111282 29069 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.036810 29375 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 12:10:43.129952 29287 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.876017 29372 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.257s
I20260709 12:10:43.159200 26547 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:43.143786 26545 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:43.170300 26466 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:10:43.175173 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 431880us
I20260709 12:10:43.185217 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:43.168789 29263 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:10:43.116616 29323 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:43.124779 29235 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:43.186918 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 55156us
I20260709 12:10:43.188359 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:43.188611 29248 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:43.190611 26466 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:43.184121 29369 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:43.195912 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:43.119138 29377 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:43.220769 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:43.223456 26466 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:43.224016 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:43.192947 29216 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.337s	user 0.009s	sys 0.006s
I20260709 12:10:43.224874 29248 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:43.229130 26467 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:43.192248 29069 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.189309 29388 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:43.175240 29287 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:43.191370 29380 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.216490 29369 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.217250 29335 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.249125 29362 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:43.248374 29248 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:43.249295 29388 raft_consensus.cc:697] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:43.247553 26467 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:43.230324 29157 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:43.162860 28986 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:43.247453 29363 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.023s	sys 0.078s
I20260709 12:10:43.248456 29316 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:43.241845 29399 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:43.277938 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 152528us
W20260709 12:10:43.298343 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.257205 29369 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.237913 29391 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 12:10:43.293193 29069 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:43.295424 29363 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.023s	sys 0.078s
I20260709 12:10:43.284192 29157 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:43.293407 29371 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.241829 29216 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:43.311685 29269 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:43.340763 26587 connection.cc:256] RPC call timeout handler was delayed by -1.6684183039999425s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
W20260709 12:10:43.345582 26587 connection.cc:256] RPC call timeout handler was delayed by -1.6162183039998581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
W20260709 12:10:43.346676 26587 connection.cc:256] RPC call timeout handler was delayed by -1.5838183039998057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
I20260709 12:10:43.321739 29316 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.275840 29380 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:43.347483 26587 connection.cc:256] RPC call timeout handler was delayed by -1.5748183040000185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
I20260709 12:10:43.324838 29391 consensus_queue.cc:1243] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:10:43.353679 26587 connection.cc:256] RPC call timeout handler was delayed by -1.4515183039998192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
W20260709 12:10:43.355347 26587 connection.cc:256] RPC call timeout handler was delayed by -1.4344183040000189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
W20260709 12:10:43.355698 26587 connection.cc:256] RPC call timeout handler was delayed by -1.1608183039998039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
I20260709 12:10:43.342470 29362 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:10:43.356709 26587 connection.cc:256] RPC call timeout handler was delayed by -1.106818303999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2163s for a response
W20260709 12:10:43.357280 26587 connection.cc:256] RPC call timeout handler was delayed by -1.0420183039998392s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2235s for a response
W20260709 12:10:43.351475 29297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.012s	sys 0.027s
I20260709 12:10:43.323522 29360 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:43.340602 29372 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:43.346565 29375 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:10:43.359743 29297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.012s	sys 0.028s
W20260709 12:10:43.391448 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.350696 29399 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:43.397006 29216 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:43.398312 29380 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:43.362891 29388 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:43.394018 29117 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:43.401398 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 394) took 1949 ms. Trace:
W20260709 12:10:43.403450 29386 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:10:43.404212 29384 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:10:43.364367 29335 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:43.416532 26539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1732) took 1956 ms (client timeout 1665 ms). Trace:
W20260709 12:10:43.399552 29390 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 12:10:43.386202 29282 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.210s	user 0.014s	sys 0.001s
I20260709 12:10:43.354620 29316 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:43.410588 29249 consensus_meta.cc:287] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.545s	user 0.009s	sys 0.006s
W20260709 12:10:43.408373 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48911.4us
I20260709 12:10:43.411868 26544 rpcz_store.cc:276] 0709 12:10:41.452521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.830463 (+377942us) service_pool.cc:224] Handling call
0709 12:10:41.867247 (+ 36784us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:41.883760 (+ 16513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.883807 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:41.891829 (+  8022us) log.cc:844] Serialized 52 byte log entry
0709 12:10:42.668985 (+777156us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:43.137028 (+468043us) log.cc:844] Serialized 14 byte log entry
0709 12:10:43.137240 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.137321 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:43.401134 (+263813us) raft_consensus.cc:1685] finished
0709 12:10:43.401158 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.401328 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27673,"prepare.queue_time_us":551578,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":68010,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":61105,"thread_start_us":855338,"threads_started":2,"wal-append.queue_time_us":1360598}
I20260709 12:10:43.404949 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:43.417034 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 58234.2us
I20260709 12:10:43.437024 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:43.438654 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:43.418100 29263 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:43.419327 26539 rpcz_store.cc:269] 0709 12:10:41.460028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.416326 (+1956298us) service_pool.cc:211] Skipping call since client already timed out
0709 12:10:43.416459 (+   133us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:10:43.342057 29371 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:43.416397 29323 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:43.407665 29375 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:43.440603 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:43.441423 29404 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.441560 29216 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:43.442003 29297 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:43.441776 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:43.411868 29310 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 2.423s	user 0.005s	sys 0.012s
I20260709 12:10:43.385486 29362 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:43.364111 29360 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:43.390636 29372 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:43.420948 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 196797us
I20260709 12:10:43.410049 29157 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:43.443867 27168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 499) took 2189 ms. Trace:
I20260709 12:10:43.542418 26472 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:10:43.543901 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:43.549950 26513 leader_election.cc:400] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 5. Current term is 6.
W20260709 12:10:43.459928 29382 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 12:10:43.542564 27168 rpcz_store.cc:276] 0709 12:10:41.254777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.254926 (+   149us) service_pool.cc:224] Handling call
0709 12:10:41.301071 (+ 46145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:41.445991 (+144920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.443620 (+1997629us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400603954. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:43.443793 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329379584}
I20260709 12:10:43.576023 27164 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 500) took 1812 ms. Trace:
I20260709 12:10:43.576171 29398 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:10:43.576695 27164 rpcz_store.cc:276] 0709 12:10:41.763871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.764047 (+   176us) service_pool.cc:224] Handling call
0709 12:10:41.820033 (+ 55986us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.827695 (+  7662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.827726 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:42.646001 (+818275us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b2c00135838. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:10:42.646513 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 12:10:43.093055 (+446542us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:43.093101 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.093189 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:43.557369 (+464180us) raft_consensus.cc:1685] finished
0709 12:10:43.557391 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.575888 (+ 18497us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":59523,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":39729,"spinlock_wait_cycles":30228864,"thread_start_us":446113,"threads_started":1,"wal-append.queue_time_us":521823}
I20260709 12:10:43.540134 29316 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:43.580762 29372 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:43.580834 29403 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.532407 29287 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:43.557425 29333 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.582s	user 0.007s	sys 0.008s
I20260709 12:10:43.581722 29403 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:43.531426 29301 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:43.594090 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44385.9us
I20260709 12:10:43.596029 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:43.584410 29301 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:43.600093 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 158426us
I20260709 12:10:43.601214 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:43.602190 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:43.615528 29069 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:43.555028 29297 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.620486 29069 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:43.631323 26513 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:43.585929 29375 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:43.438086 29282 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:43.608422 29316 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.584131 29403 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:43.637674 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:43.444692 29249 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:43.644786 26548 raft_consensus.cc:2393] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 5: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:43.647114 29375 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:43.647522 29249 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:43.648084 29375 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:43.648231 29217 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:43.649271 29375 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:43.585850 29321 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:43.631426 29297 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.459198 29263 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:43.419839 29399 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:43.582360 29333 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:43.434448 29335 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:43.636679 29394 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.643395 29301 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:43.659955 29249 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:43.699445 29406 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:43.701187 29335 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:43.703478 29360 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:43.703792 29409 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.704337 28852 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:43.705075 29282 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:43.691336 29301 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:43.709131 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 77901.9us
I20260709 12:10:43.725170 29371 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:43.732971 29333 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:43.711175 29290 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:10:43.722365 29409 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:43.734486 29290 consensus_queue.cc:1243] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:43.735318 29290 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:43.735766 29290 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:43.710623 29406 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.738323 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:43.717593 29301 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.745672 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:43.754448 29408 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.712756 29316 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:10:43.709806 29249 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:43.717430 29362 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:43.736706 29409 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:43.712982 29216 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:10:43.757156 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:43.744467 29394 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.744678 29406 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.765810 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:43.740996 29282 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:10:43.793154 29399 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:43.794047 29399 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:43.794615 29372 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.796460 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:43.796965 29360 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:43.797434 26539 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:43.797969 29372 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:10:43.811976 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:43.812760 29372 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:43.812975 26539 raft_consensus.cc:2393] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 5: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:43.813262 29372 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:43.814459 26539 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:10:43.779448 29333 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.783975 29409 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:43.844439 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:43.845183 26547 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.797456 29263 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:43.865971 26647 heartbeater.cc:646] Failed to heartbeat to 127.24.179.126:41797 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.24.179.126:41797 timed out after 15.000s (SENT)
I20260709 12:10:43.764274 29290 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:43.870280 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:43.898898 26544 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:43.777462 29362 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 12:10:43.895816 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.796557 28986 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 12:10:43.843983 29409 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:43.901262 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:43.871078 29408 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:43.870471 29321 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:43.917218 29393 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.930308 26547 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:43.922645 29290 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.932549 29249 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:43.933521 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:43.938470 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:43.843572 29333 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:43.915535 29409 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.958251 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:43.948817 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:43.962707 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:43.915731 29408 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:43.967440 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:43.968528 26467 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.971378 29418 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.971549 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:43.972409 29418 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:43.973044 29320 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.973996 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:43.975049 28852 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:43.975497 28852 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.975919 28852 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.975801 29418 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:43.986931 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:43.991858 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:43.994120 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:43.996058 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:43.999414 29333 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:43.838621 29372 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:44.009137 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:44.011739 26466 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.971769 29408 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:44.016125 29360 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.939672 29393 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:44.021771 28986 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:43.968005 29406 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:44.010140 29216 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.023573 26539 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:44.023277 29408 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.022315 29297 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:44.025137 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:44.027357 26544 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.026157 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:44.024724 29406 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:44.032753 29344 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 2.400s	user 0.005s	sys 0.012s
W20260709 12:10:44.034487 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 253924us
I20260709 12:10:44.049681 29393 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:44.049998 29369 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.711s	user 0.009s	sys 0.003s
I20260709 12:10:44.050518 29369 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:44.071203 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 45136.5us
W20260709 12:10:44.073378 26470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2615) took 2361 ms (client timeout 2241 ms). Trace:
W20260709 12:10:44.073824 26470 rpcz_store.cc:269] 0709 12:10:41.711504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.192838 (+481334us) service_pool.cc:224] Handling call
0709 12:10:44.073176 (+1880338us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54000dcad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:44.073303 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490951424}
I20260709 12:10:44.074474 29425 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:10:44.075011 29326 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:44.075439 29326 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:44.075565 29425 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:10:44.075990 26471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2601) took 2904 ms (client timeout 1914 ms). Trace:
W20260709 12:10:44.076431 26471 rpcz_store.cc:269] 0709 12:10:41.171951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.172087 (+   136us) service_pool.cc:224] Handling call
0709 12:10:44.075803 (+2903716us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54001c0f54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:44.075918 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413779328}
I20260709 12:10:44.077735 27163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 422) took 3576 ms. Trace:
I20260709 12:10:44.047150 29372 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.078147 27163 rpcz_store.cc:276] 0709 12:10:40.493879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.495846 (+  1967us) service_pool.cc:224] Handling call
0709 12:10:40.497918 (+  2072us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:40.518954 (+ 21036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:40.518995 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:40.519489 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:10:41.393090 (+873601us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b180043bd60. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:10:41.603037 (+209947us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:41.612984 (+  9947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.623394 (+ 10410us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:44.032122 (+2408728us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:10:44.041379 (+  9257us) raft_consensus.cc:1685] finished
0709 12:10:44.041424 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.070470 (+ 29046us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10561,"raft.queue_time_us":11684,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":13206,"spinlock_wait_cycles":32797184,"thread_start_us":198142,"threads_started":1,"wal-append.queue_time_us":1112793}
I20260709 12:10:44.083014 29409 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:44.071750 29360 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:44.084151 29360 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:44.085436 29409 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:44.085032 29360 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:44.075515 26470 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:10:44.085723 29316 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:44.097220 29320 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.083585 29375 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:44.102322 26467 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:44.104660 26544 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:44.052491 29371 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.107679 26466 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
W20260709 12:10:44.112211 26513 connection.cc:256] RPC call timeout handler was delayed by -2.7883389249998345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
W20260709 12:10:44.112630 26513 connection.cc:256] RPC call timeout handler was delayed by -2.6191844369998307s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
I20260709 12:10:44.099472 29316 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:44.121953 29316 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.115120 29371 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:44.124046 29371 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:44.070336 29362 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:10:44.118218 29360 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.105255 29375 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:44.139945 29375 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:44.141007 29375 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.143190 29394 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.114447 29409 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.118084 29240 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:44.119680 29369 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:44.076364 29326 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:44.169236 29359 log.cc:927] Time spent T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 2.352s	user 0.022s	sys 0.006s
I20260709 12:10:44.171774 29301 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:44.166186 29378 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.176615 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1840) took 1490 ms. Trace:
I20260709 12:10:44.184506 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 360) took 2537 ms. Trace:
I20260709 12:10:44.155150 29297 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:44.164829 29409 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:44.189471 29409 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:44.177253 26621 rpcz_store.cc:276] 0709 12:10:42.686526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.686685 (+   159us) service_pool.cc:224] Handling call
0709 12:10:42.736627 (+ 49942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.067894 (+331267us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:43.181097 (+113203us) log.cc:844] Serialized 14 byte log entry
0709 12:10:43.609799 (+428702us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:43.609877 (+    78us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:43.609944 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.176253 (+566309us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b5400379954. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:44.176332 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.176523 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":236957,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":2514,"raft.queue_time_us":21449,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":2489,"spinlock_wait_cycles":761253632,"thread_start_us":497875,"threads_started":2,"wal-append.queue_time_us":779919}
I20260709 12:10:44.185036 26622 rpcz_store.cc:276] 0709 12:10:41.646978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.647197 (+   219us) service_pool.cc:224] Handling call
0709 12:10:41.659190 (+ 11993us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.671299 (+ 12109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.671335 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:41.671945 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 12:10:41.817028 (+145083us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:41.818460 (+  1432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.818543 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:44.168570 (+2350027us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:10:44.174910 (+  6340us) raft_consensus.cc:1685] finished
0709 12:10:44.174936 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.184419 (+  9483us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11569,"raft.queue_time_us":16926,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":18818,"spinlock_wait_cycles":5142912,"thread_start_us":144665,"threads_started":1,"wal-append.queue_time_us":144346}
W20260709 12:10:44.210505 26513 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.741s (SENT) [suppressed 22 similar messages]
I20260709 12:10:44.186612 29326 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.219120 29316 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:44.215709 29235 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:44.174252 29378 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:44.227146 28852 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:44.231137 29347 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 2.598s	user 0.000s	sys 0.011s
I20260709 12:10:44.231333 29301 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:44.234099 29351 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 2.424s	user 0.006s	sys 0.007s
I20260709 12:10:44.241762 29316 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:44.243718 28852 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:44.246455 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:44.247041 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:44.247555 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.254159 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1719) took 3086 ms. Trace:
W20260709 12:10:44.262262 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 188713us
I20260709 12:10:44.167227 29240 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:44.254878 26546 rpcz_store.cc:276] 0709 12:10:41.168106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.168231 (+   125us) service_pool.cc:224] Handling call
0709 12:10:44.253887 (+3085656us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b5400140354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:44.254062 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040172800}
I20260709 12:10:44.279026 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:44.284241 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:44.286070 26473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2600) took 3124 ms (client timeout 1741 ms). Trace:
W20260709 12:10:44.286796 26473 rpcz_store.cc:269] 0709 12:10:41.161194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.161552 (+   358us) service_pool.cc:224] Handling call
0709 12:10:44.285647 (+3124095us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54001a9854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:44.285949 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467857792}
I20260709 12:10:44.297290 26473 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:44.264144 28852 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:44.311199 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:44.339452 27164 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
W20260709 12:10:44.344112 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.341199 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:44.346153 29431 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:44.363251 29431 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:44.365646 29431 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:44.345798 29362 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.367450 29378 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:44.367647 29362 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:44.332267 29372 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:44.369379 29372 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:44.369805 29240 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:44.283289 29375 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:44.370337 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:44.370708 29375 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:44.372301 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:44.372857 29375 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:44.360236 29333 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.373668 29375 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:44.332476 29290 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:44.345934 29394 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:44.374835 29290 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:44.375092 29394 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:44.375811 29290 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:44.377238 29216 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.377555 29394 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:44.378664 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:44.378980 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2606) took 2674 ms. Trace:
I20260709 12:10:44.379606 29394 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:44.379522 26464 rpcz_store.cc:276] 0709 12:10:41.704978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.716881 (+ 11903us) service_pool.cc:224] Handling call
0709 12:10:41.717189 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:41.882898 (+165709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.378746 (+2495848us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54002dc154. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:44.378915 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279121664}
I20260709 12:10:44.373728 29333 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:44.344673 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:44.381525 26469 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.339938 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:44.382709 27163 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 6: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:44.382886 29362 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:44.387961 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:44.380091 29394 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:10:44.388717 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.389062 26471 raft_consensus.cc:2410] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:44.348158 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:44.378893 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:44.390146 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:44.394466 26470 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:44.395735 26546 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:10:44.391937 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:44.401714 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 67953.2us
W20260709 12:10:44.403542 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.406509 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:44.410609 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:44.412082 26546 raft_consensus.cc:2410] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:44.378019 29216 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:10:44.370369 29372 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:44.413697 29232 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:44.414983 29232 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:44.415381 29232 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:44.416399 29232 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:44.417929 29232 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:44.398622 29394 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.419605 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:44.421073 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:44.424356 26469 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:44.424669 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:44.292642 29316 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.109s
I20260709 12:10:44.427255 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:44.427986 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:44.425984 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:44.432504 26470 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:44.437487 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:44.438338 26470 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.438933 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:44.443818 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:44.443367 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:44.439157 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:44.445317 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:44.445425 26540 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:44.350592 28852 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:44.450006 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:44.450433 26544 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:44.450639 26467 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.451682 28852 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:44.443367 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:44.448623 26540 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:10:44.442657 29336 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.451740 26544 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:10:44.460978 26470 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:10:44.435014 29296 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:44.426517 29115 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:44.407680 29210 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:10:44.470999 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 365) took 1128 ms. Trace:
I20260709 12:10:44.476811 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:44.477196 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:44.486238 26465 rpcz_store.cc:276] 0709 12:10:43.342517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.011853 (+669336us) service_pool.cc:224] Handling call
0709 12:10:44.012167 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.012451 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:44.159059 (+146608us) log.cc:844] Serialized 14 byte log entry
0709 12:10:44.470442 (+311383us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:44.470542 (+   100us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:44.470621 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.470727 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.470908 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14899,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":44,"raft.queue_time_us":19271,"thread_start_us":421398,"threads_started":2}
I20260709 12:10:44.488735 26544 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:10:44.492542 26467 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:10:44.493611 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:44.496160 26470 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:44.497633 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:44.469939 29296 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.502094 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:44.495383 29115 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:44.951519 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.530052 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:45.096458 26470 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 5: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:10:44.576125 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 365648us
W20260709 12:10:44.710299 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:44.906792 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 478867us
W20260709 12:10:45.098985 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.099668 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.101801 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:10:45.063829 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 691543us
I20260709 12:10:45.102937 26467 raft_consensus.cc:2393] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 5: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:10:44.950788 29372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.015s	sys 0.033s
W20260709 12:10:45.061483 29441 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
W20260709 12:10:45.040275 29445 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
W20260709 12:10:45.062827 29446 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.391s	user 0.000s	sys 0.000s
W20260709 12:10:44.651207 29443 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260709 12:10:45.047042 29439 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.512s	user 0.001s	sys 0.001s
W20260709 12:10:45.094511 29248 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.012s	sys 0.007s
W20260709 12:10:45.157510 26544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.007s	sys 0.014s
I20260709 12:10:44.509920 29296 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:45.094816 29289 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.009s	sys 0.011s
I20260709 12:10:44.506234 29115 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:44.570442 29425 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:45.145654 28852 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
W20260709 12:10:45.166570 26540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.009s	sys 0.018s
W20260709 12:10:45.205682 26540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.009s	sys 0.018s
I20260709 12:10:44.568434 29375 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:10:45.158378 29372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.020s	sys 0.038s
I20260709 12:10:44.510509 29171 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:45.193769 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:10:45.194432 26544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.007s	sys 0.014s
I20260709 12:10:44.913133 29394 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:45.204906 26469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.000s	sys 0.036s
W20260709 12:10:45.209231 26469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.000s	sys 0.036s
I20260709 12:10:45.210366 26467 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:45.198899 29248 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.012s	sys 0.007s
W20260709 12:10:45.202129 29289 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.009s	sys 0.011s
W20260709 12:10:45.201223 29217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.004s	sys 0.014s
W20260709 12:10:45.204756 29300 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.005s	sys 0.011s
I20260709 12:10:45.231145 26467 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:10:45.232694 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:45.234804 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:45.203779 29425 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:45.209964 29171 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:45.219360 29217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.004s	sys 0.014s
W20260709 12:10:45.222318 29300 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.005s	sys 0.011s
I20260709 12:10:45.243340 29171 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:45.270298 29450 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:10:45.277168 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:45.277887 26466 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
W20260709 12:10:45.262095 29210 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.023s	sys 0.053s
W20260709 12:10:45.279836 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 180068us
I20260709 12:10:45.288580 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.292527 26540 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:45.292680 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:45.284086 29210 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.023s	sys 0.054s
I20260709 12:10:45.299046 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:45.301064 26546 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.001s	sys 0.001s
W20260709 12:10:45.301487 26546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.002s	sys 0.001s
W20260709 12:10:45.293972 29290 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.020s	sys 0.045s
I20260709 12:10:45.305239 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:45.308059 26438 leader_election.cc:336] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.565s (SENT)
W20260709 12:10:45.308746 26438 leader_election.cc:336] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.598s (SENT)
I20260709 12:10:45.308991 26438 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:45.312472 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 144499us
I20260709 12:10:45.313872 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:45.320173 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.321091 26540 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
W20260709 12:10:45.323554 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.305058 29290 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.020s	sys 0.046s
I20260709 12:10:45.324244 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:45.330615 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:45.338151 26540 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:45.343155 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:45.351655 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.354005 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.361759 26540 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:45.396479 26540 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:10:45.335271 29248 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.396888 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:45.399143 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:45.402801 26466 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:45.404420 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.301275 29425 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:45.428413 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:45.429768 26619 raft_consensus.cc:2410] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:45.435859 26540 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:45.399610 29290 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:45.438829 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 114597us
I20260709 12:10:45.443940 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:45.448582 26613 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12. Ops: []
W20260709 12:10:45.451869 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 109743us
I20260709 12:10:45.456290 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:45.456435 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:45.457044 26617 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:45.457206 26622 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:45.458786 26615 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:45.459589 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:45.459893 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:45.460574 26621 raft_consensus.cc:2410] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:10:45.460641 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:45.460930 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:45.461474 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:45.461923 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:45.459674 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:45.462246 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:45.462708 26619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54654
I20260709 12:10:45.463109 26616 raft_consensus.cc:2410] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:45.463202 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:45.463323 26619 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:45.464037 26619 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.464221 26618 raft_consensus.cc:2410] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:45.462157 26621 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:10:45.464692 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:45.464721 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:45.461583 26615 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
W20260709 12:10:45.465487 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.465726 26616 raft_consensus.cc:2410] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:45.458776 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:45.468847 26622 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:45.441308 28852 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:45.446349 29372 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:45.414546 29248 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:45.473747 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:45.487782 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:45.488621 26466 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:45.487377 26513 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:45.495246 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:45.501174 26619 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:45.481549 29461 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:45.481086 29467 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.447002 29290 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:45.506524 26617 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:45.528735 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:45.530001 26466 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 6: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:45.532549 26619 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:45.493896 28852 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:10:45.514001 29454 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 12:10:45.547219 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.535048 26466 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:10:45.550146 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2638) took 1094 ms. Trace:
W20260709 12:10:45.537684 29456 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 12:10:45.539292 29339 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 3.908s	user 0.009s	sys 0.018s
I20260709 12:10:45.540217 29474 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.542543 29481 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:45.545475 29471 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:10:45.537431 29461 raft_consensus.cc:697] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:45.552264 26466 rpcz_store.cc:276] 0709 12:10:44.455592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.534350 (+1078758us) service_pool.cc:224] Handling call
0709 12:10:45.534748 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:45.549687 (+ 14939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.550055 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:45.554778 26614 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:45.489656 29468 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
W20260709 12:10:45.535332 29459 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
W20260709 12:10:45.581266 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 114301us
I20260709 12:10:45.492182 29372 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:45.582918 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.512981 29453 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:10:45.586879 26466 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:45.585057 29479 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:45.608844 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.532132 29296 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:45.611479 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1614) took 1224 ms. Trace:
W20260709 12:10:45.611564 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 440133us
I20260709 12:10:45.612125 26546 rpcz_store.cc:276] 0709 12:10:44.387133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.502945 (+115812us) service_pool.cc:224] Handling call
0709 12:10:44.528381 (+ 25436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:44.558362 (+ 29981us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:44.558416 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:44.568688 (+ 10272us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.301892 (+733204us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:45.301939 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.301987 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:45.544813 (+242826us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:10:45.605854 (+ 61041us) raft_consensus.cc:1685] finished
0709 12:10:45.605887 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.611405 (+  5518us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":675,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":7558,"spinlock_wait_cycles":5431552,"thread_start_us":732741,"threads_started":1,"wal-append.queue_time_us":867017}
W20260709 12:10:45.585479 29232 consensus_meta.cc:287] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.166s	user 0.019s	sys 0.000s
I20260709 12:10:45.616640 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.650759 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:45.651113 29314 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:45.651610 26543 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:45.652518 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.584605 29467 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:45.670573 29467 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:45.671820 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 361) took 2371 ms. Trace:
I20260709 12:10:45.673094 29467 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:45.579401 29474 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:45.624444 29377 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:45.624688 29461 consensus_queue.cc:237] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:45.626554 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:45.628378 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1615) took 1237 ms. Trace:
I20260709 12:10:45.698015 26470 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.628539 29333 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:45.636418 29477 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.638626 26472 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:45.644738 29296 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:45.605823 29448 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:45.648165 29248 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:45.608741 29481 raft_consensus.cc:697] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:45.698129 26544 rpcz_store.cc:276] 0709 12:10:44.390711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.321697 (+930986us) service_pool.cc:224] Handling call
0709 12:10:45.348185 (+ 26488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.442217 (+ 94032us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.442331 (+   114us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.467417 (+ 25086us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.610719 (+143302us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:45.610757 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.610838 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:45.628083 (+ 17245us) raft_consensus.cc:1685] finished
0709 12:10:45.628121 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.628299 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14869,"raft.queue_time_us":109727,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":15470,"thread_start_us":145690,"threads_started":2,"wal-append.queue_time_us":140082}
I20260709 12:10:45.655802 29303 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:45.657485 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:45.705034 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2633) took 1250 ms. Trace:
I20260709 12:10:45.651129 26546 raft_consensus.cc:2410] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:45.668184 26543 raft_consensus.cc:2376] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6. Re-sending same reply.
I20260709 12:10:45.671656 29171 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:45.618517 29290 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:45.691238 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.672525 26468 rpcz_store.cc:276] 0709 12:10:43.300120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.300250 (+   130us) service_pool.cc:224] Handling call
0709 12:10:43.307051 (+  6801us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.607032 (+299981us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:43.632522 (+ 25490us) log.cc:844] Serialized 14 byte log entry
0709 12:10:43.756858 (+124336us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:43.758649 (+  1791us) log.cc:844] Serialized 26 byte log entry
0709 12:10:43.758907 (+   258us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:43.758971 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.182065 (+1423094us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b18001adf40. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:10:45.671215 (+489150us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54001c0554. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:45.671317 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:45.671400 (+    83us) raft_consensus.cc:1685] finished
0709 12:10:45.671422 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.671697 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26708,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":3772,"raft.queue_time_us":9069,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":25072,"spinlock_wait_cycles":673909760,"thread_start_us":92964,"threads_started":1,"wal-append.queue_time_us":290952,"wal-append.run_cpu_time_us":2424,"wal-append.run_wall_time_us":1063562}
W20260709 12:10:45.697037 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.667034 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.705452 26472 rpcz_store.cc:276] 0709 12:10:44.453930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.470978 (+ 17048us) service_pool.cc:224] Handling call
0709 12:10:45.637984 (+1167006us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b5800011198. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:10:45.638289 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.703913 (+ 65624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.704212 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34487040}
W20260709 12:10:45.708983 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 51587.2us
I20260709 12:10:45.712226 26545 raft_consensus.cc:2410] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:45.695690 29372 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:45.699270 29479 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:45.716204 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:45.717386 26470 raft_consensus.cc:2410] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:45.716495 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:45.718048 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 105189us
W20260709 12:10:45.717761 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 222605us
I20260709 12:10:45.718497 26543 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:45.720916 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2647) took 1209 ms. Trace:
I20260709 12:10:45.721266 26470 rpcz_store.cc:276] 0709 12:10:44.511115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.097861 (+586746us) service_pool.cc:224] Handling call
0709 12:10:45.626347 (+528486us) spinlock_profiling.cc:243] Waited 78.6 ms on lock 0x7b5800011198. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:10:45.720854 (+ 94507us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180666112}
I20260709 12:10:45.722826 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:45.708822 29282 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.724332 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.726686 26546 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:45.727921 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:45.728648 26546 raft_consensus.cc:2376] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7. Re-sending same reply.
I20260709 12:10:45.729784 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:45.730777 26546 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:45.731647 29492 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:45.734824 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:45.735159 29492 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:45.736091 29492 raft_consensus.cc:3055] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:45.736467 29296 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:45.706825 29448 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:45.747269 29448 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:45.709942 29477 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:45.720402 29372 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:45.750887 29372 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.751246 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:45.751380 29372 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.752238 29466 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:45.752811 29466 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:45.753440 26513 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:45.753702 29466 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:45.754273 29314 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:45.754729 29314 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:45.754902 29246 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:45.755133 29314 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.758837 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:45.739569 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.764034 26545 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:45.764818 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.740939 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.742187 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.742579 29481 consensus_queue.cc:237] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:45.743419 29303 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:45.743779 29480 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:45.743916 29333 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:45.744715 29296 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:45.784655 29296 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.777314 29477 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:45.785948 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:45.786652 26545 raft_consensus.cc:2376] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6. Re-sending same reply.
I20260709 12:10:45.773983 29465 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:10:45.722317 29290 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:10:45.771461 26546 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:45.780335 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:45.789712 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.790055 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:45.790709 26546 raft_consensus.cc:2410] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:10:45.781296 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:45.779330 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:45.792572 26472 raft_consensus.cc:2410] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:45.783594 29448 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:45.739369 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:45.786912 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.736466 29492 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:45.796710 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.813426 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:45.814625 26468 raft_consensus.cc:2410] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:45.811642 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.816450 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:45.818127 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 78866.4us
W20260709 12:10:45.818295 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.819381 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.774274 29303 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.830036 26439 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:45.833839 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:45.834841 26472 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:45.836206 26470 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:45.838104 26470 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:45.710187 28852 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:45.803450 29453 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.803750 29477 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:45.840354 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 393) took 4378 ms. Trace:
I20260709 12:10:45.794703 29248 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:45.795831 29448 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:45.863245 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:45.845542 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:45.846679 26438 leader_election.cc:336] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.520s (SENT)
I20260709 12:10:45.848307 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:45.849319 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:45.851613 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:45.864871 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:45.789187 29468 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:10:45.844537 29303 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.854204 26542 rpcz_store.cc:276] 0709 12:10:41.448957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.667631 (+218674us) service_pool.cc:224] Handling call
0709 12:10:41.667936 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:41.668137 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:41.668428 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.705134 (+4036706us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b1800402b20. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a23a 00007f50760e4a2a
0709 12:10:45.827077 (+121943us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.827162 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:45.827230 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.827330 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.827509 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":100,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":16713,"raft.queue_time_us":4705,"spinlock_wait_cycles":11315584,"thread_start_us":121476,"threads_started":1}
I20260709 12:10:45.840382 29467 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:45.857182 26472 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:45.858044 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.861438 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:45.862154 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.872481 26544 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:10:45.854485 26439 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:45.847461 29320 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.749s	user 0.020s	sys 0.020s
I20260709 12:10:45.853613 29377 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:45.867175 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 108417us
I20260709 12:10:45.868175 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:45.874655 26470 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:45.875026 26470 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:45.886791 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.888640 26542 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:45.887151 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:45.889133 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.875785 26470 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:45.890553 26470 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.890915 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.891853 26542 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 6: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:10:45.870507 29361 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.527s	user 0.009s	sys 0.030s
I20260709 12:10:45.853973 29477 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:45.856068 29493 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:45.866518 29448 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:45.874045 29320 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.776s	user 0.020s	sys 0.020s
I20260709 12:10:45.917212 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.917938 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:45.917886 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.935209 26542 raft_consensus.cc:2410] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:45.915835 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.935339 26544 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:45.935786 26543 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:45.917572 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:45.915374 29361 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.586s	user 0.009s	sys 0.031s
I20260709 12:10:45.936798 26546 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:45.887887 29466 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:45.934151 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:45.886700 29252 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:45.886567 29377 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:45.919072 28986 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:45.783617 29479 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:45.945894 26472 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 8: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:45.875869 29488 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:45.941588 26470 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
W20260709 12:10:45.950260 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 102042us
I20260709 12:10:45.966915 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:45.951723 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 105112us
I20260709 12:10:45.968293 29118 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:45.969506 29118 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:45.970853 26465 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:10:45.972031 29466 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.973019 29488 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:45.974797 29216 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:45.975308 29216 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:45.955479 29377 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:45.976436 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.947681 29269 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:45.952417 28986 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:45.977500 28986 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.921702 29493 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:45.980736 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:45.982065 26545 raft_consensus.cc:2410] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:10:45.976302 29216 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:45.949379 29173 raft_consensus.cc:2764] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:10:45.866930 29492 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:45.950912 29282 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:10:46.029564 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:45.989892 29316 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.954698 29465 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:10:45.988590 29493 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:45.993232 29474 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:45.993963 29171 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:46.017181 29361 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:10:46.047209 26545 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 5: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:10:46.048647 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 81833us
W20260709 12:10:46.047541 26438 leader_election.cc:336] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.665s (SENT)
W20260709 12:10:46.049444 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.056546 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:46.060197 29502 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:10:46.060861 29505 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.061481 29505 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:46.072602 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1605) took 2261 ms. Trace:
I20260709 12:10:46.073094 26539 rpcz_store.cc:276] 0709 12:10:43.810999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.815899 (+  4900us) service_pool.cc:224] Handling call
0709 12:10:43.869623 (+ 53724us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:44.024031 (+154408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.072297 (+2048266us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b540037e1d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:46.072538 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353464704}
I20260709 12:10:46.074064 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:10:46.078248 26438 leader_election.cc:336] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.677s (SENT)
W20260709 12:10:46.079850 26438 leader_election.cc:336] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.720s (SENT)
W20260709 12:10:46.081007 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.081681 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.085806 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:46.092056 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:46.098762 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:46.099570 26539 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.099630 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:46.053893 29216 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:46.072947 29465 consensus_queue.cc:1243] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:46.054149 29361 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:46.095376 29252 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:46.024627 29477 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:46.095695 29173 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.096206 29171 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:46.134128 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.052137 29316 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:46.135003 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 280590us
I20260709 12:10:46.140846 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:46.142797 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:46.143709 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 249329us
I20260709 12:10:46.117925 29468 consensus_queue.cc:1243] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:10:46.155125 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.156005 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.158300 26438 leader_election.cc:336] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.822s (SENT)
I20260709 12:10:46.159026 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:46.165979 26438 leader_election.cc:336] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.892s (SENT)
I20260709 12:10:46.180675 26620 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:46.135679 29171 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:46.185192 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:46.189280 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:46.195830 27164 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.189862 26622 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12. Ops: []
I20260709 12:10:46.191931 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:46.197907 26619 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:46.200148 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:46.219144 29507 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:10:46.155133 29505 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:46.225565 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:46.139314 29314 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:46.219345 29157 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.238335 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:46.216847 29232 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.185582 29500 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.217232 29488 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:46.189256 29173 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:46.240393 27166 raft_consensus.cc:2410] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:10:46.246982 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.250561 26539 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:46.201820 29171 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.293886 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:46.243353 29221 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.255259 29509 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:10:46.258003 29474 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:46.263782 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:46.283397 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:46.244866 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:46.301550 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:46.200050 29361 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:46.285195 29500 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:46.303823 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:46.389103 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:46.389539 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:46.389947 26542 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 8: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:46.366950 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 405) took 1025 ms. Trace:
I20260709 12:10:46.390849 26546 rpcz_store.cc:276] 0709 12:10:45.341344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.946232 (+604888us) service_pool.cc:224] Handling call
0709 12:10:45.946560 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.946780 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:46.145492 (+198712us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.366552 (+221060us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:46.366613 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:46.366667 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.366749 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.366882 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":336815,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":100,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":120,"thread_start_us":392956,"threads_started":2}
I20260709 12:10:46.392910 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:46.351013 26438 leader_election.cc:336] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.098s (SENT)
W20260709 12:10:46.367596 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.394222 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:46.394312 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:46.394886 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:46.395289 26469 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:46.395565 26466 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.397852 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:46.400897 26542 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:46.291608 29372 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.539s	user 0.022s	sys 0.001s
I20260709 12:10:46.407670 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:46.414292 26539 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:46.393698 26546 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 8: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:46.410270 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:46.410729 26472 raft_consensus.cc:2410] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:10:46.412911 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 61958.9us
W20260709 12:10:46.416618 26438 leader_election.cc:336] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.111s (SENT)
I20260709 12:10:46.416169 26542 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:46.417479 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:46.359934 29296 consensus_meta.cc:287] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.561s	user 0.007s	sys 0.007s
W20260709 12:10:46.422443 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.420562 26546 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:46.427088 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:46.428722 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:46.429934 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:46.427898 26469 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:10:46.433084 26469 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:46.447772 26469 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:46.434899 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:46.450438 26545 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:46.277638 29232 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:46.451336 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:46.304312 29221 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:46.407271 29474 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:46.454332 26546 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:46.419286 29467 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:46.466867 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:46.455284 26615 raft_consensus.cc:2410] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:46.468086 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:46.468467 26539 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:46.468976 26615 raft_consensus.cc:2410] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:10:46.455592 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 406) took 1114 ms. Trace:
I20260709 12:10:46.458976 26469 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:46.454551 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:46.469404 26545 rpcz_store.cc:276] 0709 12:10:45.341661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.412382 (+1070721us) service_pool.cc:224] Handling call
0709 12:10:46.450232 (+ 37850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.455239 (+  5007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.455510 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:46.469971 27166 raft_consensus.cc:2410] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:46.465328 26546 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:46.419749 29360 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:46.421643 29361 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:46.459384 29173 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.346257 29488 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.114s
I20260709 12:10:46.477098 26466 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:10:46.477803 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:46.472081 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 77259.9us
I20260709 12:10:46.473531 26621 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:46.474449 26617 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:46.346484 29325 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 12:10:46.475189 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:46.490276 26615 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 6: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:46.453568 29248 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.492424 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:46.493144 26472 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:10:46.494180 26546 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:10:46.459656 29226 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:46.460089 29316 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:46.423820 29372 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:46.427747 29296 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:46.519927 26546 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:46.534513 26514 connection.cc:256] RPC call timeout handler was delayed by -4.09242772000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
W20260709 12:10:46.535085 26514 connection.cc:256] RPC call timeout handler was delayed by -2.2294277200001034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.367s for a response
I20260709 12:10:46.535960 26514 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:46.503571 29226 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.547225 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:46.464471 29506 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
W20260709 12:10:46.554205 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.539361 29448 consensus_meta.cc:287] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.588s	user 0.014s	sys 0.009s
I20260709 12:10:46.556531 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:46.487639 29360 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:46.562065 29221 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:46.564468 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 136566us
I20260709 12:10:46.566301 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:46.566946 29360 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:46.562460 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:46.567976 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:46.569197 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:46.569352 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:46.569610 26588 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:46.569624 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 90369.7us
I20260709 12:10:46.569962 26618 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:46.572216 26588 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:46.532668 29527 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:46.576954 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:46.577080 26588 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:46.577736 26546 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:46.519801 29248 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:46.551985 29226 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.545929 29314 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:46.581012 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:46.582793 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:46.582805 26615 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.579775 27164 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:10:46.585130 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:46.585976 27164 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:46.568192 27163 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:46.578444 29118 consensus_meta.cc:287] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.608s	user 0.015s	sys 0.000s
W20260709 12:10:46.580482 29303 consensus_meta.cc:287] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.685s	user 0.014s	sys 0.005s
W20260709 12:10:46.583776 29521 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 12:10:46.593135 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:46.576248 29508 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.575302 29527 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:46.578608 29505 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:46.569429 29448 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:46.583995 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:46.575644 29522 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:10:46.597453 29320 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.598647 26541 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:46.634524 26615 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:10:46.594836 29530 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:46.639231 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:46.583398 29528 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.048s
W20260709 12:10:46.648602 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.642928 27159 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:46.649627 29296 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:46.650084 29522 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.645457 29221 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:10:46.667805 29221 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:46.668238 29221 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:46.643715 29531 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:10:46.659255 28893 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:46.670713 29531 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:46.670840 29519 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:10:46.615666 29505 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:46.670776 28893 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:46.671847 29505 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:46.672441 29524 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:10:46.673983 29526 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:10:46.653349 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:46.675792 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:46.646512 29500 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:46.676896 26615 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 8: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:46.620373 27161 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: [6.7-7.8]
I20260709 12:10:46.657761 26616 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:46.658689 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:46.617491 29527 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:46.638541 29326 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.715260 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.679209 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:46.657759 29320 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.729056 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.599501 29303 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:46.666572 29522 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:46.669138 29221 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:46.703169 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:46.747605 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:46.678058 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:46.748670 26471 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
W20260709 12:10:46.674255 29216 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.006s
I20260709 12:10:46.701937 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1738) took 1170 ms. Trace:
I20260709 12:10:46.659978 26618 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:46.657943 29533 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.698846 29523 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:10:46.697582 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:10:46.777160 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 79721.2us
I20260709 12:10:46.749284 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:46.749709 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:46.689826 29349 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:10:46.753261 29226 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:46.671200 29531 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:46.745183 29326 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:46.691164 29334 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:46.755555 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:46.729055 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:46.755546 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:46.765153 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 185352us
I20260709 12:10:46.797505 26539 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
W20260709 12:10:46.690049 29377 consensus_meta.cc:287] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.714s	user 0.008s	sys 0.010s
W20260709 12:10:46.764416 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.745419 26467 raft_consensus.cc:2410] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:10:46.699725 28986 consensus_meta.cc:287] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.001s
I20260709 12:10:46.769122 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:46.772799 26548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 1593) took 3940 ms (client timeout 1721 ms). Trace:
I20260709 12:10:46.799894 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:46.800042 26548 rpcz_store.cc:269] 0709 12:10:42.832223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.858579 (+ 26356us) service_pool.cc:224] Handling call
0709 12:10:46.772533 (+3913954us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b5400338bd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:46.772715 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1782374144}
I20260709 12:10:46.774528 26547 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:10:46.779187 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:46.770466 29360 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.677798 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:46.677891 29171 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:46.767740 26542 rpcz_store.cc:276] 0709 12:10:45.531853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.425244 (+893391us) service_pool.cc:224] Handling call
0709 12:10:46.425707 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.451245 (+ 25538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.451296 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.452058 (+   762us) log.cc:844] Serialized 26 byte log entry
0709 12:10:46.572233 (+120175us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:46.582884 (+ 10651us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.624334 (+ 41450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.624562 (+   228us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.701674 (+ 77112us) raft_consensus.cc:1685] finished
0709 12:10:46.701692 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.701860 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6734,"prepare.queue_time_us":15151,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":43408,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":550,"thread_start_us":118895,"threads_started":2,"wal-append.queue_time_us":167189}
I20260709 12:10:46.784715 26544 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 8: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:46.786073 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:46.679443 29448 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:46.765036 29520 log.cc:927] Time spent T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 12:10:46.782853 29157 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:46.790863 29531 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:46.792117 29226 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:46.793053 29372 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:46.780253 29533 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:46.794360 29493 consensus_meta.cc:287] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.741s	user 0.011s	sys 0.000s
I20260709 12:10:46.788812 29508 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.826126 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52703.2us
I20260709 12:10:46.803462 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:46.645509 29316 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.120s
I20260709 12:10:46.770781 29232 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:46.804983 28986 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:46.831948 29217 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:46.832405 29217 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:46.833870 28986 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:46.834789 27160 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:46.835247 29508 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:46.835940 29303 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:46.837785 29508 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:46.806762 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:46.808898 29522 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:46.843745 27165 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 7. Ops: []
W20260709 12:10:46.682890 29453 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.824s	user 0.017s	sys 0.003s
I20260709 12:10:46.844082 29533 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:46.844602 29453 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.845196 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:46.845654 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:46.845749 27162 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:46.846552 26619 raft_consensus.cc:2410] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:46.848085 29248 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:46.847630 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:46.851058 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:10:46.852620 29483 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 1.248s	user 0.000s	sys 0.006s
I20260709 12:10:46.852399 27164 raft_consensus.cc:2410] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:46.812629 29505 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:46.827450 26471 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:46.838059 27160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 438) took 2424 ms. Trace:
I20260709 12:10:46.820523 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:46.801575 29221 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.822448 26539 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: [2.2-5.3]
I20260709 12:10:46.799798 29398 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.823035 26514 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:46.818579 29157 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:46.876677 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:46.829548 29531 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.829741 29171 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:46.810496 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:46.879525 29157 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:46.880635 29505 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:46.817036 26542 raft_consensus.cc:1217] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Deduplicated request from leader. Original: 4.4->[6.5-8.6]   Dedup: 6.5->[8.6-8.6]
I20260709 12:10:46.855785 29493 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:46.766456 29320 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:46.819581 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 242571us
I20260709 12:10:46.862179 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:46.833422 29217 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:46.885911 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:46.887969 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 65082.9us
I20260709 12:10:46.887705 26588 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:46.888823 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:46.869670 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:46.873718 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:46.891491 26472 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.877432 26539 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.866842 27160 rpcz_store.cc:276] 0709 12:10:44.413676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.413816 (+   140us) service_pool.cc:224] Handling call
0709 12:10:46.812844 (+2399028us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:10:46.821438 (+  8594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.835324 (+ 13886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.837793 (+  2469us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b54006cfcd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:46.837993 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38054912}
I20260709 12:10:46.803258 29377 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:46.882547 26542 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9. Ops: [6.5-8.6]
W20260709 12:10:46.883931 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 73548.9us
I20260709 12:10:46.898185 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:46.884114 29480 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:46.881538 29492 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.881896 27159 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 5. Current term is 7. Ops: []
I20260709 12:10:46.896294 26514 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:46.902333 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:46.889837 29541 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:46.893050 29535 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:46.894785 29316 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:46.885180 29505 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:46.937814 29535 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:46.938441 29535 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:46.903717 29542 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:10:46.905052 29394 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:46.894230 29533 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:10:46.906504 29448 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:46.907027 29493 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:46.909448 29500 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:46.908862 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:46.908517 29527 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:46.911398 29269 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:10:46.914466 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.918833 26469 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:46.922715 26542 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:46.919621 29216 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.931607 29541 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:10:46.954373 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 58175.5us
I20260709 12:10:46.959827 26619 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:10:46.973452 27133 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:46.927208 29217 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:46.878580 29398 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:46.899974 29480 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:46.997553 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:46.998096 26542 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.977435 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 1866) took 1501 ms. Trace:
W20260709 12:10:46.978210 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 69416us
I20260709 12:10:46.998623 26614 rpcz_store.cc:276] 0709 12:10:45.460395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.464389 (+  3994us) service_pool.cc:224] Handling call
0709 12:10:46.961610 (+1497221us) spinlock_profiling.cc:243] Waited 89.3 ms on lock 0x7b5400194e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:46.961847 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205363712}
I20260709 12:10:46.999291 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:46.972929 26472 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:10:46.981848 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:46.980422 29269 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:47.000464 26613 raft_consensus.cc:2410] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:47.000638 29269 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:47.001528 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:47.001803 29269 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:46.995146 29248 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:47.004096 29248 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.004527 29248 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.931878 29316 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:46.990161 29541 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.002431 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:46.934429 26539 raft_consensus.cc:2410] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:46.919708 29391 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 12:10:46.993348 26514 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:46.963624 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:47.007627 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:47.016739 27168 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 437) took 2605 ms (client timeout 2079 ms). Trace:
W20260709 12:10:47.017202 27168 rpcz_store.cc:269] 0709 12:10:44.411701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.418521 (+  6820us) service_pool.cc:224] Handling call
0709 12:10:46.963387 (+2544866us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:10:47.016664 (+ 53277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12894592}
I20260709 12:10:47.003479 29290 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:47.008495 26472 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:47.015414 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:46.960134 29505 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.019439 26514 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:46.974422 29377 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:47.021214 26539 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:10:47.020018 29479 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.978505 29531 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.036369 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:47.018121 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:47.019131 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:47.026254 26539 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:10:47.026595 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:47.003489 29269 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.027781 29533 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:47.028113 29480 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:47.015174 29316 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.034948 29320 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:46.982627 29527 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:47.038652 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:47.040156 26613 raft_consensus.cc:2410] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:47.067895 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:47.069535 26514 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:47.014109 29221 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:47.020372 29394 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:47.020742 29500 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:47.024770 29391 consensus_queue.cc:1243] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:47.026209 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:47.071964 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:47.074210 26542 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:10:47.075318 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:47.044528 29505 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:47.047123 29530 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:47.079075 29530 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.079200 26613 raft_consensus.cc:2410] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:47.079484 29530 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.079560 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:47.080114 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:47.080834 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:47.081893 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:47.084187 26613 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:47.081966 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:10:47.091732 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 65607.7us
I20260709 12:10:47.093237 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:47.095216 26542 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.095661 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:47.097540 26514 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:47.075147 29221 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:47.099064 29221 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:47.100106 29221 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.077461 29533 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.102844 29252 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:47.103643 29252 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:47.104889 29252 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:47.091087 29505 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:47.107476 29505 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:47.108796 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:47.114187 29533 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.097280 29171 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:47.105623 29539 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:47.120460 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 78894us
I20260709 12:10:47.121611 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:47.116998 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:47.127858 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.127758 26466 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:47.120688 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 403) took 1786 ms. Trace:
I20260709 12:10:47.128851 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:47.130430 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:47.128542 26543 rpcz_store.cc:276] 0709 12:10:45.334494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.946373 (+611879us) service_pool.cc:224] Handling call
0709 12:10:45.990410 (+ 44037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.990753 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:46.278530 (+287777us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.490595 (+212065us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:46.490670 (+    75us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:46.490757 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.490840 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.120457 (+629617us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b54002364d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:47.120608 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20543,"prepare.queue_time_us":367318,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":3048,"raft.queue_time_us":10613,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":6080,"spinlock_wait_cycles":15803776,"thread_start_us":487380,"threads_started":2,"wal-append.queue_time_us":263481}
I20260709 12:10:47.137187 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:47.114274 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:47.139114 26464 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:47.077636 29394 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.076987 29508 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:47.077437 29303 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:47.118029 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:47.140688 26514 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:47.141235 26542 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:47.159986 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:47.161540 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:47.143568 29527 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:47.145571 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:47.162343 26542 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:10:47.090993 29391 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:47.087579 29530 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:47.157459 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:10:47.164952 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.167496 26514 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:47.125128 29171 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.142117 29480 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:47.186589 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.191676 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:47.192709 26543 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:47.148542 29453 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:47.153759 29394 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.207785 26514 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:10:47.211072 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.220916 26514 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:47.188607 29391 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:47.189718 29171 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.157100 29448 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
W20260709 12:10:47.236874 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 83153.8us
I20260709 12:10:47.200433 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:47.197531 29527 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:47.188727 29290 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:10:47.225966 29533 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.227360 29453 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:47.230495 29364 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:47.197383 29372 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:10:47.259028 29535 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:47.260043 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:47.260984 26619 raft_consensus.cc:2410] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:47.261277 29535 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:47.261840 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:47.254078 29391 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:47.263621 29453 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:47.266569 29364 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:47.267719 29364 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:47.271672 29530 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:47.272403 29398 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:47.275641 29527 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:47.276939 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:47.277673 27167 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:47.245349 29448 consensus_queue.cc:1243] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:47.280047 26466 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:10:47.278198 27167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56886 (request call id 505) took 1061 ms. Trace:
I20260709 12:10:47.280956 27167 rpcz_store.cc:276] 0709 12:10:46.216867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.217136 (+   269us) service_pool.cc:224] Handling call
0709 12:10:47.276649 (+1059513us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:10:47.278101 (+  1452us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10681088}
I20260709 12:10:47.262061 29216 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:47.288874 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.287125 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 141646us
I20260709 12:10:47.255861 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:47.290047 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.290484 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.290781 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:47.293087 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.294674 26613 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:47.300841 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:47.301556 26619 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:47.302086 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:47.304680 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:47.306793 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:47.307761 26473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2634) took 2853 ms (client timeout 2643 ms). Trace:
I20260709 12:10:47.308354 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:47.308139 26473 rpcz_store.cc:269] 0709 12:10:44.454225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.471111 (+ 16886us) service_pool.cc:224] Handling call
0709 12:10:47.306620 (+2835509us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b5800011198. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:10:47.307688 (+  1068us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26394368}
W20260709 12:10:47.312790 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 92009.9us
I20260709 12:10:47.313853 26514 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:47.299818 29448 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.300000 28852 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.300194 29290 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:47.310125 29549 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.193s	user 0.000s	sys 0.004s
I20260709 12:10:47.303444 29216 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:47.342832 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:47.295819 29224 consensus_queue.cc:1059] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:10:47.299413 29232 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 12:10:47.322372 29548 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.171s	user 0.004s	sys 0.000s
I20260709 12:10:47.310349 29525 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:47.322610 29550 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
W20260709 12:10:47.355261 29554 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:10:47.321995 29393 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:47.349190 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:47.355695 29216 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.363860 29391 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.365078 29525 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:47.414914 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 106304us
I20260709 12:10:47.349781 29290 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:47.379252 29224 raft_consensus.cc:3055] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:47.383251 29393 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.349539 28852 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:47.383178 29221 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:47.390486 29216 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.376775 29508 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:10:47.414292 29448 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.438557 29500 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:47.420921 29449 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 2.145s	user 0.007s	sys 0.004s
I20260709 12:10:47.438930 29448 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:47.433071 29508 consensus_queue.cc:1243] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:47.407948 29525 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:47.443917 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.438721 29221 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:47.434229 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1753) took 1810 ms. Trace:
I20260709 12:10:47.448304 26544 rpcz_store.cc:276] 0709 12:10:45.624230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.945780 (+321550us) service_pool.cc:224] Handling call
0709 12:10:47.434024 (+1488244us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b54001059d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:47.434170 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1856667392}
I20260709 12:10:47.422025 29224 raft_consensus.cc:740] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:47.428009 29393 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.459215 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:47.459117 29224 consensus_queue.cc:260] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:47.460408 29224 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:47.460605 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:47.463121 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:47.464350 29248 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:47.472921 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:47.480607 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:47.479271 29533 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.479671 29557 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.497408 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:47.479478 29505 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.486881 29480 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:47.501713 26544 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.503724 26539 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:47.504143 26539 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:47.487246 29563 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:47.504823 26539 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:47.510231 26539 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.507046 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 1870) took 1364 ms. Trace:
I20260709 12:10:47.511255 26620 rpcz_store.cc:276] 0709 12:10:46.142348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.142494 (+   146us) service_pool.cc:224] Handling call
0709 12:10:47.506838 (+1364344us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b540003c354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:47.506973 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85362048}
I20260709 12:10:47.519129 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:47.490759 29394 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:47.506440 29480 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.489104 29216 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:47.539733 26539 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:47.548770 26539 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:47.559556 29316 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:47.567349 29558 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:10:47.502872 29533 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:47.574884 26544 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:47.542773 29480 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.509603 29505 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:47.574436 29269 consensus_meta.cc:287] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.004s
W20260709 12:10:47.575330 29489 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:10:47.518042 29563 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:47.587697 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.588909 26544 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:47.580307 29303 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:47.598229 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.597414 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:47.601370 26542 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:47.596951 28893 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:47.602816 29557 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:47.603281 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:47.603528 29472 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:47.593133 29221 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:47.604133 29557 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:47.605199 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:47.589751 29217 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.002s
W20260709 12:10:47.610662 29479 consensus_meta.cc:287] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.575s	user 0.013s	sys 0.000s
I20260709 12:10:47.610723 29472 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:47.608479 29561 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:47.611279 29479 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:47.611881 29563 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:47.616917 26614 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
I20260709 12:10:47.618640 29525 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:47.624393 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.627936 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:10:47.608319 29570 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:10:47.609897 28852 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:47.641848 26541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 1592) took 4808 ms (client timeout 2147 ms). Trace:
W20260709 12:10:47.642307 26541 rpcz_store.cc:269] 0709 12:10:42.830718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.889864 (+ 59146us) service_pool.cc:224] Handling call
0709 12:10:47.639108 (+4749244us) spinlock_profiling.cc:243] Waited 3.71 s on lock 0x7b54002f7bd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:47.639239 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8527351168}
I20260709 12:10:47.604571 29527 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:10:47.645735 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:47.646049 29527 consensus_queue.cc:1243] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:47.649016 27162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 439) took 1507 ms. Trace:
I20260709 12:10:47.649501 27162 rpcz_store.cc:276] 0709 12:10:46.141887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.154130 (+ 12243us) service_pool.cc:224] Handling call
0709 12:10:46.191139 (+ 37009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.846409 (+655270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.648763 (+802354us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b540071af54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:47.648946 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504797056}
I20260709 12:10:47.651201 26622 raft_consensus.cc:2393] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 6: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:47.622113 29425 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.644321 28852 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:47.659068 29171 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:47.652743 29375 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.668017 29248 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:47.668380 29375 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:47.655042 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 5c23e0d03a4d457fa50856e09fe2f649: Illegal state: Replica 01a57027214a411e80874ac7febd628b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:10:47.659145 28852 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:47.654208 26620 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 8: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:47.634606 29557 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:47.659984 29393 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:47.661523 29505 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:47.663425 29533 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:47.665491 26545 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:10:47.669695 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1875) took 1510 ms. Trace:
W20260709 12:10:47.643115 29541 consensus_meta.cc:287] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.619s	user 0.015s	sys 0.002s
I20260709 12:10:47.677364 26616 rpcz_store.cc:276] 0709 12:10:46.158925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.159043 (+   118us) service_pool.cc:224] Handling call
0709 12:10:46.192342 (+ 33299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.743132 (+550790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.669403 (+926271us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b54003d8954. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:47.669627 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1069680512}
I20260709 12:10:47.683024 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:47.684073 26622 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.685341 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 402) took 2359 ms. Trace:
I20260709 12:10:47.668049 29171 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:47.685940 26540 rpcz_store.cc:276] 0709 12:10:45.325775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.438284 (+112509us) service_pool.cc:224] Handling call
0709 12:10:45.438840 (+   556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.494883 (+2056043us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b180046d800. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5075c824bc 00007f5072fd048b 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f50760d2060 00007f50760d2bfb 00007f50760dd64b
0709 12:10:47.495030 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.495055 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:47.495593 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 12:10:47.578156 (+ 82563us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:47.578197 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.578277 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.671835 (+ 93558us) raft_consensus.cc:1685] finished
0709 12:10:47.671866 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.685233 (+ 13367us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4300,"raft.queue_time_us":97170,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":33327,"spinlock_wait_cycles":70312192,"thread_start_us":194545,"threads_started":2,"wal-append.queue_time_us":118537}
I20260709 12:10:47.691931 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:47.693444 26616 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 3.
I20260709 12:10:47.705320 29284 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:47.705920 29284 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:47.706849 29284 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:47.708057 29284 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.708137 29393 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:47.711388 27161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 502) took 1527 ms. Trace:
I20260709 12:10:47.711946 27161 rpcz_store.cc:276] 0709 12:10:46.183936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.185410 (+  1474us) service_pool.cc:224] Handling call
0709 12:10:46.589487 (+404077us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:46.745061 (+155574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.711103 (+966042us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54003b6ad0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:47.711307 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":812519168}
I20260709 12:10:47.714721 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:47.716189 29474 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:47.717182 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:47.717859 29474 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:47.718711 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 2c246551966f4307a9c8a66e2f024385: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:47.717935 29557 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:47.716526 28852 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:47.721935 26613 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:10:47.728991 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.708071 29375 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:47.737550 26622 raft_consensus.cc:2410] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:10:47.741102 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.748013 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 7c931e3af68c4073a5ed978eb0f43f3f: Illegal state: Replica 01a57027214a411e80874ac7febd628b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:10:47.750645 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2544) took 1299 ms. Trace:
I20260709 12:10:47.751151 26621 rpcz_store.cc:276] 0709 12:10:46.450763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.497001 (+ 46238us) service_pool.cc:224] Handling call
0709 12:10:46.532914 (+ 35913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.568115 (+ 35201us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:46.783157 (+215042us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.862486 (+ 79329us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.862704 (+   218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:46.862767 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:46.862846 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.088688 (+225842us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b180033ef80. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:10:47.148978 (+ 60290us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b180033ef80. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:10:47.149169 (+   191us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b180033ef80. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:10:47.594878 (+445709us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b180033ef80. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fbb2a6 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419
0709 12:10:47.750355 (+155477us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b540009f6d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:47.750444 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.750573 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49824,"prepare.queue_time_us":268006,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":1979,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":12220,"spinlock_wait_cycles":186470912,"thread_start_us":277301,"threads_started":2,"wal-append.queue_time_us":128174}
I20260709 12:10:47.754004 26613 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:10:47.754473 26621 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:47.750885 29480 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:47.757309 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 2251a6321412417a8079201067ae2d0d: Illegal state: Replica ac3ac2181aa941229a758ccf6b5607cd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:10:47.759451 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:47.764786 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:47.772709 26439 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:47.683990 29541 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:47.762805 26616 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:47.779665 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:47.783156 26613 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:47.784332 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:47.782482 29492 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:47.785753 29492 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.786141 29492 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.785105 26613 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:10:47.791980 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:47.791251 26619 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:47.773556 29374 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:47.773710 29269 raft_consensus.cc:2764] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:10:47.759745 26622 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:47.792662 26616 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:47.796906 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:47.786656 29480 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:47.794165 29374 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:47.786587 29054 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:10:47.787631 29525 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:47.802146 26622 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:47.792639 29541 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:47.807334 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:47.808133 26621 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:47.810753 26622 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:47.803499 29374 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.809398 29269 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:47.822613 29246 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:47.822969 29269 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:47.846571 29448 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:47.846997 29216 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:47.848270 28986 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.849162 29560 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:47.849649 29560 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:47.850600 29560 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:47.851944 29560 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.854552 29472 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.855177 29472 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:47.855327 29492 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:47.857631 29492 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:47.859509 29316 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:47.839416 29246 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:10:47.897145 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.899454 26439 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:47.975273 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 76260us
I20260709 12:10:47.976727 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:47.965764 29269 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:47.902082 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.979504 29269 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.979656 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:47.980614 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:47.981101 26613 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 8: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:47.979660 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2659) took 1896 ms. Trace:
I20260709 12:10:47.981884 26469 rpcz_store.cc:276] 0709 12:10:46.083391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.470882 (+387491us) service_pool.cc:224] Handling call
0709 12:10:46.471198 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.977149 (+505951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.978925 (+1001776us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b5400069ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:47.979357 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1029006208}
W20260709 12:10:47.907193 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.983865 29246 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:47.985026 29539 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.986217 29539 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:47.987201 29054 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:47.987107 29539 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:47.987779 29054 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:47.988329 29054 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.990355 29539 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:47.997879 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:47.999109 26544 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
W20260709 12:10:48.003844 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.917325 26617 raft_consensus.cc:2410] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:10:48.072670 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.073218 26617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2547) took 1572 ms (client timeout 1508 ms). Trace:
I20260709 12:10:47.921901 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:47.849169 28986 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:48.076053 29522 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:48.077354 29522 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:47.936190 26471 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:47.940968 26546 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: [2.2-5.3]
W20260709 12:10:47.947207 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.078577 26471 pending_rounds.cc:85] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 6
I20260709 12:10:48.078914 26471 pending_rounds.cc:107] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:47.963397 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2556) took 1283 ms. Trace:
I20260709 12:10:48.079226 26471 raft_consensus.cc:2889] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:47.934223 26467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1604) took 2815 ms (client timeout 1595 ms). Trace:
I20260709 12:10:48.079344 26614 rpcz_store.cc:276] 0709 12:10:46.680179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.020701 (+340522us) service_pool.cc:224] Handling call
0709 12:10:47.962767 (+942066us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b5400196754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:47.963070 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1333258624}
W20260709 12:10:48.079783 26467 rpcz_store.cc:269] 0709 12:10:45.118861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.234488 (+115627us) service_pool.cc:224] Handling call
0709 12:10:47.933498 (+2699010us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54001c2354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:47.933888 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3471632256}
I20260709 12:10:48.081339 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:48.081570 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 376) took 1861 ms. Trace:
I20260709 12:10:48.082113 26467 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:10:48.083004 26618 raft_consensus.cc:2410] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:47.965570 26619 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.083817 29522 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:48.084755 26618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2555) took 1405 ms (client timeout 1748 ms). Trace:
I20260709 12:10:48.085160 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:48.085244 26618 rpcz_store.cc:269] 0709 12:10:46.679806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.768677 (+ 88871us) service_pool.cc:224] Handling call
0709 12:10:48.084536 (+1315859us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400346054. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:48.084705 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2950301440}
I20260709 12:10:47.967681 26622 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.004254 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:48.087185 26544 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.087685 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:48.089396 26622 raft_consensus.cc:1217] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Deduplicated request from leader. Original: 4.3->[6.4-6.4]   Dedup: 6.4->[]
I20260709 12:10:48.006436 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:48.089982 26622 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:48.008272 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:47.911060 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:47.858314 29472 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:48.014175 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:48.015741 26613 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:48.016592 29290 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:48.022666 26370 catalog_manager.cc:5697] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:48.025296 29477 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.108228 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:48.029203 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:48.110023 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:47.990211 29394 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:48.030846 27163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 440) took 1888 ms. Trace:
I20260709 12:10:48.111102 26540 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.111518 27163 rpcz_store.cc:276] 0709 12:10:46.142368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.165278 (+ 22910us) service_pool.cc:224] Handling call
0709 12:10:46.226929 (+ 61651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.592861 (+365932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.029930 (+1437069us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b540077c754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:48.030515 (+   585us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":582219520}
I20260709 12:10:48.112344 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:48.030902 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:48.113480 26467 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:48.113487 26473 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:48.034722 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 54474.9us
I20260709 12:10:48.037395 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:48.111167 26469 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 7: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:48.041250 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:48.043596 29326 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:48.043918 29398 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:48.046315 29531 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:48.049278 29054 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:48.050945 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:48.056982 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:48.057904 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:48.060657 27162 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:48.061590 27134 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:48.068711 29246 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.068500 29374 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:48.071027 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:48.089524 26618 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:48.081586 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:48.073715 26617 rpcz_store.cc:269] 0709 12:10:46.500948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.537899 (+ 36951us) service_pool.cc:224] Handling call
0709 12:10:48.072922 (+1535023us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540003c854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:48.073123 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3100640128}
W20260709 12:10:48.006075 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.090340 26543 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.090734 29115 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:48.092083 28986 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:48.082031 26471 rpcz_store.cc:276] 0709 12:10:46.220014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.002907 (+782893us) service_pool.cc:224] Handling call
0709 12:10:47.935201 (+932294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.079841 (+144640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.081366 (+  1525us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b54001c2350. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:48.081518 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142969216}
W20260709 12:10:48.093071 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.093801 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:48.006757 26616 pending_rounds.cc:85] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 4
I20260709 12:10:48.094899 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:48.095862 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:48.098977 26619 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 8: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:48.126595 26616 pending_rounds.cc:107] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:10:48.127115 26616 raft_consensus.cc:2889] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:48.128126 26464 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:48.129685 29560 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:48.130262 26547 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:10:48.131738 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:48.132602 26547 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:48.128029 26470 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.132671 29398 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:48.133824 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:48.133564 29398 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:48.134856 26546 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 7: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:48.136106 29054 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:48.128170 26541 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:48.111027 26542 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 8: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:48.032217 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:48.039573 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:48.138845 26472 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:10:48.118618 29531 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:48.104727 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:48.118798 26468 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:48.125581 27166 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:48.123921 26614 raft_consensus.cc:2410] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:10:48.131935 26617 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 4. Current term is 6. Ops: []
I20260709 12:10:48.138985 26466 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.109622 26370 catalog_manager.cc:5697] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 6 to 7, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 7 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:48.139241 26546 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:48.139981 26622 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.152081 29115 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.152734 29115 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.156018 26470 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:10:48.098327 26544 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
W20260709 12:10:48.164784 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.165412 26613 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.168224 26618 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:10:48.168866 26618 pending_rounds.cc:85] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 7
I20260709 12:10:48.169030 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:48.169391 26618 pending_rounds.cc:107] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:10:48.169891 26618 raft_consensus.cc:2889] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:48.171237 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 130137us
I20260709 12:10:48.172243 29290 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:48.172832 29157 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:48.173043 29290 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:48.173424 29157 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:48.174908 29157 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:48.176026 29290 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:48.176645 29157 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.176602 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:48.159780 26588 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:48.176046 29374 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:48.192461 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 131169us
I20260709 12:10:48.193765 27134 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:48.192456 26470 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.199913 29394 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:48.202510 29171 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:48.136129 29398 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:48.210944 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 140260us
I20260709 12:10:48.173352 29492 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 12:10:48.214830 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 100044us
I20260709 12:10:48.215304 29492 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:48.140892 29531 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:48.216266 26470 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
W20260709 12:10:48.210059 26438 leader_election.cc:336] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.233s (SENT)
W20260709 12:10:48.209009 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 55874.3us
I20260709 12:10:48.213809 26473 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
W20260709 12:10:48.221208 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.215747 29492 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:48.161753 29054 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:48.224241 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:48.232725 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.230444 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:48.234615 29522 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:10:48.240414 29505 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:48.241112 29505 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:48.241660 29505 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:48.235931 26621 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:48.237490 28986 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:48.246901 28986 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:48.247406 28986 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.252848 26620 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:48.255590 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.266242 26540 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:10:48.263793 26370 catalog_manager.cc:5697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:48.279945 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:48.280958 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:48.281630 26466 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:10:48.284461 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:48.285020 26544 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.271319 29522 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:10:48.286358 29537 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:10:48.287571 29492 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:48.289652 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 126956us
I20260709 12:10:48.286865 26539 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:48.290843 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.288800 29394 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.274308 29398 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:48.286749 29522 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.293143 26622 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:10:48.283092 26468 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:48.290235 29492 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.300843 26619 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:48.291270 26438 connection.cc:256] RPC call timeout handler was delayed by -1.3195223400000486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2626s for a response
I20260709 12:10:48.302415 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 374) took 1280 ms. Trace:
W20260709 12:10:48.302865 26438 connection.cc:256] RPC call timeout handler was delayed by -1.1916347050000695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
I20260709 12:10:48.301708 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:48.305130 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 82623.3us
I20260709 12:10:48.306840 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:48.302995 26620 rpcz_store.cc:276] 0709 12:10:47.022119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.810461 (+788342us) service_pool.cc:224] Handling call
0709 12:10:48.252481 (+442020us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.253447 (+   966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.301414 (+ 47967us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b5400033250. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:48.302312 (+   898us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":995474304}
I20260709 12:10:48.300676 29522 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:10:48.301347 29461 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.078s	user 0.009s	sys 0.016s
I20260709 12:10:48.315474 26545 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.312649 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:10:48.318687 26438 connection.cc:256] RPC call timeout handler was delayed by -1.088222339999902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2883s for a response
W20260709 12:10:48.319036 26438 connection.cc:256] RPC call timeout handler was delayed by -1.0520344439999008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
I20260709 12:10:48.299189 29394 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:48.317350 29461 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.183s	user 0.009s	sys 0.017s
I20260709 12:10:48.312436 26370 catalog_manager.cc:5697] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 2 to 4, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 4 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:10:48.325758 27166 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.324946 26468 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:48.335273 26370 catalog_manager.cc:5697] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 3 to 5, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 5 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:48.337944 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:48.338678 26370 catalog_manager.cc:5697] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 4 to 6, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 6 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:48.341300 26370 catalog_manager.cc:5697] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:48.355048 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47389.6us
I20260709 12:10:48.358276 29528 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:48.359127 29528 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.359688 29528 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:48.364709 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:48.366966 29527 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:48.367641 29527 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:48.368199 29527 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:48.370481 29246 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.371405 29269 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:48.371196 29246 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:48.372143 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 51022.7us
W20260709 12:10:48.376003 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.326200 29537 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:10:48.313580 29054 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:10:48.392545 26544 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:10:48.399878 26370 catalog_manager.cc:5697] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 2 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 4 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:48.409319 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 94691.2us
I20260709 12:10:48.404141 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:48.433969 26615 raft_consensus.cc:2410] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:48.434942 29512 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.435580 29512 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:48.436249 29595 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:48.436991 28986 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:48.450196 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:10:48.460695 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 86586us
I20260709 12:10:48.474603 26466 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:10:48.478370 26469 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:48.478991 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:10:48.481905 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.439379 29054 consensus_queue.cc:1243] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:48.437081 29595 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:48.500360 26543 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
W20260709 12:10:48.503427 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 53388.3us
W20260709 12:10:48.505769 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.490594 29477 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:48.492025 29394 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:48.513661 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:48.524250 26468 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.527994 29527 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:48.532009 26466 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:48.535140 29425 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.536048 29425 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:48.490306 29461 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:10:48.546643 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:48.548326 26470 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:48.517786 29477 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.525166 29054 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:48.548012 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 62643.8us
I20260709 12:10:48.555352 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:48.556030 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:48.571509 29326 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:48.572607 26621 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:48.573758 29472 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:48.571817 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:48.574468 26469 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:48.550273 29477 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.575239 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:48.553442 29599 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.585197 29527 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:48.587709 29451 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:48.590535 29226 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:10:48.592873 26514 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:48.593641 29489 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:48.594677 29425 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:48.599470 29227 consensus_queue.cc:1059] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:48.598079 27134 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:48.558533 29171 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:10:48.605342 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2575) took 1150 ms. Trace:
I20260709 12:10:48.605687 29597 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.607147 26473 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 7: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:48.606946 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:48.549182 29537 consensus_queue.cc:1059] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 12:10:48.607362 29593 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.327s	user 0.007s	sys 0.000s
I20260709 12:10:48.617525 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:48.622146 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 50901.7us
I20260709 12:10:48.614449 26620 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:10:48.627192 26472 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:48.584338 29054 raft_consensus.cc:697] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:48.631469 29595 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:48.631742 29227 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:48.633342 29115 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:48.665457 29227 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:48.634968 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:48.635659 29451 raft_consensus.cc:3055] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:48.608189 29472 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:48.668754 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:48.635812 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:48.636257 29597 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:48.636577 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:48.621145 29599 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:48.638505 29594 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.359s	user 0.009s	sys 0.000s
I20260709 12:10:48.638710 29425 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:48.638233 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:10:48.672097 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.670006 26471 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:10:48.644254 29528 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:48.644979 29531 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.647487 29560 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:48.621057 28986 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:48.648702 29512 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:48.684391 29599 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:48.684818 29597 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:48.685797 29115 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:48.656677 26468 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:48.661957 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:48.662822 29054 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:48.664081 26470 raft_consensus.cc:2410] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:48.667605 29451 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:48.619066 26616 rpcz_store.cc:276] 0709 12:10:47.455329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.993096 (+537767us) service_pool.cc:224] Handling call
0709 12:10:47.994039 (+   943us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:48.235942 (+241903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.235992 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:48.263716 (+ 27724us) log.cc:844] Serialized 52 byte log entry
0709 12:10:48.490858 (+227142us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:48.490925 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.491001 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.605042 (+114041us) raft_consensus.cc:1685] finished
0709 12:10:48.605069 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.605251 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26672,"raft.queue_time_us":29955,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":4601,"thread_start_us":202473,"threads_started":1,"wal-append.queue_time_us":323978}
I20260709 12:10:48.586597 29246 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:48.679505 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:48.713171 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 51400.6us
I20260709 12:10:48.679169 26438 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:48.722628 26467 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:48.686599 29425 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:48.727346 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:10:48.735680 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 65600.1us
I20260709 12:10:48.737910 29246 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:48.745553 29492 raft_consensus.cc:3055] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:48.747035 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:48.748015 28986 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:10:48.748615 29600 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:10:48.758837 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:48.761914 26467 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:48.748638 29227 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:48.767082 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.780391 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:48.785753 26468 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.714601 29505 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:48.790094 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:48.798444 26540 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:48.798950 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 282897us
I20260709 12:10:48.760905 29492 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:48.669517 29472 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:48.829177 26470 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:48.840119 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:48.844914 26548 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:48.845556 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:48.846336 26541 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:48.848073 29227 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:48.849191 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 256446us
W20260709 12:10:48.839465 26615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2562) took 2157 ms (client timeout 1803 ms). Trace:
I20260709 12:10:48.854835 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:48.856101 26547 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:48.857894 26543 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:10:48.834167 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:48.850294 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:48.789362 29171 consensus_queue.cc:1243] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 6.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:10:48.854652 26615 rpcz_store.cc:269] 0709 12:10:46.681711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.820318 (+138607us) service_pool.cc:224] Handling call
0709 12:10:48.803674 (+1983356us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54001f68d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:48.839389 (+ 35715us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3602105088}
I20260709 12:10:48.787993 29597 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.865032 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:48.803048 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:48.866938 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:48.870780 29537 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:48.871248 29537 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:48.867756 26470 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:48.871619 26471 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:48.867894 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:48.872228 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:48.871680 29537 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:48.872943 27167 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:10:48.874284 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:48.875604 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:48.877666 26473 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:10:48.878562 29522 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.537s	user 0.012s	sys 0.000s
I20260709 12:10:48.879000 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:48.879026 29522 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:48.880887 29171 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:48.881523 29171 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:48.881580 29522 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:48.868786 26469 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:48.796711 28986 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:48.791944 29451 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:48.883200 26620 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:10:48.882539 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:48.802922 29512 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.893085 26540 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
W20260709 12:10:48.891083 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.893988 26620 pending_rounds.cc:85] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 6
I20260709 12:10:48.898542 26620 pending_rounds.cc:107] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:48.898622 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:48.899019 26620 raft_consensus.cc:2889] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:48.835793 29115 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:48.892503 29597 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:48.907012 29115 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:48.882354 29537 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:48.923455 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 89394.3us
I20260709 12:10:48.924228 29451 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.924558 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:48.925505 29290 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:48.925639 29537 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:48.925930 29290 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:48.926364 29290 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.926501 29246 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:48.917019 29599 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:48.903627 29489 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:48.928429 29489 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:48.929433 29489 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:48.930918 29489 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.931282 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:48.886487 29477 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:48.933615 29528 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:48.933928 29527 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:48.934551 29527 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:48.934703 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:48.935066 29527 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.935222 29477 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:48.935457 27164 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:48.883606 29492 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:48.936730 29492 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.936800 28986 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:48.917582 29512 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:48.912243 29171 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:48.939500 29605 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:48.939960 29605 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:48.940851 29605 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:48.942842 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:48.942994 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:10:48.948763 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 177205us
I20260709 12:10:48.950680 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:48.908017 29522 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:48.911204 29595 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.952054 29595 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:48.958973 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 60789.2us
I20260709 12:10:48.960120 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:48.942049 29605 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.965354 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:48.991731 26615 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:10:48.989872 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:48.995536 26622 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.999234 26620 raft_consensus.cc:2410] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:10:49.014421 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 47857.7us
I20260709 12:10:48.985766 29505 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:48.987500 29595 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:49.050997 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 206443us
I20260709 12:10:49.017050 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:49.056401 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.062055 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.966272 29599 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:10:49.009820 29246 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.081846 29448 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.082772 29448 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:49.085212 29448 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:49.095413 29512 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:49.004671 29522 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:49.095448 29115 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:49.102804 29597 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:49.105566 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:10:49.106707 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 156140us
I20260709 12:10:48.990021 29425 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:49.108333 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:49.109903 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:49.111531 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.112923 26467 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.113159 29326 raft_consensus.cc:3055] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:49.113664 29326 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:49.115288 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:49.114748 29326 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:49.117349 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:49.118211 26465 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:10:49.076063 29608 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.110010 29597 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:49.110965 29527 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:49.075825 29349 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:49.072103 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 112115us
I20260709 12:10:49.121100 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:49.130885 26588 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:10:49.128213 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 137933us
I20260709 12:10:49.123136 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:49.143946 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:48.998016 29290 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:49.126711 29246 raft_consensus.cc:2764] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:49.116544 29326 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:49.143930 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 308132us
I20260709 12:10:49.156292 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:49.166864 26439 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:49.169154 26439 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:49.169946 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:49.169126 26622 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:49.173355 26470 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:49.178109 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:49.187052 26473 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
W20260709 12:10:49.188828 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 58073.9us
I20260709 12:10:49.152887 29374 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.176501 29394 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:10:49.196681 26588 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:49.136806 29115 consensus_queue.cc:1059] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 12:10:49.201587 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.202044 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:49.176856 29595 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:49.214831 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 104999us
I20260709 12:10:49.177382 29269 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:49.199860 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:49.178687 29597 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.149144 29522 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:10:49.186769 29557 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.195860 29528 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:49.237092 26548 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:10:49.240244 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.153385 29349 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:49.214615 29595 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.176882 29472 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
W20260709 12:10:49.251367 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 401212us
I20260709 12:10:49.224543 29522 consensus_queue.cc:1243] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:49.224368 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:49.268344 26547 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
W20260709 12:10:49.259371 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.230973 29512 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:49.268913 26547 pending_rounds.cc:85] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 6
I20260709 12:10:49.275676 26547 pending_rounds.cc:107] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:49.276026 26547 raft_consensus.cc:2889] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:49.277721 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.226419 29602 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:49.254791 29531 consensus_meta.cc:287] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.573s	user 0.004s	sys 0.007s
I20260709 12:10:49.221143 29226 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:10:49.239588 29269 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:49.256973 29557 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.261062 29595 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.306669 29611 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 12:10:49.307794 29527 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:49.260848 29528 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:49.279539 29512 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:49.326686 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 98827.9us
W20260709 12:10:49.332280 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 162387us
W20260709 12:10:49.343986 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 108654us
I20260709 12:10:49.342238 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:49.333737 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:49.351652 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.304173 29602 raft_consensus.cc:697] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:49.366715 26473 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:49.393488 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44811.4us
I20260709 12:10:49.398250 26467 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:49.363791 26438 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:49.411228 29226 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:10:49.413903 29601 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:10:49.419541 29349 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:49.362874 29425 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:49.427059 29425 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:49.430090 29425 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:49.366772 29451 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:49.432996 29451 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:49.434602 29451 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:49.436801 29451 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.431643 27162 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
W20260709 12:10:49.445309 29618 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:10:49.448933 29290 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:49.354781 29448 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:49.452627 29448 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:49.366274 29599 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:49.403820 29227 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:10:49.460465 29602 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:49.463032 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 99392.8us
I20260709 12:10:49.465305 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:49.465938 29528 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:49.472127 29615 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 12:10:49.472265 27159 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:49.473093 29611 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:49.473963 29531 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:49.474648 29625 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:49.474978 26619 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:49.475169 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 141522us
I20260709 12:10:49.496676 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:49.334681 29617 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.499718 29617 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:49.486807 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.487901 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 291333us
I20260709 12:10:49.475497 29374 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:49.335791 29512 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.499032 29537 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.498623 29625 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:49.504480 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:49.502589 29246 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:49.489354 29115 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.491441 29394 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:49.502194 29617 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:49.547287 26513 leader_election.cc:336] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 2.643s (SENT)
I20260709 12:10:49.543129 26514 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:49.506861 29374 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:49.551116 29626 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.495553 29599 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:49.552342 29599 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:49.548302 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 51733.7us
W20260709 12:10:49.557812 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 65839.2us
W20260709 12:10:49.557799 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 53417.6us
I20260709 12:10:49.567767 26588 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:49.570936 26513 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:49.527577 29461 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:10:49.573388 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:49.528219 29269 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:49.545258 29394 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.592540 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:10:49.593004 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.610823 26465 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:49.604558 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:49.612663 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:49.613266 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:49.613875 26545 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.603682 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:49.616618 26548 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:49.609149 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:49.564338 29477 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.571686 29527 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:49.639256 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:49.639761 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:49.640367 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:49.640625 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:49.649745 26472 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.650030 26470 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
W20260709 12:10:49.651696 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 118362us
I20260709 12:10:49.547892 29531 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:49.607853 29617 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:49.584532 29489 consensus_meta.cc:287] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.653s	user 0.014s	sys 0.000s
I20260709 12:10:49.556947 29505 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:10:49.664776 26539 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:49.583706 29608 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:49.648288 26464 pending_rounds.cc:85] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 2
I20260709 12:10:49.577800 29290 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:49.704478 29290 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.704984 29290 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.618232 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:10:49.655902 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 69104.3us
I20260709 12:10:49.704351 26464 pending_rounds.cc:107] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:10:49.647104 26473 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.659247 26467 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:10:49.547716 29537 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:49.718459 26542 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:49.606815 28986 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.663175 26471 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:49.619711 29394 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.577085 29522 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:10:49.718816 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:49.686857 26541 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
W20260709 12:10:49.702261 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.654157 29527 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:49.690279 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:49.575850 29227 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
W20260709 12:10:49.691039 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 143779us
I20260709 12:10:49.691955 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:49.741245 27166 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:49.689020 26544 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:49.707130 26464 raft_consensus.cc:2889] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:49.705885 29505 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:49.641196 29597 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:10:49.723839 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:49.688756 29448 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:49.720546 29492 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.781s	user 0.017s	sys 0.000s
W20260709 12:10:49.741279 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.734450 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:49.714982 29528 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:49.758813 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 53550.9us
I20260709 12:10:49.770764 26466 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:49.697551 29477 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:49.697211 29171 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:10:49.756428 26588 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:49.742699 29527 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:49.783831 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 60501.8us
I20260709 12:10:49.774310 26467 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:10:49.766161 29115 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.759030 29461 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.792502 26469 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:10:49.792971 26469 pending_rounds.cc:85] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 3
I20260709 12:10:49.775794 26546 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:49.780853 29505 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:49.781354 29326 consensus_meta.cc:287] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.605s	user 0.007s	sys 0.006s
W20260709 12:10:49.797442 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.788453 29477 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:49.790606 29560 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:49.794739 29616 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:10:49.795064 29634 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.112s
I20260709 12:10:49.799428 26469 pending_rounds.cc:107] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:10:49.740163 28986 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:49.807658 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:49.817673 26469 raft_consensus.cc:2889] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:49.820889 26546 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:10:49.790529 29629 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:49.824913 29621 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.796996 29505 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:49.828733 29537 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:49.813393 29612 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 12:10:49.827391 29605 consensus_meta.cc:287] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.831s	user 0.008s	sys 0.004s
I20260709 12:10:49.830196 26545 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:49.822564 26514 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:49.846604 26472 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:10:49.843331 26548 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:10:49.836443 29625 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:49.843246 29461 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:49.870675 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 153979us
I20260709 12:10:49.871702 26588 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:49.790846 29528 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:49.880385 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 377324us
I20260709 12:10:49.883899 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:49.884828 26466 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 7: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:49.862057 29489 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:49.861442 29522 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.882572 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:49.889580 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:49.861901 29227 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:49.813087 29115 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:49.895171 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:49.901222 26472 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:10:49.901005 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 103149us
I20260709 12:10:49.823800 29560 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:49.898749 26616 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:49.899979 26473 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:49.874760 29648 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:49.895251 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:49.897697 26466 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:10:49.903823 29632 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:49.904052 29639 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:10:49.904814 29642 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:10:49.906082 29505 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:49.863438 29621 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:49.940111 26467 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 4: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:10:49.894949 29636 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:10:49.914851 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:49.941773 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:49.942790 26542 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:10:49.887154 29531 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:49.952521 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:49.971871 26466 raft_consensus.cc:2410] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:10:49.889618 29489 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:49.918836 29227 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:49.901062 29522 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:49.910149 29626 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.890890 29597 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:10:49.959877 29647 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:49.899042 29326 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:10:49.960872 29560 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:49.961171 29627 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:10:49.961015 29505 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:49.962096 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 62960.2us
I20260709 12:10:49.963979 29461 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:49.901247 29611 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.000797 26619 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:49.917629 29528 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:49.983062 27168 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:10:49.965766 26438 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.565s (SENT) [suppressed 34 similar messages]
I20260709 12:10:49.957370 29246 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.987476 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:49.988101 29489 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:49.988993 29227 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:49.950275 28986 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:49.964552 29115 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:49.994246 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.910220 29290 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:49.894949 29448 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:50.006642 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 91906us
I20260709 12:10:50.004742 29611 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.965801 29632 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:50.017158 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:49.993474 29608 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.010353 29560 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:10:50.020412 29635 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:50.020553 26545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:50.020823 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:50.021499 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:50.059680 26545 raft_consensus.cc:606] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:50.059995 27162 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
W20260709 12:10:50.009486 29595 consensus_meta.cc:287] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.650s	user 0.009s	sys 0.004s
I20260709 12:10:50.011826 29522 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:50.043569 26619 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:50.060143 26545 raft_consensus.cc:614] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:50.043025 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:50.062769 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.063357 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 49010.2us
I20260709 12:10:50.028507 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:50.085736 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.063894 29662 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:50.113729 26620 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:50.114075 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:50.119549 26465 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:10:50.121407 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:50.125191 26588 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:50.060951 29448 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:50.020465 27159 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
W20260709 12:10:50.131650 29650 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:10:50.131814 29290 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:50.139077 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:50.141168 26615 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 4: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:50.134260 27134 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:50.067983 29611 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:50.151887 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 186183us
W20260709 12:10:50.153620 26438 leader_election.cc:336] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.653s (SENT)
I20260709 12:10:50.154264 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:50.018010 29246 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:50.042682 29326 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 12:10:50.056010 29606 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 12:10:50.168915 29637 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 12:10:50.169718 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 112521us
I20260709 12:10:50.172657 29608 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.174880 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:50.169072 29522 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:50.177093 29648 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.177704 29489 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.179237 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.179852 27159 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:10:50.180673 29621 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:50.181210 29602 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.181295 29632 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:49.999931 29647 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:50.109088 29595 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:50.183983 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1661) took 1071 ms. Trace:
I20260709 12:10:50.242374 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:50.237218 26545 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:10:50.243167 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:50.237349 26539 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 8: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:50.242039 26469 rpcz_store.cc:276] 0709 12:10:49.112962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.114490 (+  1528us) service_pool.cc:224] Handling call
0709 12:10:49.114820 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.867959 (+753139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.183726 (+315767us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b54001a8454. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:50.183917 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1521731968}
I20260709 12:10:50.162042 29227 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:50.222219 26473 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.238891 29602 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:10:50.212018 29512 consensus_meta.cc:287] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.642s	user 0.012s	sys 0.001s
I20260709 12:10:50.235502 29226 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:10:50.257297 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.258741 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.236414 29597 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:50.261137 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:50.261219 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 107670us
I20260709 12:10:50.249148 29617 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:50.267939 26539 raft_consensus.cc:2410] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:10:50.268618 26438 leader_election.cc:336] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.789s (SENT)
I20260709 12:10:50.269079 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:50.248957 29227 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.244773 29537 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:10:50.270507 26548 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:10:50.251878 29461 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:50.236243 29290 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:50.271968 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:50.275285 29665 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:50.276901 26513 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:50.264086 29226 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:50.277941 29648 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:50.278322 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:50.278753 29648 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:50.279291 29652 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:10:50.279523 29648 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:50.279680 26513 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:50.279923 29226 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:50.280045 29648 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:50.280541 29648 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.281795 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.283267 26539 raft_consensus.cc:2410] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:50.287405 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.287617 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.288725 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.293205 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:50.298734 26438 leader_election.cc:336] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.818s (SENT)
W20260709 12:10:50.299212 29658 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:10:50.299296 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:50.300760 26438 leader_election.cc:336] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.848s (SENT)
I20260709 12:10:50.301222 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:50.302167 29665 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:50.303028 29665 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.290750 29461 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:50.305615 29461 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:50.306381 29394 consensus_meta.cc:287] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.540s	user 0.008s	sys 0.003s
I20260709 12:10:50.306886 29394 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:50.307817 29326 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:50.308386 29326 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:50.274622 29227 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.313804 29326 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:50.314900 29246 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:50.318414 29648 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:50.342427 26471 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:50.291085 29537 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:50.310567 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:50.323462 29662 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.343334 26539 raft_consensus.cc:2376] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6. Re-sending same reply.
I20260709 12:10:50.324263 29647 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:50.325174 29657 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.262s	user 0.002s	sys 0.000s
I20260709 12:10:50.326686 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.349076 26544 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:50.332085 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:50.336750 26438 leader_election.cc:336] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.861s (SENT)
I20260709 12:10:50.263969 29512 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:50.262106 29527 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:50.322577 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:50.368001 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:50.344409 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:50.370704 26621 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 8: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:50.349936 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:50.335520 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:50.298059 29374 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:50.350840 29617 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:50.356413 29595 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:50.344947 29537 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.356848 29662 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:50.344374 29326 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:50.285135 29425 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:10:50.363320 29649 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:50.309062 29394 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:50.374125 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:50.375196 26615 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:50.376361 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:50.273625 29448 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:50.367383 29512 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:50.384120 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.406657 26546 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 8: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:50.387555 29492 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.383421 29537 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.376370 29246 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.390885 26541 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 4. Current term is 6. Ops: [4.3-4.3]
W20260709 12:10:50.389665 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 108802us
I20260709 12:10:50.426848 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:50.349532 29625 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:10:50.408500 29608 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:50.438364 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 178734us
I20260709 12:10:50.498106 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:50.499226 26544 raft_consensus.cc:2368] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6.
I20260709 12:10:50.413414 26466 raft_consensus.cc:3055] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.500267 26466 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:50.503759 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:50.343254 29602 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:50.389797 29374 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.520778 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.524827 26541 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:10:50.526254 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 216765us
I20260709 12:10:50.526640 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:50.527256 26438 leader_election.cc:336] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.973s (SENT)
I20260709 12:10:50.528514 27166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 453) took 1347 ms. Trace:
I20260709 12:10:50.529163 26546 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:50.411036 29246 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.528617 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.383296 29617 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:50.527573 26539 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:50.501924 29625 consensus_queue.cc:1243] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:10:50.528972 27166 rpcz_store.cc:276] 0709 12:10:49.181631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.187080 (+  5449us) service_pool.cc:224] Handling call
0709 12:10:49.202715 (+ 15635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:49.741689 (+538974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.528244 (+786555us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b540077c754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:50.528449 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1237783424}
I20260709 12:10:50.565279 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:50.569203 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.497181 29451 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.595047 26539 raft_consensus.cc:2410] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:50.597471 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.602875 26546 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:50.564327 26466 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:50.393893 29326 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:50.601614 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:50.571208 29246 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.667883 29674 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.670817 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:50.729202 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:50.606045 29451 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:50.715337 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 113761us
I20260709 12:10:50.717207 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.734004 26543 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:10:50.530133 29632 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.723225 29665 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.723563 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.807621 26544 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:50.723800 29673 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:50.705551 29595 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.725001 29662 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:50.409868 29649 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:50.726418 29617 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:50.727347 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 200121us
I20260709 12:10:50.711287 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.675171 29648 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:50.729916 26545 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.523088 29394 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.162s
I20260709 12:10:50.732779 26541 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 8: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:50.718380 26466 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.735855 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:50.804095 29632 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.788233 26548 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.703018 29492 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:50.810979 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.812036 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:50.817174 26438 leader_election.cc:336] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.128s (SENT)
I20260709 12:10:50.825831 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:50.818568 26619 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:50.819721 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.826043 26543 raft_consensus.cc:2410] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:50.827188 26544 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 7: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:50.827626 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.828331 26543 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:50.828552 29512 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.829000 29512 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:50.829385 29512 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.829888 29649 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:50.808770 29673 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.826092 27166 raft_consensus.cc:2410] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:10:50.728060 29560 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:10:50.806917 29674 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:10:50.820804 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 85062.9us
I20260709 12:10:50.828346 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:50.834559 26543 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:50.838866 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:50.841173 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:50.850752 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.851683 29451 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:50.853058 29537 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:50.853480 29626 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:50.853951 29626 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:50.855844 26539 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:50.831557 29632 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.812220 29227 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:50.863534 29326 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:50.864416 29227 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:50.810696 29665 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:50.865942 29505 consensus_meta.cc:287] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.859s	user 0.012s	sys 0.000s
W20260709 12:10:50.866950 29611 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.661s	user 0.011s	sys 0.000s
I20260709 12:10:50.851760 26548 raft_consensus.cc:2410] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:50.867434 29557 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:50.867537 29611 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:50.868841 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.869460 26543 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:10:50.869874 29611 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:50.835830 29673 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.845950 29674 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:50.871104 29537 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:50.872561 29674 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:50.872689 26539 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:50.815131 29595 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:50.873958 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:50.868110 29557 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:50.874562 26539 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:50.874632 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 447879us
I20260709 12:10:50.875269 29595 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:50.875139 29557 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:50.875535 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:50.836383 29662 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.873608 29626 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:50.866695 27162 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:10:50.866674 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 49537.2us
I20260709 12:10:50.866752 29665 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:50.878618 26545 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
W20260709 12:10:50.885093 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44015.1us
I20260709 12:10:50.895470 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:50.891306 26466 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:10:50.896080 26466 pending_rounds.cc:85] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 6
I20260709 12:10:50.896355 26466 pending_rounds.cc:107] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:10:50.896581 26466 raft_consensus.cc:2889] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:50.896651 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:50.893209 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:50.893601 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:50.899179 26438 leader_election.cc:336] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.138s (SENT)
I20260709 12:10:50.899816 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:50.897433 26616 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:50.902469 26540 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:50.902860 26540 pending_rounds.cc:85] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 5
I20260709 12:10:50.903164 26540 pending_rounds.cc:107] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:10:50.903462 26540 raft_consensus.cc:2889] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:50.903525 26548 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:50.907217 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:50.907624 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.910969 26618 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260709 12:10:50.909534 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:50.914141 26613 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.894340 29394 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:50.918437 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:50.915325 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:50.905105 29461 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:50.910693 29626 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:50.906956 29665 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.924234 29505 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:50.935858 29489 consensus_meta.cc:287] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.699s	user 0.012s	sys 0.000s
I20260709 12:10:50.941045 29512 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:50.942001 29448 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:50.944185 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 51659.6us
I20260709 12:10:50.969146 26539 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:10:50.916000 29625 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:10:50.949141 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 73685.8us
I20260709 12:10:50.952682 29674 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.953814 29246 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:50.960402 29673 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:50.965785 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:50.985711 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:50.985888 26616 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:50.970518 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.993604 26466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:50.994746 26466 raft_consensus.cc:606] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:50.995299 26466 raft_consensus.cc:614] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:50.986951 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:50.998376 26619 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:10:50.998888 26548 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:10:50.968106 29461 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:51.015237 26472 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 7: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:51.002736 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:51.018754 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.019780 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.026836 29489 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.027629 29489 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:50.971987 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:51.030704 26539 raft_consensus.cc:2376] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9. Re-sending same reply.
I20260709 12:10:50.987319 29528 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.033126 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:51.034466 26539 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:10:51.037647 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:51.038554 26539 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:50.996712 29625 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:51.043810 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:51.002835 29171 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:51.050961 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:51.060708 26618 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 8: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:50.979543 29448 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:50.985498 29632 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:51.067487 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:51.041227 29595 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:51.003207 29674 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:51.068549 26544 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:51.054222 29269 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.074905 26615 raft_consensus.cc:2410] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:51.060606 29637 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.075941 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:51.063098 29054 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.063345 29492 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.078421 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:51.066098 29394 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:51.061529 29171 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:51.076776 29269 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:51.088943 29665 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.047250 29528 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:51.096174 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:51.104096 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 1696) took 1531 ms. Trace:
I20260709 12:10:51.151338 26617 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
W20260709 12:10:51.117293 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.098517 26466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:39418
I20260709 12:10:51.262564 29425 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.162716 26544 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:51.124688 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 435) took 1352 ms. Trace:
W20260709 12:10:51.365872 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 291604us
I20260709 12:10:51.101688 29512 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:51.705376 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.253116 26613 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:10:51.102295 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:51.706588 26540 rpcz_store.cc:276] 0709 12:10:49.772250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.799983 (+ 27733us) service_pool.cc:224] Handling call
0709 12:10:49.820441 (+ 20458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.908743 (+1088302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.124362 (+215619us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540037df54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:51.124586 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2470244224}
I20260709 12:10:51.097842 29674 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:51.704134 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:51.702230 26542 rpcz_store.cc:276] 0709 12:10:49.572734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.573029 (+   295us) service_pool.cc:224] Handling call
0709 12:10:51.103860 (+1530831us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400140354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:51.103988 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283618176}
I20260709 12:10:51.709748 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:51.719952 26618 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.719844 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:51.076426 29489 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:51.722486 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:51.278661 29634 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:51.302870 29599 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.263121 28986 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.104344 29602 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.700659 29606 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.734314 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:51.749851 26621 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:51.705950 29425 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:51.106441 29632 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:51.119259 29673 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:51.102888 29492 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:51.700994 29691 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:51.104001 29505 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:51.108003 29246 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:51.745043 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:51.722476 29674 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.751372 26613 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:51.753666 26621 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:51.086687 29595 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:51.086362 29054 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:51.732079 29665 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:51.207454 29626 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.776423 26617 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:51.738994 29634 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:51.086927 29637 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:51.783928 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 75778.8us
I20260709 12:10:51.080257 29461 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:51.803735 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:51.801108 26466 raft_consensus.cc:606] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:51.807962 26466 raft_consensus.cc:614] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:51.785745 29246 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:51.315078 29625 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:51.796187 29489 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.758435 29606 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:51.748106 29599 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:51.807297 29448 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:51.842638 29700 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.843477 29700 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.843863 29599 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:51.843935 29700 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:51.844542 29599 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.845001 29599 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:51.759537 28986 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:51.804458 29665 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:51.791529 29674 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:51.806809 29626 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:51.781962 29394 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:51.815923 29246 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:51.785943 29691 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:51.825603 29489 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:51.876063 29269 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:51.819533 29505 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:51.860596 29522 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:51.854701 29634 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:51.888221 29489 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:51.893923 29269 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.894126 29425 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:51.894589 29595 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:51.899822 29528 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:51.895202 29246 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:51.893308 26618 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:51.888813 28986 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:51.896631 29522 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:51.910846 29634 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:51.914278 29696 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:10:51.916337 29699 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:10:51.924255 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:51.925459 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:51.926898 29595 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:51.928416 29700 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:51.929013 29700 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.929251 29505 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:51.929738 29700 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:51.919961 29492 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:51.930361 29694 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:10:51.931659 26613 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:51.930789 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:51.932871 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:51.933236 26622 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:10:51.933487 26613 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.934419 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:51.935524 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:51.936029 29626 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:51.931104 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:51.931469 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1721) took 1010 ms. Trace:
I20260709 12:10:51.939231 26622 raft_consensus.cc:2368] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7.
I20260709 12:10:51.916283 29171 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:51.968034 26618 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:51.920151 29599 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:51.970779 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.971750 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.972579 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.942307 26439 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:51.975064 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.938562 26543 rpcz_store.cc:276] 0709 12:10:50.921624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.921783 (+   159us) service_pool.cc:224] Handling call
0709 12:10:50.922379 (+   596us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:50.925584 (+  3205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.925609 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:50.946327 (+ 20718us) log.cc:844] Serialized 52 byte log entry
0709 12:10:51.252687 (+306360us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:51.252735 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.252813 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:51.931253 (+678440us) raft_consensus.cc:1685] finished
0709 12:10:51.931274 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:51.931410 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21121,"raft.queue_time_us":2851,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":7781,"thread_start_us":291116,"threads_started":1,"wal-append.queue_time_us":851206}
I20260709 12:10:51.979321 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:51.980186 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:51.980883 26545 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:10:51.982681 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:51.983495 26543 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.980360 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:51.988399 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:51.991101 26622 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:51.929014 29674 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:51.993033 26614 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:51.996052 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:51.996995 26618 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:52.002858 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2590) took 1085 ms. Trace:
I20260709 12:10:52.003473 26616 rpcz_store.cc:276] 0709 12:10:50.917128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.917391 (+   263us) service_pool.cc:224] Handling call
0709 12:10:50.917661 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.997010 (+ 79349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.002447 (+1005437us) spinlock_profiling.cc:243] Waited 67.9 ms on lock 0x7b540009f6d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:52.002730 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156213632}
I20260709 12:10:51.931360 29606 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:52.011360 29527 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:51.973482 29171 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:52.015173 29171 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:52.016256 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:52.017304 29171 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:52.017905 29171 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.017976 29637 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:52.032330 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:52.031154 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1678) took 2372 ms. Trace:
I20260709 12:10:51.987690 29599 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:52.031152 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1722) took 1077 ms. Trace:
I20260709 12:10:51.963660 29626 consensus_queue.cc:1059] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:10:51.993809 29665 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:51.993693 29705 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.019181 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:52.047734 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 398) took 2163 ms. Trace:
W20260709 12:10:52.031191 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 227608us
I20260709 12:10:52.048063 26617 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:52.034600 26470 rpcz_store.cc:276] 0709 12:10:49.649289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.657481 (+  8192us) service_pool.cc:224] Handling call
0709 12:10:49.686455 (+ 28974us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:49.700430 (+ 13975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.700476 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:49.954386 (+253910us) spinlock_profiling.cc:243] Waited 9.48 ms on lock 0x7b1800117a00. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fbb2a6 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a
0709 12:10:51.341536 (+1387150us) spinlock_profiling.cc:243] Waited 5.75 ms on lock 0x7b2c000327f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:10:51.441177 (+ 99641us) log.cc:844] Serialized 52 byte log entry
0709 12:10:51.806040 (+364863us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:51.978598 (+172558us) log.cc:844] Serialized 14 byte log entry
0709 12:10:51.979101 (+   503us) log.cc:844] Serialized 14 byte log entry
0709 12:10:52.020749 (+ 41648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.020833 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:52.020873 (+    40us) raft_consensus.cc:1685] finished
0709 12:10:52.020883 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.021045 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41615,"prepare.queue_time_us":175074,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":104,"raft.queue_time_us":14094,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":8241,"spinlock_wait_cycles":43109248,"thread_start_us":486289,"threads_started":2,"wal-append.queue_time_us":370975}
I20260709 12:10:52.037848 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:52.044435 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:52.049333 26468 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:10:52.048285 26467 rpcz_store.cc:276] 0709 12:10:49.884660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.959211 (+ 74551us) service_pool.cc:224] Handling call
0709 12:10:49.959562 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:50.184879 (+225317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.184909 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:50.234912 (+ 50003us) log.cc:844] Serialized 26 byte log entry
0709 12:10:50.341507 (+106595us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:50.341538 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.041493 (+1699955us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54000a4e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:52.041549 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:52.041598 (+    49us) raft_consensus.cc:1685] finished
0709 12:10:52.041608 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.047657 (+  6049us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":148,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":517108608,"thread_start_us":80783,"threads_started":1,"wal-append.queue_time_us":361455,"wal-append.run_cpu_time_us":2079,"wal-append.run_wall_time_us":1228072}
I20260709 12:10:52.039871 29527 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.040148 26547 rpcz_store.cc:276] 0709 12:10:50.953646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.954761 (+  1115us) service_pool.cc:224] Handling call
0709 12:10:50.955311 (+   550us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:50.955920 (+   609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.955966 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:50.956843 (+   877us) log.cc:844] Serialized 52 byte log entry
0709 12:10:51.033504 (+ 76661us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:51.043163 (+  9659us) log.cc:844] Serialized 14 byte log entry
0709 12:10:51.044590 (+  1427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.044699 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:52.006512 (+961813us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b180027f9a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:10:52.020610 (+ 14098us) raft_consensus.cc:1685] finished
0709 12:10:52.030816 (+ 10206us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.031075 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11162,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":1995,"raft.queue_time_us":1969,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":12563,"spinlock_wait_cycles":7060352,"thread_start_us":76134,"threads_started":1,"wal-append.queue_time_us":117489}
W20260709 12:10:52.053951 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 199981us
I20260709 12:10:52.054414 26613 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:52.021030 29246 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:52.059612 26543 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:10:52.059924 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:52.054116 29425 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:10:52.057899 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:52.056388 29673 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:10:52.062885 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:52.064750 29684 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 1.040s	user 0.001s	sys 0.004s
I20260709 12:10:52.079645 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:52.080451 27161 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:52.070348 29505 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:10:52.071496 29634 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.081676 29505 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:52.082149 29505 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:52.081867 29634 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:52.060482 28986 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:52.051219 29704 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:52.039718 29629 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:52.067615 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:52.040105 29599 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:52.068699 26472 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 405) took 1681 ms (client timeout 2084 ms). Trace:
I20260709 12:10:52.068819 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:52.095530 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2586) took 1208 ms. Trace:
I20260709 12:10:52.069563 29626 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:52.070811 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:52.070786 26438 leader_election.cc:400] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6.
I20260709 12:10:52.104274 26438 leader_election.cc:403] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:52.073850 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:52.074574 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:52.105207 27164 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.075433 26616 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 5: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:52.072011 26514 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:52.052053 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:52.018369 29171 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:52.091938 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:52.098416 29693 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.072s	user 0.006s	sys 0.010s
I20260709 12:10:52.095463 27168 pending_rounds.cc:85] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 8
I20260709 12:10:52.062121 29674 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:52.096272 26468 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:52.053318 29705 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:52.089082 29602 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.098174 29629 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:52.095861 29605 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:10:52.094728 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:52.100104 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:52.098539 29599 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.127771 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:52.128427 29706 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.128966 29706 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:52.130903 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:52.100279 29522 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:52.099400 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:52.096232 26619 rpcz_store.cc:276] 0709 12:10:50.887462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.887642 (+   180us) service_pool.cc:224] Handling call
0709 12:10:50.902819 (+ 15177us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:51.002559 (+ 99740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.095265 (+1092706us) spinlock_profiling.cc:243] Waited 95.3 ms on lock 0x7b5400346554. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:52.095481 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219146624}
I20260709 12:10:52.131819 27165 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 3.
I20260709 12:10:52.141281 27159 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.141809 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:52.142635 26619 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:10:52.095890 26472 rpcz_store.cc:269] 0709 12:10:50.372760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.373456 (+   696us) service_pool.cc:224] Handling call
0709 12:10:52.053733 (+1680277us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b54003147d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:52.053842 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1396778752}
I20260709 12:10:52.144011 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:52.144377 29522 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:52.144565 26472 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.088779 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:52.112620 29425 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:52.107188 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55211.6us
I20260709 12:10:52.106657 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:52.149683 26616 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:52.090616 28986 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.111297 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:52.111800 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:52.161258 26470 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:52.111349 26469 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 7: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:52.113068 27168 pending_rounds.cc:107] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:10:52.162979 27168 raft_consensus.cc:2889] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:52.116226 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:52.117729 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:52.089440 29704 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:52.124480 27162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 461) took 1805 ms. Trace:
I20260709 12:10:52.120378 29602 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:52.090883 29246 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:52.131197 29706 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:52.099400 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:52.112617 29489 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:52.122795 27166 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:52.138497 27164 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:52.139590 26439 leader_election.cc:400] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7.
I20260709 12:10:52.172637 26439 leader_election.cc:403] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:52.150699 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:10:52.152089 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 96295us
I20260709 12:10:52.167650 26472 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:10:52.170287 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:52.174597 26464 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.175128 26617 raft_consensus.cc:2410] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:52.175675 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:52.176379 26472 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:52.171072 27162 rpcz_store.cc:276] 0709 12:10:50.319225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.321639 (+  2414us) service_pool.cc:224] Handling call
0709 12:10:50.322016 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:50.892223 (+570207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.124218 (+1231995us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54005771d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:52.124421 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1251982208}
I20260709 12:10:52.173883 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:52.118983 29115 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6.
I20260709 12:10:52.184113 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:52.186798 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:52.142097 29597 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:52.146251 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:52.190939 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 58292us
I20260709 12:10:52.113358 29626 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:52.196309 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:52.197180 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:52.159862 29425 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.170756 28986 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.148854 27161 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:52.182220 29714 raft_consensus.cc:2764] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:52.223079 27159 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:10:52.202751 27160 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:52.203960 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2592) took 1237 ms. Trace:
I20260709 12:10:52.232036 26614 rpcz_store.cc:276] 0709 12:10:50.966710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.967245 (+   535us) service_pool.cc:224] Handling call
0709 12:10:50.973128 (+  5883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:51.998333 (+1025205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.203661 (+205328us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000023d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:52.203883 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2344946432}
I20260709 12:10:52.209484 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:52.191352 26465 raft_consensus.cc:2410] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:52.117110 29674 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:52.187664 29528 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:52.113056 29505 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:52.191437 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 73790.2us
I20260709 12:10:52.239869 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:52.204676 29705 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:52.222332 29691 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:52.182363 29704 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.197677 29712 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:52.210726 29425 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.194938 29394 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.235350 29602 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:52.195868 29706 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:52.210335 29527 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:52.220409 27167 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:52.217953 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:52.214232 29665 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.190662 29673 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:10:52.210175 27163 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:52.259466 29712 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.351678 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:52.229647 29115 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:52.261938 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:52.260316 29710 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:52.210507 29492 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:10:52.195425 29597 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:52.276003 26464 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:10:52.276485 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39418 (request call id 33) took 1181 ms. Trace:
W20260709 12:10:52.276659 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 140499us
W20260709 12:10:52.275364 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 101551us
I20260709 12:10:52.250648 29705 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:52.361797 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:52.364012 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:52.272166 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:52.280856 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:52.365688 26469 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 9: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:52.284755 26472 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:52.368734 26472 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:52.287429 26471 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:52.291296 26468 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:10:52.301651 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.239893 29528 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:52.326794 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 213915us
I20260709 12:10:52.372004 26514 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:52.372249 27134 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:52.327940 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.358973 26466 rpcz_store.cc:276] 0709 12:10:51.095477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.098320 (+  2843us) service_pool.cc:224] Handling call
0709 12:10:52.276257 (+1177937us) spinlock_profiling.cc:243] Waited 90.7 ms on lock 0x7b5400314cd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d4853 00007f507b0a260a 00007f50746287d4 00007f5074628762 00007f5074628691 00007f507462860c 00007f50746278c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:52.276388 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208683904}
I20260709 12:10:52.329422 29505 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.380549 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:52.332227 29626 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:52.384292 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:52.330521 29394 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:52.356974 29602 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:52.352626 29489 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:52.355401 29115 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.359807 29595 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:52.387673 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 178378us
I20260709 12:10:52.378914 29653 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:52.412482 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:52.359441 29560 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:52.355924 29712 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.379014 29700 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:52.384912 29717 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 12:10:52.380360 29527 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:52.371471 29528 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.437872 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:52.456800 26472 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.447778 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:52.449020 26464 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:10:52.458112 26468 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.459187 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:52.460858 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:52.450220 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 178151us
I20260709 12:10:52.426244 29626 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:52.410352 29634 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:52.454800 29724 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:52.380156 29705 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:52.455863 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:52.435880 29653 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:52.476161 26464 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:10:52.431387 29115 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.446816 29625 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:52.385221 29718 consensus_queue.cc:1059] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:10:52.485798 26471 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:52.489666 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 117751us
I20260709 12:10:52.486276 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:52.427047 29602 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:52.519306 26468 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:52.498138 26539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:52.579188 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:52.580404 26539 raft_consensus.cc:606] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:10:52.452036 29720 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:52.478060 29171 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:52.577790 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:52.500895 26472 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:10:52.524353 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:52.501791 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:52.581005 26539 raft_consensus.cc:614] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:52.392134 29710 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:52.503110 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:52.443740 29595 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:52.498616 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:52.580483 26546 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:10:52.497053 29719 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:52.583613 26541 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:52.584223 26548 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:10:52.584760 26542 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:10:52.600665 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:52.588060 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:52.641917 26547 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.642776 26468 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:10:52.585146 26472 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:52.616067 26540 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 4.
I20260709 12:10:52.496585 29726 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:52.637950 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 225546us
I20260709 12:10:52.575183 29602 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.489143 29700 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:52.575889 29706 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:52.581406 29531 raft_consensus.cc:2764] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:52.498682 29492 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:52.671799 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 182728us
I20260709 12:10:52.498979 29653 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.504634 29629 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:52.584420 29720 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:52.677799 29719 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:52.485724 29727 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.192s
I20260709 12:10:52.694680 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:52.724076 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:52.639420 29721 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:10:52.701880 29734 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:52.702325 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:52.670802 29718 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:52.639634 29171 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:10:52.742985 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2591) took 1815 ms. Trace:
I20260709 12:10:52.743628 26615 rpcz_store.cc:276] 0709 12:10:50.927253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.927708 (+   455us) service_pool.cc:224] Handling call
0709 12:10:52.742620 (+1814912us) spinlock_profiling.cc:243] Waited 89.2 ms on lock 0x7b540020a154. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:52.742883 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205145344}
I20260709 12:10:52.675462 29724 raft_consensus.cc:697] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:10:52.688289 29715 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.413s	user 0.000s	sys 0.001s
I20260709 12:10:52.583169 29625 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:52.725739 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:52.575067 29394 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:52.687300 29700 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:52.748617 26621 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:52.669679 29527 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:52.650439 29489 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:52.731402 29626 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.772862 26548 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:52.771363 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:10:52.771931 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 69696.8us
I20260709 12:10:52.718778 29720 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:52.801112 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:52.806416 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 96942us
I20260709 12:10:52.713460 29706 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:52.807287 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:52.808207 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:52.747722 29597 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:52.815577 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 89893.1us
I20260709 12:10:52.825299 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:52.799131 29736 raft_consensus.cc:3055] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:52.822321 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:52.814008 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:52.822337 26542 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:52.823941 26614 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:52.860832 29595 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:52.861522 29595 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.798846 29492 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:52.840103 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 353891us
I20260709 12:10:52.805368 29741 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:52.771559 29739 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:52.801191 29700 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.771400 29674 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:52.826344 29736 raft_consensus.cc:740] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:52.853876 26615 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:10:52.810847 29740 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:10:52.687362 29726 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:52.866849 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:52.751979 29718 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:52.873324 26547 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:52.875665 29634 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.876117 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:52.876606 26468 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:10:52.894312 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:52.894536 26471 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:52.895218 26468 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:52.895826 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:52.896389 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:52.876909 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:52.843828 29597 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.877202 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:52.748347 29734 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:52.843348 29626 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:52.919874 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:52.908967 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:52.909672 26472 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260709 12:10:52.925850 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:52.924364 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:52.910065 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.910283 26542 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:52.926718 26468 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:52.911401 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:52.877377 29665 consensus_meta.cc:287] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.000s
I20260709 12:10:52.933431 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:52.906385 29531 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.882040 29705 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:52.892443 29425 consensus_meta.cc:287] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.623s	user 0.014s	sys 0.000s
I20260709 12:10:52.887606 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:52.930603 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:52.926095 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:52.881099 29492 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:52.944860 26547 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:52.944916 26471 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:52.874297 29741 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:52.948537 27134 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.010s	sys 0.009s
W20260709 12:10:52.949106 27134 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.010s	sys 0.009s
W20260709 12:10:52.949690 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 577465us
I20260709 12:10:52.949851 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:52.951037 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:52.951656 26546 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
W20260709 12:10:52.937417 29695 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 1.072s	user 0.002s	sys 0.003s
I20260709 12:10:52.935279 29674 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.932354 29634 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:52.925099 29597 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:52.889571 29737 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:10:52.955526 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:52.963908 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:52.948736 29741 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.936270 29665 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7.
I20260709 12:10:52.924011 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:52.954532 29705 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:52.941659 29673 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:52.863817 29719 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:52.977205 26468 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:10:52.964985 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:52.973547 29674 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:52.950592 26544 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:52.947255 29557 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:52.990165 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:52.965292 29626 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 9 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:53.006345 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:53.007375 26468 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:52.953552 29425 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:53.014108 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:53.015842 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:10:52.997469 29731 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 12:10:52.967144 29629 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:10:52.921572 29724 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:52.971609 29512 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:10:53.005911 29171 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:52.979468 29448 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:10:53.041414 29722 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:53.041971 29722 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:53.042413 29722 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.048704 29246 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:53.034608 29748 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:10:53.051218 29425 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:53.052966 29751 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:10:53.054311 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:53.055770 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:53.056434 26464 raft_consensus.cc:2410] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:53.058017 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:53.058986 26468 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.046137 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:53.062820 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:10:53.068359 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 91919.7us
I20260709 12:10:52.988579 29727 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 12:10:53.038209 29599 consensus_meta.cc:287] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.913s	user 0.009s	sys 0.005s
W20260709 12:10:53.070190 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 262073us
I20260709 12:10:53.039263 29171 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.067174 26588 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:53.010857 29705 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:53.096609 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2585) took 2199 ms. Trace:
I20260709 12:10:53.069612 29512 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:53.037953 29625 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:53.097054 26620 rpcz_store.cc:276] 0709 12:10:50.886662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.886875 (+   213us) service_pool.cc:224] Handling call
0709 12:10:50.902261 (+ 15386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:51.036005 (+133744us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:51.036036 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:51.043956 (+  7920us) log.cc:844] Serialized 52 byte log entry
0709 12:10:51.700808 (+656852us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:51.700845 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.700938 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:52.715631 (+1014693us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:10:53.076458 (+360827us) raft_consensus.cc:1685] finished
0709 12:10:53.076483 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.085913 (+  9430us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7824,"raft.queue_time_us":37278,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":84,"spinlock_wait_cycles":9012096,"thread_start_us":413911,"threads_started":2,"wal-append.queue_time_us":744764}
I20260709 12:10:53.102311 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:53.071414 26464 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260709 12:10:53.083340 26470 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:52.972882 29736 consensus_queue.cc:260] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:53.070103 29425 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:10:53.119379 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 52289.4us
I20260709 12:10:53.094977 29171 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.070116 29448 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:10:53.146976 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:53.136615 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 466198us
I20260709 12:10:53.147440 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:53.148424 26468 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:53.100374 29748 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:53.100971 29489 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:53.074970 29557 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:10:53.100628 29512 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.103312 29706 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:53.160243 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:53.133231 29673 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:53.084343 29599 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:53.124927 29665 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:53.146548 29425 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:53.124393 29246 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:10:53.076532 29634 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:53.153680 29748 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:53.155129 29489 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.084926 29597 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:53.163498 29512 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:53.170589 29505 consensus_meta.cc:287] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.789s	user 0.012s	sys 0.002s
I20260709 12:10:53.186474 26473 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 9: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:53.169884 29673 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:53.187911 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 172139us
I20260709 12:10:53.133258 29746 consensus_queue.cc:1059] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:10:53.172415 29665 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.186916 29489 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:53.224459 29728 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 12:10:53.202708 29673 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.165155 29626 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:53.219504 29665 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:53.244239 29704 consensus_meta.cc:287] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.970s	user 0.013s	sys 0.001s
I20260709 12:10:53.248206 29750 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:53.261435 29753 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:10:53.262581 29662 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:53.268985 27168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 529) took 1176 ms. Trace:
W20260709 12:10:53.273082 29712 consensus_meta.cc:287] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.823s	user 0.004s	sys 0.005s
W20260709 12:10:53.273407 29653 consensus_meta.cc:287] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.002s
I20260709 12:10:53.278957 27168 rpcz_store.cc:276] 0709 12:10:52.092231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.092355 (+   124us) service_pool.cc:224] Handling call
0709 12:10:52.095168 (+  2813us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:52.182609 (+ 87441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:52.182642 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:52.185758 (+  3116us) log.cc:844] Serialized 52 byte log entry
0709 12:10:52.387647 (+201889us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:52.387706 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.387797 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:53.268694 (+880897us) raft_consensus.cc:1685] finished
0709 12:10:53.268718 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.268908 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55751,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":158047,"threads_started":1,"wal-append.queue_time_us":497190}
I20260709 12:10:53.243851 29764 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:53.274695 29602 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.577s	user 0.008s	sys 0.001s
I20260709 12:10:53.251524 29735 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.228068 29505 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 12:10:53.274860 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 168350us
I20260709 12:10:53.275755 29750 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:53.281430 29662 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:53.230448 29425 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:53.305265 29711 raft_consensus.cc:3055] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:53.303200 29750 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.329905 29711 raft_consensus.cc:740] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:53.273829 29700 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:53.287338 29653 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:53.291960 29735 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:53.311240 29757 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:10:53.327783 27163 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 4.
W20260709 12:10:53.335153 29115 consensus_meta.cc:287] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.754s	user 0.012s	sys 0.000s
W20260709 12:10:53.328241 29528 consensus_meta.cc:287] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.841s	user 0.013s	sys 0.001s
I20260709 12:10:53.284373 29712 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:53.338383 29712 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:53.339525 26465 raft_consensus.cc:2368] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 5. Current term is 6.
I20260709 12:10:53.277235 29704 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:53.342566 29704 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:53.345232 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:53.335677 29115 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:53.345956 26615 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 4.
I20260709 12:10:53.352339 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:53.351421 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:53.354115 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:53.353581 26617 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:10:53.355314 26613 raft_consensus.cc:2393] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:53.353555 29528 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:53.359229 29528 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:53.359318 27168 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:10:53.366671 27168 pending_rounds.cc:85] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 6
I20260709 12:10:53.367022 27168 pending_rounds.cc:107] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:10:53.367354 27168 raft_consensus.cc:2889] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:53.369613 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:53.360980 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:53.372292 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:53.363448 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:53.364600 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:53.363348 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:53.418408 27164 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:10:53.365851 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 62960.5us
I20260709 12:10:53.360354 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:53.314873 28986 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.108s	user 0.019s	sys 0.002s
I20260709 12:10:53.422160 27165 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 4: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:53.347922 29531 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.290071 29602 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:53.436645 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:53.437834 28986 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:53.445242 29665 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:53.449959 27164 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:53.374259 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:53.452329 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:53.455533 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:53.459684 29632 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:53.469485 29632 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.470129 29632 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.471000 29662 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:53.473735 29115 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:53.476441 26622 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:10:53.479000 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:53.479822 26464 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:53.481098 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:53.446158 28986 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:53.429921 29718 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:53.482777 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:53.475181 29448 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:53.499541 29756 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:53.496235 26464 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:53.458717 29528 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:10:53.504801 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:53.505824 26464 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:53.508232 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:53.502553 29448 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.510690 29448 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.483038 29710 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:53.500283 29115 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:53.506871 29528 consensus_queue.cc:1243] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:53.538017 29115 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:53.496358 29531 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:10:53.507787 29756 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:53.506533 29712 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:53.540905 29756 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:53.541894 29712 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:53.520943 29752 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:53.525832 29720 consensus_meta.cc:287] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.688s	user 0.005s	sys 0.003s
I20260709 12:10:53.526109 29171 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:53.680261 29674 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:53.680953 29115 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:53.514079 29665 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:53.687054 29489 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:53.686968 29512 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:53.689549 29750 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:53.689368 29489 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:53.681871 29448 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:53.728108 26465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 415) took 1607 ms (client timeout 1877 ms). Trace:
W20260709 12:10:53.730000 26470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1689) took 1628 ms (client timeout 2070 ms). Trace:
I20260709 12:10:53.735165 29602 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:53.755590 29766 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:10:53.757498 26470 rpcz_store.cc:269] 0709 12:10:52.101425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.273364 (+171939us) service_pool.cc:224] Handling call
0709 12:10:53.729770 (+1456406us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b5400259ed4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:53.729924 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1487970688}
I20260709 12:10:53.657078 29752 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.756001 29708 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.764165 29448 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:53.685050 29720 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:53.772120 29722 consensus_meta.cc:287] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.729s	user 0.008s	sys 0.002s
W20260709 12:10:53.756668 26465 rpcz_store.cc:269] 0709 12:10:52.120962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.240092 (+119130us) service_pool.cc:224] Handling call
0709 12:10:53.727773 (+1487681us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b5400165654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:53.727980 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2267040000}
I20260709 12:10:53.783767 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:53.749511 29425 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:53.890128 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.909278 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1736) took 1234 ms. Trace:
I20260709 12:10:53.909960 26540 rpcz_store.cc:276] 0709 12:10:52.677476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.677736 (+   260us) service_pool.cc:224] Handling call
0709 12:10:52.683662 (+  5926us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:52.988996 (+305334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:52.989048 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:52.998011 (+  8963us) log.cc:844] Serialized 52 byte log entry
0709 12:10:53.148670 (+150659us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:53.258375 (+109705us) log.cc:844] Serialized 14 byte log entry
0709 12:10:53.908865 (+650490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.908962 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:53.909006 (+    44us) raft_consensus.cc:1685] finished
0709 12:10:53.909017 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.909212 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":437467,"prepare.queue_time_us":98898,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":718312,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":16684,"thread_start_us":727549,"threads_started":4,"wal-append.queue_time_us":212608}
I20260709 12:10:53.917155 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:53.918035 26465 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
W20260709 12:10:53.863703 29741 consensus_meta.cc:287] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.874s	user 0.012s	sys 0.000s
W20260709 12:10:53.862031 29673 consensus_meta.cc:287] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.003s
I20260709 12:10:53.781292 29752 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:53.921559 27167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 533) took 1795 ms. Trace:
I20260709 12:10:53.891230 29489 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.922233 27167 rpcz_store.cc:276] 0709 12:10:52.125712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.125823 (+   111us) service_pool.cc:224] Handling call
0709 12:10:52.126138 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.319864 (+193726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.921209 (+1601345us) spinlock_profiling.cc:243] Waited 72.6 ms on lock 0x7b5400221354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:53.921471 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167081344}
I20260709 12:10:53.881929 29512 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:53.928216 26540 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:10:53.928040 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:53.922909 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:53.901785 29712 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:53.906665 29720 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:53.932005 26545 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:53.834956 29718 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:53.934584 26470 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:53.938163 26540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:53.941352 26540 raft_consensus.cc:606] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:53.945607 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:53.946053 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:53.946323 26545 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.946941 26470 raft_consensus.cc:2410] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:10:53.834007 29708 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:53.915174 29425 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:53.923796 29632 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:53.790634 29766 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:53.953251 26470 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.915712 29722 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:53.925479 29673 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:53.955367 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2693) took 1066 ms. Trace:
I20260709 12:10:53.933130 29489 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:53.958474 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:53.925149 29741 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:53.965591 26470 rpcz_store.cc:276] 0709 12:10:52.888509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.951387 (+1062878us) service_pool.cc:224] Handling call
0709 12:10:53.953084 (+  1697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.955011 (+  1927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.955291 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:53.972932 26545 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:10:53.976634 26620 raft_consensus.cc:2368] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9.
I20260709 12:10:53.981041 29632 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:53.948840 29718 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:54.005084 27162 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 8: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:54.005342 26547 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:53.975837 29750 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:54.009560 27134 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.006s	sys 0.028s
I20260709 12:10:54.012863 29708 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:54.017320 29774 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.017938 29774 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:54.018697 29766 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:54.020342 29774 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:54.010222 27134 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.007s	sys 0.028s
W20260709 12:10:54.023553 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 515382us
I20260709 12:10:54.025074 26588 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:54.025321 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:10:54.009526 29781 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:10:54.030421 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1697) took 1912 ms. Trace:
I20260709 12:10:54.030882 26469 rpcz_store.cc:276] 0709 12:10:52.118351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.366611 (+248260us) service_pool.cc:224] Handling call
0709 12:10:52.367043 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.651494 (+284451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:52.651528 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:52.651574 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:52.651607 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.030156 (+1378549us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54001c1e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:54.030206 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.030331 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":653188992}
I20260709 12:10:54.031635 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:54.032174 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 454) took 1075 ms. Trace:
I20260709 12:10:54.032532 26617 raft_consensus.cc:2368] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5.
I20260709 12:10:54.032927 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:54.034950 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:54.035585 27167 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.035506 26616 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:10:54.035705 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:54.039062 27166 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.040014 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:54.042045 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:54.028405 29522 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:54.032553 26546 rpcz_store.cc:276] 0709 12:10:52.956460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.965498 (+  9038us) service_pool.cc:224] Handling call
0709 12:10:52.982528 (+ 17030us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:53.013752 (+ 31224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.013783 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:53.017224 (+  3441us) log.cc:844] Serialized 52 byte log entry
0709 12:10:53.164876 (+147652us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:53.300389 (+135513us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.022210 (+721821us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.030352 (+  8142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.030458 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.030514 (+    56us) raft_consensus.cc:1685] finished
0709 12:10:54.030526 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.032095 (+  1569us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":584513,"prepare.queue_time_us":94407,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":60,"raft.queue_time_us":537333,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":13431,"thread_start_us":425730,"threads_started":4,"wal-append.queue_time_us":260498}
I20260709 12:10:54.037046 29665 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:54.051927 29665 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:54.036799 29632 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:10:54.052981 29665 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:54.028679 29597 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:10:54.054004 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:54.052950 29673 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:54.052017 29489 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:54.056388 29425 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:54.067209 29718 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:54.048341 29741 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:54.068570 29722 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:54.069521 29700 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:54.069113 29711 consensus_queue.cc:260] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:54.060711 29560 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:54.074962 29560 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.075102 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:54.075443 29752 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:54.077721 29752 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:54.081655 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:54.082439 26545 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.087698 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:54.088596 26622 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:54.089715 26545 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:54.091233 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1907) took 2162 ms. Trace:
I20260709 12:10:54.091647 26621 rpcz_store.cc:276] 0709 12:10:51.928443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.934489 (+  6046us) service_pool.cc:224] Handling call
0709 12:10:52.744877 (+810388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.799436 (+ 54559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.091035 (+1291599us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b540020a150. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:54.091171 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1862783360}
I20260709 12:10:54.090018 29560 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:54.099411 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:54.099747 29726 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:54.100119 26544 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.101150 29705 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:54.107961 29560 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:54.110057 29734 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:54.115023 26544 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:54.115669 29269 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:54.116357 29269 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:54.118757 29269 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:54.122066 26473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1684) took 2046 ms (client timeout 2140 ms). Trace:
W20260709 12:10:54.122529 26473 rpcz_store.cc:269] 0709 12:10:52.076121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.076245 (+   124us) service_pool.cc:224] Handling call
0709 12:10:54.121861 (+2045616us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001a9354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:54.121992 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2452480256}
I20260709 12:10:54.124007 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:54.125833 26544 raft_consensus.cc:1217] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Deduplicated request from leader. Original: 4.4->[6.5-10.7]   Dedup: 6.5->[8.6-10.7]
I20260709 12:10:54.126536 26544 pending_rounds.cc:85] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 5
I20260709 12:10:54.126842 26544 pending_rounds.cc:107] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:10:54.127159 26544 raft_consensus.cc:2889] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:54.127415 26540 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:10:54.128755 26540 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:54.130525 26542 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:54.131448 29749 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:54.132103 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:54.132685 26540 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.136894 27167 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:10:54.145488 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:54.147778 27134 leader_election.cc:400] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5.
I20260709 12:10:54.148258 27134 leader_election.cc:403] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:54.149109 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:54.163071 27166 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:10:54.131875 29749 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:54.174744 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:54.174984 29749 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:54.175490 26542 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:54.180904 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:54.181596 26545 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:54.185463 29461 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.003s	sys 0.010s
W20260709 12:10:54.185969 29461 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.003s	sys 0.010s
I20260709 12:10:54.158149 26622 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:54.177371 27134 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:54.193025 27134 leader_election.cc:400] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9.
I20260709 12:10:54.194159 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:54.195191 26621 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.195398 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:54.196463 26620 raft_consensus.cc:2368] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9.
I20260709 12:10:54.198309 27168 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:10:54.201416 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:54.218377 26545 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:10:54.220114 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:54.204914 29752 raft_consensus.cc:2764] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:10:54.222874 27166 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:54.224334 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:54.226096 27161 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:54.227298 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:54.228495 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:54.175964 29742 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:54.180718 29700 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:54.235983 29700 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:54.239061 29749 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.239300 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:54.240301 27163 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.180832 29733 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.242939 29733 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.243480 29733 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.243324 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:10:54.222937 27159 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:10:54.237360 29700 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:54.252851 27165 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:54.257717 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:54.258652 29795 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:10:54.214648 29714 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:54.260208 29714 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:54.261421 29735 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:54.261188 29714 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:54.262925 29712 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:54.263504 29712 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:54.264410 29712 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:54.268316 29798 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:10:54.269769 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1706) took 1827 ms. Trace:
I20260709 12:10:54.274307 26466 rpcz_store.cc:276] 0709 12:10:52.442786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.581051 (+138265us) service_pool.cc:224] Handling call
0709 12:10:52.581566 (+   515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.875238 (+293672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:52.875270 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:52.875314 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:52.875348 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.269468 (+1394120us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54000dcad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:54.269525 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.269698 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":674839424}
W20260709 12:10:54.276296 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.262948 29492 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:54.280043 29599 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:54.271430 29773 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 1.041s	user 0.009s	sys 0.013s
W20260709 12:10:54.281749 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.273502 29171 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:54.283370 29758 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.054s	user 0.003s	sys 0.010s
I20260709 12:10:54.283779 27162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 391) took 1385 ms. Trace:
I20260709 12:10:54.284179 27162 rpcz_store.cc:276] 0709 12:10:52.898500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.898683 (+   183us) service_pool.cc:224] Handling call
0709 12:10:54.250317 (+1351634us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540013b5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:54.283687 (+ 33370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2480600704}
I20260709 12:10:54.285416 29745 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:54.286638 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1741) took 1431 ms. Trace:
I20260709 12:10:54.288410 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1735) took 1651 ms. Trace:
I20260709 12:10:54.288798 26541 rpcz_store.cc:276] 0709 12:10:52.637056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.640396 (+  3340us) service_pool.cc:224] Handling call
0709 12:10:52.675813 (+ 35417us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:52.772380 (+ 96567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:52.772412 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:10:52.805285 (+ 32873us) log.cc:844] Serialized 78 byte log entry
0709 12:10:53.078062 (+272777us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:53.078104 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.078174 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.247687 (+1169513us) spinlock_profiling.cc:243] Waited 6.49 ms on lock 0x7b4800270258. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507b003aa1 00007f507affab37 00007f507affa9ca 00007f507b0f226f 00007f507b0f1f37 00007f507b10655c 00007f507b106508 00007f507b106488 00007f507b106443 00007f507b1056ec 00007f507a02fa96
0709 12:10:54.282748 (+ 35061us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:10:54.288169 (+  5421us) raft_consensus.cc:1685] finished
0709 12:10:54.288192 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.288352 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":206065,"raft.run_cpu_time_us":10957,"raft.run_wall_time_us":1353759,"spinlock_wait_cycles":20766336,"thread_start_us":285486,"threads_started":2,"wal-append.queue_time_us":342460}
I20260709 12:10:54.295504 29461 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:54.297305 29461 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:54.298408 26514 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:54.298918 29425 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:54.299384 29425 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:54.298799 26371 catalog_manager.cc:5697] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.300199 29425 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:54.300530 29745 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.300478 26371 catalog_manager.cc:5697] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 5 to 6, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 6 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.301222 29425 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.302668 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:54.303690 29653 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:54.303861 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:54.304893 27134 leader_election.cc:400] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9.
I20260709 12:10:54.305226 27134 leader_election.cc:403] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:10:54.259526 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:54.329625 26548 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.287047 26543 rpcz_store.cc:276] 0709 12:10:52.854996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.862773 (+  7777us) service_pool.cc:224] Handling call
0709 12:10:52.863106 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.940999 (+ 77893us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:53.115770 (+174771us) log.cc:844] Serialized 14 byte log entry
0709 12:10:53.695689 (+579919us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b180000f220. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5072fefa40 00007f5072fea4e4 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287 00007f50760f5208
0709 12:10:53.948793 (+253104us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:53.948873 (+    80us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:53.948954 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.286342 (+337388us) spinlock_profiling.cc:243] Waited 77.6 ms on lock 0x7b54002369d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:54.286421 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.286570 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22476,"prepare.queue_time_us":242912,"prepare.run_cpu_time_us":131,"prepare.run_wall_time_us":1982,"raft.queue_time_us":551202,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":88,"spinlock_wait_cycles":183151744,"thread_start_us":533466,"threads_started":3,"wal-append.queue_time_us":179890}
I20260709 12:10:54.333987 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:54.313957 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:54.334595 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:54.335487 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:54.336441 26616 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:10:54.337185 26617 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:54.340341 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:54.341364 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:54.318640 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:54.318863 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:54.342682 26621 raft_consensus.cc:2410] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:10:54.302208 26371 catalog_manager.cc:5697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.321272 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2683) took 1479 ms. Trace:
I20260709 12:10:54.343715 26472 rpcz_store.cc:276] 0709 12:10:52.841857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.842377 (+   520us) service_pool.cc:224] Handling call
0709 12:10:52.842817 (+   440us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:52.925589 (+ 82772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.320964 (+1395375us) spinlock_profiling.cc:243] Waited 66.5 ms on lock 0x7b54002de1d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:10:54.321205 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152853888}
I20260709 12:10:54.328544 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:54.328938 26540 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:10:54.341233 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:54.345570 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:54.347820 27133 leader_election.cc:400] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 5. Current term is 6.
W20260709 12:10:54.350260 26467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.020s	sys 0.047s
I20260709 12:10:54.350369 27133 leader_election.cc:403] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:54.350786 26467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.020s	sys 0.047s
I20260709 12:10:54.351758 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:54.352473 26472 raft_consensus.cc:2376] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7. Re-sending same reply.
I20260709 12:10:54.319787 26542 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:54.353704 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:54.354480 26541 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:54.353704 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:54.355408 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.356163 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.359301 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:54.361934 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:54.363765 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:54.364634 26464 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.371711 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:54.371119 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:54.376456 26615 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.411077 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:54.389822 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.412889 27168 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:54.416913 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:54.348963 29461 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:54.422207 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:54.425011 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:54.426594 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:54.426714 29764 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:54.427958 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:54.428556 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:54.429137 26472 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:54.429325 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:54.429162 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:54.430178 26542 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:54.352389 29269 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.311285 29629 consensus_queue.cc:1059] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 12:10:54.419771 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:54.358482 29706 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.437040 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:54.454681 29662 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.314284 29171 consensus_queue.cc:1059] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 12:10:54.454931 29706 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:54.456128 29171 raft_consensus.cc:3055] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:54.456537 29171 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:54.457243 29706 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:54.457441 29171 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:54.436682 26541 raft_consensus.cc:2368] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7.
I20260709 12:10:54.361104 29745 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.351974 29597 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.358718 29599 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.427415 29764 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:54.441216 26542 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:54.482496 26548 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:10:54.444870 29595 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.445571 29054 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:54.446868 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:54.412392 29605 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 5. Current term is 6.
I20260709 12:10:54.518580 26464 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:54.520150 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:54.520870 26464 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.448794 29492 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.450807 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:54.451436 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.410378 29653 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:10:54.343169 29730 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 12:10:54.372956 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:54.435818 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:54.605456 27162 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:10:54.480340 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 58226.6us
I20260709 12:10:54.606829 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:54.480677 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:54.590071 29492 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:54.509035 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.486976 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 355259us
I20260709 12:10:54.531832 26464 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:10:54.533839 26472 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:54.610363 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:54.612051 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:54.613010 26472 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 9: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:54.614353 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:54.439153 29734 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.141s
I20260709 12:10:54.615190 26472 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:10:54.616560 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:54.617919 26472 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.516806 29766 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.627920 26371 catalog_manager.cc:5697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 3 to 4, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 4 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:54.635381 26371 catalog_manager.cc:5697] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:54.638734 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.587962 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 421) took 1240 ms. Trace:
I20260709 12:10:54.436522 29461 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:54.459517 29269 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:54.680366 26613 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:54.468735 29722 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.637919 26371 catalog_manager.cc:5697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 5 to 7, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 7 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:54.649309 29742 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5.
I20260709 12:10:54.590539 29171 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.650380 26472 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:10:54.590335 29054 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:54.656432 29766 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:54.660681 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 418) took 1537 ms. Trace:
W20260709 12:10:54.663373 29794 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:10:54.484376 29745 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:54.672024 29736 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.672646 27163 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:10:54.673727 29711 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.639595 26469 rpcz_store.cc:276] 0709 12:10:53.347383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.043344 (+695961us) service_pool.cc:224] Handling call
0709 12:10:54.044058 (+   714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.044273 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:54.177836 (+133563us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.587541 (+409705us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:54.587606 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:54.587661 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.587740 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.587886 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48843,"prepare.queue_time_us":140454,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":49170,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":8634,"thread_start_us":493201,"threads_started":2}
I20260709 12:10:54.687644 26371 catalog_manager.cc:5697] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.718851 26371 catalog_manager.cc:5697] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 5 to 6, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 6 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.721539 26371 catalog_manager.cc:5697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.486999 29597 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:54.523962 29599 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:54.708101 26470 rpcz_store.cc:276] 0709 12:10:53.123024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.021514 (+898490us) service_pool.cc:224] Handling call
0709 12:10:54.024954 (+  3440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.025309 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.025342 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.025845 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:10:54.311194 (+285349us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:54.311238 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.311308 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.660345 (+349037us) raft_consensus.cc:1685] finished
0709 12:10:54.660377 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.660596 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3441,"raft.queue_time_us":399,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":4163,"thread_start_us":263830,"threads_started":1,"wal-append.queue_time_us":621247}
I20260709 12:10:54.670141 29764 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:54.517185 29595 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:54.729687 26371 catalog_manager.cc:5697] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 3 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 4 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.740334 27167 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:54.764489 26371 catalog_manager.cc:5697] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.782904 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:54.783201 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:54.784936 26618 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:54.715114 29752 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9.
I20260709 12:10:54.811072 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:54.787011 26370 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57052 (request call id 304) took 26048 ms (client timeout 15000 ms). Trace:
I20260709 12:10:54.787565 26371 catalog_manager.cc:5697] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 4 to 7, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 7 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.814365 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:54.815212 26620 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.816250 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:54.707360 29560 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.085s
W20260709 12:10:54.838217 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.818713 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:54.840538 26615 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.823244 26371 catalog_manager.cc:5697] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 1 to 3, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 3 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.835227 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:54.852501 26371 catalog_manager.cc:5697] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 2 to 4, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 4 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:54.785964 29730 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.718044 29054 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:54.864650 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:54.854326 29749 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.615s	user 0.015s	sys 0.000s
W20260709 12:10:54.890479 26513 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.016s	sys 0.017s
I20260709 12:10:54.879379 26621 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:10:54.890913 26513 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.016s	sys 0.017s
I20260709 12:10:54.895980 26371 catalog_manager.cc:5697] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.897081 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:54.902747 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:54.891299 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 586557us
I20260709 12:10:54.939957 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2684) took 2096 ms. Trace:
I20260709 12:10:54.869623 29748 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:54.941936 29054 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:54.942726 29597 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:54.943295 29703 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.944471 29653 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.952083 29448 raft_consensus.cc:3055] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:54.972311 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 75c9184ee6b7472fb72209c9dfd651b6: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:54.972577 29653 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:54.972585 29448 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:54.973973 29748 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.974700 29703 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:54.812021 26370 rpcz_store.cc:269] 0709 12:10:28.723509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.726552 (+  3043us) service_pool.cc:224] Handling call
0709 12:10:54.771978 (+26045426us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:49.097513 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:49.098254 (+   741us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:49.098310 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:10:49.098349 (+    39us) tablet.cc:662] Decoding operations
0709 12:10:49.347174 (+248825us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:49.392268 (+ 45094us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:49.401374 (+  9106us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:10:49.431545 (+ 30171us) tablet.cc:701] Row locks acquired
0709 12:10:49.431607 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:10:49.431880 (+   273us) write_op.cc:270] Start()
0709 12:10:49.432081 (+   201us) write_op.cc:276] Timestamp: P: 1783599049431774 usec, L: 0
0709 12:10:49.432111 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:10:49.433142 (+  1031us) log.cc:844] Serialized 3258 byte log entry
0709 12:10:50.131385 (+698243us) op_driver.cc:464] REPLICATION: finished
0709 12:10:50.290719 (+159334us) write_op.cc:301] APPLY: starting
0709 12:10:50.309370 (+ 18651us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:50.314803 (+  5433us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:50.366505 (+ 51702us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:50.405168 (+ 38663us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:50.405518 (+   350us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:10:50.405576 (+    58us) write_op.cc:312] APPLY: finished
0709 12:10:50.405953 (+   377us) log.cc:844] Serialized 65 byte log entry
0709 12:10:50.406155 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:50.406281 (+   126us) write_op.cc:454] Released schema lock
0709 12:10:50.406345 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:50.406871 (+   526us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:50.406902 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6270,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":120549,"apply.run_cpu_time_us":4341,"apply.run_wall_time_us":138976,"num_ops":8,"prepare.queue_time_us":530928,"prepare.run_cpu_time_us":12378,"prepare.run_wall_time_us":542454,"raft.queue_time_us":147306,"raft.run_cpu_time_us":14129,"raft.run_wall_time_us":183845,"replication_time_us":691103,"thread_start_us":559814,"threads_started":4,"wal-append.queue_time_us":334164,"wal-append.run_cpu_time_us":21786,"wal-append.run_wall_time_us":1667136}]]}
I20260709 12:10:54.976981 29703 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:54.952332 29599 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:54.977972 26465 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:10:54.858914 29700 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.978416 29745 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:54.897789 26371 catalog_manager.cc:5697] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 2 to 5, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 5 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.971699 26620 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
W20260709 12:10:54.962934 29733 consensus_meta.cc:287] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.719s	user 0.012s	sys 0.006s
I20260709 12:10:54.980103 26371 catalog_manager.cc:5697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.981163 29733 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:54.958593 26544 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:54.958575 26467 rpcz_store.cc:276] 0709 12:10:52.843870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.867652 (+ 23782us) service_pool.cc:224] Handling call
0709 12:10:52.868051 (+   399us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:52.907436 (+ 39385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:52.907488 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:53.731524 (+824036us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b2c000327f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:10:53.750656 (+ 19132us) log.cc:844] Serialized 52 byte log entry
0709 12:10:54.351312 (+600656us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:54.351359 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.357258 (+  5899us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.939589 (+582331us) raft_consensus.cc:1685] finished
0709 12:10:54.939610 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.939881 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16483,"raft.run_cpu_time_us":508,"raft.run_wall_time_us":68944,"spinlock_wait_cycles":28319616,"thread_start_us":594883,"threads_started":1,"wal-append.queue_time_us":666270}
I20260709 12:10:54.958547 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:54.962867 29626 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.012s	sys 0.021s
I20260709 12:10:54.974553 29448 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:54.948303 26615 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:54.978685 29700 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:54.995111 26467 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9. Ops: [6.9-8.10]
W20260709 12:10:54.996111 29714 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.030s	sys 0.025s
I20260709 12:10:54.953743 29730 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:54.982438 29719 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.016s	sys 0.019s
W20260709 12:10:55.014802 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.007567 26467 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:55.022132 26467 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:55.024014 26467 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:55.041177 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:55.042260 26622 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:10:55.044427 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:55.045431 26622 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
W20260709 12:10:54.995815 29626 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.013s	sys 0.021s
I20260709 12:10:54.998291 26513 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:55.068872 26467 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:55.075284 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:55.079252 29807 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:55.022898 29719 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.020s	sys 0.020s
I20260709 12:10:55.010910 29448 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:55.116822 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.080302 26620 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:10:55.080367 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:55.019285 29714 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.031s	sys 0.026s
I20260709 12:10:55.081375 26621 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:54.997479 29745 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:10:55.083842 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 477093us
I20260709 12:10:55.085711 26467 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:10:55.088513 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet b9bd8978cfc74b93bcc4755ec8254fa7: Illegal state: Replica ac3ac2181aa941229a758ccf6b5607cd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:10:55.129662 26514 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:55.131341 26514 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:55.107120 29806 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:10:55.114847 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:55.129668 29595 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:55.092031 29700 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:55.132258 29719 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:55.147980 26514 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:55.123173 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 124970us
W20260709 12:10:55.149991 27133 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 2.194s (SENT) [suppressed 10 similar messages]
I20260709 12:10:55.160048 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:55.149842 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 63360.8us
W20260709 12:10:55.136124 29734 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.010s	sys 0.035s
I20260709 12:10:55.161494 26439 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:55.166841 26467 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:10:55.177260 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.180428 26543 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:55.188977 29766 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:55.151692 29745 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:55.154558 29425 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:55.194053 29803 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.256s	user 0.000s	sys 0.002s
I20260709 12:10:55.205009 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:55.156306 29719 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:10:55.275857 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.269222 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:55.278712 26467 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
W20260709 12:10:55.223116 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 61713.3us
I20260709 12:10:55.280177 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:55.280484 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:55.222654 29734 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.010s	sys 0.036s
I20260709 12:10:55.190095 29766 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:10:55.287871 26545 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:55.276710 29711 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:55.203435 29745 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.293883 26467 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 9: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:10:55.297252 26468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.037s	sys 0.069s
I20260709 12:10:55.208133 29425 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:55.253386 29719 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.277168 29733 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:55.300668 26468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.037s	sys 0.069s
W20260709 12:10:55.302654 26438 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.021s	sys 0.083s
W20260709 12:10:55.308063 26438 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.021s	sys 0.083s
W20260709 12:10:55.308576 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 596467us
I20260709 12:10:55.292672 29595 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:55.292542 29682 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.292459 29711 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.297312 29734 consensus_queue.cc:1243] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:55.355834 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:55.296895 29745 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:55.308758 29807 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.326666 29766 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:55.295645 29700 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:10:55.356694 29730 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:55.359418 29711 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:55.351684 29595 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:55.302664 29808 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 12:10:55.407670 29492 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:55.403470 26472 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.035s	sys 0.076s
I20260709 12:10:55.371033 29599 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:55.374339 29734 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:55.413285 26472 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.036s	sys 0.077s
I20260709 12:10:55.398813 29665 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.399905 26622 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:55.365734 29606 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:10:55.360821 29682 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:55.441419 26466 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.008s	sys 0.004s
I20260709 12:10:55.408294 29595 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.453576 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1714) took 1124 ms. Trace:
I20260709 12:10:55.407585 29766 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:55.444211 26469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.005s	sys 0.007s
W20260709 12:10:55.445782 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:55.446301 26613 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.009s	sys 0.005s
W20260709 12:10:55.460008 26469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.006s	sys 0.007s
I20260709 12:10:55.454005 26468 rpcz_store.cc:276] 0709 12:10:54.329350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.330673 (+  1323us) service_pool.cc:224] Handling call
0709 12:10:54.370471 (+ 39798us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.412904 (+ 42433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.412936 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.423805 (+ 10869us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.307650 (+883845us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:55.307696 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.307771 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.453338 (+145567us) raft_consensus.cc:1685] finished
0709 12:10:55.453358 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.453510 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53811,"raft.queue_time_us":67157,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":23250,"thread_start_us":784686,"threads_started":1,"wal-append.queue_time_us":991513}
W20260709 12:10:55.460412 26613 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.010s	sys 0.005s
W20260709 12:10:55.461041 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:55.450824 26466 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.008s	sys 0.004s
I20260709 12:10:55.449011 29492 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:55.441847 29706 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.006s	sys 0.007s
W20260709 12:10:55.452155 29810 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:10:55.458825 26471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2698) took 2481 ms (client timeout 1894 ms). Trace:
W20260709 12:10:55.468813 26473 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.005s	sys 0.022s
W20260709 12:10:55.481304 26473 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.005s	sys 0.022s
I20260709 12:10:55.399958 29807 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:55.479625 26470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.001s	sys 0.009s
I20260709 12:10:55.482040 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:10:55.493657 26470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.001s	sys 0.009s
W20260709 12:10:55.481101 26471 rpcz_store.cc:269] 0709 12:10:52.977364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.977606 (+   242us) service_pool.cc:224] Handling call
0709 12:10:55.456874 (+2479268us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b5400069ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:55.458732 (+  1858us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4796987136}
W20260709 12:10:55.467700 29706 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.007s	sys 0.008s
I20260709 12:10:55.459852 29766 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:55.402769 29425 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:55.484880 29054 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.438563 29599 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:55.512092 26471 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:10:55.514763 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1719) took 1183 ms. Trace:
I20260709 12:10:55.516252 26470 rpcz_store.cc:276] 0709 12:10:54.331817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.776215 (+444398us) service_pool.cc:224] Handling call
0709 12:10:54.784831 (+  8616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.785027 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:54.847895 (+ 62868us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.513179 (+665284us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:55.513234 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:55.513282 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.513337 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.514680 (+  1343us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":81859,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":4481,"thread_start_us":645839,"threads_started":1}
I20260709 12:10:55.450587 29665 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:55.524977 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 429) took 1041 ms. Trace:
I20260709 12:10:55.527041 26468 rpcz_store.cc:276] 0709 12:10:54.483341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.512468 (+1029127us) service_pool.cc:224] Handling call
0709 12:10:55.524409 (+ 11941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.524635 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.524663 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:55.524704 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:55.524734 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.524790 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.524916 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:55.525938 26471 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:55.535398 27167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56886 (request call id 542) took 1339 ms. Trace:
I20260709 12:10:55.535877 27167 rpcz_store.cc:276] 0709 12:10:54.195788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.201041 (+  5253us) service_pool.cc:224] Handling call
0709 12:10:55.535198 (+1334157us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b5400438854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:55.535328 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1183831424}
W20260709 12:10:55.539716 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 389716us
I20260709 12:10:55.541496 26468 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:55.525511 29808 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:55.543036 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:55.479347 29492 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:55.551600 29814 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:10:55.521188 29054 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:55.662976 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.839278 26467 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:10:55.842947 26544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1820) took 1527 ms (client timeout 1998 ms). Trace:
I20260709 12:10:55.528311 29425 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.651800 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 1766) took 1513 ms. Trace:
I20260709 12:10:55.557361 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1718) took 1225 ms. Trace:
W20260709 12:10:55.605852 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 953d8c981a6c459f8b7f3dbbb66fda45: Illegal state: Replica ac3ac2181aa941229a758ccf6b5607cd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:10:55.692508 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:55.853592 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 693561us
W20260709 12:10:55.783953 26465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 416) took 2662 ms (client timeout 2194 ms). Trace:
W20260709 12:10:55.649233 29825 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:10:55.728652 26514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.000s	sys 0.027s
I20260709 12:10:55.714643 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1716) took 1383 ms. Trace:
W20260709 12:10:55.861392 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.861297 29626 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:10:55.865164 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:55.941263 26465 rpcz_store.cc:269] 0709 12:10:53.121689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.922520 (+800831us) service_pool.cc:224] Handling call
0709 12:10:55.783620 (+1861100us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000dc0d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:55.783841 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2391820672}
W20260709 12:10:55.849155 26544 rpcz_store.cc:269] 0709 12:10:54.315650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.335247 (+ 19597us) service_pool.cc:224] Handling call
0709 12:10:55.842677 (+1507430us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b54001068d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:55.842851 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1311915264}
W20260709 12:10:55.890599 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.870113 26469 rpcz_store.cc:276] 0709 12:10:54.331555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.717568 (+386013us) service_pool.cc:224] Handling call
0709 12:10:54.777529 (+ 59961us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:54.799033 (+ 21504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.799064 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:54.821799 (+ 22735us) log.cc:844] Serialized 52 byte log entry
0709 12:10:55.460592 (+638793us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:55.460632 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.460703 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.557122 (+ 96419us) raft_consensus.cc:1685] finished
0709 12:10:55.557142 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.557290 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20922,"raft.queue_time_us":34653,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":9765,"thread_start_us":573749,"threads_started":1,"wal-append.queue_time_us":691197}
W20260709 12:10:55.943413 26514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.000s	sys 0.030s
W20260709 12:10:55.944039 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.559943 29599 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:55.641103 29711 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:55.947010 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:55.947461 26614 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:55.938248 29830 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:55.568118 29461 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:55.558015 29813 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:10:55.941388 26473 rpcz_store.cc:276] 0709 12:10:54.331122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.700753 (+369631us) service_pool.cc:224] Handling call
0709 12:10:54.725046 (+ 24293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.774649 (+ 49603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.774683 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.775454 (+   771us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.481879 (+706425us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:55.481940 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.482040 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.714273 (+232233us) raft_consensus.cc:1685] finished
0709 12:10:55.714305 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.714522 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3688,"raft.queue_time_us":62067,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":29522,"thread_start_us":613507,"threads_started":1,"wal-append.queue_time_us":806892}
I20260709 12:10:55.949874 29752 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:55.953351 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:55.952099 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:55.953971 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:55.971582 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:55.951653 29626 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:10:55.907894 29748 consensus_meta.cc:287] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.933s	user 0.012s	sys 0.002s
I20260709 12:10:55.955272 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:55.647286 29595 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:55.956967 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 809005us
I20260709 12:10:55.984368 26514 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:55.988729 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:55.989246 26464 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:55.990100 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:55.990798 26465 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:10:55.993240 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:55.993578 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:55.994155 26465 raft_consensus.cc:2410] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:10:55.957738 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:55.878933 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 335968us
I20260709 12:10:55.568567 29807 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:55.958637 26615 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:55.561491 29653 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:55.544430 27159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 546) took 1200 ms. Trace:
I20260709 12:10:55.552677 29665 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:55.563450 29682 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:56.003518 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:55.965049 26588 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:55.966229 26587 connection.cc:256] RPC call timeout handler was delayed by -1.2224187310000616s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
I20260709 12:10:55.968456 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1728) took 1531 ms. Trace:
W20260709 12:10:55.969677 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.945459 29269 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:55.869921 26545 rpcz_store.cc:276] 0709 12:10:54.138732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.219807 (+ 81075us) service_pool.cc:224] Handling call
0709 12:10:55.651519 (+1431712us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400106dd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:55.651692 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2451717376}
I20260709 12:10:55.868417 29712 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:56.011567 27168 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:55.978511 26622 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:10:55.994297 26464 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:55.875164 29808 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:55.997040 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:56.005909 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:56.005595 26467 rpcz_store.cc:276] 0709 12:10:54.437506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.294616 (+857110us) service_pool.cc:224] Handling call
0709 12:10:55.783820 (+489204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.848889 (+ 65069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.968248 (+119359us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54000dc0d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:55.968389 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124246784}
I20260709 12:10:56.006914 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:56.007701 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:56.008013 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:55.977752 29828 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.009318 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:55.971415 29830 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:55.982935 29736 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:55.579126 29766 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:55.952986 29708 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.011750 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:56.014106 26465 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 9: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:56.014359 26621 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.014676 27164 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:56.016088 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:56.002044 29748 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.010736 29682 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:56.018649 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:56.018991 27167 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:56.015424 29461 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:56.024369 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:56.015110 29828 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:56.026530 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:56.027275 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:56.017377 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:56.018213 29818 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:56.043339 26473 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:56.020202 29712 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:56.041706 29461 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:56.018537 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:56.040309 27165 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:10:56.042364 26545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:56.019501 29736 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:56.047984 29808 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:56.048415 26469 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 10: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:56.051206 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:56.045987 29824 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.353s	user 0.001s	sys 0.001s
I20260709 12:10:56.059082 29595 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:56.052891 29736 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.059845 29711 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:56.054610 26469 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:10:56.061203 26467 raft_consensus.cc:2410] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:56.069782 26468 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.044863 29828 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.054901 26621 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:10:56.031399 29829 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:10:56.057447 29835 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:10:56.021571 29626 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:56.057572 29461 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:56.027750 29448 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:56.044605 29818 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:56.121855 29818 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.048759 29054 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:56.025207 29708 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:56.032263 29748 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:56.137868 27168 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:56.138772 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:56.139885 26547 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:56.140434 26547 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:56.141266 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:56.142151 26620 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:56.158509 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:56.141425 26547 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:56.166215 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:56.166772 26547 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.158993 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:56.165378 29626 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.171537 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:56.174013 27162 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:56.186497 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1710) took 1859 ms. Trace:
I20260709 12:10:56.187016 26466 rpcz_store.cc:276] 0709 12:10:54.327218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.327377 (+   159us) service_pool.cc:224] Handling call
0709 12:10:54.327820 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.797693 (+469873us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:55.462132 (+664439us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.858250 (+396118us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:55.859011 (+   761us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.859217 (+   206us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:55.859914 (+   697us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.860191 (+   277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.860314 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.186213 (+325899us) raft_consensus.cc:1685] finished
0709 12:10:56.186234 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.186416 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67350,"prepare.queue_time_us":128968,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":26646,"raft.queue_time_us":81052,"raft.run_cpu_time_us":384,"raft.run_wall_time_us":12578,"thread_start_us":1386323,"threads_started":3,"wal-append.queue_time_us":468867}
I20260709 12:10:56.107693 29829 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:56.193611 27163 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:56.193883 29492 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:56.195601 29836 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.187s	user 0.003s	sys 0.000s
I20260709 12:10:56.198557 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1717) took 1867 ms. Trace:
I20260709 12:10:56.199059 26472 rpcz_store.cc:276] 0709 12:10:54.331337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.695475 (+364138us) service_pool.cc:224] Handling call
0709 12:10:54.695971 (+   496us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:54.696447 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.696475 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:54.697084 (+   609us) log.cc:844] Serialized 52 byte log entry
0709 12:10:55.433490 (+736406us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:55.461929 (+ 28439us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.462168 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.462225 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.119586 (+657361us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b1800074e00. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:10:56.198193 (+ 78607us) raft_consensus.cc:1685] finished
0709 12:10:56.198309 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.198480 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45307,"prepare.queue_time_us":24049,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":18647,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":7871,"spinlock_wait_cycles":42413440,"thread_start_us":654295,"threads_started":1,"wal-append.queue_time_us":778402}
I20260709 12:10:56.203477 29766 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:56.001713 27159 rpcz_store.cc:276] 0709 12:10:54.344190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.345936 (+  1746us) service_pool.cc:224] Handling call
0709 12:10:54.426626 (+ 80690us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.427031 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.427062 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.427588 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 12:10:54.893011 (+465423us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:54.954924 (+ 61913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.963071 (+  8147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.528947 (+565876us) raft_consensus.cc:1685] finished
0709 12:10:55.533975 (+  5028us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.540624 (+  6649us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1957,"raft.queue_time_us":7341,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3138,"thread_start_us":433728,"threads_started":1,"wal-append.queue_time_us":924189}
I20260709 12:10:56.190693 29752 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 9 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:56.186769 29749 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.216295 29749 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:56.221210 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 213574us
I20260709 12:10:56.255862 29839 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.259382 29841 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:56.259506 29839 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:56.270902 29752 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:56.315274 29839 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:56.316479 26618 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:10:56.319543 29719 consensus_meta.cc:287] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.966s	user 0.010s	sys 0.011s
I20260709 12:10:56.320170 29719 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:56.321533 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 325040us
I20260709 12:10:56.322540 29606 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.323275 29829 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:56.323388 29606 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:56.324038 29829 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:56.324611 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 340311us
I20260709 12:10:56.324735 29829 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:56.325884 29606 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:56.331943 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:56.332788 26621 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:56.336828 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:56.343776 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:56.347455 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.348340 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:56.348407 26514 connection.cc:256] RPC call timeout handler was delayed by -1.5531263240000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30190000000000006s for a response
W20260709 12:10:56.349418 26514 connection.cc:256] RPC call timeout handler was delayed by -1.289839862000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20750000000000002s for a response
I20260709 12:10:56.349568 26544 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:56.349478 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:56.358862 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:56.359802 26543 raft_consensus.cc:2368] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5.
I20260709 12:10:56.366797 26548 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:56.357020 29808 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:56.345954 29448 raft_consensus.cc:697] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:56.357403 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:10:56.370677 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.321157 29845 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:10:56.380776 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:56.376398 26620 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
W20260709 12:10:56.388203 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.334002 29841 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:56.389801 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:56.339938 29492 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:56.391008 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:56.394479 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:56.394979 26543 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:56.395247 26544 raft_consensus.cc:2368] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9.
I20260709 12:10:56.394263 26539 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.392373 26439 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:56.398066 26439 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:56.395998 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 379946us
I20260709 12:10:56.399966 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:56.408704 26546 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.409709 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:56.371555 26468 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:10:56.410547 26464 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:56.411166 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:56.411530 26465 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:56.379940 29712 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:56.414237 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:56.421054 26470 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:10:56.415081 26472 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:56.418488 26543 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:10:56.353289 29711 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:10:56.419473 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:56.420244 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:56.424619 26466 raft_consensus.cc:2410] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:56.357311 29595 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
W20260709 12:10:56.442932 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 119565us
I20260709 12:10:56.393424 29808 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:56.359532 29269 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:10:56.405030 29599 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:56.398759 29837 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.402303 29840 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.393704 29748 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:56.357487 29838 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:10:56.403192 26547 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:10:56.420652 29745 consensus_meta.cc:287] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.033s	user 0.022s	sys 0.000s
I20260709 12:10:56.369925 29597 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 12:10:56.461169 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 146122us
W20260709 12:10:56.459897 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 112528us
I20260709 12:10:56.369010 29448 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:56.404739 29834 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:10:56.475152 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 6598ff9cfd5346af8da1e9928f3a5ac9: Illegal state: Replica 01a57027214a411e80874ac7febd628b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:10:56.625774 26588 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:56.402031 29492 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:56.464018 29599 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.466030 29749 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:56.523825 29830 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:56.598729 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.618453 29808 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:56.599543 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:56.661557 26540 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:56.413941 29817 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.643190 29745 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:56.662997 29817 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:56.663578 29848 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.664255 29848 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:56.664726 29848 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.655344 29719 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:56.665856 29817 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:56.407968 29606 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:56.404510 29682 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.656767 29599 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:56.617610 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.484252 29837 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:56.622707 26545 raft_consensus.cc:606] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:56.691102 26545 raft_consensus.cc:614] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:56.623355 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1771) took 1467 ms. Trace:
I20260709 12:10:56.692025 26547 rpcz_store.cc:276] 0709 12:10:55.155926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.156554 (+   628us) service_pool.cc:224] Handling call
0709 12:10:55.156964 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.133862 (+976898us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b5400259020. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f5076051dc0 00007f50760dc1c0 00007f50760dd231 00007f50760d9d8f 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c
0709 12:10:56.622517 (+488655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.623270 (+   753us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440298880}
W20260709 12:10:56.617887 29425 consensus_meta.cc:287] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.743s	user 0.005s	sys 0.017s
W20260709 12:10:56.645205 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 225785us
I20260709 12:10:56.695473 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:56.620756 29828 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.548s	user 0.018s	sys 0.001s
I20260709 12:10:56.698796 29828 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:56.701836 29828 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:56.702764 29842 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:56.598634 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:56.705325 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:56.640283 29844 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.241s	user 0.005s	sys 0.000s
I20260709 12:10:56.622087 29752 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:10:56.404368 29832 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 12:10:56.667716 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.710857 26540 raft_consensus.cc:2410] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:10:56.712080 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.625092 29748 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:56.713162 29748 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:56.716250 29748 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:56.672986 26471 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:56.677376 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.717628 26544 raft_consensus.cc:2410] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:10:56.718933 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.616806 26539 raft_consensus.cc:2410] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:56.665994 29859 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:56.720742 29859 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:56.721195 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:56.722828 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.574636 29841 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:56.688576 26542 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
W20260709 12:10:56.675343 29853 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:10:56.652200 29829 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:56.724261 26544 raft_consensus.cc:2410] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:56.693964 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.717427 26541 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:56.643438 29807 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:10:56.729108 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.740278 26542 raft_consensus.cc:2393] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:56.730968 29492 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:56.731320 29766 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.008s
I20260709 12:10:56.733206 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:56.738234 26547 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:56.670502 29719 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:56.723443 29859 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:56.736817 29764 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:10:56.751744 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.753772 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:56.742321 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:56.755776 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:56.750651 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 94446.6us
I20260709 12:10:56.760278 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.761132 26542 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:56.761258 26513 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:56.761399 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:10:56.762964 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:56.764061 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.746884 26539 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:10:56.729152 29708 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:56.622457 29840 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:56.689016 29606 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:56.770380 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:56.771796 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:56.772126 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:56.772753 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:56.773003 29829 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.743328 29852 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.670572 29808 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:56.769122 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.776203 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:56.776553 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:56.805135 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:56.805794 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:56.806712 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:56.806872 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:56.781412 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.725646 29682 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:56.748526 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.774264 29854 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.809834 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.810883 26547 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:56.812218 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:56.817173 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:56.807806 26542 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:56.820945 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:56.821255 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.765753 29269 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.804227 26544 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
W20260709 12:10:56.822628 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52319.9us
I20260709 12:10:56.901572 26613 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:10:56.901937 26513 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:56.825253 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.836937 26619 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:56.827083 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:56.900882 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:56.902825 26541 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:56.900600 26547 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:56.773662 29828 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:56.767100 29859 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:56.903951 26540 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:56.863085 26546 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
W20260709 12:10:56.827452 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 207338us
I20260709 12:10:56.840219 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:56.910156 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.911365 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.912520 26546 raft_consensus.cc:2368] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7.
I20260709 12:10:56.906611 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:56.759364 29719 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:56.787829 29752 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:56.827165 29855 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:10:56.925113 29863 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.930693 29863 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.918941 26471 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:56.925391 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.925688 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.821798 29847 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:56.925719 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.929491 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:56.926048 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 190274us
I20260709 12:10:56.902544 29817 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:56.782900 29849 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.158s
I20260709 12:10:56.916671 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:56.910161 29766 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:56.833117 29748 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:56.937474 26471 pending_rounds.cc:85] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 6
I20260709 12:10:56.902611 29860 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:56.911396 29828 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:56.964421 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:56.990653 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:56.807960 29834 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:56.942909 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:56.928562 29854 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.002621 29808 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:57.003324 29808 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.943296 29749 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:57.007261 29748 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:56.935959 29862 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:10:56.987813 29492 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.015522 29606 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:56.824445 29852 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:57.009907 26546 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
W20260709 12:10:56.944042 29818 consensus_meta.cc:287] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.817s	user 0.011s	sys 0.009s
W20260709 12:10:56.981850 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 65297.3us
I20260709 12:10:56.983573 26547 raft_consensus.cc:2410] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:56.934262 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:57.026233 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:57.026815 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:57.026230 26541 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:57.027848 26547 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:56.910534 29269 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:56.986004 26471 pending_rounds.cc:107] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:57.046808 26471 raft_consensus.cc:2889] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:56.994096 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:57.048311 26542 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:56.915360 29842 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:56.996590 26468 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:10:56.927299 29752 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:10:56.943904 29626 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.772s	user 0.014s	sys 0.018s
I20260709 12:10:56.989111 26587 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:10:56.998956 29857 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 12:10:56.999183 29840 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:57.000726 29682 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:56.964370 26544 raft_consensus.cc:2410] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:10:56.940205 29863 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:57.022761 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 382893us
I20260709 12:10:56.980448 26545 raft_consensus.cc:2410] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:10:57.045223 27133 connection.cc:256] RPC call timeout handler was delayed by -1.236256990000129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 12:10:57.158066 27133 connection.cc:256] RPC call timeout handler was delayed by -1.2029569900000752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
I20260709 12:10:57.158293 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:56.972312 29847 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:56.996667 29828 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:57.107437 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.059324 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:10:57.037159 29736 consensus_meta.cc:287] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.977s	user 0.012s	sys 0.013s
I20260709 12:10:57.009739 29748 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:57.036713 29711 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.018s	sys 0.039s
I20260709 12:10:56.994148 29859 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:57.145745 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.988019 29869 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:57.007272 29845 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.195892 29845 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:57.160491 26547 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:57.204654 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:10:57.206820 29861 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:10:57.169691 27134 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:57.008759 29834 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:57.010157 29749 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:57.193392 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:57.226464 26545 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:57.061702 29745 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:57.218530 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:57.194015 29851 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:57.194737 29711 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.019s	sys 0.040s
I20260709 12:10:57.195063 29859 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.213647 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:57.060148 29839 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.218155 29708 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.232939 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:57.018265 29860 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:57.036563 29606 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:57.208455 29867 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.039547 29818 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:57.047451 29492 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:57.357003 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2622) took 1022 ms. Trace:
I20260709 12:10:57.367159 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:57.362998 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:57.367112 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:57.371021 26617 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:10:57.373629 26541 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 8: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:57.252908 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:57.373628 26540 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:57.311499 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:57.375808 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:57.376612 26615 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:10:57.377532 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 537361us
I20260709 12:10:57.372033 26621 rpcz_store.cc:276] 0709 12:10:56.335802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.348011 (+ 12209us) service_pool.cc:224] Handling call
0709 12:10:57.356669 (+1008658us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b540020a654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:57.356897 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1338640128}
I20260709 12:10:57.382354 26540 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:10:57.383024 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:57.378160 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:57.363883 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:57.384296 26547 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:10:57.384831 27162 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:57.384909 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:57.381485 26548 raft_consensus.cc:2410] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:10:57.383311 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 394583us
I20260709 12:10:57.385963 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:57.376873 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:57.387179 26541 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:57.387277 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:57.381024 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:57.378309 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 352154us
I20260709 12:10:57.389031 26547 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 9: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:57.163348 29849 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.183319 29852 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:57.403146 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.389727 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:57.390620 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:57.391268 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:57.410151 26540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:57.410856 26540 raft_consensus.cc:606] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:57.411284 26540 raft_consensus.cc:614] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:57.411384 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:57.389122 26616 raft_consensus.cc:2410] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:57.410894 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:57.345348 29719 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:57.345438 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:57.429489 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:57.430366 29597 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:57.346499 29269 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:57.359423 29848 consensus_meta.cc:287] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.694s	user 0.012s	sys 0.001s
I20260709 12:10:57.432649 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:57.445739 26540 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:57.442529 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:57.372697 29859 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.372331 29708 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.387987 29845 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:57.211833 29736 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:57.414115 29711 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.389381 29808 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:57.431226 29748 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:57.427910 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:57.389674 29837 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:57.457394 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:57.447186 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:57.397598 29054 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:57.413815 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:57.444509 29653 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.021s	sys 0.010s
I20260709 12:10:57.320125 29842 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:57.432654 29832 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.429179 29745 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.462958 26543 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 7: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:57.379128 29665 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:10:57.379917 29839 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:57.378099 29492 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:57.443639 29867 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:57.456370 29708 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.475716 27160 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 5: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:10:57.455614 29719 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.312337 29847 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:57.294665 29752 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:57.456571 29848 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:57.449254 29626 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.491994 29595 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.542317 29595 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:57.542534 29752 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.542918 29595 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:57.491863 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 44757.1us
I20260709 12:10:57.448653 29597 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:57.544854 29597 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.546641 29848 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:57.548700 29818 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:57.500701 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 87013.3us
I20260709 12:10:57.551200 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:57.502130 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.503700 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:57.462294 29711 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.462837 29269 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.509058 26542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:57.555531 26542 raft_consensus.cc:606] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:10:57.556087 26542 raft_consensus.cc:614] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:57.501541 29653 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.021s	sys 0.010s
I20260709 12:10:57.428934 29849 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:57.501914 29606 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.504647 29448 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:57.550464 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:57.553783 29829 consensus_meta.cc:287] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.749s	user 0.011s	sys 0.000s
W20260709 12:10:57.557194 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53556.5us
I20260709 12:10:57.574683 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:57.574975 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:57.575407 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:57.533998 29845 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:57.567775 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:57.579221 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:57.553957 26438 leader_election.cc:400] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7.
I20260709 12:10:57.533741 29867 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:10:57.549491 29599 consensus_meta.cc:287] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.814s	user 0.012s	sys 0.001s
I20260709 12:10:57.577039 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:57.577128 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:57.577973 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:57.581126 26618 raft_consensus.cc:2410] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:57.581139 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:57.583413 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:57.584561 26438 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:57.585639 26438 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:57.506616 29764 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:10:57.555868 29711 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.558234 29626 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.592259 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:57.555079 29269 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:57.568588 29606 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.561084 29748 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:57.581446 29818 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.600178 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:57.587040 29054 raft_consensus.cc:2764] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:57.586846 29847 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.589033 29832 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.587700 29829 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.597012 29808 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.598331 29682 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.612315 29606 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.631649 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:57.654608 26614 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:57.655212 29860 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:57.656077 29882 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:10:57.597426 29840 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.656845 29840 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:57.659014 29839 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:57.659178 29840 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:57.662063 26539 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:10:57.604031 29269 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.611940 29748 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:57.662752 29748 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.603626 29869 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.604327 29719 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:10:57.593690 29599 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:57.669118 29599 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:57.602530 29626 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:57.669847 29626 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.671291 29850 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:57.671905 29850 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:57.676389 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:57.616722 29858 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:10:57.613396 29871 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:57.615906 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:57.602097 29837 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:10:57.651196 29878 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:57.652153 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 52127.7us
I20260709 12:10:57.753226 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:57.755079 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:57.593858 29872 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:10:57.638037 29891 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:10:57.625761 29818 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.648336 29888 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:57.598919 29864 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.681463 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:57.673142 29850 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:57.770680 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 89361.5us
I20260709 12:10:57.682650 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:57.620064 29749 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:57.699144 29492 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:57.699430 29871 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:10:57.700057 29874 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.387s	user 0.004s	sys 0.000s
I20260709 12:10:57.678598 29829 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:57.701355 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 104639us
I20260709 12:10:57.595124 29845 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:57.644923 29808 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.624307 29870 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:10:57.617259 29862 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:10:57.679324 29682 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:57.759276 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:57.801848 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:10:57.806178 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47043.4us
I20260709 12:10:57.806627 29900 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.807057 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:57.807243 29900 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:10:57.807703 29900 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.678160 29606 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:57.771238 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 192114us
W20260709 12:10:57.774611 29902 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.081s	user 0.000s	sys 0.003s
I20260709 12:10:57.782086 29708 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:57.813455 29845 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:57.813637 29682 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:57.814409 29871 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:57.768239 29818 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.785086 29748 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:57.786537 29864 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:57.765904 29869 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.792825 29859 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:57.794651 29828 consensus_meta.cc:287] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.006s
I20260709 12:10:57.773032 29888 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:57.777483 29745 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.752463 29878 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.764317 29599 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:57.850726 29863 consensus_meta.cc:287] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.643s	user 0.003s	sys 0.010s
I20260709 12:10:57.749615 29448 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:57.851290 29863 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:57.851862 29448 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:57.852350 29606 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:57.824364 29849 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:57.853602 29896 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 12:10:57.853993 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.808318 29877 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:10:57.810086 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:57.856046 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 46035.6us
I20260709 12:10:57.857863 29764 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:57.808387 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:57.809172 29665 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:57.859038 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 50744.5us
I20260709 12:10:57.859230 29665 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:57.859370 29719 raft_consensus.cc:3055] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:57.859874 29665 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.859917 29719 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:57.860484 29665 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.860975 29719 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:57.816349 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:57.799546 29837 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.862856 26620 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:10:57.863601 27134 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:57.815517 29461 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:57.862193 29719 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.870229 27162 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:57.744621 29867 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:57.804246 29808 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.871930 27160 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:57.872857 29837 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:57.873319 29837 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.787075 29597 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:57.876293 29597 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:57.874780 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:57.810932 29832 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:57.832625 29869 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:57.827147 29862 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:10:57.841850 29864 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:57.842561 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:57.844120 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:57.860406 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:57.896027 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:57.897616 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:57.803448 29850 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.790040 29269 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:57.862900 26545 raft_consensus.cc:2368] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8.
I20260709 12:10:57.850953 29878 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:57.865341 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.866240 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.866953 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:57.496945 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 119389us
I20260709 12:10:57.909180 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:57.868021 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:57.851003 29599 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.909907 29752 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:57.910614 29599 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.837666 29711 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:57.916035 29711 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:57.877259 29828 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:57.918049 29828 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:57.892891 26514 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:57.894214 26618 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:57.842561 29736 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:57.903832 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.931514 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:57.891646 29832 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:57.827832 29845 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:10:57.863992 29764 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:57.826352 29626 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:57.925930 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:57.932581 26542 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:10:57.933743 27133 leader_election.cc:400] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 4 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5.
I20260709 12:10:57.906577 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:57.925627 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:57.902498 29492 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.907523 29830 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.950380 27133 leader_election.cc:400] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9.
I20260709 12:10:57.919350 29864 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:57.957279 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 50820.6us
I20260709 12:10:57.960635 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:57.961285 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:57.956596 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:57.961943 26548 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:10:57.962937 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:57.962831 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:57.962754 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:57.963812 26544 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 4.
I20260709 12:10:57.964411 26540 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:57.963883 26548 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 8: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:57.949142 29606 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:57.965559 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:57.894181 29869 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.964329 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:57.970464 26540 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:58.029161 26547 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:10:57.919827 29872 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.950614 29752 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:57.951177 29832 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.947670 29653 consensus_queue.cc:1059] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:10:57.931937 27159 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
W20260709 12:10:58.028276 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.927585 29597 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.950527 29849 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:58.028131 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 59144.3us
I20260709 12:10:57.927863 29595 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:58.034813 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:57.955533 29492 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:57.956858 29736 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.990680 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:57.967213 29711 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:58.045166 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:58.031195 26547 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:10:58.069980 26547 pending_rounds.cc:85] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 4
I20260709 12:10:58.070309 26547 pending_rounds.cc:107] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:10:58.070669 26547 raft_consensus.cc:2889] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.071173 26547 pending_rounds.cc:107] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:10:58.071458 26547 raft_consensus.cc:2889] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.045490 26540 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:10:58.047819 26544 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.050307 29863 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:57.973982 29828 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:58.026968 29905 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:10:57.973421 29606 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.968091 29830 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:58.075451 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:58.068693 26548 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 7: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:10:58.085788 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 57998.6us
I20260709 12:10:58.059154 29859 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:57.970229 29864 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:58.095290 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:58.065629 29492 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.096814 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:58.096769 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:58.098377 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:58.098203 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:58.133128 26466 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.105931 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:58.099495 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:58.135434 26548 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
W20260709 12:10:58.100190 26514 leader_election.cc:336] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Timed out: RequestConsensusVote RPC to 127.24.179.68:35069 timed out after 1.713s (SENT)
I20260709 12:10:58.066002 29736 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.070547 29597 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:58.080940 29875 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.138134 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:58.087751 29606 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.138231 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:58.146883 26470 raft_consensus.cc:2410] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:58.136989 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:58.148736 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 48589.5us
I20260709 12:10:58.149940 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:58.139500 26464 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 5: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:58.078574 29828 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:58.100996 29752 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:58.099608 29863 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:58.142709 26544 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:10:58.133229 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:58.141958 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:58.156072 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:58.157200 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:58.231098 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:58.138868 29736 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.235292 26465 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:58.235294 26544 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.166601 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:58.164701 26466 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:10:58.240250 26470 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 10: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:58.232586 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:58.241180 26548 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:10:58.151252 29597 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:58.151542 29748 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:58.277634 29682 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.285746 29682 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:58.258270 26548 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:58.161917 29745 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:58.290446 29682 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:58.289146 29745 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:58.232967 29905 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:10:58.292514 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1858) took 1613 ms. Trace:
I20260709 12:10:58.162117 29828 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.293085 26545 rpcz_store.cc:276] 0709 12:10:56.679801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.366678 (+686877us) service_pool.cc:224] Handling call
0709 12:10:58.292289 (+925611us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b5400106dd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:58.292453 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127770368}
I20260709 12:10:58.245527 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:58.299717 26473 raft_consensus.cc:2410] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 14 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:10:58.238452 29863 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:58.302852 26543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1828) took 1705 ms (client timeout 1548 ms). Trace:
W20260709 12:10:58.303422 26543 rpcz_store.cc:269] 0709 12:10:56.597845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.598503 (+   658us) service_pool.cc:224] Handling call
0709 12:10:58.302538 (+1704035us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54002369d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:58.302750 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1849113856}
I20260709 12:10:58.303980 29863 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:58.307650 26622 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:58.152760 29859 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:58.280298 26546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1852) took 1655 ms (client timeout 2085 ms). Trace:
W20260709 12:10:58.315920 26615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 1954) took 2169 ms (client timeout 1511 ms). Trace:
W20260709 12:10:58.316427 26615 rpcz_store.cc:269] 0709 12:10:56.138300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.140097 (+  1797us) service_pool.cc:224] Handling call
0709 12:10:58.307109 (+2167012us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400194e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:58.307330 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2799283456}
W20260709 12:10:58.316218 26546 rpcz_store.cc:269] 0709 12:10:56.625922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.914661 (+288739us) service_pool.cc:224] Handling call
0709 12:10:58.280020 (+1365359us) spinlock_profiling.cc:243] Waited 71.2 ms on lock 0x7b5400110dd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:58.280203 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163811072}
I20260709 12:10:58.094878 29764 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:58.305593 29745 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.315435 29269 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:58.328620 26544 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:10:58.339591 29712 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:58.379510 29712 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:58.380333 29830 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:58.380546 29712 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:58.381690 29712 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.336335 29838 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:10:58.385625 29864 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:58.386855 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1833) took 1779 ms. Trace:
W20260709 12:10:58.343930 29907 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 12:10:58.345358 29708 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:58.349485 29849 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:58.353178 29888 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:58.361575 29595 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:58.367910 29904 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.320s	user 0.002s	sys 0.000s
I20260709 12:10:58.367595 29871 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:58.368760 29841 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:58.369807 29711 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:58.442811 29711 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:58.444155 29711 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:58.445765 29711 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.330891 29597 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:58.354249 29900 consensus_meta.cc:287] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.000s
I20260709 12:10:58.336900 29626 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:58.394958 29818 consensus_meta.cc:287] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.003s
W20260709 12:10:58.428687 29665 consensus_meta.cc:287] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.568s	user 0.011s	sys 0.000s
W20260709 12:10:58.397197 29837 consensus_meta.cc:287] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.003s
I20260709 12:10:58.436280 29869 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:58.404922 29719 consensus_meta.cc:287] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.535s	user 0.011s	sys 0.000s
I20260709 12:10:58.397351 29849 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:58.403016 29808 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.000s
I20260709 12:10:58.457239 29837 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:58.459450 29851 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.156s	user 0.021s	sys 0.039s
I20260709 12:10:58.473045 29872 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:58.446960 29900 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:58.485869 29900 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:10:58.491863 29878 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.561s	user 0.011s	sys 0.002s
I20260709 12:10:58.492799 29878 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:58.499289 29878 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:58.534703 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.536186 26464 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 7: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:58.244563 26468 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:10:58.536777 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:58.387446 26539 rpcz_store.cc:276] 0709 12:10:56.607507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.204254 (+596747us) service_pool.cc:224] Handling call
0709 12:10:58.386531 (+1182277us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54003377d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:58.386738 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1032411904}
I20260709 12:10:58.538571 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:58.540156 26470 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:58.540587 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:58.389006 26541 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:58.541877 26471 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:58.365947 26588 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:58.356254 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2621) took 2024 ms. Trace:
I20260709 12:10:58.456920 29818 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:58.558911 26622 rpcz_store.cc:276] 0709 12:10:56.331381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.331525 (+   144us) service_pool.cc:224] Handling call
0709 12:10:58.307328 (+1975803us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.308301 (+   973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.355969 (+ 47668us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b5400194e50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:58.356152 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4479312256}
I20260709 12:10:58.461352 29808 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:58.568608 29745 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:58.495599 29869 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:58.544004 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 394007us
I20260709 12:10:58.544339 26547 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:58.456260 29665 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:58.574958 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 341020us
I20260709 12:10:58.541921 26467 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:10:58.577828 26473 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:10:58.461027 29752 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:58.579288 26619 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 8: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:10:58.466436 29867 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.011s	sys 0.004s
W20260709 12:10:58.557857 26620 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.002s	sys 0.009s
W20260709 12:10:58.466089 29851 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.163s	user 0.022s	sys 0.039s
I20260709 12:10:58.599291 26618 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:58.585970 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:58.454229 29599 consensus_meta.cc:287] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.543s	user 0.014s	sys 0.000s
W20260709 12:10:58.579599 29448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.005s	sys 0.007s
W20260709 12:10:58.607796 26620 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.003s	sys 0.009s
I20260709 12:10:58.610369 29599 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:58.615089 29599 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:58.615935 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1842) took 2006 ms. Trace:
W20260709 12:10:58.616850 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 250839us
I20260709 12:10:58.617049 29841 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:58.617844 29841 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.618484 29841 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.619096 26544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:58.620357 26544 raft_consensus.cc:606] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:58.620934 26544 raft_consensus.cc:614] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:58.623561 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:58.624796 26469 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:10:58.601382 29837 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:58.616612 26541 rpcz_store.cc:276] 0709 12:10:56.609702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.446596 (+836894us) service_pool.cc:224] Handling call
0709 12:10:58.388187 (+941591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.542339 (+154152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.615369 (+ 73030us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b54003377d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:58.615648 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2122794752}
W20260709 12:10:58.628726 29448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.005s	sys 0.007s
I20260709 12:10:58.633927 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:58.639855 29764 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:58.575980 29828 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:58.640093 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:58.649952 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:58.652980 26473 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.655045 26622 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:58.660414 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.660627 29895 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.664023 26469 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:58.664582 26544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:10:58.666023 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:58.660682 26613 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
W20260709 12:10:58.666714 26587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.000s	sys 0.022s
W20260709 12:10:58.667215 29867 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.012s	sys 0.004s
I20260709 12:10:58.662619 29665 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:58.662501 29895 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:58.678817 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:58.679617 29895 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:58.680002 26469 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 7: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:58.681041 26467 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.672945 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:58.673348 29752 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:58.686082 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:58.686179 29917 raft_consensus.cc:2764] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:10:58.669438 26544 raft_consensus.cc:606] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
W20260709 12:10:58.674492 26587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.000s	sys 0.023s
I20260709 12:10:58.693207 26544 raft_consensus.cc:614] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:58.692322 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:58.713881 29808 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:58.723795 29828 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:58.699542 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 874029us
I20260709 12:10:58.733498 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2640) took 1051 ms. Trace:
I20260709 12:10:58.733807 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:58.734105 26614 rpcz_store.cc:276] 0709 12:10:57.681695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.682256 (+   561us) service_pool.cc:224] Handling call
0709 12:10:58.733048 (+1050792us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b5400196754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:58.733292 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2080239488}
I20260709 12:10:58.735049 29867 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:58.735587 29867 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:58.734697 29736 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:58.736009 29867 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.739259 27163 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:10:58.691416 29818 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:58.676338 29851 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:58.748431 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:58.749320 26471 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:58.750850 29930 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.249s	user 0.001s	sys 0.001s
I20260709 12:10:58.749325 29851 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:58.763300 26366 catalog_manager.cc:5697] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 3 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 4 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:58.772258 26471 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:10:58.776564 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:58.789220 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:58.790803 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 205211us
I20260709 12:10:58.791342 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:58.794721 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:58.794299 26366 catalog_manager.cc:5697] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 5 to 6, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 6 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:58.800217 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:58.800928 26366 catalog_manager.cc:5697] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:58.782747 29736 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:58.802521 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:58.807307 29745 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:58.809760 26614 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:10:58.811189 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:58.822875 26467 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:10:58.824524 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:58.824847 26464 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:10:58.829278 26471 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:10:58.830219 26466 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.830914 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:58.831584 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:58.821360 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:58.842275 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:58.842779 26613 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:58.843539 26622 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:10:58.843878 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:58.854596 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:10:58.858640 29931 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.168s	user 0.002s	sys 0.000s
I20260709 12:10:58.831975 27159 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:58.870422 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:58.876087 26471 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:10:58.880801 26464 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:58.872666 26366 catalog_manager.cc:5697] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 4 to 5, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 5 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:10:58.870112 29818 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:10:58.886077 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:58.868595 29926 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.895813 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:58.892513 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:58.900028 26464 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:58.900769 26473 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:58.896806 29808 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.904317 29808 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:58.907740 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:58.911923 29712 consensus_meta.cc:287] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.506s	user 0.015s	sys 0.010s
I20260709 12:10:58.912807 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:58.916251 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:58.920994 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.922727 29847 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:58.923434 29847 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:58.924602 29847 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:58.931322 29606 consensus_meta.cc:287] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.772s	user 0.014s	sys 0.005s
I20260709 12:10:58.932186 29926 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:58.950908 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.953234 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:58.908378 29841 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:58.962030 26371 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39184 (request call id 158) took 10710 ms. Trace:
I20260709 12:10:58.956651 26366 catalog_manager.cc:5697] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:58.914240 29818 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:10:58.971092 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:58.962126 29808 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:58.980239 29492 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.819s	user 0.013s	sys 0.008s
I20260709 12:10:58.980898 29492 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:58.981480 29926 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:58.946969 29606 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:58.980324 29900 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:10:58.989543 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 76936.7us
I20260709 12:10:58.991421 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:58.997809 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.992053 29832 consensus_meta.cc:287] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.837s	user 0.015s	sys 0.008s
I20260709 12:10:58.986994 29900 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:59.001223 26622 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:59.007493 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:59.009953 26366 catalog_manager.cc:5697] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:59.018275 29934 log.cc:927] Time spent T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.135s	user 0.002s	sys 0.000s
I20260709 12:10:59.020195 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:58.964744 26371 rpcz_store.cc:276] 0709 12:10:48.251634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.252045 (+   411us) service_pool.cc:224] Handling call
0709 12:10:58.961775 (+10709730us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:55.949632 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:55.955579 (+  5947us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:55.955631 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:10:55.955652 (+    21us) tablet.cc:662] Decoding operations
0709 12:10:55.975964 (+ 20312us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:55.978037 (+  2073us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:55.982640 (+  4603us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:10:56.047715 (+ 65075us) tablet.cc:701] Row locks acquired
0709 12:10:56.047753 (+    38us) write_op.cc:260] PREPARE: finished
0709 12:10:56.047942 (+   189us) write_op.cc:270] Start()
0709 12:10:56.048073 (+   131us) write_op.cc:276] Timestamp: P: 1783599056047866 usec, L: 0
0709 12:10:56.048090 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:10:56.129482 (+ 81392us) log.cc:844] Serialized 6665 byte log entry
0709 12:10:56.781864 (+652382us) op_driver.cc:464] REPLICATION: finished
0709 12:10:57.374853 (+592989us) write_op.cc:301] APPLY: starting
0709 12:10:57.374948 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:57.375323 (+   375us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:57.375459 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:57.620788 (+245329us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:57.621258 (+   470us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 12:10:57.621336 (+    78us) write_op.cc:312] APPLY: finished
0709 12:10:57.621865 (+   529us) log.cc:844] Serialized 119 byte log entry
0709 12:10:57.622116 (+   251us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:57.622371 (+   255us) write_op.cc:454] Released schema lock
0709 12:10:57.633943 (+ 11572us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:57.650936 (+ 16993us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:57.650973 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1527884,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":592666,"apply.run_cpu_time_us":7538,"apply.run_wall_time_us":276022,"num_ops":17,"prepare.queue_time_us":540897,"prepare.run_cpu_time_us":20379,"prepare.run_wall_time_us":465878,"raft.queue_time_us":116282,"raft.run_cpu_time_us":23581,"raft.run_wall_time_us":602505,"replication_time_us":733602,"thread_start_us":998233,"threads_started":4,"wal-append.queue_time_us":474191,"wal-append.run_cpu_time_us":30468,"wal-append.run_wall_time_us":1978743}]]}
W20260709 12:10:59.029086 29933 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:10:59.030467 29605 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:10:59.030831 27134 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:59.032214 27134 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:59.032598 29605 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:59.033181 29605 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:59.033654 29605 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.036775 29838 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.037447 29838 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:59.037509 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:59.034060 29917 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:59.046515 26466 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:10:59.038108 29838 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.045485 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:59.048496 27165 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:59.053010 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:59.058269 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:59.058586 29900 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:59.060206 29900 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.061935 29764 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:59.062996 29841 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:59.067052 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:59.065649 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:59.011509 29832 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:59.078832 29926 raft_consensus.cc:2764] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:10:59.082454 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:59.083822 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:10:59.084482 29850 consensus_meta.cc:287] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.178s	user 0.012s	sys 0.010s
I20260709 12:10:59.085285 29850 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:10:59.088440 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 65403.2us
I20260709 12:10:59.090265 29858 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:59.093700 29711 consensus_meta.cc:287] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.647s	user 0.014s	sys 0.003s
W20260709 12:10:59.094544 29935 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.184s	user 0.000s	sys 0.002s
I20260709 12:10:59.058347 29752 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:10:59.098038 26472 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 6: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:59.099025 29832 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:59.099721 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2732) took 1001 ms. Trace:
I20260709 12:10:59.075843 29917 raft_consensus.cc:697] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:59.100157 26472 rpcz_store.cc:276] 0709 12:10:58.098027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.098141 (+   114us) service_pool.cc:224] Handling call
0709 12:10:59.099460 (+1001319us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b54000dcad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:10:59.099644 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2219025152}
W20260709 12:10:59.101580 26438 leader_election.cc:336] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.085s (SENT)
I20260709 12:10:59.102114 26438 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:59.104367 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:59.104809 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:59.105947 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:59.106240 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:59.106982 29878 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.107306 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:59.107533 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:59.107847 29878 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:10:59.108348 29878 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.108726 29878 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:10:59.109757 29448 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:59.100895 29605 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:59.111696 29448 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:59.113169 29818 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:59.117892 29818 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:59.083910 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 88618.5us
I20260709 12:10:59.134469 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:10:59.140525 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 107153us
I20260709 12:10:59.118377 29818 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:59.130460 29808 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:59.080927 29745 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:59.130692 29492 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:59.165041 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:59.168918 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:59.169703 26622 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.170584 29818 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:59.171886 29818 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.175263 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:59.186424 26622 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:10:59.160849 29808 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:59.133212 29867 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:59.195716 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 112375us
I20260709 12:10:59.184001 29837 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.101504 29917 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:59.204520 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:59.205549 26513 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:59.206609 29745 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:59.207396 29922 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:59.209800 29736 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.212803 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:59.193084 29808 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:59.254904 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:10:59.263399 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.189967 29851 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:59.263284 26614 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:59.194167 29606 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:59.190308 29492 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:59.270910 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 52965.5us
W20260709 12:10:59.271042 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 51397.7us
W20260709 12:10:59.279989 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 182394us
I20260709 12:10:59.198340 29828 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:59.198151 29605 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:59.285113 26472 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:10:59.200342 29764 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:59.305751 29932 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.407s	user 0.004s	sys 0.000s
I20260709 12:10:59.273661 29736 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:59.219422 29941 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:59.325404 29941 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:59.326642 29941 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:59.327993 29941 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.306632 29828 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:59.307436 29448 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:59.331838 29448 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:59.332929 29448 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:59.268929 29851 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:59.335208 29851 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:59.336364 29851 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.273530 29745 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:59.311061 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 168118us
I20260709 12:10:59.312899 26466 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:59.322793 29764 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:59.284166 29492 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.324399 29878 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:59.284425 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:59.316129 29832 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:59.352993 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 46184.7us
W20260709 12:10:59.352660 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 152136us
I20260709 12:10:59.283540 29837 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:59.347509 29492 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.366518 29828 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:59.367297 29828 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:59.368227 29828 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:59.368986 29828 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:59.371212 29828 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:59.374498 29828 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.375847 29745 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:59.377676 29736 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:59.359923 29606 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:10:59.395259 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.397641 29878 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:59.398488 29752 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:10:59.398882 26618 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.399175 29752 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:59.400101 29888 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.400653 29888 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:59.401495 29922 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:59.402014 26470 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.403940 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:59.404798 26618 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 8: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:10:59.404716 29867 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:59.405881 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:59.406189 29888 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:10:59.402011 29922 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.408545 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:59.410305 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:10:59.411618 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 206318us
W20260709 12:10:59.413350 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 51740.4us
I20260709 12:10:59.418802 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:10:59.358340 29832 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:59.400596 29849 consensus_meta.cc:287] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.900s	user 0.014s	sys 0.004s
I20260709 12:10:59.388168 27159 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:10:59.401716 29752 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:59.427902 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:59.419229 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:59.429050 29711 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:59.444734 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:59.446741 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:59.447616 27166 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.448526 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:59.420680 29888 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:10:59.451376 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:59.440533 29878 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:10:59.438419 29849 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:59.456764 29849 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:59.460665 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:59.441643 29711 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:59.463039 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:59.455188 29832 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:59.475901 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:59.476732 26467 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:10:59.478886 29764 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:59.479301 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:59.480988 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:59.482908 29952 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:59.474125 29878 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:59.484618 26467 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:10:59.485308 26467 pending_rounds.cc:85] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 7
I20260709 12:10:59.485622 26467 pending_rounds.cc:107] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:10:59.485927 26467 raft_consensus.cc:2889] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:59.484505 29837 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:59.495463 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.494467 26588 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:10:59.465015 29711 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.491932 26439 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:10:59.464821 29888 consensus_queue.cc:1243] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:59.495576 29878 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:59.518867 29878 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:59.511442 29867 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:10:59.503132 29448 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:59.512418 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 85910.3us
W20260709 12:10:59.526629 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 90610.4us
I20260709 12:10:59.532311 29947 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:59.532366 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:59.537117 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 45274.3us
I20260709 12:10:59.538311 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:59.539052 26438 leader_election.cc:400] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8.
I20260709 12:10:59.539443 26438 leader_election.cc:403] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:59.532954 29832 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.525138 29448 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.552834 29878 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8.
I20260709 12:10:59.508366 29838 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:59.554982 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:59.557534 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:10:59.582841 27165 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:59.558635 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:59.583688 29950 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.140s	user 0.002s	sys 0.000s
I20260709 12:10:59.584874 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:10:59.585692 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:59.550891 29448 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.586658 29764 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:59.587621 29764 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.587350 29492 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:59.588094 29764 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:59.588557 29764 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.589805 29492 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:59.589993 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:59.558815 26618 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:59.559422 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:59.592329 26544 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.592391 29867 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:59.560963 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:59.561297 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:59.542222 29832 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:59.550683 29837 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.597975 29837 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:59.599423 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:59.600087 26547 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.600993 29808 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:59.602304 26466 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:59.562503 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:59.562860 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:10:59.565151 29922 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:10:59.567199 29956 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:10:59.611060 29922 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:59.614346 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:10:59.614712 27168 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:59.615867 29808 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:59.571496 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:10:59.550683 29952 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:59.575773 26616 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:59.560509 26439 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:10:59.579850 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 67149.6us
I20260709 12:10:59.534073 29947 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:10:59.586707 26541 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 8: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:59.586105 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:59.578260 26617 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:10:59.604696 26619 raft_consensus.cc:2410] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:59.608780 26613 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:10:59.647594 27162 raft_consensus.cc:2410] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:10:59.620165 26547 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:10:59.604427 29858 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:59.595582 29838 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:10:59.658154 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.652945 29858 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:59.660434 29858 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:59.661885 29858 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.662564 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:59.663334 26539 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.663964 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:59.664844 26543 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 8: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:10:59.665871 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:59.666836 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:59.667213 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:59.667665 26547 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.668031 26545 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:10:59.668213 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:59.668377 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:59.668790 26540 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.669070 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:59.669651 26545 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.669772 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:59.670511 29606 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:10:59.670989 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:10:59.671655 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.669642 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:59.672694 26546 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.671672 26542 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.675735 29837 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:59.677122 29448 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:59.678651 26541 raft_consensus.cc:2376] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8. Re-sending same reply.
I20260709 12:10:59.679279 26543 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:10:59.682896 29947 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:59.684427 29947 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.684906 26539 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
W20260709 12:10:59.687186 29959 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:10:59.689670 26544 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
W20260709 12:10:59.690847 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 130427us
I20260709 12:10:59.693681 26547 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:10:59.648173 29832 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.648465 29952 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:10:59.700634 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 51035.7us
W20260709 12:10:59.667941 29962 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 12:10:59.697587 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.625568 29492 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:10:59.707228 29878 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:59.716028 29878 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:59.716441 29878 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:10:59.717257 29878 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:59.708106 29961 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.718829 29961 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:59.719292 27160 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:10:59.721287 29961 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:10:59.722178 26466 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:59.725535 29952 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:59.708736 29838 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:59.667230 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:10:59.736464 26548 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:59.710023 29960 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:10:59.643265 29867 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 12:10:59.739346 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.740283 29818 raft_consensus.cc:3055] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:59.710758 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 124814us
I20260709 12:10:59.740895 29818 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:10:59.741425 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:59.742903 26513 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:59.742419 29818 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:59.744441 29818 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.745375 29606 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:59.746073 29606 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:59.746335 29828 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:59.747210 29828 raft_consensus.cc:697] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:10:59.747078 29606 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:10:59.748593 29828 consensus_queue.cc:237] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:10:59.752032 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.769168 27166 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:10:59.754841 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:59.756639 26470 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:59.757121 26465 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:59.756079 26471 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.756374 26466 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:59.759567 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 57587.2us
I20260709 12:10:59.755813 26542 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:10:59.761687 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:59.752779 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:10:59.777397 26539 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:10:59.760306 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:10:59.768368 26543 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:10:59.764377 26545 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:10:59.750329 26540 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:10:59.694056 29711 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:59.768143 26546 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
W20260709 12:10:59.782585 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 82444.4us
I20260709 12:10:59.744767 26513 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:59.783957 26544 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:59.787798 26469 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 9: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:10:59.804177 26473 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:59.805989 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.789680 29878 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.798564 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:10:59.818424 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 73726us
I20260709 12:10:59.759406 29867 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:10:59.804059 29837 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:59.821254 26514 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:10:59.824807 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:10:59.825855 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.826927 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:59.828788 26464 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:59.839757 26539 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:10:59.841980 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:10:59.851826 26617 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:10:59.856832 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:59.858032 29736 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.858592 29736 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:10:59.858986 29736 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.860687 29764 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:10:59.862735 29951 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.859246 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:59.826254 29837 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.877575 26466 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 12:10:59.881279 26464 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.882807 26548 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:10:59.884722 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:10:59.885565 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.886719 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 72708.7us
I20260709 12:10:59.862682 29745 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.889902 26473 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:10:59.891968 26471 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:10:59.892757 29764 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:10:59.894793 26465 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:10:59.897296 26541 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:59.896664 29832 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.903363 26513 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:10:59.882071 29837 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.888779 29828 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.888585 29745 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:10:59.921093 29745 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.921216 26472 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:59.923187 26468 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:59.916422 29764 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.927824 29711 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:59.928419 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.986577 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 84432.3us
I20260709 12:10:59.914297 29448 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:10:59.991461 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 74184.4us
I20260709 12:10:59.994910 26514 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:10:59.998274 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 94998.9us
I20260709 12:10:59.999558 29828 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.003814 29828 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:00.007972 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:00.008693 29764 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.010272 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.006207 29828 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:00.011739 29764 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:00.012334 29764 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:00.015383 26543 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:00.035804 26473 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:11:00.045538 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 46233.7us
I20260709 12:11:00.045984 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.046885 26465 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:00.051098 26539 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:00.013322 29764 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:00.060007 26539 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:00.035461 29832 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.029121 29838 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:11:00.057421 26513 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.050182 29952 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:00.065378 26466 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:00.068768 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.056277 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:11:00.070133 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 62229.6us
I20260709 12:11:00.071622 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:00.072376 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:00.069693 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:00.078354 26473 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:00.059830 29711 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.081593 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.085230 29961 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.085772 29961 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:00.087944 29961 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:00.088665 26544 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 12:11:00.089129 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:00.089958 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:00.090324 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:00.091586 29828 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:00.090957 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:00.092293 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:00.066533 29832 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:00.092509 29828 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:00.093075 26541 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 8: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:00.090642 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:00.093520 29828 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:00.094028 29951 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:00.094143 26619 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:00.094790 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.096139 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.089164 26543 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:00.097294 26546 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:11:00.098378 26466 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:00.082383 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:00.103186 26620 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:00.107703 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.110710 26540 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:00.117369 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:00.122989 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.118289 26613 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:11:00.129554 26466 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:11:00.125463 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:00.131956 26471 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.133845 26473 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:00.136345 29838 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:00.099738 29832 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:00.096859 27160 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:00.139288 29492 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.139866 29492 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:00.124945 29957 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.141119 29957 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:00.142241 29492 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:00.138710 29952 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:00.144891 29952 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:00.145895 29952 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:00.126097 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:00.151156 26468 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 8: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:00.156042 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:00.158607 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 104712us
I20260709 12:11:00.161062 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:00.198722 26469 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:00.199854 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.114573 29951 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:00.162143 26546 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.132565 29606 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:00.212989 29606 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:00.213536 29606 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.213912 29606 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:00.214617 26588 consensus_peers.cc:597] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fce5ecc0a3714c80861557f318edce9d. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:00.215124 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 55128.1us
I20260709 12:11:00.217020 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:00.217940 27166 raft_consensus.cc:2410] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:11:00.218025 29957 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:00.218518 29832 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:00.219141 26468 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:00.222131 29837 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:00.224692 29837 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:00.227254 26473 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:00.228184 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:00.229126 26465 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:00.231349 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:00.239077 26539 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
W20260709 12:11:00.240422 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 144213us
W20260709 12:11:00.282780 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.288386 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:00.289570 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.290441 27168 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:00.292398 26467 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
W20260709 12:11:00.293947 29974 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.226s	user 0.003s	sys 0.000s
I20260709 12:11:00.297063 29745 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:00.298571 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 142621us
I20260709 12:11:00.300208 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.300236 29808 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:00.300634 26439 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:00.303151 26548 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:00.306039 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.307103 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:00.205008 29951 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:00.310981 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:00.307125 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:00.317118 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.336573 26546 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
W20260709 12:11:00.339610 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 51488.2us
I20260709 12:11:00.345245 26471 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:11:00.306857 29492 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:00.341437 27165 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:00.341531 26541 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:00.343874 26617 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:00.347142 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:00.351603 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.357591 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 234689us
I20260709 12:11:00.359197 26539 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 12:11:00.360867 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:00.371151 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:00.373256 26439 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:00.356691 29947 consensus_meta.cc:287] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.672s	user 0.012s	sys 0.004s
I20260709 12:11:00.371942 26613 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:00.317126 29851 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.378760 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.380887 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:00.382830 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 286785us
I20260709 12:11:00.382077 29957 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:00.318547 29951 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:00.357009 29492 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.357297 29878 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:00.387669 26615 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:00.390061 26619 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:11:00.390059 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.396330 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:00.396351 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:00.396742 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:00.398521 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.395260 26619 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:00.403601 26438 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:00.402148 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:00.363698 29837 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:00.407976 26541 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: [11.9-13.10]
I20260709 12:11:00.410104 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:00.356715 29961 consensus_queue.cc:1059] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 12:11:00.438942 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 128085us
I20260709 12:11:00.389211 29957 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.435667 26621 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:00.436569 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:00.439801 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:00.440574 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55487.4us
W20260709 12:11:00.434760 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 117502us
I20260709 12:11:00.441851 26621 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:00.404793 29867 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:00.454011 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.372262 29926 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:11:00.405498 29448 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:00.451148 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:00.444921 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 46544us
I20260709 12:11:00.450261 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:00.458035 26543 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:00.458643 26513 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.395094 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:00.462931 26541 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 12:11:00.410557 29947 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:00.436002 29711 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.414427 29828 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:00.399712 29980 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:00.464629 26542 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:11:00.466187 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:00.466464 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 64451.2us
I20260709 12:11:00.473193 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:00.442243 29878 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:00.473814 26544 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.471144 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:00.399821 29492 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.473306 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:00.451911 29992 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:00.467193 26619 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:00.470372 29736 consensus_meta.cc:287] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.004s
I20260709 12:11:00.533634 26514 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:00.453677 29957 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:00.451047 29952 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:00.529014 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 118964us
I20260709 12:11:00.530980 26619 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:00.526489 26540 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:00.457188 29808 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.542799 29982 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:00.471882 29947 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.543515 29983 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:00.543951 29947 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.541736 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.442714 29837 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:00.555225 29982 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.558934 29982 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:00.561228 29982 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:00.546144 29952 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:00.575047 29952 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:00.575296 29984 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:11:00.535862 29832 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:11:00.583693 29832 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:00.584213 29832 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:00.585314 29832 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:00.588066 26540 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:00.588460 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:00.589680 26548 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:00.590835 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:00.590306 26542 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:00.591497 26548 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:00.592046 29990 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:00.592505 29448 raft_consensus.cc:697] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:00.595134 26547 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260709 12:11:00.595995 29711 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:00.596415 29711 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.596779 29711 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.474402 27159 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:11:00.508347 29878 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.600239 29878 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.539899 29980 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:00.534533 29992 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.602917 29992 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.603353 26542 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:00.605041 29980 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:00.539929 29841 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:00.555774 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:00.527083 29764 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:00.608996 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 53367.2us
I20260709 12:11:00.591121 26543 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:00.610235 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 101533us
I20260709 12:11:00.606859 29841 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:00.455891 29987 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 12:11:00.618635 29979 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:11:00.546128 29736 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:00.619706 26547 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:00.627071 26544 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:00.508020 29828 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:00.658984 26540 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:00.532132 29996 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:00.674571 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.658668 26621 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:00.636209 26542 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:00.621299 29985 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:00.673084 29987 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:00.673480 26543 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:00.632071 29838 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:11:00.677066 26619 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:11:00.685922 26621 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.630676 26548 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
W20260709 12:11:00.680794 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 56635.5us
I20260709 12:11:00.620666 29764 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.700748 26545 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:11:00.658224 29837 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:00.593851 29448 consensus_queue.cc:237] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:00.558130 29745 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:00.703989 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 80556.2us
I20260709 12:11:00.704880 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.707221 26621 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:00.703213 29851 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:11:00.703711 29764 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.718596 29837 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:00.719313 29837 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:00.689868 29987 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.720288 29987 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.721714 29837 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:00.723726 29961 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:00.724179 29961 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:00.727263 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.728616 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.732064 29828 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:00.731910 29961 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:00.733678 29961 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.736220 29979 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:00.736827 29979 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:11:00.742264 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.744573 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 286034us
W20260709 12:11:00.745012 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.747004 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.618384 27160 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:11:00.556716 29900 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.146s
I20260709 12:11:00.734162 29736 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:00.692312 29832 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.737768 29979 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:00.759900 26543 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:00.766219 29745 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.767787 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.768739 29745 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:00.769258 29745 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:00.770188 29745 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:00.773095 26513 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.776672 26541 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:00.777156 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.775144 26368 catalog_manager.cc:5697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:00.770068 26366 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57048 (request call id 301) took 22101 ms (client timeout 15000 ms). Trace:
W20260709 12:11:00.755859 29606 consensus_meta.cc:287] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.000s
I20260709 12:11:00.790879 26368 catalog_manager.cc:5697] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:00.797550 29764 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:00.800102 29764 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:00.800849 29764 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:00.801446 29764 raft_consensus.cc:697] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:00.802793 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:00.802569 29764 consensus_queue.cc:237] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:00.806478 29841 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:00.807859 29841 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.806010 26368 catalog_manager.cc:5697] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:00.751619 30000 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:00.811679 29837 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:00.812433 29837 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:00.802174 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:00.811111 26368 catalog_manager.cc:5697] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 2 to 4, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 4 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:00.782984 26366 rpcz_store.cc:269] 0709 12:10:38.669050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.669344 (+   294us) service_pool.cc:224] Handling call
0709 12:11:00.769930 (+22100586us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:59.175046 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:59.175756 (+   710us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:59.175807 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:10:59.175836 (+    29us) tablet.cc:662] Decoding operations
0709 12:10:59.176893 (+  1057us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:59.177006 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:59.177052 (+    46us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:10:59.177821 (+   769us) tablet.cc:701] Row locks acquired
0709 12:10:59.177881 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:10:59.178092 (+   211us) write_op.cc:270] Start()
0709 12:10:59.178305 (+   213us) write_op.cc:276] Timestamp: P: 1783599059178015 usec, L: 0
0709 12:10:59.178338 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:10:59.320513 (+142175us) log.cc:844] Serialized 2477 byte log entry
0709 12:10:59.428031 (+107518us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5072fd00ac 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b
0709 12:10:59.798546 (+370515us) op_driver.cc:464] REPLICATION: finished
0709 12:11:00.067321 (+268775us) write_op.cc:301] APPLY: starting
0709 12:11:00.068691 (+  1370us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:00.071406 (+  2715us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:00.071443 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:00.197715 (+126272us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:00.204325 (+  6610us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:11:00.210811 (+  6486us) write_op.cc:312] APPLY: finished
0709 12:11:00.211252 (+   441us) log.cc:844] Serialized 53 byte log entry
0709 12:11:00.211484 (+   232us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:00.211613 (+   129us) write_op.cc:454] Released schema lock
0709 12:11:00.211679 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:00.212216 (+   537us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:00.212248 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":29827,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":235122,"apply.run_cpu_time_us":4109,"apply.run_wall_time_us":153888,"num_ops":6,"prepare.queue_time_us":113378,"prepare.run_cpu_time_us":49476,"prepare.run_wall_time_us":331662,"raft.queue_time_us":154979,"raft.run_cpu_time_us":25907,"raft.run_wall_time_us":147220,"replication_time_us":587447,"spinlock_wait_cycles":39352704,"thread_start_us":334550,"threads_started":4,"wal-append.queue_time_us":164035}]]}
I20260709 12:11:00.822552 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:00.750095 29951 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:00.753753 29711 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:00.832520 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 358186us
I20260709 12:11:00.836817 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:00.838333 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 379355us
I20260709 12:11:00.846089 26368 catalog_manager.cc:5697] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 5 to 6, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 6 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:00.845485 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.860060 26546 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:00.871775 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.874768 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.876854 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.817281 29606 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:00.881947 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 176117us
I20260709 12:11:00.883570 26588 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:00.892071 26548 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 12:11:00.898001 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.908425 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 179888us
I20260709 12:11:00.911100 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.886339 29926 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 12:11:00.919601 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 140205us
I20260709 12:11:00.891458 30007 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:00.956806 26541 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:00.960220 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 77150.7us
I20260709 12:11:00.896598 30000 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:11:00.960340 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 76884.9us
W20260709 12:11:00.964437 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 53196.4us
I20260709 12:11:00.965505 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.892249 29957 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:00.966511 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:00.892944 29952 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:00.907909 29992 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:00.969993 26547 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:00.980352 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:00.910344 29867 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:11:00.968896 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:00.981545 26542 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:00.967455 29492 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:00.972796 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:00.973862 29711 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:00.967209 29947 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:00.974634 30009 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.976531 29952 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:00.976701 30020 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:00.993356 26541 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:00.978667 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:00.979128 26368 catalog_manager.cc:5697] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 1 to 3, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 3 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:00.990597 26542 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:00.977926 30022 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
W20260709 12:11:00.991600 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 112287us
I20260709 12:11:00.994830 26368 catalog_manager.cc:5697] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 4 to 6, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 6 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:00.999773 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:00.997879 26368 catalog_manager.cc:5697] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 6 to 7, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 7 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:00.918985 30002 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:11:00.999838 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:01.001259 26368 catalog_manager.cc:5697] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:00.996549 29926 consensus_queue.cc:1059] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:11:01.031644 26439 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:01.032372 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:01.033010 26542 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:11:01.016193 26541 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:01.018702 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:01.034484 26471 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:11:01.030723 26543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:11:01.035566 26543 raft_consensus.cc:606] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:01.007266 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:01.036273 26543 raft_consensus.cc:614] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:01.001708 30009 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:00.995990 29979 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:01.058362 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:01.030864 29951 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:01.032029 29711 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:01.018991 29606 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:01.023484 29992 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:01.070709 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:01.023484 29957 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:01.006050 29961 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:11:01.073921 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 74232.1us
I20260709 12:11:01.026211 29878 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:01.069819 30022 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:01.073649 29926 consensus_queue.cc:1243] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:01.074563 29985 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:01.069356 29979 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:01.101336 29832 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.099159 29711 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:01.102973 29957 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:01.096901 29752 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:11:01.089006 29961 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:01.110512 29867 raft_consensus.cc:3055] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:11:01.110555 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 112082us
I20260709 12:11:01.104240 30022 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:01.121591 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:01.105103 30007 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:11:01.125771 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 118595us
W20260709 12:11:01.162649 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.162768 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:01.072477 30000 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:01.140944 29996 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.173255 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:01.119652 30014 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:11:01.175293 30012 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:11:01.175976 30028 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:01.176625 29492 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:01.176774 30025 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:11:01.177536 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:01.177917 30009 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:01.177982 30003 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:01.114827 30002 consensus_queue.cc:1243] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:01.176079 29982 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.112752 29832 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:01.185463 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.186866 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.106959 29987 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:01.182173 30014 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:01.178968 29851 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:11:01.191370 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:01.182837 29982 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.193586 30018 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:01.193434 29711 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:01.196377 30021 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:11:01.198491 29979 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:01.198619 30026 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:01.199234 29947 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:01.220182 29987 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:01.200613 30031 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:11:01.222239 30031 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:01.222649 30031 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:01.223555 30031 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:01.224558 30005 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.256s	user 0.000s	sys 0.002s
I20260709 12:11:01.224918 30031 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.191795 30010 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 12:11:01.226804 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:01.228629 29851 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:01.229060 29851 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:01.201146 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:01.119462 29957 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:01.162544 29867 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:01.207479 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:01.208465 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:11:01.209214 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.213011 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:01.214011 26616 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:01.237129 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45854us
I20260709 12:11:01.237083 26543 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.190682 29832 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.189844 30028 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:01.211974 29982 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:01.217976 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.192914 30029 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:11:01.191633 30024 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
W20260709 12:11:01.238574 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 207019us
W20260709 12:11:01.248538 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.237383 26616 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:01.285534 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 51847.8us
I20260709 12:11:01.286463 30029 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:01.286918 30029 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:01.287845 30029 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:01.289153 30029 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:01.206761 30002 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 12:11:01.296422 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 58019.8us
I20260709 12:11:01.298102 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:01.299124 26546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2251a6321412417a8079201067ae2d0d"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:11:01.229900 29851 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:01.303653 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 191367us
I20260709 12:11:01.299326 26543 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:01.312765 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:01.303490 26546 raft_consensus.cc:606] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:11:01.315092 26546 raft_consensus.cc:614] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:01.315304 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:01.302486 26616 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:01.320477 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:01.324250 26616 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.325881 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:01.326622 26546 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.312142 30026 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:01.366927 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:01.372116 26544 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.375995 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:01.376935 26539 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:01.322651 29878 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:01.413700 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:01.422878 26540 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 8: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:01.412899 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:01.424487 26545 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 10: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:01.413091 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:01.319878 30032 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:01.322746 29448 raft_consensus.cc:3055] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:01.439007 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 124984us
I20260709 12:11:01.440786 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:01.325951 29941 raft_consensus.cc:3055] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:01.367836 29752 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.321897 30020 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:01.294806 29957 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:01.377017 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:01.327907 30007 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:01.480649 27168 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:01.294744 29867 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:01.327464 29979 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.102s
I20260709 12:11:01.376040 29985 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.416078 29851 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.383174 30035 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:01.483407 26544 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:01.458271 29448 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:01.464332 29941 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:01.497521 30016 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.497902 30020 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:01.474927 29878 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.503468 29997 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:01.469125 30036 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:01.303747 30022 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:01.510344 26546 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:01.476130 30032 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:11:01.512861 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.510380 26539 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
W20260709 12:11:01.520370 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.522044 26615 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:01.525945 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:01.507728 30018 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:01.528882 26620 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:01.479269 29752 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:01.513754 29606 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.537231 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:01.529505 26620 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:01.517752 29997 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:01.370481 30014 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:01.540789 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:01.545503 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:01.548512 30023 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:01.518577 30026 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:01.553062 30001 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:01.554081 30030 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:01.554746 30030 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:01.557876 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:01.558706 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.547096 26620 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:01.563334 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.519846 29878 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:01.519870 30008 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:11:01.516472 30016 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:01.581290 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:01.471570 30028 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:01.587031 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.590941 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.509806 29985 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:01.564075 30024 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:01.616983 26465 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.561669 30036 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:01.543414 29606 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:01.615754 29979 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:01.629088 26616 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:11:01.628875 30044 consensus_queue.cc:1175] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac3ac2181aa941229a758ccf6b5607cd" responder_term: 9 status { last_received { term: 9 index: 6 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:01.631542 26473 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:01.529031 30011 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.261s
W20260709 12:11:01.654421 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.627624 30054 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:01.679963 27162 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
W20260709 12:11:01.677284 30038 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
W20260709 12:11:01.677626 30033 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 12:11:01.578289 29832 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:01.680122 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 98025.1us
I20260709 12:11:01.560708 29448 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:01.678256 30024 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:01.840883 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1809) took 1147 ms. Trace:
W20260709 12:11:01.812741 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 252197us
W20260709 12:11:01.840384 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.877099 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.899463 26548 rpcz_store.cc:276] 0709 12:11:00.701271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.702970 (+  1699us) service_pool.cc:224] Handling call
0709 12:11:00.705658 (+  2688us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.901878 (+196220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.840623 (+938745us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b5400104fd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:01.840819 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":428095872}
I20260709 12:11:01.696530 29997 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:01.907898 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.631147 30032 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:01.831988 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:01.913550 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.919956 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.922483 30057 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.923276 30057 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:01.737128 30011 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.187s
I20260709 12:11:01.922612 26621 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:01.876993 29711 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:01.843712 30034 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
W20260709 12:11:01.846334 30051 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
W20260709 12:11:01.802647 30031 consensus_meta.cc:287] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.577s	user 0.014s	sys 0.001s
W20260709 12:11:01.932456 26585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.001s	sys 0.013s
I20260709 12:11:01.675194 30035 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 9 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:01.808153 29448 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.842926 29926 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:01.918856 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 478170us
I20260709 12:11:01.775753 30050 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.828542 30052 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.734870 30049 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.843878 30037 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.845698 29841 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:01.776296 30053 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:01.712776 29979 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:01.811816 29985 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:01.974006 26616 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
W20260709 12:11:01.976783 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.941597 26585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.001s	sys 0.014s
W20260709 12:11:01.941781 26438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.004s	sys 0.008s
W20260709 12:11:01.979943 26438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.004s	sys 0.008s
W20260709 12:11:01.980130 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.809267 30047 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:01.926426 30042 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:01.875064 27159 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:11:01.929723 30057 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:01.955801 29841 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:01.964270 30045 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:01.964567 30062 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:01.964689 29606 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:01.965279 29837 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:01.951058 29752 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:01.969326 30060 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
W20260709 12:11:01.980810 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.982123 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:01.987080 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:01.974706 29828 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:01.991521 26465 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:01.926452 29711 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:01.726004 30018 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:01.946040 29926 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:01.717814 30054 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:02.006141 26471 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.987119 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:02.011401 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:01.988669 29878 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:02.094924 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:02.116753 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:02.089411 30061 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.090133 30066 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:11:02.113168 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:02.113672 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 455) took 1084 ms. Trace:
I20260709 12:11:01.996464 30047 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:02.117125 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:02.117408 26465 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:02.121435 30047 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:01.994702 30000 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:01.912463 30036 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:02.081121 30033 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:11:01.990988 30031 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 12:11:02.135010 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.122535 26472 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 10: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:11:02.135514 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.132845 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:02.113422 30021 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:11:01.974705 30053 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:02.119419 26467 rpcz_store.cc:276] 0709 12:11:00.997754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.998320 (+   566us) service_pool.cc:224] Handling call
0709 12:11:00.998664 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.031018 (+ 32354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.031050 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.031563 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.189676 (+158113us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:01.311648 (+121972us) log.cc:844] Serialized 14 byte log entry
0709 12:11:01.475301 (+163653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.475528 (+   227us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.018476 (+542948us) raft_consensus.cc:1685] finished
0709 12:11:02.018509 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.081642 (+ 63133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86104,"prepare.queue_time_us":280104,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":5622,"raft.queue_time_us":256705,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":13628,"spinlock_wait_cycles":31666432,"thread_start_us":312284,"threads_started":3,"wal-append.queue_time_us":180197}
I20260709 12:11:02.000964 30037 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 12:11:01.963442 30052 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:02.140568 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:02.140481 26471 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:02.142352 26472 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:01.958673 30050 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:01.960264 30049 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:02.149375 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:01.998822 30042 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:02.163228 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:02.166808 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:02.170624 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.171325 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.123129 30000 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:02.182870 30000 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:02.184959 29828 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.185635 29828 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:02.007771 30024 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:02.161430 30062 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.134238 30035 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:02.164443 30044 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:11:02.143086 29841 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:02.117694 30061 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:02.161265 30045 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:02.215832 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 211173us
W20260709 12:11:02.349068 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.201232 26471 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.650959 29878 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:02.709760 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.426851 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:02.710801 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.710953 26467 raft_consensus.cc:2368] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9.
I20260709 12:11:02.712409 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:02.713128 26467 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:02.713608 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.715709 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.471921 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.716289 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.716882 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.719115 29878 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:02.229270 30080 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:02.720476 30080 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:02.721472 29878 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:02.618333 29764 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:02.230365 30071 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 12:11:02.450026 26513 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.528s (SENT) [suppressed 23 similar messages]
I20260709 12:11:02.214514 30028 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:02.732594 30028 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:02.732776 30054 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:02.733347 29764 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:02.733700 30028 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:02.734898 30028 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.735069 30049 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:02.736532 30080 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:02.737092 30080 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.724036 30045 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:02.737569 30080 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:02.724802 30062 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:02.740059 30085 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:02.740661 30085 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:02.742234 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.742823 26466 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:02.175841 30069 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:11:02.715085 30026 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.158s	user 0.010s	sys 0.005s
I20260709 12:11:02.554777 30082 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.719746 30052 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:02.555346 29998 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.504009 30000 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.655818 29979 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:02.764431 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.761502 30026 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.209s	user 0.010s	sys 0.005s
W20260709 12:11:02.727416 30031 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.029s	sys 0.028s
I20260709 12:11:02.194307 29926 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:02.773043 29764 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:02.774264 29711 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:02.793870 26472 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.633s	user 0.007s	sys 0.003s
I20260709 12:11:02.794598 26472 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
W20260709 12:11:02.784446 30031 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.030s	sys 0.028s
I20260709 12:11:02.235006 30042 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:02.766728 26618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.013s	sys 0.010s
I20260709 12:11:02.757162 29841 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.755685 30024 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.744657 29838 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.761660 30069 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:02.787756 26467 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
W20260709 12:11:02.783552 30018 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.005s	sys 0.022s
I20260709 12:11:02.773672 26471 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
W20260709 12:11:02.788789 30014 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.011s	sys 0.022s
I20260709 12:11:02.778708 29998 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:02.779093 30037 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:11:02.775864 30082 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:02.781189 30000 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:02.984161 26618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.014s	sys 0.011s
W20260709 12:11:02.805365 29982 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.488s	user 0.010s	sys 0.006s
I20260709 12:11:02.976681 29941 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:02.985359 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2684) took 1056 ms. Trace:
I20260709 12:11:02.946224 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 459) took 1366 ms. Trace:
W20260709 12:11:02.836086 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 386085us
W20260709 12:11:02.984305 30014 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.018s	sys 0.035s
W20260709 12:11:02.870879 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 151310us
I20260709 12:11:02.986761 26618 rpcz_store.cc:276] 0709 12:11:01.928603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.928892 (+   289us) service_pool.cc:224] Handling call
0709 12:11:01.940771 (+ 11879us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.944748 (+  3977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.944785 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.960137 (+ 15352us) log.cc:844] Serialized 26 byte log entry
0709 12:11:02.984902 (+1024765us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:02.984950 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.985028 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.985081 (+    53us) raft_consensus.cc:1685] finished
0709 12:11:02.985096 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.985264 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5724,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":4671,"thread_start_us":986692,"threads_started":1,"wal-append.queue_time_us":837994}
W20260709 12:11:02.844393 30019 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 1.827s	user 0.000s	sys 0.015s
I20260709 12:11:02.986557 26469 rpcz_store.cc:276] 0709 12:11:01.579414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.579552 (+   138us) service_pool.cc:224] Handling call
0709 12:11:01.623900 (+ 44348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.001001 (+377101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.001053 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:02.001112 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:02.001182 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.945942 (+944760us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b540035f7d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:02.945997 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.946154 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":866566528}
I20260709 12:11:02.799752 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:02.992172 26472 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.985069 29982 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:02.943991 30074 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.776s	user 0.004s	sys 0.005s
W20260709 12:11:02.861380 30089 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:11:02.868088 30029 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.579s	user 0.018s	sys 0.000s
W20260709 12:11:02.987617 30018 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.016s	sys 0.030s
I20260709 12:11:02.985585 29941 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:11:02.943966 29448 consensus_meta.cc:287] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.996s	user 0.010s	sys 0.002s
I20260709 12:11:02.993424 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:02.805050 29926 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.027401 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:03.027978 26467 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.029789 29867 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.032979 30000 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:03.033885 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:03.034591 26544 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:03.035629 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:03.036222 26466 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.039645 29982 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:03.040620 27159 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 506) took 1721 ms (client timeout 2196 ms). Trace:
W20260709 12:11:03.041079 27159 rpcz_store.cc:269] 0709 12:11:01.319213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.319407 (+   194us) service_pool.cc:224] Handling call
0709 12:11:03.040381 (+1720974us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54003b7754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:03.040529 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":840992640}
I20260709 12:11:03.043651 30060 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:03.044080 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:03.044744 26539 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.019160 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:02.939265 30053 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:03.023464 26472 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:11:03.024269 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:02.862008 29828 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:03.033324 26541 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:11:03.033522 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.036164 26467 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:03.045481 26469 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.902957 30085 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:02.859473 30061 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:03.011510 29951 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.993643 30050 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:03.046386 30049 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.021361 30028 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:11:03.048075 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:03.061100 26472 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:03.063055 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:03.064483 30079 log.cc:927] Time spent T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
W20260709 12:11:03.067147 30013 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 2.091s	user 0.004s	sys 0.010s
I20260709 12:11:03.067684 30091 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:11:03.049499 26467 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:02.990537 29838 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:03.089346 26471 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:03.019255 29745 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.057405 30049 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.073127 26472 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:03.044093 30060 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:03.050791 29982 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.107957 29982 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:03.110739 30050 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.111516 30050 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.114076 29838 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:03.070299 29951 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.054756 30069 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.053375 30018 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:11:03.090633 30037 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:11:03.101985 26617 raft_consensus.cc:2410] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:11:03.096611 29996 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:03.104601 29745 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.101897 30082 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:03.106920 30060 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.110241 29982 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:03.114764 30061 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:03.139439 30061 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:03.099599 26466 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:03.125041 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:11:03.145848 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.151445 26539 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
W20260709 12:11:03.198043 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.153491 26469 raft_consensus.cc:2410] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:11:03.201304 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.134510 26615 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:11:03.123126 30018 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:03.124331 30028 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:03.126852 30060 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.125824 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:03.136770 30083 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:03.210922 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 86021.5us
I20260709 12:11:03.115809 30053 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.121870 30069 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.119282 29998 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:03.126096 30056 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.232617 30056 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.234948 30056 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:03.243837 30007 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.244455 30007 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:03.245802 30045 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:03.125969 29745 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:03.114230 30050 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:03.126343 30000 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.247140 30000 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.218701 30083 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:03.247782 30016 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:03.251430 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:03.124121 29996 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:03.216699 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 90951.9us
I20260709 12:11:03.135922 29838 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.137269 30042 raft_consensus.cc:3055] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:03.126349 30017 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.132964 30046 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:03.128172 30065 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:03.202034 30025 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:03.274775 30083 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.137537 30030 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:03.276178 30083 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.279788 30000 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:03.280622 30017 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:03.120617 29951 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:03.218169 30036 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:03.283176 30036 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:03.128533 30101 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:03.222591 30061 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:03.224771 29992 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.225347 30082 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.214057 30018 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:03.294911 29764 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.294571 30018 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.295478 29764 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.215214 30028 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:03.226289 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:03.226861 30053 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:03.117340 30093 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.126s
I20260709 12:11:03.246557 30007 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:03.259598 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:03.297677 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 495) took 2064 ms. Trace:
I20260709 12:11:03.299439 27162 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:03.299329 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.262157 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:03.300941 26469 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.263098 29996 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.264279 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:03.268253 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:03.249040 30016 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.265878 30056 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:03.269344 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:03.312129 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:03.312525 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:03.313069 26540 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:11:03.313408 26548 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.272271 30020 raft_consensus.cc:3055] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:03.272920 30065 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:03.274611 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.317117 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.283267 30017 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:03.115134 29926 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 12:11:03.284605 26468 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:03.263239 30042 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:03.299969 26542 rpcz_store.cc:276] 0709 12:11:01.233421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.233612 (+   191us) service_pool.cc:224] Handling call
0709 12:11:01.233983 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.250115 (+ 16132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.250145 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.288045 (+ 37900us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.828685 (+540640us) spinlock_profiling.cc:243] Waited 8.02 ms on lock 0x7b180046bac0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:11:01.935969 (+107284us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:01.942510 (+  6541us) log.cc:844] Serialized 14 byte log entry
0709 12:11:01.960792 (+ 18282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.960906 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.046640 (+1085734us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b180046bac0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:11:03.239697 (+193057us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b180046bac0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fbb2a6 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1
0709 12:11:03.241214 (+  1517us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b180046bac0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:11:03.296253 (+ 55039us) raft_consensus.cc:1685] finished
0709 12:11:03.296283 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.297609 (+  1326us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26975,"prepare.queue_time_us":6212,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":4633,"raft.queue_time_us":19131,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":53711,"spinlock_wait_cycles":125581312,"thread_start_us":107047,"threads_started":1,"wal-append.queue_time_us":682000}
I20260709 12:11:03.327201 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:03.328004 26540 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:03.295888 30018 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:03.283737 30036 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:03.309078 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.350684 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:03.309409 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:03.265936 30046 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:03.314949 26544 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:03.317502 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.317972 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:03.308323 26513 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:03.321362 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:03.373494 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.374048 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.374493 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.323951 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 59786.6us
W20260709 12:11:03.325321 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 106759us
I20260709 12:11:03.376646 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:03.377238 26469 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:03.328400 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:03.305094 29951 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.333192 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:03.332653 27162 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:03.315405 30001 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:03.350210 30044 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:03.334249 30025 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:03.349596 30065 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:03.318471 30016 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:03.348585 29900 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:03.334563 29448 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.338635 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:03.347270 29961 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:03.441978 30025 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.453184 26545 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:03.453753 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2686) took 1470 ms. Trace:
I20260709 12:11:03.392092 29957 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:03.454380 30025 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:03.476615 26548 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:03.442191 29900 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:03.404860 29951 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.479965 30053 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:03.265091 29838 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:03.480386 29951 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:03.481153 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:03.481730 29832 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:03.482206 29838 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:03.297943 29764 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:03.298887 30101 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:03.318114 30020 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:03.297421 29992 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.298094 30082 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:03.415198 26542 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:11:03.328562 30007 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:03.417004 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:03.396236 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:03.491644 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 95540.9us
I20260709 12:11:03.491343 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:03.493549 26542 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:03.324085 30056 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:03.427887 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:03.495195 26546 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 10: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:03.495298 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:03.356505 30049 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:03.445320 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:03.445855 26622 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.324391 30028 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.442000 26620 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.451622 29448 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.347712 29867 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:03.382911 30068 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:03.454154 26617 rpcz_store.cc:276] 0709 12:11:01.983541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.983716 (+   175us) service_pool.cc:224] Handling call
0709 12:11:03.453507 (+1469791us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b5400196254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:03.453687 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2267951360}
I20260709 12:11:03.454543 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 457) took 2443 ms. Trace:
I20260709 12:11:03.505577 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 454) took 2508 ms. Trace:
I20260709 12:11:03.479483 29900 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.338807 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:03.509138 26470 rpcz_store.cc:276] 0709 12:11:00.998464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.999381 (+   917us) service_pool.cc:224] Handling call
0709 12:11:01.012761 (+ 13380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.121365 (+108604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.121395 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.121439 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:01.121486 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.441984 (+2320498us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54003d0c54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:03.442047 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.442206 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249284352}
I20260709 12:11:03.512118 26616 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:03.490813 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:03.486678 26540 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:11:03.396750 30044 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:03.487699 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:03.560645 27168 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 5.
I20260709 12:11:03.488260 26613 raft_consensus.cc:2410] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:03.486892 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:03.493762 26544 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:03.561987 26543 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 8: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:03.500893 26545 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:03.509290 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:03.509807 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:03.510008 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:03.562451 26465 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:11:03.485872 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 177638us
I20260709 12:11:03.563542 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:03.490916 29957 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:03.557518 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:03.567807 26548 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:11:03.568058 26472 raft_consensus.cc:2376] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10. Re-sending same reply.
I20260709 12:11:03.558041 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:03.431999 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 140635us
I20260709 12:11:03.563773 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:03.564168 26465 raft_consensus.cc:2376] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11. Re-sending same reply.
I20260709 12:11:03.496868 30093 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:03.585408 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.502573 29838 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:03.562963 26619 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
W20260709 12:11:03.618860 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 55183.7us
I20260709 12:11:03.357390 30042 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
W20260709 12:11:03.570561 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 62796.5us
I20260709 12:11:03.571744 29998 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:03.513429 29996 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:03.630162 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:03.631064 26547 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 10: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:03.631523 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:03.631909 29996 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:03.499471 30007 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:03.571774 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:03.633697 30082 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:03.634321 26617 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
W20260709 12:11:03.634920 30107 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:11:03.635696 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:03.636440 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:03.637094 26544 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:11:03.635756 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:03.604252 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:03.606256 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:03.606827 30020 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.607892 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:03.496989 30046 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.603493 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:03.614868 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:03.507400 29980 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:03.623061 26622 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:03.624487 26616 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
W20260709 12:11:03.625085 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.626427 29957 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.628554 30062 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:03.632301 30105 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:11:03.633373 30007 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:03.637529 26540 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:03.605020 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:03.603394 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:03.603226 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:04.119969 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:03.510751 26464 rpcz_store.cc:276] 0709 12:11:00.997414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.997590 (+   176us) service_pool.cc:224] Handling call
0709 12:11:01.032688 (+ 35098us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:01.071899 (+ 39211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.071935 (+    36us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:01.085176 (+ 13241us) log.cc:844] Serialized 78 byte log entry
0709 12:11:01.199986 (+114810us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:01.314658 (+114672us) log.cc:844] Serialized 14 byte log entry
0709 12:11:01.535247 (+220589us) log.cc:844] Serialized 14 byte log entry
0709 12:11:02.937581 (+1402334us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b18000f5260. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:11:03.370343 (+432762us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b18000f5260. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5075c824bc 00007f5072fd048b 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287
0709 12:11:03.370784 (+   441us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.505241 (+134457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.505330 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.505366 (+    36us) raft_consensus.cc:1685] finished
0709 12:11:03.505377 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.505518 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":168476,"prepare.queue_time_us":287885,"prepare.run_cpu_time_us":138,"prepare.run_wall_time_us":2937,"raft.queue_time_us":543390,"raft.run_cpu_time_us":627,"raft.run_wall_time_us":25339,"spinlock_wait_cycles":12470016,"thread_start_us":496742,"threads_started":5,"wal-append.queue_time_us":200522,"wal-append.run_cpu_time_us":7249,"wal-append.run_wall_time_us":1872220}
I20260709 12:11:04.047353 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:03.836918 26620 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:11:03.699282 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.123144 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.121460 26613 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:11:04.124855 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:03.642587 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.128280 26547 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:11:04.128798 26619 raft_consensus.cc:2410] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:03.890034 26439 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:11:04.129887 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 239964us
I20260709 12:11:04.122004 26468 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:04.130735 26439 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:04.130805 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:04.001187 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:04.131783 27162 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:11:03.639886 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:04.132961 26546 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:11:04.125941 26621 raft_consensus.cc:2410] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:11:03.691231 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.121917 26469 raft_consensus.cc:2376] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6. Re-sending same reply.
I20260709 12:11:04.132339 27166 raft_consensus.cc:2410] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:11:04.127319 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.784967 30080 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:04.139355 29832 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:04.139076 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.624274 30093 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:04.140111 29832 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 9 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:11:04.141654 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.142014 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.142823 26616 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:04.143314 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2675) took 2600 ms. Trace:
W20260709 12:11:04.119421 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 464537us
I20260709 12:11:04.122002 27168 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:11:03.652536 30044 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:04.143953 26620 rpcz_store.cc:276] 0709 12:11:01.522434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.522552 (+   118us) service_pool.cc:224] Handling call
0709 12:11:01.522852 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:03.417761 (+1894909us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540005c6a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f507604fa1d 00007f50760361a4 00007f50760b8447 00007f50760d0fe7 00007f50760d27de 00007f50760dcb49 00007f50760dd416 00007f50760d9d8f 00007f50760d983e 00007f507b09e419
0709 12:11:04.122725 (+704964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.122916 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":277016960}
W20260709 12:11:04.148168 26542 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.003s	sys 0.010s
W20260709 12:11:04.148665 26542 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.003s	sys 0.010s
W20260709 12:11:03.989207 30109 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.254s	user 0.001s	sys 0.001s
W20260709 12:11:04.062482 30036 consensus_meta.cc:287] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.000s
I20260709 12:11:04.144651 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:04.119604 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 516333us
I20260709 12:11:04.154120 26544 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 9: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:04.144846 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.120450 26514 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:04.144475 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:03.650924 30096 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.368s	user 0.001s	sys 0.000s
I20260709 12:11:04.158620 27165 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 10: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:04.158486 26622 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:11:04.159752 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:04.160760 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:04.163447 27134 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:03.616086 29448 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:04.164466 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:04.164831 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:04.165580 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:04.166978 26470 raft_consensus.cc:2410] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:03.766894 29838 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 9 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:04.147377 30042 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.167995 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.124545 29900 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.169759 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:04.183193 26473 raft_consensus.cc:2376] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8. Re-sending same reply.
I20260709 12:11:04.183506 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.161643 26464 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:11:03.650528 29992 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:04.173051 27168 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:57562
I20260709 12:11:04.187247 27168 raft_consensus.cc:606] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:11:04.187716 27168 raft_consensus.cc:614] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:03.779240 27159 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:04.189132 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:04.190107 26468 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:11:03.910930 30016 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:04.174237 26513 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:04.126755 30101 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:04.165683 26469 raft_consensus.cc:2376] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10. Re-sending same reply.
I20260709 12:11:04.170656 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.194681 26613 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:03.651171 30068 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:04.199608 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:04.200444 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:04.177507 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.169040 30009 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:04.193455 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:04.152333 30060 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:11:04.176615 30080 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:04.203884 26466 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:11:04.141227 29832 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:04.200657 26473 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:11:03.647816 30056 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:04.206841 26616 raft_consensus.cc:2410] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:11:04.177064 29448 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:04.148939 29980 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:04.239521 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.162650 30036 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:04.196681 30044 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.201872 30101 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.208096 30009 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.245313 30080 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:04.199879 29992 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:11:04.252017 30068 raft_consensus.cc:2764] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:11:04.240391 30020 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.274953 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.268949 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.268663 30076 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:04.254035 29867 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:11:04.274523 30093 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:04.256590 29448 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:04.282017 30009 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:04.286926 26616 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:11:04.272003 26471 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:04.308130 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.260393 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:04.317340 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1914) took 1015 ms. Trace:
I20260709 12:11:04.317920 26539 rpcz_store.cc:276] 0709 12:11:03.301870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.303292 (+  1422us) service_pool.cc:224] Handling call
0709 12:11:03.303852 (+   560us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:03.305494 (+  1642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.305526 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:03.309219 (+  3693us) log.cc:844] Serialized 78 byte log entry
0709 12:11:03.442959 (+133740us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:11:03.488928 (+ 45969us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.489238 (+   310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.489311 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.787559 (+298248us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b18002396e0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:11:04.306142 (+518583us) raft_consensus.cc:1685] finished
0709 12:11:04.316966 (+ 10824us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.317243 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1073,"prepare.queue_time_us":45654,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":1787,"raft.queue_time_us":3595,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":17109,"spinlock_wait_cycles":6201728,"thread_start_us":102701,"threads_started":1,"wal-append.queue_time_us":178431}
I20260709 12:11:04.323279 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.326064 26616 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:04.334769 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2001) took 1007 ms. Trace:
I20260709 12:11:04.336268 26616 rpcz_store.cc:276] 0709 12:11:03.327124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.325087 (+997963us) service_pool.cc:224] Handling call
0709 12:11:04.325555 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.333985 (+  8430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.334688 (+   703us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:04.267051 29838 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:04.354717 26618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.047s	sys 0.084s
I20260709 12:11:04.356442 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.357975 26613 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:11:04.356858 26618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.047s	sys 0.084s
I20260709 12:11:04.301695 30076 raft_consensus.cc:697] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:04.316253 30093 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:04.362262 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 2000) took 1040 ms. Trace:
I20260709 12:11:04.368436 26613 rpcz_store.cc:276] 0709 12:11:03.321810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.333362 (+1011552us) service_pool.cc:224] Handling call
0709 12:11:04.362165 (+ 28803us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:04.360654 30104 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 1.003s	user 0.007s	sys 0.009s
I20260709 12:11:04.367431 30093 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.400830 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.272469 30101 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:04.397920 30093 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.398222 29867 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:11:04.435111 29448 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:04.366326 30080 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:04.439070 30036 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:04.430001 29867 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:04.446434 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.444892 29997 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.449071 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.449918 26613 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:11:04.457646 30101 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:04.476119 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:04.466979 29992 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:04.448056 30076 consensus_queue.cc:237] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:04.506896 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2681) took 2585 ms. Trace:
W20260709 12:11:04.512012 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 348657us
I20260709 12:11:04.507485 26615 rpcz_store.cc:276] 0709 12:11:01.921149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.921328 (+   179us) service_pool.cc:224] Handling call
0709 12:11:01.921700 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:03.210290 (+1288590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.506524 (+1296234us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54003d9354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:04.506806 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2788360064}
I20260709 12:11:04.514511 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:04.516274 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:04.516680 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 396272us
I20260709 12:11:04.516990 26615 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
W20260709 12:11:04.517227 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 386560us
I20260709 12:11:04.528556 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.529215 26615 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:11:04.529763 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:04.527194 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 353047us
W20260709 12:11:04.531483 30112 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:04.486796 29992 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:04.533188 26615 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:04.513777 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:04.543179 29448 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.544715 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:04.525910 30068 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:04.545288 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2687) took 1170 ms. Trace:
I20260709 12:11:04.543111 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:04.549209 27168 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 7: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:04.549199 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:04.548964 26615 rpcz_store.cc:276] 0709 12:11:03.375094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.529846 (+1154752us) service_pool.cc:224] Handling call
0709 12:11:04.530166 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.545018 (+ 14852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.545231 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:04.555166 30042 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:04.555943 30042 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:04.558552 30036 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:04.558712 27163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 512) took 1130 ms. Trace:
I20260709 12:11:04.559118 30036 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:04.559661 30036 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.559211 27163 rpcz_store.cc:276] 0709 12:11:03.428693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.451665 (+ 22972us) service_pool.cc:224] Handling call
0709 12:11:04.502418 (+1050753us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:11:04.558637 (+ 56219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5571840}
I20260709 12:11:04.560649 29992 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:04.563010 29980 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:04.542711 30101 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.564543 30101 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:04.566847 30101 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:04.568121 26619 raft_consensus.cc:2410] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:04.568473 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2787) took 1011 ms. Trace:
I20260709 12:11:04.575220 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.576628 26615 raft_consensus.cc:2410] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:11:04.583935 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 323634us
I20260709 12:11:04.568872 26471 rpcz_store.cc:276] 0709 12:11:03.557352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.558185 (+   833us) service_pool.cc:224] Handling call
0709 12:11:04.568272 (+1010087us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54003d0c54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:04.568406 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340636416}
I20260709 12:11:04.569559 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:04.597884 26620 raft_consensus.cc:2410] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:11:04.595314 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:04.607234 27168 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:04.551801 29867 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.608247 26439 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:04.610530 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.603442 27165 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
W20260709 12:11:04.618774 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 49342.9us
I20260709 12:11:04.620008 26615 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:11:04.624941 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:04.625437 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:04.630683 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:04.631609 26542 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:04.631917 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:04.632759 27163 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 9: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:04.636445 26542 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:04.567468 30032 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:04.639433 26621 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:11:04.639721 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.640733 26615 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:11:04.622085 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:04.641927 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.642920 26615 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:04.651618 26542 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:04.550436 29448 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:04.658563 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:04.670164 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.682379 26622 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.682508 26615 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:11:04.656082 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 1995) took 1335 ms. Trace:
I20260709 12:11:04.552239 30068 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:04.693935 26546 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:04.683809 26618 rpcz_store.cc:276] 0709 12:11:03.320374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.320722 (+   348us) service_pool.cc:224] Handling call
0709 12:11:03.339669 (+ 18947us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:03.620537 (+280868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.620572 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:03.622468 (+  1896us) log.cc:844] Serialized 26 byte log entry
0709 12:11:04.359618 (+737150us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:11:04.359677 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.539528 (+179851us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54001b0654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:04.539585 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.623670 (+ 84085us) raft_consensus.cc:1685] finished
0709 12:11:04.623691 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.655995 (+ 32304us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65030,"raft.queue_time_us":66640,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":102858,"spinlock_wait_cycles":491262208,"thread_start_us":525832,"threads_started":1,"wal-append.queue_time_us":768964}
I20260709 12:11:04.685696 26542 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:04.697690 26542 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:04.696398 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.700680 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:04.698146 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2685) took 2734 ms. Trace:
I20260709 12:11:04.686601 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1933) took 1056 ms. Trace:
I20260709 12:11:04.686518 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:04.690922 26544 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:04.612243 30062 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:04.703064 26614 rpcz_store.cc:276] 0709 12:11:01.963493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.992334 (+ 28841us) service_pool.cc:224] Handling call
0709 12:11:01.998122 (+  5788us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.013757 (+ 15635us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:02.013805 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:02.094890 (+ 81085us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.793830 (+1698940us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b1800314260. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:11:04.282602 (+488772us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:04.282646 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.282716 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.684307 (+401591us) raft_consensus.cc:1685] finished
0709 12:11:04.684326 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.698075 (+ 13749us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23470,"raft.queue_time_us":126713,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":8057,"spinlock_wait_cycles":7314304,"thread_start_us":488540,"threads_started":1,"wal-append.queue_time_us":2333474}
I20260709 12:11:04.708314 26541 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:04.708787 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:04.721446 26546 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:11:04.709367 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:04.710561 26542 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:04.600678 29980 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 12:11:04.729423 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:04.655747 29992 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:04.705778 26543 rpcz_store.cc:276] 0709 12:11:03.630063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.767780 (+137717us) service_pool.cc:224] Handling call
0709 12:11:04.545016 (+777236us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:11:04.545241 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.686270 (+141029us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:04.686291 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:04.686322 (+    31us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:04.686341 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.686443 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.686551 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81512,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":133,"spinlock_wait_cycles":3667200,"thread_start_us":140660,"threads_started":1}
I20260709 12:11:04.734745 26545 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 8: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:04.735255 27166 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:04.619729 30047 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
W20260709 12:11:04.733429 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.618148 30016 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.082s
W20260709 12:11:04.741074 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.741427 26547 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: [2.2-7.4]
I20260709 12:11:04.695413 30101 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:04.743516 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:04.744014 26622 raft_consensus.cc:2410] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:04.689112 30117 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:04.641135 29867 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:04.746816 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.755335 26614 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:11:04.750123 26544 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 10: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:11:04.745538 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 132027us
I20260709 12:11:04.752704 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.733340 30062 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.708141 30042 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:04.683813 30032 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:04.748222 26539 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:04.779577 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.684572 30009 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:04.697917 29957 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:11:04.804582 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:04.784423 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:04.799329 26544 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:11:04.748723 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:04.804955 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:04.728404 29832 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:11:04.815223 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:04.806231 26547 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 11: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:04.804003 26622 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:04.781368 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:04.821833 26543 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 12:11:04.750360 29980 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:11:04.824983 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 44800.9us
I20260709 12:11:04.808658 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:04.751053 30117 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.740322 30080 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
W20260709 12:11:04.816334 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 236079us
W20260709 12:11:04.745005 30082 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.005s	sys 0.056s
I20260709 12:11:04.816184 26614 raft_consensus.cc:2376] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10. Re-sending same reply.
W20260709 12:11:04.824319 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 216152us
I20260709 12:11:04.781078 30122 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.840619 26439 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:04.751565 30101 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.828904 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:04.827409 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:04.784257 30062 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.850872 30016 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:04.851838 29867 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:04.852445 29867 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:04.853410 29867 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.753830 29992 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:11:04.778870 30020 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:04.837707 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2002) took 1510 ms. Trace:
I20260709 12:11:04.754295 30044 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:04.781093 29900 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:04.840314 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.814841 30056 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:04.843531 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:04.843766 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:04.891860 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.892388 26622 raft_consensus.cc:2376] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11. Re-sending same reply.
I20260709 12:11:04.892562 26614 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:11:04.844858 30115 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:11:04.845160 29832 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:04.845973 30116 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:11:04.846488 29448 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:04.850965 30121 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:11:04.797459 30114 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:04.839183 30082 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.005s	sys 0.061s
I20260709 12:11:04.838761 30042 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
W20260709 12:11:04.881346 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.882526 26616 rpcz_store.cc:276] 0709 12:11:03.327389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.342876 (+1015487us) service_pool.cc:224] Handling call
0709 12:11:04.369511 (+ 26635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.369794 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:04.588265 (+218471us) log.cc:844] Serialized 14 byte log entry
0709 12:11:04.837071 (+248806us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:04.837134 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:04.837198 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.837479 (+   281us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.837637 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31393,"raft.queue_time_us":49473,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":14000,"thread_start_us":407119,"threads_started":3}
I20260709 12:11:04.853751 30080 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:04.834017 30117 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.891896 29980 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:04.906701 26439 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:04.855676 29867 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:04.874758 30101 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.910681 29832 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:04.876624 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 49324.8us
I20260709 12:11:04.921715 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.888228 29957 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:04.927129 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.927337 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:04.927460 27166 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
W20260709 12:11:04.928094 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.906034 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 74758.1us
W20260709 12:11:04.940555 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.941480 26472 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:04.941738 26465 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:04.891860 30056 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:04.942946 26467 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:04.917047 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.942840 27166 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:57562
I20260709 12:11:04.943204 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:04.932030 26439 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:04.943904 27166 raft_consensus.cc:606] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:04.945354 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:04.945981 26465 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:04.946295 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:04.939529 26616 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:11:04.945071 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:04.949463 26472 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:04.952829 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:04.893887 30020 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:04.953064 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.955331 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:04.966992 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.967734 26467 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:04.939044 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:04.955785 27159 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:11:04.946971 29832 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.926752 29448 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:04.933841 30042 consensus_queue.cc:1243] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:04.957067 30047 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:04.905454 29900 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:04.959268 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:04.921231 30080 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:04.960834 26471 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:04.961370 26620 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:05.007437 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2006) took 1576 ms. Trace:
I20260709 12:11:05.007969 26620 rpcz_store.cc:276] 0709 12:11:03.430736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.960741 (+1530005us) service_pool.cc:224] Handling call
0709 12:11:04.961048 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.007140 (+ 46092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.007367 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:04.947969 29957 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.903249 30044 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:04.954938 26439 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:04.963387 26615 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:11:05.014734 26615 pending_rounds.cc:85] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 3
I20260709 12:11:05.014982 26615 pending_rounds.cc:107] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:11:05.015148 26615 raft_consensus.cc:2889] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:04.971213 26540 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:04.971544 26467 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
W20260709 12:11:05.016165 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 123499us
I20260709 12:11:04.980134 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:04.966995 26473 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:11:04.980397 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:05.015728 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2007) took 1557 ms. Trace:
I20260709 12:11:04.931869 30007 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.023094 26514 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:04.933898 30102 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.984645 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:04.910759 30120 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:11:04.956578 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2695) took 1456 ms. Trace:
I20260709 12:11:04.885670 30122 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:04.989142 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:05.016237 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:05.017868 26615 rpcz_store.cc:276] 0709 12:11:03.458713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.962777 (+1504064us) service_pool.cc:224] Handling call
0709 12:11:04.963053 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.015464 (+ 52411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.015665 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:04.929699 30136 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.017154 26465 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:11:05.012550 30042 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.026638 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:05.026793 26622 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
W20260709 12:11:05.025704 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 182263us
I20260709 12:11:05.018007 29957 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.027339 30130 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:04.988778 29992 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 12:11:05.012676 30131 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:11:04.988509 29448 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:05.004052 30047 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.029959 26619 rpcz_store.cc:276] 0709 12:11:03.500384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.145724 (+645340us) service_pool.cc:224] Handling call
0709 12:11:04.956365 (+810641us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54002602d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:04.956510 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":891583232}
I20260709 12:11:04.998627 30134 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:11:04.981277 29980 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.027376 30141 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:04.921234 30114 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:05.048094 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.048919 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:05.029572 30093 consensus_meta.cc:287] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.575s	user 0.012s	sys 0.001s
I20260709 12:11:04.978940 30045 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:11:04.985780 30016 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:05.059090 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:05.091114 26465 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:05.091275 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:05.038417 30076 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:04.990561 30068 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:05.038715 30009 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:05.071579 26541 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:05.070488 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:05.064412 30136 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.070498 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:05.037493 30102 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:05.073416 30080 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.070478 30047 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:05.082623 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 95553.6us
I20260709 12:11:05.063433 26614 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:05.013581 30056 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.065459 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:05.136041 26544 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:05.124294 26620 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:05.125350 26619 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:11:05.138156 26619 pending_rounds.cc:85] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 6
I20260709 12:11:05.138458 26619 pending_rounds.cc:107] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:11:05.138731 26619 raft_consensus.cc:2889] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:05.078493 29838 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.057852 30042 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:05.090338 30016 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:05.134527 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 73161.3us
I20260709 12:11:05.153604 27165 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:05.119793 30119 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:05.154935 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 250083us
I20260709 12:11:05.168888 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:05.127282 30076 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:05.089864 30093 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:05.081310 30141 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:05.122270 30068 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 12:11:05.197130 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 242247us
I20260709 12:11:05.201182 30076 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.201840 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:05.184134 26622 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:05.202803 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:05.154990 30124 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.203964 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:05.204661 26547 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 5.
I20260709 12:11:05.206190 26439 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:05.206763 30141 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:05.134073 30009 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:05.212667 26548 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:05.213864 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:05.214471 26548 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:11:05.219462 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2696) took 1713 ms. Trace:
I20260709 12:11:05.219903 26621 rpcz_store.cc:276] 0709 12:11:03.506291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.162161 (+655870us) service_pool.cc:224] Handling call
0709 12:11:05.219252 (+1057091us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b5400268754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:05.219388 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1046289664}
I20260709 12:11:05.222836 26621 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:05.223956 27167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 513) took 1736 ms. Trace:
I20260709 12:11:05.224236 26621 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:11:05.224596 26621 pending_rounds.cc:85] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 9
I20260709 12:11:05.224368 27167 rpcz_store.cc:276] 0709 12:11:03.488062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.566503 (+ 78441us) service_pool.cc:224] Handling call
0709 12:11:05.223765 (+1657262us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b540071af54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:05.223900 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1858315520}
I20260709 12:11:05.224951 26621 pending_rounds.cc:107] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:11:05.225226 26621 raft_consensus.cc:2889] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:05.222836 30102 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:05.235093 26548 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:11:05.236706 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2697) took 1670 ms. Trace:
I20260709 12:11:05.237898 26622 rpcz_store.cc:276] 0709 12:11:03.565860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.045630 (+1479770us) service_pool.cc:224] Handling call
0709 12:11:05.065432 (+ 19802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.203422 (+137990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.236459 (+ 33037us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400379e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:05.236642 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269271424}
I20260709 12:11:05.244961 26619 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:05.245952 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2021) took 1007 ms. Trace:
I20260709 12:11:05.170413 30119 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.247360 26619 rpcz_store.cc:276] 0709 12:11:04.239002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.182167 (+943165us) service_pool.cc:224] Handling call
0709 12:11:05.244418 (+ 62251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.245594 (+  1176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.245871 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.161167 30060 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:05.154242 30016 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.181427 30080 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.184510 30056 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.155054 29838 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:05.250859 29867 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:05.261086 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.167065 29992 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
W20260709 12:11:05.261854 30125 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:11:05.208065 30045 consensus_queue.cc:1243] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:05.169081 30032 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:05.208060 30115 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:11:05.259534 27134 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:05.184358 30134 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 12:11:05.253279 30020 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:05.252583 30119 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.253516 30060 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:05.275906 30140 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 12:11:05.269385 29900 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:05.207625 29448 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.293617 27134 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:05.389065 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 95532.9us
I20260709 12:11:05.390007 27134 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:05.295644 30139 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 12:11:05.296419 30114 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:05.296473 30126 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:11:05.263926 30143 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:11:05.291369 30018 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:05.297969 30129 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:11:05.277874 30009 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:05.298627 30151 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:05.298859 30149 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:11:05.299700 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2688) took 1907 ms. Trace:
I20260709 12:11:05.300644 30134 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:05.302860 30028 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.303486 30101 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:05.304584 30158 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.307068 30122 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:05.379218 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.379603 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2693) took 1887 ms. Trace:
I20260709 12:11:05.448628 26620 rpcz_store.cc:276] 0709 12:11:03.492320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.009019 (+1516699us) service_pool.cc:224] Handling call
0709 12:11:05.009424 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.137082 (+127658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.379315 (+242233us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54003a4b54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:05.379520 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263542656}
I20260709 12:11:05.286948 30044 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:05.385912 26514 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:05.451448 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 65665us
W20260709 12:11:05.439268 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 233199us
I20260709 12:11:05.452765 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:05.374984 30032 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:05.440881 26616 rpcz_store.cc:276] 0709 12:11:03.392648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.961731 (+1569083us) service_pool.cc:224] Handling call
0709 12:11:04.962040 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:04.962733 (+   693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:04.962760 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:04.986687 (+ 23927us) log.cc:844] Serialized 26 byte log entry
0709 12:11:05.168514 (+181827us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:05.168572 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.168646 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:05.299469 (+130823us) raft_consensus.cc:1685] finished
0709 12:11:05.299488 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.299637 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17694,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":3161,"thread_start_us":137813,"threads_started":1,"wal-append.queue_time_us":276924}
W20260709 12:11:05.451467 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 405787us
I20260709 12:11:05.459287 26439 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:05.461683 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:05.462683 26616 raft_consensus.cc:2410] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 11 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:05.462976 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:05.438879 30102 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:05.464304 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:05.464612 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:05.438452 30018 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.467622 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:05.438958 30009 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.445032 29986 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:05.444823 30151 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:05.469635 26620 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:11:05.469808 26514 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:05.471513 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2011) took 1964 ms. Trace:
I20260709 12:11:05.473973 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:05.450965 30134 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.474567 27168 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 8: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:05.480810 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:05.477820 26615 rpcz_store.cc:276] 0709 12:11:03.506670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.041318 (+1534648us) service_pool.cc:224] Handling call
0709 12:11:05.041766 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.471146 (+429380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.471180 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:05.471220 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:05.471260 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.471324 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.471443 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7656,"raft.queue_time_us":226902,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":4990,"thread_start_us":413518,"threads_started":1}
I20260709 12:11:05.484472 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:05.456458 30032 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.485566 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:05.486542 26513 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:05.489569 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:05.497140 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:05.465652 30150 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.468984 30102 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.501945 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:05.506326 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:05.471483 30009 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.471356 29986 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.471513 30018 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.486614 30134 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.509089 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:05.507810 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:05.512471 27165 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:05.518323 26539 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:11:05.512387 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:05.507282 26465 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
W20260709 12:11:05.514608 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.491842 30032 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.516263 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:05.520267 26467 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:05.519587 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:05.521874 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.480136 30151 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.525439 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:05.527814 27167 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
W20260709 12:11:05.529990 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 70785.9us
I20260709 12:11:05.530957 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:05.500262 29992 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:05.528720 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:05.540616 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:05.513293 30102 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.517385 29986 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.541498 26468 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:05.549402 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:05.474256 30060 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.526229 30093 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:05.597347 30060 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:05.555810 30161 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:05.558000 30114 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:11:05.559269 26511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.000s	sys 0.017s
W20260709 12:11:05.598758 26511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.000s	sys 0.018s
I20260709 12:11:05.595958 29997 raft_consensus.cc:993] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:11:05.564250 30044 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:05.600061 30093 raft_consensus.cc:1081] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:11:05.600549 30044 raft_consensus.cc:3055] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:05.601092 30044 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:05.601318 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:05.602198 30169 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:05.602336 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 56717.8us
I20260709 12:11:05.602813 30169 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.603161 30169 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.603237 26439 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:05.604560 30007 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.604717 26439 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:05.602187 29448 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.611814 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:05.606078 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:05.613998 26439 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:05.614841 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:05.615336 26439 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:05.515846 30148 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:05.538618 30155 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:11:05.544641 30042 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:05.567592 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:05.547758 30170 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:11:05.579002 30036 consensus_meta.cc:287] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.019s	user 0.015s	sys 0.000s
I20260709 12:11:05.579802 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:05.529680 30132 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:05.586491 30162 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 12:11:05.627710 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 61080.1us
I20260709 12:11:05.638365 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:05.548491 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:05.594269 30124 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:05.596349 30062 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.745s	user 0.007s	sys 0.003s
I20260709 12:11:05.542496 30150 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:05.669154 30150 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.669564 30150 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.528949 29980 raft_consensus.cc:2764] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:05.675063 29980 raft_consensus.cc:2764] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:05.677225 30130 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:05.548292 29992 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 11 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:05.679298 29992 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.598702 30161 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:05.633414 29867 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:05.683084 29867 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:05.683950 29867 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:05.685101 29867 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:05.685261 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 46987.7us
I20260709 12:11:05.686071 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:05.687546 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:05.688719 29900 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:05.689031 30162 consensus_queue.cc:1243] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:05.689347 29900 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:05.689651 30114 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:05.690572 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:05.690577 26545 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:05.691604 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:05.631057 30042 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.664170 30170 raft_consensus.cc:697] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:05.623199 30157 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:05.698649 30157 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:05.699118 30170 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:05.701324 30046 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.621942 30044 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.650501 30152 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.657406 30036 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:05.708233 30162 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:05.708732 30162 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.709134 30162 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.709827 30036 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:05.631984 30007 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.630707 30122 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.710979 30122 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.668637 30124 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.682585 30161 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:05.653847 30132 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:05.713220 30132 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.716023 30122 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:05.713610 30161 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.717386 30161 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.587993 30119 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.719228 26544 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:11:05.720191 30119 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:05.632371 30155 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:05.722901 30155 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.723292 30155 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.634152 30160 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:05.690047 29900 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.629468 30009 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:05.726699 30160 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:05.727182 30160 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.728684 30009 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:05.690126 30114 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:05.729956 30114 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.731226 30114 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.689260 30135 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.697458 30165 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:05.744164 30165 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.744591 30165 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.652114 30171 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:05.697080 30042 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.746116 30171 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:05.665227 30120 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:05.747107 27163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 427) took 1062 ms. Trace:
I20260709 12:11:05.747190 30171 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.619243 30101 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:05.747722 27163 rpcz_store.cc:276] 0709 12:11:04.684566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.689908 (+  5342us) service_pool.cc:224] Handling call
0709 12:11:04.959797 (+269889us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:11:04.960066 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.960365 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:05.199019 (+238654us) log.cc:844] Serialized 14 byte log entry
0709 12:11:05.700365 (+501346us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b180043eac0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5075c824bc 00007f5072fd048b 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a23a
0709 12:11:05.745270 (+ 44905us) log.cc:844] Serialized 14 byte log entry
0709 12:11:05.745779 (+   509us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:05.746668 (+   889us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:05.746739 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.746823 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.747020 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":493221,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":91,"raft.queue_time_us":2106,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":198,"spinlock_wait_cycles":19585024,"thread_start_us":471219,"threads_started":2,"wal-append.queue_time_us":479257}
I20260709 12:11:05.632751 29838 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:05.751754 30042 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:05.752094 30136 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:05.542147 30149 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.122s
I20260709 12:11:05.623652 30148 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.772197 30148 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.703405 30044 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.699095 30157 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.765758 29986 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:05.564429 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2689) took 2144 ms. Trace:
I20260709 12:11:05.695155 30062 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:05.778676 29986 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:05.777603 26618 rpcz_store.cc:276] 0709 12:11:03.419818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.962665 (+1542847us) service_pool.cc:224] Handling call
0709 12:11:05.001735 (+ 39070us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:05.002238 (+   503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.002279 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:05.002843 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 12:11:05.455549 (+452706us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:05.455611 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.455709 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:05.564199 (+108490us) raft_consensus.cc:1685] finished
0709 12:11:05.564221 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.564362 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117825,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":11693,"thread_start_us":411567,"threads_started":1,"wal-append.queue_time_us":516220}
I20260709 12:11:05.618561 30018 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:05.693168 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:05.742946 30135 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:11:05.784281 26620 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:05.785295 30018 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:05.785490 30135 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:05.706633 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:05.738866 30122 consensus_queue.cc:1175] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac3ac2181aa941229a758ccf6b5607cd" responder_term: 8 status { last_received { term: 6 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: [7.5-7.5]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:11:05.786715 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 80200.1us
I20260709 12:11:05.752774 29900 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:05.677856 30130 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.796483 30130 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:05.763302 27168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 518) took 1063 ms. Trace:
W20260709 12:11:05.766530 30047 consensus_meta.cc:287] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.612s	user 0.008s	sys 0.003s
I20260709 12:11:05.797173 27168 rpcz_store.cc:276] 0709 12:11:04.700140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.700343 (+   203us) service_pool.cc:224] Handling call
0709 12:11:05.763000 (+1062657us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b54006ce3d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:05.763213 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1771351808}
I20260709 12:11:05.799723 30102 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:05.793407 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:05.813405 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:05.813541 30102 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:05.814852 30156 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.792199 30135 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.818902 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:05.820029 26368 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57044 (request call id 311) took 25283 ms (client timeout 15000 ms). Trace:
I20260709 12:11:05.821702 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:05.755264 26545 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:05.823580 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:05.824450 30145 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:05.825163 30145 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:05.825470 30145 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:05.820551 26368 rpcz_store.cc:269] 0709 12:10:40.536975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.537241 (+   266us) service_pool.cc:224] Handling call
0709 12:11:05.819919 (+25282678us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:01.556631 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:01.807191 (+250560us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:01.808501 (+  1310us) write_op.cc:435] Acquired schema lock
0709 12:11:01.810932 (+  2431us) tablet.cc:662] Decoding operations
0709 12:11:01.966828 (+155896us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:01.966894 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:01.966922 (+    28us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:11:01.967674 (+   752us) tablet.cc:701] Row locks acquired
0709 12:11:01.967693 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:11:01.967852 (+   159us) write_op.cc:270] Start()
0709 12:11:01.967980 (+   128us) write_op.cc:276] Timestamp: P: 1783599061967801 usec, L: 0
0709 12:11:01.968004 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:11:01.968738 (+   734us) log.cc:844] Serialized 3641 byte log entry
0709 12:11:03.068901 (+1100163us) op_driver.cc:464] REPLICATION: finished
0709 12:11:03.265689 (+196788us) write_op.cc:301] APPLY: starting
0709 12:11:03.269102 (+  3413us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:03.269352 (+   250us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:03.269474 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:03.270777 (+  1303us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:03.271067 (+   290us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:11:03.271119 (+    52us) write_op.cc:312] APPLY: finished
0709 12:11:03.271431 (+   312us) log.cc:844] Serialized 71 byte log entry
0709 12:11:03.271629 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:03.271803 (+   174us) write_op.cc:454] Released schema lock
0709 12:11:03.271855 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:03.272301 (+   446us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:03.272333 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":213,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":180303,"apply.run_cpu_time_us":3393,"apply.run_wall_time_us":13444,"num_ops":9,"prepare.queue_time_us":360704,"prepare.run_cpu_time_us":38330,"prepare.run_wall_time_us":640313,"raft.queue_time_us":220867,"raft.run_cpu_time_us":22918,"raft.run_wall_time_us":115319,"replication_time_us":1100729,"thread_start_us":695881,"threads_started":4,"wal-append.queue_time_us":808864,"wal-append.run_cpu_time_us":33027,"wal-append.run_wall_time_us":1497909}]]}
I20260709 12:11:05.825773 30145 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:05.801638 30016 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.005s
I20260709 12:11:05.803169 30137 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.826860 30137 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.827821 30156 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:05.830895 26613 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:11:05.831430 26613 pending_rounds.cc:85] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 5
I20260709 12:11:05.831735 26613 pending_rounds.cc:107] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:11:05.831998 26613 raft_consensus.cc:2889] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:05.832151 30135 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:05.832648 30135 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:05.833177 30016 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.835521 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:05.797386 30047 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.796118 30162 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:05.693471 29832 consensus_meta.cc:287] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.688s	user 0.011s	sys 0.000s
I20260709 12:11:05.838197 30162 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:05.818830 30132 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:05.838367 29832 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.839636 26471 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:05.839414 30145 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.841524 30145 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:05.833232 30135 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:05.837764 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2004) took 2467 ms. Trace:
I20260709 12:11:05.843065 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:05.842540 26613 rpcz_store.cc:276] 0709 12:11:03.385009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.466964 (+1081955us) service_pool.cc:224] Handling call
0709 12:11:04.472010 (+  5046us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.832615 (+1360605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.837510 (+  4895us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540020ab54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:05.837699 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3124034944}
W20260709 12:11:05.787813 29957 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.725s	user 0.011s	sys 0.000s
W20260709 12:11:05.847347 30117 consensus_meta.cc:287] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.914s	user 0.009s	sys 0.003s
W20260709 12:11:05.842988 30056 consensus_meta.cc:287] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.570s	user 0.005s	sys 0.004s
I20260709 12:11:05.870021 26366 catalog_manager.cc:5697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:05.877585 26366 catalog_manager.cc:5697] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:05.898885 30082 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:05.876214 30117 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:05.901007 30082 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:05.901496 30117 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:05.818320 29867 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:05.847338 30160 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:05.849010 30137 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:05.851210 30047 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:05.852005 30080 consensus_meta.cc:287] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.001s
I20260709 12:11:05.853541 30132 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:05.854688 29832 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:05.855088 30016 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:05.971488 26539 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:05.858217 30046 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:05.973841 30046 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:05.974417 30046 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.801790 29900 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:05.861487 30156 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.782331 30062 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:05.864075 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:05.980053 30156 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:05.980576 30156 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:05.958277 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 450501us
I20260709 12:11:05.980221 30150 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:05.981031 30156 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.901535 30082 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.981451 26513 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:05.985579 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 121593us
W20260709 12:11:05.988690 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 476408us
I20260709 12:11:05.993688 26539 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:05.988912 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:05.998802 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:05.999619 26514 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:05.997164 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:06.018517 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:06.003778 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:05.873404 29957 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:06.005721 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:06.010895 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:06.012878 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:06.014533 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:06.020819 26465 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.886926 30032 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:06.017433 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:06.017763 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:06.023464 26544 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.024555 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:06.022259 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:06.034539 26545 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:11:06.000936 30062 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:06.008404 30128 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:06.042667 30062 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:06.043388 26467 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 9: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:06.043588 30062 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:06.044344 29957 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:06.021096 30157 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:06.047324 26465 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:06.049260 30157 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:06.026873 30169 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:06.056653 30169 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:06.062707 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:06.063454 26473 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:06.014740 30045 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:06.067446 30130 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:06.068106 30130 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:06.068171 30155 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:06.069149 30130 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:06.069517 30045 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:06.070236 30045 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:06.071177 30155 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:06.035946 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:06.038826 30143 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:06.041898 30032 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:06.072139 30028 consensus_meta.cc:287] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.618s	user 0.007s	sys 0.003s
W20260709 12:11:06.085901 26547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.009s	sys 0.011s
W20260709 12:11:06.074049 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 458758us
I20260709 12:11:06.087028 26473 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:06.029563 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:05.990706 29900 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:11:06.090543 26539 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:06.082511 26541 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.001s	sys 0.018s
W20260709 12:11:06.091758 26541 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.002s	sys 0.018s
W20260709 12:11:06.082816 26548 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.011s	sys 0.007s
W20260709 12:11:06.077540 30151 consensus_meta.cc:287] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.001s
I20260709 12:11:06.075239 26544 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
W20260709 12:11:06.089841 26438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.006s	sys 0.014s
I20260709 12:11:06.090431 26617 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
W20260709 12:11:06.101855 26438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.007s	sys 0.014s
W20260709 12:11:06.080189 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44328.2us
W20260709 12:11:06.096637 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 72183.5us
I20260709 12:11:06.103886 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:06.102367 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 605237us
W20260709 12:11:06.098047 26548 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.011s	sys 0.008s
W20260709 12:11:06.099846 27134 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.011s	sys 0.012s
I20260709 12:11:06.042197 30165 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:06.086314 26547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.009s	sys 0.011s
W20260709 12:11:06.108409 27134 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.011s	sys 0.012s
I20260709 12:11:06.109508 26546 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:11:06.111485 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:06.116029 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 682703us
I20260709 12:11:05.888265 26366 catalog_manager.cc:5697] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 2 to 6, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 6 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:06.119130 26465 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:06.117713 26366 catalog_manager.cc:5697] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 4 to 7, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 7 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:06.121529 26366 catalog_manager.cc:5697] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 3 to 8, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 8 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:11:06.123850 26617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 2013) took 2595 ms (client timeout 1852 ms). Trace:
I20260709 12:11:06.129057 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:06.129289 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:06.128088 26465 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:06.099994 30020 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:06.104224 30080 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:06.102720 29448 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:06.125685 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.124416 26617 rpcz_store.cc:269] 0709 12:11:03.513348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.635336 (+121988us) service_pool.cc:224] Handling call
0709 12:11:06.108849 (+2473513us) spinlock_profiling.cc:243] Waited 2.45 s on lock 0x7b54000023d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:06.108993 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5643406208}
I20260709 12:11:06.132064 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:06.149991 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:06.161165 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:06.171833 26620 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.166024 26539 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:06.107784 29832 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.172818 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:06.173686 27166 raft_consensus.cc:2393] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 8: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:06.175199 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:06.170578 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:06.175940 27166 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 7: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:06.078768 30148 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:06.168220 26471 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 9 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:06.180461 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:06.180869 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:06.180461 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:06.182199 26539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:11:06.220542 26468 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:11:06.185249 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:06.229350 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 58386.4us
I20260709 12:11:06.185012 30156 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:06.180913 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:06.187283 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:06.124480 30158 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:11:06.124536 30056 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:11:06.190129 30160 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:06.186878 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:06.192936 26588 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:06.095477 30155 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:11:06.194272 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:06.337903 26617 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.342185 27166 raft_consensus.cc:2368] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10.
W20260709 12:11:06.136075 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 356425us
W20260709 12:11:06.344138 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 157343us
I20260709 12:11:06.135751 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:06.125605 30134 consensus_meta.cc:287] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.003s
I20260709 12:11:06.131408 30114 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.141696 26366 catalog_manager.cc:5697] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:06.195614 30165 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:06.129493 30028 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.094866 30169 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 12:11:06.203495 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:06.204519 26620 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:11:06.355557 26542 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 11: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:06.355581 26616 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.356523 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:06.357267 26620 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:11:06.124187 30153 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:06.114513 30150 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:06.369892 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:06.213482 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:06.371215 26614 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:06.218797 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:06.371539 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:06.372502 26620 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.124949 30179 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:06.168038 30170 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:06.227916 26539 raft_consensus.cc:606] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:11:06.185071 26466 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:06.194274 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:06.237044 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 105041us
I20260709 12:11:06.116662 30047 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
W20260709 12:11:06.333628 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 69887.6us
I20260709 12:11:06.236349 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:06.108407 30151 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:06.235267 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:06.347937 26366 catalog_manager.cc:5697] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 6 to 9, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 9 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:11:06.227448 30044 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.407836 26366 catalog_manager.cc:5697] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:06.197257 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:06.348942 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:06.411199 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 62354.6us
I20260709 12:11:06.350266 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:06.158210 30146 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.011s	sys 0.023s
W20260709 12:11:06.417485 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 181270us
I20260709 12:11:06.368199 27159 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 11: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
W20260709 12:11:06.358361 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 165514us
I20260709 12:11:06.129540 30009 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.201s
I20260709 12:11:06.125711 29957 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.207s
I20260709 12:11:06.173728 30143 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:06.222798 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.326833 30124 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.390765 27168 raft_consensus.cc:2368] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8.
W20260709 12:11:06.426157 30146 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.141s	user 0.012s	sys 0.029s
I20260709 12:11:06.395797 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:06.467362 26467 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:06.335611 30171 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:06.412309 26613 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.412528 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:06.416896 26619 raft_consensus.cc:2410] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:06.416733 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:06.354246 30115 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:06.175128 30161 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.200s
W20260709 12:11:06.358661 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.423735 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:06.497325 26621 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:06.445147 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:06.497622 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:06.361317 30169 consensus_queue.cc:1243] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:11:06.426863 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:06.444401 26464 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:11:06.215140 29448 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:06.229144 29832 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:06.350335 30016 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:11:06.459573 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:06.467276 26588 leader_election.cc:400] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10.
I20260709 12:11:06.470822 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:06.394663 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:06.386829 30179 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:06.233809 30082 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:06.361531 30028 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:06.338413 30135 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:06.506801 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:06.507015 26614 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:06.507414 30172 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.515857 26617 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:11:06.507674 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1953) took 1323 ms. Trace:
I20260709 12:11:06.519088 26548 rpcz_store.cc:276] 0709 12:11:05.183817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.237716 (+ 53899us) service_pool.cc:224] Handling call
0709 12:11:05.238070 (+   354us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:05.312012 (+ 73942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.312053 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:05.436202 (+124149us) log.cc:844] Serialized 52 byte log entry
0709 12:11:06.106861 (+670659us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:06.352734 (+245873us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.360188 (+  7454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.360987 (+   799us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.507439 (+146452us) raft_consensus.cc:1685] finished
0709 12:11:06.507463 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.507614 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83246,"prepare.queue_time_us":89526,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":81117,"raft.run_cpu_time_us":840,"raft.run_wall_time_us":144308,"thread_start_us":847687,"threads_started":2,"wal-append.queue_time_us":1008887}
I20260709 12:11:06.474687 26618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:48232
I20260709 12:11:06.507480 30007 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:11:06.545102 26622 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:06.545506 26622 pending_rounds.cc:85] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 5
I20260709 12:11:06.450917 30177 raft_consensus.cc:2764] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:11:06.547319 30036 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:06.355068 30114 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:06.547619 29832 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:06.547926 30036 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:06.460289 26514 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:06.548772 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 88587.4us
I20260709 12:11:06.548961 30036 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:06.549466 30114 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:06.549540 26514 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:06.492271 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:06.550662 30177 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:06.498656 26544 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 7: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:06.358301 30134 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:06.459820 29900 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.494730 30124 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:06.512584 30157 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:06.409572 30170 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:06.532814 26470 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:06.533955 30151 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:06.468884 30143 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.490710 30188 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:06.499094 30141 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.485937 30160 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:11:06.537853 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1951) took 1355 ms. Trace:
I20260709 12:11:06.556576 30028 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:06.541445 30046 consensus_meta.cc:287] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.000s
I20260709 12:11:06.542384 30148 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:06.543790 30156 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:06.446944 30044 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:06.474476 30068 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:06.545570 26618 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:06.616225 26618 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.452920 26620 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:06.614043 26548 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 10. Ops: []
I20260709 12:11:06.617781 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:06.546729 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 134291us
I20260709 12:11:06.618992 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:06.558619 30183 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:06.628152 26620 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:06.502665 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:06.552038 26622 pending_rounds.cc:107] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:06.629467 26622 raft_consensus.cc:2889] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:06.629616 26620 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:06.629933 26620 pending_rounds.cc:85] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 5
I20260709 12:11:06.458982 26616 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:11:06.630149 26620 pending_rounds.cc:107] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:06.513825 26464 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:06.631886 26617 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:06.513895 26588 leader_election.cc:403] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:06.556129 30135 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:06.555987 26471 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:06.558321 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:06.512787 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:06.577708 26613 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:06.508596 30117 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:06.515681 30172 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:06.580876 30157 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:06.459311 30062 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.583439 26621 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:06.514521 30082 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:06.512917 30179 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:06.583760 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:06.656944 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:06.657421 26540 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:06.595633 26547 rpcz_store.cc:276] 0709 12:11:05.182021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.220180 (+ 38159us) service_pool.cc:224] Handling call
0709 12:11:05.228385 (+  8205us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:05.267272 (+ 38887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.267306 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:05.272247 (+  4941us) log.cc:844] Serialized 26 byte log entry
0709 12:11:05.812346 (+540099us) spinlock_profiling.cc:243] Waited 55.2 ms on lock 0x7b4800270258. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507b003aa1 00007f507affab37 00007f507affa9ca 00007f507b0f226f 00007f507b0f1f37 00007f507b10655c 00007f507b106508 00007f507b106488 00007f507b106443 00007f507b1056ec 00007f507a02fa96
0709 12:11:06.115298 (+302952us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:06.115364 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.115472 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.537507 (+422035us) raft_consensus.cc:1685] finished
0709 12:11:06.537531 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.537776 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38494,"raft.queue_time_us":63330,"raft.run_cpu_time_us":5290,"raft.run_wall_time_us":497179,"spinlock_wait_cycles":126966016,"thread_start_us":740499,"threads_started":1,"wal-append.queue_time_us":1074122}
I20260709 12:11:06.547680 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:06.658847 26473 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:06.660036 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:06.609529 30184 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:06.626294 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:06.582111 30143 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.634117 27168 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:06.634353 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 121639us
I20260709 12:11:06.627985 30183 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:06.641197 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:11:06.632798 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 165724us
I20260709 12:11:06.635257 26620 raft_consensus.cc:2889] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:06.682570 27162 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:06.682842 26588 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:06.597667 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:06.572459 29900 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:06.693140 29900 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:06.654286 27165 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:06.675952 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:06.613411 30046 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:06.695144 30134 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:06.695294 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:06.695919 26545 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:06.697108 30046 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:06.643702 30185 consensus_queue.cc:1059] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:11:06.639683 29867 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:06.698477 30124 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:06.698876 30156 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:06.699957 26614 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:06.700381 26614 pending_rounds.cc:85] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 5
I20260709 12:11:06.700165 30044 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:06.700740 26614 pending_rounds.cc:107] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:06.665509 30184 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:06.701058 26614 raft_consensus.cc:2889] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:06.702044 30184 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:06.703213 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:06.703995 26473 raft_consensus.cc:2368] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8.
I20260709 12:11:06.704923 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:06.705662 26473 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:06.705834 30183 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:06.660058 30062 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:06.708518 30062 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:06.708704 30165 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.644356 30188 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:06.604086 30141 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:06.709466 30165 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:06.711191 30206 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:11:06.711400 30141 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:06.650138 30028 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:06.713820 30028 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:06.581686 26465 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 10: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:06.685310 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:06.686013 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:06.715204 26464 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:06.685698 30135 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:06.628479 30068 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:06.648803 30117 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:06.688694 30157 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:06.690333 30172 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:06.706604 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:06.706350 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:06.718382 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:06.653121 30160 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10.
I20260709 12:11:06.678067 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:06.718128 27168 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:11:06.728320 30028 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:06.724813 26473 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:06.737366 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:06.737460 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:06.738379 27165 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 9: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:06.647627 30174 consensus_queue.cc:1059] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:11:06.738276 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:06.745616 26548 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
W20260709 12:11:06.747027 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 69066.4us
I20260709 12:11:06.747977 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:06.746989 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:06.755615 27160 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:11:06.731848 30045 consensus_meta.cc:287] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.657s	user 0.010s	sys 0.003s
I20260709 12:11:06.768347 26540 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:06.767117 27162 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:11:06.769897 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:06.786970 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:06.758858 30062 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.808629 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:06.809897 26613 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:06.811034 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:06.792418 26545 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:06.811808 26613 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 9: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:06.811911 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:06.795095 27168 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:06.812577 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:06.796674 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:06.813376 26545 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:06.725499 29985 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:11:06.816793 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:06.763963 30044 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:06.787884 30161 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:06.794363 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:06.815907 27165 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:11:06.763235 30020 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:06.817473 26548 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:11:06.829434 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:06.839414 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:06.841499 26616 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:06.808032 30135 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:06.806674 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:06.814283 30156 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:06.869549 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:06.784875 30045 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:06.831851 30020 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.887259 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:06.889902 27134 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:06.835361 29900 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:06.873405 30135 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.892251 30135 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.894131 30114 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:06.894680 30114 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:06.895534 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:06.896220 26622 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.897172 30068 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:06.899040 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:06.904055 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:06.904974 26546 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:06.923493 27160 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 8: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:06.924263 30117 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:06.925050 30117 raft_consensus.cc:3055] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:06.925436 30117 raft_consensus.cc:740] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:06.892257 29900 raft_consensus.cc:697] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:06.887269 30165 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:06.927345 29900 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:06.888437 30156 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:06.935998 26613 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.946312 30045 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:06.946971 30114 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:06.948284 30114 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.827167 30062 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:06.953963 30062 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:06.875342 30044 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:06.955660 26618 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:06.956012 26546 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:06.956429 30170 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:06.876621 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:06.957726 27163 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 11: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:06.861620 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:06.959563 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:06.996583 26619 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:06.996803 26548 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:06.997273 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:06.997876 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:06.996420 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:07.062467 26618 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:06.998368 26540 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:11:07.005472 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 435806us
I20260709 12:11:07.003561 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:07.090711 26546 raft_consensus.cc:2376] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10. Re-sending same reply.
I20260709 12:11:06.992687 26464 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
W20260709 12:11:07.091604 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 230075us
W20260709 12:11:07.036311 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 375029us
I20260709 12:11:06.976074 26622 raft_consensus.cc:2410] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:11:07.100013 26613 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:11:07.102802 26548 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:11:07.110788 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.102617 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:06.975379 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:07.113946 26545 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 10: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:07.113106 26587 leader_election.cc:400] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8.
I20260709 12:11:07.115938 26587 leader_election.cc:403] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:11:07.122960 26540 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.139998 26513 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:06.998282 30045 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.137373 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:06.939375 30117 consensus_queue.cc:260] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:07.182610 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:07.183373 26622 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:07.190857 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:11:07.196187 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 56275.1us
I20260709 12:11:07.046025 30177 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:07.197778 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:07.194113 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:07.200736 26439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.044s	sys 0.023s
W20260709 12:11:07.201606 26439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.045s	sys 0.024s
I20260709 12:11:07.198155 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 1843) took 1178 ms. Trace:
I20260709 12:11:07.202689 26542 rpcz_store.cc:276] 0709 12:11:06.005251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.005402 (+   151us) service_pool.cc:224] Handling call
0709 12:11:07.182965 (+1177563us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b54002f80d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:07.183131 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":764167936}
I20260709 12:11:07.138706 29867 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8.
I20260709 12:11:07.213289 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:07.214603 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:07.226881 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:07.025952 30179 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:07.228739 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:07.217027 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:07.198957 30150 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.234649 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:07.145902 30020 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:07.246522 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:07.257510 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:07.259891 26620 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 8: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:07.276587 26543 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:07.274231 26618 raft_consensus.cc:2410] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:11:07.297423 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 407554us
I20260709 12:11:07.215144 30166 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:11:07.236634 30174 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:07.300244 27134 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:07.260037 30219 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:07.269295 30227 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:07.357787 30220 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:07.357955 29448 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:07.272954 30213 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 12:11:07.358448 30220 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:07.359325 26548 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:11:07.354019 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 53910.9us
W20260709 12:11:07.265877 30183 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.000s
I20260709 12:11:07.386233 30183 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:07.388686 30183 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:07.389703 26546 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:07.389957 26547 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:11:07.265058 30143 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.570s	user 0.007s	sys 0.002s
I20260709 12:11:07.413707 26540 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:11:07.274258 30130 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:07.433810 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:07.222334 30172 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 12:11:07.329008 30068 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:07.499919 26548 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:07.508095 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 473) took 1396 ms. Trace:
I20260709 12:11:07.545913 26467 rpcz_store.cc:276] 0709 12:11:06.111632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.111800 (+   168us) service_pool.cc:224] Handling call
0709 12:11:06.157539 (+ 45739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.475961 (+318422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.507650 (+1031689us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54000a4e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:07.507987 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":708698880}
I20260709 12:11:07.366420 30174 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:07.467657 30227 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:07.459122 30143 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:07.507596 29900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.014s	sys 0.031s
I20260709 12:11:07.617611 30068 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:11:07.649189 30173 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.026s	sys 0.028s
W20260709 12:11:07.685322 30158 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.002s	sys 0.044s
I20260709 12:11:07.802094 30068 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:07.516058 30177 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:07.795341 29900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.015s	sys 0.032s
W20260709 12:11:07.810283 30173 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.028s	sys 0.030s
I20260709 12:11:07.842489 26545 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 9: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:07.819815 30183 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.934926 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:07.935645 30183 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:07.936846 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 739134us
W20260709 12:11:07.864204 30223 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.505s	user 0.001s	sys 0.000s
I20260709 12:11:07.942632 30227 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:07.937835 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 691483us
I20260709 12:11:07.667711 30219 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:07.947491 30219 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:07.948670 30219 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:07.929005 26540 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:07.955844 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:07.938236 30183 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:07.820864 30135 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.928s	user 0.013s	sys 0.000s
I20260709 12:11:07.957108 26622 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.824070 30174 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:07.653080 30220 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:07.971257 26542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.008s	sys 0.006s
W20260709 12:11:07.976037 26542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.009s	sys 0.006s
I20260709 12:11:07.957755 30135 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
W20260709 12:11:07.965642 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 568672us
W20260709 12:11:07.988016 26588 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.68:35069 timed out after 2.080s (SENT) [suppressed 35 similar messages]
I20260709 12:11:07.983585 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:07.962630 30148 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.010s	sys 0.012s
I20260709 12:11:08.000857 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:07.964764 30157 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.002079 26548 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:08.005981 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:07.967152 29900 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.011889 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:08.007735 26547 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:11:07.978690 30183 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:08.057657 29900 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.010763 29448 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:11:08.063836 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 129034us
W20260709 12:11:07.968276 30155 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.003s	sys 0.010s
W20260709 12:11:08.002681 30148 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.011s	sys 0.013s
I20260709 12:11:08.000053 30174 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.019536 26615 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:08.024948 26622 raft_consensus.cc:2410] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:08.001469 30020 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:07.950198 30219 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.989764 30172 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:08.011776 30179 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:08.031383 30232 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.533s	user 0.001s	sys 0.001s
W20260709 12:11:08.045994 27134 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.020s	sys 0.018s
I20260709 12:11:08.060601 30183 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:07.977245 30166 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:08.063055 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:08.067003 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:08.068010 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 2056) took 1179 ms. Trace:
I20260709 12:11:08.082017 26622 rpcz_store.cc:276] 0709 12:11:06.888994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.266968 (+377974us) service_pool.cc:224] Handling call
0709 12:11:08.067900 (+800932us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:08.083278 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:08.067903 30114 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.055711 30165 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.088833 30165 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.073007 30177 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.090698 30177 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.093287 30177 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:08.066582 30155 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.004s	sys 0.011s
W20260709 12:11:08.076572 27134 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.021s	sys 0.019s
I20260709 12:11:08.078593 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 500) took 1918 ms. Trace:
I20260709 12:11:08.079684 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 480) took 1896 ms. Trace:
W20260709 12:11:08.097167 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 664038us
I20260709 12:11:08.083910 26622 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:11:08.097893 27134 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:08.097239 26619 rpcz_store.cc:276] 0709 12:11:06.160071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.522091 (+362020us) service_pool.cc:224] Handling call
0709 12:11:06.536268 (+ 14177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.997125 (+460857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.078285 (+1081160us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54003d9854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:08.078521 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034237184}
I20260709 12:11:08.078235 30172 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.081881 30130 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.082518 30143 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:08.067698 29448 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.088099 30252 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.095021 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:08.014685 30157 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:08.097371 26472 rpcz_store.cc:276] 0709 12:11:06.183519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.183650 (+   131us) service_pool.cc:224] Handling call
0709 12:11:06.183993 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.600354 (+416361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.600386 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:06.600430 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:06.600521 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.079422 (+1478901us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54003147d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:08.079481 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.079619 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":957034368}
I20260709 12:11:08.099721 26540 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:11:08.099848 30114 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.096210 30250 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.100929 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:08.100530 26514 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:08.077355 30233 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:08.104331 29900 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.103118 30165 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.108856 30219 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:11:08.103240 30208 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.914s	user 0.010s	sys 0.004s
I20260709 12:11:08.114666 30254 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.127727 30242 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:08.128152 30234 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:11:08.186906 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:08.188313 26622 raft_consensus.cc:2410] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:08.128769 29448 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.130436 30183 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:08.134745 30172 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:08.135488 30135 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.168849 30250 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:08.136705 30251 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:11:08.137110 30177 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:08.137593 30143 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:08.124125 30252 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.094748 30166 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.209635 30177 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:08.209913 30166 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:08.138293 30179 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:08.210772 30177 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.140645 26588 leader_election.cc:400] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8.
W20260709 12:11:08.212502 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 72068.6us
I20260709 12:11:08.182612 30242 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.175861 30176 raft_consensus.cc:3055] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:11:08.177282 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 74769.6us
I20260709 12:11:08.110793 30130 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.136533 26514 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:08.217129 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 80685.4us
I20260709 12:11:08.218923 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:08.219794 26622 raft_consensus.cc:2410] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:08.180308 30219 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:08.173604 30233 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 9 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:08.138041 29985 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:08.136345 30157 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:08.196463 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 101520us
I20260709 12:11:08.216631 30176 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:08.216092 30250 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:08.225400 30130 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:08.190116 30254 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.243970 30250 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:08.245862 30254 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.229696 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 472) took 2118 ms. Trace:
I20260709 12:11:08.234771 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:08.233940 29985 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:08.246908 26469 rpcz_store.cc:276] 0709 12:11:06.111287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.111419 (+   132us) service_pool.cc:224] Handling call
0709 12:11:06.131318 (+ 19899us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:06.181107 (+ 49789us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.181140 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:06.361012 (+179872us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b2c000327f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:11:06.410726 (+ 49714us) log.cc:844] Serialized 26 byte log entry
0709 12:11:06.829983 (+419257us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:06.830021 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.830091 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.102687 (+1272596us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:08.229446 (+126759us) raft_consensus.cc:1685] finished
0709 12:11:08.229468 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.229625 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2702,"raft.queue_time_us":22089,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":107383936,"thread_start_us":344918,"threads_started":1,"wal-append.queue_time_us":573413}
I20260709 12:11:08.247833 29985 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:08.235411 30135 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.248994 30135 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.236558 29900 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.218575 30143 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:08.250770 30143 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:08.250707 29900 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.251253 30135 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.251439 30143 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.253206 29900 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.236119 30233 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:08.255549 30219 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:08.237076 30020 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:08.239888 30176 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:08.258148 30176 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.237146 30165 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:08.216493 29448 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:11:08.258901 30165 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:08.216996 30242 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.227104 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:08.246556 30246 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.186s	user 0.000s	sys 0.002s
I20260709 12:11:08.264456 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1958) took 1171 ms. Trace:
I20260709 12:11:08.257587 30020 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.267097 30252 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.237286 30255 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.262032 30165 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:08.268767 26622 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:11:08.264838 26542 rpcz_store.cc:276] 0709 12:11:07.092913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.237489 (+144576us) service_pool.cc:224] Handling call
0709 12:11:07.238419 (+   930us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.238844 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.238887 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.239468 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 12:11:07.976582 (+737114us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:07.976634 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.976728 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.230964 (+254236us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:08.264161 (+ 33197us) raft_consensus.cc:1685] finished
0709 12:11:08.264186 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.264395 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2515840,"thread_start_us":582201,"threads_started":1,"wal-append.queue_time_us":756135}
I20260709 12:11:08.271127 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:08.287245 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.291414 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:08.291663 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.277143 30231 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:08.294731 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:08.290693 29448 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:08.305397 29448 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.288431 30165 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:08.306644 30032 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:08.287900 30219 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:08.289476 29900 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:08.292304 30252 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.317405 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2714) took 2085 ms. Trace:
I20260709 12:11:08.298007 30251 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.321024 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:08.324307 30156 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:08.333473 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:08.334510 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:08.334924 30219 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.336642 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 508) took 1845 ms. Trace:
I20260709 12:11:08.337023 30176 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:08.352134 26543 rpcz_store.cc:276] 0709 12:11:06.491238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.491468 (+   230us) service_pool.cc:224] Handling call
0709 12:11:06.502595 (+ 11127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.297107 (+794512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.336361 (+1039254us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b54000b5254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:08.336570 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1779158912}
I20260709 12:11:08.340734 30117 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:08.342875 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:08.344185 27160 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:11:08.347981 26617 rpcz_store.cc:276] 0709 12:11:06.231920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.516774 (+284854us) service_pool.cc:224] Handling call
0709 12:11:06.631635 (+114861us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:06.632249 (+   614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.317199 (+1684950us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400379e50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:08.317345 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263268736}
I20260709 12:11:08.315970 30020 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.348717 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:08.327472 30263 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:08.361953 30263 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.364290 30263 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:08.364485 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.296018 30259 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.353291 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:08.353458 26547 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 10: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:08.317926 30032 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.365979 30032 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.363785 30242 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:08.277865 30255 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.362236 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:08.364305 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:08.360854 27162 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 11: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:08.354867 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:08.387190 30020 raft_consensus.cc:2764] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:11:08.369607 30236 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.308s	user 0.001s	sys 0.001s
I20260709 12:11:08.350364 26619 raft_consensus.cc:2410] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:08.366770 30184 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.374037 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 1965) took 1259 ms. Trace:
I20260709 12:11:08.373416 30219 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:08.349701 29900 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.317874 30165 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.351806 30252 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.383823 30114 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.387701 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:08.398540 26617 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:11:08.400208 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:08.366688 30143 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.387749 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:08.390264 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 75340.7us
W20260709 12:11:08.394150 26465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 476) took 2231 ms (client timeout 2781 ms). Trace:
W20260709 12:11:08.419195 26465 rpcz_store.cc:269] 0709 12:11:06.160670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.160794 (+   124us) service_pool.cc:224] Handling call
0709 12:11:08.391908 (+2231114us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b540027b0d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:08.392024 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":941750656}
I20260709 12:11:08.419708 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:08.420607 30255 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.421238 30255 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:08.421782 30255 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:08.394552 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2713) took 2231 ms. Trace:
I20260709 12:11:08.422566 26614 rpcz_store.cc:276] 0709 12:11:06.162761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.511951 (+349190us) service_pool.cc:224] Handling call
0709 12:11:06.512442 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.701638 (+189196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.394251 (+1692613us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b540003c354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:08.394486 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430320000}
I20260709 12:11:08.422766 30255 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:08.424000 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:08.424850 26614 raft_consensus.cc:2410] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:11:08.392765 26545 rpcz_store.cc:276] 0709 12:11:07.114947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.137002 (+ 22055us) service_pool.cc:224] Handling call
0709 12:11:08.373837 (+1236835us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b5400337cd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:08.373975 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1517316352}
I20260709 12:11:08.385748 30263 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.426501 30263 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.396986 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:08.397279 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2804) took 2001 ms. Trace:
I20260709 12:11:08.428067 26619 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:08.401865 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:08.428202 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:08.418013 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:08.433355 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:08.434612 27162 raft_consensus.cc:2410] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:11:08.432857 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:08.435357 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:08.437398 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:08.438006 27160 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:08.438282 27159 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 10: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:08.438571 30219 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:08.438697 30263 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.439105 30219 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:08.439411 30156 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:08.439906 30156 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.439601 30219 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.440497 30156 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.440555 30188 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:08.441401 30188 consensus_queue.cc:1243] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:11:08.439847 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 1.23699e+06us
I20260709 12:11:08.444047 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2812) took 1974 ms. Trace:
I20260709 12:11:08.435657 27164 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:11:08.447681 27163 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:08.447764 30191 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:08.448382 27163 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:08.444500 26471 rpcz_store.cc:276] 0709 12:11:06.469398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.643293 (+173895us) service_pool.cc:224] Handling call
0709 12:11:06.643635 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:06.651311 (+  7676us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:06.715692 (+ 64381us) log.cc:844] Serialized 14 byte log entry
0709 12:11:08.440596 (+1724904us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:08.441057 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.441241 (+   184us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:08.441278 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.441346 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.443828 (+  2482us) raft_consensus.cc:1685] finished
0709 12:11:08.443847 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.443982 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1224798,"prepare.queue_time_us":64334,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":4456,"raft.queue_time_us":1226343,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":12927,"thread_start_us":491707,"threads_started":1,"wal-append.queue_time_us":1270302}
I20260709 12:11:08.449407 27163 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:08.449944 30227 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.450608 30227 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:08.451258 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2045) took 1642 ms. Trace:
I20260709 12:11:08.452003 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 2055) took 1580 ms. Trace:
I20260709 12:11:08.452502 26620 rpcz_store.cc:276] 0709 12:11:06.871318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.216741 (+345423us) service_pool.cc:224] Handling call
0709 12:11:08.451804 (+1235063us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b540009f1d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:08.451942 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60400512}
I20260709 12:11:08.451668 26621 rpcz_store.cc:276] 0709 12:11:06.808842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.809871 (+  1029us) service_pool.cc:224] Handling call
0709 12:11:06.810191 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:06.810574 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.810601 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:06.819423 (+  8822us) log.cc:844] Serialized 26 byte log entry
0709 12:11:07.380037 (+560614us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:07.380103 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.380209 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.368919 (+988710us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:08.445982 (+ 77063us) raft_consensus.cc:1685] finished
0709 12:11:08.446009 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.451190 (+  5181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3835,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":15911,"spinlock_wait_cycles":3452800,"thread_start_us":471936,"threads_started":1,"wal-append.queue_time_us":1187302}
I20260709 12:11:08.453967 26620 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:08.454589 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:08.455291 27163 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.455459 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2059) took 1565 ms. Trace:
I20260709 12:11:08.433295 30114 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:08.455825 26620 rpcz_store.cc:276] 0709 12:11:06.889785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.453360 (+1563575us) service_pool.cc:224] Handling call
0709 12:11:08.453739 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:08.454357 (+   618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.455403 (+  1046us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:08.465045 27165 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
W20260709 12:11:08.467975 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.473662 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:08.474735 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:08.475409 27133 leader_election.cc:336] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.590s (SENT)
I20260709 12:11:08.477969 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:08.482976 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:08.489440 26620 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:08.489677 26472 raft_consensus.cc:2393] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 7: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:08.490025 26471 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:08.490224 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2061) took 1496 ms. Trace:
I20260709 12:11:08.491355 30080 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.485033 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:08.486127 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:08.492653 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:08.493170 26467 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:08.493294 26473 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.493872 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:08.488379 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:08.483407 30060 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:08.497210 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:08.491200 26620 rpcz_store.cc:276] 0709 12:11:06.993760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.488877 (+1495117us) service_pool.cc:224] Handling call
0709 12:11:08.489204 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:08.489950 (+   746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.490169 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:08.493188 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:08.497936 26545 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:08.397828 30032 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:08.496186 27133 leader_election.cc:336] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.721s (SENT)
W20260709 12:11:08.496384 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 53168.9us
I20260709 12:11:08.508200 26439 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:08.472072 30009 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:08.495914 26472 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:08.487398 30215 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.512126 26620 raft_consensus.cc:1217] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-8.4]   Dedup: 2.2->[4.3-8.4]
I20260709 12:11:08.503890 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:08.513841 26542 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:08.486186 30221 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.505712 26470 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:11:08.506873 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:08.519937 26465 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 9: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:08.465641 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:08.509089 27168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 531) took 1744 ms. Trace:
I20260709 12:11:08.452888 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:08.520376 27168 rpcz_store.cc:276] 0709 12:11:06.764753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.765249 (+   496us) service_pool.cc:224] Handling call
0709 12:11:06.794507 (+ 29258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.812570 (+ 18063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.508347 (+1695777us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b540014fad0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:08.509015 (+   668us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66281728}
I20260709 12:11:08.511893 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:08.488055 30158 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.512566 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:08.501997 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:08.523759 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 510) took 1965 ms. Trace:
I20260709 12:11:08.504927 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1957) took 1412 ms. Trace:
I20260709 12:11:08.488010 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:08.515656 26620 pending_rounds.cc:85] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 2
I20260709 12:11:08.534637 26620 pending_rounds.cc:107] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:11:08.516359 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:08.516322 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:08.501161 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2058) took 1611 ms. Trace:
I20260709 12:11:08.535801 26620 raft_consensus.cc:2889] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:08.535600 26619 rpcz_store.cc:276] 0709 12:11:06.889536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.439418 (+1549882us) service_pool.cc:224] Handling call
0709 12:11:08.439833 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:08.440083 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.440110 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:08.445493 (+  5383us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.500836 (+ 55343us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:08.500875 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.500944 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.500986 (+    42us) raft_consensus.cc:1685] finished
0709 12:11:08.500996 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.501106 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":46508,"threads_started":1,"wal-append.queue_time_us":36411}
I20260709 12:11:08.521675 26472 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
W20260709 12:11:08.522194 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.517349 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:08.524159 26544 rpcz_store.cc:276] 0709 12:11:06.558716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.558871 (+   155us) service_pool.cc:224] Handling call
0709 12:11:06.559260 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:06.712430 (+153170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.712504 (+    74us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:06.713083 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 12:11:07.096469 (+383386us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:07.096510 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.515235 (+1418725us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540018b5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:08.515288 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.515332 (+    44us) raft_consensus.cc:1685] finished
0709 12:11:08.515343 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.523698 (+  8355us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9355,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":16032,"spinlock_wait_cycles":351351040,"thread_start_us":382711,"threads_started":1,"wal-append.queue_time_us":514115,"wal-append.run_cpu_time_us":2286,"wal-append.run_wall_time_us":1038584}
I20260709 12:11:08.538810 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:08.539588 26472 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:08.540093 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:08.531884 29900 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.543107 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:08.529991 26473 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
W20260709 12:11:08.530897 30267 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:11:08.506119 30060 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:08.548563 30160 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.549252 30160 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.550778 30252 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.550714 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:08.537181 30158 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:08.552505 30269 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:11:08.544111 27159 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:11:08.553699 30158 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:08.524533 26546 rpcz_store.cc:276] 0709 12:11:07.092536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.103377 (+ 10841us) service_pool.cc:224] Handling call
0709 12:11:07.103771 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.390227 (+286456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.504656 (+1114429us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b54002f8ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:08.504863 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":656962432}
I20260709 12:11:08.533977 27168 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:11:08.534842 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 82032.5us
I20260709 12:11:08.545872 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:08.497936 30080 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.546654 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:08.514882 30151 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:08.560020 26539 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:08.547278 30016 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:08.560456 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:08.507046 30169 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:11:08.561508 26546 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 9: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:08.563514 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:08.564105 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:08.566877 26472 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:08.567044 26465 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 10: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:08.567462 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:08.559239 30117 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:08.565054 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:08.516073 30009 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.518916 30215 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.533187 30221 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.601073 29900 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.601557 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:08.747116 26546 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:08.602435 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:08.739899 26619 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:11:08.729990 30263 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:08.559653 30068 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.005s	sys 0.037s
I20260709 12:11:08.740916 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:08.741394 26464 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.680536 26539 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:11:08.682770 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.682052 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:08.600714 30155 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.172s
I20260709 12:11:08.748612 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:08.756104 26542 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:08.749677 26465 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:11:08.758963 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:08.603384 26613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 2052) took 1736 ms (client timeout 1735 ms). Trace:
I20260709 12:11:08.561645 30016 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.543466 30149 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:08.603899 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:08.755043 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.761714 26470 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 9: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:08.539088 30146 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.755411 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:08.756062 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:08.757786 26546 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
W20260709 12:11:08.664155 30267 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 12:11:08.760463 26613 rpcz_store.cc:269] 0709 12:11:06.866703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.869190 (+  2487us) service_pool.cc:224] Handling call
0709 12:11:08.603139 (+1733949us) spinlock_profiling.cc:243] Waited 58.8 ms on lock 0x7b5400033254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:08.603293 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135198592}
I20260709 12:11:08.776150 26613 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:08.734748 30183 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.777802 26613 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:08.724265 30143 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:08.768121 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:08.770116 26618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 2053) took 1899 ms (client timeout 1964 ms). Trace:
W20260709 12:11:08.783522 26618 rpcz_store.cc:269] 0709 12:11:06.870680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.193751 (+323071us) service_pool.cc:224] Handling call
0709 12:11:08.769895 (+1576144us) spinlock_profiling.cc:243] Waited 73.4 ms on lock 0x7b5400267d54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:08.770050 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168816896}
I20260709 12:11:08.771117 26469 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:08.773120 26465 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:08.752041 30068 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.028s	sys 0.064s
I20260709 12:11:08.778824 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:08.788834 26539 raft_consensus.cc:2410] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:08.780333 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:08.790515 26543 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:11:08.790786 30080 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:08.791965 26471 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:11:08.753190 29992 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:08.778712 26466 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:08.767150 30149 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.568100 30173 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.216s
I20260709 12:11:08.794682 26613 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:08.762840 30254 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.802038 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:08.766862 30016 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.804134 26613 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:08.804502 26465 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 10: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:08.754804 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:08.807749 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 53028us
I20260709 12:11:08.809242 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:08.792340 30160 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.566263 30242 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.633863 30255 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.794898 26464 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:08.752942 30165 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.802194 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:08.763995 29900 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:08.810631 27163 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:11:08.814263 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:08.814815 26618 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:11:08.820760 26618 pending_rounds.cc:85] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 4
I20260709 12:11:08.821086 26618 pending_rounds.cc:107] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:11:08.821106 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:08.822041 26618 raft_consensus.cc:2889] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:08.793102 29992 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.778748 30146 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:08.799057 30149 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:08.823580 26613 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:08.827065 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.763339 30263 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.828269 26619 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:08.786801 30183 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.813628 30252 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:08.817077 30009 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:08.816548 30251 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.821187 30114 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:08.837136 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.824893 30165 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:08.824299 30227 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:08.810642 30219 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.811221 30254 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:08.836225 30252 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.851162 30219 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:08.852341 30156 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.844554 30251 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:08.839545 30032 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.820111 30255 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:08.860430 30221 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:08.843520 30114 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.861231 30114 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.845546 30165 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.859370 30252 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.865337 30165 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.874161 30252 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:08.875033 30276 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:11:08.875666 30146 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:08.876519 30149 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.877067 30156 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.877203 30263 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.876552 30252 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.877895 30165 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:08.878726 30183 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:08.862218 30251 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:08.818257 26471 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:11:08.911744 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:08.915498 26473 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:11:08.927482 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 106327us
I20260709 12:11:08.929355 26514 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:08.787106 26542 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:08.914281 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:08.940624 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:08.940902 26545 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:08.948333 26471 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:11:08.949151 26469 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:08.959614 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2060) took 2069 ms. Trace:
I20260709 12:11:08.988175 26621 rpcz_store.cc:276] 0709 12:11:06.890048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.453385 (+1563337us) service_pool.cc:224] Handling call
0709 12:11:08.472408 (+ 19023us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:08.472892 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.472935 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:08.481897 (+  8962us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.741855 (+259958us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:08.741884 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.741937 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.959048 (+217111us) raft_consensus.cc:1685] finished
0709 12:11:08.959091 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.959387 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6131,"thread_start_us":226268,"threads_started":1,"wal-append.queue_time_us":252742}
I20260709 12:11:08.964877 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:08.991011 26613 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:11:08.992714 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:08.994043 26613 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 10: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
W20260709 12:11:08.966789 26615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 2054) took 2095 ms (client timeout 1718 ms). Trace:
I20260709 12:11:08.950109 26471 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:08.973102 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:08.994598 26615 rpcz_store.cc:269] 0709 12:11:06.871020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.963038 (+ 92018us) service_pool.cc:224] Handling call
0709 12:11:08.966178 (+2003140us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b54002602d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:08.966527 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2131436800}
I20260709 12:11:08.995321 26617 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:08.996191 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:08.997751 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:08.976096 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 527) took 1001 ms. Trace:
I20260709 12:11:08.998629 26540 rpcz_store.cc:276] 0709 12:11:07.974747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.011590 (+ 36843us) service_pool.cc:224] Handling call
0709 12:11:08.975671 (+964081us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b54003377d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:08.975899 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101627136}
I20260709 12:11:08.942134 26539 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:08.984933 26438 connection.cc:256] RPC call timeout handler was delayed by -1.2964085119999709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
I20260709 12:11:08.985580 26614 pending_rounds.cc:85] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 3
W20260709 12:11:09.000418 26438 connection.cc:256] RPC call timeout handler was delayed by -1.2496085119998952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
I20260709 12:11:09.000515 26614 pending_rounds.cc:107] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 7.4
W20260709 12:11:09.000844 26438 connection.cc:256] RPC call timeout handler was delayed by -1.0750085120000676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
I20260709 12:11:09.000941 26614 raft_consensus.cc:2889] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:08.945421 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.002765 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:09.004156 26615 raft_consensus.cc:2410] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 15 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:11:08.984040 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:09.005167 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:08.987161 26544 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:08.998929 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:08.981600 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:08.856864 29992 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:08.856415 30016 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:09.045882 30251 consensus_queue.cc:1059] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:09.023710 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:08.427981 26468 rpcz_store.cc:276] 0709 12:11:06.396107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.505614 (+109507us) service_pool.cc:224] Handling call
0709 12:11:06.505993 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:06.597997 (+ 92004us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.598029 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:06.609133 (+ 11104us) log.cc:844] Serialized 26 byte log entry
0709 12:11:07.046373 (+437240us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:07.100294 (+ 53921us) log.cc:844] Serialized 14 byte log entry
0709 12:11:08.394251 (+1293957us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b18002cb2a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5072fefa40 00007f5072fea4e4 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287 00007f50760f5208
0709 12:11:08.396869 (+  2618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.396944 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.396986 (+    42us) raft_consensus.cc:1685] finished
0709 12:11:08.397080 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.397217 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":218927,"prepare.queue_time_us":60113,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":48,"raft.queue_time_us":1391504,"raft.run_cpu_time_us":18099,"raft.run_wall_time_us":28182,"spinlock_wait_cycles":7207168,"thread_start_us":432840,"threads_started":1,"wal-append.queue_time_us":714373,"wal-append.run_cpu_time_us":2272,"wal-append.run_wall_time_us":1031311}
I20260709 12:11:09.028270 26618 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:08.878769 30149 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:09.029318 30143 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:09.033578 30183 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:08.880116 30215 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:09.029290 26543 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:09.037237 30191 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.037514 30165 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:09.042754 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:09.052428 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:09.105465 26618 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:09.105355 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:09.107725 26618 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:09.107933 30191 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:09.109876 26618 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:09.050139 30016 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:09.068797 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:09.070752 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 64848.6us
I20260709 12:11:09.080307 26613 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:09.088286 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:09.047926 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.076005 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:09.055374 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:09.058964 29832 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.074779 30184 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:09.096990 30231 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:11:09.084252 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:09.061184 29957 raft_consensus.cc:3055] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:09.048285 30251 raft_consensus.cc:3055] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:09.046312 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:09.048679 30020 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.076752 29985 consensus_queue.cc:1059] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
W20260709 12:11:09.098446 30239 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 1.158s	user 0.001s	sys 0.003s
W20260709 12:11:09.094018 30204 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.753s	user 0.001s	sys 0.001s
I20260709 12:11:09.095639 29900 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:09.082990 30183 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:09.081856 30158 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:09.082752 30143 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:09.084003 30148 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.075103 30173 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.171691 30173 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:09.069442 30060 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:09.173193 30060 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.146780 29957 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:09.175959 29957 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:09.178627 30184 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:09.181883 30184 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:09.188259 26438 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:09.189836 29448 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:09.194415 26465 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:09.196125 29832 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:09.198633 30032 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:09.201387 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 237863us
I20260709 12:11:09.205021 30117 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:09.207050 30227 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:09.207561 30227 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:09.209007 30227 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:09.211351 30227 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:09.214140 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.052086 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:09.156073 26617 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:09.157864 30191 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:09.158774 26619 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:11:09.158380 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 112456us
I20260709 12:11:09.071357 30134 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:09.167014 27168 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:09.168102 30255 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:09.167999 30148 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:09.168515 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:09.158376 30016 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:09.162882 30143 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.170646 27167 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:09.148231 30251 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:09.159821 30158 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:11:09.225032 27166 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56886 (request call id 591) took 2287 ms (client timeout 1722 ms). Trace:
I20260709 12:11:09.159543 30183 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.178143 29957 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.247843 30020 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:09.250192 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:09.251264 27159 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
W20260709 12:11:09.253252 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 177649us
I20260709 12:11:09.254961 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:09.254631 30016 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:09.174290 30173 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:09.237970 27166 rpcz_store.cc:269] 0709 12:11:06.874216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.874427 (+   211us) service_pool.cc:224] Handling call
0709 12:11:09.054797 (+2180370us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:11:09.161936 (+107139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4633984}
I20260709 12:11:09.261054 26618 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:09.202374 30254 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:09.267329 26613 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:09.270855 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1949) took 4058 ms. Trace:
I20260709 12:11:09.271695 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:09.244227 30184 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.277117 26619 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 12:11:09.279446 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.290580 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2741) took 1067 ms. Trace:
I20260709 12:11:09.301892 26615 rpcz_store.cc:276] 0709 12:11:08.223110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.038015 (+814905us) service_pool.cc:224] Handling call
0709 12:11:09.038583 (+   568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.039025 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:09.039916 (+   891us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.290005 (+250089us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:09.290097 (+    92us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:09.290172 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.290276 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.290484 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":280,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":3160,"thread_start_us":246358,"threads_started":1}
I20260709 12:11:09.293239 29832 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:09.336084 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 201976us
W20260709 12:11:09.337540 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 56044.3us
I20260709 12:11:09.271390 26541 rpcz_store.cc:276] 0709 12:11:05.181437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.181559 (+   122us) service_pool.cc:224] Handling call
0709 12:11:05.245905 (+ 64346us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:06.102835 (+856930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.102879 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:06.112886 (+ 10007us) log.cc:844] Serialized 78 byte log entry
0709 12:11:06.361243 (+248357us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:11:06.423821 (+ 62578us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.472566 (+ 48745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.472685 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.711928 (+239243us) spinlock_profiling.cc:243] Waited 7.54 ms on lock 0x7b18000a0cc0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:11:08.329830 (+1617902us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b18000a0cc0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:11:09.093108 (+763278us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:09.217284 (+124176us) raft_consensus.cc:1685] finished
0709 12:11:09.217316 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.239671 (+ 22355us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71379,"prepare.queue_time_us":62883,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":132189,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":220,"spinlock_wait_cycles":101899264,"thread_start_us":1014867,"threads_started":2,"wal-append.queue_time_us":370039}
I20260709 12:11:09.351162 30215 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.392004 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:09.399534 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 144753us
I20260709 12:11:09.424522 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:09.419078 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.423568 30020 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:09.413612 30184 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:11:09.420979 30255 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.403210 30251 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:09.445199 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.445626 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.472111 26472 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
W20260709 12:11:09.475023 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.475780 30184 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:09.476392 30184 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:09.445997 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:09.447090 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 60311.2us
W20260709 12:11:09.479245 30282 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 12:11:09.482007 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.482547 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:09.482810 26468 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:09.485255 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.486316 26472 raft_consensus.cc:2410] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:11:09.488487 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 84377.5us
I20260709 12:11:09.457669 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:09.462731 26617 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:09.445544 26547 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:09.448164 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:09.439512 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 281353us
I20260709 12:11:09.441344 26439 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:09.456131 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.453509 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.470096 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.457589 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2742) took 1234 ms. Trace:
I20260709 12:11:09.528375 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:09.451467 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.477734 30184 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:09.406599 30158 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:09.543987 26470 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:11:09.470121 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2722) took 1390 ms. Trace:
I20260709 12:11:09.461205 26588 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:09.560851 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:09.561877 26617 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:11:09.451485 30251 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:09.564503 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.567620 26468 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:09.565146 26617 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:09.564543 26471 raft_consensus.cc:2376] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11. Re-sending same reply.
I20260709 12:11:09.565702 26464 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:09.566553 26465 raft_consensus.cc:2376] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10. Re-sending same reply.
I20260709 12:11:09.570755 26473 raft_consensus.cc:2410] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:09.447526 30148 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:09.571724 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2064) took 2410 ms. Trace:
W20260709 12:11:09.571877 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 130748us
I20260709 12:11:09.573117 30134 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:09.572191 26620 rpcz_store.cc:276] 0709 12:11:07.080565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.509348 (+1428783us) service_pool.cc:224] Handling call
0709 12:11:08.509730 (+   382us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:08.544571 (+ 34841us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:11:08.671109 (+126538us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.259225 (+588116us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:09.347319 (+ 88094us) log.cc:844] Serialized 52 byte log entry
0709 12:11:09.347578 (+   259us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:11:09.347630 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.378001 (+ 30371us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.490662 (+112661us) raft_consensus.cc:1685] finished
0709 12:11:09.490679 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.490825 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19306,"prepare.queue_time_us":297380,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":985,"raft.queue_time_us":15801,"raft.run_cpu_time_us":445,"raft.run_wall_time_us":14001,"thread_start_us":597220,"threads_started":2,"wal-append.queue_time_us":618343}
I20260709 12:11:09.448181 30255 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:09.577809 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:09.579133 26541 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 6: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:09.580502 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:09.583004 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:09.584560 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:09.585049 30047 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:09.582901 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:09.593802 30255 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:09.600930 30236 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.145s	user 0.003s	sys 0.000s
I20260709 12:11:09.601183 26466 raft_consensus.cc:2368] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10.
I20260709 12:11:09.570879 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:09.585137 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:09.594691 30007 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:11:09.609598 30007 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:09.610031 30007 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:09.614681 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.615049 29832 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:11:09.616302 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.556843 26616 rpcz_store.cc:276] 0709 12:11:07.957922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.525578 (+567656us) service_pool.cc:224] Handling call
0709 12:11:08.547139 (+ 21561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.547393 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:08.747057 (+199664us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.300836 (+553779us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:09.321401 (+ 20565us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:09.326832 (+  5431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.338936 (+ 12104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.347920 (+  8984us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17420,"prepare.queue_time_us":301385,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":15929,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":13660,"spinlock_wait_cycles":42814848,"thread_start_us":672391,"threads_started":2,"wal-append.queue_time_us":650094}
I20260709 12:11:09.619354 30255 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.579203 26469 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
W20260709 12:11:09.621426 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 47286.7us
I20260709 12:11:09.561620 30215 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:09.535032 30231 raft_consensus.cc:3055] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:09.635241 30158 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:09.638537 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 47762.6us
W20260709 12:11:09.654098 30286 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:11:09.529697 26621 rpcz_store.cc:276] 0709 12:11:08.223487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.031156 (+807669us) service_pool.cc:224] Handling call
0709 12:11:09.031882 (+   726us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:09.051189 (+ 19307us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:09.051713 (+   524us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.296154 (+244441us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.296612 (+   458us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:09.310939 (+ 14327us) log.cc:844] Serialized 26 byte log entry
0709 12:11:09.311225 (+   286us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:09.311277 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.311388 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.457356 (+145968us) raft_consensus.cc:1685] finished
0709 12:11:09.457385 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.457521 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18167,"prepare.queue_time_us":2205,"prepare.run_cpu_time_us":137,"prepare.run_wall_time_us":3848,"raft.queue_time_us":26165,"raft.run_cpu_time_us":466,"raft.run_wall_time_us":465,"thread_start_us":235875,"threads_started":1,"wal-append.queue_time_us":343504}
I20260709 12:11:09.639452 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:09.639879 30047 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:09.640355 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:09.641089 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:09.642228 30148 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:09.642649 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:09.642836 30143 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:09.643671 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:09.651682 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 190685us
I20260709 12:11:09.654484 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:09.639336 26469 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:09.637657 30183 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:09.459070 30020 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.204s
I20260709 12:11:09.670056 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:09.654649 30231 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:09.654460 30191 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:11:09.675769 26543 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:09.676860 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:09.681200 30060 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.008s
I20260709 12:11:09.683518 30032 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:09.684422 30148 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:09.687052 30148 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:09.687794 30148 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:09.688864 26542 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:09.686833 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.678201 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:09.695178 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:09.698137 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:09.699270 26470 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:09.700444 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:09.700444 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:09.696411 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:09.703243 26619 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:11:09.703823 26619 pending_rounds.cc:85] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 7
I20260709 12:11:09.704126 26619 pending_rounds.cc:107] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:11:09.704429 26619 raft_consensus.cc:2889] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:09.706538 26469 raft_consensus.cc:2410] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:09.715126 30143 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:09.717116 30183 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:09.718631 30020 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:09.719324 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.720593 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:09.721213 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:09.721791 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.722170 30060 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:09.723182 29900 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:09.723680 29900 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.724040 29900 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.724951 26548 raft_consensus.cc:2410] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:09.727377 26588 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:09.729351 26588 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:09.730602 30068 consensus_queue.cc:1059] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:11:09.735167 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:09.736514 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 70178.2us
I20260709 12:11:09.737687 29957 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:09.746093 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.747931 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:09.722705 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:09.755033 26588 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:09.733513 30020 raft_consensus.cc:2764] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:11:09.761003 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.765988 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:09.762830 26548 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:09.738520 29957 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:11:09.769882 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:09.770367 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.770648 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:09.776046 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 53447.2us
I20260709 12:11:09.777110 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.753988 30255 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:09.793886 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:09.797885 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.798200 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.798926 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:09.797938 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.801874 26466 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:09.802971 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.803640 26466 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:11:09.804603 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:09.805768 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:09.806632 26469 raft_consensus.cc:2410] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:09.806772 26472 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 9: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:09.807760 26466 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.807698 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.808248 26472 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:09.808550 26467 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:09.809684 26472 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:09.810312 26467 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:11:09.811512 30283 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.422s	user 0.003s	sys 0.000s
I20260709 12:11:09.812417 26548 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.820176 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.828346 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:09.831211 26470 raft_consensus.cc:2410] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:09.832428 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:09.833253 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 301371us
I20260709 12:11:09.847069 26464 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:09.852005 26471 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.861598 26465 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:09.847894 29957 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:11:09.831357 30255 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:09.866825 26621 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:09.867237 30254 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:09.867810 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:11:09.869907 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 216007us
I20260709 12:11:09.873127 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:09.879724 26466 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:09.882892 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:09.843122 30020 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:11:09.796658 30231 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:09.895875 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:09.896530 26619 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:09.877818 30254 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.898335 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.902241 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:09.907392 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:09.897666 27134 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:09.911394 26468 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:11:09.906597 26370 catalog_manager.cc:5697] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 6 to 8, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 8 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:09.915095 26621 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:09.916268 30259 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.916884 30259 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:09.919269 30259 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:09.924983 29448 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:09.912024 26468 pending_rounds.cc:85] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 5
I20260709 12:11:09.927170 26468 pending_rounds.cc:107] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:11:09.927534 26468 raft_consensus.cc:2889] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:09.928982 26466 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:09.925472 29448 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:09.929759 29448 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:09.933238 26548 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:09.904246 30254 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:09.937762 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 53463.9us
I20260709 12:11:09.940212 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:09.922850 30047 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:09.947350 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:09.950047 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 54322.4us
I20260709 12:11:09.889753 30251 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:11:09.960296 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:09.941269 30231 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.967453 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.961433 26439 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:09.970966 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.976413 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:09.977200 26465 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:09.979065 26541 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:11:09.959975 30295 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.144s	user 0.001s	sys 0.001s
I20260709 12:11:09.982076 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:09.986287 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 343778us
W20260709 12:11:09.991164 30301 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:11:09.980717 27166 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:11:09.991806 30233 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:11:09.962090 30020 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:11:09.993757 26619 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:11:09.993583 27159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:57562
W20260709 12:11:09.994294 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.994289 26619 pending_rounds.cc:85] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 8
W20260709 12:11:09.994880 30298 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:11:09.994750 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:09.977065 30227 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.758s	user 0.016s	sys 0.000s
I20260709 12:11:09.964037 30047 raft_consensus.cc:697] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:09.954419 30032 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:11:10.003701 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:10.027585 26619 pending_rounds.cc:107] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 9.9
W20260709 12:11:10.035712 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 84880.7us
I20260709 12:11:10.036053 26619 raft_consensus.cc:2889] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:10.029778 27159 raft_consensus.cc:606] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:11:10.031605 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:09.998551 29957 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:10.001370 26616 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:10.073534 30250 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:10.073599 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2067) took 1116 ms. Trace:
I20260709 12:11:10.074338 26622 rpcz_store.cc:276] 0709 12:11:08.957097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.147294 (+190197us) service_pool.cc:224] Handling call
0709 12:11:09.160976 (+ 13682us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:09.269391 (+108415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:09.269422 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:09.312396 (+ 42974us) log.cc:844] Serialized 26 byte log entry
0709 12:11:09.498306 (+185910us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:09.543788 (+ 45482us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.555789 (+ 12001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.555900 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:10.073340 (+517440us) raft_consensus.cc:1685] finished
0709 12:11:10.073364 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.073531 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19759,"prepare.queue_time_us":45231,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":19747,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":3290,"thread_start_us":143583,"threads_started":1,"wal-append.queue_time_us":400780}
I20260709 12:11:10.073642 29448 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.079429 26469 raft_consensus.cc:2410] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:11:10.044821 27159 raft_consensus.cc:614] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:10.082870 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:11:10.082163 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 149687us
W20260709 12:11:10.067889 30114 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.064s	user 0.015s	sys 0.003s
I20260709 12:11:10.074237 30250 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.084486 27161 raft_consensus.cc:2410] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:11:10.111660 30251 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.112316 30251 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:10.091030 30259 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:11:10.125078 30259 consensus_queue.cc:1243] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:10.109259 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:10.101622 30250 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.135547 26471 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:10.137849 26464 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:10.096464 30233 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 12:11:10.139746 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 60673.8us
I20260709 12:11:10.145640 27161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "541724f47bb04d5185dd369750546cbf"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:57562
I20260709 12:11:10.146441 27161 raft_consensus.cc:606] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 9 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:10.151232 30313 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.152081 30313 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.155354 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:10.163682 26439 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:10.096294 30114 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.014623 30255 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:10.175446 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 107270us
I20260709 12:11:10.181334 26465 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:10.172878 29957 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.111099 30047 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:10.196082 29957 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:10.188277 29900 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.204571 29957 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.206359 29900 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:10.207314 29900 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:10.208024 29900 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.208263 30251 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:10.209314 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 66331.2us
I20260709 12:11:10.210325 29900 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:10.210667 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:10.211009 29900 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:11:10.203801 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 101828us
I20260709 12:11:10.211790 30313 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:10.212915 30313 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:10.213789 30313 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:11:10.214243 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.213934 30312 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:10.214475 27133 leader_election.cc:336] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.652s (SENT)
I20260709 12:11:10.212996 26618 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 12:11:10.203747 30114 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:10.218413 30281 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.771s	user 0.000s	sys 0.004s
I20260709 12:11:10.218928 30215 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:10.219342 30215 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:10.223459 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2057) took 3334 ms. Trace:
I20260709 12:11:10.223959 26614 rpcz_store.cc:276] 0709 12:11:06.889299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.425477 (+1536178us) service_pool.cc:224] Handling call
0709 12:11:08.984807 (+559330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:09.001976 (+ 17169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:09.002009 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:09.004967 (+  2958us) log.cc:844] Serialized 26 byte log entry
0709 12:11:09.115672 (+110705us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:09.115707 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.127521 (+ 11814us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.753352 (+625831us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:09.812748 (+ 59396us) raft_consensus.cc:1685] finished
0709 12:11:09.812768 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.223186 (+410418us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b54001f68d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:10.223345 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292243072,"thread_start_us":110104,"threads_started":1,"wal-append.queue_time_us":306743}
W20260709 12:11:10.232419 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:10.238138 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.249495 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:10.255236 29448 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:10.254546 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 43958.7us
I20260709 12:11:10.252367 30312 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:10.220403 30215 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.271893 30183 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:10.283183 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1973) took 1053 ms. Trace:
I20260709 12:11:10.284612 30191 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:10.266995 29900 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.295068 30308 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:10.295904 30308 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:10.296757 30307 raft_consensus.cc:3055] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:10.297190 30307 raft_consensus.cc:740] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:11:10.302716 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 59410.8us
I20260709 12:11:10.283880 26544 rpcz_store.cc:276] 0709 12:11:09.231204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.235225 (+  4021us) service_pool.cc:224] Handling call
0709 12:11:09.252841 (+ 17616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.253344 (+   503us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:09.391783 (+138439us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.925646 (+533863us) log.cc:844] Serialized 14 byte log entry
0709 12:11:10.279501 (+353855us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:10.279575 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:10.279645 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.279747 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.279933 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":353468,"prepare.queue_time_us":203121,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":111,"raft.queue_time_us":594387,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":16637,"thread_start_us":615109,"threads_started":3,"wal-append.queue_time_us":418086}
I20260709 12:11:10.276831 29957 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:10.288270 30316 raft_consensus.cc:2764] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:10.298245 30314 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.314769 30321 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:10.315549 30321 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:10.319279 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:10.319203 30254 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.322651 30321 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:10.322072 30254 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:10.292640 30191 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:10.326643 30314 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:10.326838 30305 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:10.298182 30308 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:10.327571 29957 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:10.333256 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 450495us
I20260709 12:11:10.336540 30312 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:10.337776 29900 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:10.342054 26513 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:10.298161 30307 consensus_queue.cc:260] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.342308 30068 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:10.343413 30307 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.311033 30143 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.348364 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 1974) took 1076 ms. Trace:
W20260709 12:11:10.354619 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 337110us
I20260709 12:11:10.356998 30306 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:10.357836 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2069) took 1387 ms. Trace:
I20260709 12:11:10.358717 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:10.358273 26618 rpcz_store.cc:276] 0709 12:11:08.970964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.274940 (+303976us) service_pool.cc:224] Handling call
0709 12:11:09.315891 (+ 40951us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:10.216667 (+900776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.357496 (+140829us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b540020a154. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:10.357765 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2022039936}
I20260709 12:11:10.346951 30305 consensus_queue.cc:1243] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:10.350854 30047 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:11:10.373045 30134 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:10.373754 30134 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:10.375128 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:10.376364 30254 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.376947 30254 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.377296 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:10.377406 30254 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.378327 29900 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.351485 30143 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:10.378756 29900 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:10.379226 29900 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.380577 30143 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:10.375156 30134 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:10.385736 30134 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.387364 29900 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:10.389087 30314 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:10.395092 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:10.395248 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:10.390005 30191 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.399755 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:10.401017 30314 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:10.404482 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.344892 30250 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:10.419121 30047 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:10.409909 29900 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:10.423398 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:10.430866 27168 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:57562
I20260709 12:11:10.432395 26613 raft_consensus.cc:1217] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[6.7-10.9]   Dedup: 6.7->[8.8-10.9]
I20260709 12:11:10.432946 26613 pending_rounds.cc:85] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 7
I20260709 12:11:10.433175 26613 pending_rounds.cc:107] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:11:10.433398 26613 raft_consensus.cc:2889] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:10.431926 27168 raft_consensus.cc:606] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:11:10.435305 27168 raft_consensus.cc:614] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:10.443033 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:10.444193 26614 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:10.436072 30330 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.451366 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:10.424644 30328 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 12:11:10.460491 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:10.456571 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 43958.9us
I20260709 12:11:10.470677 30032 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:10.461091 30316 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:10.472142 30032 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:10.472642 30032 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:10.473755 30032 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:10.477115 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:10.472209 30316 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.491405 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:10.492910 30060 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:10.493427 30060 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.493594 26545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:11:10.493829 30060 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:10.494315 26545 raft_consensus.cc:606] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:10.494457 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:10.494875 26545 raft_consensus.cc:614] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:10.477814 30032 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.495930 30316 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.494212 30305 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:11:10.511948 30148 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:10.512576 30328 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:10.515050 29900 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:10.532454 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 173806us
W20260709 12:11:10.536640 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.534197 26587 leader_election.cc:400] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10.
I20260709 12:11:10.534649 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:10.526670 30233 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:10.541224 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 45933us
I20260709 12:11:10.535761 29900 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:10.552124 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.553547 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:10.554157 26620 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.556049 26514 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:10.550751 29900 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.555274 30068 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:10.551862 30306 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
W20260709 12:11:10.559494 30335 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:11:10.561326 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 194776us
I20260709 12:11:10.568655 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:10.528908 30332 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:11:10.571259 30254 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.548749 30250 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:10.590576 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:10.564843 30060 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.600760 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:10.553227 30313 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:11:10.598614 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 45856.4us
I20260709 12:11:10.567204 29900 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.606020 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:10.609635 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.546278 30233 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:10.613899 26621 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:10.615585 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:10.616346 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:10.618459 27164 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:10.619383 26616 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:10.620282 30060 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:10.621039 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52584.6us
I20260709 12:11:10.621169 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:10.621826 26617 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:11:10.622228 26465 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 9: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:10.622853 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:10.625263 27166 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:11:10.624073 30331 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.626183 30331 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:10.626662 30331 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.631170 26472 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:10.602746 30306 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:10.632714 26464 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:10.633736 26620 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
W20260709 12:11:10.637161 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:10.637976 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 116719us
I20260709 12:11:10.640715 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:10.641428 26472 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:10.642341 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:10.643131 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:10.642165 27161 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:11:10.646742 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:10.647325 26469 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:11:10.647573 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:10.649358 30259 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:10.650309 30215 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:10.651011 26618 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:11:10.651392 26618 pending_rounds.cc:85] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 3
I20260709 12:11:10.617120 30313 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.647112 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:10.657575 26464 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:10.659821 30314 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:10.660166 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:10.660576 30314 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:10.661499 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:10.661633 30314 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.348798 26539 rpcz_store.cc:276] 0709 12:11:09.272198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.275872 (+  3674us) service_pool.cc:224] Handling call
0709 12:11:09.283065 (+  7193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.322937 (+ 39872us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:09.498780 (+175843us) log.cc:844] Serialized 14 byte log entry
0709 12:11:10.346053 (+847273us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:10.346115 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:10.346176 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.346370 (+   194us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.348309 (+  1939us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":465217,"prepare.queue_time_us":128707,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":491964,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":18904,"thread_start_us":402957,"threads_started":3,"wal-append.queue_time_us":361809}
I20260709 12:11:10.663481 29832 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:10.664489 29832 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:10.664999 29832 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:10.664412 30007 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:10.665715 30007 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.675899 26618 pending_rounds.cc:107] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:11:10.676345 26618 raft_consensus.cc:2889] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:10.676714 26618 pending_rounds.cc:107] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:11:10.676956 26618 raft_consensus.cc:2889] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:10.671783 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:10.681269 30255 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:10.681882 30255 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:10.682338 30255 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.682602 30250 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:10.683827 30307 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:10.684303 30307 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:10.685281 30307 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.688555 26614 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.691449 26439 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:10.704128 30313 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:10.707288 29900 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:10.715651 30233 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:10.667937 30134 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:11:10.719137 30134 consensus_queue.cc:1243] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:10.719972 30337 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:10.720593 30337 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:10.721946 30337 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:10.723158 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 43758.6us
I20260709 12:11:10.723891 30337 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.736827 30227 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:10.737660 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:10.737043 30250 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:10.694967 30315 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:10.740082 30114 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:10.677944 30254 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:10.742594 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:10.724468 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:10.763854 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:10.768801 26619 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:10.769141 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 106752us
I20260709 12:11:10.665987 29832 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.695438 30339 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:10.789208 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 46764.3us
I20260709 12:11:10.791915 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:10.771301 30307 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.768695 30315 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:10.784521 30259 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.786671 30233 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:10.788064 30339 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.794315 30068 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:10.775522 30183 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:11:10.795166 30114 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:10.783519 30143 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:11:10.800056 30148 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:10.805290 30158 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:11:10.801954 30315 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.785333 30332 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:11:10.818545 30324 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.016s
W20260709 12:11:10.824684 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.814996 30254 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:10.825547 30254 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:10.825958 30254 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:10.826193 26614 raft_consensus.cc:2410] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:10.810782 29832 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:10.822952 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 98660.4us
I20260709 12:11:10.831190 26366 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39184 (request call id 159) took 6975 ms. Trace:
I20260709 12:11:10.831840 26370 catalog_manager.cc:5697] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 5 to 9, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 9 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:10.827399 30114 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.801803 30259 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.792960 30306 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:11:10.813728 30339 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.847406 30191 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.848520 30308 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:10.851491 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260709 12:11:10.851656 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.854682 30331 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.844002 30231 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.879932 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:10.880735 30331 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:10.880311 30231 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:10.881304 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:10.882668 30231 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:10.806589 30233 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:10.860756 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:10.859839 26370 catalog_manager.cc:5697] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:10.883460 30233 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.884246 26370 catalog_manager.cc:5697] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 4 to 6, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 6 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:10.885022 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:10.886073 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:10.886322 26370 catalog_manager.cc:5697] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 3 to 5, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 5 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:10.888255 29448 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:10.859625 30068 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:10.888741 29448 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:10.889179 29448 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.874925 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:10.888204 26370 catalog_manager.cc:5697] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:10.892809 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 81867.2us
I20260709 12:11:10.856709 30259 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.900293 27134 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:10.901381 26370 catalog_manager.cc:5697] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 6 to 7, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 7 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:10.906383 26370 catalog_manager.cc:5697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 7 to 8, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 8 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:10.914346 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:10.916996 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:10.917464 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:10.917886 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.816053 30316 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:10.918344 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:10.904325 30283 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:11:10.889810 30068 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.878023 30308 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:10.896836 30020 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:10.921840 30332 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:10.942739 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:10.935868 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:10.944110 26615 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:10.935158 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:10.945355 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:10.923209 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:10.942214 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:10.941752 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 98778.2us
I20260709 12:11:10.943701 26467 raft_consensus.cc:2410] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:10.938760 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:10.910715 30231 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:10.958459 26470 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:10.907786 30148 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:10.961762 26472 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:10.909125 30060 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:10.967175 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:10.972986 26370 catalog_manager.cc:5697] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 6 to 7, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 7 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:10.971697 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:10.976346 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:10.975828 26370 catalog_manager.cc:5697] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 5 to 6, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 6 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:10.977384 26473 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:10.978683 26370 catalog_manager.cc:5697] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 6 to 7, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 7 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:11:10.984272 26370 catalog_manager.cc:5697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 6 to 9, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 9 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:10.986989 26370 catalog_manager.cc:5697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 4 to 7, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 7 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:10.989722 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:10.992535 29448 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:10.959263 26469 raft_consensus.cc:2376] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9. Re-sending same reply.
I20260709 12:11:11.000048 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:11.006095 26542 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.941066 30184 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:10.940272 30316 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:11.013954 26370 catalog_manager.cc:5697] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 7 to 9, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 9 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:11.016601 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.017505 26547 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.017714 26541 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 9: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:11.018554 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:10.942770 30020 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:10.934712 30327 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:11.022136 26545 raft_consensus.cc:2410] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:11.022375 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:11.024582 26548 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:11.023140 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:11.013056 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:11.024278 26370 catalog_manager.cc:5697] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 6 to 7, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 7 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:11.017560 26539 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:11.027578 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:11.035852 26469 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.038831 30364 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.039445 30364 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:11.041299 26470 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.022063 30148 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:10.838872 26366 rpcz_store.cc:276] 0709 12:11:03.858338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.865036 (+  6698us) service_pool.cc:224] Handling call
0709 12:11:10.830943 (+6965907us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:07.088311 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:07.399425 (+311114us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:07.431133 (+ 31708us) write_op.cc:435] Acquired schema lock
0709 12:11:07.458146 (+ 27013us) tablet.cc:662] Decoding operations
0709 12:11:08.008173 (+550027us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:08.014421 (+  6248us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:08.020070 (+  5649us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:11:08.117657 (+ 97587us) tablet.cc:701] Row locks acquired
0709 12:11:08.122843 (+  5186us) write_op.cc:260] PREPARE: finished
0709 12:11:08.130950 (+  8107us) write_op.cc:270] Start()
0709 12:11:08.131077 (+   127us) write_op.cc:276] Timestamp: P: 1783599068130874 usec, L: 0
0709 12:11:08.131106 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:11:08.131929 (+   823us) log.cc:844] Serialized 3218 byte log entry
0709 12:11:08.384482 (+252553us) op_driver.cc:464] REPLICATION: finished
0709 12:11:08.547052 (+162570us) write_op.cc:301] APPLY: starting
0709 12:11:08.547161 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:08.547367 (+   206us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:08.547511 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:08.548503 (+   992us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:08.548738 (+   235us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:11:08.548782 (+    44us) write_op.cc:312] APPLY: finished
0709 12:11:08.549040 (+   258us) log.cc:844] Serialized 65 byte log entry
0709 12:11:08.549208 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:08.549331 (+   123us) write_op.cc:454] Released schema lock
0709 12:11:08.549381 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:08.549764 (+   383us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:08.549790 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":669198,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":138048,"apply.run_cpu_time_us":2758,"apply.run_wall_time_us":16326,"num_ops":8,"prepare.queue_time_us":541187,"prepare.run_cpu_time_us":53612,"prepare.run_wall_time_us":1175363,"raft.queue_time_us":56774,"raft.run_cpu_time_us":13353,"raft.run_wall_time_us":140886,"replication_time_us":251305,"thread_start_us":527004,"threads_started":4,"wal-append.queue_time_us":136029,"wal-append.run_cpu_time_us":8680,"wal-append.run_wall_time_us":1311443}]]}
I20260709 12:11:11.018219 30184 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:11.044872 26547 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:11.045580 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:11.016028 30330 consensus_meta.cc:287] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.558s	user 0.014s	sys 0.000s
I20260709 12:11:11.056839 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:11.049798 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:11.060712 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:11.061471 26620 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 6: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:11.063385 26513 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:11.065538 26467 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 9: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:11.061117 26543 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:11:11.074810 30364 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:11.076043 26470 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:11.076656 26619 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 12:11:11.074954 29448 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:11.076797 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:11.146359 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:10.959793 30306 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 12:11:11.146452 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:11.155646 26370 catalog_manager.cc:5697] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:11.158278 26468 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 11: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:11.157186 30020 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:11.013497 30183 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:11:11.048933 30327 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:11.069950 30330 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:11.081895 30347 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 12:11:11.082718 30332 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:11.186774 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:11.186890 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:11.187963 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:11.290671 26543 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.189400 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:11.065810 30254 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:11.219657 26548 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:10.958280 30047 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 12:11:11.227123 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:11.229035 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:11.232658 26473 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:11:11.233505 26621 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:11.239903 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:11:11.243844 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.254496 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 241455us
I20260709 12:11:11.189837 30251 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.183806 30307 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:11.230212 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:11.191102 30227 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.198345 30324 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:11.256964 30032 consensus_meta.cc:287] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.736s	user 0.011s	sys 0.003s
I20260709 12:11:11.198565 29957 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:11:11.309424 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:11.331557 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 104557us
I20260709 12:11:11.312232 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:11.268872 30231 raft_consensus.cc:697] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:11.329540 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:11.310806 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:11.332721 26541 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.263758 27164 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:11:11.203122 30308 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:11.306527 30329 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:11.337800 27168 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 9: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:11.336385 26370 catalog_manager.cc:5697] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:11.368156 26616 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:11.348381 26547 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 8: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:11.368002 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:11:11.369800 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.333701 30312 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:11.335994 30215 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.685s	user 0.013s	sys 0.000s
I20260709 12:11:11.348769 30363 raft_consensus.cc:993] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
W20260709 12:11:11.344396 30356 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:11:11.373546 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 469643us
I20260709 12:11:11.334981 30324 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:11.419039 26467 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:11.359095 30360 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:11:11.337611 30367 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:11.346926 30332 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:11.313416 30251 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:11.328747 30227 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:11.442610 30231 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:11.442934 30184 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:11.444434 30184 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:11.446782 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 519) took 1232 ms. Trace:
I20260709 12:11:11.426381 30329 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:11.447347 26622 rpcz_store.cc:276] 0709 12:11:10.214449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.214612 (+   163us) service_pool.cc:224] Handling call
0709 12:11:10.215002 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:10.253339 (+ 38337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.253395 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:10.268849 (+ 15454us) log.cc:844] Serialized 26 byte log entry
0709 12:11:10.579177 (+310328us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b18003f4ea0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:11:10.597374 (+ 18197us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:10.597436 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.597543 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:11.446333 (+848790us) raft_consensus.cc:1685] finished
0709 12:11:11.446362 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.446698 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36577,"raft.queue_time_us":33876,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":4037,"spinlock_wait_cycles":6161280,"thread_start_us":17906,"threads_started":1,"wal-append.queue_time_us":319742}
I20260709 12:11:11.452076 30227 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:11.453285 30361 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:11:11.431692 30183 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.334190 30307 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:11.461402 30366 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:11:11.466703 30370 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.467599 30370 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:11.472391 30307 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:11.490751 30374 raft_consensus.cc:1081] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 9 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:11:11.530273 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:11.430425 30363 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:11.341856 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.548542 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.548877 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:11.549569 27164 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:11:11.556404 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:11.558175 27168 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:11:11.505676 30360 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:11:11.533391 30227 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:11.378414 30308 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:11.562640 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.377776 30312 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:11:11.550055 30060 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.009s	sys 0.010s
W20260709 12:11:11.601509 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.609103 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:11.631960 26614 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
W20260709 12:11:11.632009 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.552838 26370 catalog_manager.cc:5697] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 3 to 4, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 4 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:11.601011 30227 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:11.430523 30327 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:11.621695 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:11.616191 26622 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:11.639997 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:11.549875 30374 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:11.638453 26588 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:11.652684 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.654543 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 53916.6us
I20260709 12:11:11.655479 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:11.651527 26370 catalog_manager.cc:5697] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 4 to 7, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 7 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:11.458963 30332 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:11.691026 30327 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.692428 26370 catalog_manager.cc:5697] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:11.646289 29832 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.806s	user 0.015s	sys 0.007s
I20260709 12:11:11.637192 30060 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:11.697386 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 279151us
I20260709 12:11:11.560240 30363 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:11.698619 26464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.020s	sys 0.051s
I20260709 12:11:11.702083 29448 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:11.705865 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:11.709415 26464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.020s	sys 0.052s
W20260709 12:11:11.707742 26438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.000s	sys 0.069s
W20260709 12:11:11.710475 26438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.000s	sys 0.069s
W20260709 12:11:11.710815 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 632521us
W20260709 12:11:11.724788 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.733960 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:11.699707 30365 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:11:11.748823 30251 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:11.751171 26618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "541724f47bb04d5185dd369750546cbf"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:48232
W20260709 12:11:11.755863 26469 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.676s	user 0.011s	sys 0.010s
W20260709 12:11:11.734918 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 424840us
I20260709 12:11:11.756659 26469 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
W20260709 12:11:11.762881 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.764817 26370 catalog_manager.cc:5697] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 11 to 13, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 13 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:11.687503 30374 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:11.723615 30330 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:11.718150 29832 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:11.784698 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 44560us
I20260709 12:11:11.785943 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:11.787699 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:11.792862 30371 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:11.793574 30371 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.794035 30371 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:11.794301 30158 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:11.794823 30158 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:11.795861 30158 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:11.797026 30158 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.798487 30372 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:11.799196 30372 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.799672 30372 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:11.803261 30148 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:11.806537 30370 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:11.806694 30060 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:11.809242 30227 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:11.776515 30191 consensus_meta.cc:287] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.898s	user 0.008s	sys 0.012s
I20260709 12:11:11.818899 29832 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:11.779592 30330 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.821653 30330 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:11.822261 30363 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:11.828708 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 94903.7us
I20260709 12:11:11.832558 26370 catalog_manager.cc:5697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:11.830605 26467 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
W20260709 12:11:11.836009 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.836946 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:11.832443 30313 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:11.843418 26543 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.033s
I20260709 12:11:11.774488 30329 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:11.845237 26543 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:11.790167 30379 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.810099 30227 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
W20260709 12:11:11.874461 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 103468us
I20260709 12:11:11.877102 26370 catalog_manager.cc:5697] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 6 to 9, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 9 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:11.879437 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 91837.5us
I20260709 12:11:11.880304 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:11.879571 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:11.891031 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:11.884668 30379 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:11.899865 30379 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:11.929968 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:11.903556 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:11.904146 30313 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:11.709975 30312 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:11.927353 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:12.016009 26541 consensus_meta.cc:287] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.681s	user 0.017s	sys 0.026s
I20260709 12:11:11.922955 30254 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:11.929212 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:11.931469 30255 consensus_meta.cc:287] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.249s	user 0.020s	sys 0.000s
I20260709 12:11:11.911039 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:11.910648 30315 consensus_meta.cc:287] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.072s	user 0.007s	sys 0.012s
W20260709 12:11:11.932137 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.918851 30332 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:11.928627 26546 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:11.902477 30374 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:11.933360 30382 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:11.897109 30339 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.007s	user 0.009s	sys 0.011s
I20260709 12:11:11.908567 26370 catalog_manager.cc:5697] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 3 to 5, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 5 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:11.975706 26540 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:11.906522 30233 consensus_meta.cc:287] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.022s	user 0.017s	sys 0.004s
I20260709 12:11:11.961102 30363 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:11.912299 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:11.934067 30357 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.832s	user 0.000s	sys 0.011s
I20260709 12:11:11.907739 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:11.941133 27159 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:11.944895 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:11.973873 30367 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.536s	user 0.007s	sys 0.014s
I20260709 12:11:11.938795 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:12.013166 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.883482 30385 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:11:12.065289 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.076926 26466 raft_consensus.cc:2410] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:12.053357 26370 catalog_manager.cc:5697] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 5 to 6, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 6 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:12.018532 26541 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:12.081729 26370 catalog_manager.cc:5697] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:12.019166 27163 consensus_meta.cc:287] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.010s
W20260709 12:11:12.020246 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.084944 27163 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:12.018065 26621 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:11:12.024308 26545 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:11:12.024895 26542 consensus_meta.cc:287] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.008s	user 0.016s	sys 0.006s
W20260709 12:11:12.086892 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.051671 30379 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:12.029610 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 317765us
I20260709 12:11:12.050293 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:12.054819 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 151334us
I20260709 12:11:12.015810 30313 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:12.057897 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:12.092777 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:11:12.059466 26615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.006s	sys 0.031s
W20260709 12:11:12.093856 26615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.006s	sys 0.032s
I20260709 12:11:12.051939 30314 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:12.086508 26542 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:12.028503 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:12.097071 26547 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:12.089653 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:12.027912 30307 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
W20260709 12:11:12.100931 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.024608 30255 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.084209 26370 catalog_manager.cc:5697] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 2 to 5, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 5 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.098608 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1861) took 1141 ms. Trace:
I20260709 12:11:12.052052 30363 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:12.095178 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:12.105207 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:12.102617 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 1896) took 1169 ms. Trace:
I20260709 12:11:12.098665 26616 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:12.026813 30315 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:12.079519 30374 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:12.107748 30254 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:12.108358 26546 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 12:11:12.105806 26542 rpcz_store.cc:276] 0709 12:11:10.927249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.927378 (+   129us) service_pool.cc:224] Handling call
0709 12:11:12.096619 (+1169241us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:12.113799 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.114689 30307 consensus_queue.cc:1243] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:12.119297 27159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 617) took 1203 ms. Trace:
I20260709 12:11:12.120332 30363 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:12.107290 26370 catalog_manager.cc:5697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 7 to 9, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 9 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:12.122634 30384 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.219s	user 0.004s	sys 0.000s
I20260709 12:11:12.123212 26616 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:12.104835 26466 rpcz_store.cc:276] 0709 12:11:10.948719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.018586 (+ 69867us) service_pool.cc:224] Handling call
0709 12:11:11.944717 (+926131us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b5800011198. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:11:12.090350 (+145633us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3091712}
I20260709 12:11:12.096122 30313 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:12.057051 30371 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:12.131047 26541 raft_consensus.cc:2410] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:11:12.106702 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:12.140057 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 46990us
I20260709 12:11:12.087245 30385 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:12.092543 30367 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:12.052759 30339 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.096582 30373 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.093379 30327 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:12.151724 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 244073us
I20260709 12:11:12.182313 26622 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:12.153039 26620 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:12.153144 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 278812us
I20260709 12:11:12.055239 30233 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:12.165171 26618 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:12.183599 26618 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.166288 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:12.167470 29448 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:12.176787 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.150540 30259 consensus_meta.cc:287] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.227s	user 0.014s	sys 0.009s
I20260709 12:11:12.180526 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:12.151134 30191 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.187794 26546 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: [7.5-10.7]
I20260709 12:11:12.151000 27159 rpcz_store.cc:276] 0709 12:11:10.899749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.903085 (+  3336us) service_pool.cc:224] Handling call
0709 12:11:11.940433 (+1037348us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:11:11.940690 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.078162 (+137472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.103597 (+ 25435us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13094784}
I20260709 12:11:12.189483 30191 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.190327 30233 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:12.191862 30191 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:12.194722 30259 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:12.196976 27167 raft_consensus.cc:2368] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9.
I20260709 12:11:12.197450 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:12.198379 27167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 447) took 1114 ms. Trace:
I20260709 12:11:12.198809 27167 rpcz_store.cc:276] 0709 12:11:11.083917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.229945 (+146028us) service_pool.cc:224] Handling call
0709 12:11:12.198142 (+968197us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b540077c754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:12.198309 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2046533376}
I20260709 12:11:12.199564 30307 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:12.148118 30007 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:12.200832 30259 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:12.203161 30255 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:12.151471 30374 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:12.101203 30379 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:12.165884 30308 consensus_meta.cc:287] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.004s
I20260709 12:11:12.188145 30339 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:12.206305 30374 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:12.206951 30330 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:12.208292 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 44193.7us
I20260709 12:11:12.208575 26543 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:12.209136 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:12.209558 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 511) took 1429 ms. Trace:
I20260709 12:11:12.194300 26541 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:12.210988 30394 raft_consensus.cc:2764] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:12.209990 26464 rpcz_store.cc:276] 0709 12:11:10.780275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.780468 (+   193us) service_pool.cc:224] Handling call
0709 12:11:10.791605 (+ 11137us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:10.800845 (+  9240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.800874 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:10.833370 (+ 32496us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.709901 (+876531us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:11.709945 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.710021 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:12.121748 (+411727us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:12.209203 (+ 87455us) raft_consensus.cc:1685] finished
0709 12:11:12.209230 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.209470 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26053,"raft.queue_time_us":6318,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":12172,"spinlock_wait_cycles":73724288,"thread_start_us":873601,"threads_started":1,"wal-append.queue_time_us":1032270}
I20260709 12:11:12.206717 27161 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:12.212879 30183 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.213493 27163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 543) took 1605 ms. Trace:
I20260709 12:11:12.213429 30183 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.213960 27163 rpcz_store.cc:276] 0709 12:11:10.608366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.608520 (+   154us) service_pool.cc:224] Handling call
0709 12:11:12.213282 (+1604762us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b540071c5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:12.213388 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1648770432}
I20260709 12:11:12.215991 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:12.215866 30183 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:12.201102 30307 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:12.201920 30148 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:12.201769 30306 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:12.217799 30215 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.218422 30368 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:12.218953 30368 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:12.219343 30368 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.210599 29957 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:12.222599 30377 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:11:12.171545 30385 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:12.223953 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2767) took 1070 ms. Trace:
I20260709 12:11:12.223819 29957 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:12.225203 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 44768.9us
I20260709 12:11:12.225574 29957 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:12.227097 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:12.226127 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:12.224386 26615 rpcz_store.cc:276] 0709 12:11:11.153334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.374805 (+221471us) service_pool.cc:224] Handling call
0709 12:11:11.421614 (+ 46809us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.459621 (+ 38007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.459676 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.507372 (+ 47696us) log.cc:844] Serialized 26 byte log entry
0709 12:11:12.094802 (+587430us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:12.094876 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.094999 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:12.223699 (+128700us) raft_consensus.cc:1685] finished
0709 12:11:12.223720 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.223883 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6096,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":135,"thread_start_us":536496,"threads_started":1,"wal-append.queue_time_us":657759}
I20260709 12:11:12.234150 27134 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:12.222677 30328 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:12.225224 30191 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
W20260709 12:11:12.238314 30388 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.435s	user 0.002s	sys 0.000s
I20260709 12:11:12.226511 29957 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.240469 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2763) took 1088 ms. Trace:
I20260709 12:11:12.240604 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:12.240991 26620 rpcz_store.cc:276] 0709 12:11:11.152114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.259189 (+107075us) service_pool.cc:224] Handling call
0709 12:11:11.277374 (+ 18185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.182956 (+905582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.240233 (+ 57277us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b5400379954. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:12.240405 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2013241216}
W20260709 12:11:12.243839 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.241925 26618 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:12.245527 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:12.245759 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:12.246037 26614 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 9. Current term is 11. Ops: []
I20260709 12:11:12.246563 26615 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:12.247532 29448 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.185237 26370 catalog_manager.cc:5697] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:11:12.184304 27133 leader_election.cc:336] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.992s (SENT)
I20260709 12:11:12.249778 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2765) took 1097 ms. Trace:
I20260709 12:11:12.250185 26613 rpcz_store.cc:276] 0709 12:11:11.152731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.333883 (+181152us) service_pool.cc:224] Handling call
0709 12:11:11.349532 (+ 15649us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.372440 (+ 22908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.372472 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.493311 (+120839us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.719917 (+226606us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:11.719961 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.720034 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:12.237628 (+517594us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:12.242036 (+  4408us) raft_consensus.cc:1685] finished
0709 12:11:12.242057 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.249704 (+  7647us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9681,"raft.queue_time_us":64112,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"spinlock_wait_cycles":50706176,"thread_start_us":186024,"threads_started":1,"wal-append.queue_time_us":269506}
I20260709 12:11:12.252671 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:12.249464 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:12.249039 27134 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:12.255368 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.257105 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:12.257781 26620 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:11:12.256851 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:12.253502 26613 raft_consensus.cc:2393] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:12.170253 30254 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:12.258846 29448 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:12.261881 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:12.237571 30328 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:12.262684 29448 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:12.263772 29448 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:12.263863 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:12.264281 29448 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:12.264619 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.265373 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.242698 30331 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.206s	user 0.009s	sys 0.020s
I20260709 12:11:12.263146 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:12.262974 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:12.247658 30114 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.990s	user 0.021s	sys 0.013s
I20260709 12:11:12.267925 26438 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:12.171176 30337 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 12:11:12.266669 30134 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.274178 26619 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:12.274618 30327 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:12.275422 30148 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:12.281323 30148 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:12.281829 30148 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.282372 26619 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:12.282939 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:12.283819 26619 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:12.284214 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:12.284512 30379 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:12.284832 26543 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:12.285157 26619 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:12.285728 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:12.269654 30307 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.286814 30395 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:12.287295 30395 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.264950 30255 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:12.287638 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1867) took 1225 ms. Trace:
I20260709 12:11:12.287855 30158 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:12.287959 30255 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:12.288940 30259 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.289361 26539 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:11:12.289494 30215 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:12.263691 29957 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.290743 26539 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:12.264725 30363 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.291204 30328 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.292169 26539 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:11:12.292377 30328 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.293809 27161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 618) took 1393 ms. Trace:
I20260709 12:11:12.246980 30227 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:12.294778 30227 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:12.295272 30227 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.281090 30316 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:12.280207 30134 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.245393 30306 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:11:12.289089 30255 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.267616 30314 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.286284 26543 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:11:12.275127 30330 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:12.277058 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:12.297675 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:12.300985 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:12.269075 30331 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.232s	user 0.009s	sys 0.020s
I20260709 12:11:12.288092 26467 rpcz_store.cc:276] 0709 12:11:11.063115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.157973 (+ 94858us) service_pool.cc:224] Handling call
0709 12:11:12.287460 (+1129487us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54002dc154. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:12.287580 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296110976}
I20260709 12:11:12.391978 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1893) took 1478 ms. Trace:
W20260709 12:11:12.270668 30114 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.022s	sys 0.014s
I20260709 12:11:12.261281 30377 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:12.395056 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.392148 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:12.408517 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 136286us
W20260709 12:11:12.416816 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 153926us
I20260709 12:11:12.287667 30395 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.250109 30308 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:11:12.421667 26546 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 10: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:12.406132 30007 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.425990 26544 rpcz_store.cc:276] 0709 12:11:10.913199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.914265 (+  1066us) service_pool.cc:224] Handling call
0709 12:11:10.940648 (+ 26383us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:10.967612 (+ 26964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.967669 (+    57us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:11.500051 (+532382us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b2c0005b0f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:11:11.610375 (+110324us) log.cc:844] Serialized 52 byte log entry
0709 12:11:12.022667 (+412292us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:12.251859 (+229192us) log.cc:844] Serialized 14 byte log entry
0709 12:11:12.268495 (+ 16636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.268577 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:12.268626 (+    49us) raft_consensus.cc:1685] finished
0709 12:11:12.391674 (+123048us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.391885 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31409,"prepare.queue_time_us":271990,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":31728,"raft.run_cpu_time_us":389,"raft.run_wall_time_us":69604,"spinlock_wait_cycles":9861376,"thread_start_us":496774,"threads_started":2,"wal-append.queue_time_us":476377}
I20260709 12:11:12.437968 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:12.294260 27161 rpcz_store.cc:276] 0709 12:11:10.900049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.902800 (+  2751us) service_pool.cc:224] Handling call
0709 12:11:10.957427 (+ 54627us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.212183 (+1254756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.293554 (+ 81371us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400603954. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:12.293742 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2865466112}
W20260709 12:11:12.417538 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 233242us
I20260709 12:11:12.443759 29448 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:12.454357 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.295846 30254 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.392997 30365 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.406100 30379 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:12.439591 30372 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.639s	user 0.007s	sys 0.007s
I20260709 12:11:12.393101 30339 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:12.453405 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:12.462332 26617 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:12.392943 30373 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:12.463234 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:12.419251 30394 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:12.431254 30329 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.468708 29448 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:12.469821 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:12.436406 29832 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:12.472596 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:12.443953 30337 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:12.476766 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 199778us
I20260709 12:11:12.447320 30215 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:12.482180 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:12.482384 29448 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:12.486735 29448 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.467381 30020 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:12.498764 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.498922 29448 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:12.476359 30114 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:12.523073 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 59934.2us
I20260709 12:11:12.524675 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:12.447573 30377 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.494892 30330 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.465545 30007 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.495572 30316 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:12.532284 26613 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:12.475242 30060 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
W20260709 12:11:12.543061 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.542284 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:12.472043 30379 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.524914 30306 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:12.472116 30372 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:12.474795 30339 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:12.496188 29832 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:11:12.482820 30329 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:12.592620 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.502707 30215 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:12.618789 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.624097 30379 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:12.585573 30306 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:12.592988 30148 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.524879 30324 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:12.541883 30410 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:11:12.531543 30020 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:12.495280 30337 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:12.620122 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 77944.3us
W20260709 12:11:12.628392 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 104160us
I20260709 12:11:12.530756 30412 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:12.531646 30114 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:12.630149 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.630800 30371 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:12.633689 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 163604us
I20260709 12:11:12.551276 30315 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:12.480106 30373 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.480226 30394 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.585496 30316 raft_consensus.cc:697] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:12.655893 27133 leader_election.cc:336] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.944s (SENT)
I20260709 12:11:12.587143 30419 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:12.689069 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:12.689234 30419 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.689996 30419 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.482256 30365 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:11:12.619769 30183 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:11:12.684296 30394 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:12.682755 26514 leader_election.cc:400] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9.
I20260709 12:11:12.735447 26514 leader_election.cc:403] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:11:12.686380 30373 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:12.683810 30114 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.685814 30316 consensus_queue.cc:237] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.682785 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:12.638566 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:12.665544 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:12.700093 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.711186 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:12.718302 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:12.767782 26613 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:12.768183 26544 raft_consensus.cc:2410] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:12.720197 30134 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:12.619282 30330 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:12.661069 30375 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.690210 30370 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:12.710991 30020 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:12.736078 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 53532.7us
W20260709 12:11:12.739751 30385 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.001s
I20260709 12:11:12.669080 30324 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
W20260709 12:11:12.690891 30387 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 12:11:12.753615 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 71046.9us
I20260709 12:11:12.755947 30373 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:12.747653 30417 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:12.774055 30430 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:11:12.781419 26621 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [4.4-6.5]
W20260709 12:11:12.781821 30406 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 12:11:12.726908 30424 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:12.809345 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:12.825366 30373 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:12.826542 30373 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:12.811088 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 145665us
W20260709 12:11:12.806968 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 64777.8us
I20260709 12:11:12.834681 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:12.835937 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:12.836124 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:12.816365 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:12.778280 30377 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:12.822711 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.780481 29832 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:12.839571 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:12.834746 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.836742 26544 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:12.845718 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:12.830847 30327 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.799273 30394 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:11:12.831408 30324 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.847838 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:12.819550 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.800772 30375 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:12.810716 30385 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:12.910548 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:12.911348 26541 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.912345 26546 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:12.886685 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:12.870031 29448 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:12.914964 30365 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:12.841202 30430 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:12.920194 30372 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:12.920840 30375 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:12.909873 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:12.922346 26615 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:11:12.910661 26540 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:12.913635 29448 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:12.927018 26613 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:12.869773 30328 consensus_meta.cc:287] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.002s
I20260709 12:11:12.933699 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:12.934792 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:12.935925 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:12.865299 30407 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 12:11:12.938818 26468 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.942246 29448 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:12.949668 26543 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:12.950830 29448 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.949102 26471 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:12.869542 30305 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:12.959306 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:12.959638 26465 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:11:12.959956 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.959826 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:12.968029 26464 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:12.868378 30068 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:12.857234 30377 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:12.960515 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:12.915767 30437 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:12.887156 30148 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:12.964498 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:12.886978 30007 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:12.865041 30420 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.840478 30306 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.867576 30415 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:12.919656 30337 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:12.971575 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 131748us
I20260709 12:11:12.839239 30424 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:12.975063 26466 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.975159 26544 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:12.975312 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:12.918742 30327 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.977519 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:12.870200 30434 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:12.960124 30365 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.988615 26467 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.884886 29832 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:12.971738 30068 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:13.026557 30068 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:13.027899 30068 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:13.003976 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.966002 30305 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:13.006560 26439 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:12.974539 26547 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
W20260709 12:11:13.005597 30363 consensus_meta.cc:287] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.714s	user 0.011s	sys 0.001s
I20260709 12:11:13.008817 30306 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.919979 30324 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:12.982089 30377 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:13.006417 29957 consensus_meta.cc:287] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.716s	user 0.012s	sys 0.000s
I20260709 12:11:13.019152 26541 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:13.020025 26542 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 7: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:11:13.010617 30368 consensus_meta.cc:287] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.791s	user 0.014s	sys 0.000s
I20260709 12:11:13.025168 29832 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:12.941761 30430 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:13.061574 26539 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:13.150650 30430 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:13.063182 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 56738.6us
I20260709 12:11:13.152006 26464 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
W20260709 12:11:13.060062 27133 leader_election.cc:336] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.781s (SENT)
I20260709 12:11:13.153292 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:13.153549 26469 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:13.072635 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.154881 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.146461 26471 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:13.088572 30305 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:13.017743 30434 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:11:13.097031 30227 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.801s	user 0.013s	sys 0.000s
I20260709 12:11:13.098377 30327 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:13.098687 30324 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:13.099820 27163 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:57562
W20260709 12:11:13.105662 30313 consensus_meta.cc:287] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.922s	user 0.007s	sys 0.003s
I20260709 12:11:13.164695 30313 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:13.165992 30426 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:11:13.167141 27166 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:13.167764 30395 consensus_meta.cc:287] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.706s	user 0.012s	sys 0.000s
I20260709 12:11:13.159544 30370 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:13.159626 30432 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 12:11:13.115581 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.138495 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 224893us
I20260709 12:11:13.169915 30339 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:13.162675 30227 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:13.172552 30227 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:13.147130 26466 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:13.158044 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2764) took 2005 ms. Trace:
I20260709 12:11:13.119112 30377 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:13.163874 27163 raft_consensus.cc:606] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:11:13.168244 30395 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:13.173192 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 113207us
I20260709 12:11:13.187664 27163 raft_consensus.cc:614] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:13.108218 30424 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:13.175666 26467 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:13.180179 26469 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:13.138870 26468 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:13.180938 30433 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.172756 30434 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:13.206117 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:13.206959 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:13.207145 26621 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:11:13.207676 26465 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:11:13.191205 30305 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.181522 27160 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:13.208871 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:13.185278 30312 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.177656 26617 rpcz_store.cc:276] 0709 12:11:11.152438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.261072 (+108634us) service_pool.cc:224] Handling call
0709 12:11:11.306687 (+ 45615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.467745 (+1161058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.157739 (+689994us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540003be54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:13.157981 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2657298176}
I20260709 12:11:13.033078 30365 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:13.217979 30365 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:13.193481 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:13.218863 26466 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 5.
I20260709 12:11:13.196046 30007 consensus_queue.cc:1059] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:13.196430 30395 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:13.197269 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:13.199921 30313 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:13.181845 30440 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.209830 26539 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 9: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:13.228969 30440 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:13.231478 30330 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:13.222795 30337 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.232910 30337 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:13.235955 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:13.231616 30440 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:13.209759 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:13.241371 26468 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.209710 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:13.210696 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:13.212875 27168 raft_consensus.cc:2368] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10.
I20260709 12:11:13.242722 26467 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:13.213672 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:13.222085 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:13.225286 26545 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:11:13.245946 26545 pending_rounds.cc:85] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 7
I20260709 12:11:13.246243 26545 pending_rounds.cc:107] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:11:13.225636 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:13.246546 26545 raft_consensus.cc:2889] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:13.225687 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:13.246727 26541 raft_consensus.cc:2376] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10. Re-sending same reply.
I20260709 12:11:13.227265 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:13.202601 30394 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:13.246084 27163 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:13.248528 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:13.253829 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:13.253867 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:13.255227 27159 raft_consensus.cc:2393] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:13.255288 26621 raft_consensus.cc:2410] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:13.212275 30424 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.259670 30424 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:13.266821 30007 raft_consensus.cc:3055] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:13.212030 30433 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:13.268558 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:13.267352 30007 raft_consensus.cc:740] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:13.155129 30368 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:13.300971 30368 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:13.271659 27167 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:13.302471 26622 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:13.303304 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:13.304659 30007 consensus_queue.cc:260] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:13.305066 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:13.306036 30007 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:13.283195 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:13.284260 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 70733.8us
I20260709 12:11:13.285008 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:13.285713 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:13.285801 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:13.286437 30134 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.287083 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:13.291874 30419 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.582s	user 0.013s	sys 0.000s
W20260709 12:11:13.294535 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.298591 30385 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:13.303431 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:13.306691 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:13.282192 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:13.306807 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:13.309302 30396 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.280218 27163 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:57562
I20260709 12:11:13.310858 30424 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:13.415354 30435 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.444s	user 0.004s	sys 0.001s
I20260709 12:11:13.398700 26466 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:11:13.414238 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:13.420275 26539 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 7: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:13.420446 26466 pending_rounds.cc:85] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 5
I20260709 12:11:13.415928 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:13.421342 27163 raft_consensus.cc:606] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:13.388908 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:13.421900 27163 raft_consensus.cc:614] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:13.422435 26473 raft_consensus.cc:2368] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9.
I20260709 12:11:13.420835 26466 pending_rounds.cc:107] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 8.6
W20260709 12:11:13.364868 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.423249 26466 raft_consensus.cc:2889] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:13.335897 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.430807 26541 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:11:13.431288 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:13.434638 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:13.427376 26545 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:13.443948 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:13.398752 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:13.375036 26467 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:13.450099 26617 raft_consensus.cc:2393] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:11:13.376120 27133 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.869s (SENT) [suppressed 30 similar messages]
I20260709 12:11:13.446550 26468 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:13.455448 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:13.455850 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:13.460366 26469 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
W20260709 12:11:13.461347 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.468950 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:13.469422 26473 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:13.469625 26469 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:13.471274 26473 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:13.472340 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:13.473282 27163 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 9: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:13.474360 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:13.475499 26465 raft_consensus.cc:2368] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9.
I20260709 12:11:13.471853 26469 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:13.477764 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:13.478003 26469 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:13.449223 30339 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:13.397274 30158 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:13.333315 30420 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9.
I20260709 12:11:13.489200 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:13.490686 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:13.494302 26468 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:13.495757 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:13.491827 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:13.498560 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.449333 30424 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:13.501276 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:13.502050 26465 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:11:13.503036 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:13.479784 30339 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.507011 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:13.509295 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:13.509955 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:13.519217 26473 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 5.
I20260709 12:11:13.472785 30328 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.488094 30158 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:13.466354 30337 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:13.527279 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:13.522588 26542 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:13.529716 26468 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:13.523690 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:13.464066 27161 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:11:13.440877 30377 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:13.539112 27163 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:57562
I20260709 12:11:13.521817 30339 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.517225 26619 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:13.521577 30424 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 9 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:13.549146 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:13.533164 26513 leader_election.cc:400] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9.
I20260709 12:11:13.506177 30143 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.530543 26539 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:11:13.553681 26513 leader_election.cc:403] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:13.440141 30396 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:13.554526 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:13.539922 27163 raft_consensus.cc:606] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:13.555742 27163 raft_consensus.cc:614] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:13.556824 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:13.542227 30158 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:13.542949 26465 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 7: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:13.543931 26468 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: [3.3-6.5]
W20260709 12:11:13.521821 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 145748us
I20260709 12:11:13.547556 26467 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:13.444937 30419 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:13.562233 27133 leader_election.cc:336] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.155s (SENT)
I20260709 12:11:13.558792 30143 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:13.566578 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:13.568126 30143 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:13.560117 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:13.569023 26539 raft_consensus.cc:2376] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9. Re-sending same reply.
I20260709 12:11:13.570516 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:13.571523 26539 raft_consensus.cc:2410] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:13.557593 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:13.563612 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:13.572751 27167 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 7: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:13.564123 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:13.565806 26464 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 11: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:13.566059 26468 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:13.573032 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:13.573704 26619 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:13.574905 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:13.576807 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.542992 30377 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:13.577462 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:13.532055 30328 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:13.582082 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:11:13.579206 26619 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 10: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:13.584626 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:13.585503 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:13.584779 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:13.587829 26619 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:13.573719 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 102537us
I20260709 12:11:13.589609 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:13.595532 26468 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:13.594924 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:13.596603 26439 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:13.577452 30143 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9.
I20260709 12:11:13.578820 30370 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:13.603945 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.608513 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 79787.4us
I20260709 12:11:13.610116 26513 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:13.599757 30431 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.623836 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:13.617776 26439 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:13.625187 26468 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:13.629308 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:13.630275 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:13.631081 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 529) took 2032 ms. Trace:
I20260709 12:11:13.631470 26614 rpcz_store.cc:276] 0709 12:11:11.598988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.632983 (+ 33995us) service_pool.cc:224] Handling call
0709 12:11:11.645708 (+ 12725us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.246427 (+600719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.630818 (+1384391us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b54003a4654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:13.631018 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1380197248}
I20260709 12:11:13.635449 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:13.636605 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:11:13.628034 30306 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.558s	user 0.013s	sys 0.000s
I20260709 12:11:13.643157 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:13.637202 26513 leader_election.cc:400] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9.
I20260709 12:11:13.627025 30368 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:13.638105 30251 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:11:13.650923 30368 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:13.651659 30251 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:13.652118 30251 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:13.653187 30251 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:13.641415 30431 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:13.627789 30457 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.699510 26619 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:13.637643 30377 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:13.672869 30452 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.072s	user 0.002s	sys 0.000s
I20260709 12:11:13.629886 30370 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:11:13.672880 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:13.672994 30251 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:13.627292 30143 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:11:13.673609 30413 raft_consensus.cc:3055] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:13.721407 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 48647.1us
I20260709 12:11:13.637440 30420 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:11:13.674482 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:13.722999 26614 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:13.697846 30060 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:13.674842 30433 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:13.728258 30339 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:13.731684 30227 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:13.733371 30227 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:13.734010 30227 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:13.675017 30454 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.073s	user 0.000s	sys 0.002s
I20260709 12:11:13.653615 30368 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:13.629730 30424 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:13.630548 30331 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:13.635285 30047 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.611670 30231 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:11:13.677264 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:13.633836 30191 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:13.642055 30307 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.709604 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:13.709882 26619 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:13.706188 27134 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:13.713361 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.673867 30328 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:13.723627 30365 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.747768 30420 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:13.721009 30413 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:13.753628 30420 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:13.736912 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 128990us
I20260709 12:11:13.754133 30420 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.736451 30143 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:13.756382 30143 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:13.712698 29832 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:13.741675 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 64477us
I20260709 12:11:13.710706 30396 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:13.754576 30047 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.759392 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:13.759491 30047 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:13.760325 30433 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.760471 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:13.760876 30433 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:13.745406 26466 raft_consensus.cc:2368] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10.
W20260709 12:11:13.746520 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.745941 27164 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:13.639381 30305 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.742825 30191 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:13.728807 30060 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:13.723536 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:13.766284 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:13.766104 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 60039.9us
I20260709 12:11:13.774834 26618 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:13.775013 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:13.767436 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:13.770676 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.698500 30431 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:13.762475 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:13.798094 26615 raft_consensus.cc:2410] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:11:13.765192 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.783535 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:13.763109 30433 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:13.782169 30191 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:13.787928 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1860) took 2830 ms. Trace:
I20260709 12:11:13.805037 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:48232 (request call id 532) took 2152 ms. Trace:
I20260709 12:11:13.791872 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:13.746161 30331 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:13.793635 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:13.782507 30385 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:13.762298 30339 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:13.767074 30396 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:13.763370 30047 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:13.803689 30143 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:13.806854 30060 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:13.828562 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:13.806645 30420 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:13.804243 30312 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:13.754243 30413 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:13.811053 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:11:13.835757 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.795626 30307 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.814136 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:13.836568 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.799882 26619 raft_consensus.cc:2368] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7.
I20260709 12:11:13.817883 30385 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.840580 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:13.787806 30330 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:13.808562 26472 rpcz_store.cc:276] 0709 12:11:10.948351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.054966 (+106615us) service_pool.cc:224] Handling call
0709 12:11:11.079716 (+ 24750us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:11.373634 (+293918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.373664 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:11.418681 (+ 45017us) log.cc:844] Serialized 52 byte log entry
0709 12:11:11.835296 (+416615us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:11.882581 (+ 47285us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.882863 (+   282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.882968 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:11.960008 (+ 77040us) spinlock_profiling.cc:243] Waited 7.45 ms on lock 0x7b180038ad60. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:11:11.965657 (+  5649us) spinlock_profiling.cc:243] Waited 63.8 ms on lock 0x7b180038ad60. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:11:12.541921 (+576264us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b180038ad60. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:11:13.771133 (+1229212us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b240011aa88. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072e739c4 00007f5072e71acb 00007f507302cdc9 00007f507302ca55 00007f507302bfb0 00007f5075ca2488 00007f5075ca2be8 00007f5075c7a398 00007f5075c7576a 00007f5075c74bb6
0709 12:11:13.778370 (+  7237us) raft_consensus.cc:1685] finished
0709 12:11:13.778457 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.778645 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12110,"prepare.queue_time_us":46009,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":48623,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":28281,"spinlock_wait_cycles":214304768,"thread_start_us":614764,"threads_started":2,"wal-append.queue_time_us":535683}
I20260709 12:11:13.843668 26467 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 12:11:13.822038 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.822899 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 99422.6us
I20260709 12:11:13.804459 30368 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:13.804612 30431 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:13.804608 30377 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.758725 29832 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:13.851509 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:13.804793 30461 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:13.833508 27160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 451) took 1373 ms. Trace:
I20260709 12:11:13.838023 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:13.856880 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:13.857580 26619 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:13.815161 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:13.858533 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:13.820017 30433 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:13.809475 26618 rpcz_store.cc:276] 0709 12:11:11.636848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.750922 (+114074us) service_pool.cc:224] Handling call
0709 12:11:13.741368 (+1990446us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54003a4654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d1a3d 00007f507b0a1cd0 00007f5074626254 00007f50746261e2 00007f5074626111 00007f507462608c 00007f5074625342 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:13.789538 (+ 48170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":949811456}
W20260709 12:11:13.858822 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 43790.3us
I20260709 12:11:13.858958 27134 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:13.858831 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:13.846457 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:13.848098 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.849355 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:13.846021 30330 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.860383 26541 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:11:13.847899 30250 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:13.860697 27160 rpcz_store.cc:276] 0709 12:11:12.459702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.460680 (+   978us) service_pool.cc:224] Handling call
0709 12:11:12.467636 (+  6956us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:13.216209 (+748573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.833104 (+616895us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b540071acd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:13.833428 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611347840}
I20260709 12:11:13.847337 30307 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:13.854822 30461 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:13.862496 30461 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:13.863535 30307 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:13.864749 30329 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:13.851008 30143 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.866233 30143 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:13.837574 30396 raft_consensus.cc:697] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:13.830318 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:13.854049 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:13.854187 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:13.834813 30312 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.845880 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:13.873157 26548 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:13.847077 30339 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:13.861593 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:13.858556 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:13.876001 26619 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:13.876474 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:13.876888 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:13.877113 26543 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 6.
I20260709 12:11:13.870998 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:13.871452 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:13.845726 30385 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:13.845733 30368 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:13.877823 26615 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:13.878885 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:13.879554 26545 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:13.846925 30444 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:11:13.852260 30379 raft_consensus.cc:3055] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:13.906240 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:13.881717 26547 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:13.907495 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:11:13.892976 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.887681 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:13.910145 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:13.868162 30330 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:13.868264 30433 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:13.875555 30339 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.870927 30231 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:13.921367 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:13.921489 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:13.920311 26619 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:13.879480 27159 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.875149 30312 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:13.876161 30251 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:13.883085 30060 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.926374 26471 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:13.923934 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:13.926360 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.911437 30368 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:13.927500 26547 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 9: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:13.918922 30365 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:13.923051 30339 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:13.916132 30379 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:13.920782 30433 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:13.924125 30395 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:13.929450 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 50618.7us
I20260709 12:11:13.935590 27165 raft_consensus.cc:2368] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7.
I20260709 12:11:13.924397 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:13.939111 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:13.949525 26548 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:11:13.925813 30259 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:13.934244 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:13.939111 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:13.925243 30251 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.953523 30251 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:13.950069 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:13.881287 30331 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:13.964351 30467 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:13.964740 30465 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:11:13.966252 30215 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:13.970511 30143 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:13.986058 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:13.955008 30395 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:13.937422 30424 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:11:13.995999 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:13.971953 30259 raft_consensus.cc:697] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 9 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:13.997337 30466 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:11:14.004356 30417 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:13.992174 30329 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.012943 27166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 544) took 3051 ms. Trace:
I20260709 12:11:13.936830 30396 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:14.014045 27166 rpcz_store.cc:276] 0709 12:11:10.956221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.956411 (+   190us) service_pool.cc:224] Handling call
0709 12:11:11.000185 (+ 43774us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.167667 (+2167482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:14.001429 (+833762us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b54005771d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:14.007970 (+  6541us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4983034752}
I20260709 12:11:13.995002 30020 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:13.984437 30305 consensus_queue.cc:1059] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:11:14.001107 30307 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:11:14.003103 30467 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.034940 30020 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:14.038559 30191 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:14.015825 30420 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:14.038372 30020 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:14.041028 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:14.030812 30227 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:14.042335 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:14.042829 30259 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:14.043646 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:14.035290 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 49341.5us
I20260709 12:11:14.046933 26541 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:14.047832 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:14.019742 30468 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:14.050760 27159 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:13.990613 30379 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:14.036077 30409 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:14.046994 30417 raft_consensus.cc:3055] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:14.060832 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:14.062075 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:14.064914 26548 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.065215 26544 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 10: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:14.018457 30329 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:14.062175 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 58452.7us
I20260709 12:11:14.064465 30417 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:14.075667 30227 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:14.078981 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:14.068468 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:14.083292 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:14.084690 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:14.087836 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:14.041051 30191 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:14.079160 30379 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.094777 26548 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:11:14.046577 30467 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:14.099629 26615 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:11:14.105767 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:14.088426 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:14.090461 30215 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.054841 30468 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:14.090816 30424 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:14.125240 27164 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:14.087836 30411 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:11:14.125208 30047 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.128034 30020 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.131320 30047 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:14.132431 30471 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:11:14.132602 30467 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:14.133752 30047 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:14.123692 27160 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
W20260709 12:11:14.135926 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 46376us
I20260709 12:11:14.059266 30395 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:14.141549 26514 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:14.129192 30424 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.144042 30424 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:14.162905 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.163591 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 115852us
I20260709 12:11:14.164768 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:14.166124 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:14.167289 26615 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:14.167956 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:14.169612 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:14.171905 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:14.175299 26514 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:14.176162 26619 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:14.181459 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:14.183918 26514 leader_election.cc:400] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7.
I20260709 12:11:14.184514 26514 leader_election.cc:403] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:11:14.189405 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:14.193662 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:14.196005 26438 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:14.198040 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:14.198496 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:14.201232 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:14.152460 30307 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:14.207170 30476 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:11:14.207906 30472 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:11:14.180241 30431 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:14.211453 30431 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:14.201983 30143 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.212975 30368 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:14.202127 30047 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:14.216849 30047 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:14.202376 30215 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.219715 30251 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:14.222770 26545 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:14.224902 30020 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:14.187601 30420 raft_consensus.cc:2764] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:11:14.203857 30411 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.215728 30312 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:14.462927 30060 consensus_meta.cc:287] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.533s	user 0.006s	sys 0.006s
I20260709 12:11:14.604926 30060 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.605779 30060 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:14.606312 30060 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:14.606494 30312 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:14.215720 30461 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:14.607352 30060 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:14.608814 30461 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:14.334239 30330 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:14.615629 30314 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:14.616657 30314 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:14.218757 30468 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:14.217926 30047 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:14.604478 30329 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:14.625607 30424 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:14.142580 30417 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:14.644623 30417 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.215858 30368 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:14.603916 30251 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:14.462724 30385 consensus_meta.cc:287] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.549s	user 0.002s	sys 0.009s
I20260709 12:11:14.913435 30385 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:14.707352 30339 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:14.937043 30339 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:14.820235 30314 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:14.984364 30433 consensus_meta.cc:287] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.021s	user 0.008s	sys 0.004s
W20260709 12:11:14.967787 30365 consensus_meta.cc:287] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.994s	user 0.009s	sys 0.001s
I20260709 12:11:14.916602 30385 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:15.045111 30396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.011s	sys 0.014s
W20260709 12:11:15.078384 30396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.011s	sys 0.015s
I20260709 12:11:15.077972 30365 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:15.078647 30424 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:15.074129 30433 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:15.103184 30227 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.013s	sys 0.096s
W20260709 12:11:15.109117 30379 consensus_meta.cc:287] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.992s	user 0.012s	sys 0.000s
W20260709 12:11:15.151922 30409 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.070s	user 0.014s	sys 0.000s
W20260709 12:11:15.114876 30227 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.014s	sys 0.096s
W20260709 12:11:15.180301 30047 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.043s	sys 0.067s
W20260709 12:11:15.180548 30395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.013s	sys 0.008s
W20260709 12:11:15.273676 30047 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.043s	sys 0.067s
W20260709 12:11:15.278923 30395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.014s	sys 0.008s
I20260709 12:11:15.181318 30409 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:15.332412 30433 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:15.575241 30483 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
W20260709 12:11:15.576184 30488 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:11:15.573997 30480 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
W20260709 12:11:15.594018 30411 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.956s	user 0.016s	sys 0.000s
I20260709 12:11:15.851312 30411 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7.
W20260709 12:11:15.201036 30331 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.003s	sys 0.018s
W20260709 12:11:16.162875 30331 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.844s	user 0.003s	sys 0.019s
I20260709 12:11:16.172344 30158 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:16.179800 30314 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.187s	user 0.008s	sys 0.007s
W20260709 12:11:16.180327 30314 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.187s	user 0.008s	sys 0.007s
W20260709 12:11:16.495242 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.496081 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.496737 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.497469 30158 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.498258 30158 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:16.501266 30158 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:16.501264 30394 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:16.503254 30394 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:16.505784 30394 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:16.534540 26546 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:11:16.535395 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2022) took 2626 ms. Trace:
I20260709 12:11:16.535633 26546 rpcz_store.cc:276] 0709 12:11:13.908707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.533622 (+2624915us) service_pool.cc:224] Handling call
0709 12:11:16.534173 (+   551us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.535065 (+   892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.535341 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:16.536026 26360 maintenance_manager.cc:419] P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033589
I20260709 12:11:16.537483 30306 raft_consensus.cc:3055] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:16.537978 30306 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:16.538911 30306 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:16.540340 30306 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:16.548259 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 562) took 2638 ms. Trace:
I20260709 12:11:16.548679 26546 rpcz_store.cc:276] 0709 12:11:13.909719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.536344 (+2626625us) service_pool.cc:224] Handling call
0709 12:11:16.536665 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:16.537070 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.537103 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:16.537813 (+   710us) log.cc:844] Serialized 52 byte log entry
0709 12:11:16.538963 (+  1150us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:16.547014 (+  8051us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.547666 (+   652us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.547905 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.547980 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.548019 (+    39us) raft_consensus.cc:1685] finished
0709 12:11:16.548029 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.548174 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40,"prepare.queue_time_us":8423,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":92,"raft.queue_time_us":1973,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":261,"spinlock_wait_cycles":79616,"thread_start_us":8404,"threads_started":2,"wal-append.queue_time_us":1136}
I20260709 12:11:16.552918 26546 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:11:16.553308 26546 pending_rounds.cc:85] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 5
I20260709 12:11:16.553633 26546 pending_rounds.cc:107] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:11:16.553604 30306 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.554025 30328 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.554258 26546 raft_consensus.cc:2889] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:16.554533 30306 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:16.555384 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1918) took 2637 ms. Trace:
I20260709 12:11:16.554613 30328 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:16.555794 26546 rpcz_store.cc:276] 0709 12:11:13.917602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.550557 (+2632955us) service_pool.cc:224] Handling call
0709 12:11:16.552526 (+  1969us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.555083 (+  2557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.555297 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:16.557117 30306 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:16.557519 30328 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:16.560196 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2024) took 2641 ms. Trace:
I20260709 12:11:16.560856 26546 rpcz_store.cc:276] 0709 12:11:13.919015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.556705 (+2637690us) service_pool.cc:224] Handling call
0709 12:11:16.557090 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.557312 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:16.557929 (+   617us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.559611 (+  1682us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.559823 (+   212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:16.559870 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:16.559930 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.560000 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.560133 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":257,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":65,"raft.queue_time_us":234,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":165,"spinlock_wait_cycles":227072,"thread_start_us":718,"threads_started":1,"wal-append.queue_time_us":1073}
I20260709 12:11:16.563238 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 564) took 2407 ms. Trace:
I20260709 12:11:16.563678 26547 rpcz_store.cc:276] 0709 12:11:14.156223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.562570 (+2406347us) service_pool.cc:224] Handling call
0709 12:11:16.562816 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.562951 (+   135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.562967 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:16.562999 (+    32us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:16.563019 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.563052 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.563130 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:16.569670 30419 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:16.573081 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 563) took 2511 ms. Trace:
I20260709 12:11:16.573578 26546 rpcz_store.cc:276] 0709 12:11:14.061961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.562557 (+2500596us) service_pool.cc:224] Handling call
0709 12:11:16.562898 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.563267 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.563294 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.563749 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.571055 (+  7306us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:16.571416 (+   361us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.571966 (+   550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.572051 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.572832 (+   781us) raft_consensus.cc:1685] finished
0709 12:11:16.572851 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.573003 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":206,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":261,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":181,"thread_start_us":6887,"threads_started":1,"wal-append.queue_time_us":7219}
W20260709 12:11:16.603631 27133 connection.cc:256] RPC call timeout handler was delayed by -1.8961403239998162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32010000000000005s for a response
I20260709 12:11:16.605216 30499 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.605804 30499 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:16.606791 26617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 552) took 2383 ms (client timeout 1696 ms). Trace:
W20260709 12:11:16.607434 26548 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.476s	user 0.017s	sys 0.024s
W20260709 12:11:16.607834 26548 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.476s	user 0.018s	sys 0.024s
I20260709 12:11:16.608197 30499 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:16.609194 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1912) took 2740 ms. Trace:
W20260709 12:11:16.607210 26617 rpcz_store.cc:269] 0709 12:11:14.223586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.606578 (+2382992us) service_pool.cc:211] Skipping call since client already timed out
0709 12:11:16.606699 (+   121us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:11:16.609648 26548 rpcz_store.cc:276] 0709 12:11:13.868643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.116056 (+247413us) service_pool.cc:224] Handling call
0709 12:11:14.116474 (+   418us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:14.116887 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:14.116926 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:14.119326 (+  2400us) log.cc:844] Serialized 52 byte log entry
0709 12:11:16.608223 (+2488897us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:16.608606 (+   383us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.608839 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.608924 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.608971 (+    47us) raft_consensus.cc:1685] finished
0709 12:11:16.608985 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.609134 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2374,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":901,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":3058,"thread_start_us":2476738,"threads_started":1,"wal-append.queue_time_us":1034614}
I20260709 12:11:16.612708 30499 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.613339 30499 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:16.614568 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 543) took 3034 ms. Trace:
I20260709 12:11:16.614952 26614 rpcz_store.cc:276] 0709 12:11:13.579744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.723751 (+144007us) service_pool.cc:224] Handling call
0709 12:11:13.725301 (+  1550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.753702 (+ 28401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:13.753758 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:13.753820 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:13.753874 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.614256 (+2860382us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b540009f1d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:16.614301 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.614468 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64632704}
I20260709 12:11:16.615514 30499 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:16.616721 30499 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:16.617532 27133 connection.cc:256] RPC call timeout handler was delayed by -1.2813341209998725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 12:11:16.618080 27133 connection.cc:256] RPC call timeout handler was delayed by -1.2804341209998711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
W20260709 12:11:16.618573 27133 connection.cc:256] RPC call timeout handler was delayed by -1.2534341210000548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
I20260709 12:11:16.617974 30499 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:16.618906 27133 connection.cc:256] RPC call timeout handler was delayed by -1.1778341209999326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
W20260709 12:11:16.619277 27133 connection.cc:256] RPC call timeout handler was delayed by -1.065334120999978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
W20260709 12:11:16.619621 27133 connection.cc:256] RPC call timeout handler was delayed by -1.0590341209999679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
W20260709 12:11:16.619938 27133 connection.cc:256] RPC call timeout handler was delayed by -1.0590341209999679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
I20260709 12:11:16.620615 30499 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:16.621706 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.627902 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.628705 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.629017 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.636574 26464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 519) took 3451 ms (client timeout 3201 ms). Trace:
W20260709 12:11:16.637142 26464 rpcz_store.cc:269] 0709 12:11:13.179017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.196932 (+ 17915us) service_pool.cc:224] Handling call
0709 12:11:16.630129 (+3433197us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b54001c0554. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:16.630302 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":789265152}
I20260709 12:11:16.638443 30501 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.639317 30502 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:16.884570 30502 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:16.887156 30502 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:16.887826 30502 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.888273 30502 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:16.890612 30502 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:16.878862 30503 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.891645 30503 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:16.892820 30501 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:16.895083 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 129219us
W20260709 12:11:16.906199 27133 leader_election.cc:336] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.623s (SENT)
I20260709 12:11:16.906709 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:16.907521 30499 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:16.895943 30503 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:16.908340 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.908399 27133 leader_election.cc:336] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.653s (SENT)
I20260709 12:11:16.910147 30413 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:16.911062 27133 leader_election.cc:336] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.869s (SENT)
W20260709 12:11:16.912581 27133 leader_election.cc:336] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.869s (SENT)
I20260709 12:11:16.913002 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:16.913829 30499 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:16.924444 30501 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:16.927058 26540 raft_consensus.cc:2410] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:11:16.928864 26540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 1908) took 3081 ms (client timeout 1500 ms). Trace:
W20260709 12:11:16.929131 26540 rpcz_store.cc:269] 0709 12:11:13.848212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.848360 (+   148us) service_pool.cc:224] Handling call
0709 12:11:16.928657 (+3080297us) spinlock_profiling.cc:243] Waited 3.07 s on lock 0x7b54003cf354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:16.928785 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7053163904}
W20260709 12:11:16.935643 27164 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56886 (request call id 634) took 3144 ms (client timeout 2170 ms). Trace:
W20260709 12:11:16.936090 27164 rpcz_store.cc:269] 0709 12:11:13.791191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.792270 (+  1079us) service_pool.cc:224] Handling call
0709 12:11:16.935442 (+3143172us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b540071b954. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:16.935567 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45591296}
I20260709 12:11:16.957597 30502 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.958010 30413 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:16.958992 30382 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.959123 30413 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:16.959561 30382 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:16.961545 30413 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:16.961664 30500 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.962272 30500 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:16.958544 30501 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:16.963227 30505 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.963663 30501 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:16.966001 30501 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:16.966630 30501 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.958264 30502 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:16.968897 30502 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:16.969585 30501 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:16.963753 30505 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:16.970741 26542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 542) took 3761 ms (client timeout 1656 ms). Trace:
W20260709 12:11:16.971155 26542 rpcz_store.cc:269] 0709 12:11:13.208845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.210353 (+  1508us) service_pool.cc:224] Handling call
0709 12:11:16.970550 (+3760197us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b5400237dd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:16.970667 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643094912}
I20260709 12:11:16.971832 30501 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:16.962142 30413 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.973335 30500 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:16.975221 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 541) took 4450 ms. Trace:
I20260709 12:11:16.976203 26622 rpcz_store.cc:276] 0709 12:11:12.524394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.534856 (+ 10462us) service_pool.cc:224] Handling call
0709 12:11:12.595059 (+ 60203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.302937 (+707878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.974901 (+3671964us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b5400267854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:16.975116 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1626318080}
I20260709 12:11:16.975541 30382 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:16.971881 30505 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:16.983482 26513 connection.cc:256] RPC call timeout handler was delayed by -1.5384678830000666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23399999999999999s for a response
W20260709 12:11:16.983989 26513 connection.cc:256] RPC call timeout handler was delayed by -1.1777477890000227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2217s for a response
W20260709 12:11:16.984304 26513 connection.cc:256] RPC call timeout handler was delayed by -1.0794678830000066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28500000000000003s for a response
I20260709 12:11:16.986176 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:16.986654 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:16.986953 26548 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:16.989395 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:16.990097 26548 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:16.990965 30413 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:16.992161 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:16.992724 30250 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:16.995154 30250 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.996412 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:16.997056 26542 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.987282 26540 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:16.993825 26548 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:17.005972 30494 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.994693 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2876) took 3154 ms. Trace:
I20260709 12:11:17.006961 26473 rpcz_store.cc:276] 0709 12:11:13.840414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.841644 (+  1230us) service_pool.cc:224] Handling call
0709 12:11:13.842300 (+   656us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:13.866832 (+ 24532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:13.866864 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:13.867390 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 12:11:14.016640 (+149250us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:14.016706 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.994249 (+2977543us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b54002599d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:16.994303 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.994353 (+    50us) raft_consensus.cc:1685] finished
0709 12:11:16.994364 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.994628 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1900,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7941,"spinlock_wait_cycles":55451904,"thread_start_us":147895,"threads_started":1,"wal-append.queue_time_us":220101,"wal-append.run_cpu_time_us":2580,"wal-append.run_wall_time_us":1173668}
I20260709 12:11:17.010097 29957 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.010716 29957 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:17.012794 29957 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:17.015738 26540 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:11:17.008648 30494 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:17.018381 30413 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:17.018884 30494 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:17.016754 26542 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:17.024617 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:17.025604 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:17.028337 30363 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:17.028900 30363 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.029258 30363 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.024284 30250 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:17.035142 27159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 635) took 2901 ms. Trace:
I20260709 12:11:17.035588 27159 rpcz_store.cc:276] 0709 12:11:14.133930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.134177 (+   247us) service_pool.cc:224] Handling call
0709 12:11:14.134558 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:14.142934 (+  8376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:14.142963 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:14.142989 (+    26us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:14.143052 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.034851 (+2891799us) spinlock_profiling.cc:243] Waited 8.16 ms on lock 0x7b54003b6ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:17.034905 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.035069 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18775296}
I20260709 12:11:17.039781 30250 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:17.047756 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1916) took 3166 ms. Trace:
I20260709 12:11:17.048208 26545 rpcz_store.cc:276] 0709 12:11:13.881383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.163149 (+281766us) service_pool.cc:224] Handling call
0709 12:11:14.198104 (+ 34955us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:14.223416 (+ 25312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.047466 (+2824050us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b5400398ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:17.047682 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56051456}
I20260709 12:11:17.057125 30250 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:17.057718 30250 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.058156 30250 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.064512 30328 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.065183 30328 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:17.067356 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:17.069862 30328 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:17.070477 30500 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:17.073868 30500 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:17.076355 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.071017 27165 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 455) took 3194 ms (client timeout 1765 ms). Trace:
W20260709 12:11:17.077121 27165 rpcz_store.cc:269] 0709 12:11:13.876550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.876739 (+   189us) service_pool.cc:224] Handling call
0709 12:11:17.070749 (+3194010us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b540056bb54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:17.070925 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40065920}
I20260709 12:11:17.072893 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:17.080638 30500 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:17.081404 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:17.082741 26545 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:17.083438 26438 connection.cc:256] RPC call timeout handler was delayed by -2.5135148800000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
W20260709 12:11:17.083868 26438 connection.cc:256] RPC call timeout handler was delayed by -2.473014879999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260709 12:11:17.089499 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 3.2922e+06us
I20260709 12:11:17.090567 30324 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:17.091241 30324 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:17.093488 30324 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:17.094063 30324 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.094573 29957 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.095189 29957 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:17.097966 29957 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:17.099895 30506 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.101433 29832 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:17.104565 30330 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:17.106930 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.107717 30506 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:17.111948 26618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.913s	user 0.054s	sys 0.102s
I20260709 12:11:17.101315 30250 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:17.109462 30413 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:11:17.112463 26618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.925s	user 0.055s	sys 0.102s
I20260709 12:11:17.112903 30413 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:17.114512 30500 raft_consensus.cc:697] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:17.115628 30505 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:17.116139 30505 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:17.117105 30505 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:17.118867 30505 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.121322 26539 raft_consensus.cc:2368] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7.
I20260709 12:11:17.122547 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:17.123579 26539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2018) took 3267 ms (client timeout 1521 ms). Trace:
W20260709 12:11:17.124048 26539 rpcz_store.cc:269] 0709 12:11:13.856967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.858268 (+  1301us) service_pool.cc:224] Handling call
0709 12:11:17.123313 (+3265045us) spinlock_profiling.cc:243] Waited 3.26 s on lock 0x7b54000b5254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:17.123494 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7501030272}
I20260709 12:11:17.125612 30324 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:17.128086 30324 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:17.128891 29957 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.129489 29957 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:17.131124 30250 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:17.115636 30500 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:17.132673 26439 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:17.133436 30134 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:17.134969 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:17.134131 30134 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:17.136205 30134 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.136662 30134 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.139799 26545 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:17.105046 30363 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:17.142349 27168 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 450) took 4687 ms (client timeout 1755 ms). Trace:
I20260709 12:11:17.142979 30363 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:17.142827 27168 rpcz_store.cc:269] 0709 12:11:12.455369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.456401 (+  1032us) service_pool.cc:224] Handling call
0709 12:11:17.142097 (+4685696us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b54006a68d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:17.142250 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1659328128}
I20260709 12:11:17.144177 30506 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:17.147083 26615 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:17.155534 26588 connection.cc:256] RPC call timeout handler was delayed by -1.4269031219998851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
W20260709 12:11:17.157917 26466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2857) took 3716 ms (client timeout 2340 ms). Trace:
I20260709 12:11:17.160459 30314 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:17.167380 30314 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:17.170346 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.170523 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.163975 26587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.973s	user 0.012s	sys 0.011s
W20260709 12:11:17.171562 26587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.981s	user 0.013s	sys 0.012s
W20260709 12:11:17.172336 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 2.98285e+06us
I20260709 12:11:17.166581 30474 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.175097 30474 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:17.177749 30474 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:17.158411 26466 rpcz_store.cc:269] 0709 12:11:13.441412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.463031 (+ 21619us) service_pool.cc:224] Handling call
0709 12:11:17.157692 (+3694661us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54003d0c54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:17.157840 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":586806144}
I20260709 12:11:17.179240 30467 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:17.179787 30467 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:17.180932 30467 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:17.196185 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.236093 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:17.222209 26620 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.060s	user 0.033s	sys 0.024s
W20260709 12:11:17.258733 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.198880 26470 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 11. Ops: []
W20260709 12:11:17.216279 27134 connection.cc:256] RPC call timeout handler was delayed by -1.3414508280000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
I20260709 12:11:17.259680 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:17.260780 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:17.261046 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:17.261713 26540 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.262734 26588 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:17.187372 26541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2019) took 3330 ms (client timeout 1566 ms). Trace:
I20260709 12:11:17.261704 26539 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
W20260709 12:11:17.241925 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 67553.2us
W20260709 12:11:17.264329 26541 rpcz_store.cc:269] 0709 12:11:13.857313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.861314 (+  4001us) service_pool.cc:224] Handling call
0709 12:11:17.187037 (+3325723us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400105ed4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:17.187241 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393168256}
I20260709 12:11:17.264984 26615 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:17.268388 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:17.269068 26473 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.269753 26540 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
W20260709 12:11:17.255996 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 121139us
I20260709 12:11:17.276677 26439 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:17.283728 30328 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.286257 26544 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:17.290704 30467 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.223457 30500 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:17.292692 30500 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:17.254650 30114 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 12:11:17.299314 26620 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.137s	user 0.037s	sys 0.026s
I20260709 12:11:17.299716 30324 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:17.300189 30324 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.170249 30314 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:17.300549 30324 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:17.301817 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:17.302590 26466 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:17.303121 27168 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:17.304287 26439 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:17.305738 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:17.300562 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:17.306305 26465 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:17.306846 26621 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.297408 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:17.307806 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:17.306547 26469 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 16: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:11:17.310079 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 47443.2us
W20260709 12:11:17.310117 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 45890.9us
I20260709 12:11:17.310949 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:17.315382 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:17.316267 26469 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:11:17.317330 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:17.318012 26469 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:17.319576 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:17.321362 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:17.322613 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:17.323491 26471 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:17.333336 26473 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:17.320391 26469 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:17.335829 27165 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:17.335984 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:17.337090 26469 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:17.337435 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:17.338330 26545 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.339941 30513 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:17.341091 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:17.341377 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 44045.7us
I20260709 12:11:17.341804 26472 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:11:17.336144 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:17.342902 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:17.343480 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:17.311391 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:17.344523 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:17.345104 26467 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.345148 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:17.344045 26466 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:17.341122 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:17.348560 26614 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:17.219424 30306 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.342073 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:17.350231 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:17.351744 30505 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:17.352807 26513 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:17.353039 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:17.225970 30434 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.353324 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:17.344700 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:17.358258 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:17.359447 26468 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:11:17.345770 27162 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:17.360523 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:17.302596 30328 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:17.361824 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:17.303655 30437 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.311882 30363 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:17.312249 30158 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.377806 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:17.390654 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:17.391614 29448 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:17.376924 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:17.352639 30114 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.334647 30313 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:17.379911 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 43834.4us
I20260709 12:11:17.363511 30499 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:17.343083 29832 raft_consensus.cc:2764] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:17.352249 30505 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.363098 30306 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:17.396713 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:17.411185 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:17.384390 26617 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:17.411999 26466 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:11:17.376825 30444 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:17.379172 30314 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:11:17.388185 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 46200.8us
I20260709 12:11:17.403370 26467 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:17.375125 30518 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:17.404554 26465 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:17.334308 30510 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:17.401242 30330 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:17.356895 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:17.410082 26545 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:17.372043 30519 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:17.346127 29957 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:17.354187 30474 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:11:17.411861 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:17.412993 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:17.446637 26513 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:17.410789 30505 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:17.413580 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 64013.7us
I20260709 12:11:17.413076 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:17.449323 26471 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:17.413481 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:17.411909 26622 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:11:17.415750 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:17.359202 30250 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:11:17.417846 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:17.363152 30331 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:11:17.420759 30134 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:17.408416 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:17.453770 26473 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:17.418879 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:17.454751 26467 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:17.455811 30134 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:17.457602 26464 raft_consensus.cc:2368] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 11. Current term is 12.
I20260709 12:11:17.402540 30499 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:17.449839 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.445211 26469 raft_consensus.cc:2368] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10.
I20260709 12:11:17.458340 30499 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.394996 30363 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:17.447924 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:17.419392 30328 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:17.423616 30518 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.473006 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:17.473050 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 54592us
W20260709 12:11:17.478647 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 76486.6us
I20260709 12:11:17.417709 30444 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.402473 30114 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:17.490495 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:17.491331 26622 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:11:17.492502 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:17.495817 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.487386 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:17.414594 30500 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:17.480387 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:17.508337 30500 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:17.513983 30500 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:17.514462 30500 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:17.515547 30500 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:17.517647 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.522111 30444 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.481235 30331 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:17.447455 30510 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:17.447131 30330 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:11:17.629257 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.660411 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.660615 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 151783us
I20260709 12:11:17.468842 30332 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:17.670830 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 184335us
W20260709 12:11:17.555647 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 139963us
I20260709 12:11:17.467640 30413 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:17.469375 30519 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:17.690487 26513 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:17.699824 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2793) took 3532 ms. Trace:
I20260709 12:11:17.700708 26618 rpcz_store.cc:276] 0709 12:11:14.167746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.168587 (+   841us) service_pool.cc:224] Handling call
0709 12:11:14.187343 (+ 18756us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.112905 (+2925562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:17.112937 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:17.113432 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:11:17.512150 (+398718us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b540005b7a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076044090 00007f50760516b8 00007f50760da92b 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c
0709 12:11:17.512211 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:17.512260 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.512364 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.512411 (+    47us) raft_consensus.cc:1685] finished
0709 12:11:17.512422 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.699725 (+187303us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":427307,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":123,"spinlock_wait_cycles":66661760,"thread_start_us":3163064,"threads_started":2,"wal-append.queue_time_us":236828}
I20260709 12:11:17.471756 30328 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.534933 30331 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:17.659150 30516 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:11:17.707029 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.561985 30531 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:17.706822 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:17.688762 30330 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.524232 30313 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:17.748121 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:17.699936 30314 raft_consensus.cc:697] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:17.722862 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:17.695407 30332 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.718637 30522 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.728479 29448 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:17.741259 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:17.691978 29832 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:11:17.748116 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.750438 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:17.751271 26621 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:17.753630 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:17.737017 30331 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.763583 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:17.535807 30020 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.201s
I20260709 12:11:17.725948 30328 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.784814 29448 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:17.789443 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.765832 30332 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.658993 30525 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:17.589373 30499 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:17.769902 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:17.774729 27159 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.777572 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:17.779277 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:17.749159 30531 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.779668 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:17.774188 30522 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:17.781845 30538 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:17.781370 30314 consensus_queue.cc:237] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:17.718782 30509 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
W20260709 12:11:17.793936 26439 connection.cc:256] RPC call timeout handler was delayed by -2.15384581100011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
I20260709 12:11:17.481638 30518 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.774039 30494 raft_consensus.cc:2764] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:11:17.768453 30530 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:17.797405 30474 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:17.804852 26621 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:17.801669 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:17.850179 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.791577 30466 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.814790 30538 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.788036 30134 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.787395 30523 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:17.816675 30525 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:17.825769 27189 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc620 after lost signal to thread 25296
I20260709 12:11:17.803572 30020 consensus_queue.cc:1243] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:17.827957 30519 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:17.780416 29832 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:17.817646 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 127300us
I20260709 12:11:17.840742 27159 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
W20260709 12:11:17.821218 26439 connection.cc:256] RPC call timeout handler was delayed by -1.9134921439999744s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
I20260709 12:11:17.801523 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 551) took 3640 ms. Trace:
I20260709 12:11:17.803362 30306 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:17.812358 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:17.906674 26622 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.906029 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:17.876421 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.821612 30515 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:11:17.802851 30313 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:17.808707 30531 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.821703 30534 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.895821 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:17.904945 26469 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:17.820616 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 130293us
I20260709 12:11:17.830597 30539 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.910560 26473 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:11:17.902933 26620 rpcz_store.cc:276] 0709 12:11:14.161380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.161549 (+   169us) service_pool.cc:224] Handling call
0709 12:11:14.161880 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:14.162082 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:17.299880 (+3137798us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.796702 (+496822us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:17.796916 (+   214us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:17.800770 (+  3854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.801060 (+   290us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.801390 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1012473,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":1714,"raft.queue_time_us":88494,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":63,"thread_start_us":3633616,"threads_started":3,"wal-append.queue_time_us":169284}
I20260709 12:11:17.894315 30114 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:17.793841 30510 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:17.920836 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:17.894074 30538 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:17.943771 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.966756 30060 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:17.967387 30060 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:17.967952 30060 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.967644 30525 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:17.948616 26473 pending_rounds.cc:85] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 7
I20260709 12:11:17.949052 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:17.969695 26473 pending_rounds.cc:107] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:11:17.970044 26473 raft_consensus.cc:2889] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:17.947939 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:17.949028 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 499803us
I20260709 12:11:17.971529 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:17.971957 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:17.972203 26473 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:17.973510 26542 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:17.864557 30474 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:17.956604 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 60860.4us
I20260709 12:11:17.958796 30549 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:11:17.959509 30535 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:11:17.959808 30545 raft_consensus.cc:3055] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:17.971529 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:17.987119 26588 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:17.916919 30306 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:17.988606 30114 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:17.969508 30539 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:17.991268 26543 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:17.992368 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:17.993498 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:17.893731 30523 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:17.995007 26547 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:17.995715 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:17.997489 26541 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:17.998101 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:17.998912 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:17.999555 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:17.894039 30134 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.012130 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:17.913455 30540 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.907862 30413 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:18.006119 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:17.863832 30530 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:18.123529 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.022737 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:17.987510 26545 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:18.199365 26620 raft_consensus.cc:2410] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:18.026433 27165 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 6.
I20260709 12:11:17.970196 30499 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:18.028667 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2770) took 5800 ms. Trace:
I20260709 12:11:18.193024 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:18.196751 26473 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 7: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:18.189472 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:18.197108 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 191077us
I20260709 12:11:18.204421 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.204692 26513 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:18.205765 26473 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:11:18.195010 26542 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 6.
I20260709 12:11:18.196430 26539 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.196696 26548 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:11:18.213785 26620 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:18.200523 26616 rpcz_store.cc:276] 0709 12:11:12.228020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.245123 (+ 17103us) service_pool.cc:224] Handling call
0709 12:11:12.551881 (+306758us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b5800049298. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5eee 000000000036eb39 00007f507b0291e0 00007f507b0f20c4 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:11:12.552131 (+   250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:12.755120 (+202989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:12.755157 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:17.229962 (+4474805us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b2c000c78e8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:11:17.230520 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:11:17.402265 (+171745us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:17.402302 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.402529 (+   227us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.028410 (+625881us) raft_consensus.cc:1685] finished
0709 12:11:18.028432 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.028604 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42553,"raft.queue_time_us":75272,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":4841,"spinlock_wait_cycles":31567488,"thread_start_us":330647,"threads_started":2,"wal-append.queue_time_us":304622}
I20260709 12:11:18.193928 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:18.240273 26541 raft_consensus.cc:2410] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:11:18.024765 30467 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.733s	user 0.010s	sys 0.003s
W20260709 12:11:18.026131 30434 consensus_meta.cc:287] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.646s	user 0.014s	sys 0.000s
I20260709 12:11:18.245730 26514 leader_election.cc:400] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 6 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 6. Current term is 7.
I20260709 12:11:18.251145 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:18.249668 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.262751 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:17.951478 30534 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:18.262208 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 54807.9us
I20260709 12:11:18.263916 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:18.265142 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:18.270232 30548 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:11:18.270495 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:18.271667 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:18.272239 26620 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:18.273067 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:18.273620 26620 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 6.
I20260709 12:11:18.274917 26546 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:18.265611 26621 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
W20260709 12:11:18.275642 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 71054.6us
I20260709 12:11:18.060191 30306 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.266064 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:18.266557 26472 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
W20260709 12:11:18.267459 27189 debug-util.cc:398] Leaking SignalData structure 0x7b08002589a0 after lost signal to thread 26405
W20260709 12:11:18.283859 27189 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc380 after lost signal to thread 26419
W20260709 12:11:18.285528 27189 debug-util.cc:398] Leaking SignalData structure 0x7b0800258b20 after lost signal to thread 26497
W20260709 12:11:18.286600 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.267706 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:18.268133 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:18.287791 26544 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:11:18.288313 26466 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.021401 30545 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:18.290930 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.039783 30549 raft_consensus.cc:697] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:18.188853 30537 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.279001 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:18.277136 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:18.263924 30411 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.243880 30542 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:18.292963 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:18.277165 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:18.290659 30434 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:18.258746 26543 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:11:18.304121 30557 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.204960 30540 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.305510 30545 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:18.307252 30536 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:11:18.307991 30534 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:18.309559 26546 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:18.312163 27165 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:18.312019 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:18.281586 30467 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.325141 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:18.294095 30306 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.330681 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:18.333139 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:18.338796 27159 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:18.333345 26619 raft_consensus.cc:2410] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:18.300200 30537 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.310920 30363 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:18.341482 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:18.338116 26613 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:11:18.336570 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:18.353224 30331 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.000s
I20260709 12:11:18.334615 30522 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:18.355710 30530 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:18.358853 30534 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:18.359671 30534 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.361217 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:18.364614 30474 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:18.367025 30324 consensus_meta.cc:287] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.066s	user 0.008s	sys 0.004s
I20260709 12:11:18.367657 30539 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:18.367502 30324 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.368273 30539 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.368655 26471 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:11:18.369949 30534 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:18.341708 30413 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.371842 27159 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:11:18.342762 26466 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:18.340626 29832 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:18.374634 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:18.344071 30537 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.335698 30467 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.379696 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.381750 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:18.348045 30561 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:18.347922 30060 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.349788 30134 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:18.352811 30538 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.337241 30557 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.379719 30522 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:18.399071 30522 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:18.374415 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.400331 30538 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:18.400000 30522 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.381508 30467 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.401010 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:18.401656 26466 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.401877 30523 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:18.334313 30434 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.403244 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.404561 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.404935 30434 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:18.405154 26468 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:11:18.406844 30561 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:18.407418 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.407704 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2882) took 1139 ms. Trace:
I20260709 12:11:18.396680 30549 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.408135 26464 rpcz_store.cc:276] 0709 12:11:17.268304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.278350 (+ 10046us) service_pool.cc:224] Handling call
0709 12:11:18.407510 (+1129160us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54001c1454. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:18.407645 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310827392}
I20260709 12:11:18.409098 30561 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:18.325357 30411 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.409356 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:18.410095 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2853) took 4978 ms. Trace:
I20260709 12:11:18.410528 26470 rpcz_store.cc:276] 0709 12:11:13.432026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.465261 (+ 33235us) service_pool.cc:224] Handling call
0709 12:11:14.124778 (+659517us) spinlock_profiling.cc:243] Waited 7.96 ms on lock 0x7b54001c08a8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507b003aa1 00007f507b07eebc 00007f507b0b408c 00007f507b09e93b 00007f507b09e3d2 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c
0709 12:11:14.124907 (+   129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.259572 (+3134665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.398297 (+1138725us) spinlock_profiling.cc:243] Waited 3.07 s on lock 0x7b54001c0a54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:18.410002 (+ 11705us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7087226880}
I20260709 12:11:18.411118 30411 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:18.381453 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.412045 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:18.412411 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.412621 26470 raft_consensus.cc:2376] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9. Re-sending same reply.
I20260709 12:11:18.413138 26465 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 9: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:18.413875 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.393083 26617 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:18.407156 26620 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:18.374536 30545 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.415316 26473 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:18.415748 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.419462 26465 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
I20260709 12:11:18.406164 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:18.397621 27189 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc160 after lost signal to thread 26572
W20260709 12:11:18.380735 30505 consensus_meta.cc:287] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.903s	user 0.011s	sys 0.001s
I20260709 12:11:18.376235 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:18.426057 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.408721 30060 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:18.421542 27189 debug-util.cc:398] Leaking SignalData structure 0x7b0800392000 after lost signal to thread 26646
W20260709 12:11:18.429955 27189 debug-util.cc:398] Leaking SignalData structure 0x7b08003ae520 after lost signal to thread 27192
W20260709 12:11:18.430439 27189 debug-util.cc:398] Leaking SignalData structure 0x7b080038c3c0 after lost signal to thread 27193
I20260709 12:11:18.413491 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.423686 26539 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:18.425918 26466 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
W20260709 12:11:18.380261 30332 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.000s
W20260709 12:11:18.415041 30444 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.852s	user 0.012s	sys 0.000s
W20260709 12:11:18.380465 30328 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.004s
I20260709 12:11:18.432564 26470 raft_consensus.cc:2410] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:11:18.433856 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:18.422322 26622 consensus_meta.cc:287] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
W20260709 12:11:18.343271 26587 connection.cc:256] RPC call timeout handler was delayed by -3.8101197900000443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
I20260709 12:11:18.437639 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.353735 30331 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.439181 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.459316 26622 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:18.396672 30158 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:18.396346 30540 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:18.429665 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:18.464218 26466 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:18.464708 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 83821us
W20260709 12:11:18.453589 27132 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.002s	sys 0.025s
W20260709 12:11:18.379444 30330 consensus_meta.cc:287] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.002s
I20260709 12:11:18.368695 30539 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.439808 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:18.466940 27132 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.002s	sys 0.025s
I20260709 12:11:18.467132 26468 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:18.459352 26587 connection.cc:256] RPC call timeout handler was delayed by -3.7093197899998813s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
W20260709 12:11:18.467752 26587 connection.cc:256] RPC call timeout handler was delayed by -3.519419790000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
W20260709 12:11:18.468173 26587 connection.cc:256] RPC call timeout handler was delayed by -3.3871197900000425s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
W20260709 12:11:18.468590 26587 connection.cc:256] RPC call timeout handler was delayed by -3.3745197900000221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
W20260709 12:11:18.468978 26587 connection.cc:256] RPC call timeout handler was delayed by -3.275519789999862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
W20260709 12:11:18.469368 26587 connection.cc:256] RPC call timeout handler was delayed by -2.7949197899999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26280000000000003s for a response
I20260709 12:11:18.462560 26465 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 12: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:18.459764 26464 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:18.472826 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:18.473448 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:18.477113 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:18.479346 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:18.480348 26466 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:18.480638 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.482883 26466 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:18.483724 26465 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:18.486052 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2900) took 1174 ms. Trace:
I20260709 12:11:18.486515 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:18.488583 29448 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:18.489063 29448 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:18.489265 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:18.492674 26540 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 10: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:18.486464 26471 rpcz_store.cc:276] 0709 12:11:17.311816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.449946 (+138130us) service_pool.cc:224] Handling call
0709 12:11:17.472597 (+ 22651us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.369076 (+896479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.485808 (+116732us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b54002de1d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:18.485991 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2060212096}
I20260709 12:11:18.480297 30539 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.490044 29448 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.419679 30306 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.495867 26471 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:11:18.503371 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 226303us
I20260709 12:11:18.504318 30494 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:11:18.487550 30330 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:18.509054 30518 consensus_meta.cc:287] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.652s	user 0.005s	sys 0.005s
I20260709 12:11:18.509534 30518 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.510442 30330 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:18.495206 29448 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:18.511897 30466 consensus_meta.cc:287] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.000s
I20260709 12:11:18.492511 30540 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.510658 30558 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:18.444059 30332 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.513517 30324 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:18.514329 30332 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:18.515177 26547 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:18.512465 30466 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:18.461778 30158 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:18.513634 26471 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:18.516199 26513 leader_election.cc:400] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10.
I20260709 12:11:18.516247 26468 raft_consensus.cc:2410] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:11:18.515394 30331 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:18.443463 30505 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.520913 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:18.462517 30328 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.517730 26469 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 12: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:18.460283 30542 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:18.457058 30444 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.502277 30523 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.485687 30510 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:11:18.518868 26513 leader_election.cc:403] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:18.526281 30529 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:18.556602 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:18.494755 30434 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:18.485471 30134 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:18.557358 30434 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:18.557598 30134 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:18.557844 30434 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.495359 30526 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.559144 30134 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.485317 30528 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:18.528664 30525 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:11:18.563019 30528 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 9 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:18.563970 30528 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.564580 30549 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10.
I20260709 12:11:18.556723 30529 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.566256 30529 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.565936 30542 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.533505 30557 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:18.533247 30505 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:18.533058 30518 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:18.566321 30434 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.538854 30158 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.569375 30158 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.570628 30434 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:18.571781 30523 raft_consensus.cc:2764] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
W20260709 12:11:18.519246 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 547138us
I20260709 12:11:18.539611 30467 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:18.576788 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.543449 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2894) took 1235 ms. Trace:
W20260709 12:11:18.577724 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.547534 26543 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:18.576711 30467 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:18.580796 30467 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.580861 26622 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260709 12:11:18.581947 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:18.582197 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:18.582682 26547 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:18.582888 26464 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.583369 26546 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:18.582023 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:18.583796 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:18.584106 26618 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.584791 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.585542 26464 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 9: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:18.581350 30467 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.504829 30564 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:18.586370 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:18.552841 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.602591 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:18.603307 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:18.604322 27167 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:18.604480 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:18.605574 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:18.522428 30531 consensus_meta.cc:287] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.567s	user 0.010s	sys 0.000s
W20260709 12:11:18.588195 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.588532 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:18.589027 26541 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:18.591115 26544 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:18.616478 26618 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:11:18.523149 26471 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:18.613632 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:18.619253 27166 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:11:18.599954 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:18.577775 26472 rpcz_store.cc:276] 0709 12:11:17.307747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.347073 (+ 39326us) service_pool.cc:224] Handling call
0709 12:11:18.543243 (+1196170us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b54002db754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:18.543373 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1885053824}
I20260709 12:11:18.610756 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:18.550227 30566 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:11:18.549556 30474 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:11:18.611720 29957 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.611399 30555 consensus_queue.cc:1059] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:18.590723 30564 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:18.639210 30510 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:18.619107 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:18.616425 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:18.555455 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:18.624152 27159 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:18.622551 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:18.626327 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:18.626879 27134 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:18.624905 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.635550 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:18.636185 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.636504 30507 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:18.653908 30158 consensus_queue.cc:1059] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:18.654277 26615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2794) took 4476 ms (client timeout 1815 ms). Trace:
I20260709 12:11:18.643919 30510 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:11:18.654815 26615 rpcz_store.cc:269] 0709 12:11:14.168823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.169066 (+   243us) service_pool.cc:224] Handling call
0709 12:11:18.644556 (+4475490us) spinlock_profiling.cc:243] Waited 2.95 s on lock 0x7b5400345b54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:18.644691 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6780598528}
I20260709 12:11:18.655194 30158 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:18.656145 30553 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.655721 30510 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.656392 30555 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.586478 30500 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.647257 27134 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:11:18.590876 30547 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.402s	user 0.000s	sys 0.003s
I20260709 12:11:18.656348 26472 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:18.658103 30555 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:18.628796 30531 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.659886 30555 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:18.660063 26472 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:18.661041 30531 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:18.660914 30555 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.628611 30331 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:18.629865 30505 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.662303 30331 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.662959 26472 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:18.638451 29957 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.664767 30331 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:18.665285 26472 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:18.665431 29957 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:18.538009 30537 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.656633 30553 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.657215 30510 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.637646 30567 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.547211 30558 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:18.655668 30158 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:18.669829 26439 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:18.670603 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:18.665668 30506 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:18.555922 30306 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:18.639436 30564 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:18.592144 30328 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:18.662892 30505 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.666846 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:18.697077 30553 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.644600 30466 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:18.678474 27162 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:18.590309 30467 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:18.684856 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:18.698544 26464 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:18.721045 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:18.721702 26622 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:18.613709 30529 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.639420 30413 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:18.704052 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 148673us
I20260709 12:11:18.727141 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:11:18.704613 26514 connection.cc:256] RPC call timeout handler was delayed by -2.5353961539999545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
W20260709 12:11:18.730096 26514 connection.cc:256] RPC call timeout handler was delayed by -2.4792201329998989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 12:11:18.730500 26514 connection.cc:256] RPC call timeout handler was delayed by -2.1255201330000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21480000000000002s for a response
I20260709 12:11:18.731078 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:18.648275 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:18.707508 26467 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260709 12:11:18.708770 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:18.732539 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 84354.2us
I20260709 12:11:18.733120 26618 raft_consensus.cc:2410] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:11:18.733274 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:18.734009 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:18.734818 26618 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:18.711014 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:18.710035 26620 raft_consensus.cc:2410] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:18.705399 30570 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.712783 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:18.712827 26619 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:18.717248 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 50487.1us
I20260709 12:11:18.746008 26588 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:18.549319 30444 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:18.738888 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:18.739434 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:18.741369 26438 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.538s (SENT) [suppressed 15 similar messages]
I20260709 12:11:18.709417 30558 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:18.743333 26540 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:11:18.747898 26622 raft_consensus.cc:2410] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:11:18.713413 29957 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:18.751034 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:18.751860 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:18.758183 26513 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:18.753726 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:18.756091 30332 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:18.779155 30561 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:18.779649 30561 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:18.780064 30561 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.780570 30505 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:18.781107 30560 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.781419 30557 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.781695 30560 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.752435 30330 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.749085 30314 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:18.786334 30571 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:11:18.759658 30565 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:18.756093 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:18.755808 30534 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:11:18.786528 30543 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:18.792737 26467 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.756443 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:18.796307 30562 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:18.796550 27167 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:11:18.756129 30020 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:18.798743 30020 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:18.799662 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:18.800540 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:18.793787 30565 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.801455 30474 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:18.753176 26540 pending_rounds.cc:85] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 6
I20260709 12:11:18.804904 26540 pending_rounds.cc:107] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:18.785245 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:18.783979 30560 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:18.792819 30543 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:18.752585 30570 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.752605 30566 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:18.748296 30060 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:18.773944 26514 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:18.794652 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:18.794509 30330 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.795004 30114 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:18.795449 30534 consensus_queue.cc:1243] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:11:18.756958 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:18.798664 29957 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 12 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:18.805783 26540 raft_consensus.cc:2889] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:18.785808 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:18.719787 30527 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:18.808566 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 48652.4us
I20260709 12:11:18.847126 26513 leader_election.cc:400] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 11. Current term is 12.
I20260709 12:11:18.847554 26513 leader_election.cc:403] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:18.818511 26467 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:11:18.819409 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:18.749799 30328 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:18.849140 26544 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.741972 30528 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:18.850509 30528 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:18.852777 30528 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:18.856798 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 71105.4us
W20260709 12:11:18.857952 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.752980 30134 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.862262 26542 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 7: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:18.863989 26613 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:18.864450 26613 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:18.790223 30537 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:18.713670 30567 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:18.865166 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 91367.2us
I20260709 12:11:18.873739 26514 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:18.814320 30543 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.864830 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:18.804596 30555 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 12:11:18.842149 30331 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:18.749191 30413 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.884172 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:18.817472 30562 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:11:18.734975 30466 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.841048 30566 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:18.866225 30557 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.887532 26541 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:18.913570 26541 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:18.915100 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.893448 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:18.872731 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.919289 26466 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:18.920524 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:18.921497 26466 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 11: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:18.828158 30060 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:18.904078 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:18.922274 26469 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.923978 26467 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.866814 30134 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:18.927241 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:18.869474 30527 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:18.887957 30328 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.892910 30306 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.848567 30526 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:11:18.759712 30158 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.909298 26613 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:18.870018 30474 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:11:18.896790 30537 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.978297 26613 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.911100 30509 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:18.926034 30568 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.401s	user 0.000s	sys 0.001s
W20260709 12:11:18.925838 30569 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.422s	user 0.000s	sys 0.002s
W20260709 12:11:18.990171 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 61611.8us
I20260709 12:11:18.990727 26466 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.990886 26548 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:19.094538 26548 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:19.096161 26548 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:18.991281 26467 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:19.100931 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:19.101728 26467 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:18.927479 30560 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:18.909978 30566 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.926108 30060 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.954720 30134 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.900703 30444 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:11:19.071596 26544 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:11:19.079583 30530 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:18.975440 30523 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:19.005255 26469 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
W20260709 12:11:19.015870 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:19.082433 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 50400.7us
W20260709 12:11:19.092429 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 250433us
I20260709 12:11:19.110443 30020 consensus_queue.cc:1243] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:18.895539 30558 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:18.959194 30505 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
I20260709 12:11:18.954814 30506 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.124s
I20260709 12:11:19.120132 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:18.963022 30328 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.139299 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:19.141232 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:19.143559 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:18.962033 30513 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
I20260709 12:11:19.153318 26544 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.159067 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:19.160146 26469 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:19.153714 26548 raft_consensus.cc:2368] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11.
I20260709 12:11:18.996445 30537 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:19.170674 26544 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:19.158043 30328 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.116472 30560 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:19.179719 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:19.182888 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:19.124219 30114 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.191977 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:19.192216 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:19.192881 26467 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.193990 26544 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 10: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:11:19.158954 30539 consensus_meta.cc:287] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.642s	user 0.002s	sys 0.009s
I20260709 12:11:19.195544 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:19.199131 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:19.203435 26548 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.203483 26469 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.998579 29957 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:19.216651 30570 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:19.221733 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.221573 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:19.190191 30529 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:19.193931 30560 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:19.193681 30558 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.253312 26548 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:19.277683 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:19.202040 30332 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:19.261889 26467 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:19.254433 26466 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:19.280941 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:19.281214 26614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 557) took 1925 ms (client timeout 1934 ms). Trace:
I20260709 12:11:19.285064 26469 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:19.288852 30525 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:11:19.755699 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:19.852077 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.338155 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:19.344961 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:19.854333 29448 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:19.855942 26466 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:19.856228 26469 raft_consensus.cc:2410] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:19.856788 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2907) took 1126 ms. Trace:
I20260709 12:11:19.857162 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2906) took 1129 ms. Trace:
I20260709 12:11:19.321455 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:19.858147 29448 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:19.858983 26467 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.857875 26469 rpcz_store.cc:276] 0709 12:11:18.727933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.337708 (+609775us) service_pool.cc:224] Handling call
0709 12:11:19.857048 (+519340us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:19.860365 30604 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.860647 29448 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:19.775103 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:19.862931 26471 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.347913 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 531) took 1083 ms. Trace:
I20260709 12:11:19.867122 26473 rpcz_store.cc:276] 0709 12:11:18.264681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.276189 (+ 11508us) service_pool.cc:224] Handling call
0709 12:11:19.347701 (+1071512us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54000dc0d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:19.347840 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283948800}
W20260709 12:11:19.782752 26512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.000s	sys 0.004s
W20260709 12:11:19.870764 26512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.001s	sys 0.004s
W20260709 12:11:19.872390 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.299490 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:19.876757 30529 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.876976 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:19.297073 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:11:19.879280 26587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.003s	sys 0.005s
W20260709 12:11:19.879997 26587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.003s	sys 0.005s
I20260709 12:11:19.880672 30528 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:19.329084 26548 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:19.298619 26614 rpcz_store.cc:269] 0709 12:11:17.355854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.356002 (+   148us) service_pool.cc:224] Handling call
0709 12:11:19.281002 (+1925000us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b54003a4654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:19.281148 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4338344704}
W20260709 12:11:19.547161 30510 consensus_meta.cc:287] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.843s	user 0.006s	sys 0.009s
I20260709 12:11:19.861697 30604 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:19.342967 30411 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:19.344841 30330 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:19.379169 30513 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:19.295149 30521 raft_consensus.cc:2764] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Leader election decision vote started in defunct term 10: won
I20260709 12:11:19.551738 30530 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:19.363284 30526 consensus_queue.cc:1243] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:19.133637 30527 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:19.210276 30539 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:19.491214 30537 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:19.890287 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 569) took 1099 ms. Trace:
I20260709 12:11:19.907097 30537 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.908109 30537 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:19.909019 30526 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:11:19.542937 30543 consensus_meta.cc:287] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.004s
W20260709 12:11:19.910771 30590 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.556s	user 0.012s	sys 0.038s
I20260709 12:11:19.911476 30543 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:19.912492 30526 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:19.395429 30538 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:19.563766 30545 consensus_meta.cc:287] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.137s	user 0.007s	sys 0.006s
W20260709 12:11:19.555004 30553 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.811s	user 0.011s	sys 0.001s
I20260709 12:11:19.947892 30553 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:11:19.950654 30020 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.951566 30020 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:19.557209 30561 consensus_meta.cc:287] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.777s	user 0.011s	sys 0.000s
W20260709 12:11:19.558619 30564 consensus_meta.cc:287] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.839s	user 0.008s	sys 0.004s
I20260709 12:11:20.027180 30564 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:20.031399 26621 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:11:19.702148 30566 consensus_meta.cc:287] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.567s	user 0.013s	sys 0.000s
I20260709 12:11:20.035202 30566 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:19.399775 30572 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.417s	user 0.001s	sys 0.000s
W20260709 12:11:19.404454 30582 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 12:11:19.388859 30574 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.414s	user 0.001s	sys 0.000s
I20260709 12:11:20.043248 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2905) took 1315 ms. Trace:
I20260709 12:11:20.043704 26464 rpcz_store.cc:276] 0709 12:11:18.727562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.728149 (+   587us) service_pool.cc:224] Handling call
0709 12:11:18.728596 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.728975 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.729006 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.729504 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.961780 (+232276us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:18.961822 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.961896 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.042794 (+1080898us) raft_consensus.cc:1685] finished
0709 12:11:20.042835 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.043056 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1066,"raft.queue_time_us":100,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":9966,"spinlock_wait_cycles":841600,"thread_start_us":219139,"threads_started":1,"wal-append.queue_time_us":437896}
W20260709 12:11:19.399535 30576 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:11:19.436941 30577 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.312s	user 0.002s	sys 0.000s
W20260709 12:11:19.436939 30580 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
W20260709 12:11:19.363804 30581 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 12:11:20.049213 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1946) took 1432 ms. Trace:
W20260709 12:11:19.437161 30583 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
I20260709 12:11:20.049980 26547 rpcz_store.cc:276] 0709 12:11:18.616790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.617767 (+   977us) service_pool.cc:224] Handling call
0709 12:11:18.644119 (+ 26352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.644396 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.644436 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.645060 (+   624us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.758683 (+113623us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:18.758736 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.801025 (+ 42289us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.048429 (+1247404us) raft_consensus.cc:1685] finished
0709 12:11:20.048501 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.048851 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":104962,"threads_started":1,"wal-append.queue_time_us":337846}
I20260709 12:11:19.365494 30598 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:20.051911 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 548) took 1450 ms. Trace:
I20260709 12:11:20.052496 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1945) took 1436 ms. Trace:
W20260709 12:11:19.557669 30606 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:11:20.053117 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:20.054539 30545 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:20.054710 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 94860.5us
I20260709 12:11:20.052914 30598 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:20.055876 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:20.057749 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:20.052989 26546 rpcz_store.cc:276] 0709 12:11:18.616399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.618091 (+  1692us) service_pool.cc:224] Handling call
0709 12:11:18.618641 (+   550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.620572 (+  1931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.620624 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.621272 (+   648us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.835558 (+214286us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:18.835625 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.835748 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.052063 (+1216315us) raft_consensus.cc:1685] finished
0709 12:11:20.052104 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.052300 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1370,"raft.queue_time_us":10840,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"thread_start_us":125378,"threads_started":1,"wal-append.queue_time_us":230024}
W20260709 12:11:19.826639 26438 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.075s	user 0.001s	sys 0.020s
I20260709 12:11:20.057554 30598 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:19.877784 30529 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:19.859038 30525 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:20.059119 30525 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:19.205987 30114 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:19.857453 26466 rpcz_store.cc:276] 0709 12:11:18.729878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.343323 (+613445us) service_pool.cc:224] Handling call
0709 12:11:19.856604 (+513281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:20.061172 30529 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:19.899310 26615 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:20.061446 30566 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:19.930503 26513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.018s	sys 0.036s
I20260709 12:11:19.935019 26539 raft_consensus.cc:2368] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10.
I20260709 12:11:19.894345 26614 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:19.936244 30537 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:19.898622 30604 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:19.891839 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 539) took 1533 ms. Trace:
I20260709 12:11:19.906263 30539 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:19.926956 30543 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:19.900992 30534 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:19.954003 26543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.110s	user 0.001s	sys 0.017s
I20260709 12:11:19.898334 30530 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.896498 30411 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:19.896909 30513 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:19.892094 30528 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.085s
W20260709 12:11:19.987650 26436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.004s	sys 0.023s
I20260709 12:11:19.988315 30540 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.995282 30020 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:20.007006 29448 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.007266 30561 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:20.008184 26511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.004s	sys 0.016s
I20260709 12:11:20.008628 30613 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.008531 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:11:20.087932 26511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.004s	sys 0.016s
W20260709 12:11:20.013598 30134 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.880s	user 0.006s	sys 0.017s
W20260709 12:11:20.017107 30560 consensus_meta.cc:287] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.709s	user 0.012s	sys 0.008s
W20260709 12:11:20.048314 30328 consensus_meta.cc:287] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.873s	user 0.014s	sys 0.006s
W20260709 12:11:19.419756 30589 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 12:11:19.825114 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.058614 26438 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.307s	user 0.002s	sys 0.020s
I20260709 12:11:20.059201 30558 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:19.835739 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2797) took 1581 ms. Trace:
I20260709 12:11:19.907222 26617 rpcz_store.cc:276] 0709 12:11:18.791035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.801479 (+ 10444us) service_pool.cc:224] Handling call
0709 12:11:18.801785 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.803277 (+  1492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.803303 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.803945 (+   642us) log.cc:844] Serialized 26 byte log entry
0709 12:11:19.039070 (+235125us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:19.039133 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.039240 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:19.889660 (+850420us) raft_consensus.cc:1685] finished
0709 12:11:19.889708 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.890064 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":789,"raft.queue_time_us":12574,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":24027,"thread_start_us":234711,"threads_started":1,"wal-append.queue_time_us":622659}
I20260709 12:11:20.061549 26466 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
W20260709 12:11:20.062215 26513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.019s	sys 0.036s
I20260709 12:11:19.940267 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 551) took 1051 ms. Trace:
I20260709 12:11:19.914230 30538 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:19.926167 30526 consensus_queue.cc:1243] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:20.062805 26470 rpcz_store.cc:276] 0709 12:11:18.357833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.458102 (+100269us) service_pool.cc:224] Handling call
0709 12:11:19.891214 (+1433112us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54001c0554. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:19.891601 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601464576}
I20260709 12:11:20.076462 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2154) took 1178 ms. Trace:
I20260709 12:11:20.079280 26471 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:20.096685 26473 rpcz_store.cc:276] 0709 12:11:18.864063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.868786 (+1004723us) service_pool.cc:224] Handling call
0709 12:11:19.869546 (+   760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:19.870206 (+   660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.870262 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:19.870361 (+    99us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:19.914625 (+ 44264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.914700 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.914814 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:20.081002 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:11:20.082815 26436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.004s	sys 0.024s
W20260709 12:11:20.081856 26543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.238s	user 0.001s	sys 0.018s
I20260709 12:11:20.062242 30114 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:20.076753 30534 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:20.098083 26614 rpcz_store.cc:276] 0709 12:11:18.895727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.892414 (+996687us) service_pool.cc:224] Handling call
0709 12:11:19.893180 (+   766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.062464 (+169284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.073803 (+ 11339us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:20.052444 26472 rpcz_store.cc:276] 0709 12:11:18.601511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.671890 (+ 70379us) service_pool.cc:224] Handling call
0709 12:11:18.672223 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.672907 (+   684us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.672935 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.673415 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.806458 (+133043us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:19.134684 (+328226us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.363747 (+229063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.363848 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.051432 (+687584us) raft_consensus.cc:1685] finished
0709 12:11:20.051473 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.051725 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":191172,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":155614,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":217,"thread_start_us":635632,"threads_started":3,"wal-append.queue_time_us":289955}
I20260709 12:11:20.095343 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1896) took 1754 ms. Trace:
I20260709 12:11:20.089577 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:20.096485 26466 pending_rounds.cc:85] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 9
I20260709 12:11:20.089002 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 567) took 1501 ms. Trace:
I20260709 12:11:20.101694 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 552) took 1237 ms. Trace:
I20260709 12:11:20.105758 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2914) took 1374 ms. Trace:
I20260709 12:11:20.105290 26464 rpcz_store.cc:276] 0709 12:11:18.864483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.045906 (+1181423us) service_pool.cc:224] Handling call
0709 12:11:20.063483 (+ 17577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.096247 (+ 32764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.096281 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:20.101479 (+  5198us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:20.101509 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.101554 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.101650 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:20.106334 26471 rpcz_store.cc:276] 0709 12:11:18.731669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.317807 (+586138us) service_pool.cc:224] Handling call
0709 12:11:20.103340 (+785533us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:20.107854 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 50287.1us
I20260709 12:11:20.091502 30553 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:20.094552 30545 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:20.104776 26621 rpcz_store.cc:276] 0709 12:11:18.587801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.588613 (+   812us) service_pool.cc:224] Handling call
0709 12:11:18.588908 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.032054 (+1443146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.082757 (+ 50703us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b540020a654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:20.088925 (+  6168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3315624832}
I20260709 12:11:20.104589 26466 pending_rounds.cc:107] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:11:20.113778 26466 raft_consensus.cc:2889] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:20.097491 30558 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:20.119880 30534 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.121639 30534 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:20.121857 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.123983 30413 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:20.126600 30114 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:20.127048 30331 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:11:20.127373 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 1.38595e+06us
I20260709 12:11:20.127743 30331 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.128196 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 579) took 1377 ms. Trace:
I20260709 12:11:20.128360 30513 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:20.128698 26543 rpcz_store.cc:276] 0709 12:11:18.750963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.751125 (+   162us) service_pool.cc:224] Handling call
0709 12:11:18.751431 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.753015 (+  1584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.753054 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.753556 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 12:11:20.127581 (+1374025us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:20.127712 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.127827 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.127884 (+    57us) raft_consensus.cc:1685] finished
0709 12:11:20.127896 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.128117 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36397,"raft.queue_time_us":6233,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":23128,"thread_start_us":1258856,"threads_started":1,"wal-append.queue_time_us":1211117}
I20260709 12:11:20.101032 30540 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.113544 30545 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:20.138742 30545 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.140285 30540 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:20.133853 27134 connection.cc:256] RPC call timeout handler was delayed by -1.130525974999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
I20260709 12:11:20.107452 30564 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:20.136442 30509 consensus_meta.cc:287] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.135s	user 0.009s	sys 0.012s
I20260709 12:11:20.143630 30509 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.138051 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:20.144611 26467 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:20.144878 26622 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.144721 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:20.145969 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:20.146678 30564 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:20.147161 30060 consensus_meta.cc:287] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.014s	user 0.015s	sys 0.010s
I20260709 12:11:20.146996 30411 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:20.148443 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.098871 30328 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.137844 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:20.151255 30509 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:20.088997 30613 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.096555 30560 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.096182 26616 rpcz_store.cc:276] 0709 12:11:18.254026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.254183 (+   157us) service_pool.cc:224] Handling call
0709 12:11:18.578321 (+324138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.578579 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:18.692991 (+114412us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.158188 (+465197us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:19.158247 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:19.158302 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.158370 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.834853 (+676483us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b5400268750. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:19.835272 (+   419us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":280500,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":14724,"raft.queue_time_us":290443,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"spinlock_wait_cycles":753794304,"thread_start_us":578709,"threads_started":3,"wal-append.queue_time_us":525762}
I20260709 12:11:20.160580 26617 raft_consensus.cc:2410] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:11:20.163159 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 549) took 1376 ms. Trace:
I20260709 12:11:20.167186 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:20.166718 30060 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:20.169152 27162 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:20.170660 30529 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:20.173087 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 553) took 1195 ms. Trace:
I20260709 12:11:20.117813 30558 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:20.176141 30560 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:20.178690 30613 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:20.178835 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:20.179128 30411 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.179764 26546 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 10: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:20.180846 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:20.182581 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:20.184561 26614 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:20.185942 26614 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:20.103022 26468 rpcz_store.cc:276] 0709 12:11:18.203602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.522232 (+318630us) service_pool.cc:224] Handling call
0709 12:11:18.523452 (+  1220us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.524047 (+   595us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:19.282509 (+758462us) spinlock_profiling.cc:243] Waited 53.5 ms on lock 0x7b18001bc0a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f5079ad23c7 00007f50760e49a7 00007f50760f40bf 00007f50760f4038
0709 12:11:19.773291 (+490782us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.931855 (+158564us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:19.932774 (+   919us) log.cc:844] Serialized 26 byte log entry
0709 12:11:19.932991 (+   217us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:19.933050 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.933199 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:19.938706 (+  5507us) raft_consensus.cc:1685] finished
0709 12:11:19.940542 (+  1836us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.958073 (+ 17531us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":363458,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":10227,"raft.run_cpu_time_us":441,"raft.run_wall_time_us":15159,"spinlock_wait_cycles":123020032,"thread_start_us":600757,"threads_started":2,"wal-append.queue_time_us":82182}
I20260709 12:11:20.127187 30538 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.186363 26473 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 12:11:20.155484 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:20.188884 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:20.191301 30513 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.194037 26617 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:20.194636 30553 raft_consensus.cc:2764] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:11:20.170830 30564 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:20.195709 30553 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:20.196249 30553 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.196696 30553 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:20.197867 30564 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:20.200181 30523 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:20.161553 30540 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:11:20.230465 30523 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.231057 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2143) took 1578 ms. Trace:
I20260709 12:11:20.167033 30114 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:20.097747 30134 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.242334 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:20.243333 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:20.244027 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:20.244328 30134 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:20.159337 30561 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:20.244813 26618 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:11:20.173595 26466 rpcz_store.cc:276] 0709 12:11:18.977314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.060593 (+1083279us) service_pool.cc:224] Handling call
0709 12:11:20.061077 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.172751 (+111674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.172985 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:20.245802 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:20.170379 27133 leader_election.cc:336] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 3.201s (SENT)
I20260709 12:11:20.246187 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:20.246598 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:20.247612 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 584) took 1492 ms. Trace:
W20260709 12:11:20.247938 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 77768.9us
I20260709 12:11:20.249801 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:20.251472 30158 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.252786 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:20.248046 26542 rpcz_store.cc:276] 0709 12:11:18.754798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.756698 (+  1900us) service_pool.cc:224] Handling call
0709 12:11:20.247150 (+1490452us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b540018bfd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:20.247383 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36476160}
I20260709 12:11:20.255650 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:20.256004 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:20.256769 26617 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 10: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:20.256973 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:20.257810 26542 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 10: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:20.221460 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:20.219550 30328 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:20.258643 26620 raft_consensus.cc:2410] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:20.248072 30509 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.259783 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:20.260789 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:20.261219 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:20.262080 26620 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:20.263190 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:20.270936 30521 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:20.271576 30555 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:20.170243 30060 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:20.271780 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:20.224512 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:20.233289 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.272702 30060 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:20.228989 26468 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260709 12:11:20.182286 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:20.274286 26546 raft_consensus.cc:2410] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:20.273339 30060 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:20.274969 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2041) took 1054 ms. Trace:
W20260709 12:11:20.275410 30591 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.927s	user 0.026s	sys 0.044s
I20260709 12:11:20.235890 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:20.239421 30114 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:20.231642 26619 rpcz_store.cc:276] 0709 12:11:18.652840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.653039 (+   199us) service_pool.cc:224] Handling call
0709 12:11:18.653429 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.748472 (+ 95043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.230425 (+1481953us) spinlock_profiling.cc:243] Waited 59.2 ms on lock 0x7b5400345654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:20.230854 (+   429us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136134400}
I20260709 12:11:20.258213 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2031) took 1113 ms. Trace:
I20260709 12:11:20.166194 26469 rpcz_store.cc:276] 0709 12:11:18.783088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.861612 (+1078524us) service_pool.cc:224] Handling call
0709 12:11:19.865408 (+  3796us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:19.868255 (+  2847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.868334 (+    79us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:19.869748 (+  1414us) log.cc:844] Serialized 26 byte log entry
0709 12:11:19.981189 (+111441us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:20.083913 (+102724us) log.cc:844] Serialized 14 byte log entry
0709 12:11:20.084184 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.084256 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.157509 (+ 73253us) raft_consensus.cc:1685] finished
0709 12:11:20.157529 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.159821 (+  2292us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19570,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":3025,"raft.queue_time_us":1259,"raft.run_cpu_time_us":630,"raft.run_wall_time_us":3424,"thread_start_us":100317,"threads_started":1,"wal-append.queue_time_us":235658}
I20260709 12:11:20.223097 26543 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:20.223722 30525 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.263751 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:20.264937 26539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 1943) took 1649 ms (client timeout 2011 ms). Trace:
I20260709 12:11:20.265350 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:20.265523 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:20.266356 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:20.166107 26545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.012s	sys 0.031s
I20260709 12:11:20.268167 26548 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:20.164471 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2908) took 1434 ms. Trace:
W20260709 12:11:20.269564 26613 consensus_meta.cc:287] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.281s	user 0.014s	sys 0.007s
I20260709 12:11:20.270087 26464 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:20.267176 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:20.277160 30565 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:20.275656 30060 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:20.293608 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:20.271157 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:20.272172 30555 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:20.297078 26614 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:20.297811 30060 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.297657 30555 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:20.298878 30313 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:20.299015 30494 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:20.299398 30313 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:20.299692 30494 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:20.300472 30313 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.300843 30494 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:20.301946 30313 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.302214 30552 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:20.302595 30526 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:20.303390 30526 consensus_queue.cc:1243] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:20.303959 30526 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:20.304339 30526 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:20.304708 30526 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.264981 27162 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:20.305622 30566 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:17.983647 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:20.306005 30566 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:20.307092 30566 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.308513 30566 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.269202 30567 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:20.310775 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1890) took 2284 ms. Trace:
I20260709 12:11:20.311183 26465 rpcz_store.cc:276] 0709 12:11:18.025803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.493337 (+467534us) service_pool.cc:224] Handling call
0709 12:11:19.767283 (+1273946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:19.768180 (+   897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.768250 (+    70us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:19.768386 (+   136us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:19.768471 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.768637 (+   166us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.310467 (+541830us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54000dc0d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:20.310589 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2928551808}
I20260709 12:11:20.314896 30509 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:20.275410 26546 rpcz_store.cc:276] 0709 12:11:19.221064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.181922 (+960858us) service_pool.cc:224] Handling call
0709 12:11:20.274879 (+ 92957us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:20.316375 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:20.316948 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.313942 30114 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:11:20.288167 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1947) took 1670 ms. Trace:
I20260709 12:11:20.317668 30363 consensus_queue.cc:1059] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:20.331290 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:20.331481 30363 raft_consensus.cc:3055] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:20.332010 30363 raft_consensus.cc:740] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:20.333173 30363 consensus_queue.cc:260] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:20.318883 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2144) took 1651 ms. Trace:
I20260709 12:11:20.334553 26615 rpcz_store.cc:276] 0709 12:11:18.667842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.667995 (+   153us) service_pool.cc:224] Handling call
0709 12:11:18.668301 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.061965 (+1393664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.318559 (+256594us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400032354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:20.318817 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2829080448}
I20260709 12:11:20.299206 30555 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.336390 26615 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:20.323495 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:20.297684 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:20.339617 30466 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:20.288504 26467 rpcz_store.cc:276] 0709 12:11:18.730157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.317588 (+587431us) service_pool.cc:224] Handling call
0709 12:11:20.161455 (+843867us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:20.286116 26539 rpcz_store.cc:269] 0709 12:11:18.615591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.616167 (+   576us) service_pool.cc:224] Handling call
0709 12:11:20.264693 (+1648526us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540037f5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:20.264871 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2928848640}
I20260709 12:11:20.343714 30538 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.344517 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:20.344974 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:20.285312 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:20.346374 26543 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:20.330824 26540 rpcz_store.cc:276] 0709 12:11:18.617181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.651094 (+ 33913us) service_pool.cc:224] Handling call
0709 12:11:18.651489 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.860948 (+209459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.286132 (+1425184us) spinlock_profiling.cc:243] Waited 91.5 ms on lock 0x7b54003cf354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:20.287982 (+  1850us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210343168}
I20260709 12:11:20.347653 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:20.348639 26540 raft_consensus.cc:2410] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:20.349043 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2043) took 1081 ms. Trace:
I20260709 12:11:20.349329 26540 rpcz_store.cc:276] 0709 12:11:19.267964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.347243 (+1079279us) service_pool.cc:224] Handling call
0709 12:11:20.348986 (+  1743us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38144}
I20260709 12:11:20.257616 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:20.287443 27167 raft_consensus.cc:2410] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:11:20.347631 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:20.351289 30363 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.351763 26543 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 7: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:20.352072 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:20.352738 26471 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:20.352917 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:20.287900 26545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.163s	user 0.012s	sys 0.031s
I20260709 12:11:20.288269 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2039) took 1079 ms. Trace:
I20260709 12:11:20.285967 30525 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.354619 26548 rpcz_store.cc:276] 0709 12:11:19.209257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.277148 (+ 67891us) service_pool.cc:224] Handling call
0709 12:11:20.288184 (+1011036us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:20.355688 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:20.356614 26548 raft_consensus.cc:2410] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:11:20.357410 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.357774 26548 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 10. Ops: []
I20260709 12:11:20.287961 26472 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:20.291474 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:20.286650 27159 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 11: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:20.350304 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:20.359789 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 580) took 1607 ms. Trace:
I20260709 12:11:20.360440 26540 raft_consensus.cc:2410] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:11:20.360220 26545 rpcz_store.cc:276] 0709 12:11:18.751962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.888151 (+136189us) service_pool.cc:224] Handling call
0709 12:11:18.899738 (+ 11587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.899968 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:19.123984 (+224016us) log.cc:844] Serialized 14 byte log entry
0709 12:11:20.359276 (+1235292us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:20.359395 (+   119us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:20.359462 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.359554 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.359733 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56207,"prepare.queue_time_us":367538,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":19914,"raft.queue_time_us":4859,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":165,"thread_start_us":1390693,"threads_started":2,"wal-append.queue_time_us":1034616}
I20260709 12:11:20.365288 26545 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:20.367336 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2032) took 1211 ms. Trace:
I20260709 12:11:20.367820 26548 rpcz_store.cc:276] 0709 12:11:19.149472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.357202 (+1207730us) service_pool.cc:224] Handling call
0709 12:11:20.357605 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.358173 (+   568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.358361 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:20.368279 30134 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.369030 30134 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.370664 30517 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.371022 27133 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:20.371290 30517 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.373589 30557 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.373767 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:20.371981 30564 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.374305 30557 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:20.374961 30518 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.375535 30518 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:20.377183 30557 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:20.373100 26540 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:20.377861 29957 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.378517 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2035) took 1218 ms. Trace:
I20260709 12:11:20.279907 26542 rpcz_store.cc:276] 0709 12:11:19.145862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.256673 (+1110811us) service_pool.cc:224] Handling call
0709 12:11:20.258162 (+  1489us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:20.379165 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 44432us
I20260709 12:11:20.379608 30134 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:20.380278 30020 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:20.345840 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:20.381134 30020 consensus_queue.cc:1243] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:20.381685 30020 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:20.381429 26539 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:20.382062 30020 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:20.379017 26540 rpcz_store.cc:276] 0709 12:11:19.160064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.361156 (+1201092us) service_pool.cc:224] Handling call
0709 12:11:20.361571 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.378210 (+ 16639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.378430 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:20.383395 26539 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:20.334080 30613 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.345819 26615 raft_consensus.cc:2410] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:20.289099 26613 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:20.384439 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 570) took 1583 ms. Trace:
I20260709 12:11:20.384768 26613 rpcz_store.cc:276] 0709 12:11:18.800765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.815065 (+ 14300us) service_pool.cc:224] Handling call
0709 12:11:18.856829 (+ 41764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.384164 (+1527335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.384388 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:20.330644 30114 consensus_queue.cc:1243] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:20.378655 26470 raft_consensus.cc:2410] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:20.386229 30518 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:20.382279 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:20.386734 26539 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:20.383128 30020 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.273339 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:20.387823 30020 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:20.377445 26367 catalog_manager.cc:5697] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 7 to 8, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 8 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:20.389182 30521 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:20.381451 30543 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:20.384130 30517 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:20.383932 26542 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:20.378142 30558 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:20.280090 26438 connection.cc:256] RPC call timeout handler was delayed by -1.3635538290000113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
W20260709 12:11:20.402407 26438 connection.cc:256] RPC call timeout handler was delayed by -1.2942538289998993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
I20260709 12:11:20.400166 30613 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:20.397974 30540 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.403532 30613 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:20.404035 30613 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.403941 30540 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:20.405381 30314 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
W20260709 12:11:20.406616 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.282933 30522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.574s	user 0.026s	sys 0.066s
I20260709 12:11:20.390875 26622 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:20.407464 26546 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:20.409654 26617 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.415740 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2046) took 1045 ms. Trace:
W20260709 12:11:20.416050 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.416231 26546 rpcz_store.cc:276] 0709 12:11:19.370118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.315997 (+945879us) service_pool.cc:224] Handling call
0709 12:11:20.415671 (+ 99674us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:20.396642 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:20.398479 26545 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:20.164754 26544 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:11:20.421458 26540 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:11:20.402199 27165 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:20.389595 30521 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:20.282881 30306 consensus_meta.cc:287] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.295s	user 0.009s	sys 0.013s
I20260709 12:11:20.402706 30543 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:20.449388 26438 connection.cc:256] RPC call timeout handler was delayed by -1.2384538290000364s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
W20260709 12:11:20.450052 26438 connection.cc:256] RPC call timeout handler was delayed by -1.2321538290000262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
W20260709 12:11:20.418409 30522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.903s	user 0.026s	sys 0.070s
I20260709 12:11:20.455770 26619 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:20.452792 26588 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:20.452792 26543 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:20.461730 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2033) took 1311 ms. Trace:
I20260709 12:11:20.462260 26543 rpcz_store.cc:276] 0709 12:11:19.150044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.354103 (+1204059us) service_pool.cc:224] Handling call
0709 12:11:20.461640 (+107537us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:20.463608 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2038) took 1265 ms. Trace:
W20260709 12:11:20.466204 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.468080 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 85910.3us
I20260709 12:11:20.464154 26544 rpcz_store.cc:276] 0709 12:11:19.197883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.239884 (+ 42001us) service_pool.cc:224] Handling call
0709 12:11:20.456746 (+1216862us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:20.401391 30545 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:20.472298 26438 connection.cc:256] RPC call timeout handler was delayed by -1.1457538289998865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
W20260709 12:11:20.473131 26438 connection.cc:256] RPC call timeout handler was delayed by -1.1115538290000586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
W20260709 12:11:20.473659 26438 connection.cc:256] RPC call timeout handler was delayed by -1.066818086000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
W20260709 12:11:20.474082 26438 connection.cc:256] RPC call timeout handler was delayed by -1.033253828999932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
W20260709 12:11:20.474495 26438 connection.cc:256] RPC call timeout handler was delayed by -1.0088205950000884s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
W20260709 12:11:20.476899 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.478431 26513 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:20.418251 30564 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:11:20.452392 30543 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:20.407418 30331 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.481411 26546 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:20.467325 30114 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.407753 30530 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:20.409219 30526 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:20.486860 27159 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:20.447934 30552 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 12:11:20.490492 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.492257 26514 leader_election.cc:336] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Timed out: RequestConsensusVote RPC to 127.24.179.68:35069 timed out after 1.755s (SENT)
I20260709 12:11:20.468096 30306 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 11. Current term is 12.
I20260709 12:11:20.488217 30537 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:20.496483 30545 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:20.422842 30510 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:11:20.494190 30540 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:20.520480 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:20.527891 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:20.535862 26621 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:20.539459 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:20.503576 30513 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.540760 26616 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:20.541587 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:20.548019 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 128543us
I20260709 12:11:20.549619 30539 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.545934 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:20.551739 26470 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
W20260709 12:11:20.558986 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 58019.3us
I20260709 12:11:20.561369 30332 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.562000 30332 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:20.564666 30332 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:20.567831 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:20.568698 30530 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:20.569594 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:20.531229 30537 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:20.570533 26467 raft_consensus.cc:2410] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:11:20.558902 26547 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:20.575809 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:20.576732 26471 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
W20260709 12:11:20.579525 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 88520.6us
I20260709 12:11:20.583957 30331 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:20.584869 30519 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 11.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:20.586186 26587 leader_election.cc:400] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10.
I20260709 12:11:20.543406 30413 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:20.508551 30114 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.586956 26541 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
W20260709 12:11:20.596158 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 85960.3us
I20260709 12:11:20.551599 30539 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.599814 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:11:20.613058 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 76811.8us
I20260709 12:11:20.614460 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:20.594545 30518 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.625258 30558 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:20.629578 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:20.632560 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:20.600641 26472 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
W20260709 12:11:20.634207 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.642982 26473 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:20.566887 30513 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.645468 26471 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:11:20.649430 30507 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:20.626339 30538 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:20.600008 30509 consensus_queue.cc:1059] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:11:20.655480 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:20.660528 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.622630 30413 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:20.668193 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:20.669610 26472 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:20.650418 30507 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:20.600703 30553 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.570708 30523 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:20.565575 30543 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:20.689704 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 63762.5us
I20260709 12:11:20.690923 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:20.684943 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:20.654891 30538 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.693724 26470 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.694010 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:20.694787 26471 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.628131 30539 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.636523 30518 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.702215 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:20.708325 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:20.711884 26472 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.695930 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2044) took 1356 ms. Trace:
I20260709 12:11:20.674937 30517 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:20.715756 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 120603us
I20260709 12:11:20.712366 26541 rpcz_store.cc:276] 0709 12:11:19.339862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.940561 (+600699us) service_pool.cc:224] Handling call
0709 12:11:20.291411 (+350850us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b5c0003720c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5079a44161 00007f5079be5a79 00007f507b09f9b6 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:20.695684 (+404273us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400140354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:20.695846 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532732928}
I20260709 12:11:20.693274 30523 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:20.723739 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 43952.8us
I20260709 12:11:20.698220 30538 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:20.728931 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.753418 30630 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 12:11:20.754966 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.756103 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.756652 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.691442 30530 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:11:20.764671 30539 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:20.767030 30632 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:11:20.769264 30507 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 11.13, Last appended by leader: 13, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:20.771736 30507 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.774770 30413 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.784511 30518 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:20.778600 30526 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:20.786247 30526 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:20.787230 30526 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:20.787590 30526 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:20.788097 30521 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.788558 30526 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.788985 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:20.789532 30521 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.789892 30526 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:20.748996 30306 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:20.790365 26513 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:20.790740 30306 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:20.791507 26513 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:20.791802 30306 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.792860 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:20.792979 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:20.779873 30513 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:20.794538 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:20.786492 26466 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:20.795145 30114 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:20.795271 26547 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:20.780561 30553 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:20.724166 30537 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:20.798089 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:11:20.811326 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.815338 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:20.819118 26471 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:20.723451 30540 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:11:20.823626 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:20.810710 30561 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:20.823784 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 133047us
I20260709 12:11:20.824815 30561 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:20.825433 30561 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.823813 30540 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:20.827049 30540 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:20.828192 30540 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.830945 26546 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 10: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:20.829672 30540 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:20.845623 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.853317 26471 raft_consensus.cc:1217] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Deduplicated request from leader. Original: 6.5->[8.6-11.7]   Dedup: 8.6->[11.7-11.7]
I20260709 12:11:20.854061 26471 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: [8.6-11.7]
W20260709 12:11:20.830464 30534 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.708s	user 0.016s	sys 0.000s
I20260709 12:11:20.859042 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:20.868777 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53517.2us
W20260709 12:11:20.864190 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.889911 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.874447 26467 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:20.875222 26473 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:20.868034 26539 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:20.867105 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:20.886149 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 59886.4us
I20260709 12:11:20.893918 26514 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:20.895519 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:20.896411 26548 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: [7.5-11.7]
I20260709 12:11:20.860301 30331 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:20.897217 30331 raft_consensus.cc:697] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:20.898288 30331 consensus_queue.cc:237] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.903385 26464 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:11:20.905058 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:20.906131 26464 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 9: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:11:20.906523 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.906910 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:20.907635 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.908932 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:20.909865 26469 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:20.910903 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:20.911767 26468 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:20.912863 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:20.913815 26468 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 10: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:20.914711 26466 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:20.915180 30513 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:20.916131 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:20.916352 30513 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:20.916931 30513 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:20.917661 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:20.917784 30513 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:20.918846 26438 leader_election.cc:336] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.521s (SENT)
I20260709 12:11:20.918982 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:20.919209 30513 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:20.919730 27165 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
W20260709 12:11:20.920753 26438 leader_election.cc:336] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.566s (SENT)
I20260709 12:11:20.925501 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:20.926522 26546 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 10: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:20.926788 26540 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:20.928124 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:20.929818 26543 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:20.895529 30467 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.932709 30467 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.934619 26465 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
W20260709 12:11:20.935133 30613 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.530s	user 0.013s	sys 0.000s
I20260709 12:11:20.935832 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:20.935693 30613 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:20.936782 26465 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:20.938859 26471 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:20.942639 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:20.943475 26465 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:20.947009 26465 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:20.947293 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.948262 30555 consensus_meta.cc:287] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.612s	user 0.012s	sys 0.000s
W20260709 12:11:20.949918 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.967386 26465 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:20.954249 30549 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:20.955510 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 61708.4us
I20260709 12:11:20.945483 30467 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:20.854597 30539 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:20.863251 30564 raft_consensus.cc:3055] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:21.006335 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:21.007432 26619 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:20.886081 30466 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:20.852524 30523 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.141s
I20260709 12:11:21.014480 26468 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:21.016439 26469 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:21.017475 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:21.019603 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:21.020467 26618 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:20.982412 30613 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:21.025112 26513 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:21.039459 26467 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:21.040158 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.030049 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:21.045430 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:21.035646 26465 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:21.050917 26619 raft_consensus.cc:2393] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:21.052343 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:21.053282 26539 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 7: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:21.001642 30539 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:11:21.001189 26617 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.006s
I20260709 12:11:21.056707 26465 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.055711 26472 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:21.056955 26617 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:21.009208 30564 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:21.061275 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:21.063659 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:21.063894 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:21.064385 26622 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:21.064599 27167 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.053921 30332 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:21.067016 30466 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:21.068145 30466 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:21.073364 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:21.074678 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:21.075246 26545 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.076864 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:21.064040 27159 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.079826 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:21.099954 26470 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:21.090668 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:21.102067 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 217691us
I20260709 12:11:21.102839 26513 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:21.104218 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:21.062574 30561 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:21.103477 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:21.110302 26539 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:21.077746 30539 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.130187 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:21.132339 26618 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.114553 30413 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:21.134914 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:21.141983 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.078411 30467 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:11:21.143172 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:21.174741 26622 raft_consensus.cc:2410] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:11:21.175916 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 57579.8us
I20260709 12:11:21.177400 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:21.178742 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53256.9us
I20260709 12:11:21.179690 30467 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.181348 27165 raft_consensus.cc:2410] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 12 because replica has last-logged OpId of term: 11 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 12.
I20260709 12:11:21.181567 30411 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:21.122471 30566 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:21.182350 30411 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:21.182898 30566 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:21.183398 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:21.183686 30537 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:21.122699 30564 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:21.185501 30566 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:21.151943 26619 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:21.153515 27159 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:21.154410 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:21.121373 30509 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.106339 30538 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:21.167996 30561 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:21.172319 30413 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:21.209594 26547 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:21.184191 26622 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 7: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:21.183526 30411 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:21.178746 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:21.122092 30306 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:21.200891 26466 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 7.
W20260709 12:11:21.144928 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.210023 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:21.247761 27167 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:21.248497 26473 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 7.
I20260709 12:11:21.248049 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:21.256875 26621 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.259603 26439 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:21.249589 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:21.267393 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:11:21.268568 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 89916.5us
I20260709 12:11:21.271265 27162 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 8: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:21.271696 30306 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:21.288118 30538 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:21.291122 26513 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:21.286949 30549 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:21.301921 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:21.303028 26513 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:21.268997 30517 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:11:21.306648 30549 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:21.308060 30549 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:21.318933 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 51643.2us
I20260709 12:11:21.271512 30518 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:21.335474 26619 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:21.340847 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 46602.5us
I20260709 12:11:21.344080 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:21.349731 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.351598 26620 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:21.302098 30523 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:11:21.352451 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.328670 30538 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:21.335246 30513 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:21.356189 26615 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:21.356623 30517 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.364243 30517 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:21.346529 30526 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.373145 30526 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:21.375815 30526 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:21.359158 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 58897.1us
I20260709 12:11:21.277009 30539 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:21.384495 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:21.349154 30561 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:21.349500 30613 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.387094 26513 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:11:21.387691 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.388159 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.388526 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:21.389209 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:11:21.390044 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.382205 26545 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:21.340113 30518 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.359397 30538 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.425032 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:21.424973 30534 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:11:21.283176 30413 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:21.423542 30517 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:21.435276 30517 raft_consensus.cc:2764] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:21.289068 30306 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:21.436039 30517 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.359826 30523 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:21.423944 30518 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:21.466478 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:21.423699 30332 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:21.604738 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.431578 30538 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.447129 30566 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:21.428851 30509 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:11:21.611063 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 168397us
I20260709 12:11:21.438898 30561 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.603214 30332 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:21.610507 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 454314us
I20260709 12:11:21.447528 30313 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.623756 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:21.637734 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.629810 30651 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 12:11:21.630658 30332 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.623545 30566 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:21.658736 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:21.670492 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:21.603101 30517 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:21.673863 26587 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:21.626766 30509 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:21.661820 30555 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.667446 30566 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.655341 30561 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.672680 30313 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:21.672086 30537 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:21.677433 30534 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:21.699239 26539 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.005s
W20260709 12:11:21.703332 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 44695.6us
I20260709 12:11:21.706218 26539 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
W20260709 12:11:21.694974 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 351009us
I20260709 12:11:21.707754 26439 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:21.700832 30313 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.701184 30537 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.687908 30598 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:11:21.708739 30534 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.728036 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:21.722146 30537 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:21.704962 30555 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:21.720145 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 331641us
I20260709 12:11:21.714839 30513 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:21.716112 26439 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:21.721735 30313 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.734254 30534 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.713277 30525 consensus_queue.cc:1059] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:11:21.726475 30539 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:21.792622 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.796294 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.751464 30655 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:21.803836 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 75923us
I20260709 12:11:21.808112 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:21.807006 30060 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:21.801682 30598 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:21.825340 26621 consensus_meta.cc:287] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.004s
I20260709 12:11:21.825909 26621 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:21.805471 30523 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:21.834372 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 156194us
W20260709 12:11:21.850003 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 134087us
W20260709 12:11:21.858280 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.829263 30655 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.828318 30598 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:21.842813 30539 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:21.869246 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.869081 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:21.849332 30523 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:21.870836 27162 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:11:21.870770 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:21.875959 30517 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:21.882915 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:21.883685 26473 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
W20260709 12:11:21.870645 30661 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:11:21.894980 26466 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:21.888650 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:21.888900 26539 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.894688 30670 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.897601 30670 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:21.898495 30660 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:21.899091 30660 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.899474 30660 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.900951 30670 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:21.901858 30670 raft_consensus.cc:3055] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:21.902604 30509 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:21.903998 30659 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:11:21.906426 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:21.907105 30555 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:21.907629 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:21.908226 30664 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:11:21.908705 26467 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 9: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:21.873606 30523 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.913401 30517 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.869973 30539 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.913565 30523 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.915444 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:21.919860 26545 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:21.919817 27162 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:21.914254 30517 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:21.922605 30598 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:21.928046 30598 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:21.928815 26617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 2158) took 1585 ms (client timeout 2054 ms). Trace:
W20260709 12:11:21.929291 26617 rpcz_store.cc:269] 0709 12:11:20.343262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.351456 (+  8194us) service_pool.cc:224] Handling call
0709 12:11:21.928595 (+1577139us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b5400268754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:21.928726 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85183360}
I20260709 12:11:21.930476 30517 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:21.931680 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:21.934262 30650 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.655s	user 0.011s	sys 0.010s
I20260709 12:11:21.937489 30566 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:21.941749 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 45079.7us
I20260709 12:11:21.867321 30658 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:11:21.942642 30517 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:21.943181 30517 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.943598 30517 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:21.944628 26513 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:21.932307 30060 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:11:21.924860 30663 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:11:21.919226 30539 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.951267 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:21.952178 27162 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:21.952610 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:21.902359 30670 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:21.869192 30513 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:21.958776 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:21.946463 30060 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.965850 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:21.967307 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:21.972422 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:21.955991 30521 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.932343 30666 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:11:21.947856 30306 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:11:21.977962 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:21.977408 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.965371 30665 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:21.971629 30411 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:21.974689 30134 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:21.953092 26622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:11:22.039451 26622 raft_consensus.cc:606] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:22.039862 26622 raft_consensus.cc:614] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:21.990303 30538 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.046828 30678 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.983577 30676 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:21.995327 30561 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:21.983372 30677 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:22.047191 30060 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:21.989445 30518 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:22.070264 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 92402.1us
I20260709 12:11:22.070577 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:22.038641 30134 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.080478 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:22.090023 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:22.094089 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:22.095081 26467 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.094111 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:22.096186 26464 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.096385 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:22.064800 30526 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:22.058596 30665 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 11 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:11:22.098582 26438 leader_election.cc:336] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.538s (SENT)
I20260709 12:11:22.063073 30411 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:22.100536 26472 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:22.103317 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:22.077231 30134 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.057600 30332 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.035372 30670 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.112562 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:22.100725 30566 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:22.060071 30676 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:22.070674 30677 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:22.148537 26469 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:22.168745 30411 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.169704 30332 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:22.134863 30670 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:22.181181 26469 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:22.183172 30687 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:11:22.184051 30060 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:22.184223 30687 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:22.184698 30687 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:22.185215 30674 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.280s	user 0.002s	sys 0.000s
W20260709 12:11:22.186494 30682 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:11:22.191179 30676 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:22.192401 30684 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:11:22.122887 30523 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.197677 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:22.200177 26622 raft_consensus.cc:2393] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:22.131248 30537 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:22.198062 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 78535us
I20260709 12:11:22.119516 30660 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.179266 30689 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.185633 30687 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.205245 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:22.232086 26471 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 13: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:22.205031 27167 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:22.204217 26467 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:22.241983 30689 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.255055 26466 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 10: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:22.255020 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:22.256848 26545 raft_consensus.cc:2368] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10.
I20260709 12:11:22.167829 30566 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.184401 30680 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:22.246650 30689 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:22.203181 30306 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.198235 30526 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.264099 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:22.203001 30658 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:22.274909 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:22.275617 26543 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
W20260709 12:11:22.275550 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 163079us
I20260709 12:11:22.279563 26547 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:22.281637 26544 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:22.282603 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:22.281659 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:22.286638 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:22.288069 26587 leader_election.cc:400] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10.
I20260709 12:11:22.288489 26587 leader_election.cc:403] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:22.289158 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:22.290490 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:22.291389 26545 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:11:22.197741 30517 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:22.242365 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:22.252357 30509 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:22.294466 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 195932us
I20260709 12:11:22.294595 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:22.200385 30534 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.255007 30561 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:22.304803 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:22.274708 30687 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.308629 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:22.319253 26465 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:22.307529 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:22.271585 30688 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:22.309365 26470 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:22.260623 30676 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:11:22.324838 26541 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:22.324877 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:22.302502 30689 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:22.273600 30613 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:11:22.302241 30521 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:22.302994 30528 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.330319 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:22.306121 30671 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.333390 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:22.305536 30060 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:22.184557 30665 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.280649 30686 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:11:22.278668 30566 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.336141 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:22.344376 26467 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.313097 30519 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:22.336971 26470 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:22.332556 26473 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:22.277184 30526 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.323568 30555 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:22.310024 30507 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:22.340483 30683 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:11:22.340325 30695 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:11:22.330425 30467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.069s	user 0.008s	sys 0.006s
W20260709 12:11:22.368973 30467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.116s	user 0.009s	sys 0.006s
I20260709 12:11:22.369602 30467 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:22.343122 30671 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:22.281850 30306 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:22.309724 30509 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:22.372185 30671 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:22.373374 30306 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:22.373598 30509 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:22.346043 30519 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.374197 30537 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:22.374607 30519 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.363615 30507 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:22.377048 30507 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:22.368178 30517 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:22.377861 26465 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:22.348183 30685 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:11:22.349890 30526 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:22.345376 30598 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:11:22.297590 30658 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:22.379940 30313 consensus_meta.cc:287] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.001s
I20260709 12:11:22.380064 30538 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:22.380656 30658 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:22.341032 30693 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.381646 27165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 574) took 1363 ms. Trace:
I20260709 12:11:22.381850 30677 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:22.382045 27165 rpcz_store.cc:276] 0709 12:11:20.995706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.995913 (+   207us) service_pool.cc:224] Handling call
0709 12:11:22.359265 (+1363352us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5400603954. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:22.359444 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":374510976}
I20260709 12:11:22.384476 26615 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:22.384865 30566 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:22.367451 30534 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:22.342555 30700 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 12:11:22.366386 30703 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.368090 30702 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:22.389410 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:22.390708 26467 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:22.405826 26470 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:22.344323 30331 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:11:22.403064 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.334646 30134 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:22.413718 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:22.361137 30689 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:22.426236 26616 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:22.380430 30313 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:22.426677 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.437749 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.420709 30677 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.341724 30528 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:22.429109 30660 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:22.431509 30566 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.425380 30526 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.438201 26464 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:22.436410 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:22.455289 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.458069 27134 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:22.421733 30537 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:22.418156 30507 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:11:22.437942 30521 raft_consensus.cc:697] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:22.470045 27167 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
W20260709 12:11:22.456451 30705 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:11:22.436750 30523 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:22.474656 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:22.478195 26620 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:22.411056 30703 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.479192 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:22.479271 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:22.473989 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:22.386184 30561 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.428617 30331 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:22.479663 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:22.480881 26619 raft_consensus.cc:2393] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:22.480959 26616 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
W20260709 12:11:22.482143 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.482332 26439 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:22.483007 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:22.469588 30509 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:22.483963 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:22.486609 30134 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:22.466667 30537 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:22.477613 30642 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.173s	user 0.005s	sys 0.008s
I20260709 12:11:22.499888 30331 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:22.500463 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 596) took 2239 ms. Trace:
I20260709 12:11:22.500638 26613 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:22.500907 26542 rpcz_store.cc:276] 0709 12:11:20.260861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.421382 (+160521us) service_pool.cc:224] Handling call
0709 12:11:20.456953 (+ 35571us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:20.503728 (+ 46775us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:20.719167 (+215439us) log.cc:844] Serialized 14 byte log entry
0709 12:11:21.024928 (+305761us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:21.045201 (+ 20273us) log.cc:844] Serialized 26 byte log entry
0709 12:11:21.045366 (+   165us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:21.045410 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.045496 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:22.296726 (+1251230us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:22.500146 (+203420us) raft_consensus.cc:1685] finished
0709 12:11:22.500257 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.500394 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19082,"prepare.queue_time_us":221391,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":39796,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":41641,"spinlock_wait_cycles":6041472,"thread_start_us":414934,"threads_started":2,"wal-append.queue_time_us":443275}
I20260709 12:11:22.481202 30543 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.505558 30712 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.464779 30566 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.479852 30693 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10.
I20260709 12:11:22.514595 30708 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.515377 30708 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.517824 30708 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:22.496706 30313 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:22.498327 30537 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:22.510182 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.518705 30703 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:22.519296 30655 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:22.519497 30528 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:22.484826 30509 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.520310 30509 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:22.512897 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:22.509143 30566 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:22.468160 30526 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:22.526726 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 193023us
I20260709 12:11:22.487025 30676 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:22.543944 30676 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.544508 30676 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.553613 26622 raft_consensus.cc:2410] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:11:22.555168 30526 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:22.556128 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:22.535274 30134 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.488652 30713 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.488282 30521 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:22.493671 30689 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.509172 30697 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.488762 30711 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.542208 30413 raft_consensus.cc:3055] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:22.506347 30712 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:22.543147 30539 consensus_meta.cc:287] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.581s	user 0.012s	sys 0.000s
I20260709 12:11:22.474852 30060 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:22.562090 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 91164us
W20260709 12:11:22.566056 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.586377 26438 leader_election.cc:336] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.753s (SENT)
W20260709 12:11:22.583001 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 245886us
W20260709 12:11:22.565593 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 81676.1us
I20260709 12:11:22.590765 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:22.588801 30665 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:22.589422 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 256166us
I20260709 12:11:22.588562 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:22.571805 30526 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.596765 26513 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:22.572969 30413 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:22.604893 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:22.606067 26438 leader_election.cc:336] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.790s (SENT)
I20260709 12:11:22.606745 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:22.648022 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.712577 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 107810us
I20260709 12:11:22.714227 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:22.715461 26622 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:22.716866 30134 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.595273 30519 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:22.717494 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:22.596158 30665 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.718152 26614 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 7.
I20260709 12:11:22.719195 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:22.597718 30331 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.124s
I20260709 12:11:22.720134 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:22.720222 30665 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:22.720844 26619 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:22.603575 30529 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.122s
W20260709 12:11:22.722878 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 122968us
I20260709 12:11:22.727604 26539 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:22.719206 30519 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:22.729501 30060 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.731468 30710 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.734530 30649 consensus_queue.cc:1059] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.137s
I20260709 12:11:22.734941 26615 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 14. Ops: []
I20260709 12:11:22.736056 30543 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:22.736326 30709 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.736675 30543 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:22.736956 30709 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:22.742168 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 144493us
I20260709 12:11:22.743295 26514 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:22.745515 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:22.746366 26619 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:22.748057 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:22.586094 30539 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.749958 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:22.720788 30706 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.180s
I20260709 12:11:22.750981 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:22.755872 26587 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:22.595901 30703 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.146s
I20260709 12:11:22.721962 30712 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:22.760085 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 159677us
I20260709 12:11:22.579823 30711 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.727571 30660 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:22.733989 30509 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:22.567368 30713 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.770629 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:22.773026 30060 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:22.774442 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:22.758240 30566 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:22.776757 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 178851us
I20260709 12:11:22.796561 30566 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.797020 30566 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:22.757550 30313 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:11:22.801115 30519 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:22.801832 30519 raft_consensus.cc:697] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:22.803256 30509 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:22.804066 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:22.784605 30716 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:11:22.737875 30543 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.804701 27159 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:11:22.603055 30528 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.149s
I20260709 12:11:22.789592 30719 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:22.789649 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 46480us
I20260709 12:11:22.728830 30658 consensus_queue.cc:1059] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:11:22.765172 30693 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:22.605839 30526 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.591343 30697 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:22.721524 30413 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.845796 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:22.773783 30411 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:22.802901 30519 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:22.757367 30561 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:11:22.809388 30060 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:22.736079 30695 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.819808 30313 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.821822 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:22.862174 26547 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.816156 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:22.821151 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:22.844174 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 88409.3us
W20260709 12:11:23.840932 26370 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57052 (request call id 305) took 24922 ms (client timeout 15000 ms). Trace:
I20260709 12:11:23.841809 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:11:23.053973 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.421139 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:23.847369 30743 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:23.848059 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 427007us
I20260709 12:11:23.848024 30743 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.832223 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:23.850486 30743 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:23.850688 26465 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:23.851366 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2960) took 1021 ms. Trace:
I20260709 12:11:23.851735 26465 rpcz_store.cc:276] 0709 12:11:22.830089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.831913 (+  1824us) service_pool.cc:224] Handling call
0709 12:11:23.851294 (+1019381us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.852897 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:23.853551 26465 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:23.854060 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2957) took 1024 ms. Trace:
I20260709 12:11:22.817842 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:23.855422 26466 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.816396 26467 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:23.861126 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2950) took 1051 ms. Trace:
I20260709 12:11:23.861588 26467 rpcz_store.cc:276] 0709 12:11:22.809227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.815577 (+  6350us) service_pool.cc:224] Handling call
0709 12:11:22.815945 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.860784 (+1044839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.861058 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.001834 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:23.863833 26469 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:23.864377 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 564) took 1058 ms. Trace:
I20260709 12:11:23.864679 26469 rpcz_store.cc:276] 0709 12:11:22.805755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.807560 (+  1805us) service_pool.cc:224] Handling call
0709 12:11:23.864313 (+1056753us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.865644 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:22.809839 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:23.854372 26465 rpcz_store.cc:276] 0709 12:11:22.829284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.852590 (+1023306us) service_pool.cc:224] Handling call
0709 12:11:23.854003 (+  1413us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.868389 26470 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.869107 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:23.190384 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:23.842007 26370 rpcz_store.cc:269] 0709 12:10:58.918243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.918640 (+   397us) service_pool.cc:224] Handling call
0709 12:11:23.840557 (+24921917us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:13.026298 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:13.027089 (+   791us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:13.027151 (+    62us) write_op.cc:435] Acquired schema lock
0709 12:11:13.027174 (+    23us) tablet.cc:662] Decoding operations
0709 12:11:13.029519 (+  2345us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:13.029623 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:13.029653 (+    30us) tablet.cc:685] Acquiring locks for 29 operations
0709 12:11:13.171799 (+142146us) tablet.cc:701] Row locks acquired
0709 12:11:13.171849 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:11:13.172027 (+   178us) write_op.cc:270] Start()
0709 12:11:13.172189 (+   162us) write_op.cc:276] Timestamp: P: 1783599073171959 usec, L: 0
0709 12:11:13.172215 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:11:13.307644 (+135429us) log.cc:844] Serialized 11372 byte log entry
0709 12:11:13.813057 (+505413us) op_driver.cc:464] REPLICATION: finished
0709 12:11:13.992142 (+179085us) write_op.cc:301] APPLY: starting
0709 12:11:14.004050 (+ 11908us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:14.006672 (+  2622us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:14.006835 (+   163us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:14.613599 (+606764us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:14.614762 (+  1163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=29
0709 12:11:14.614857 (+    95us) write_op.cc:312] APPLY: finished
0709 12:11:14.616313 (+  1456us) log.cc:844] Serialized 194 byte log entry
0709 12:11:14.616977 (+   664us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:14.910820 (+293843us) write_op.cc:454] Released schema lock
0709 12:11:14.911009 (+   189us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:14.911702 (+   693us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:14.911766 (+    64us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1188832,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":131859,"apply.run_cpu_time_us":12565,"apply.run_wall_time_us":938707,"num_ops":29,"prepare.queue_time_us":279029,"prepare.run_cpu_time_us":32883,"prepare.run_wall_time_us":472610,"raft.queue_time_us":84543,"raft.run_cpu_time_us":57855,"raft.run_wall_time_us":179793,"replication_time_us":606611,"thread_start_us":368662,"threads_started":4,"wal-append.queue_time_us":293927,"wal-append.run_cpu_time_us":12175,"wal-append.run_wall_time_us":2011780}]]}
I20260709 12:11:23.871354 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2956) took 1042 ms. Trace:
I20260709 12:11:23.871742 26472 rpcz_store.cc:276] 0709 12:11:22.829010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.190120 (+361110us) service_pool.cc:224] Handling call
0709 12:11:23.871270 (+681150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.872802 26472 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:23.873283 26466 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
W20260709 12:11:22.984330 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:23.177276 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.867214 30692 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:23.877432 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.877628 30692 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:22.847105 26543 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:23.879642 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 604) took 1071 ms. Trace:
I20260709 12:11:23.880024 26543 rpcz_store.cc:276] 0709 12:11:22.808615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.808750 (+   135us) service_pool.cc:224] Handling call
0709 12:11:23.879567 (+1070817us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.011507 26547 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:23.448995 26359 maintenance_manager.cc:643] P 8f3fd02e9cbb4cbb90df37bb5fd109c3: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 6.246s	user 0.198s	sys 0.071s Metrics: {"bytes_written":29271,"cfile_init":1,"dirs.queue_time_us":15270,"dirs.run_cpu_time_us":501,"dirs.run_wall_time_us":5090,"drs_written":1,"lbm_read_time_us":419,"lbm_reads_lt_1ms":4,"lbm_write_time_us":69438,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":29,"peak_mem_usage":0,"rows_written":63,"thread_start_us":43842,"threads_started":2,"wal-append.queue_time_us":26663}
I20260709 12:11:23.509327 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:23.586875 26438 leader_election.cc:336] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.544s (SENT)
I20260709 12:11:23.884078 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:23.884716 26467 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:23.032847 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:23.886216 26360 maintenance_manager.cc:419] P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10554 bytes on disk
I20260709 12:11:23.888599 26615 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:23.889305 26359 maintenance_manager.cc:643] P 8f3fd02e9cbb4cbb90df37bb5fd109c3: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":325,"lbm_reads_lt_1ms":4}
I20260709 12:11:23.508611 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:23.289281 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 598) took 1085 ms. Trace:
I20260709 12:11:23.034476 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:23.892973 26617 rpcz_store.cc:276] 0709 12:11:22.203377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.203876 (+   499us) service_pool.cc:224] Handling call
0709 12:11:22.227646 (+ 23770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.263233 (+ 35587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.263283 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:22.263337 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:22.263379 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.288953 (+1025574us) spinlock_profiling.cc:243] Waited 35.3 ms on lock 0x7b5400379e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:23.289014 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.289202 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81281280}
I20260709 12:11:23.893666 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2953) took 1065 ms. Trace:
I20260709 12:11:23.893743 26622 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:23.894012 26467 rpcz_store.cc:276] 0709 12:11:22.828067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.883725 (+1055658us) service_pool.cc:224] Handling call
0709 12:11:23.884302 (+   577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.893397 (+  9095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.893610 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.305199 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:22.856828 26621 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:23.033605 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:22.867286 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 51262.2us
W20260709 12:11:23.365602 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.905423 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:23.445482 27161 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:23.902165 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 604) took 1514 ms. Trace:
I20260709 12:11:23.428809 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:23.909073 27166 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:23.036748 27159 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:23.429008 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:23.041045 27162 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:23.432107 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:23.037880 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:23.427261 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:23.914367 27163 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.916033 27168 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:22.865187 30060 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:22.891057 30306 raft_consensus.cc:3055] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:23.925343 30306 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:22.865864 30313 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:23.548161 30332 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:23.931624 30332 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:23.934917 26617 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:23.371637 30363 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.939345 30363 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:23.043740 30507 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:23.941211 30507 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:23.941920 30363 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:23.943609 30507 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:23.271919 30413 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.947376 27165 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:22.976444 30411 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:23.952203 30411 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.794764 30523 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.992406 30510 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:23.965801 30510 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:23.253547 30518 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:22.834053 30526 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:23.992077 30526 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:23.090801 30540 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.015s	sys 0.004s
I20260709 12:11:23.388939 30539 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:22.975833 30561 consensus_queue.cc:1243] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:11:23.268581 30564 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.048983 30549 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:24.049677 30549 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:22.981652 30566 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:24.051631 30549 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:24.053838 30566 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:23.318578 30655 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:24.064538 30655 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.066012 30566 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.066619 30566 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:24.069555 30566 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:23.344980 30660 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.071267 30660 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:24.072479 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.073447 30660 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:24.074062 30660 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:11:23.332106 30667 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 1.445s	user 0.008s	sys 0.024s
W20260709 12:11:22.913509 30670 consensus_meta.cc:287] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.725s	user 0.009s	sys 0.004s
I20260709 12:11:22.834156 30676 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:24.081488 30676 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:23.483503 30680 raft_consensus.cc:3055] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:24.084559 30672 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.084932 30680 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:24.085232 30672 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:22.832007 30687 consensus_meta.cc:287] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.000s
I20260709 12:11:24.095376 30655 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.847374 30689 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:23.285560 30691 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:24.099171 30691 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:24.100488 30655 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:23.478029 26618 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:22.865538 30695 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.845463 30697 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:22.824290 30699 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:24.106580 30695 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:24.107036 30699 raft_consensus.cc:697] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 11 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:24.108196 30699 consensus_queue.cc:237] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.823369 30709 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:22.877825 30711 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:22.976400 30713 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:22.847856 30677 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:22.827327 30710 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:24.114645 26464 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:22.875147 30706 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.822347 30717 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 12:11:24.125126 30717 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:24.125548 30717 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:22.927248 30719 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:23.567101 30724 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.788s	user 0.006s	sys 0.000s
W20260709 12:11:23.543363 30728 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.607s	user 0.004s	sys 0.000s
I20260709 12:11:23.314568 30740 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.130524 30740 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:24.132793 30740 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:23.346571 30744 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.134217 30744 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:24.136355 30744 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:22.886195 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:24.140620 30719 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:24.140822 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 1.25471e+06us
I20260709 12:11:23.703826 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1934) took 1826 ms. Trace:
I20260709 12:11:23.743902 30702 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.142896 30719 consensus_queue.cc:1059] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:24.143230 30702 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:24.144304 30719 raft_consensus.cc:3055] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:24.144745 30719 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:23.835937 30537 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.867376 30743 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:24.146795 30537 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:24.146912 30743 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:24.147868 26619 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:24.148933 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 607) took 1117 ms. Trace:
I20260709 12:11:24.149049 30537 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:24.149225 30743 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:23.867239 30134 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.149271 26619 rpcz_store.cc:276] 0709 12:11:23.032024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.033271 (+  1247us) service_pool.cc:224] Handling call
0709 12:11:24.148766 (+1115495us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b5400033254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:24.148866 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":562129152}
I20260709 12:11:23.873379 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2952) took 1045 ms. Trace:
I20260709 12:11:22.808019 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:23.873952 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2948) took 1065 ms. Trace:
I20260709 12:11:23.878144 30692 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.881700 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 607) took 1072 ms. Trace:
I20260709 12:11:24.152612 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:24.152915 26547 rpcz_store.cc:276] 0709 12:11:22.809517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.809642 (+   125us) service_pool.cc:224] Handling call
0709 12:11:23.881633 (+1071991us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.883067 30696 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.154163 30697 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:24.154014 30696 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:24.154824 26514 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:24.154879 30697 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:24.155756 30413 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:24.156208 30696 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:23.366735 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:24.157127 30537 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.157496 26614 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.157693 30537 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:23.891535 26616 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.158351 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:24.160061 30537 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:24.161304 30692 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:23.898443 26467 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:24.162936 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2955) took 1334 ms. Trace:
I20260709 12:11:23.899266 26620 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.163712 30692 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:23.898757 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2958) took 1036 ms. Trace:
I20260709 12:11:24.166633 26469 rpcz_store.cc:276] 0709 12:11:22.829551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.865313 (+1035762us) service_pool.cc:224] Handling call
0709 12:11:23.866341 (+  1028us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:24.166759 30699 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:24.167659 30699 consensus_queue.cc:1243] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:24.168438 26469 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:24.169159 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2959) took 1339 ms. Trace:
I20260709 12:11:24.169382 30699 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:24.169524 26469 rpcz_store.cc:276] 0709 12:11:22.829813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.167681 (+1337868us) service_pool.cc:224] Handling call
0709 12:11:24.168048 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:24.168877 (+   829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.169101 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:24.150112 30134 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:24.152673 26466 rpcz_store.cc:276] 0709 12:11:22.808481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.809424 (+   943us) service_pool.cc:224] Handling call
0709 12:11:23.873863 (+1064439us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:24.163309 26467 rpcz_store.cc:276] 0709 12:11:22.828687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.897671 (+1068984us) service_pool.cc:224] Handling call
0709 12:11:23.898037 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:24.162617 (+264580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.162868 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:24.174062 26466 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:24.174314 30134 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:23.941936 27163 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:24.174826 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2962) took 1339 ms. Trace:
I20260709 12:11:23.934165 30332 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:23.977512 26470 raft_consensus.cc:2410] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:24.175259 26466 rpcz_store.cc:276] 0709 12:11:22.835276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.173314 (+1338038us) service_pool.cc:224] Handling call
0709 12:11:24.173655 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:24.174571 (+   916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.174773 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:24.176043 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2949) took 1367 ms. Trace:
I20260709 12:11:24.174057 26473 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:24.176470 26470 rpcz_store.cc:276] 0709 12:11:22.808865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.809517 (+   652us) service_pool.cc:224] Handling call
0709 12:11:24.175976 (+1366459us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.982813 27168 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:11:23.958217 30523 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:24.177647 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 567) took 1370 ms. Trace:
I20260709 12:11:23.967967 30510 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:24.178071 26473 rpcz_store.cc:276] 0709 12:11:22.806754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.807721 (+   967us) service_pool.cc:224] Handling call
0709 12:11:24.177470 (+1369749us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b540035f7d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:24.177586 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49340672}
I20260709 12:11:24.178572 30648 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:23.976003 30306 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:23.982795 30313 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:23.996204 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 90908.9us
I20260709 12:11:24.181846 30306 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.183141 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:24.183419 26616 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:24.184084 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:24.184441 26614 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:24.186486 30523 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:24.187050 30507 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.187501 30507 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.187855 30507 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:23.997298 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 87395.5us
I20260709 12:11:23.985344 30756 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:23.992206 30363 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.192427 30363 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:24.193185 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:24.193415 27134 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:24.193480 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:24.194206 27163 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
W20260709 12:11:24.034144 30540 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.612s	user 0.019s	sys 0.004s
I20260709 12:11:24.035810 30759 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.054219 30549 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.053601 30649 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:24.061251 30757 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:24.062475 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 475550us
I20260709 12:11:22.775228 30665 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.253922 30665 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:24.199658 30759 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:24.075143 30660 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:24.082240 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 207492us
I20260709 12:11:24.079381 30525 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.258589 26439 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:24.258911 26541 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:11:24.064569 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 222869us
I20260709 12:11:24.259872 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:24.260730 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:24.086026 30680 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:24.262845 30743 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:24.263433 30743 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:24.263918 30743 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.264195 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.264834 26473 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:24.096482 26366 catalog_manager.cc:5697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:24.266005 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:24.100138 30691 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:22.830437 30693 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.305540 30693 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:24.117762 26464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 566) took 1311 ms (client timeout 1700 ms). Trace:
I20260709 12:11:24.132855 30717 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:24.306656 26464 rpcz_store.cc:269] 0709 12:11:22.806449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.807786 (+  1337us) service_pool.cc:224] Handling call
0709 12:11:24.117527 (+1309741us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54000dbbd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:24.117686 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1344329088}
I20260709 12:11:24.308115 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.133669 30706 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:23.637509 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1972) took 1382 ms. Trace:
I20260709 12:11:24.310083 27168 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:24.310952 30717 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.311245 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:24.150692 26472 rpcz_store.cc:276] 0709 12:11:22.827720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.872340 (+1044620us) service_pool.cc:224] Handling call
0709 12:11:23.872643 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.873142 (+   499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.873325 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:24.311991 26543 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:24.145694 30719 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:24.142679 26471 rpcz_store.cc:276] 0709 12:11:21.877583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.895382 (+ 17799us) service_pool.cc:224] Handling call
0709 12:11:23.703328 (+1807946us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b5400069ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:23.703539 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746285952}
I20260709 12:11:24.312556 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.313164 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.313258 26472 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:24.313280 30719 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.313783 26471 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
W20260709 12:11:24.151068 26367 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57048 (request call id 302) took 24519 ms (client timeout 15000 ms). Trace:
I20260709 12:11:24.146081 30702 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:23.907812 26621 rpcz_store.cc:276] 0709 12:11:22.388012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.388414 (+   402us) service_pool.cc:224] Handling call
0709 12:11:22.417558 (+ 29144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.900272 (+1482714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.901865 (+  1593us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b5400268254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:23.902088 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1009561856}
I20260709 12:11:24.166957 26514 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:24.315672 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:24.315900 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.169979 30699 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.959589 26622 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:11:24.316468 30702 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:24.316819 26622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 610) took 1283 ms (client timeout 1561 ms). Trace:
I20260709 12:11:24.316998 30702 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.179541 26468 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:24.196048 26620 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:24.201079 26588 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:24.201372 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:24.204186 30648 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.204586 30740 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:24.316625 30699 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.316422 26621 raft_consensus.cc:2393] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:24.194375 30564 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:24.297101 30691 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.211357 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:24.353770 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:24.314587 26367 rpcz_store.cc:269] 0709 12:10:59.631896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.632403 (+   507us) service_pool.cc:224] Handling call
0709 12:11:24.149293 (+24516890us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:23.439858 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:23.440462 (+   604us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:23.440517 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:11:23.440553 (+    36us) tablet.cc:662] Decoding operations
0709 12:11:23.440943 (+   390us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:23.441056 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:23.441087 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:11:23.441372 (+   285us) tablet.cc:701] Row locks acquired
0709 12:11:23.441437 (+    65us) write_op.cc:260] PREPARE: finished
0709 12:11:23.441830 (+   393us) write_op.cc:270] Start()
0709 12:11:23.441993 (+   163us) write_op.cc:276] Timestamp: P: 1783599083441697 usec, L: 0
0709 12:11:23.442042 (+    49us) op_driver.cc:348] REPLICATION: starting
0709 12:11:23.454460 (+ 12418us) log.cc:844] Serialized 541 byte log entry
0709 12:11:23.481632 (+ 27172us) op_driver.cc:464] REPLICATION: finished
0709 12:11:23.483254 (+  1622us) write_op.cc:301] APPLY: starting
0709 12:11:23.483364 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:23.487752 (+  4388us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:23.487878 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:23.489085 (+  1207us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:23.489361 (+   276us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:11:23.489405 (+    44us) write_op.cc:312] APPLY: finished
0709 12:11:23.489732 (+   327us) log.cc:844] Serialized 25 byte log entry
0709 12:11:23.489953 (+   221us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:23.490044 (+    91us) write_op.cc:454] Released schema lock
0709 12:11:23.490102 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:23.490582 (+   480us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:23.490612 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3015529,"reported_tablets":44,"spinlock_wait_cycles":85248,"child_traces":[["op",{"apply.queue_time_us":1334,"apply.run_cpu_time_us":7059,"apply.run_wall_time_us":7298,"cfile_cache_hit":2,"cfile_cache_hit_bytes":2088,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6215,"cfile_init":1,"lbm_read_time_us":839,"lbm_reads_lt_1ms":8,"num_ops":1,"prepare.queue_time_us":28488,"prepare.run_cpu_time_us":3902,"prepare.run_wall_time_us":17952,"replication_time_us":39391,"thread_start_us":27787,"threads_started":2}]]}
I20260709 12:11:24.355075 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:24.356292 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:24.356918 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 565) took 1550 ms. Trace:
I20260709 12:11:24.357125 26619 raft_consensus.cc:2410] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 11 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:24.357319 26468 rpcz_store.cc:276] 0709 12:11:22.806090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.815279 (+  9189us) service_pool.cc:224] Handling call
0709 12:11:24.356760 (+1541481us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b5400165654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:24.356861 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679878912}
I20260709 12:11:24.357842 26619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:11:24.213721 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:24.358422 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.358916 26616 raft_consensus.cc:2410] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:11:24.359069 26468 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:24.359965 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:24.205504 26438 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 3.319s (SENT) [suppressed 25 similar messages]
I20260709 12:11:24.221103 30773 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:24.195770 30313 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.227870 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:24.196748 30363 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:24.205219 30537 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:11:24.235594 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:24.236901 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2961) took 1406 ms. Trace:
I20260709 12:11:24.364451 26468 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:11:24.191092 30756 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:24.258716 30525 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:24.261993 30134 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:24.262938 30680 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.090978 30672 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:22.996800 30688 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:24.263480 30692 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:24.387523 30688 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:24.387790 30692 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:24.388533 30688 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:24.388710 30692 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:24.389672 30688 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.095865 30539 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.264672 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:24.390887 26470 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:24.390765 30539 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:24.393787 30539 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:24.096179 30613 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.394707 30613 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:24.397544 30613 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:24.096789 26494 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad640 after lost signal to thread 25293
I20260709 12:11:24.266603 30523 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:24.266765 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:24.266283 26366 catalog_manager.cc:5697] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 4 to 6, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 6 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:11:24.398511 30523 raft_consensus.cc:697] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:24.097754 30689 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:24.399335 26366 catalog_manager.cc:5697] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:24.400828 30689 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:24.269265 26473 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:24.401122 26366 catalog_manager.cc:5697] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:24.270321 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:24.285305 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:24.402832 26465 raft_consensus.cc:2410] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:11:24.402706 26614 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:24.286298 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:24.398522 26466 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.404258 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:24.384843 30740 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.404906 26541 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:24.405773 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:24.406801 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:24.288655 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:24.407701 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.407621 30669 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:24.408169 30669 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:24.408231 26544 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:24.385154 30660 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:24.409240 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:24.409075 30669 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:24.409838 26544 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:24.289192 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:24.288323 30540 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.288564 30713 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:24.293469 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:24.296527 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:24.296440 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:24.294517 30771 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:11:24.410145 26613 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:24.309705 26539 rpcz_store.cc:276] 0709 12:11:22.254934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.266531 (+ 11597us) service_pool.cc:224] Handling call
0709 12:11:22.295779 (+ 29248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.728262 (+432483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.637255 (+908993us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b540037f5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:23.637443 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992609152}
W20260709 12:11:24.315794 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 148931us
I20260709 12:11:24.179047 30510 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.009441 30526 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:24.314208 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.347127 30763 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:24.317261 26622 rpcz_store.cc:269] 0709 12:11:23.033066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.034174 (+  1108us) service_pool.cc:224] Handling call
0709 12:11:24.316754 (+1282580us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:24.317448 30702 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.348428 30757 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:24.349582 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:24.427443 26548 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:24.351572 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:24.427809 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 154894us
I20260709 12:11:24.207003 26542 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:24.352125 30648 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.361368 26619 raft_consensus.cc:606] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:24.429289 26619 raft_consensus.cc:614] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:24.362598 26545 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:24.430860 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:24.322077 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.314693 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.363601 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 2176) took 1105 ms. Trace:
I20260709 12:11:24.364789 26469 rpcz_store.cc:276] 0709 12:11:22.830360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.172578 (+1342218us) service_pool.cc:224] Handling call
0709 12:11:24.174117 (+  1539us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:24.174615 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:24.174647 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:24.175268 (+   621us) log.cc:844] Serialized 52 byte log entry
0709 12:11:24.196942 (+ 21674us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:24.196994 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.197062 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.236684 (+ 39622us) raft_consensus.cc:1685] finished
0709 12:11:24.236705 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.236840 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":493,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"thread_start_us":21267,"threads_started":1,"wal-append.queue_time_us":59551}
I20260709 12:11:24.373406 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.372397 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:24.377763 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 176764us
I20260709 12:11:24.361948 30773 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:24.399629 30523 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:24.401602 30756 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:24.277558 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:24.456441 26615 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:24.398200 26494 debug-util.cc:398] Leaking SignalData structure 0x7b080033c080 after lost signal to thread 25296
I20260709 12:11:24.258098 30759 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:24.404917 30740 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.402709 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:24.369983 30665 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:24.384884 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 106435us
I20260709 12:11:24.410820 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:24.412129 27165 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:24.416018 26472 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
W20260709 12:11:24.410775 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 121680us
I20260709 12:11:24.414047 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:24.408228 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.414958 26514 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:24.412844 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:24.415532 26613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2841) took 1701 ms (client timeout 1844 ms). Trace:
I20260709 12:11:24.413573 26470 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:24.425544 26466 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:24.351670 30564 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:24.433274 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 2954) took 1604 ms. Trace:
I20260709 12:11:24.411031 30540 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:24.474953 26588 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:24.440922 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.451802 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:24.453275 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.454502 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.454905 26620 rpcz_store.cc:276] 0709 12:11:23.258551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.304847 (+ 46296us) service_pool.cc:224] Handling call
0709 12:11:24.363546 (+1058699us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:24.367796 30313 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:24.431614 26545 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:24.458752 26471 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:24.455725 26366 catalog_manager.cc:5697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:11:24.411302 30713 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:24.612947 30759 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.613193 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:24.410382 30669 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.613530 30759 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.614543 30759 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.544963 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.616209 26464 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
W20260709 12:11:24.568090 26494 debug-util.cc:398] Leaking SignalData structure 0x7b0800381120 after lost signal to thread 26405
W20260709 12:11:24.617926 26494 debug-util.cc:398] Leaking SignalData structure 0x7b08003624a0 after lost signal to thread 26419
I20260709 12:11:24.618515 26469 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:24.421885 30613 raft_consensus.cc:2764] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:11:24.621167 26465 rpcz_store.cc:276] 0709 12:11:22.828383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.868824 (+1040441us) service_pool.cc:224] Handling call
0709 12:11:24.432989 (+564165us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b54003d0c54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:24.433188 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1225576192}
I20260709 12:11:24.456297 30648 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.624442 30564 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:24.603051 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.627760 26539 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:24.629691 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:24.455596 26546 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:11:24.624409 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:24.632133 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.633349 26546 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:24.623641 26471 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:24.543393 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 337889us
W20260709 12:11:24.635877 26569 debug-util.cc:398] Leaking SignalData structure 0x7b0800166800 after lost signal to thread 25293
I20260709 12:11:24.629413 26366 catalog_manager.cc:5697] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:24.636544 26541 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
W20260709 12:11:24.641106 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 184144us
W20260709 12:11:24.636309 26569 debug-util.cc:398] Leaking SignalData structure 0x7b0800166380 after lost signal to thread 25296
W20260709 12:11:24.613499 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 198590us
W20260709 12:11:24.643299 26569 debug-util.cc:398] Leaking SignalData structure 0x7b0800166a80 after lost signal to thread 26405
I20260709 12:11:24.622440 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:11:24.643903 26569 debug-util.cc:398] Leaking SignalData structure 0x7b0800099720 after lost signal to thread 26419
I20260709 12:11:24.541716 26615 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
W20260709 12:11:24.644927 26569 debug-util.cc:398] Leaking SignalData structure 0x7b0800168e80 after lost signal to thread 26465
W20260709 12:11:24.645380 26569 debug-util.cc:398] Leaking SignalData structure 0x7b0800168e40 after lost signal to thread 26466
I20260709 12:11:24.431363 30763 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:24.645700 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08001666a0 after lost signal to thread 26467
I20260709 12:11:24.650983 27133 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:24.657019 26546 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:11:24.657783 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.658555 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.633456 26545 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:24.616941 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.659521 26470 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:24.623449 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:24.630970 26542 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:24.647336 26473 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.661810 30678 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.662318 30678 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.451658 30757 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:24.662865 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08001666e0 after lost signal to thread 26470
W20260709 12:11:24.663214 26569 debug-util.cc:398] Leaking SignalData structure 0x7b0800166180 after lost signal to thread 26473
I20260709 12:11:24.663089 30543 consensus_queue.cc:1059] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:11:24.663879 26569 debug-util.cc:398] Leaking SignalData structure 0x7b0800166a20 after lost signal to thread 26497
I20260709 12:11:24.664090 30543 raft_consensus.cc:3055] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:24.664592 30543 raft_consensus.cc:740] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:24.665491 30543 consensus_queue.cc:260] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:24.666143 30763 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:24.527913 30740 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:24.667578 25298 debug-util.cc:398] Leaking SignalData structure 0x7b080000fee0 after lost signal to thread 26514
I20260709 12:11:24.662737 30678 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.671330 26540 raft_consensus.cc:2410] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:24.672940 26472 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:24.620273 26494 debug-util.cc:398] Leaking SignalData structure 0x7b0800376a80 after lost signal to thread 26497
I20260709 12:11:24.620461 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.669587 30543 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:24.675714 26494 debug-util.cc:398] Leaking SignalData structure 0x7b0800337560 after lost signal to thread 26572
I20260709 12:11:24.675889 26469 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
W20260709 12:11:24.677008 26494 debug-util.cc:398] Leaking SignalData structure 0x7b080025a980 after lost signal to thread 26646
I20260709 12:11:24.630970 26539 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
W20260709 12:11:24.620613 26613 rpcz_store.cc:269] 0709 12:11:22.713701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.718940 (+  5239us) service_pool.cc:224] Handling call
0709 12:11:24.415357 (+1696417us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b540003c354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:24.415469 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3860767616}
I20260709 12:11:24.652064 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:24.416344 30526 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:24.639959 26468 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:24.656589 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:24.618916 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.662426 30525 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:24.664224 26569 debug-util.cc:398] Leaking SignalData structure 0x7b0800166b20 after lost signal to thread 26511
I20260709 12:11:24.666600 30672 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.635677 26471 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:24.660341 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:24.615183 30713 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:24.678349 26494 debug-util.cc:398] Leaking SignalData structure 0x7b08003b2900 after lost signal to thread 27192
W20260709 12:11:24.687079 26569 debug-util.cc:398] Leaking SignalData structure 0x7b080022fae0 after lost signal to thread 26514
I20260709 12:11:24.688655 26543 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:24.682505 26470 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 9. Current term is 10. Ops: [8.8-9.9]
W20260709 12:11:24.721259 26569 debug-util.cc:398] Leaking SignalData structure 0x7b080021aba0 after lost signal to thread 26543
W20260709 12:11:24.721745 26569 debug-util.cc:398] Leaking SignalData structure 0x7b0800305700 after lost signal to thread 26547
I20260709 12:11:24.721472 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:24.722441 26543 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:11:24.722506 26569 debug-util.cc:398] Leaking SignalData structure 0x7b080036d7c0 after lost signal to thread 26572
I20260709 12:11:24.688294 26471 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:11:24.645881 26588 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:24.689121 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:24.637018 30649 consensus_queue.cc:1059] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:24.691797 26438 connection.cc:256] RPC call timeout handler was delayed by -1.0217001599999094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
I20260709 12:11:24.740114 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:24.740948 26471 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.694708 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:24.661712 26544 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:24.699741 26464 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:24.665598 30757 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:24.704123 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.715399 26366 catalog_manager.cc:5697] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:24.725008 26494 debug-util.cc:398] Leaking SignalData structure 0x7b08001dee40 after lost signal to thread 27193
W20260709 12:11:24.725768 26569 debug-util.cc:398] Leaking SignalData structure 0x7b0800262e60 after lost signal to thread 26615
I20260709 12:11:24.726647 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:24.736299 26472 pending_rounds.cc:85] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 7
I20260709 12:11:24.674773 30613 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:24.683789 30539 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.784868 26472 pending_rounds.cc:107] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:11:24.796284 26472 raft_consensus.cc:2889] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:24.744726 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2963) took 1909 ms. Trace:
I20260709 12:11:24.744689 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:11:24.754276 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.745093 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 56042.8us
I20260709 12:11:24.746083 26543 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:24.798331 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:24.746181 26473 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
W20260709 12:11:24.745230 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 99616us
I20260709 12:11:24.790050 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.791849 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:24.801347 26464 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:24.801716 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.802600 26473 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:24.789122 30537 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.804394 30537 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.699290 30714 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:24.794426 26569 debug-util.cc:398] Leaking SignalData structure 0x7b0800199b80 after lost signal to thread 26619
I20260709 12:11:24.692209 30672 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.796898 26472 pending_rounds.cc:107] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 10.9
W20260709 12:11:24.807498 26569 debug-util.cc:398] Leaking SignalData structure 0x7b080022fbc0 after lost signal to thread 26621
I20260709 12:11:24.797022 26467 rpcz_store.cc:276] 0709 12:11:22.835772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.173470 (+1337698us) service_pool.cc:224] Handling call
0709 12:11:24.173770 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:24.379158 (+205388us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:24.380767 (+  1609us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.513466 (+132699us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.539624 (+ 26158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:24.539698 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:24.539766 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.669687 (+129921us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b1800419680. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:11:24.744486 (+ 74799us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54001a9354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:24.744537 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.744668 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35784,"prepare.queue_time_us":50921,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":84,"raft.queue_time_us":83386,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":202,"spinlock_wait_cycles":476674688,"thread_start_us":93245,"threads_started":1}
W20260709 12:11:24.808274 26569 debug-util.cc:398] Leaking SignalData structure 0x7b0800259200 after lost signal to thread 26622
I20260709 12:11:24.808735 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:24.809150 26569 debug-util.cc:398] Leaking SignalData structure 0x7b0800355ec0 after lost signal to thread 26646
W20260709 12:11:24.809705 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08001c6e20 after lost signal to thread 27133
I20260709 12:11:24.809888 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.807616 26472 raft_consensus.cc:2889] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:24.810518 26569 debug-util.cc:398] Leaking SignalData structure 0x7b080037daa0 after lost signal to thread 27159
W20260709 12:11:24.810819 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08002401e0 after lost signal to thread 27162
W20260709 12:11:24.811048 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa6e0 after lost signal to thread 27165
W20260709 12:11:24.811654 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08003da640 after lost signal to thread 27192
W20260709 12:11:24.811934 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08003bafa0 after lost signal to thread 27193
I20260709 12:11:24.812146 26467 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:24.797644 26366 catalog_manager.cc:5697] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 7 to 10, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 10 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:24.812795 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:24.816488 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:24.812816 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.820159 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.863476 26467 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:24.819533 30537 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.695946 30313 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:24.877665 30313 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.878284 30313 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.878890 30313 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.825759 26548 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:24.812184 26569 debug-util.cc:398] Leaking SignalData structure 0x7b080030b960 after lost signal to thread 30060
W20260709 12:11:24.883320 26569 debug-util.cc:398] Leaking SignalData structure 0x7b080011dec0 after lost signal to thread 30306
W20260709 12:11:24.883658 26569 debug-util.cc:398] Leaking SignalData structure 0x7b0800333040 after lost signal to thread 30313
W20260709 12:11:24.883942 26569 debug-util.cc:398] Leaking SignalData structure 0x7b080029d0e0 after lost signal to thread 30411
W20260709 12:11:24.884191 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08003627a0 after lost signal to thread 30507
I20260709 12:11:24.884059 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:24.884593 26569 debug-util.cc:398] Leaking SignalData structure 0x7b080029b300 after lost signal to thread 30510
W20260709 12:11:24.884908 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08003b99e0 after lost signal to thread 30523
W20260709 12:11:24.885159 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08003261e0 after lost signal to thread 30526
W20260709 12:11:24.885435 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7880 after lost signal to thread 30540
W20260709 12:11:24.885710 26569 debug-util.cc:398] Leaking SignalData structure 0x7b080032ad80 after lost signal to thread 30561
W20260709 12:11:24.885953 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08000fd580 after lost signal to thread 30566
W20260709 12:11:24.886210 26569 debug-util.cc:398] Leaking SignalData structure 0x7b0800052d80 after lost signal to thread 30649
I20260709 12:11:24.834789 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.886874 26473 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:11:24.887866 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.889032 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:24.889577 26473 raft_consensus.cc:2376] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12. Re-sending same reply.
I20260709 12:11:24.835866 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.837100 26366 catalog_manager.cc:5697] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 4 to 8, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 8 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:24.838850 26471 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:24.699586 30773 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:24.684165 30549 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
W20260709 12:11:24.844439 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.744899 30756 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.703647 30306 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.118s
I20260709 12:11:24.695107 30665 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 12:11:24.782793 30540 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:24.796167 30539 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:24.789311 30525 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.859432 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:24.796392 30613 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:11:24.860378 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.822706 30714 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.820660 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:24.865586 26545 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:24.866640 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:24.868541 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:24.864611 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.971705 26467 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:11:24.736404 30507 consensus_meta.cc:287] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.548s	user 0.012s	sys 0.001s
I20260709 12:11:24.834893 30713 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.969915 26542 raft_consensus.cc:2376] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12. Re-sending same reply.
I20260709 12:11:24.892028 26366 catalog_manager.cc:5697] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 6 to 8, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 8 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:11:24.991010 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:11:24.893292 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08000432a0 after lost signal to thread 30665
W20260709 12:11:24.991722 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08002dad80 after lost signal to thread 30670
W20260709 12:11:24.992141 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4700 after lost signal to thread 30676
W20260709 12:11:24.992367 26569 debug-util.cc:398] Leaking SignalData structure 0x7b0800364ce0 after lost signal to thread 30677
I20260709 12:11:24.902596 26471 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:11:24.992626 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08003636e0 after lost signal to thread 30687
W20260709 12:11:24.992889 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08003bca40 after lost signal to thread 30688
W20260709 12:11:24.993099 26569 debug-util.cc:398] Leaking SignalData structure 0x7b080026d6e0 after lost signal to thread 30689
W20260709 12:11:24.993327 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08002aca60 after lost signal to thread 30693
W20260709 12:11:24.993541 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08003ef800 after lost signal to thread 30695
I20260709 12:11:24.993656 26471 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:24.853096 30743 consensus_meta.cc:287] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.589s	user 0.016s	sys 0.000s
I20260709 12:11:24.996074 30549 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:24.995797 30743 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:24.965250 30539 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.824872 30672 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:24.909050 26438 leader_election.cc:336] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.867s (SENT)
I20260709 12:11:25.003187 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:25.002875 26366 catalog_manager.cc:5697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 5 to 9, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 9 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:25.004192 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 95178.9us
W20260709 12:11:25.005142 26438 leader_election.cc:336] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.944s (SENT)
I20260709 12:11:25.004722 26366 catalog_manager.cc:5697] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:25.006048 26438 leader_election.cc:336] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.970s (SENT)
I20260709 12:11:24.918875 26473 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:25.007419 30306 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.978925 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:24.841086 30759 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:25.007993 30306 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:25.009049 26548 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 13: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:25.007541 30743 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:25.009891 30743 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:24.906759 26464 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:11:24.991684 26545 raft_consensus.cc:2376] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16. Re-sending same reply.
I20260709 12:11:25.020475 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.021314 26545 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
W20260709 12:11:24.993786 26569 debug-util.cc:398] Leaking SignalData structure 0x7b080032c860 after lost signal to thread 30697
I20260709 12:11:25.022459 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.011693 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:25.023540 26539 raft_consensus.cc:2368] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14.
I20260709 12:11:25.024618 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:24.989727 30713 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.026810 30713 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.012661 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:25.030915 26541 raft_consensus.cc:2376] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11. Re-sending same reply.
I20260709 12:11:25.032228 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.033746 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:11:25.014674 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.946133 30756 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:25.022785 26569 debug-util.cc:398] Leaking SignalData structure 0x7b080038dc20 after lost signal to thread 30699
W20260709 12:11:25.035884 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08002def80 after lost signal to thread 30706
W20260709 12:11:25.036197 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08000573e0 after lost signal to thread 30709
W20260709 12:11:25.036414 26569 debug-util.cc:398] Leaking SignalData structure 0x7b080031e060 after lost signal to thread 30710
W20260709 12:11:25.036638 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08003f0f40 after lost signal to thread 30711
I20260709 12:11:25.010018 30306 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:25.037245 26569 debug-util.cc:398] Leaking SignalData structure 0x7b0800045c00 after lost signal to thread 30713
I20260709 12:11:25.037479 26545 raft_consensus.cc:2410] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:11:25.051543 30756 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:25.051497 30702 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.000s
I20260709 12:11:25.052590 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.052760 30702 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:25.054183 26543 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 10: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:25.054608 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:25.015383 30680 consensus_meta.cc:287] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.638s	user 0.009s	sys 0.000s
W20260709 12:11:25.037642 26569 debug-util.cc:398] Leaking SignalData structure 0x7b0800321960 after lost signal to thread 30717
I20260709 12:11:25.055694 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:25.055997 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08001ead80 after lost signal to thread 30719
I20260709 12:11:25.056878 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.057616 26543 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:25.058617 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:25.058492 30507 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:25.059878 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:25.060575 26543 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 10: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:25.061049 30507 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:24.962441 30776 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:25.061352 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:11:25.045780 30693 consensus_meta.cc:287] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.740s	user 0.008s	sys 0.000s
I20260709 12:11:24.964282 30525 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.981550 30714 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.062662 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.062825 30525 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.061992 30776 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:25.063764 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.064381 26543 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 7.
I20260709 12:11:25.065215 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.065836 30776 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:25.066987 30693 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:25.069743 30693 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:25.043457 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:25.071247 26541 raft_consensus.cc:2410] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:11:25.072141 30702 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:25.072445 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:25.073304 26541 raft_consensus.cc:2376] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12. Re-sending same reply.
I20260709 12:11:25.049940 30539 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:25.075928 30771 raft_consensus.cc:3055] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:25.076390 30771 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:25.076903 30539 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:25.077399 30771 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:24.974740 30613 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:25.083133 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.066278 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:25.119375 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.119375 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:25.121222 26618 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:25.009986 30759 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:25.088557 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.089339 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:25.090986 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.124234 26544 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
W20260709 12:11:25.091725 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 99444.1us
I20260709 12:11:25.126384 26619 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:25.126277 26439 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:25.091621 26539 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:25.094094 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:25.095125 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.099205 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:25.102571 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:25.104318 27163 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:25.108989 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:25.129691 26622 raft_consensus.cc:2410] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:25.129554 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:25.112977 26620 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:11:25.130738 26620 pending_rounds.cc:85] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 6
I20260709 12:11:25.131091 26620 pending_rounds.cc:107] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:11:25.131384 26620 raft_consensus.cc:2889] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:25.115271 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:25.128355 27165 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:11:25.112566 26614 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:11:25.134569 26614 pending_rounds.cc:85] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 4
I20260709 12:11:25.135802 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:25.136868 26617 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:25.134899 26614 pending_rounds.cc:107] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 7.5
W20260709 12:11:25.090559 30523 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.032s	sys 0.040s
W20260709 12:11:25.141876 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.141752 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:25.124092 26548 raft_consensus.cc:2376] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10. Re-sending same reply.
I20260709 12:11:25.133224 26439 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:25.142709 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:25.143769 26543 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 13: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:25.144325 26614 raft_consensus.cc:2917] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Aborting config change with OpId 7.5: Aborted: Op aborted by new leader
I20260709 12:11:25.144898 26614 raft_consensus.cc:2889] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:25.081895 30672 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:25.123206 30717 consensus_meta.cc:287] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.812s	user 0.006s	sys 0.006s
I20260709 12:11:25.147148 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.146431 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:25.147974 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:25.146101 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:25.147634 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.150506 27163 raft_consensus.cc:2410] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:25.154146 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:25.158558 26621 raft_consensus.cc:2410] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 12:11:25.163753 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.152236 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:25.166857 26543 raft_consensus.cc:2368] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 6. Current term is 8.
I20260709 12:11:25.168124 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.168943 26615 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:25.169195 26543 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 10: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:25.139134 30660 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:25.171316 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:25.170357 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:25.174196 26619 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:11:25.147519 30699 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.797s	user 0.001s	sys 0.010s
W20260709 12:11:25.147709 30523 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.032s	sys 0.041s
I20260709 12:11:25.172911 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:25.178459 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.179288 26541 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:25.180194 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.181911 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:25.185582 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.186810 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.190514 30699 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:25.195349 26546 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 9: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:25.148540 30757 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:25.197469 26622 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:25.198880 26543 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 10: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:25.199137 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.199677 27162 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:25.199862 26548 raft_consensus.cc:2368] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12.
I20260709 12:11:25.147010 30771 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.172334 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.204779 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48222 (request call id 12) took 25623 ms. Trace:
I20260709 12:11:25.204605 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:25.129483 30313 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:25.205829 26619 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.181330 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.123632 30678 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:25.208606 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:25.207491 26543 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:25.173142 30743 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.205168 26614 rpcz_store.cc:276] 0709 12:10:59.575029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.575456 (+   427us) service_pool.cc:224] Handling call
0709 12:10:59.704468 (+129012us) spinlock_profiling.cc:243] Waited 42.4 ms on lock 0x7b4c00433440. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50743a6a20 00007f50743b7a29 00007f507437d644 00007f50743a4f2d 00007f50743a4b93 00007f50760331af 00007f5076032f3e 00007f50760b8888 00007f50760d575c 00007f50760d676a 00007f50760d591b
0709 12:10:59.743063 (+ 38595us) log.cc:844] Serialized 506 byte log entry
0709 12:10:59.934517 (+191454us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b540005a8a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f5076053142 00007f5076033eaa 00007f507603ad53 00007f507603acd9 00007f507603ac69 00007f507603ac31 00007f5076039dfd 0000000000388634 0000000000388479 00007f5072fed475
0709 12:11:00.008004 (+ 73487us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b4c001cc080. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50743a6a20 00007f50743b7a29 00007f50743b813f 00007f507437c2ab 00007f50743a9f3c 00007f50743aa3fe 00007f507463750b 00007f5076036381 00007f507603426b 00007f507603ad53 00007f507603acd9
0709 12:11:25.175503 (+25167499us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3044,"raft.queue_time_us":10002,"raft.run_cpu_time_us":8351,"raft.run_wall_time_us":413069,"spinlock_wait_cycles":121219968,"thread_start_us":52903,"threads_started":1,"wal-append.queue_time_us":124364,"wal-append.run_cpu_time_us":2532,"wal-append.run_wall_time_us":1074763}
I20260709 12:11:25.214824 26622 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:25.208016 26542 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:11:25.211117 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 205085us
I20260709 12:11:25.212378 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:25.216085 26438 leader_election.cc:336] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.973s (SENT)
I20260709 12:11:25.206907 26541 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:11:25.204952 30564 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.003s	sys 0.027s
W20260709 12:11:25.208369 30669 consensus_meta.cc:287] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.003s
I20260709 12:11:25.228200 26615 raft_consensus.cc:2410] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:25.228236 26542 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:25.230079 26622 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:11:25.230927 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.217417 30713 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:25.239064 26438 leader_election.cc:336] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.003s (SENT)
I20260709 12:11:25.239722 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:25.212020 30523 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:25.242936 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet fce5ecc0a3714c80861557f318edce9d: Aborted: Op aborted by new leader
I20260709 12:11:25.244042 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:25.245262 26544 raft_consensus.cc:2410] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:25.247885 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.253414 30773 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:25.231323 30648 consensus_meta.cc:287] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.006s
I20260709 12:11:25.273952 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:25.278659 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:25.227643 30564 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.003s	sys 0.028s
I20260709 12:11:25.257966 30523 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.287340 26548 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:25.223275 30537 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:25.273033 26622 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:11:25.331990 26622 pending_rounds.cc:85] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 4
I20260709 12:11:25.332347 26622 pending_rounds.cc:107] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:11:25.332671 26622 raft_consensus.cc:2889] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:25.300475 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:25.289630 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 585708us
I20260709 12:11:25.334723 26614 raft_consensus.cc:2410] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 12:11:25.308054 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.337672 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:11:25.285372 30543 consensus_meta.cc:287] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.001s
I20260709 12:11:25.141065 30756 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 12:11:25.286998 30740 consensus_meta.cc:287] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.620s	user 0.007s	sys 0.005s
I20260709 12:11:25.360236 26614 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 12:11:25.399746 26588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.009s	sys 0.038s
I20260709 12:11:25.385866 30313 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:25.386480 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.360868 30699 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:25.300069 30523 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:25.382438 26514 connection.cc:256] RPC call timeout handler was delayed by -2.4432284859999527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
W20260709 12:11:25.410933 26514 connection.cc:256] RPC call timeout handler was delayed by -2.3271284859999923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1844s for a response
W20260709 12:11:25.403498 30688 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.013s	user 0.012s	sys 0.005s
I20260709 12:11:25.361708 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:25.352402 30672 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:25.283910 30648 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:25.401585 26588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.009s	sys 0.039s
I20260709 12:11:25.383167 30759 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:25.396224 26547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.018s	sys 0.029s
W20260709 12:11:25.428853 26547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.019s	sys 0.029s
I20260709 12:11:25.420650 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:25.429836 26614 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 13: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:25.427706 26615 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 12:11:25.402148 30717 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:25.432180 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 1982) took 1158 ms. Trace:
W20260709 12:11:25.437837 26587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.028s	sys 0.017s
I20260709 12:11:25.380167 30740 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:25.438299 26587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.028s	sys 0.017s
W20260709 12:11:25.450361 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 633980us
I20260709 12:11:25.435781 26547 rpcz_store.cc:276] 0709 12:11:24.273348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.458660 (+185312us) service_pool.cc:224] Handling call
0709 12:11:24.531396 (+ 72736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:24.531718 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:24.565898 (+ 34180us) log.cc:844] Serialized 14 byte log entry
0709 12:11:25.430739 (+864841us) log.cc:844] Serialized 14 byte log entry
0709 12:11:25.430995 (+   256us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:25.431075 (+    80us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:25.431140 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.431795 (+   655us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.432068 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37587,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":146301,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":862835,"threads_started":2,"wal-append.queue_time_us":582827}
I20260709 12:11:25.451329 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:25.457820 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:25.458880 27167 raft_consensus.cc:2368] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 9. Current term is 10.
I20260709 12:11:25.458819 26614 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:25.457926 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:25.433693 30691 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.079s	user 0.010s	sys 0.003s
I20260709 12:11:25.432868 26514 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:25.462971 26613 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:25.464736 26466 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:11:25.466830 26466 pending_rounds.cc:85] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 4
I20260709 12:11:25.467224 26466 pending_rounds.cc:107] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:11:25.467490 26466 raft_consensus.cc:2889] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:25.472128 26513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.006s	sys 0.018s
I20260709 12:11:25.472236 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:25.474867 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:25.476192 26513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.006s	sys 0.018s
I20260709 12:11:25.477604 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:25.479604 26469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.023s	sys 0.034s
W20260709 12:11:25.480249 26469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.023s	sys 0.034s
W20260709 12:11:25.478322 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 785367us
I20260709 12:11:25.463449 30313 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:25.463363 30669 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:25.439090 30759 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:25.490983 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:25.493906 26615 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 13: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:11:25.495325 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:25.480855 30692 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.064s	user 0.040s	sys 0.022s
W20260709 12:11:25.497224 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.498035 27167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 590) took 1214 ms. Trace:
I20260709 12:11:25.499464 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:25.500288 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:25.500599 26620 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 10: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:25.454877 30717 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:25.498477 27167 rpcz_store.cc:276] 0709 12:11:24.283271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.283390 (+   119us) service_pool.cc:224] Handling call
0709 12:11:25.497833 (+1214443us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54005771d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:25.497971 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2407379328}
I20260709 12:11:25.480609 30526 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:25.508869 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:25.509855 30564 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.509894 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:25.526081 27165 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:25.517107 30784 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:11:25.485797 30691 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:25.504092 30692 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.087s	user 0.041s	sys 0.022s
I20260709 12:11:25.523730 30740 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:25.523571 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1955) took 1240 ms. Trace:
I20260709 12:11:25.526010 27163 raft_consensus.cc:2393] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 10: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
W20260709 12:11:25.515007 30790 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:11:25.527339 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:25.476205 30540 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:11:25.499480 30537 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:25.491180 30713 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:25.490197 30669 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:25.490805 30680 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:25.480997 30693 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:11:25.495442 30678 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:25.533370 26465 rpcz_store.cc:276] 0709 12:11:24.283363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.623838 (+340475us) service_pool.cc:224] Handling call
0709 12:11:24.624650 (+   812us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:24.626123 (+  1473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:24.626199 (+    76us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:24.685669 (+ 59470us) log.cc:844] Serialized 26 byte log entry
0709 12:11:25.255691 (+570022us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:25.255753 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.255854 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:25.523246 (+267392us) raft_consensus.cc:1685] finished
0709 12:11:25.523278 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.523486 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":201,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":99,"thread_start_us":459475,"threads_started":1,"wal-append.queue_time_us":703101}
I20260709 12:11:25.538630 27159 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:25.540069 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.542014 26619 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:25.552747 27165 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
W20260709 12:11:25.543514 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 304490us
W20260709 12:11:25.535355 30785 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 12:11:25.550876 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 404827us
I20260709 12:11:25.530103 30660 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:25.557914 26439 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:25.525188 30526 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:25.552927 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:25.553627 26438 leader_election.cc:336] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.006s (SENT)
I20260709 12:11:25.549285 30669 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.535463 30757 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:25.532311 30564 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:25.562904 30795 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:11:25.576208 30665 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:25.577654 30757 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:25.562963 26438 leader_election.cc:336] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.013s (SENT)
I20260709 12:11:25.563360 30526 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:25.566983 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:25.584066 26615 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 13: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:25.567516 30691 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:25.554791 30680 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:25.570307 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 137533us
W20260709 12:11:25.570814 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 87796.5us
I20260709 12:11:25.573756 30799 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:25.579754 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 572) took 1033 ms. Trace:
I20260709 12:11:25.630656 26472 rpcz_store.cc:276] 0709 12:11:24.546410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.705081 (+158671us) service_pool.cc:224] Handling call
0709 12:11:24.736085 (+ 31004us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:24.810965 (+ 74880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:24.810995 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:24.811454 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 12:11:25.279154 (+467700us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:25.279212 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.279323 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:25.579520 (+300197us) raft_consensus.cc:1685] finished
0709 12:11:25.579541 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.579689 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":467323,"threads_started":1,"wal-append.queue_time_us":665333}
I20260709 12:11:25.579022 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:25.576258 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:25.633432 26619 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:25.581095 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:25.581987 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:25.633559 26620 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:11:25.634266 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52401.1us
I20260709 12:11:25.635036 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:25.636210 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:25.573024 30525 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.002s
I20260709 12:11:25.570014 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:25.601897 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:25.604336 30794 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:11:25.611800 30680 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:25.615599 30759 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:25.618736 30773 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.626449 30660 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:25.627280 30648 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:25.639660 26621 raft_consensus.cc:2410] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:25.639376 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:25.652741 27159 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
W20260709 12:11:25.672729 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.673975 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:25.676594 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:25.678934 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 77127.6us
I20260709 12:11:25.681221 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:25.683660 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:25.684583 26472 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.693423 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:25.694353 26465 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:25.645961 30788 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:11:25.653867 30507 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:25.707049 30693 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.641906 30691 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:25.673509 30672 raft_consensus.cc:2764] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 12:11:25.721752 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 158818us
I20260709 12:11:25.678236 30799 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:11:25.726979 26438 leader_election.cc:336] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.109s (SENT)
W20260709 12:11:25.734753 26438 leader_election.cc:336] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.145s (SENT)
I20260709 12:11:25.735900 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:25.689260 30797 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:25.740347 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 7c931e3af68c4073a5ed978eb0f43f3f: Illegal state: Replica 01a57027214a411e80874ac7febd628b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:11:25.653281 30525 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:25.744534 26472 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:25.710093 30688 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:25.748404 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 112262us
I20260709 12:11:25.710460 30648 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.721136 30806 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.749533 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:25.756407 26439 leader_election.cc:400] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 9. Current term is 10.
I20260709 12:11:25.756942 26439 leader_election.cc:403] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:25.758165 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:25.750017 26588 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:25.675097 30773 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:25.759793 26588 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:25.761612 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:25.762290 26465 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:25.763679 26621 pending_rounds.cc:85] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 9
I20260709 12:11:25.764045 26621 pending_rounds.cc:107] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:11:25.764324 26621 raft_consensus.cc:2889] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:25.762223 26618 raft_consensus.cc:2376] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13. Re-sending same reply.
I20260709 12:11:25.772933 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2964) took 1035 ms. Trace:
I20260709 12:11:25.773597 26469 rpcz_store.cc:276] 0709 12:11:24.737723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.739247 (+  1524us) service_pool.cc:224] Handling call
0709 12:11:24.749815 (+ 10568us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:11:24.811144 (+ 61329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:24.811192 (+    48us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:11:24.821679 (+ 10487us) log.cc:844] Serialized 104 byte log entry
0709 12:11:25.481182 (+659503us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:25.749058 (+267876us) log.cc:844] Serialized 14 byte log entry
0709 12:11:25.772485 (+ 23427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.772576 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:25.772624 (+    48us) raft_consensus.cc:1685] finished
0709 12:11:25.772643 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.772851 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23055,"raft.queue_time_us":47036,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":29811,"thread_start_us":778279,"threads_started":2,"wal-append.queue_time_us":689652}
I20260709 12:11:25.740811 30507 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 13 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:25.753054 30665 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:25.747818 30688 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:25.787153 26514 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:25.785734 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:25.723169 30693 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:25.766891 30678 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:25.787146 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 621) took 1153 ms. Trace:
I20260709 12:11:25.793220 26618 raft_consensus.cc:2393] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 10: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:11:25.771713 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 97820.9us
W20260709 12:11:25.789844 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55233.1us
I20260709 12:11:25.793740 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 1961) took 1499 ms. Trace:
I20260709 12:11:25.748663 30717 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:25.794581 26466 rpcz_store.cc:276] 0709 12:11:24.294168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.634439 (+340271us) service_pool.cc:224] Handling call
0709 12:11:24.634956 (+   517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:25.468119 (+833163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.793403 (+325284us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b54002de6d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:25.793656 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1907464576}
W20260709 12:11:25.795809 26438 leader_election.cc:336] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.147s (SENT)
I20260709 12:11:25.796337 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:25.791782 30797 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:11:25.799067 30525 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:25.798560 30507 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 11.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:25.799937 30804 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:11:25.800629 30771 consensus_meta.cc:287] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.592s	user 0.002s	sys 0.019s
I20260709 12:11:25.800511 30804 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:25.801275 30771 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.804152 30313 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:25.804867 30313 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.772112 30713 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:25.797466 26513 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:25.814805 27168 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:25.791194 30688 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.791527 26514 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:25.777621 30756 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.793236 26540 rpcz_store.cc:276] 0709 12:11:24.633974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.672582 (+ 38608us) service_pool.cc:224] Handling call
0709 12:11:24.672918 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:24.673310 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:24.673341 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:24.673970 (+   629us) log.cc:844] Serialized 52 byte log entry
0709 12:11:25.145675 (+471705us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:25.186161 (+ 40486us) log.cc:844] Serialized 14 byte log entry
0709 12:11:25.196733 (+ 10572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.196812 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:25.786891 (+590079us) raft_consensus.cc:1685] finished
0709 12:11:25.786915 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.787074 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26941,"prepare.run_cpu_time_us":8511,"prepare.run_wall_time_us":17278,"raft.queue_time_us":1605,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":188,"thread_start_us":471240,"threads_started":1,"wal-append.queue_time_us":813988}
W20260709 12:11:25.820114 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 70652.1us
I20260709 12:11:25.785843 30665 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.785337 30808 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 9. Current term is 10.
I20260709 12:11:25.807288 30759 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.778944 30523 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:25.788900 30814 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:11:25.835769 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:25.819252 30797 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.820230 30678 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:25.844966 27133 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:25.826828 30665 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:25.846321 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:25.828181 30743 consensus_meta.cc:287] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.607s	user 0.018s	sys 0.000s
W20260709 12:11:25.843410 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47663.4us
I20260709 12:11:25.821354 30692 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.811555 30648 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 12:11:25.842622 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 73423.2us
I20260709 12:11:25.822679 30713 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:25.846479 30613 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.003s
I20260709 12:11:25.847564 26540 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:25.851649 30773 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:25.857388 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:25.857493 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:25.863009 26472 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:11:25.863102 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:25.863705 26540 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:25.865586 30714 consensus_meta.cc:287] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.802s	user 0.009s	sys 0.011s
I20260709 12:11:25.866257 30714 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:25.869203 30714 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:25.870149 30313 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:25.872854 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:25.873709 26615 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 13: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:25.874681 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:25.875784 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.876088 30678 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:25.806937 30691 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:25.879611 30693 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:25.872080 26540 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:25.845237 30564 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:25.848598 30759 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.852910 30743 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.853307 30813 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.855504 30804 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:25.890967 27159 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:25.896540 30313 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:25.956243 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 107196us
I20260709 12:11:25.827654 30799 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:25.979643 26438 leader_election.cc:336] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.155s (SENT)
I20260709 12:11:25.980182 26438 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:25.981083 30313 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.883358 30771 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:25.969729 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 85932.1us
I20260709 12:11:25.971931 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:25.972254 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:25.985769 27165 raft_consensus.cc:2410] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:11:25.975201 27163 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:25.976320 30523 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:25.885927 30816 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:25.881331 30797 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:25.982869 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:25.996263 26546 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.972776 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:25.981648 30313 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:25.880465 30613 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:25.997264 26547 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:25.998813 26539 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:25.973172 30815 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.000861 26548 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:26.009444 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:26.011672 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 220268us
I20260709 12:11:26.013711 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:26.014102 26513 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:25.993652 30771 raft_consensus.cc:697] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:25.997510 30797 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:26.020182 26614 raft_consensus.cc:2410] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:11:26.023509 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:26.015166 30815 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:26.027591 30815 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:26.028610 30815 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:26.029582 30815 consensus_queue.cc:1243] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:26.030265 30815 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:11:26.030424 26438 leader_election.cc:336] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.170s (SENT)
I20260709 12:11:25.919705 30813 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:26.031472 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.010310 30757 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.020680 30814 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:26.043581 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.020996 30808 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:26.020505 30306 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:26.045958 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 46251.4us
W20260709 12:11:26.055493 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.010609 30523 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:11:26.076750 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:11:26.077760 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47465.7us
I20260709 12:11:25.994921 30713 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:26.085294 26438 leader_election.cc:336] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.234s (SENT)
I20260709 12:11:26.031790 30743 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:11:26.046315 30756 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.090161 30564 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:26.048046 30660 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.087152 30306 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:26.093152 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:26.094851 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:26.097450 27165 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:26.091593 30819 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.249s	user 0.002s	sys 0.000s
I20260709 12:11:26.126495 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:26.100431 30660 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:26.104054 30613 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:26.108821 30820 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:11:26.098893 30771 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:26.094345 30564 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:11:26.142541 30669 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.551s	user 0.006s	sys 0.006s
I20260709 12:11:26.142899 30564 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.143056 30669 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:26.123580 30813 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:26.124014 26438 leader_election.cc:336] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.527s (SENT)
I20260709 12:11:26.148330 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.080868 30827 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:26.127498 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:26.149492 26622 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:26.152104 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:26.157718 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:26.159492 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:26.160295 26541 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.157734 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:26.163611 26543 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.151093 30827 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.165230 30672 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:26.165704 30672 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.165649 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:26.166199 30672 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:26.167009 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:26.167292 30526 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.584s	user 0.003s	sys 0.009s
I20260709 12:11:26.167817 30526 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:26.168172 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:26.162171 30507 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:11:26.100256 30306 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:26.175236 30306 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:26.087725 30797 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:26.177307 30814 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:26.177587 30526 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:26.177763 30797 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:26.178649 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 54683.9us
W20260709 12:11:26.179343 26438 leader_election.cc:336] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.564s (SENT)
I20260709 12:11:26.179710 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.165257 30827 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:26.182545 30306 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.187060 30660 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:26.097522 30648 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 12:11:26.192263 30648 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:26.192698 30648 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:11:26.192811 26438 leader_election.cc:336] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.720s (SENT)
I20260709 12:11:26.193333 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.193535 30648 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:26.194088 30808 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.194844 30808 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.195689 30313 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:26.195878 26438 connection.cc:256] RPC call timeout handler was delayed by -1.0966301419998672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
I20260709 12:11:26.216038 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:26.216967 26542 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:26.225744 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.226583 26541 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:26.227876 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:26.228803 26472 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:26.230777 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:26.231594 26472 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:26.233526 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:26.234380 26472 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:26.235433 26546 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:26.236744 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:26.237587 26546 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:26.241645 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:26.242547 26470 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.246019 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:26.246991 26467 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.249780 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:26.250370 26464 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.254680 27168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 474) took 1149 ms. Trace:
I20260709 12:11:26.254082 27165 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:26.255105 27168 rpcz_store.cc:276] 0709 12:11:25.105005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.105185 (+   180us) service_pool.cc:224] Handling call
0709 12:11:26.254511 (+1149326us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b540077c754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:26.254619 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1543097216}
I20260709 12:11:26.257720 26543 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:26.259054 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:26.260020 26543 raft_consensus.cc:2368] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9.
I20260709 12:11:26.261984 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:26.263013 26465 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:26.275064 27165 raft_consensus.cc:2368] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9.
I20260709 12:11:26.182637 30743 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:26.263280 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 244208us
W20260709 12:11:26.249143 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 225745us
I20260709 12:11:26.277341 26513 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:26.266669 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:26.268180 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:26.280164 26472 raft_consensus.cc:2410] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:11:26.271011 26438 leader_election.cc:336] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.722s (SENT)
W20260709 12:11:26.281805 26438 leader_election.cc:336] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 3.117s (SENT)
I20260709 12:11:26.284045 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.287423 26467 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:26.289563 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:26.291366 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:26.303900 26471 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.291375 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:26.292943 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:26.306530 26541 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.306723 26469 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.295105 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:26.292117 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:26.308488 26473 raft_consensus.cc:2393] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 10: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:26.302680 26438 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.309525 26472 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.311889 26468 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:26.307525 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:26.308339 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:26.315726 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:26.316599 26546 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.321951 26467 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:26.345793 26470 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:11:26.349498 30759 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.352031 30827 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:26.354849 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:26.356021 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 79223.9us
I20260709 12:11:26.357431 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:26.314214 26618 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
W20260709 12:11:26.358736 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:26.369004 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 91770.6us
I20260709 12:11:26.370167 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:26.370512 26472 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
W20260709 12:11:26.369059 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 85416.3us
I20260709 12:11:26.371536 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.372788 26464 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:26.207248 30816 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:11:26.356480 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 49299.5us
I20260709 12:11:26.376292 26466 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:26.380734 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.394625 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.397313 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.381608 30693 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:26.382570 30814 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:26.383502 30549 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.383399 30838 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:26.407020 26541 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
W20260709 12:11:26.407156 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 46902.5us
I20260709 12:11:26.263502 30672 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:26.309245 30807 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:11:26.414052 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 43958.3us
W20260709 12:11:26.414316 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 132560us
I20260709 12:11:26.471115 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:26.436766 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.355074 30808 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.387574 30680 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:26.443532 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:26.408540 26546 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:26.403137 30693 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.473585 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:26.474334 26473 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:11:26.474712 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:26.407917 30714 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.414129 30525 raft_consensus.cc:2764] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:26.412652 30713 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.421059 30759 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 12:11:26.413059 30814 consensus_queue.cc:1243] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:11:26.477576 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 382792us
I20260709 12:11:26.604605 26438 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.575183 26469 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:26.626605 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:26.628731 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:26.629583 26469 raft_consensus.cc:2376] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13. Re-sending same reply.
W20260709 12:11:26.629709 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 232463us
I20260709 12:11:26.631556 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.632896 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:26.441636 30771 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.469630 30813 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:26.646870 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 175460us
W20260709 12:11:26.556437 30665 consensus_meta.cc:287] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.701s	user 0.013s	sys 0.004s
I20260709 12:11:26.480218 30313 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.623711 26467 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:26.475764 30660 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:26.567894 30827 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:26.621115 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:26.471062 30789 log.cc:927] Time spent T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:11:26.635723 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:26.641616 30808 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.481600 30807 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:26.626335 30743 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 12:11:26.441816 30795 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 12:11:26.571765 30831 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:11:26.572515 30840 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:11:26.687355 30843 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:11:26.680197 30525 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:26.689278 30525 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:26.690295 30836 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 0.153s	user 0.000s	sys 0.002s
I20260709 12:11:26.690604 30525 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:26.662880 30507 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.474313 30756 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.454460 26471 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
W20260709 12:11:26.627593 30688 consensus_meta.cc:287] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.804s	user 0.020s	sys 0.000s
W20260709 12:11:26.653672 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.624610 30693 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.415495 30799 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:26.480976 30680 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.567255 30838 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:26.660820 26473 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.649804 30523 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:26.640352 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:26.480669 26466 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:26.600800 30564 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:26.650442 30847 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.650209 30771 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:26.643256 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.704767 30846 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:11:26.538763 30816 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:26.712262 30672 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:26.662010 30313 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:26.697872 30827 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:11:26.659756 30665 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:26.763206 26542 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.546s	user 0.016s	sys 0.002s
I20260709 12:11:26.803821 30808 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.805648 26542 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:26.680797 30845 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.806770 30845 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:26.809015 30845 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:26.772965 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:26.809759 26465 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:26.729579 30688 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:26.812057 30688 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:26.812265 30807 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:26.812893 30827 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:26.813287 30827 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:26.814064 30827 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:26.773558 26466 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:26.815222 30827 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.815855 26466 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:26.729090 30756 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:26.818045 26466 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:26.664703 30660 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:26.818765 30756 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:26.819201 26469 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 10: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:26.819502 26470 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
W20260709 12:11:26.775823 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 332327us
W20260709 12:11:26.779475 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:26.782804 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 139687us
I20260709 12:11:26.822377 26438 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.730911 30680 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.739645 30523 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.800345 26473 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:26.770291 30799 raft_consensus.cc:697] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:26.822979 26514 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:26.729642 30507 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:26.829773 26473 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 11 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 12:11:26.830130 26465 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:11:26.831570 26465 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:11:26.823431 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 174532us
I20260709 12:11:26.826221 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.836040 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:26.869947 27163 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
W20260709 12:11:26.828975 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 180004us
I20260709 12:11:26.854740 26540 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 13: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:26.820024 30660 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:26.860126 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 136676us
I20260709 12:11:26.823900 30838 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:11:26.828222 30850 raft_consensus.cc:2764] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:26.831923 30756 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.828924 30743 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.829010 30523 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:26.858363 30813 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:11:26.876617 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 50542.6us
I20260709 12:11:26.877480 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.908715 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.909633 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.880388 27133 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:26.911247 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.833010 30846 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:11:26.915907 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.884127 30807 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.877378 30847 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:26.920425 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.891705 30838 consensus_queue.cc:1243] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:26.905200 30669 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:26.828265 30799 consensus_queue.cc:237] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:26.947615 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:26.917336 30845 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:26.918570 30757 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.906683 30743 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:27.025045 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:27.015208 27159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 596) took 1067 ms. Trace:
W20260709 12:11:27.039004 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 90717.1us
I20260709 12:11:26.928128 30846 consensus_queue.cc:1243] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:11:27.044883 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.112756 26514 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:26.956280 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:26.930895 30816 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:27.013828 30811 raft_consensus.cc:3055] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:27.175428 30811 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:27.176402 30313 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:26.925808 30713 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:27.177105 30713 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.182142 30713 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.185912 30525 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.954128 30808 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.220s
I20260709 12:11:26.946691 30838 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:27.187356 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 2007) took 1032 ms. Trace:
I20260709 12:11:27.176137 30816 raft_consensus.cc:697] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:27.111662 27159 rpcz_store.cc:276] 0709 12:11:25.947524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.971638 (+ 24114us) service_pool.cc:224] Handling call
0709 12:11:27.014899 (+1043261us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b54003b5e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:27.015118 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2121284992}
I20260709 12:11:26.952458 30660 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.177721 30856 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:26.998705 30848 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:11:27.180195 27165 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:11:27.181026 30844 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.554s	user 0.000s	sys 0.002s
I20260709 12:11:27.181131 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:26.957324 30678 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:27.182533 27160 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:27.182884 30855 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
W20260709 12:11:27.170836 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 223337us
I20260709 12:11:27.165773 30857 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.113657 30845 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.187830 26540 rpcz_store.cc:276] 0709 12:11:26.155457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.157238 (+  1781us) service_pool.cc:224] Handling call
0709 12:11:27.187134 (+1029896us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b5400140354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:27.187287 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1546993152}
I20260709 12:11:27.111591 26468 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:27.194721 26621 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:27.125281 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:27.227833 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:27.228574 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 103429us
I20260709 12:11:27.229264 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:27.229491 26614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 620) took 1755 ms (client timeout 1837 ms). Trace:
W20260709 12:11:27.229948 26614 rpcz_store.cc:269] 0709 12:11:25.474328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.474567 (+   239us) service_pool.cc:224] Handling call
0709 12:11:27.226613 (+1752046us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b540037a854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:27.229411 (+  2798us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1251674496}
W20260709 12:11:27.178613 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 66028.6us
I20260709 12:11:27.230660 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:27.231233 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:26.965312 30306 consensus_meta.cc:287] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.782s	user 0.009s	sys 0.002s
I20260709 12:11:26.931224 30859 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.023438 30771 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:27.187192 30838 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:27.212634 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:27.167547 30807 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:27.024107 30665 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:27.048363 30858 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:27.219825 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 158262us
I20260709 12:11:27.006445 30539 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:27.212576 30678 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.262531 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:27.263077 30678 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.263267 26618 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.266647 30313 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:27.267164 30313 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.267506 30313 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.271072 26617 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:27.271200 30523 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:27.272303 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:27.272826 30507 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:27.223376 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:27.295836 26620 raft_consensus.cc:2410] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:11:27.296793 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:27.298007 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:27.299914 26620 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:27.302528 30807 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:27.230089 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:27.315263 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 85245.8us
I20260709 12:11:27.316622 30613 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:27.287086 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48982.9us
I20260709 12:11:27.317334 30613 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.317963 30613 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.245867 30827 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:27.318385 30807 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:27.319043 30827 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:27.320050 30827 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:27.245434 30838 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:27.243464 30808 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.050828 30669 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.168s
I20260709 12:11:27.191848 30816 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:27.231319 30845 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.273524 30523 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:27.226465 30856 raft_consensus.cc:697] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:27.275193 30743 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:27.125497 30564 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:27.276667 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:11:27.351411 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 74822.5us
I20260709 12:11:27.238628 26514 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:27.279721 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:27.353566 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2195) took 1639 ms. Trace:
W20260709 12:11:27.353833 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 115333us
I20260709 12:11:27.260591 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:27.262194 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:27.354210 26622 rpcz_store.cc:276] 0709 12:11:25.713858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.716875 (+  3017us) service_pool.cc:224] Handling call
0709 12:11:25.744146 (+ 27271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:26.149903 (+405757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.353193 (+1203290us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b540020ab54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:27.353471 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":931788800}
I20260709 12:11:27.261878 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:27.258994 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 78bbb48570954bf4ad1039abff47c036: Illegal state: Replica 01a57027214a411e80874ac7febd628b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:11:27.241072 26588 leader_election.cc:400] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9.
I20260709 12:11:27.356305 26588 leader_election.cc:403] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 12:11:27.283221 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.285971 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:27.357591 26542 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.239212 30526 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:26.945278 30847 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:27.363385 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:27.364519 26465 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:27.258713 30539 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:27.287029 30692 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:27.288374 26618 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:27.288458 30756 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:27.015223 30813 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:27.223737 30824 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:27.182996 30811 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:27.237825 30849 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:27.290609 30844 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:11:27.242694 30549 consensus_meta.cc:287] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.803s	user 0.009s	sys 0.005s
I20260709 12:11:27.291430 26468 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:27.292121 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:27.224874 26615 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 11 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 12:11:27.367810 30507 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:27.200193 30525 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:27.316646 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:27.336454 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2010) took 1171 ms. Trace:
I20260709 12:11:27.341615 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:27.416884 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 100354us
I20260709 12:11:27.343380 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:27.274276 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:27.346633 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:27.418998 26469 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:27.417275 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 75832.7us
I20260709 12:11:27.420305 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:27.350344 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:27.366720 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 136488us
I20260709 12:11:27.422004 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:27.370373 26470 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:27.423075 26472 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 13: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:27.391785 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:27.385844 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:27.424154 26548 raft_consensus.cc:2410] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:27.416710 26545 rpcz_store.cc:276] 0709 12:11:26.178900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.203474 (+ 24574us) service_pool.cc:224] Handling call
0709 12:11:26.263053 (+ 59579us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.298457 (+ 35404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.298488 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.354710 (+ 56222us) log.cc:844] Serialized 26 byte log entry
0709 12:11:26.797116 (+442406us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:26.797163 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.797263 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:27.336147 (+538884us) raft_consensus.cc:1685] finished
0709 12:11:27.336178 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:27.336373 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32774,"raft.queue_time_us":95183,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6200,"thread_start_us":353015,"threads_started":1,"wal-append.queue_time_us":449365}
I20260709 12:11:27.230834 30857 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:27.252776 30858 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:27.343143 30855 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:11:27.449594 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:27.367527 30838 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:27.455681 30838 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.456315 30838 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.362934 30526 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.461531 30526 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.462759 30648 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.464447 30665 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:27.465689 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:27.397679 30797 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:27.466975 30834 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:27.467150 30797 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:27.351459 30699 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:11:27.397886 30824 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.468492 30824 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.426862 26615 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:27.471362 26615 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:11:27.448048 30678 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:27.372076 30799 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:27.372357 30854 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.464195 30802 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:11:27.436967 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.467644 30834 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:27.426442 30811 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:27.471798 26615 pending_rounds.cc:85] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 5
I20260709 12:11:27.441437 30870 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.426222 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:27.505239 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 79076.7us
I20260709 12:11:27.505892 26613 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:27.506361 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:27.367645 30771 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:11:27.385785 30564 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:11:27.419246 30549 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.404078 30807 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:11:27.425523 30846 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:27.486408 26542 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:27.523360 26469 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:11:27.523955 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:27.487558 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:27.427215 30714 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:27.526495 30876 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:11:27.437440 30759 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.491532 27160 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:27.499801 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:27.529465 26545 raft_consensus.cc:2410] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:27.501581 26615 pending_rounds.cc:107] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:11:27.530021 26615 raft_consensus.cc:2889] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:27.531836 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:27.532954 26615 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 13: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:27.526571 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:27.536713 26541 raft_consensus.cc:2368] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12.
I20260709 12:11:27.413647 30849 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:27.542948 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:11:27.513643 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.445317 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:27.535454 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:27.551255 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:27.552485 26621 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:11:27.548062 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 194943us
I20260709 12:11:27.555334 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:27.548885 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:27.512213 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:27.549226 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:27.522343 30855 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:27.491418 30799 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:27.594432 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 86550.8us
W20260709 12:11:27.596764 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 47618.8us
W20260709 12:11:27.597427 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 57485.3us
W20260709 12:11:27.601012 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.603442 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:27.562427 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:27.604794 26621 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 17: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:27.608590 26545 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 10: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:11:27.608541 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 51976us
I20260709 12:11:27.610591 26621 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:27.612887 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2011) took 1398 ms. Trace:
I20260709 12:11:27.613343 26547 rpcz_store.cc:276] 0709 12:11:26.214559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.214724 (+   165us) service_pool.cc:224] Handling call
0709 12:11:26.262607 (+ 47883us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.358771 (+ 96164us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:26.382074 (+ 23303us) log.cc:844] Serialized 14 byte log entry
0709 12:11:26.446666 (+ 64592us) log.cc:844] Serialized 14 byte log entry
0709 12:11:26.538644 (+ 91978us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.564127 (+ 25483us) log.cc:844] Serialized 26 byte log entry
0709 12:11:26.564286 (+   159us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:26.564324 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.564407 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:27.023134 (+458727us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b18002bfa80. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:11:27.180453 (+157319us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:27.259228 (+ 78775us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b18002bfa80. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:11:27.453821 (+194593us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b18002bfa80. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:11:27.612632 (+158811us) raft_consensus.cc:1685] finished
0709 12:11:27.612654 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:27.612813 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99036,"prepare.queue_time_us":54182,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":3698,"raft.queue_time_us":268266,"raft.run_cpu_time_us":502,"raft.run_wall_time_us":43961,"spinlock_wait_cycles":243113344,"thread_start_us":116314,"threads_started":2,"wal-append.queue_time_us":153662}
W20260709 12:11:27.602108 30693 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.834s	user 0.011s	sys 0.002s
I20260709 12:11:27.591904 30855 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.556460 30507 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:27.492141 30856 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:27.621631 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 109527us
W20260709 12:11:27.622761 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 199837us
I20260709 12:11:27.546895 30691 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
W20260709 12:11:27.416356 30828 consensus_queue.cc:1175] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "01a57027214a411e80874ac7febd628b" responder_term: 8 status { last_received { term: 6 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 7. Current term is 8. Ops: [7.8-7.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:27.630678 30713 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:27.624125 30313 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:27.624361 30804 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.604593 30859 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.635339 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:27.663312 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:27.636883 30855 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.637545 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:27.613206 30771 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.657476 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:27.661621 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:27.660452 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 150684us
I20260709 12:11:27.664049 26548 raft_consensus.cc:2410] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:11:27.612219 30873 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 12:11:27.663965 26545 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:27.672783 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:27.669268 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:27.644631 30714 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:27.678167 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:27.621719 30699 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:11:27.686686 26616 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:27.691964 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.693389 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:27.693663 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:27.536130 30858 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:27.662532 30539 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:27.695528 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:27.626564 30693 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:27.697111 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:27.703763 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:27.704406 30804 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:27.719105 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:27.700214 30680 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.866s	user 0.012s	sys 0.001s
I20260709 12:11:27.739934 30849 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:27.747062 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:27.720592 30885 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:27.775648 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:27.748535 30889 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:11:27.748732 30890 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:27.750034 30897 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:27.685227 30892 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.695495 30564 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.689989 30847 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:27.769059 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 65378.8us
I20260709 12:11:27.780802 30885 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.719327 30814 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.749910 30526 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:27.779384 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 98713.5us
I20260709 12:11:27.780690 30756 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.825620 30885 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.719105 30525 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:27.828434 30526 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:27.834584 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:27.780295 30881 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:11:27.836045 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:27.840621 26539 raft_consensus.cc:2410] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 15 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:11:27.823962 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:27.826711 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:27.838434 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:27.844542 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 247081us
I20260709 12:11:27.822903 30858 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:27.775249 30878 log.cc:927] Time spent T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.258s	user 0.001s	sys 0.001s
W20260709 12:11:27.884388 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 46199.2us
I20260709 12:11:27.635564 30834 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:27.887205 26438 leader_election.cc:336] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.840s (SENT)
I20260709 12:11:27.726034 30539 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 12:11:27.847210 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:27.776517 30678 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:27.780755 30898 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.889809 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:27.931618 26539 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:27.724692 30893 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.152s
I20260709 12:11:27.828641 30665 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:27.935596 27162 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:27.822546 30857 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:27.829562 30797 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:27.822780 30897 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:27.840489 30847 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:27.913898 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:27.915665 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 231697us
I20260709 12:11:27.891747 30827 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:27.776516 30680 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:27.991176 30713 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:27.832372 30526 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 12:11:27.976339 30693 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:27.750972 30507 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:28.031157 30680 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:27.935390 30665 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:11:27.946959 30887 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:11:27.965801 26547 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 13: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:11:27.969231 30648 consensus_meta.cc:287] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.506s	user 0.014s	sys 0.000s
W20260709 12:11:27.971655 30613 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.653s	user 0.008s	sys 0.005s
I20260709 12:11:27.841406 30714 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:27.976306 30525 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:27.946575 30897 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.977974 26539 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:27.958146 30691 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:27.985677 30898 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:27.988078 30900 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:28.065136 26620 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: [8.5-10.6]
W20260709 12:11:27.988663 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 141593us
I20260709 12:11:27.836836 30564 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:27.918625 30523 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:27.993003 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 50391.6us
W20260709 12:11:27.932420 30660 consensus_meta.cc:287] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.721s	user 0.014s	sys 0.000s
I20260709 12:11:27.892470 30756 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 12:11:28.001945 30313 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:27.837507 30838 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:28.094014 26539 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:11:28.008765 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 121665us
W20260709 12:11:28.009990 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.013463 30871 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:28.016009 30886 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
I20260709 12:11:27.927211 30902 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.134s
I20260709 12:11:28.094857 30665 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.022620 30857 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:28.031698 26615 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 12:11:28.011422 30808 consensus_meta.cc:287] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.688s	user 0.011s	sys 0.003s
I20260709 12:11:28.053148 30691 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:11:28.023609 30811 consensus_meta.cc:287] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.004s
W20260709 12:11:28.042956 30824 consensus_meta.cc:287] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.571s	user 0.014s	sys 0.000s
W20260709 12:11:28.051299 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 209460us
W20260709 12:11:28.044245 30845 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.678s	user 0.006s	sys 0.008s
I20260709 12:11:28.038669 30799 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:28.067318 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:28.158128 30691 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:28.158732 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 91569.9us
I20260709 12:11:28.159436 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:28.160248 30680 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:28.160358 30898 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:28.160813 30680 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:28.161300 30898 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:28.079784 26620 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:11:28.161863 30680 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.164049 26620 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:28.092481 26622 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
W20260709 12:11:28.165724 30854 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.003s
I20260709 12:11:28.050678 30525 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:28.048251 30613 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.166792 26622 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:28.168004 30613 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:28.166173 30854 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9.
I20260709 12:11:28.170265 26545 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:28.172282 26539 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:28.173575 26614 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 10: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:28.173449 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:28.146003 26438 leader_election.cc:336] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.928s (SENT)
I20260709 12:11:28.139433 30838 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:28.140524 26540 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 9: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:28.184962 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:28.128407 27134 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:28.153439 26547 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:28.058245 30827 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:28.155107 30845 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:28.135169 30901 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:11:28.176518 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:28.088138 30660 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:28.179247 26472 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:28.180181 26471 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 17: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:28.203168 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:28.174619 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:28.089314 30900 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:28.176039 30898 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:28.180485 26467 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:11:28.142328 30665 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:28.187541 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 59282.6us
I20260709 12:11:28.145872 30523 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:28.191566 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:28.195611 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.154119 30808 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:28.168035 26622 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:28.143380 30648 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:11:28.210247 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:28.210213 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:28.219408 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:28.228850 26472 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.231963 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:28.233847 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:28.245669 26464 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.239457 30907 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.248247 27165 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:28.248261 30907 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.210631 30680 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:28.250896 30680 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:28.250998 30523 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.253273 30680 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:28.254923 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:28.235549 26587 connection.cc:256] RPC call timeout handler was delayed by -1.2267263099997763s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
I20260709 12:11:28.256436 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:28.256621 26587 connection.cc:256] RPC call timeout handler was delayed by -1.2096263099997486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 12:11:28.256986 26587 connection.cc:256] RPC call timeout handler was delayed by -1.2069263099997443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
I20260709 12:11:28.257051 26468 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.218863 30892 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:28.257318 26587 connection.cc:256] RPC call timeout handler was delayed by -1.1907263099999454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
W20260709 12:11:28.257975 26587 connection.cc:256] RPC call timeout handler was delayed by -1.1736263099999178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
I20260709 12:11:28.255014 26617 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:28.236152 26616 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:11:28.258268 26587 connection.cc:256] RPC call timeout handler was delayed by -1.1574263099998916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
I20260709 12:11:28.197417 30828 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:28.259690 26587 connection.cc:256] RPC call timeout handler was delayed by -1.1349263099998552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 12:11:28.280872 26587 connection.cc:256] RPC call timeout handler was delayed by -1.10702630999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
W20260709 12:11:28.281240 26587 connection.cc:256] RPC call timeout handler was delayed by -1.0935263099997883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
W20260709 12:11:28.281534 26587 connection.cc:256] RPC call timeout handler was delayed by -1.0125263099998847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1844s for a response
I20260709 12:11:28.279158 26465 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:28.176127 30824 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:28.146945 30871 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:28.292395 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:28.184190 30855 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.294832 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:28.297017 26464 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:28.299788 26616 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:28.300573 26472 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:28.234157 30660 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.263618 30857 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:28.323082 27168 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 12:11:28.315853 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:28.324120 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:28.297771 30830 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.258471 30672 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 12:11:28.324738 26467 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:11:28.317042 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:28.278451 30892 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.342998 30564 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:28.343181 30892 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:28.323508 30857 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.344983 30845 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:28.345469 30857 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:28.345950 30900 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.311527 30808 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:11:28.339062 30902 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:28.352294 30871 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:28.326538 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:28.355223 26471 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:28.356101 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:28.327328 26544 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:28.312157 26621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:11:28.338290 26618 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:28.368613 27163 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:28.371847 26587 leader_election.cc:400] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 8 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9.
I20260709 12:11:28.259629 30525 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.377255 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:28.367446 30902 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:28.382692 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:28.387226 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:28.370067 30808 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.325103 30660 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:28.330740 30692 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 12:11:28.390618 30771 consensus_meta.cc:287] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.714s	user 0.012s	sys 0.002s
I20260709 12:11:28.381345 30669 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:28.406318 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.383364 30859 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:28.357494 30313 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:11:28.392494 30714 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:28.442625 30669 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:28.327653 30827 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:28.444046 30909 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 12:11:28.425168 30918 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:11:28.449075 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.399797 30855 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:28.354043 30830 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:28.455190 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 71206.7us
I20260709 12:11:28.397274 30892 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.460345 30892 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.408656 30902 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:28.426213 30660 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:28.429493 30692 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.407294 30907 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:28.337630 30898 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.431169 30771 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:28.432260 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2140) took 1070 ms. Trace:
I20260709 12:11:28.435657 30859 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:28.437819 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:28.441656 30713 consensus_queue.cc:1059] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:28.442374 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:28.492374 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.405179 30523 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.506136 26548 rpcz_store.cc:276] 0709 12:11:27.361896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.060045 (+698149us) service_pool.cc:224] Handling call
0709 12:11:28.060587 (+   542us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.061063 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.061104 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.077480 (+ 16376us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.187168 (+109688us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:28.203140 (+ 15972us) log.cc:844] Serialized 14 byte log entry
0709 12:11:28.203368 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.203437 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.432009 (+228572us) raft_consensus.cc:1685] finished
0709 12:11:28.432034 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.432195 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29913,"prepare.queue_time_us":22085,"prepare.run_cpu_time_us":301,"prepare.run_wall_time_us":17988,"raft.queue_time_us":9122,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":58912,"thread_start_us":109303,"threads_started":1,"wal-append.queue_time_us":168137}
I20260709 12:11:28.409940 30808 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.512080 26467 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:28.551847 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 109544us
I20260709 12:11:28.550941 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:28.503921 30743 raft_consensus.cc:3055] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:28.552731 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:28.509598 30660 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.563079 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:28.565758 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:28.566648 30669 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:28.568367 30908 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:28.570547 30613 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:28.519277 30902 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:28.548156 30507 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.582996 27162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 682) took 1393 ms. Trace:
I20260709 12:11:28.583375 27162 rpcz_store.cc:276] 0709 12:11:27.180254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.180912 (+   658us) service_pool.cc:224] Handling call
0709 12:11:27.181187 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:27.936231 (+755044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.572863 (+636632us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54006a68d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:28.573138 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1734321536}
I20260709 12:11:28.587874 26468 raft_consensus.cc:2410] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:11:28.572381 30881 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:11:28.563642 30907 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:28.511333 30692 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:28.553747 30925 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:28.575301 30510 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:28.602640 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.564080 30743 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:28.611441 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:28.579159 30824 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:28.612236 26468 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:28.553265 30523 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.572552 30828 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:11:28.627367 26467 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:28.602792 30756 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.582693 30660 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.636096 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:28.626410 30510 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:28.641939 26468 raft_consensus.cc:2410] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:11:28.638377 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 72739.8us
I20260709 12:11:28.602288 30669 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:28.654806 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.599314 30857 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:28.615381 30907 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:28.595310 30507 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:28.665299 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:28.627862 30892 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:28.671121 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:28.676533 30902 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.648824 30890 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:28.688160 26468 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:28.697381 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:28.697707 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:28.698824 26468 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:28.688766 26467 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:11:28.613461 30925 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.692109 30743 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:28.708455 30930 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:11:28.708774 30743 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.675763 30807 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:28.710286 30807 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:28.713138 30507 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:28.703701 30942 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:28.723047 30942 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:28.724762 30669 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:28.727064 30935 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:11:28.729269 26547 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:28.729903 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:28.730454 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:28.730703 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:28.730368 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:28.731146 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:28.731827 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:28.732375 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:28.733089 26545 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:28.731813 26547 raft_consensus.cc:2410] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:28.733469 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:28.731969 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:28.734867 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:28.735867 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:28.737464 30838 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.737645 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:28.738284 26545 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:28.738073 30838 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.739276 30858 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.739856 30858 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.740442 30838 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:28.741026 30838 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.741465 30838 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.732491 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:28.744150 30510 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:28.744702 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:28.745394 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:28.745535 26547 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:28.747117 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:28.737411 30802 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:28.750730 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:28.751739 26473 raft_consensus.cc:2410] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:11:28.751139 30802 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:28.752599 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:28.754170 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:28.754674 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.753247 26473 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:28.721113 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:28.702702 30892 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:28.638298 30756 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.722215 30890 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:28.738860 30897 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.663s	user 0.012s	sys 0.001s
W20260709 12:11:28.706243 30927 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:11:28.756656 26542 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:28.789594 26542 pending_rounds.cc:85] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 5
I20260709 12:11:28.789898 26542 pending_rounds.cc:107] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:28.790141 26542 raft_consensus.cc:2889] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:28.719797 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2137) took 1359 ms. Trace:
I20260709 12:11:28.790760 26541 rpcz_store.cc:276] 0709 12:11:27.360832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.964562 (+603730us) service_pool.cc:224] Handling call
0709 12:11:27.965076 (+   514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.016351 (+ 51275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.016413 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.016999 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.185770 (+168771us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:28.206356 (+ 20586us) log.cc:844] Serialized 14 byte log entry
0709 12:11:28.718968 (+512612us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b180014f5c0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5072fefa40 00007f5072fea4e4 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287 00007f50760f5208
0709 12:11:28.719246 (+   278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.719348 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.719410 (+    62us) raft_consensus.cc:1685] finished
0709 12:11:28.719544 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.719719 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54717,"prepare.queue_time_us":23362,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":566469,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":6292,"spinlock_wait_cycles":30280064,"thread_start_us":168346,"threads_started":1,"wal-append.queue_time_us":310474}
I20260709 12:11:28.793047 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:28.793401 30802 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:28.690924 30931 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 12:11:28.757229 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:28.795535 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:28.796154 26539 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:28.796627 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:28.794343 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:28.797595 26547 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:28.790637 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 230264us
I20260709 12:11:28.751754 26545 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:28.760835 26468 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:28.796805 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:28.767306 26473 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:28.803793 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:28.804479 26542 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:28.805459 26468 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: [12.11-13.12]
I20260709 12:11:28.742113 30858 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:28.680339 30830 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:28.756367 26472 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 13. Current term is 14. Ops: [13.14-13.14]
W20260709 12:11:28.691370 30924 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.255s	user 0.001s	sys 0.001s
W20260709 12:11:28.768723 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 74541.5us
I20260709 12:11:28.824344 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:28.807780 26468 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:11:28.783190 30892 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.827234 30857 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:28.827468 30892 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.802754 30802 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.828230 30802 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.830947 26541 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:11:28.821591 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:28.830787 30907 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.832127 26542 raft_consensus.cc:2410] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:11:28.832314 26539 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:28.832481 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:28.833737 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:28.848520 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:28.832562 30802 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:28.834125 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:28.850580 26468 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:11:28.851330 26547 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:28.853302 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:28.848114 30857 raft_consensus.cc:2764] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:28.858009 26539 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:28.859364 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:28.839516 30900 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:28.865191 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:28.800295 30897 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.866587 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:28.856012 30945 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:28.869645 26468 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 12:11:28.870738 30890 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:28.871584 30665 consensus_meta.cc:287] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.632s	user 0.014s	sys 0.000s
I20260709 12:11:28.840566 30943 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:28.854064 30931 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:28.874284 26548 raft_consensus.cc:2410] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:11:28.888806 30858 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.891490 30827 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.899479 30808 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:28.883153 30943 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.831893 30947 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:11:28.873663 30507 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.903600 26542 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:28.862118 30613 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:28.865723 30915 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:28.889565 30885 consensus_meta.cc:287] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.057s	user 0.007s	sys 0.008s
I20260709 12:11:28.914670 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:28.858337 30828 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:11:28.869223 30802 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:28.930420 26545 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:28.932143 26545 pending_rounds.cc:85] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 5
I20260709 12:11:28.932490 26545 pending_rounds.cc:107] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:28.908838 30857 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:11:28.932824 26545 raft_consensus.cc:2889] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:28.918015 27168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 602) took 1402 ms. Trace:
I20260709 12:11:28.866075 30855 consensus_queue.cc:1059] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:11:28.929865 26539 raft_consensus.cc:2368] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12.
I20260709 12:11:28.935616 26539 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:28.934322 27168 rpcz_store.cc:276] 0709 12:11:27.515513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.516243 (+   730us) service_pool.cc:224] Handling call
0709 12:11:27.535089 (+ 18846us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:28.323628 (+788539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.917613 (+593985us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b540071c5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:28.917927 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1811530496}
I20260709 12:11:28.937628 30838 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:28.938251 30838 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:28.938614 30855 raft_consensus.cc:3055] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:28.939029 30855 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:28.939159 30838 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:28.939549 30838 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:28.939990 30855 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:28.940436 30838 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.941326 30855 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.941630 30838 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:28.924168 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:28.908468 30945 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:11:28.910993 30871 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:11:28.913661 30814 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:11:28.913628 30858 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:28.948118 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:28.915968 30827 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:28.955837 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:28.928509 30507 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:28.964958 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:28.965878 26616 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:28.972695 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:28.974013 26619 raft_consensus.cc:2410] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:28.933171 30915 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:28.934262 30885 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:28.985579 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:28.958007 30665 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:28.986503 26619 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:28.990360 30507 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:28.990504 30915 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:28.991155 30885 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:28.991309 30665 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:28.995934 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:28.996167 30892 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.997644 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:28.998988 30915 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.999585 30915 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:29.000823 30943 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:29.001966 30915 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:28.946177 30802 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:28.993053 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:28.992832 27167 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:28.992741 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:28.992077 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:28.991695 30827 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:29.019152 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:29.029026 27163 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:29.029158 26466 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:11:29.030344 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:29.030993 26466 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:29.022135 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 641) took 1730 ms. Trace:
I20260709 12:11:29.033035 26540 rpcz_store.cc:276] 0709 12:11:27.291531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.291777 (+   246us) service_pool.cc:224] Handling call
0709 12:11:29.021899 (+1730122us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b54000b5254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:29.022065 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1670603136}
I20260709 12:11:29.035151 26470 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:29.036751 26470 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:29.036895 26439 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:29.038669 30931 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:29.038959 26470 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:29.040112 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:29.040979 26618 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:29.023475 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:29.043161 26619 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:29.044234 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:29.023893 30691 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:29.024631 26543 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:28.988128 30897 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:29.026928 30858 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:29.039086 30931 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.022750 30892 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:29.042174 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:29.079252 26618 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:29.080587 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:29.081189 26618 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:29.057482 26470 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: [10.5-10.5]
W20260709 12:11:29.067031 26614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 2201) took 1806 ms (client timeout 1856 ms). Trace:
I20260709 12:11:29.082834 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:11:29.077514 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:29.083040 26614 rpcz_store.cc:269] 0709 12:11:27.260138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.260285 (+   147us) service_pool.cc:224] Handling call
0709 12:11:29.066724 (+1806439us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b54003d8e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:29.066940 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1883085184}
I20260709 12:11:29.085103 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:29.088578 26470 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:29.090776 26470 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:29.095660 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:29.098526 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:29.104501 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.029214 30802 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:29.066733 30713 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.074595 30799 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.067034 30827 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.107582 27167 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:29.111321 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:29.112658 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:29.110591 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:29.113936 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:29.112710 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:29.135584 27168 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:11:29.135612 26468 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:29.121119 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:29.123948 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.080889 30931 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:29.078356 30757 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:29.130038 27162 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:29.131220 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.134997 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:29.140786 30885 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:29.110320 30771 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:29.146492 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:29.155040 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 295745us
I20260709 12:11:29.133246 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:29.167339 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 216411us
I20260709 12:11:29.168980 26470 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:29.167418 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:29.178376 30871 consensus_queue.cc:1243] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:11:29.179586 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 318008us
W20260709 12:11:29.217686 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 50354.4us
I20260709 12:11:29.219547 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:29.182711 26618 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:11:29.221423 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:29.191866 30858 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:29.192029 30802 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:29.193830 30814 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:29.225834 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:29.226423 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 597) took 1044 ms. Trace:
I20260709 12:11:29.226907 26472 rpcz_store.cc:276] 0709 12:11:28.181827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.313825 (+131998us) service_pool.cc:224] Handling call
0709 12:11:28.314278 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.821236 (+506958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.226125 (+404889us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b54000dbbd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:29.226337 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1016130304}
I20260709 12:11:29.195175 30665 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:29.195777 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:29.143739 30885 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:29.217326 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 70999.6us
I20260709 12:11:29.224848 26438 leader_election.cc:400] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12.
I20260709 12:11:29.233950 26438 leader_election.cc:403] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:29.237459 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:29.216496 30507 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:29.217154 30771 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:29.229233 30811 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:29.137658 30799 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:29.246810 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:29.247716 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:29.225711 30669 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.230680 30858 consensus_queue.cc:1243] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:29.139187 30827 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:29.244004 30969 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:11:29.234012 30907 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.237332 30885 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:29.215637 30951 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:11:29.242568 30855 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:29.243855 30507 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.264858 30845 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.265576 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:29.229112 30943 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:11:29.268431 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:29.252381 30771 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:29.311257 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:29.255538 30802 consensus_queue.cc:1243] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:29.280148 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:29.256269 30892 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:29.242251 30804 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:11:29.286078 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:29.309497 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 113932us
I20260709 12:11:29.261654 30897 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:29.323900 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:29.316501 26618 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 13: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:29.325985 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:29.327584 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:29.328738 26618 raft_consensus.cc:2410] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:11:29.268379 30855 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:29.329537 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:29.285485 30507 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.288702 30743 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12.
I20260709 12:11:29.321785 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:29.288467 30525 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.290189 30907 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.311064 30972 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:29.341238 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:29.343902 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 641) took 1261 ms. Trace:
I20260709 12:11:29.342913 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:29.317718 30971 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:29.318092 30892 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:29.351137 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:29.330878 30845 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.352795 26622 rpcz_store.cc:276] 0709 12:11:28.082173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.243921 (+161748us) service_pool.cc:224] Handling call
0709 12:11:28.244386 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.259172 (+ 14786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.259202 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:28.259241 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:28.259270 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.343535 (+1084265us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b540020a654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:29.343609 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.343797 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33508608}
I20260709 12:11:29.329555 30897 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:29.340186 30858 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:29.343003 30802 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 12:11:29.438841 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:29.360500 30953 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:29.375401 30954 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:11:29.334431 30526 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:11:29.464543 30953 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:29.465564 30985 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.350960 30972 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:29.355600 26618 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 12:11:29.453269 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 102220us
I20260709 12:11:29.466949 30953 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:29.468086 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:29.336715 30665 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 12:11:29.469677 30665 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.470588 30665 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:29.470919 30979 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 12:11:29.471238 30665 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:29.426518 30902 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:29.427111 30971 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:29.466166 30985 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:29.454578 30855 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:29.474859 30902 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:29.482892 30956 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 12:11:29.483575 30902 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:29.480439 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:29.482089 26618 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:29.492436 26622 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:29.494699 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:29.480151 30838 consensus_meta.cc:287] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.538s	user 0.014s	sys 0.000s
W20260709 12:11:29.454226 30973 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:11:29.498255 26618 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:29.505625 26469 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
W20260709 12:11:29.486997 30962 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:11:29.480649 30526 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:29.474337 30665 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:29.461390 30858 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:29.494158 30892 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:29.455423 30870 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:11:29.454820 30981 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.125s
W20260709 12:11:29.606621 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 282870us
I20260709 12:11:29.715054 26619 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:29.717303 30799 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:29.565941 30947 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.555907 30845 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:29.718485 26621 raft_consensus.cc:606] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:29.718568 30845 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:29.719064 26621 raft_consensus.cc:614] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:29.475703 30971 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:29.624864 30945 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:29.673081 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.478410 30985 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:29.607798 30858 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.685629 30961 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:29.686367 30955 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:29.687005 30978 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 12:11:29.607584 30975 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
W20260709 12:11:29.694361 26617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 2205) took 2433 ms (client timeout 1759 ms). Trace:
W20260709 12:11:29.741220 26617 rpcz_store.cc:269] 0709 12:11:27.261367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.272040 (+ 10673us) service_pool.cc:224] Handling call
0709 12:11:29.694058 (+2422018us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b5400196754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:29.694239 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2214946688}
I20260709 12:11:29.696657 26620 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: [4.4-8.6]
I20260709 12:11:29.699175 30814 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:29.700515 30811 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:29.703292 30967 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.249s	user 0.000s	sys 0.000s
W20260709 12:11:29.709177 30879 log.cc:927] Time spent T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.066s	user 0.003s	sys 0.000s
I20260709 12:11:29.710763 30827 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:29.604868 30838 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:11:29.712755 30957 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.402s	user 0.001s	sys 0.001s
W20260709 12:11:29.724020 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 403899us
I20260709 12:11:29.731520 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:29.733492 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:29.734690 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:29.762352 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.736636 26514 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:29.737790 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:29.732350 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:29.785475 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:29.785926 26545 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:29.786604 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:29.787310 26540 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:29.787523 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:29.788390 26542 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:29.735467 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:29.788676 26540 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 12:11:29.790014 26540 pending_rounds.cc:85] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 4
I20260709 12:11:29.753526 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:29.790783 26472 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:29.791818 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:29.792930 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:29.793475 26472 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:29.756054 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:29.790278 26540 pending_rounds.cc:107] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 12:11:29.795728 26540 raft_consensus.cc:2889] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:29.797648 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:29.797578 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:29.798713 26464 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 13: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:29.737736 30955 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:29.798312 26468 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 8.
I20260709 12:11:29.809939 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:29.744334 30814 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:29.813308 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:29.819857 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 325222us
I20260709 12:11:29.826100 26541 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:29.827447 30990 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:29.827741 30983 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.829145 26541 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:29.834079 26472 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:29.834301 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:29.836687 26464 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 8: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:29.837630 26466 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:29.837987 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:29.784308 30838 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:29.855188 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.748142 30885 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:29.858848 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2220) took 1276 ms. Trace:
I20260709 12:11:29.866075 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:29.867069 26464 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:29.866240 26615 rpcz_store.cc:276] 0709 12:11:28.582087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.789322 (+207235us) service_pool.cc:224] Handling call
0709 12:11:28.789761 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.831863 (+ 42102us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.831895 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.841823 (+  9928us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.065997 (+224174us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:29.066041 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.066136 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.858530 (+792394us) raft_consensus.cc:1685] finished
0709 12:11:29.858559 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.858749 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41610,"raft.queue_time_us":42063,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":17541,"thread_start_us":193484,"threads_started":1,"wal-append.queue_time_us":474539}
I20260709 12:11:29.869377 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:29.870568 26472 raft_consensus.cc:2410] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:29.784715 30845 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:29.847657 30799 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.877249 30526 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:11:29.836704 30507 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:29.883232 27162 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:29.862998 30981 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.863441 30743 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.885254 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 635) took 2775 ms. Trace:
I20260709 12:11:29.830467 30827 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:11:29.886123 26546 rpcz_store.cc:276] 0709 12:11:27.105161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.105363 (+   202us) service_pool.cc:224] Handling call
0709 12:11:27.105766 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.106148 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.106190 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:27.125042 (+ 18852us) log.cc:844] Serialized 26 byte log entry
0709 12:11:27.366720 (+241678us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:27.391328 (+ 24608us) log.cc:844] Serialized 14 byte log entry
0709 12:11:27.391913 (+   585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.392018 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.631141 (+1239123us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b1800149680. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:11:29.708411 (+1077270us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:29.880065 (+171654us) raft_consensus.cc:1685] finished
0709 12:11:29.880098 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.880291 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":284,"prepare.queue_time_us":24748,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":60079,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":20795,"spinlock_wait_cycles":80159872,"thread_start_us":153023,"threads_started":1,"wal-append.queue_time_us":242433}
I20260709 12:11:29.891664 30507 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:29.878803 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:29.895916 26466 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:29.871294 30890 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:29.884433 30989 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:29.872546 30313 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:29.900110 26464 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:11:29.901614 30958 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:11:29.902460 26466 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:29.785362 30771 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:29.724332 30945 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:29.829077 30983 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:29.828214 30990 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:29.926460 26473 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:29.923280 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 2997) took 2546 ms. Trace:
I20260709 12:11:29.930708 26465 rpcz_store.cc:276] 0709 12:11:27.366799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.367033 (+   234us) service_pool.cc:224] Handling call
0709 12:11:27.391615 (+ 24582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.282267 (+890652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.912395 (+1630128us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b54003151d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:29.912673 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2040296704}
W20260709 12:11:29.909790 30931 consensus_meta.cc:287] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.769s	user 0.013s	sys 0.000s
I20260709 12:11:29.873656 30955 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:29.895011 30981 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:29.894825 30743 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:29.876411 30814 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:29.897714 30991 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:11:29.904080 30890 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:29.907714 30313 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:29.983552 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.965607 30960 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:11:29.987957 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 126951us
W20260709 12:11:29.991847 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 255311us
I20260709 12:11:29.906452 30989 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:29.970043 30931 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:29.996768 26468 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:29.997897 30931 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:30.001307 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:30.003496 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:30.000173 26473 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:30.009704 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:30.008694 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2885) took 2526 ms. Trace:
I20260709 12:11:30.012130 26620 rpcz_store.cc:276] 0709 12:11:27.481976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.164825 (+682849us) service_pool.cc:224] Handling call
0709 12:11:29.696337 (+1531512us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:29.743380 (+ 47043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.008517 (+265137us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400196750. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:30.008636 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3521296128}
I20260709 12:11:30.014237 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:29.993029 30814 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.018148 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 637) took 2912 ms. Trace:
I20260709 12:11:30.018767 26544 rpcz_store.cc:276] 0709 12:11:27.105819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.106404 (+   585us) service_pool.cc:224] Handling call
0709 12:11:28.019429 (+913025us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:11:28.019698 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.359262 (+339564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.017777 (+1658515us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b540018bfd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:30.018056 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":763411072}
W20260709 12:11:30.037377 30980 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:11:30.038015 30771 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:30.038213 30945 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:30.038990 30942 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:30.039242 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 606) took 1074 ms. Trace:
I20260709 12:11:30.039610 26470 rpcz_store.cc:276] 0709 12:11:28.964941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.169866 (+204925us) service_pool.cc:224] Handling call
0709 12:11:29.170207 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:29.170597 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.170625 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:29.171166 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.285423 (+114257us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:29.285484 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.285596 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.038973 (+753377us) raft_consensus.cc:1685] finished
0709 12:11:30.039000 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.039162 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":412,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"thread_start_us":113751,"threads_started":1,"wal-append.queue_time_us":573670}
I20260709 12:11:30.040743 26465 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:11:30.048548 30313 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:30.009717 30991 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:11:30.000104 30960 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:30.008077 30859 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:30.009914 30692 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:30.004958 30988 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:11:29.999193 30902 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:11:30.021170 30838 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:30.079195 26473 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:30.076023 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 72248us
I20260709 12:11:30.062649 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:30.085104 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:30.059419 30993 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:11:30.092458 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:30.062781 30885 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:30.067988 30890 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:30.071462 30981 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:30.050537 30757 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.066361 30802 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.073916 30988 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:30.065050 30989 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:30.066354 30743 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:30.054713 30996 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:30.120146 30990 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:30.065951 30960 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:30.120627 30660 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:30.121093 30983 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:30.087567 30902 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:11:30.123010 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:30.106231 30999 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:11:30.124967 30999 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:30.050380 30313 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:11:30.125502 30313 consensus_queue.cc:1243] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:30.125283 30972 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:30.077870 30971 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:30.128156 30971 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:30.111459 30892 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:30.115082 26469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 1989) took 1939 ms (client timeout 1882 ms). Trace:
I20260709 12:11:30.116454 30680 consensus_queue.cc:1059] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:30.124260 27168 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
W20260709 12:11:30.130751 26469 rpcz_store.cc:269] 0709 12:11:28.176123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.176278 (+   155us) service_pool.cc:224] Handling call
0709 12:11:30.114857 (+1938579us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54003156d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:30.114989 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2943986432}
I20260709 12:11:30.132436 26541 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:30.114243 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 599) took 1931 ms. Trace:
I20260709 12:11:30.131709 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:30.135316 26471 rpcz_store.cc:276] 0709 12:11:28.182348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.356396 (+174048us) service_pool.cc:224] Handling call
0709 12:11:28.356841 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.426977 (+ 70136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.427010 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.427507 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.554509 (+127002us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:28.554550 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.108767 (+1554217us) spinlock_profiling.cc:243] Waited 69.7 ms on lock 0x7b540035f7d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:30.108848 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.108926 (+    78us) raft_consensus.cc:1685] finished
0709 12:11:30.108944 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.114174 (+  5230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29989,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":46447,"spinlock_wait_cycles":160368000,"thread_start_us":120015,"threads_started":1,"wal-append.queue_time_us":238660,"wal-append.run_cpu_time_us":1844,"wal-append.run_wall_time_us":1079839}
I20260709 12:11:30.146484 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:30.147656 26620 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:11:30.153523 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 139407us
I20260709 12:11:30.141341 26439 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:30.245318 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 103954us
W20260709 12:11:30.246762 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 147276us
I20260709 12:11:30.247768 26542 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:30.155278 26614 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:30.174129 26619 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 13. Current term is 14. Ops: [13.14-13.14]
I20260709 12:11:30.173626 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:30.180904 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:30.265381 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:30.267944 26619 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 12:11:30.268424 26619 pending_rounds.cc:85] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 11
I20260709 12:11:30.269268 26619 pending_rounds.cc:107] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 12:11:30.275836 26619 raft_consensus.cc:2889] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:30.277005 30771 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 11.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:11:30.161463 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.153333 30693 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:30.278825 30693 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:30.149103 30983 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:30.151134 30743 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:11:30.283394 30983 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:30.114703 30988 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:30.286996 30988 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.195576 30756 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:30.114748 30757 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:30.125319 30999 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:30.120656 30996 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.291087 30996 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:30.293300 30757 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:30.194777 30892 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:30.168025 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:30.159660 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:30.296140 26616 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:30.296381 26615 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:30.153844 30858 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:30.255484 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:30.302613 31003 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.303409 26548 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:30.242287 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:30.306176 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 64341.4us
I20260709 12:11:30.257117 30660 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:30.306829 30660 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.307283 30660 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:30.260051 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 256459us
I20260709 12:11:30.311529 26514 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:30.281790 30693 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:30.175282 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:30.318843 31005 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.319892 31005 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:30.158733 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:30.323292 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2232) took 1249 ms. Trace:
I20260709 12:11:30.323863 26614 rpcz_store.cc:276] 0709 12:11:29.074164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.491264 (+417100us) service_pool.cc:224] Handling call
0709 12:11:29.499873 (+  8609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:30.249332 (+749459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.322771 (+ 73439us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b5400195854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:30.323079 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1506618112}
I20260709 12:11:30.270424 26439 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:30.282037 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:30.268656 26617 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:30.303506 31003 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:30.305583 30999 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:30.254359 30890 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.298543 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:30.156421 30972 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.327695 26617 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:30.315174 30858 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:30.339150 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 69001.3us
I20260709 12:11:30.351967 26439 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:30.354743 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:30.355629 30999 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:30.356487 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:30.357012 30859 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.357630 30855 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:30.361581 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:30.348117 30771 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:30.364617 30771 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:30.366341 30771 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:30.366878 30890 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:30.368108 30771 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.262703 30313 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 12:11:30.373036 30961 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:30.355044 30757 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:30.390846 30757 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.391566 30757 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.392361 30807 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:30.369704 26542 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:30.375075 30892 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.380038 30871 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:30.383289 26471 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:30.382905 30902 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:30.393712 30756 consensus_queue.cc:1059] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:11:30.396425 30863 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.396950 30523 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:30.397342 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:30.397951 30942 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.398873 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:30.398085 30892 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:30.402766 27162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 492) took 1162 ms. Trace:
I20260709 12:11:30.285800 30983 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:30.370134 30890 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:30.369632 30897 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:30.393852 30807 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.400538 30961 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.412948 27162 rpcz_store.cc:276] 0709 12:11:29.240521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.240713 (+   192us) service_pool.cc:224] Handling call
0709 12:11:29.241122 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.883757 (+642635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.382172 (+498415us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b540077c754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:30.402510 (+ 20338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1476088704}
I20260709 12:11:30.400954 30871 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:30.430768 30858 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:30.438418 26615 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:30.448693 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:30.455400 26547 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:11:30.456154 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:30.457155 26473 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
W20260709 12:11:30.458319 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 102065us
I20260709 12:11:30.459676 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:30.449565 30858 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:30.465257 30858 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:30.380066 30845 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:11:30.467345 30845 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:30.467686 30897 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.436230 30756 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.471827 30756 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:30.473798 30892 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:30.467778 30845 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:30.478091 26465 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:30.462216 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:30.479465 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 67412.6us
I20260709 12:11:30.533483 26616 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:30.488010 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:30.493486 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48222 (request call id 13) took 2478 ms. Trace:
I20260709 12:11:30.480912 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:30.538035 26613 rpcz_store.cc:276] 0709 12:11:28.015278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.501098 (+485820us) service_pool.cc:224] Handling call
0709 12:11:30.492890 (+1991792us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54000023d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760e0735 00007f507b0a0d29 00007f507461f1d4 00007f507461f162 00007f507461f091 00007f507461f00c 00007f507461e2c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:30.493201 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2788660480}
I20260709 12:11:30.491104 26472 raft_consensus.cc:1217] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Deduplicated request from leader. Original: 6.5->[8.6-13.8]   Dedup: 8.6->[11.7-13.8]
I20260709 12:11:30.456210 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:30.481408 31004 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:30.474332 30756 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:30.476890 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:30.547312 26472 pending_rounds.cc:85] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 6
W20260709 12:11:30.557184 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 95089.7us
I20260709 12:11:30.558827 30523 raft_consensus.cc:2764] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:11:30.486430 30743 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:30.499476 30507 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:30.454807 30902 consensus_queue.cc:1243] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:11:30.564284 26472 pending_rounds.cc:107] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:30.563421 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:30.573863 30857 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:30.495565 30996 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:30.574955 26472 raft_consensus.cc:2889] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:30.564268 31004 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.478514 30838 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.138s
I20260709 12:11:30.478477 31015 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.099s
I20260709 12:11:30.455405 30942 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:30.498117 30845 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:30.588248 31004 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:30.499533 30871 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:30.595568 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:30.647269 26473 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:30.653635 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:30.655865 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:30.656774 26470 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:30.659399 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 182770us
I20260709 12:11:30.647862 30507 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:30.663219 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:30.665160 30983 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.650020 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:30.601094 30660 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:30.676144 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:30.677781 30665 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:30.678053 30963 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:30.681634 26544 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:30.682746 31006 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:30.683171 31016 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:30.683669 31016 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.683595 31006 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:30.685084 27163 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:30.684146 31016 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:30.686626 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 230845us
I20260709 12:11:30.692798 26622 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 13. Current term is 14. Ops: [13.14-13.14]
I20260709 12:11:30.694921 26467 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:11:30.698067 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 103665us
W20260709 12:11:30.697671 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.710438 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:30.698469 30814 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:30.712366 30814 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.712419 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2133) took 3352 ms. Trace:
I20260709 12:11:30.712886 30814 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.714161 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:30.694572 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:30.697824 31005 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.715409 31005 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:30.716918 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60224 (request call id 24) took 2422 ms. Trace:
I20260709 12:11:30.717300 26621 rpcz_store.cc:276] 0709 12:11:28.294359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.311981 (+ 17622us) service_pool.cc:224] Handling call
0709 12:11:30.716483 (+2404502us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54000023d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d4853 00007f507b0a260a 00007f50746287d4 00007f5074628762 00007f5074628691 00007f507462860c 00007f50746278c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:30.716683 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3122559360}
I20260709 12:11:30.717969 31005 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:30.699563 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet ad6ce9ef10d748ecbe957fb8e6de47b0: Illegal state: Replica aaadfdd9ca9f424c91505f9b43876233 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
W20260709 12:11:30.722800 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:30.723058 30994 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.679s	user 0.001s	sys 0.000s
W20260709 12:11:30.723325 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.724045 30799 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:30.617084 30743 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:11:30.724534 30799 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:30.712890 26543 rpcz_store.cc:276] 0709 12:11:27.359604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.844561 (+484957us) service_pool.cc:224] Handling call
0709 12:11:29.024434 (+1179873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.050335 (+ 25901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.702013 (+1651678us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54000b5250. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:30.712204 (+ 10191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2623449472}
I20260709 12:11:30.692497 26465 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:30.728472 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:30.725871 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 65139.9us
W20260709 12:11:30.729063 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.731681 30799 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:30.687373 30871 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.645953 30988 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:30.735355 30756 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:30.697651 30996 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:30.743643 26470 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
W20260709 12:11:30.746205 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.686316 31006 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:30.752112 30743 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:30.692054 30665 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:30.754647 30942 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:30.754833 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:30.761682 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 116640us
I20260709 12:11:30.758721 26540 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:30.758000 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:30.742798 30799 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:30.677008 30983 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 12:11:30.757705 30859 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.769922 30988 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:30.772559 26543 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:30.774030 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:30.775477 26539 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:30.775673 30757 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:30.776721 26544 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:30.778875 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:30.793299 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:30.801234 30665 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:30.802731 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 135315us
I20260709 12:11:30.803860 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:30.804982 30859 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:30.807335 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:30.807832 26514 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:30.798254 27134 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:30.809281 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:30.743239 30961 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:30.828239 30884 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.830626 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:30.829279 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.842139 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:30.843291 26514 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:30.844908 26465 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:30.821367 30660 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:30.840093 26587 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.882s (SENT) [suppressed 19 similar messages]
I20260709 12:11:30.827472 30757 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:30.856233 30992 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.856251 31028 consensus_queue.cc:1059] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:11:30.840479 30665 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:30.842192 30855 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.875519 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:30.876559 27167 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 9: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:30.876917 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:30.875732 26622 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:11:30.879887 26622 pending_rounds.cc:85] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 10
I20260709 12:11:30.880230 26622 pending_rounds.cc:107] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 12:11:30.880544 26622 raft_consensus.cc:2889] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:30.877936 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:30.888551 26614 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:30.889779 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:30.891459 30855 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:30.894542 30992 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:30.904366 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 65378.1us
I20260709 12:11:30.882023 30858 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:30.883541 31028 consensus_queue.cc:1243] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:30.897154 30859 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:30.907418 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 101057us
I20260709 12:11:30.896900 30855 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:30.908018 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:30.913434 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:30.920739 26614 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:30.886144 30814 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:30.918661 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:30.928117 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:30.928514 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:30.920737 31025 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.120s	user 0.002s	sys 0.000s
I20260709 12:11:30.914587 30507 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:30.929070 31029 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.936094 26439 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:30.938722 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:30.925642 30961 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:30.943646 26545 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 14: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:30.927371 30871 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.942021 27167 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:30.944929 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:30.942543 30858 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.940303 30988 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.943698 30983 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:30.976745 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:30.977161 27160 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:30.976788 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:30.979630 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:30.988466 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:31.003163 26620 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:11:30.991586 30992 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:30.992671 31033 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:11:30.993217 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:11:30.995702 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:31.008948 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.996783 26617 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:30.998018 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:11:31.004096 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 59292.9us
I20260709 12:11:31.012377 26539 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 9: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:31.013033 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:31.015820 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:31.018646 26467 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:31.019007 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:31.019791 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:31.020105 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:31.020340 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:31.020677 26619 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:31.021600 30757 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:31.022998 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:31.022609 30757 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:31.023535 30972 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.023931 30757 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.024402 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:31.022333 26619 raft_consensus.cc:1217] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 4.4->[6.5-10.7]   Dedup: 7.6->[10.7-10.7]
I20260709 12:11:31.025318 26619 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: [6.5-10.7]
I20260709 12:11:31.025522 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:31.027078 31032 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:11:31.027504 26464 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: [12.11-13.12]
I20260709 12:11:31.029058 26617 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.029891 30313 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:31.037509 30955 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.038673 30925 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:31.044013 30693 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.050235 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:31.024139 30972 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:30.973608 31006 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:31.001420 30983 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.063601 26467 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:31.071875 30814 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:31.006347 30988 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:31.075562 30988 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:31.023403 31034 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:11:31.024417 30757 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.063544 27160 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 14. (term mismatch)
I20260709 12:11:31.080322 27160 pending_rounds.cc:85] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 13
I20260709 12:11:31.080658 27160 pending_rounds.cc:107] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 13.14
I20260709 12:11:31.080906 27160 raft_consensus.cc:2889] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:31.080776 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:31.081620 26613 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:31.084462 31019 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.393s	user 0.003s	sys 0.000s
I20260709 12:11:31.086752 31005 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:31.065447 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:31.008419 30871 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:30.975490 30996 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:31.066635 30942 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.067899 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:31.094923 26620 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:31.068979 30863 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.643s	user 0.005s	sys 0.007s
I20260709 12:11:31.069773 31006 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:31.046247 30807 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.622s	user 0.006s	sys 0.005s
I20260709 12:11:31.091821 26617 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:11:31.108467 26617 pending_rounds.cc:85] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 11
I20260709 12:11:31.108847 26617 pending_rounds.cc:107] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:11:31.096406 30858 consensus_queue.cc:1059] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:11:31.109109 26617 raft_consensus.cc:2889] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:31.109632 30858 raft_consensus.cc:3055] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:31.109998 30526 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:11:31.092175 27159 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 14: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:31.110074 30858 raft_consensus.cc:740] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:31.098727 26615 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:31.111155 31028 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.111334 30942 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:31.111891 31028 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:31.112265 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:31.113201 26622 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 11 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:11:31.113900 30942 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:31.114158 31028 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:31.049319 30897 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.004s
I20260709 12:11:31.070520 30983 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.114880 30996 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:31.117766 30996 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:31.097563 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:31.120787 30972 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:31.121829 30931 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.122833 30931 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:31.125016 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:31.125290 30931 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:31.127991 30871 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:31.121914 30857 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:11:31.131646 31039 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
W20260709 12:11:31.134874 31024 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.307s	user 0.000s	sys 0.002s
I20260709 12:11:31.142002 30983 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:31.139930 31003 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:31.138018 30858 consensus_queue.cc:260] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:31.140763 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:31.141769 30660 raft_consensus.cc:3055] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:31.088675 31005 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:11:31.144999 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:31.106885 30665 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:31.111351 26439 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:31.121658 30925 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:31.183988 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.152774 30857 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.185485 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:31.186527 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:31.187961 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:31.190025 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:31.190910 31005 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:31.172156 31004 consensus_meta.cc:287] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.007s
W20260709 12:11:31.192262 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:31.225276 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 52180.8us
I20260709 12:11:31.192457 30757 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:31.193737 26467 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:11:31.143468 30863 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:31.195003 30983 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:31.199790 31006 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:31.207305 30858 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.208429 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:31.111434 30756 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:31.210355 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:31.214720 26613 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:11:31.184863 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:31.222110 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 110889us
I20260709 12:11:31.228170 26466 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:31.232264 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:31.233150 30871 consensus_queue.cc:1059] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:31.178576 30660 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:31.235461 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:31.226845 31016 consensus_meta.cc:287] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.004s
I20260709 12:11:31.240188 26470 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 9: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:31.243228 26619 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:31.244556 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:31.266252 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:31.260385 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:31.268873 26464 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:31.238957 30807 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:31.270932 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:31.271549 26471 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:31.270632 26622 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:31.275069 26439 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:31.271808 26472 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:31.238880 30756 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:31.224979 30925 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:31.277045 26620 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:31.230762 31004 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:31.247347 31029 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:31.288512 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 78327.2us
I20260709 12:11:31.289129 26439 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:31.270954 30988 raft_consensus.cc:3055] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:31.266729 31005 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:31.293885 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 453798us
I20260709 12:11:31.274257 30807 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.249586 31016 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:31.296634 30988 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:31.302845 30942 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:31.305328 31020 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.620s	user 0.003s	sys 0.000s
I20260709 12:11:31.308992 31004 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:31.312017 26439 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:31.310125 31028 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:31.313090 26439 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:31.318624 27163 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:31.300915 30807 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.297317 30951 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 12:11:31.316488 31029 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:11:31.328105 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.335777 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:31.337927 30992 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:31.338784 30992 consensus_queue.cc:1243] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:31.340129 30992 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:31.340565 30992 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:31.340310 30896 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:31.341082 30992 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.342978 30756 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:31.344991 30756 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.319530 30743 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:11:31.381513 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 59258.3us
I20260709 12:11:31.330735 31029 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.385478 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:31.385907 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:31.387444 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:31.389005 30680 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:31.355226 30757 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:31.404212 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:31.316648 30931 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 12:11:31.390115 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:31.354558 31028 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:31.350363 30863 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:31.326643 31015 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:11:31.409106 26473 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:31.316998 30660 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:31.395509 31029 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:31.428689 26546 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:31.420207 26541 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:31.438376 26547 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:31.425289 30902 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:31.450699 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:31.427839 30863 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:31.443004 30660 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:31.507509 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.448469 31004 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:31.524993 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 64527.8us
I20260709 12:11:31.455726 30902 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:31.455566 31006 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.419096 30680 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:31.452759 30896 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:11:31.432885 30988 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:31.526916 30989 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:31.537917 30902 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.538144 30931 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.571000 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:31.572319 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:31.572979 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2243) took 1177 ms. Trace:
I20260709 12:11:31.580300 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:31.581589 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:31.585392 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 141695us
I20260709 12:11:31.586282 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:31.588078 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 275047us
I20260709 12:11:31.530660 31004 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:31.518656 31005 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:11:31.568029 31016 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:31.569952 30989 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:31.547524 31051 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:31.602699 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:31.603276 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:31.603487 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:31.603987 27159 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 12:11:31.604326 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:31.586301 31014 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.722s	user 0.003s	sys 0.001s
I20260709 12:11:31.611016 26616 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 13: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:31.571849 30743 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:31.617877 26472 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:31.585398 30996 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:31.591527 30897 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:31.590461 30858 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:31.570484 30942 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:31.608834 30884 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:31.595867 30814 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.580536 26618 rpcz_store.cc:276] 0709 12:11:30.395382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.989326 (+593944us) service_pool.cc:224] Handling call
0709 12:11:30.989736 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:30.990131 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:31.239378 (+249247us) log.cc:844] Serialized 14 byte log entry
0709 12:11:31.569173 (+329795us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:31.569242 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:31.569314 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.569383 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.572885 (+  3502us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22501,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":89,"raft.queue_time_us":6707,"thread_start_us":544812,"threads_started":2}
I20260709 12:11:31.571939 31006 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:31.643308 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.596931 30988 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.646771 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:31.662603 27159 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.662658 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:31.648909 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 62708.2us
I20260709 12:11:31.650555 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:31.651867 27162 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:31.638892 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:31.636482 30897 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.616851 30931 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:31.700714 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:31.609712 30863 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:31.700736 30743 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:31.661166 30992 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:31.734864 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.736146 26469 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:31.706480 30814 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:31.634406 30858 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.660563 30896 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:31.708010 30884 raft_consensus.cc:697] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 9 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:31.707595 30989 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:31.595150 30648 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.235s
I20260709 12:11:31.625321 30799 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.735736 31016 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:31.709019 31052 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 12:11:31.719091 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.738054 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:31.712586 31041 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:31.724334 30897 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:31.748560 31053 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:11:31.749588 26470 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:31.752887 26620 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:31.734640 30507 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:31.711830 26619 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:31.764603 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 225129us
I20260709 12:11:31.741631 30858 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.762022 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:31.783456 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:31.755577 31061 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.768239 31016 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:31.793073 30828 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 12:11:31.824715 31046 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 12:11:31.853497 30991 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.854472 30991 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:31.791723 31028 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:31.850775 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.782764 31051 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:11:31.822198 30672 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:31.859985 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:31.860344 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 91393.1us
W20260709 12:11:31.822953 31050 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:11:31.785295 30507 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:31.858271 30693 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.816668 30896 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:11:31.782347 30799 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:31.823890 30942 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:31.903600 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:11:31.899792 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:31.945153 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.903090 27160 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:31.897513 30510 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:31.952579 27159 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:31.857739 30991 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:31.987023 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 61848.7us
I20260709 12:11:31.871068 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:32.010636 26621 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 13: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:31.827479 30680 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:31.873064 30992 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:31.877782 31056 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 12:11:31.874492 31048 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
W20260709 12:11:31.870293 31062 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:11:31.869527 31071 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:31.919252 31006 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:31.870352 30955 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.820s	user 0.009s	sys 0.004s
I20260709 12:11:31.858793 31041 raft_consensus.cc:697] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:11:31.879598 31049 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.286s	user 0.002s	sys 0.000s
W20260709 12:11:31.875010 31055 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:11:31.869397 30713 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.875711 31067 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:31.870136 31051 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:31.865609 31004 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:31.979529 30857 consensus_meta.cc:287] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.744s	user 0.009s	sys 0.006s
W20260709 12:11:31.988898 30807 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.586s	user 0.014s	sys 0.000s
W20260709 12:11:31.879405 31054 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:11:31.886493 30672 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:31.918737 31028 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:32.015076 31029 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.564s	user 0.012s	sys 0.000s
I20260709 12:11:31.870512 31009 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.035772 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:32.041960 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 318682us
I20260709 12:11:31.913456 30925 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:31.911103 30871 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:31.918516 30892 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:32.003516 30510 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:31.895246 31058 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:31.827859 31061 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:31.908645 30983 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.129s
I20260709 12:11:31.867249 30313 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.173s
I20260709 12:11:32.029810 30991 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:32.067876 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 284505us
I20260709 12:11:32.038480 30693 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.064183 31067 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.850639 30884 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:32.050282 31006 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.016662 30526 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:11:32.081553 26619 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:32.089882 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:32.064361 31051 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:32.073881 30955 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.081573 30814 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.075320 31004 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.190771 31004 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:32.191623 31016 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:32.082654 30672 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.081712 30857 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.162566 30813 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:32.163170 31057 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:11:32.088459 30931 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:32.177059 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 87309.4us
W20260709 12:11:32.175092 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.175643 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 74708.4us
I20260709 12:11:32.078773 30713 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.096658 30892 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:32.186269 31086 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.080828 30807 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:32.199636 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.155377 30871 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:32.168736 31067 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.044382 31071 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.087543 31028 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:32.225446 30660 consensus_meta.cc:287] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.694s	user 0.014s	sys 0.001s
I20260709 12:11:32.188614 30925 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.095026 31029 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.282750 26466 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:11:32.283263 31015 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:32.283861 31029 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.283864 31015 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:32.232034 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 59009.3us
W20260709 12:11:32.211122 30988 consensus_meta.cc:287] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.000s
I20260709 12:11:32.231570 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2036) took 1192 ms. Trace:
I20260709 12:11:32.285974 26468 rpcz_store.cc:276] 0709 12:11:31.024328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.059932 (+ 35604us) service_pool.cc:224] Handling call
0709 12:11:31.087246 (+ 27314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:31.087697 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:31.087748 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:31.088324 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 12:11:31.528677 (+440353us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:31.528742 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.528857 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:32.216194 (+687337us) raft_consensus.cc:1685] finished
0709 12:11:32.216214 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:32.216362 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4589,"raft.queue_time_us":1220,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"thread_start_us":439864,"threads_started":1,"wal-append.queue_time_us":521008}
I20260709 12:11:32.287196 31015 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.075737 31076 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.144s
I20260709 12:11:32.288085 31076 consensus_queue.cc:1243] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:32.289383 31076 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:32.178756 30896 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:11:32.245234 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:32.252072 30807 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.253399 31061 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.180900 31058 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:32.292608 30902 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.684s	user 0.003s	sys 0.007s
I20260709 12:11:32.222834 31004 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:32.293184 31058 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:32.255972 31082 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:11:32.257196 31078 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.294914 31078 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:32.296865 30672 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:32.297330 31078 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.258435 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:32.298046 27159 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:32.298230 26473 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 13: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:11:32.259500 31075 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 12:11:32.262488 30857 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.212132 30813 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.210916 30814 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:32.289973 31076 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:32.235812 30510 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:32.300042 30814 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.097291 31009 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.302080 31076 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:32.302867 31076 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.303340 31076 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.304118 31009 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:32.184037 31006 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.305557 31076 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:32.306504 31006 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.264818 30713 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:32.266304 31086 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.267748 31069 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:11:32.268174 30989 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.308161 30858 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.308858 31086 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.302115 30814 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:32.312434 30756 consensus_meta.cc:287] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.967s	user 0.011s	sys 0.005s
I20260709 12:11:32.268883 30693 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:32.212073 30955 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:32.270326 30799 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.271245 30892 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:32.212281 31041 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:32.272614 31071 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.273604 27163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 496) took 1496 ms. Trace:
I20260709 12:11:32.275084 31028 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.267813 31087 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.325706 27163 rpcz_store.cc:276] 0709 12:11:30.776923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.786789 (+  9866us) service_pool.cc:224] Handling call
0709 12:11:30.822510 (+ 35721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.323749 (+501239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:32.273339 (+949590us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54006cfcd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:32.273545 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140192640}
I20260709 12:11:32.271287 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3040) took 1163 ms. Trace:
I20260709 12:11:32.249773 30897 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.334710 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:32.298941 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:32.336323 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:32.276377 30871 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:32.337725 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:32.174575 30991 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.331723 31087 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.327342 26467 rpcz_store.cc:276] 0709 12:11:31.107938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.108226 (+   288us) service_pool.cc:224] Handling call
0709 12:11:31.119157 (+ 10931us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:31.230246 (+111089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:32.271016 (+1040770us) spinlock_profiling.cc:243] Waited 74.2 ms on lock 0x7b54001fefd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:32.271219 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170715904}
I20260709 12:11:32.332696 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:32.340592 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:32.340783 26471 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:32.337859 31015 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:32.341498 26541 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:32.255986 30845 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.327334 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:32.337812 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:32.350201 26470 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.293219 30902 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.356379 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:32.358590 30858 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.359155 30996 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:32.359628 30996 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:32.360598 30996 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.362043 30996 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.349557 26469 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:32.334712 30897 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.363355 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:32.363555 31087 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.365041 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:32.365734 26468 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:32.366650 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:32.366843 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:32.367493 26468 raft_consensus.cc:2410] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:11:32.370663 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:32.371338 26471 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:32.245142 30992 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.373266 30992 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:32.375976 27162 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:32.377264 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:32.368360 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:32.379839 26468 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:32.381384 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 43710.9us
I20260709 12:11:32.385349 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:32.387212 26513 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:32.393455 26473 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:32.388687 30756 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:32.402730 26464 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:32.412067 26513 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:32.397444 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:32.349895 30814 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.358630 30892 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.420519 26467 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:32.421370 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:32.425979 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:32.427728 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.428309 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.418820 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 355749us
I20260709 12:11:32.431245 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:32.385790 30992 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:32.442212 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:32.409325 30807 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:32.441574 31005 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:32.385535 30799 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:11:32.418457 31071 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.415508 31096 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:32.431773 30897 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:32.392966 30858 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:11:32.437513 30756 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:32.448457 30902 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:32.476814 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:32.481994 26470 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:32.483188 26513 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:32.430357 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:32.463289 31086 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:32.431488 30814 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:32.480075 30863 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.007s	sys 0.024s
I20260709 12:11:32.498494 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:32.470674 30897 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.479023 31096 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.507788 26514 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:32.464964 30988 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:11:32.497104 31086 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.498343 30925 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.465346 30807 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.479233 31071 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:32.515357 31096 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.523442 31083 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:32.477183 31005 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.528345 26542 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:32.527518 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:32.502991 31004 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:32.499758 31029 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:32.495289 30942 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:32.503224 30858 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:32.536125 31091 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.531174 31086 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.538278 30814 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.528182 30991 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:32.540098 31067 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.543845 30807 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.544737 30714 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:32.583007 30714 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.547427 26614 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:32.561528 30955 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:32.550366 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:32.588884 26617 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:32.553335 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:32.589915 26621 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.590750 31067 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:32.506780 30863 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.007s	sys 0.024s
I20260709 12:11:32.594785 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:32.595471 26622 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:32.596498 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:32.511554 30897 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:32.556447 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 126194us
I20260709 12:11:32.507212 31087 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:32.607801 31087 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:32.510877 31079 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:32.610646 31079 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.611123 31079 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.563969 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:32.612000 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 48125.1us
I20260709 12:11:32.536290 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:32.569852 31029 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.570777 30942 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.571579 31005 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.572028 30871 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:32.562845 31004 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:11:32.575184 31064 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.792s	user 0.001s	sys 0.002s
I20260709 12:11:32.560716 31083 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.516136 31097 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:32.587180 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:32.639593 26618 raft_consensus.cc:2410] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:32.595412 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:32.601604 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.595521 30714 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:32.603546 26621 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:32.621152 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:32.529937 30756 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:32.641007 31097 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:32.646889 31097 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:32.651028 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:32.651973 26470 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:11:32.653167 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 116969us
I20260709 12:11:32.616079 31087 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:32.598202 26614 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:32.641654 31005 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:32.701121 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2925) took 1469 ms. Trace:
I20260709 12:11:32.701602 26613 rpcz_store.cc:276] 0709 12:11:31.231964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.244396 (+ 12432us) service_pool.cc:224] Handling call
0709 12:11:31.266445 (+ 22049us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:31.283913 (+ 17468us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:31.302011 (+ 18098us) log.cc:844] Serialized 14 byte log entry
0709 12:11:31.584673 (+282662us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:31.586091 (+  1418us) log.cc:844] Serialized 26 byte log entry
0709 12:11:31.586432 (+   341us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:31.586469 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.586556 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:31.910210 (+323654us) spinlock_profiling.cc:243] Waited 7.86 ms on lock 0x7b48000cded8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507b003aa1 00007f507affab37 00007f507affa9ca 00007f507b0f226f 00007f507b0f1f37 00007f507b10655c 00007f507b106508 00007f507b106488 00007f507b106443 00007f507b1056ec 00007f507a02fa96
0709 12:11:32.700083 (+789873us) spinlock_profiling.cc:243] Waited 8.54 ms on lock 0x7b24002bf178. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072e739c4 00007f5072e71acb 00007f507302cdc9 00007f507302ca55 00007f507302bfb0 00007f5075ca2488 00007f5075ca2be8 00007f5075c7a398 00007f5075c7576a 00007f5075c74bb6
0709 12:11:32.700848 (+   765us) raft_consensus.cc:1685] finished
0709 12:11:32.700874 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:32.701025 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18265,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":3146,"raft.queue_time_us":603,"raft.run_cpu_time_us":2654,"raft.run_wall_time_us":337085,"spinlock_wait_cycles":37719680,"thread_start_us":233565,"threads_started":1,"wal-append.queue_time_us":309022}
I20260709 12:11:32.704617 31071 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:32.697422 31097 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:32.709158 31097 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:32.709296 30510 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.710368 31004 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:32.644436 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:32.716094 30507 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.688648 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:32.637650 30871 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.687332 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:32.723291 26546 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:32.695009 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:32.723616 26617 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:11:32.662237 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.713155 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:32.644848 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:32.724416 26465 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:32.724499 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:32.725345 31105 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:11:32.725432 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:32.728667 30507 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:32.729257 30507 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.729664 30507 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.717363 31004 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.640951 31083 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.620427 30955 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:32.748106 26513 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:32.750232 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:32.751026 26541 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:32.748883 30951 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:11:32.751739 30951 consensus_queue.cc:1243] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:32.752689 31096 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.735379 26514 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:32.730713 31005 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.760571 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3052) took 1182 ms. Trace:
I20260709 12:11:32.761205 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:32.739017 26617 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
W20260709 12:11:32.744419 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.757174 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:32.734592 30871 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.761260 26466 rpcz_store.cc:276] 0709 12:11:31.577756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.578332 (+   576us) service_pool.cc:224] Handling call
0709 12:11:31.598971 (+ 20639us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:32.283206 (+684235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:32.760204 (+476998us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b540006a4d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:32.760484 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1572003584}
I20260709 12:11:32.767619 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:32.642675 31086 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.766068 26465 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:32.772202 26466 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:11:32.827729 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:32.829031 27134 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:32.829176 30996 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.801743 30884 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:32.834884 30884 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:32.835363 30884 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.835261 31016 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.838085 27134 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:32.838974 26468 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:32.760620 30988 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:32.850286 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 115066us
I20260709 12:11:32.851812 26473 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:32.855365 31028 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.856055 31028 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:32.861696 31051 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:32.863281 31051 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.876312 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:32.876555 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:32.826462 31041 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.764974 30955 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:32.880550 26465 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:32.848219 31111 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:11:32.875541 26439 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:32.883278 26514 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:32.885066 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:32.882119 26439 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:32.847290 30648 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:32.892150 26439 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:32.892445 26514 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:32.850096 30988 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.836896 31063 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:11:32.875108 30925 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.903378 31096 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.898849 31071 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:32.903537 30955 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.919037 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:32.905037 30897 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.905567 30672 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:32.906602 31005 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.907186 31086 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.907632 30813 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.910472 30988 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:32.913259 31107 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.278s	user 0.002s	sys 0.000s
I20260709 12:11:32.878530 31029 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.916100 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:32.914041 30857 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:11:32.886554 31028 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:32.876345 30989 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:11:32.924798 26621 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:32.894845 31060 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:32.913280 30828 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 12:11:32.919003 30845 consensus_meta.cc:287] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.529s	user 0.013s	sys 0.000s
I20260709 12:11:32.914577 30814 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.918867 30925 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.920921 26619 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:32.936913 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:32.886415 31041 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:32.935932 30857 consensus_queue.cc:1243] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:11:32.930055 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.951061 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 71531.2us
I20260709 12:11:32.931975 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:32.958633 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:32.959689 31118 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:32.960270 31118 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:32.961449 31118 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:32.942962 31060 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:32.948016 30680 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.970417 31118 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.970043 30680 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:32.971084 31041 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.971432 26622 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:32.975344 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 666) took 1616 ms. Trace:
I20260709 12:11:32.964327 31086 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:32.975875 26620 rpcz_store.cc:276] 0709 12:11:31.359344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.359504 (+   160us) service_pool.cc:224] Handling call
0709 12:11:31.359896 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.771780 (+411884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:32.975068 (+1203288us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b5400033254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:32.975272 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":903202176}
W20260709 12:11:32.979460 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 337846us
I20260709 12:11:32.980775 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:32.981669 31095 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.982594 30693 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.983385 30693 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:32.984835 30925 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:32.984588 31093 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:32.992116 31009 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:32.994354 30897 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:33.005417 31060 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.010010 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:33.010035 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 51494.3us
I20260709 12:11:33.012312 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:33.013324 26467 raft_consensus.cc:2410] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:33.012228 26439 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:33.016197 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:33.016610 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:33.021992 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:33.022748 26617 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:33.028998 26467 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:33.034190 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.035530 26544 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:33.037729 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:33.038487 26544 raft_consensus.cc:2368] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11.
I20260709 12:11:33.038349 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.039776 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.039875 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:33.040051 30863 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:33.040664 26540 raft_consensus.cc:2410] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:33.040546 26547 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.040504 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.043140 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:33.049090 26467 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 14: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:33.050417 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:33.052143 30813 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.052101 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:33.020618 30743 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:33.018373 31095 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.966614 31079 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:33.054332 26466 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:33.072618 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:33.073911 26467 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:11:33.049669 26439 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:33.020503 31003 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.017925 31009 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:11:33.056041 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:33.059785 30743 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.055794 31090 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:11:33.084487 26466 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:33.026342 31086 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:33.026901 31071 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 12 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:33.020560 30931 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:33.063409 26465 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:33.057740 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.062785 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:33.021432 30807 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:11:33.053431 30972 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:33.092669 26539 raft_consensus.cc:2410] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:33.096838 26617 pending_rounds.cc:85] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 5
I20260709 12:11:33.081735 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.097293 26617 pending_rounds.cc:107] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:11:33.097565 26617 raft_consensus.cc:2889] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:33.091037 26466 pending_rounds.cc:85] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 5
I20260709 12:11:33.097994 26466 pending_rounds.cc:107] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:11:33.098279 26466 raft_consensus.cc:2889] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:33.098644 26466 pending_rounds.cc:107] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:33.098874 26466 raft_consensus.cc:2889] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:33.079952 31028 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:33.104403 26543 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 13: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:33.105125 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:33.101372 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:33.085804 30743 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.107786 26545 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 13: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:33.116098 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:33.116943 26539 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 14: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:33.118456 26465 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:33.119206 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.122215 26469 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 12:11:33.100440 31003 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:33.100777 30931 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:33.131716 26464 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:33.123886 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.133031 26543 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:33.126830 26545 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:33.105816 31028 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.145290 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.147516 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.140787 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.148835 26545 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:11:33.151744 26587 leader_election.cc:400] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11.
I20260709 12:11:33.152423 26464 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:33.124312 30855 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.154994 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.106582 31083 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:33.161661 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.157666 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.162835 26539 raft_consensus.cc:2410] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:33.158516 26545 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:33.137174 31028 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.165323 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.170955 26468 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:33.166146 26548 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:33.183143 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.104561 26613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:11:33.186618 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:33.186666 26613 raft_consensus.cc:606] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:11:33.187481 26613 raft_consensus.cc:614] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:33.188174 31079 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:33.189778 30507 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:33.191243 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:33.192260 26473 raft_consensus.cc:2410] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:33.192552 30507 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:33.192835 30884 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:33.188215 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:33.194856 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.194945 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:33.195864 26542 raft_consensus.cc:2410] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:33.196309 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:33.197355 26546 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:33.197558 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:33.198282 31083 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:33.198596 27160 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:33.199501 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:33.193185 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:33.190650 26543 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 12:11:33.200605 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.202554 26546 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:33.205969 26547 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:33.132890 31072 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:11:33.211539 26545 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:33.213604 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:33.214568 26472 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:11:33.214659 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:33.215781 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:33.221669 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.223199 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.216409 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:33.143082 31003 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:33.233718 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:33.237733 26540 raft_consensus.cc:2410] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:11:33.235759 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.238655 26465 raft_consensus.cc:2410] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:11:33.238845 26539 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
W20260709 12:11:33.247853 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 125478us
W20260709 12:11:33.257340 31119 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:11:33.262130 30991 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:33.265022 31095 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:33.266863 30892 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:33.269631 30892 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:33.270939 31095 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:33.271385 31095 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:33.272333 31095 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:33.277959 31093 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:33.279174 30714 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:33.279628 30714 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:33.280511 30714 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:33.281083 31072 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:33.281821 30714 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.288087 31051 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.288930 31051 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:33.291611 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.291728 31060 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:33.293131 31015 consensus_queue.cc:1059] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:33.293991 31060 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:33.294174 30510 raft_consensus.cc:3055] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:33.243804 30931 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:33.295799 31058 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:33.231491 31071 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:33.298496 30871 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:33.298728 31051 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:33.300849 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:33.339190 26617 raft_consensus.cc:2410] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:33.301223 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:33.339855 31058 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:33.340245 27163 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:33.340919 31058 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:33.341401 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:33.342164 26539 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:33.301918 26613 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:33.242750 30743 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:33.303936 31009 consensus_queue.cc:1059] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:33.305200 31003 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:33.307407 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:33.307472 30863 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:33.312175 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.312958 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:33.315704 31028 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:33.319700 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.345989 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:33.347378 30863 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.349117 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.368238 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:33.370995 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:33.374487 27163 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:33.375818 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.376777 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:33.376797 26546 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:33.378057 26616 raft_consensus.cc:2410] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:33.379145 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:33.380146 26473 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.380628 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:33.379159 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.382473 26546 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:33.381940 26543 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:33.342269 31058 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.384400 26541 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 14: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:33.389182 26540 raft_consensus.cc:2410] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:33.389530 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:33.390574 26539 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 14: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:33.331979 30510 raft_consensus.cc:740] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:33.387092 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:33.384493 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.393169 30961 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:33.393618 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.395042 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.395884 26547 raft_consensus.cc:2410] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:11:33.396425 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:33.396696 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.406898 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.405448 26588 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:33.407076 26547 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:33.404184 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.402711 31093 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:33.418982 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.409531 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:33.421341 26547 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 10: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:33.369529 31029 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.422793 26546 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:33.383114 30714 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:33.375581 30672 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:33.404417 31114 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.477s	user 0.005s	sys 0.000s
I20260709 12:11:33.381242 31003 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:33.421227 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.426496 26472 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 10: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:33.426198 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:33.451478 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:33.451812 26622 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:33.427328 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:33.428297 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:33.408717 30961 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:33.410496 30828 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.435927 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:33.418926 26540 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:33.456333 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:33.436134 30845 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:33.439244 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:33.440342 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.390903 30857 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:33.446635 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:33.443406 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:33.455778 30961 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.461680 26539 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 13: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:33.445933 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:33.448657 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:33.449291 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:33.338456 30988 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:33.435825 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:33.449994 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:33.463914 26619 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:33.464321 26620 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:33.453567 26615 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:33.454205 27163 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 10: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:33.457257 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:33.439167 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:33.416005 31051 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:11:33.437310 30756 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.475013 26547 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:33.449504 30884 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:33.460072 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:33.465646 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.470633 26540 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:11:33.476824 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:33.470988 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:33.458618 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:33.487839 26613 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:33.488611 26613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:11:33.489205 26613 raft_consensus.cc:606] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:33.489588 26613 raft_consensus.cc:614] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:33.489327 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:33.458563 31060 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.485345 26540 pending_rounds.cc:85] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 7
I20260709 12:11:33.492296 26618 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:33.495263 26540 pending_rounds.cc:107] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:11:33.492494 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:33.490955 26473 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:33.495937 26616 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.492847 26546 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:33.493994 26544 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:11:33.494176 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:33.494472 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:33.498205 26619 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.498821 26615 raft_consensus.cc:2410] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:11:33.495551 26540 raft_consensus.cc:2889] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:33.499593 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:33.462175 30845 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:33.461784 30961 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.447475 31029 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:33.505096 26620 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:11:33.500610 26613 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:33.452560 30672 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:33.475260 30756 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:33.501669 31060 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:33.521409 30672 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:33.526676 30925 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.528132 30871 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:33.547034 30988 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:33.548295 31060 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:33.548609 31028 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:33.531919 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 92768.9us
I20260709 12:11:33.463552 30510 consensus_queue.cc:260] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:33.552271 30510 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.554170 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:33.569820 31060 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.577427 31072 raft_consensus.cc:3055] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:33.577967 31072 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:33.580159 31029 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:33.475360 30857 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:33.509539 30845 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.592442 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:33.595652 30942 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:33.620281 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:33.620553 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.621080 26613 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:11:33.623879 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:33.626237 26546 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 13: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:33.609607 26619 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:33.544486 30756 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.631613 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:33.631680 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:33.633551 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:33.614950 30510 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.636102 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.641695 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.643361 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:33.632715 30871 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:33.644948 30824 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:33.645515 30824 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.645372 30871 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:33.646003 30824 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:33.648061 30871 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:33.639045 31029 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:33.650863 26366 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39184 (request call id 160) took 16309 ms (client timeout 15000 ms). Trace:
I20260709 12:11:33.654136 30961 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:33.656096 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:33.658049 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:33.662510 26544 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.662575 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:33.663564 31029 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:33.664017 31029 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:33.664408 31029 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.670823 26546 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
W20260709 12:11:33.659377 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.660413 31072 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:33.674582 31079 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.675869 30743 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:33.674731 26616 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
W20260709 12:11:33.679719 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.675489 31079 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:33.683256 26544 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
W20260709 12:11:33.684145 31122 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.475s	user 0.002s	sys 0.000s
I20260709 12:11:33.714684 26540 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
W20260709 12:11:33.651410 26366 rpcz_store.cc:269] 0709 12:11:17.398136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.419336 (+ 21200us) service_pool.cc:224] Handling call
0709 12:11:33.650598 (+16231262us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:25.569636 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:25.582667 (+ 13031us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:25.585169 (+  2502us) write_op.cc:435] Acquired schema lock
0709 12:11:25.587078 (+  1909us) tablet.cc:662] Decoding operations
0709 12:11:25.837804 (+250726us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:25.837912 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:25.837951 (+    39us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:11:25.878720 (+ 40769us) tablet.cc:701] Row locks acquired
0709 12:11:25.878743 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:11:25.878905 (+   162us) write_op.cc:270] Start()
0709 12:11:25.879032 (+   127us) write_op.cc:276] Timestamp: P: 1783599085878860 usec, L: 0
0709 12:11:25.879056 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:11:25.879833 (+   777us) log.cc:844] Serialized 4750 byte log entry
0709 12:11:27.054929 (+1175096us) op_driver.cc:464] REPLICATION: finished
0709 12:11:27.576539 (+521610us) write_op.cc:301] APPLY: starting
0709 12:11:27.595250 (+ 18711us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:28.367294 (+772044us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b1800331600. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5075e190ec 00007f5075e1baf7 00007f5075e1cfb0 00007f5079b311bb 00007f5079b31532 00007f5079b78b93 00007f5079a25de3 00007f5079a256ab 00007f5079a26e77
0709 12:11:28.427848 (+ 60554us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:28.427884 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:28.749978 (+322094us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:28.750257 (+   279us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0709 12:11:28.750310 (+    53us) write_op.cc:312] APPLY: finished
0709 12:11:28.835002 (+ 84692us) log.cc:844] Serialized 113 byte log entry
0709 12:11:29.077678 (+242676us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:29.077917 (+   239us) write_op.cc:454] Released schema lock
0709 12:11:29.084209 (+  6292us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:29.165502 (+ 81293us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:29.216301 (+ 50799us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2618061,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":445032,"apply.run_cpu_time_us":35840,"apply.run_wall_time_us":1584445,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54239,"num_ops":12,"prepare.queue_time_us":522247,"prepare.run_cpu_time_us":27266,"prepare.run_wall_time_us":729237,"raft.queue_time_us":242885,"raft.run_cpu_time_us":30836,"raft.run_wall_time_us":490623,"replication_time_us":1120647,"spinlock_wait_cycles":42533760,"thread_start_us":1468071,"threads_started":5,"wal-append.queue_time_us":886522,"wal-append.run_cpu_time_us":20200,"wal-append.run_wall_time_us":2357132}]]}
I20260709 12:11:33.721079 30845 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:33.717329 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:33.729839 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:33.718379 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:33.735931 31095 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.736634 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:33.737740 26613 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:33.739470 26514 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:33.742925 26514 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:33.743119 30988 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.743974 30955 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.730590 27162 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:33.748168 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:33.750180 26588 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:33.754190 26371 catalog_manager.cc:5697] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:33.759477 31029 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:33.761308 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.754244 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:33.763852 26514 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:33.764324 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:33.768087 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:33.770871 30925 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:33.771131 26616 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:33.771524 30925 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:33.771802 31028 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:33.772159 30925 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.775480 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:33.775873 30871 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:33.776293 26618 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.776876 30693 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:33.778314 31029 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:33.770227 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:33.722182 30680 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:33.780651 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:33.784435 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:33.782799 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:33.785166 26619 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.785398 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:33.758328 26371 catalog_manager.cc:5697] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:11:33.787426 31029 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.789527 26617 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:33.717325 31079 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:33.786974 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:33.792965 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:33.775508 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:33.749936 31060 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.686587 30510 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:33.783262 31094 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:33.723663 31072 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.812652 30942 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.814631 31079 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:33.820703 30756 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:33.821262 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:33.823377 31120 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:33.829631 26514 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:33.826155 30988 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:33.793884 30693 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:33.797019 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:33.803751 30991 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:33.852283 26618 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:33.863469 26619 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:33.810599 30961 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:33.831826 30857 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:33.826357 30824 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:33.854889 31094 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.880028 26371 catalog_manager.cc:5697] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 6 to 8, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 8 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:33.807751 30896 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:11:33.884280 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:11:33.889442 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 92499.8us
I20260709 12:11:33.899634 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:33.903086 26470 raft_consensus.cc:2410] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:33.867429 30845 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:33.902171 30680 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:33.901182 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:33.901928 30672 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:11:33.909400 31003 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.912552 31003 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:33.915486 30896 consensus_queue.cc:1243] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:33.915287 31004 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:33.915812 31078 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:33.916111 30896 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:33.916282 31078 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:33.916498 30896 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:33.916602 30510 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:33.917305 31079 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:33.917966 31079 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.917423 30896 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:33.909668 30828 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.904161 31094 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.919176 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:33.918411 31079 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.898156 30988 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:33.934728 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:33.915339 31003 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.923920 31028 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:33.941118 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:33.927160 30828 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:33.944970 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:33.940289 30680 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:33.957362 30863 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.005s
I20260709 12:11:33.958209 30824 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:33.957927 30863 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:33.924126 30925 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:33.939885 30693 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:33.947854 30991 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.980526 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:34.020232 26614 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:33.959506 30871 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:33.999905 30863 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:33.981071 30680 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:33.948091 30845 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
W20260709 12:11:34.034276 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 248954us
W20260709 12:11:34.036621 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.944532 30961 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:11:34.047472 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:34.023521 30693 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:33.960614 30896 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.052847 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:33.955132 31083 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:34.055668 31083 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:34.056406 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:34.056725 31083 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:34.062680 30756 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:34.067124 30693 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:34.067909 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 238341us
I20260709 12:11:34.069281 26514 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:34.064587 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:34.064834 26619 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:34.032433 31029 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:34.063113 31120 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:34.071554 31158 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:34.072412 30824 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:34.051285 30845 consensus_queue.cc:1243] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:34.073588 26514 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:34.065351 31060 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:34.080046 30665 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:34.080570 30665 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:11:34.081774 31143 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:11:34.081436 30665 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:34.083297 30680 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:34.083793 30680 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:34.087392 30680 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:34.089119 30680 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.089689 30863 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.094218 30989 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.094642 31029 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:34.096477 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:34.102574 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 255191us
I20260709 12:11:34.123016 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:34.137401 26614 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:11:34.139199 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:34.139243 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:34.144707 31140 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.496s	user 0.006s	sys 0.004s
I20260709 12:11:34.141083 30896 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.146948 30896 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:34.150745 30855 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:34.150784 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:34.151429 30855 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:34.151700 27159 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:34.152465 30855 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:34.153133 26588 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:34.153528 30855 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.154057 30845 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:34.154520 30845 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.154896 30845 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.155601 31003 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:34.157827 31003 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:34.140323 30925 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:34.162989 31069 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:34.163573 31069 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 15 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:34.164491 31069 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:34.167923 30845 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:34.168357 31078 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:34.123349 31120 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:11:34.130204 30942 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:34.170910 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet fc3ac2eaa71249dc96238b05adbd6b9b: Illegal state: Replica aaadfdd9ca9f424c91505f9b43876233 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:11:34.174247 31078 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:34.174559 30991 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:34.174976 30991 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:34.175854 30991 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:34.177016 30991 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:34.171203 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:34.180101 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:34.133886 31143 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.051s	user 0.002s	sys 0.001s
I20260709 12:11:34.193948 27162 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:34.135234 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:34.195894 26588 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:34.196071 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 60964.8us
I20260709 12:11:34.197058 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:34.209481 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.213191 30942 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:34.219218 30942 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.219650 30942 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.187487 30896 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:34.222097 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.212651 31003 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:34.216008 31120 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:34.233798 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:34.236517 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:34.217859 30961 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:34.221312 30988 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:34.257414 26471 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:34.257586 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:34.258248 26473 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.228279 31058 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.238535 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:34.237843 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 277171us
I20260709 12:11:34.261207 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:34.261399 26467 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.259407 31120 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:11:34.259821 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 140815us
I20260709 12:11:34.261897 26465 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:34.264401 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:34.265353 26618 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 12: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:34.266029 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:34.266844 26468 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:34.267642 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:34.271185 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:34.272483 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.275349 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:34.235054 31003 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:34.281499 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:34.282362 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 2062) took 1239 ms. Trace:
I20260709 12:11:34.239771 30828 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:34.282693 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:34.290117 26541 rpcz_store.cc:276] 0709 12:11:33.033021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.033206 (+   185us) service_pool.cc:224] Handling call
0709 12:11:34.272216 (+1239010us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54002f80d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:34.272376 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":784938240}
I20260709 12:11:34.293820 26471 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:34.295998 26473 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:34.296736 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:34.299703 31156 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.302887 31120 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:34.307828 31162 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:34.308730 26615 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:34.309343 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:34.354701 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:34.355355 26617 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.311053 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:34.356338 26616 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:34.357225 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:34.357674 26616 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:34.291888 30955 consensus_meta.cc:287] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.547s	user 0.013s	sys 0.000s
I20260709 12:11:34.313588 30989 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:34.316219 30845 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:34.377105 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:34.377830 27159 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.291240 30902 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 12:11:34.318593 31095 consensus_meta.cc:287] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.004s
I20260709 12:11:34.318882 31003 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:34.272184 31058 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:34.402742 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:34.403666 26469 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:34.405102 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:34.405910 26469 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:34.406832 30902 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:34.407299 30902 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:34.408180 30902 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:34.409471 30902 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.320446 31079 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:34.411108 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:34.412056 27163 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:34.369100 30863 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:34.297570 30665 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:34.260689 30961 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:34.323997 31154 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:34.313748 31094 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:34.333552 31083 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:34.339422 26467 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:34.386664 31078 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.358662 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:34.360015 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.361701 26465 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:34.434942 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:34.435639 26465 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
W20260709 12:11:34.436472 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 77913.9us
I20260709 12:11:34.391683 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:34.321337 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:34.437999 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:34.438648 27162 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.438848 26547 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:34.393126 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:11:34.441442 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 48417.7us
I20260709 12:11:34.413714 26621 raft_consensus.cc:2410] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:34.351951 31155 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:34.416173 26468 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:34.367017 30988 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:34.455868 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:34.419785 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:34.402199 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:34.419842 26616 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:34.366448 30857 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:34.378381 30955 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:34.429817 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:34.350569 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53946.2us
I20260709 12:11:34.426038 31158 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:34.391506 30807 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:34.412559 31079 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:34.454838 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:34.472748 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:34.473686 26543 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:34.447485 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:34.469548 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:34.475822 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:34.476679 26467 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:34.476644 26616 raft_consensus.cc:2368] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12.
I20260709 12:11:34.479172 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:34.479960 26616 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:11:34.484952 26617 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:34.489151 27159 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:34.371122 31156 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:34.447840 31162 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:34.455026 31051 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:34.496325 26439 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:34.509768 31158 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:11:34.500260 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 226132us
I20260709 12:11:34.501330 27162 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
W20260709 12:11:34.503407 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet c4646c5ce9a9467da50e9f3587b11ad5: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:11:34.517180 26588 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:34.519184 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:34.519517 26466 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:34.520195 26473 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:34.435163 30665 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:34.448040 31078 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:34.526470 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.498134 30989 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:34.508992 26439 leader_election.cc:400] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12.
I20260709 12:11:34.551468 26439 leader_election.cc:403] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:34.534543 26467 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:11:34.524132 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:34.548921 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:34.514899 30931 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:34.553611 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44752.8us
I20260709 12:11:34.557721 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:34.563519 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:34.564263 26467 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:34.495774 30857 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:34.581401 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.524987 31058 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:34.591910 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:34.560552 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:34.573312 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:34.496045 30807 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:34.545110 31165 raft_consensus.cc:3055] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:34.525391 31051 raft_consensus.cc:697] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:34.516611 30660 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:11:34.561236 31071 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.544907 31159 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:34.498631 31155 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:34.600937 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:34.613837 26614 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 15: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:34.601586 26542 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:34.568209 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:34.615630 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:34.616516 26539 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:34.617412 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:34.618466 26543 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 13: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:34.567260 30845 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:34.589459 30955 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:34.610968 31029 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:34.600545 31165 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:34.562433 30989 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:34.620769 30714 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.613183 31168 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:34.676412 26467 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:34.684352 26616 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:11:34.687218 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 242198us
I20260709 12:11:34.689116 26439 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:34.694195 26514 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:34.709319 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:34.714519 26616 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:11:34.653337 31029 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:11:34.690668 31160 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
W20260709 12:11:34.726805 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 264070us
I20260709 12:11:34.740710 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:34.742595 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:34.650154 30955 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:34.655794 30714 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:34.711057 30961 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:34.713613 31162 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:34.721974 31118 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:34.721036 31094 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:34.722065 31170 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:34.739475 30988 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:34.691494 31168 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:34.763235 31118 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.758420 31156 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:34.815939 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 2948) took 1211 ms. Trace:
W20260709 12:11:34.804215 30942 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.584s	user 0.012s	sys 0.000s
I20260709 12:11:34.787390 30665 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:34.726976 31051 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:34.810294 31078 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:34.808918 31179 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:34.819164 31118 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:34.854511 26622 rpcz_store.cc:276] 0709 12:11:33.604936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.605081 (+   145us) service_pool.cc:224] Handling call
0709 12:11:33.605381 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.605590 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:33.626332 (+ 20742us) log.cc:844] Serialized 14 byte log entry
0709 12:11:34.327198 (+700866us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b1800384e80. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a23a 00007f50760e4a2a
0709 12:11:34.807652 (+480454us) log.cc:844] Serialized 14 byte log entry
0709 12:11:34.815364 (+  7712us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:34.815449 (+    85us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:34.815534 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.815652 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:34.815838 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25866,"prepare.queue_time_us":20663,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":4990,"raft.queue_time_us":67195,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":10617,"spinlock_wait_cycles":4956032,"thread_start_us":456040,"threads_started":2,"wal-append.queue_time_us":1133060}
W20260709 12:11:34.862022 31169 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.262s	user 0.002s	sys 0.000s
I20260709 12:11:34.822157 31159 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:34.865891 31164 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 12:11:34.762737 31162 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:34.895363 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 415453us
I20260709 12:11:34.756306 31165 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:34.877942 30988 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:34.938879 30714 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:34.941201 31173 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:11:34.878312 30857 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:34.877635 31078 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:34.886548 31166 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.265s	user 0.001s	sys 0.001s
I20260709 12:11:34.817276 31029 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:34.861339 30942 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:34.899711 31161 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.260s	user 0.002s	sys 0.000s
I20260709 12:11:34.946161 30989 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:35.012734 31194 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:11:34.897747 30807 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:34.897310 31179 raft_consensus.cc:697] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:34.896960 30863 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:11:35.092451 31180 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
W20260709 12:11:35.093079 31177 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:11:35.092653 31179 consensus_queue.cc:237] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:35.095150 30855 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.941s	user 0.007s	sys 0.009s
I20260709 12:11:35.054536 31058 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:35.097703 31159 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:35.099182 31191 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:11:35.092124 31187 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:35.102751 26547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.000s	sys 0.017s
I20260709 12:11:35.105212 26470 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:11:35.103892 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 361386us
I20260709 12:11:35.079989 31165 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:35.108057 30902 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.698s	user 0.015s	sys 0.001s
W20260709 12:11:35.107647 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 388062us
I20260709 12:11:35.066264 31170 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:11:35.119043 31172 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.353s	user 0.000s	sys 0.001s
I20260709 12:11:35.176117 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:35.134198 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:35.183244 26615 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:35.185371 26615 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:11:35.163558 26547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.011s	sys 0.022s
W20260709 12:11:35.140828 26539 consensus_meta.cc:287] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.516s	user 0.012s	sys 0.000s
I20260709 12:11:35.187633 26539 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:35.188498 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:35.189903 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:35.191092 26619 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:35.106776 31063 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:35.118589 31058 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.161952 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:35.216065 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 54209us
I20260709 12:11:35.197424 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:35.197593 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.217805 26614 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:11:35.224149 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:35.221691 30672 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.227735 30672 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:35.181301 30807 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:35.230093 30672 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:35.254349 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:35.123409 26587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.019s	sys 0.009s
I20260709 12:11:35.174801 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:35.103960 30863 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:35.260170 30863 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:35.261068 30863 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:35.123776 30955 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:35.168041 31187 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.262440 31003 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.262825 31187 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.263073 31003 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:35.265910 31003 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:35.268018 30955 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:35.269248 30955 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:35.273324 26587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.027s	sys 0.013s
W20260709 12:11:35.274520 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 658601us
I20260709 12:11:35.281183 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:35.216444 31028 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:11:35.232864 31072 consensus_meta.cc:287] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.360s	user 0.013s	sys 0.004s
W20260709 12:11:35.284584 26586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.019s	sys 0.040s
W20260709 12:11:35.292831 26586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.019s	sys 0.040s
W20260709 12:11:35.317724 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:35.318439 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:35.319034 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.320413 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:35.322386 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:35.322685 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:35.324751 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.324817 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:35.325435 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:35.326058 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:35.326252 26619 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.322116 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:35.327108 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:35.329054 27168 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
W20260709 12:11:35.330708 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 388051us
I20260709 12:11:35.295382 31168 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:35.294658 31028 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:35.335799 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 167545us
I20260709 12:11:35.335337 26513 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:35.262064 30863 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:11:35.341807 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:35.312278 31189 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:11:35.343755 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 6d235a62666644668508e208ad8d21d3: Illegal state: Replica aaadfdd9ca9f424c91505f9b43876233 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:11:35.343806 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:35.224628 31063 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.312240 31202 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:35.345242 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:35.282405 30807 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:35.362360 27165 raft_consensus.cc:2393] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 11: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:35.363430 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:35.364472 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:35.312234 31188 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:35.366057 26620 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:35.329715 31072 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:35.367842 30714 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:35.374716 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:35.344394 31201 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.370306 26513 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:35.347772 31168 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.386114 26539 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:35.386857 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:35.386888 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:35.390018 26514 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:35.391939 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:35.394310 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:35.380221 31184 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:35.397166 27162 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:35.400532 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:35.408696 26619 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:35.411027 26614 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:35.378829 30942 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:35.387733 31158 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:35.427376 31058 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:35.450465 30756 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:35.385124 31072 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:35.385437 30988 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:11:35.414291 30857 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:35.414139 31083 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.979s	user 0.014s	sys 0.000s
I20260709 12:11:35.374099 31202 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.312752 31170 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:35.465556 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 01f2ec42332f4afd97d2dbfac0d5ee00: Illegal state: Replica aaadfdd9ca9f424c91505f9b43876233 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:11:35.454068 31214 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:35.455284 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 174199us
I20260709 12:11:35.399561 31168 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.405491 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:35.422461 30989 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:35.409996 30855 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:35.528139 26616 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:35.480618 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 287379us
I20260709 12:11:35.459758 31063 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:35.460506 30955 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:35.458447 31195 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:35.454140 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2069) took 1116 ms. Trace:
I20260709 12:11:35.397855 31201 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:35.516933 30942 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.481724 31004 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:35.489773 30756 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:35.540570 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:35.536363 31118 consensus_meta.cc:287] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.639s	user 0.014s	sys 0.000s
W20260709 12:11:35.538067 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 150688us
I20260709 12:11:35.484525 31200 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.544534 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:35.577822 26619 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:35.546192 26614 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:35.581174 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:35.544406 26473 rpcz_store.cc:276] 0709 12:11:34.337555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.365479 (+ 27924us) service_pool.cc:224] Handling call
0709 12:11:34.519979 (+154500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:34.520562 (+   583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.453896 (+933334us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54001c1e50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:35.454071 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354134400}
I20260709 12:11:35.517597 31058 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:35.495296 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 103468us
I20260709 12:11:35.483705 30871 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:35.555895 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:35.600716 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44921.5us
I20260709 12:11:35.600903 26544 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:35.605731 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:35.557703 26622 raft_consensus.cc:2393] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:35.536636 31158 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:35.559047 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:35.539033 30855 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:35.559768 27165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:57562
I20260709 12:11:35.560410 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:35.561491 31168 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:35.557389 31214 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:35.524442 31155 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:35.570425 31223 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.571878 30756 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.554821 31004 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:35.572815 30807 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:35.557180 30942 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.552140 31195 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:35.542541 30857 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:35.547056 31220 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.542536 31083 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:35.582991 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 188790us
I20260709 12:11:35.576566 31118 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.584219 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:35.587152 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 214391us
I20260709 12:11:35.597661 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 2936) took 2152 ms. Trace:
I20260709 12:11:35.535600 31219 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:35.486572 31184 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:35.603052 31071 consensus_meta.cc:287] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.989s	user 0.015s	sys 0.000s
I20260709 12:11:35.751238 31071 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12.
I20260709 12:11:35.572779 31187 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:35.752012 31184 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:35.752461 27163 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:35.589150 31058 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:35.594813 30988 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.671360 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:35.642590 30902 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.629638 30896 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:35.679507 31201 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:35.682288 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2281) took 1375 ms. Trace:
I20260709 12:11:35.757318 26467 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:35.734161 31214 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 11 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:35.596306 31200 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:35.697211 31215 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.706732 31208 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.706954 30714 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:35.706310 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 100638us
I20260709 12:11:35.716511 26613 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:35.699689 30991 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.767710 31213 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.768810 30991 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.769098 31213 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.728909 31223 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.607966 31210 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 12:11:35.597170 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:35.720032 27165 raft_consensus.cc:606] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:11:35.720309 27160 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:35.778119 27165 raft_consensus.cc:614] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:35.725726 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:35.778816 26468 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:35.779723 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:35.727499 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:35.731446 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:35.780584 26466 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:35.735848 26472 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:35.736496 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:35.737486 30756 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.728991 31004 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:35.743975 30855 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:35.745927 26621 rpcz_store.cc:276] 0709 12:11:33.432858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.433277 (+   419us) service_pool.cc:224] Handling call
0709 12:11:35.584533 (+2151256us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b540003be54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:35.584687 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2189771136}
I20260709 12:11:35.746222 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:35.744614 31083 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:35.750751 31197 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.350s	user 0.005s	sys 0.000s
I20260709 12:11:35.734586 31078 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:35.757532 26618 rpcz_store.cc:276] 0709 12:11:34.307261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.309087 (+  1826us) service_pool.cc:224] Handling call
0709 12:11:35.179520 (+870433us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5800049298. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:11:35.179780 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:35.180211 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:35.180239 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:35.192907 (+ 12668us) log.cc:844] Serialized 26 byte log entry
0709 12:11:35.350720 (+157813us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:35.350763 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.350845 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:35.681896 (+331051us) raft_consensus.cc:1685] finished
0709 12:11:35.681922 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:35.682194 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5252,"raft.queue_time_us":2804,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":20365,"spinlock_wait_cycles":28742912,"thread_start_us":62780,"threads_started":1,"wal-append.queue_time_us":377113}
I20260709 12:11:35.632587 31072 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:35.760000 30902 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.796938 30902 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:35.771104 31208 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.798207 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2216) took 1357 ms. Trace:
I20260709 12:11:35.788425 31083 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:35.798650 26619 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:35.767894 31215 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:35.801267 31215 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:35.762650 30988 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.802526 26546 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:35.771005 30991 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:35.761096 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:35.760841 31028 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.756349 31058 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:35.774375 31202 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:35.765656 30896 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:35.811848 30896 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.747973 30857 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:35.816085 26471 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:35.816310 30857 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:35.798658 26545 rpcz_store.cc:276] 0709 12:11:34.440645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.441488 (+   843us) service_pool.cc:224] Handling call
0709 12:11:34.460806 (+ 19318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:34.461117 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:34.461154 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:34.498435 (+ 37281us) log.cc:844] Serialized 26 byte log entry
0709 12:11:34.789362 (+290927us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:34.863796 (+ 74434us) log.cc:844] Serialized 14 byte log entry
0709 12:11:34.864260 (+   464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.864386 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:35.762604 (+898218us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b18004888c0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:11:35.797880 (+ 35276us) raft_consensus.cc:1685] finished
0709 12:11:35.797986 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:35.798122 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14720,"prepare.queue_time_us":87266,"prepare.run_cpu_time_us":200,"prepare.run_wall_time_us":201,"raft.queue_time_us":317760,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":14256,"spinlock_wait_cycles":53890944,"thread_start_us":267223,"threads_started":1,"wal-append.queue_time_us":664495}
I20260709 12:11:35.720082 30871 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.782549 31095 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.790668 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:35.791021 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:35.780669 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:35.792603 31078 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:35.794257 30942 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:35.795032 31207 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.332s	user 0.002s	sys 0.003s
I20260709 12:11:35.749550 31220 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.760375 31195 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:35.816219 26620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 684) took 2198 ms (client timeout 1528 ms). Trace:
W20260709 12:11:35.826501 26620 rpcz_store.cc:269] 0709 12:11:33.617999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.619308 (+  1309us) service_pool.cc:224] Handling call
0709 12:11:35.816037 (+2196729us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b5400269154. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:35.816145 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3830712064}
I20260709 12:11:35.819108 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 642) took 1444 ms. Trace:
I20260709 12:11:35.821226 26473 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:35.821923 26544 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.792765 31118 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:35.823134 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:35.823364 26464 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:35.787798 31213 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:35.829248 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:35.829867 26464 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:35.787173 31228 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:35.827579 26465 rpcz_store.cc:276] 0709 12:11:34.375077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.443477 (+ 68400us) service_pool.cc:224] Handling call
0709 12:11:34.443722 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:34.623007 (+179285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:34.623056 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:34.623118 (+    62us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:34.623168 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.818827 (+1195659us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b540027b0d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:35.818874 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:35.819039 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411706240}
I20260709 12:11:35.833482 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:35.834153 26473 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:35.816264 31223 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:35.835706 26470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 3079) took 1596 ms (client timeout 1972 ms). Trace:
I20260709 12:11:35.837340 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:35.837276 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:35.837827 26470 rpcz_store.cc:269] 0709 12:11:34.235713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.236149 (+   436us) service_pool.cc:224] Handling call
0709 12:11:35.831452 (+1595303us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b54002dbc54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:35.831574 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1994960640}
I20260709 12:11:35.838173 26545 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:35.822588 31095 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.838605 26542 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:11:35.826108 30991 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:35.839376 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:35.842108 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:35.845980 26544 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:35.845357 26464 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:35.828359 31214 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.845749 31200 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:35.848668 31199 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.566s	user 0.002s	sys 0.003s
I20260709 12:11:35.847486 26464 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:35.843065 26545 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:35.853345 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:35.847146 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:35.855769 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:35.854179 26545 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:35.857620 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:35.852051 26464 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:35.859934 26464 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.860170 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:35.860803 26544 raft_consensus.cc:2410] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:11:35.861392 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:35.842263 30988 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:35.862051 26542 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.845208 30991 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.863117 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:35.887774 26470 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:35.864774 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:35.866663 31004 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.874615 31162 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:35.876617 31078 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:35.881440 26546 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:11:35.896549 26546 pending_rounds.cc:85] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 8
I20260709 12:11:35.896847 26546 pending_rounds.cc:107] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:11:35.897107 26546 raft_consensus.cc:2889] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:35.897446 31004 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:35.862828 31195 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:35.862965 31171 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:35.900599 31220 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:35.901808 31208 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:35.898278 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:35.900748 31195 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:35.902828 26546 raft_consensus.cc:2376] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11. Re-sending same reply.
I20260709 12:11:35.902948 31195 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.905082 31187 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:35.905447 31230 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 12:11:35.908201 31232 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:11:35.847090 31213 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:35.909629 31213 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.910074 31213 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.900650 31171 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:35.911145 31171 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:35.902339 31198 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.347s	user 0.001s	sys 0.002s
I20260709 12:11:35.921496 26541 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:35.921662 26542 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:35.925846 26546 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:11:35.898681 30991 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:35.916683 31072 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.931241 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:35.944612 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:35.945292 26615 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:35.935250 26545 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:35.940610 26464 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:11:35.926371 26546 pending_rounds.cc:85] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 5
I20260709 12:11:35.947592 26546 pending_rounds.cc:107] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:11:35.948016 26546 raft_consensus.cc:2889] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:35.917578 30855 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.948740 26464 pending_rounds.cc:85] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 9
I20260709 12:11:35.950585 26464 pending_rounds.cc:107] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:11:35.951025 26464 raft_consensus.cc:2889] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:35.949743 31208 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:35.953778 31208 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.954162 31208 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.955327 31193 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:11:35.936800 30892 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.941905 30714 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.966355 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:35.967954 26613 raft_consensus.cc:2376] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11. Re-sending same reply.
I20260709 12:11:35.948787 31072 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:35.969480 31051 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.009s	sys 0.011s
I20260709 12:11:35.979211 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:35.980670 26587 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:35.957217 30855 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.982347 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:35.981153 26613 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:35.983364 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:35.960417 30892 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:35.986230 26621 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:35.961373 30714 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:35.989760 31206 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.527s	user 0.009s	sys 0.000s
W20260709 12:11:35.981720 31051 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.010s	sys 0.011s
I20260709 12:11:35.991349 30714 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:35.982280 31193 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:35.989197 31072 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:35.997740 30855 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:35.983143 30871 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:35.984150 31060 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.002821 31072 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:36.003369 30855 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.003294 31083 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:36.004014 30714 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:36.004845 31240 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:35.994613 31193 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:36.028683 31058 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:36.031353 30892 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:36.032272 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2214) took 1592 ms. Trace:
I20260709 12:11:36.012135 31060 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:36.034611 31208 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:36.037636 31239 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.042716 31240 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:36.058710 31239 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.059305 31240 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:36.061707 31239 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:36.012709 31072 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.062678 31072 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:36.063474 31212 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.610s	user 0.001s	sys 0.008s
I20260709 12:11:36.065222 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2217) took 1624 ms. Trace:
I20260709 12:11:36.066002 31058 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:36.075525 31028 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:36.076341 31083 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:36.065626 26540 rpcz_store.cc:276] 0709 12:11:34.440927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.442317 (+  1390us) service_pool.cc:224] Handling call
0709 12:11:34.442615 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:34.442923 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:34.754556 (+311633us) log.cc:844] Serialized 14 byte log entry
0709 12:11:35.314016 (+559460us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:35.314560 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 12:11:35.314715 (+   155us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:35.314759 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.314842 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:36.062902 (+748060us) spinlock_profiling.cc:243] Waited 75.7 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:36.064909 (+  2007us) raft_consensus.cc:1685] finished
0709 12:11:36.065021 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.065154 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5289,"prepare.queue_time_us":51762,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":5609,"raft.queue_time_us":160051,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":213,"spinlock_wait_cycles":174171008,"thread_start_us":832063,"threads_started":3,"wal-append.queue_time_us":645155}
W20260709 12:11:36.082604 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 485482us
I20260709 12:11:36.083616 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:36.085193 26514 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:36.052733 26548 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:36.086488 30665 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:36.087138 30988 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:36.087195 30665 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:36.087877 30988 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:36.088039 30665 consensus_queue.cc:1243] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:11:36.054620 31216 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.627s	user 0.002s	sys 0.005s
I20260709 12:11:36.088874 30988 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.092365 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:36.093007 31214 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:36.093351 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:36.093595 31214 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.086102 31202 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.099177 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:36.101155 31208 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:36.101537 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:36.041618 30855 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.102224 27167 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.103745 30855 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:36.103874 31028 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:36.104514 31028 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:36.106490 31060 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:36.106910 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:36.107177 31060 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.107569 26473 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:11:36.108124 26465 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:36.046710 31193 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.108927 31184 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:36.109436 31193 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.101145 31187 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:11:36.107288 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:36.094920 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:36.111598 26621 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
W20260709 12:11:36.095822 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.093055 26467 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:36.096058 31214 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:36.098569 31204 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:36.106593 31051 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:36.113967 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:36.094151 26464 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:36.117015 31028 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:36.095855 26466 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:36.107725 31060 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:36.117776 26467 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:36.096108 31170 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:36.117034 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:36.118590 31170 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.042050 30714 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.119622 30714 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.119764 31060 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:36.121021 31095 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:36.120963 31170 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:36.114002 31051 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:36.048643 26547 rpcz_store.cc:276] 0709 12:11:34.440088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.440215 (+   127us) service_pool.cc:224] Handling call
0709 12:11:34.440569 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:34.440964 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:34.441009 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:34.455517 (+ 14508us) log.cc:844] Serialized 26 byte log entry
0709 12:11:35.203620 (+748103us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:35.272591 (+ 68971us) log.cc:844] Serialized 14 byte log entry
0709 12:11:35.272822 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.272913 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:35.989071 (+716158us) spinlock_profiling.cc:243] Waited 56.1 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:36.013211 (+ 24140us) raft_consensus.cc:1685] finished
0709 12:11:36.031957 (+ 18746us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.032180 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8540,"prepare.queue_time_us":70367,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":154431,"raft.run_cpu_time_us":426,"raft.run_wall_time_us":40340,"spinlock_wait_cycles":129011968,"thread_start_us":688846,"threads_started":1,"wal-append.queue_time_us":966430}
I20260709 12:11:36.123208 31051 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:36.125619 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:36.062196 31218 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.633s	user 0.000s	sys 0.006s
I20260709 12:11:36.127156 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:36.128070 26466 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:36.130975 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:36.116268 31156 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:36.133078 31156 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:36.132899 30991 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.134286 31156 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.136165 31156 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.137435 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:36.115617 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:36.138846 26465 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:36.112895 31179 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:36.139650 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:36.139998 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:36.140115 31179 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.142048 27160 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:36.121948 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2296) took 1648 ms. Trace:
I20260709 12:11:36.138168 27162 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:36.142597 26616 rpcz_store.cc:276] 0709 12:11:34.473798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.722078 (+248280us) service_pool.cc:224] Handling call
0709 12:11:34.722481 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:35.528770 (+806289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.121710 (+592940us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b540009f1d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:36.121886 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1852307840}
I20260709 12:11:36.115677 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:36.144274 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:36.144641 26473 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.146569 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:36.147972 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:36.148653 27160 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
W20260709 12:11:36.153260 26513 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.972s (SENT) [suppressed 12 similar messages]
I20260709 12:11:36.157356 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:36.053963 31171 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:36.159008 26613 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:36.157361 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:36.160105 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:36.161151 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:36.161976 26617 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:11:36.158799 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:36.162966 26614 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:36.115154 26472 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:36.161168 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:36.156565 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:36.167095 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:36.168095 26619 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:36.169505 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:36.172161 27162 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 11: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:36.174789 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:36.175625 27160 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.176862 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:36.179073 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:36.180574 27163 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.184388 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:36.184669 26543 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:11:36.185149 26543 pending_rounds.cc:85] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 10
I20260709 12:11:36.185472 26543 pending_rounds.cc:107] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:11:36.185734 26543 raft_consensus.cc:2889] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:36.185230 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:36.133091 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:36.186995 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:36.187657 26541 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
W20260709 12:11:36.187757 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 54737.2us
I20260709 12:11:36.188586 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:36.189253 26544 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:36.189625 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:36.190109 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:36.151571 27134 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:36.200234 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:36.201009 26546 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.201063 26620 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:36.200305 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:36.202364 27134 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:36.208536 26473 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:11:36.211256 26547 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:36.219977 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:36.224671 26615 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:36.225826 26617 raft_consensus.cc:1217] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 4.4->[6.5-12.8]   Dedup: 7.6->[10.7-12.8]
I20260709 12:11:36.226572 26617 pending_rounds.cc:85] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 6
I20260709 12:11:36.226859 26617 pending_rounds.cc:107] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:11:36.227145 26617 raft_consensus.cc:2889] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:36.227169 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:36.228495 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:36.230688 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:36.231313 26542 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.232303 31188 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:36.232753 31188 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:36.233112 31188 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.235837 26619 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:36.238925 30863 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:36.213204 31058 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:36.241782 31058 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:36.242281 31058 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.199775 31183 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:11:36.242543 31214 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:36.243541 31214 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:36.243906 31214 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:36.244799 31214 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:36.246074 31214 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:36.246534 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.247311 31060 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.247848 31060 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.250692 31179 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:36.210932 31095 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:36.253819 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:36.253741 31095 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:36.254534 26472 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:36.255934 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:36.256630 26541 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:11:36.257421 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:36.258100 27168 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:36.252980 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:36.260095 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:36.260298 26464 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:36.260792 26467 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:36.261932 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:36.263020 26469 raft_consensus.cc:2368] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15.
I20260709 12:11:36.260104 26548 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:36.239831 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:36.266140 26539 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 13: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:36.272498 26546 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
W20260709 12:11:36.279558 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 296262us
W20260709 12:11:36.279634 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 52561us
I20260709 12:11:36.282437 26514 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:36.272642 27160 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:36.273787 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:36.247325 31225 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:11:36.222513 27167 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:36.285588 26472 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:36.278654 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:36.253088 31171 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:36.292824 31183 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:36.293143 31170 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:36.283802 31028 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:11:36.306000 31028 consensus_queue.cc:1243] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:36.293922 31225 consensus_queue.cc:1243] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:36.290799 30665 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:36.290218 31184 raft_consensus.cc:2764] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:36.282385 31060 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:36.309372 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:36.289177 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:36.288100 26542 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:36.298717 26465 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:11:36.280658 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:36.317963 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:36.309793 30665 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.307652 31120 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:36.309726 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:36.321046 27163 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:36.307876 31170 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:36.315290 31029 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.004s	sys 0.028s
I20260709 12:11:36.328279 31170 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.330554 31187 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:36.330960 31095 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:36.331854 31187 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:36.316805 31213 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.332264 31187 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:36.329355 26588 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:36.322603 26473 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:36.327368 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:36.296499 31204 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:11:36.303982 30991 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:36.336567 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:36.316295 31171 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:36.343544 26473 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:36.324184 31078 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:36.338238 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:36.329663 31029 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.004s	sys 0.028s
I20260709 12:11:36.326114 30665 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:36.353708 26514 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:36.351236 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:36.349023 26439 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:36.325595 31120 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:36.349020 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:36.334443 31060 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.358624 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:36.360378 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:36.361045 26588 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:36.357134 26439 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:36.364791 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:36.339000 31028 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:36.347177 31213 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:36.344270 31171 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:36.374123 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 220896us
I20260709 12:11:36.342788 30756 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:36.374429 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:36.378383 26539 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:36.354357 31078 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.333974 31159 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:11:36.325170 31243 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:11:36.366632 31120 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:36.376756 31029 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.354926 31225 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.333236 31187 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:36.371502 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:36.367527 30925 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:36.377368 31171 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.390149 31078 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.393409 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:36.366470 31168 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:36.344617 30855 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:11:36.413492 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:36.414623 26540 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:36.368441 31208 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:36.355085 30863 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:11:36.404119 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:36.405405 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:36.426090 26547 raft_consensus.cc:2410] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:36.406651 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:36.426316 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:36.407015 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:36.427922 26469 raft_consensus.cc:2410] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:36.409539 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:36.410296 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:36.411115 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:36.417212 26548 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:36.429440 26546 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:11:36.398188 30925 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:36.415333 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:36.422660 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:36.417354 31195 consensus_meta.cc:287] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.006s
I20260709 12:11:36.426316 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:36.400126 30845 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:36.410184 26588 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:36.422500 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:36.412237 30991 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:11:36.370414 31060 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.433394 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:36.392917 30902 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:11:36.446686 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:36.431809 31095 raft_consensus.cc:3055] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:36.432986 26472 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:36.407191 31202 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:36.389941 30756 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.440845 31188 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:36.443323 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:36.413630 31028 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:36.408073 31168 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.431540 31187 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:36.468406 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:36.422513 30714 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.450299 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:36.451432 26468 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:36.433789 30925 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.482702 26472 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:36.404088 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:11:36.463065 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 106033us
I20260709 12:11:36.452793 31095 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:36.446338 26588 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:36.470773 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:36.498631 26464 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.479105 26470 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:36.467921 31213 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:36.451367 31208 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:36.486208 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:36.505949 26467 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.506505 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:36.469906 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:11:36.491130 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 87491.4us
I20260709 12:11:36.508040 26547 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:36.492033 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 143072us
I20260709 12:11:36.492673 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:36.494989 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:36.509334 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:36.510433 27162 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 13: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:36.496364 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:36.496740 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:36.432569 31072 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.500116 26622 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 12:11:36.497491 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:36.464072 31028 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:11:36.500790 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 54534.7us
I20260709 12:11:36.479188 31168 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.471645 31210 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:36.502794 31213 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:36.501778 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.445642 31195 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:36.547972 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:36.551026 31249 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:11:36.552534 27160 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:36.553848 31029 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.554633 31029 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.556319 31083 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:36.556743 31083 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:36.557638 31029 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:36.557541 31083 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.558677 30660 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.559397 30660 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.560513 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:36.523617 31028 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.512387 27168 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:36.513872 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:36.508777 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:36.514215 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:36.488579 31241 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:36.502986 31244 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:11:36.524385 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:36.615121 27162 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:36.478930 30896 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:11:36.501775 31202 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:36.616493 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:36.616835 31202 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:36.617462 31202 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.503634 31243 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:36.626116 31083 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.599640 31156 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:11:36.631476 31156 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:36.631922 31156 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:36.632820 31156 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.634135 31156 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.500986 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:36.544464 26547 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:36.647572 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:36.647902 26472 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:36.569310 26542 raft_consensus.cc:2410] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:11:36.509322 26513 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:36.570757 30660 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:36.572832 31060 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:36.578894 26618 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:36.580111 31195 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:36.657864 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:36.563808 31210 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:36.587376 30714 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:36.591171 30756 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:36.591735 30991 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:36.596169 26620 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.613768 31241 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.634372 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:36.671059 26616 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:36.636237 31072 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:36.639590 31095 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.516958 31225 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:11:36.684026 31225 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:36.684522 31225 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:36.685496 31225 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.640004 30925 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.509490 31208 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:36.642755 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 73767.3us
I20260709 12:11:36.646008 31243 raft_consensus.cc:697] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:36.647315 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 146418us
W20260709 12:11:36.649447 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 138817us
I20260709 12:11:36.544901 26464 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:36.655210 26467 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
W20260709 12:11:36.665264 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 156005us
I20260709 12:11:36.665954 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:36.670212 31221 raft_consensus.cc:2764] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:36.682814 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:36.723489 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:36.695856 26614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:11:36.725040 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:36.725548 26614 raft_consensus.cc:606] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:36.725971 26614 raft_consensus.cc:614] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:36.696836 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:36.727869 26546 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.643884 26615 pending_rounds.cc:85] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 3
I20260709 12:11:36.730603 26615 pending_rounds.cc:107] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:11:36.730959 26615 raft_consensus.cc:2889] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:36.731354 26615 pending_rounds.cc:107] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:11:36.731628 26615 raft_consensus.cc:2889] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:36.659736 31051 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:36.664558 31060 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.710031 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:36.710341 26620 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:11:36.712441 31257 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:36.714241 31179 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:36.716035 30925 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:36.718185 31204 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:36.721448 26439 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:36.658452 31188 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:36.735682 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:36.705964 26471 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.705178 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:36.658707 31256 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:36.698638 31208 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.751295 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:36.772676 26614 raft_consensus.cc:2410] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:36.753448 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:36.754541 26546 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:36.747723 31257 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.738590 30824 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:11:36.730605 31095 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:36.766733 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.762593 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:36.668958 31170 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.770335 31253 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:36.668598 30665 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:36.776409 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 71366.9us
I20260709 12:11:36.738979 31051 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.777657 31257 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.787853 26513 leader_election.cc:400] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15.
I20260709 12:11:36.794117 26513 leader_election.cc:403] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 12:11:36.779690 31251 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.062s	user 0.001s	sys 0.001s
I20260709 12:11:36.798221 26618 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:36.755796 30714 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:11:36.796895 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:36.764712 31058 consensus_meta.cc:287] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.002s
I20260709 12:11:36.800104 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:36.771831 31256 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:36.689049 31213 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:36.812724 26543 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 19: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:36.818019 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:36.787740 30925 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:36.785393 31214 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:36.765836 31225 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.751947 31060 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.797552 31184 consensus_queue.cc:1059] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:11:36.823132 30824 raft_consensus.cc:3055] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:36.819370 31221 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.805996 31201 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15.
I20260709 12:11:36.777499 31210 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:36.813979 30714 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.829941 31241 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:36.814601 31256 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.788480 31253 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.831050 31213 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.821065 31058 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:36.861078 30925 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.839221 31208 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:36.844682 31170 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:36.793637 31051 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.849792 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:36.857264 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 181558us
W20260709 12:11:36.862901 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44991.5us
I20260709 12:11:36.846539 31078 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:36.794648 30756 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:11:36.848922 31029 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:36.892356 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 191938us
I20260709 12:11:36.834570 26618 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:36.864173 31214 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.922364 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:36.923301 26546 raft_consensus.cc:2410] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 12:11:36.925565 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:36.906915 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 160907us
I20260709 12:11:36.868500 31204 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.878546 30824 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:36.891904 31253 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.920674 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:36.952199 26466 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.919917 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:36.926785 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:36.929337 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:36.929666 30714 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:36.969465 30824 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:36.933202 31078 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:36.936249 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:36.938164 26548 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 12:11:36.941222 31120 consensus_meta.cc:287] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.001s
I20260709 12:11:36.988436 31120 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:36.950016 31214 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:36.991125 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 54963.3us
I20260709 12:11:36.992487 30824 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.992749 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:36.856333 31243 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:36.994406 31200 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:36.941407 30665 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:36.995327 31078 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:36.995934 31078 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 13 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:36.909830 30925 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.946134 27159 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:36.949134 31060 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:36.959412 26541 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:11:36.967557 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:36.965395 26471 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
W20260709 12:11:37.011916 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 92083.7us
I20260709 12:11:36.958607 26545 raft_consensus.cc:2376] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11. Re-sending same reply.
I20260709 12:11:36.866991 31257 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.018241 31257 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:37.003382 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.019181 26618 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 10: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:37.012920 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:37.026229 26466 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:36.994508 31120 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:37.000636 31187 consensus_meta.cc:287] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 12:11:36.951181 31188 raft_consensus.cc:3055] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:37.062752 31188 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:37.063715 31188 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:37.064937 31188 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:37.067801 31208 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:36.996948 31078 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:37.067833 27159 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:37.039973 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:37.041160 31083 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.041757 31095 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:36.981441 31184 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.065s
W20260709 12:11:37.060495 31171 consensus_meta.cc:287] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.001s
I20260709 12:11:37.100134 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:37.100955 26541 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:37.036234 31170 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:37.106706 26618 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:37.061686 31221 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.080905 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:37.082345 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:37.028787 30714 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:37.096580 26544 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:37.057246 31051 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:37.116859 27163 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:36.962862 31202 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:37.134466 26621 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:37.143960 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 390590us
I20260709 12:11:37.145095 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:37.135140 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:37.098781 31208 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:37.157333 27159 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 10: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
W20260709 12:11:37.158964 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 76701.6us
I20260709 12:11:37.160172 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:37.082370 30991 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:11:37.136514 31179 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.162809 26588 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:37.168525 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 318701us
I20260709 12:11:37.172734 26541 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:37.085642 31083 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.174875 26542 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:37.180545 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:37.182281 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:37.197538 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 418443us
I20260709 12:11:37.200958 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:37.201551 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:37.201655 26618 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:37.203979 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:37.139748 31095 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:37.100239 31171 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:37.207273 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 47165.1us
I20260709 12:11:37.209380 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:37.209550 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:37.211165 26617 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:37.214995 26620 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:11:37.215386 26620 pending_rounds.cc:85] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 6
I20260709 12:11:37.215098 26438 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:37.215642 26620 pending_rounds.cc:107] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:37.216005 26620 raft_consensus.cc:2889] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:37.166999 30714 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:37.225420 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 62719.2us
I20260709 12:11:37.133150 31170 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.220626 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:37.223716 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:37.212262 31028 consensus_meta.cc:287] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.571s	user 0.003s	sys 0.012s
I20260709 12:11:37.261145 31028 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.262713 26473 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:37.264324 31028 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:37.269243 31120 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:37.220307 31029 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.232722 31273 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:37.232961 31261 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:11:37.206725 31058 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:37.235544 31083 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:37.225010 30665 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:37.237650 31256 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.238517 31241 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:37.238682 31240 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.237399 26367 catalog_manager.cc:5697] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 7 to 10, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 10 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:37.240054 31171 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:37.240686 26613 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 15: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:11:37.241421 31156 consensus_meta.cc:287] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.000s
I20260709 12:11:37.242173 31095 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.159353 31264 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
W20260709 12:11:37.244647 31168 consensus_meta.cc:287] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.698s	user 0.009s	sys 0.004s
I20260709 12:11:37.211477 31257 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:37.212487 31060 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:37.246886 31170 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:37.217084 31208 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:37.260479 26621 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
W20260709 12:11:37.282922 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 59314.1us
I20260709 12:11:37.213074 31254 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:37.214624 30863 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:37.230414 31255 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:11:37.271260 30660 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:37.297747 26615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.001s	sys 0.013s
W20260709 12:11:37.354059 26615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.001s	sys 0.013s
I20260709 12:11:37.314729 26547 raft_consensus.cc:2410] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:11:37.220216 31221 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:11:37.210731 31179 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.340199 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:37.299890 31241 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:37.359054 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 137180us
I20260709 12:11:37.286600 31028 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 12:11:37.362565 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 145565us
I20260709 12:11:37.335116 31273 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.368113 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:37.335955 31060 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:37.363356 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:37.367249 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 321842us
I20260709 12:11:37.350051 31254 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.372718 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:37.374218 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:37.359827 31221 consensus_queue.cc:1243] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:37.297554 30665 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.381525 26469 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:37.384954 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:37.371192 31240 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:37.383774 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:37.359058 30660 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.370896 31060 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.377926 30902 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:11:37.378098 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:37.339162 31168 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:37.370096 30892 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.355410 31214 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.369200 31170 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:11:37.380944 31171 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:11:37.375108 31273 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.375986 31254 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.486292 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:37.482963 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:37.407598 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.407663 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:37.408188 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.482148 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:37.382707 31058 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:11:37.428154 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 44510.9us
I20260709 12:11:37.497695 27168 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:37.432765 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:37.407445 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:37.398903 31240 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:37.517395 26619 raft_consensus.cc:2410] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:11:37.434497 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet cff430729a9d4c8183d8ddad129d6ecf: Illegal state: Replica aaadfdd9ca9f424c91505f9b43876233 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:11:37.555894 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:37.382261 30863 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:37.394459 31179 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:37.399417 31243 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:37.518510 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 110907us
I20260709 12:11:37.569902 31284 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.435842 31264 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:37.505012 31221 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:37.558633 31270 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.435202 31208 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:37.557924 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 150572us
I20260709 12:11:37.393939 30925 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:37.500397 31202 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:37.489734 30660 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:37.469594 31279 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:11:37.403203 31204 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.581992 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:37.505299 30665 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:37.443681 31277 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.282s	user 0.003s	sys 0.001s
I20260709 12:11:37.449313 31271 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:37.517827 31058 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:37.485076 31282 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:37.419034 30991 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:37.629014 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:37.550604 31286 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 12:11:37.482314 30988 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.517091 31170 consensus_queue.cc:1243] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:37.606187 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:37.644038 26469 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:37.608389 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:37.597698 30902 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.614027 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:37.592237 31264 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:37.616138 31078 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:37.628136 31058 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:37.590688 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:37.466200 31241 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:37.592550 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:37.588419 26547 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:37.592891 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:37.598630 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:37.666829 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 68287.8us
I20260709 12:11:37.668713 26438 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:37.479466 31256 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:37.618073 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.678333 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:37.620275 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:37.679330 26543 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:37.577680 30714 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:37.621556 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:37.434525 31156 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:37.626649 26545 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:11:37.629967 26546 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:37.604737 31243 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.427196 31029 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.179s
I20260709 12:11:37.414888 31051 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:37.600358 30925 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:37.593302 31253 consensus_meta.cc:287] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.000s
I20260709 12:11:37.585168 31287 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:37.597602 30824 consensus_meta.cc:287] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.605s	user 0.003s	sys 0.012s
W20260709 12:11:37.595894 31188 consensus_meta.cc:287] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.531s	user 0.013s	sys 0.000s
I20260709 12:11:37.633055 31271 raft_consensus.cc:697] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:37.554996 31240 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:37.603888 30863 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:37.680133 31028 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:37.693771 31225 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.813s	user 0.014s	sys 0.006s
I20260709 12:11:37.654637 26544 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 14: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:37.589701 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:37.623056 30892 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:37.659003 26473 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:37.591813 26465 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:11:37.654237 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 274221us
W20260709 12:11:37.660588 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 181641us
I20260709 12:11:37.598502 31200 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:11:37.680966 26548 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 10: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:37.681962 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:37.702363 31253 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.726255 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:37.727460 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:37.728168 26468 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:37.682283 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:37.623858 31267 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:11:37.702872 30714 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:37.730304 30714 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.730707 31264 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:37.681646 31262 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:11:37.594745 31221 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.724028 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2320) took 1191 ms. Trace:
I20260709 12:11:37.690572 31243 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.695135 30665 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:37.694809 31156 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.663192 31171 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.698889 26546 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:37.589128 31284 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.679915 30660 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.684247 26547 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:37.733357 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:37.733551 31214 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:37.680440 31270 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.711671 31271 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:37.721980 26542 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:37.719065 31257 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:37.725440 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:37.724051 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:37.741451 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:37.689162 26470 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:37.750303 26621 pending_rounds.cc:85] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 4
I20260709 12:11:37.724399 26439 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:37.782492 26621 pending_rounds.cc:107] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 9.5
W20260709 12:11:37.782685 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 58372.2us
I20260709 12:11:37.658291 30902 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.783273 26468 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:37.784427 26439 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:37.784855 30902 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:37.747161 26615 rpcz_store.cc:276] 0709 12:11:36.532315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.642443 (+110128us) service_pool.cc:224] Handling call
0709 12:11:36.643626 (+  1183us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:11:36.732443 (+ 88817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:36.732491 (+    48us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:11:36.733279 (+   788us) log.cc:844] Serialized 104 byte log entry
0709 12:11:37.354711 (+621432us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:37.354773 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.354966 (+   193us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:37.723773 (+368807us) raft_consensus.cc:1685] finished
0709 12:11:37.723791 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:37.723971 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6192,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":5791,"thread_start_us":620897,"threads_started":1,"wal-append.queue_time_us":638636}
I20260709 12:11:37.754007 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:37.651170 30988 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:37.756146 26616 pending_rounds.cc:85] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 6
I20260709 12:11:37.786607 26622 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:37.766888 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:37.787175 31256 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:37.787748 31256 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 12 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:37.788347 30988 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:37.723222 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:37.778767 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:37.779800 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:37.789343 26473 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:37.788904 31256 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.780310 26620 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:11:37.790177 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:37.790458 26620 pending_rounds.cc:85] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 10
I20260709 12:11:37.790539 31291 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:37.790813 26620 pending_rounds.cc:107] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:11:37.791060 31291 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.791172 26620 raft_consensus.cc:2889] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:37.791488 31291 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.791654 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:37.781055 26541 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:37.792853 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:37.782805 26621 raft_consensus.cc:2889] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:37.793908 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:37.775785 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:37.786732 26616 pending_rounds.cc:107] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:11:37.795354 26616 raft_consensus.cc:2889] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:37.795744 26616 pending_rounds.cc:107] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:11:37.795434 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:37.796044 26616 raft_consensus.cc:2889] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:37.796691 26547 raft_consensus.cc:2368] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12.
I20260709 12:11:37.795907 30988 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.797999 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:37.799028 26547 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:37.801795 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:37.803715 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:37.796808 26545 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:11:37.804803 26545 pending_rounds.cc:85] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 8
I20260709 12:11:37.804956 26547 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:37.805055 26545 pending_rounds.cc:107] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:11:37.806007 26545 raft_consensus.cc:2889] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:37.806758 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:37.754951 26543 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
W20260709 12:11:37.752048 31281 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:11:37.794994 26542 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.809578 26543 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:11:37.699738 31168 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:37.781881 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:37.814774 31168 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.816560 26542 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:37.817140 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:37.817879 26473 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:37.818795 26468 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:37.827647 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:37.828193 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:37.829068 26615 raft_consensus.cc:2368] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14.
I20260709 12:11:37.723197 31273 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:37.748015 31095 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:37.837146 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:37.835057 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:37.730154 31060 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:37.756559 30665 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:37.762770 30991 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:37.767635 31083 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.722354 30892 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.845155 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:37.844692 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:37.856563 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:37.830120 31078 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:37.830200 31219 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.858276 26438 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:37.862989 31257 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:37.841598 30988 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:37.866873 26471 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:37.863170 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:37.866289 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:37.871502 26467 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:37.872763 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:37.714251 30863 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.863914 30902 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:11:37.866547 31208 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:37.875555 31060 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:37.876042 31208 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.874308 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:37.846041 31095 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:37.879055 31299 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:11:37.879575 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:37.877024 30991 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.775575 31171 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:37.843670 30665 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.831673 31201 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:11:37.884415 26620 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: []
W20260709 12:11:37.909451 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 46367.6us
I20260709 12:11:37.911338 31298 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:37.912583 30902 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:37.912705 31311 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:37.913121 30902 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:37.915082 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 56909us
I20260709 12:11:37.916143 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:37.910374 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:37.911479 31095 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:37.830005 31270 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.883162 30988 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:37.926067 26469 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:37.914104 30902 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.854888 31240 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:37.927433 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:37.843497 31291 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.858476 31083 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:37.931053 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:37.861326 31296 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:11:37.936022 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:37.933548 26469 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 14: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:11:37.936991 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44993.4us
I20260709 12:11:37.937603 26467 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:37.919421 31225 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.927870 30988 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:37.965476 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 49468.6us
I20260709 12:11:37.984494 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:37.985042 31270 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:37.986953 26540 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:37.991014 31221 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:37.991278 30892 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:37.992093 31256 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.992852 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:37.995234 31273 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.995854 31156 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:37.996639 31253 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:37.995879 31273 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:38.000272 26438 leader_election.cc:400] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12.
I20260709 12:11:38.000685 26438 leader_election.cc:403] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:38.001358 26548 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:37.937613 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:37.934501 31095 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:37.931813 31313 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.971097 26439 leader_election.cc:400] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14.
I20260709 12:11:38.015195 26468 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:37.974416 31171 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:37.977550 31240 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:37.978860 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:38.003611 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 66096.7us
I20260709 12:11:38.020337 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:38.011274 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:38.015069 26439 leader_election.cc:403] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:11:38.020673 26468 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:38.024099 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:38.025000 27168 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:38.028816 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:38.031080 26620 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:38.032074 30714 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:38.032516 30896 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:38.032831 30714 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:38.033039 30896 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:38.034543 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:38.035928 31253 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.969851 31298 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.970304 31305 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:37.972996 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.058765 27167 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:38.065047 26588 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:38.002496 30902 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.014489 30925 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:38.064002 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:38.064277 26467 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:38.043897 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:38.084961 26540 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:38.070447 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:38.033985 30714 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.025727 31095 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:38.071233 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:38.093286 27160 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:38.065800 26620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:11:38.017418 30892 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:38.096271 30892 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.084329 31305 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:38.096741 30892 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.077663 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:38.079489 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 110452us
I20260709 12:11:38.102304 26439 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:38.104002 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:38.017757 31316 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.992103 31284 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:38.085249 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 63303.8us
I20260709 12:11:38.112179 26546 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:38.112015 26438 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:38.089658 26540 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:37.971838 31262 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 12:11:38.072211 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:38.094379 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 012eaf6f22154b85929ab516a788db5f: Illegal state: Replica aaadfdd9ca9f424c91505f9b43876233 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:11:38.088747 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:37.958556 31078 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:38.107067 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:38.085414 31253 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14.
I20260709 12:11:38.092865 31240 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:38.092787 31156 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.127653 26467 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:38.127526 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:38.125813 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 63846.6us
I20260709 12:11:38.072240 31213 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:11:38.107985 31295 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.110692 31270 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:38.191120 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 81050.9us
I20260709 12:11:38.083504 31298 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.092540 31028 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:11:38.154557 31240 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.186523 30991 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:38.206430 31273 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:38.154421 31313 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:38.197839 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 67705.8us
I20260709 12:11:38.108863 31268 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
I20260709 12:11:38.196344 31321 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.251890 31083 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:38.189599 31120 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:38.198115 31254 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.620s	user 0.012s	sys 0.000s
I20260709 12:11:38.191072 31060 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:38.291241 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:38.192795 31029 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.296445 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:38.273801 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:38.297748 26616 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
W20260709 12:11:38.284555 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.298804 26514 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:38.289839 26467 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:11:38.214426 31240 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:38.301151 26472 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 10: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:38.189209 31156 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:38.311198 31320 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:11:38.208963 30863 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:11:38.313200 31156 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:38.313356 30863 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:38.314033 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.300341 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:38.300565 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:38.212818 30991 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:38.305624 31298 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:38.307581 31323 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 12:11:38.296516 31293 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:11:38.310658 31029 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.315196 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:38.319242 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:38.355521 26467 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
W20260709 12:11:38.356726 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 56254.6us
I20260709 12:11:38.353924 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:38.359009 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:38.360809 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:38.245877 31287 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:11:38.292003 31257 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:38.209757 31295 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.352882 26367 catalog_manager.cc:5697] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:38.307643 31058 consensus_meta.cc:287] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.626s	user 0.005s	sys 0.005s
I20260709 12:11:38.370062 26473 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:11:38.365279 26467 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:38.303980 31313 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:38.313877 30863 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:38.383102 26367 catalog_manager.cc:5697] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 5 to 8, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 8 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.361234 30991 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:38.374369 26540 consensus_queue.cc:237] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:11:38.335098 31120 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 12 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:38.271730 30892 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.327967 31179 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.294893 31221 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 12:11:38.366525 31307 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.370265 31213 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:38.407552 26367 catalog_manager.cc:5697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 11 to 12, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 12 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:11:38.298672 31254 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.246179 31095 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.370072 31298 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.371116 31156 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.303615 31060 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:38.282267 31321 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:38.412604 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:38.415328 26367 catalog_manager.cc:5697] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.395978 31058 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.470624 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:38.470429 26622 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:11:38.396523 31291 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:38.407131 31179 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:38.478091 26371 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57044 (request call id 312) took 39300 ms (client timeout 15000 ms). Trace:
I20260709 12:11:38.376847 31257 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.521886 26464 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 15: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:38.398234 31253 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.080s
W20260709 12:11:38.474970 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 276778us
I20260709 12:11:38.417107 31298 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.469769 31296 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.524667 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:38.527791 26367 catalog_manager.cc:5697] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.471825 31213 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:38.530849 27159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 733) took 1115 ms. Trace:
W20260709 12:11:38.520323 31264 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.014s	sys 0.059s
W20260709 12:11:38.499087 31323 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:11:38.500599 31179 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:38.532447 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 278890us
I20260709 12:11:38.476943 31286 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:38.485566 31083 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:38.534880 27159 rpcz_store.cc:276] 0709 12:11:37.415830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.415991 (+   161us) service_pool.cc:224] Handling call
0709 12:11:37.434490 (+ 18499us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:37.439305 (+  4815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:37.439351 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:37.560950 (+121599us) spinlock_profiling.cc:243] Waited 7.67 ms on lock 0x7b2c00135838. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:11:37.580798 (+ 19848us) log.cc:844] Serialized 52 byte log entry
0709 12:11:37.702922 (+122124us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:38.265801 (+562879us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b18001818a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f5079ad23c7 00007f50760e49a7 00007f50760f40bf 00007f50760f4038
0709 12:11:38.530122 (+264321us) log.cc:844] Serialized 14 byte log entry
0709 12:11:38.530471 (+   349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.530568 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:38.530617 (+    49us) raft_consensus.cc:1685] finished
0709 12:11:38.530631 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.530789 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4272,"raft.queue_time_us":23243,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":5780,"spinlock_wait_cycles":112895616,"thread_start_us":341961,"threads_started":2,"wal-append.queue_time_us":104299}
I20260709 12:11:38.540625 26466 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:11:38.398473 31313 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:38.533383 26618 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.553813 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:38.556614 31334 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:11:38.557117 31058 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:38.557457 31329 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:11:38.475262 31156 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.535126 31298 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.559021 27166 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:38.559155 31213 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:38.543675 26367 catalog_manager.cc:5697] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:11:38.486639 30863 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:38.524993 26371 rpcz_store.cc:269] 0709 12:10:59.169962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.170183 (+   221us) service_pool.cc:224] Handling call
0709 12:11:38.470485 (+39300302us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:34.478079 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:34.720126 (+242047us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:34.735038 (+ 14912us) write_op.cc:435] Acquired schema lock
0709 12:11:34.740163 (+  5125us) tablet.cc:662] Decoding operations
0709 12:11:34.943353 (+203190us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:35.085236 (+141883us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:35.087093 (+  1857us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:11:35.287754 (+200661us) tablet.cc:701] Row locks acquired
0709 12:11:35.316803 (+ 29049us) write_op.cc:260] PREPARE: finished
0709 12:11:35.346320 (+ 29517us) write_op.cc:270] Start()
0709 12:11:35.384062 (+ 37742us) write_op.cc:276] Timestamp: P: 1783599095333180 usec, L: 0
0709 12:11:35.398717 (+ 14655us) op_driver.cc:348] REPLICATION: starting
0709 12:11:35.542576 (+143859us) log.cc:844] Serialized 1312 byte log entry
0709 12:11:35.997372 (+454796us) op_driver.cc:464] REPLICATION: finished
0709 12:11:36.423456 (+426084us) write_op.cc:301] APPLY: starting
0709 12:11:36.434042 (+ 10586us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:36.583969 (+149927us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:36.584104 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:36.840726 (+256622us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:36.841079 (+   353us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:11:36.841139 (+    60us) write_op.cc:312] APPLY: finished
0709 12:11:36.846868 (+  5729us) log.cc:844] Serialized 41 byte log entry
0709 12:11:36.857850 (+ 10982us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:36.865542 (+  7692us) write_op.cc:454] Released schema lock
0709 12:11:36.884158 (+ 18616us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:37.027404 (+143246us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:37.031523 (+  4119us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":379808,"apply.run_cpu_time_us":9364,"apply.run_wall_time_us":526380,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16655,"num_ops":3,"prepare.queue_time_us":323499,"prepare.run_cpu_time_us":32549,"prepare.run_wall_time_us":1310204,"raft.queue_time_us":78024,"raft.run_cpu_time_us":82342,"raft.run_wall_time_us":304941,"replication_time_us":598459,"thread_start_us":677488,"threads_started":4,"wal-append.queue_time_us":170472,"wal-append.run_cpu_time_us":32862,"wal-append.run_wall_time_us":2127532}]]}
W20260709 12:11:38.564680 31326 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 12:11:38.562091 31295 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:38.565351 31328 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 12:11:38.567148 30892 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:38.569134 30991 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.570040 31321 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:38.521560 31272 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:11:38.606350 31300 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:11:38.632344 26618 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:38.656145 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:38.596618 31221 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:38.657718 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:38.570967 31286 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:38.581351 31188 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:38.629459 30665 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.715s	user 0.007s	sys 0.006s
I20260709 12:11:38.633695 26367 catalog_manager.cc:5697] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 7 to 12, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 12 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.661402 26618 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:38.660966 26439 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:38.539269 31120 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:38.669198 31254 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:38.669441 31156 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:38.545421 31296 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.674129 31296 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:38.675221 26367 catalog_manager.cc:5697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 8 to 11, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 11 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.676566 30991 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:38.678239 31351 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.678851 31351 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.679607 31168 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:38.680040 31168 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:38.681326 31351 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:38.681576 30902 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.596s	user 0.007s	sys 0.002s
I20260709 12:11:38.582491 31083 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:38.682865 31221 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:38.684526 31083 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:38.685055 31221 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:38.669456 31313 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:38.686647 31254 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:38.687150 31254 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.687528 31254 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.659480 31272 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:38.684553 30988 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.702s	user 0.008s	sys 0.004s
W20260709 12:11:38.691074 31316 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.003s
I20260709 12:11:38.690791 30988 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.691237 31272 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:38.691558 31316 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12.
I20260709 12:11:38.693024 30988 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:38.659696 31243 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.884s	user 0.004s	sys 0.009s
I20260709 12:11:38.693922 31243 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.653792 31287 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:11:38.695286 26619 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:38.680919 31168 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:38.682097 31286 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:38.696856 26616 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:38.693938 31257 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:38.701207 31029 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:38.700937 31240 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:38.702345 26622 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:11:38.702363 31060 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:38.703523 31240 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:38.677896 26367 catalog_manager.cc:5697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:11:38.662839 30863 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.707688 26367 catalog_manager.cc:5697] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 5 to 7, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 7 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.709964 31243 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:38.712111 31179 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.718580 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:38.719692 27165 raft_consensus.cc:2393] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:38.726210 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:38.729028 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:38.729527 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:38.731779 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:38.732549 27167 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:38.716166 31168 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:38.737226 26367 catalog_manager.cc:5697] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 6 to 9, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 9 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:38.739662 31332 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.215s	user 0.003s	sys 0.000s
I20260709 12:11:38.740811 26367 catalog_manager.cc:5697] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 2 to 10, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 10 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.738721 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:38.751541 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:38.752187 26546 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:11:38.753021 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:38.753531 26546 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.741644 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:38.754834 26542 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:38.755115 31183 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.755635 31183 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:38.757848 31183 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:38.742192 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:38.755638 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:38.758699 26470 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:11:38.759212 26542 raft_consensus.cc:2410] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:38.759735 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:38.760281 26542 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:38.760454 26470 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:38.761297 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:38.761511 26542 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:38.764449 31183 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.765136 31183 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:38.762286 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:38.767052 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:38.767346 31183 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:38.768244 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:38.769042 26470 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:38.743923 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:38.746353 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:38.770787 26544 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:38.770911 31273 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.699004 30665 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.775028 30665 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:38.749851 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:38.775821 26543 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:38.770038 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:38.777511 26470 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:38.779476 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:38.779351 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:38.781603 26539 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 15: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:38.782526 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:38.776562 26546 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:38.784467 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:38.782462 26470 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:38.786128 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:38.780711 26367 catalog_manager.cc:5697] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 7 to 12, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 12 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.787825 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:38.789422 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:38.790864 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:38.792235 26470 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:38.793259 26513 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:38.795323 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:38.796334 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:38.795796 26367 catalog_manager.cc:5697] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 7 to 10, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 10 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.793291 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:38.786895 31219 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:38.787748 31351 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:11:38.802255 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.799204 31286 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.803267 31156 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:11:38.792074 31083 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:38.806640 31083 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.807041 31083 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:38.793069 31221 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:38.792943 31349 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:38.822870 31359 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:11:38.823148 31349 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:38.796897 31201 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.823716 31349 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.825750 26467 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:38.829031 31254 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.811969 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:38.842759 26467 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:38.834739 31179 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:38.811637 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.835904 30896 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.837647 31298 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.846099 31029 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:38.847121 30896 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:38.847373 31029 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:38.845435 31221 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:38.848459 31029 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:38.848768 31221 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:38.798722 30756 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:11:38.800065 31273 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:11:38.803298 31060 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:38.797930 31296 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.802341 31295 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:11:38.832674 31305 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:38.843514 31219 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:38.835620 26367 catalog_manager.cc:5697] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 8 to 9, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 9 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.853914 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:38.862553 26467 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:38.870432 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:38.862267 26367 catalog_manager.cc:5697] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 2 to 8, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 8 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.879807 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:38.910231 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:38.911705 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:38.914449 26467 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:38.917797 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:38.918676 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2337) took 1084 ms. Trace:
I20260709 12:11:38.919255 26615 rpcz_store.cc:276] 0709 12:11:37.834200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.835643 (+  1443us) service_pool.cc:224] Handling call
0709 12:11:37.835973 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.900346 (+ 64373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:37.900396 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:37.900461 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:37.900511 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.918314 (+1017803us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b540037ad54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:38.918382 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.918593 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147331456}
I20260709 12:11:38.915908 31225 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:38.856199 31356 consensus_queue.cc:1059] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:11:38.922348 26470 raft_consensus.cc:2368] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15.
I20260709 12:11:38.922971 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:38.925307 26546 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:38.811251 30665 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 12:11:38.854588 31060 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.859815 31298 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:38.929726 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:38.913125 31295 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:38.937734 26367 catalog_manager.cc:5697] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 7 to 8, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 8 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:11:38.942798 31078 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:11:38.958923 31330 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.458s	user 0.002s	sys 0.000s
I20260709 12:11:38.908600 31338 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:38.960136 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 720) took 1265 ms. Trace:
I20260709 12:11:38.912144 31296 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:38.921721 31170 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:38.925618 30988 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:38.927549 31201 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:38.927273 31179 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:38.977718 26367 catalog_manager.cc:5697] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:11:38.980391 26545 rpcz_store.cc:276] 0709 12:11:37.694831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.695731 (+   900us) service_pool.cc:224] Handling call
0709 12:11:37.696070 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.806542 (+110472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.959861 (+1153319us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b5400110dd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:38.960069 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230866816}
I20260709 12:11:38.983165 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:38.983997 26465 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:38.982476 26367 catalog_manager.cc:5697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 7 to 8, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 8 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:11:38.858418 31219 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:38.972309 31060 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.981449 30988 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.986464 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:38.987632 26367 catalog_manager.cc:5697] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 5 to 8, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 8 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:11:38.982348 31201 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.973501 31295 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.983142 31179 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.995518 31179 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.996343 31280 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:38.996846 31280 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:38.994688 26367 catalog_manager.cc:5697] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 6 to 9, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 9 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.981729 31170 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.972157 31264 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:11:38.997776 31280 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:38.990680 30988 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.001660 31295 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:39.038147 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.038465 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3116) took 1352 ms. Trace:
I20260709 12:11:39.038872 26468 rpcz_store.cc:276] 0709 12:11:37.685721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.021904 (+336183us) service_pool.cc:224] Handling call
0709 12:11:38.022171 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:38.079013 (+ 56842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:38.079042 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:38.079449 (+   407us) log.cc:844] Serialized 26 byte log entry
0709 12:11:38.251427 (+171978us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:38.251475 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.251550 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:38.958080 (+706530us) spinlock_profiling.cc:243] Waited 7.48 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:39.015718 (+ 57638us) raft_consensus.cc:1685] finished
0709 12:11:39.015742 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.038362 (+ 22620us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61038,"raft.queue_time_us":56758,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":10042,"spinlock_wait_cycles":17199872,"thread_start_us":149636,"threads_started":1,"wal-append.queue_time_us":305484}
I20260709 12:11:39.017938 26465 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:38.991176 31201 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.989619 31321 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:11:39.004743 31170 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.980785 31078 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:38.982740 31338 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:39.036469 31254 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:39.043340 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 2125) took 1454 ms. Trace:
I20260709 12:11:39.045852 26541 rpcz_store.cc:276] 0709 12:11:37.589222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.592624 (+  3402us) service_pool.cc:224] Handling call
0709 12:11:39.043064 (+1450440us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400398ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:39.043275 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263611648}
I20260709 12:11:39.051456 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:39.018217 31265 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:39.061007 26539 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:39.060114 26620 raft_consensus.cc:606] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:39.039544 31280 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:39.045425 31168 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.034108 31083 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:39.050421 30756 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.061182 31221 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:39.073195 31221 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 11 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:39.074229 31221 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.078869 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 2132) took 1050 ms. Trace:
I20260709 12:11:39.082226 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:39.086249 26546 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:39.085741 26543 rpcz_store.cc:276] 0709 12:11:38.028415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.028571 (+   156us) service_pool.cc:224] Handling call
0709 12:11:39.078678 (+1050107us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b54003cfd54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:39.078801 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1716359552}
I20260709 12:11:39.061515 31265 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:39.078485 30756 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:39.099782 31357 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:11:39.106563 31264 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:39.107257 31264 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:39.109440 31264 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:39.070341 31168 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.079053 31349 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:39.111591 31078 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:39.111986 31168 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:39.112555 31349 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:39.118444 31225 raft_consensus.cc:3055] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:39.118954 31225 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:39.119879 31225 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.123440 31265 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:39.124235 31083 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:39.124461 30988 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.061540 31060 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.125026 31265 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.126952 31060 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:39.130309 26514 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:39.135210 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:39.135408 26546 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:11:39.135540 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:39.140516 26540 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
I20260709 12:11:39.149231 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:39.156248 31321 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:39.157200 31321 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:39.158180 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:39.161173 31321 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:39.162303 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2245) took 1398 ms. Trace:
I20260709 12:11:39.162899 26548 rpcz_store.cc:276] 0709 12:11:37.763854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.766500 (+  2646us) service_pool.cc:224] Handling call
0709 12:11:39.162090 (+1395590us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b540037f5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:39.162225 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491986304}
I20260709 12:11:39.166258 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:39.167142 26472 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.180945 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2250) took 1415 ms. Trace:
I20260709 12:11:39.183662 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:11:39.131924 31368 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:11:39.156134 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3009) took 1078 ms. Trace:
I20260709 12:11:39.186299 26548 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 12:11:39.152375 26514 consensus_peers.cc:597] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 953d8c981a6c459f8b7f3dbbb66fda45. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:39.159891 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:39.194056 26467 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:39.195447 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:39.197392 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:39.199070 26546 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:39.191610 26619 rpcz_store.cc:276] 0709 12:11:38.077583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.077751 (+   168us) service_pool.cc:224] Handling call
0709 12:11:38.078158 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:38.695729 (+617571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.155726 (+459997us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b54003d8e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:39.156044 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1418665344}
I20260709 12:11:39.181568 26547 rpcz_store.cc:276] 0709 12:11:37.765399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.808388 (+ 42989us) service_pool.cc:224] Handling call
0709 12:11:39.043321 (+1234933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.043660 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:39.044080 (+   420us) log.cc:844] Serialized 14 byte log entry
0709 12:11:39.090693 (+ 46613us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:39.090771 (+    78us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:39.090848 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.090958 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.179975 (+ 89017us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b180046bc40. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fbb2a6 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4
0709 12:11:39.180693 (+   718us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400398ad0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:39.180855 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27625,"prepare.queue_time_us":1383,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":60,"raft.queue_time_us":105,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":8518,"spinlock_wait_cycles":2847650816,"thread_start_us":46047,"threads_started":1,"wal-append.queue_time_us":51514}
I20260709 12:11:39.201781 27133 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:39.203248 26540 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:39.207767 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:39.144479 31168 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.149214 31349 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:39.221174 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.152400 31083 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:39.122239 31295 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.222349 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:39.231702 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:39.234426 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2117) took 1206 ms. Trace:
I20260709 12:11:39.132099 31179 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.236104 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:39.218582 31321 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:39.239079 31060 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:39.227759 31168 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:39.277046 31168 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:39.279171 31170 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.285727 31179 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:39.287465 31170 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:39.291699 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60224 (request call id 28) took 1228 ms. Trace:
I20260709 12:11:39.292335 26620 rpcz_store.cc:276] 0709 12:11:38.063183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.065673 (+  2490us) service_pool.cc:224] Handling call
0709 12:11:38.739635 (+673962us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b5800049298. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b6c40 00007f507b0a2bb9 00007f507b0a247c 00007f50746287d4
0709 12:11:39.291437 (+551802us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b540003c854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d4853 00007f507b0a260a 00007f50746287d4 00007f5074628762 00007f5074628691 00007f507462860c 00007f50746278c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:39.291566 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":774579840}
W20260709 12:11:39.294809 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:39.296921 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.298099 31270 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:11:39.298774 31270 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:39.299981 31270 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.301868 31263 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:11:39.233867 31337 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.699s	user 0.002s	sys 0.002s
I20260709 12:11:39.307121 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 660) took 1930 ms. Trace:
I20260709 12:11:39.314963 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:39.342769 26544 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 11: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:39.313510 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:39.343461 26543 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:39.343542 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:39.304895 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.308301 26613 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:39.316967 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:39.346467 26540 raft_consensus.cc:2368] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11.
I20260709 12:11:39.321976 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:39.309263 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:39.307722 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:39.329751 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:39.330570 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:39.251523 31321 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.330776 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:39.342314 26471 rpcz_store.cc:276] 0709 12:11:37.377081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.377216 (+   135us) service_pool.cc:224] Handling call
0709 12:11:37.377523 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.871157 (+493634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.306859 (+1435702us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54003fc0d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:39.307059 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124780416}
I20260709 12:11:39.331025 26618 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:39.229481 31349 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.336063 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:39.267302 31208 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:39.352270 26547 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 11: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:39.228632 31078 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:11:39.356868 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:39.357995 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:39.354802 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:39.258638 31029 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 12:11:39.374689 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:39.359452 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:39.375228 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:39.353754 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:39.353994 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:39.376685 26614 raft_consensus.cc:2410] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:11:39.377131 26471 raft_consensus.cc:2368] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11.
I20260709 12:11:39.378337 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:39.379515 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:39.380144 26471 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:39.247884 27160 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:39.343075 31213 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.363857 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:39.386782 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:39.387890 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.332000 31060 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:39.372874 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:39.391570 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:39.397929 26587 leader_election.cc:400] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11.
I20260709 12:11:39.393510 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:39.394450 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:39.399603 26622 raft_consensus.cc:2368] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 11. Current term is 12.
I20260709 12:11:39.398838 26587 leader_election.cc:403] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:39.381595 31213 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:39.401978 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:39.357606 31321 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:39.348032 31262 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:39.352494 31243 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.419579 26439 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:39.421918 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:39.419550 26471 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.364615 31304 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:39.436767 26615 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:39.420234 31028 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:39.437987 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:39.438249 31028 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.431128 31257 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.440575 31028 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:39.440701 31171 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:39.429745 30896 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:39.445380 30896 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.445801 30896 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:39.447019 31319 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:39.447497 31319 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:39.448392 31319 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:39.449678 31319 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:39.449965 26587 leader_election.cc:400] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11.
I20260709 12:11:39.450690 31271 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:39.425617 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:39.389140 31029 consensus_queue.cc:1243] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:39.429308 26472 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:39.424538 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:39.433243 31267 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:39.458671 26614 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:39.460460 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2112) took 1872 ms. Trace:
I20260709 12:11:39.460988 26466 rpcz_store.cc:276] 0709 12:11:37.588292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.590763 (+  2471us) service_pool.cc:224] Handling call
0709 12:11:37.591060 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:38.572784 (+981724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.460106 (+887322us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b540035edd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:39.460376 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2183204608}
I20260709 12:11:39.427764 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:39.451205 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:39.456270 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:39.462903 26619 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:39.352344 31339 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:39.456808 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:39.463440 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:39.352531 31263 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.391024 31298 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.397837 31095 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:39.469635 26618 raft_consensus.cc:2393] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 13: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:39.468582 26514 leader_election.cc:400] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 11. Current term is 12.
I20260709 12:11:39.372632 31240 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:11:39.423098 30756 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:39.500602 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:39.501025 27160 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:39.501746 27168 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
W20260709 12:11:39.465170 26464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 2116) took 1857 ms (client timeout 1551 ms). Trace:
I20260709 12:11:39.478837 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:39.481799 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:39.470508 26471 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:39.491676 26514 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:39.505069 26471 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:11:39.493003 26439 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:39.477094 30991 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:39.495359 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:39.511480 26615 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:39.494257 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:39.451627 31375 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:11:39.513187 26472 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:39.515722 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.518643 26472 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:39.471735 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:39.521452 26466 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:39.521836 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:39.503509 26464 rpcz_store.cc:269] 0709 12:11:37.607940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.608113 (+   173us) service_pool.cc:224] Handling call
0709 12:11:39.464887 (+1856774us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b54000dc5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:39.465076 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2016379648}
I20260709 12:11:39.398813 31170 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:11:39.483575 30892 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:39.483217 31296 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:39.451332 31271 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 12 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:11:39.497040 31330 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:11:39.523155 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:39.483700 31241 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:39.584079 31241 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:39.583711 31271 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.558790 31349 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:39.532235 30991 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.552845 30902 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:11:39.583755 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 60705.6us
I20260709 12:11:39.553619 30756 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:39.554127 31285 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:39.537776 31290 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:39.587939 31290 raft_consensus.cc:2764] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:11:39.588536 31290 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:39.588997 31290 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.537993 31286 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:39.590714 31286 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.590837 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:39.591235 31286 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:39.593061 31372 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 12:11:39.489588 30988 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:39.595767 30991 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:39.596563 30991 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:39.506068 31273 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:11:39.495923 31298 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.600842 31298 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:39.506649 31291 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:11:39.601811 31291 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:39.602178 31291 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:39.603842 31263 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:39.467759 31243 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.478104 31304 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.558337 31295 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:39.563198 31170 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:39.567239 31280 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.501s	user 0.003s	sys 0.007s
I20260709 12:11:39.568745 27167 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 12:11:39.569311 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:39.641603 27167 pending_rounds.cc:85] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 11
I20260709 12:11:39.642017 27167 pending_rounds.cc:107] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 12:11:39.642319 27167 raft_consensus.cc:2889] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:39.569423 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:39.482607 31267 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:39.505038 31352 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 12:11:39.488517 31339 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:39.576833 31257 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 10. Current term is 11.
I20260709 12:11:39.454293 31262 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:39.598079 30896 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.584699 31241 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.536769 26439 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:39.670501 26615 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:11:39.603505 31291 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:39.618476 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 381339us
I20260709 12:11:39.635744 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:39.638759 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:39.640158 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:39.571524 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:39.645488 26468 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:11:39.704185 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.646071 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3115) took 1960 ms. Trace:
I20260709 12:11:39.559031 31060 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.619884 31349 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.667392 31262 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:39.634804 31263 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:39.670536 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 133948us
I20260709 12:11:39.719053 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2347) took 1168 ms. Trace:
I20260709 12:11:39.719542 26439 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:39.488675 31095 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:39.634467 31170 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:39.235136 26473 rpcz_store.cc:276] 0709 12:11:38.027776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.827752 (+799976us) service_pool.cc:224] Handling call
0709 12:11:38.828108 (+   356us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:38.828492 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:38.828519 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:38.829147 (+   628us) log.cc:844] Serialized 52 byte log entry
0709 12:11:38.960737 (+131590us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:39.201749 (+241012us) log.cc:844] Serialized 14 byte log entry
0709 12:11:39.233885 (+ 32136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.234004 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:39.234074 (+    70us) raft_consensus.cc:1685] finished
0709 12:11:39.234093 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.234328 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16771,"prepare.queue_time_us":18722,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":32606,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":8905,"thread_start_us":348211,"threads_started":2,"wal-append.queue_time_us":148601}
I20260709 12:11:39.672780 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:39.664767 26588 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:39.745404 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:39.745931 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:39.746134 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 81563.6us
W20260709 12:11:39.682250 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 435475us
I20260709 12:11:39.746219 26622 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:39.701409 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:11:39.749090 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 47801us
I20260709 12:11:39.750077 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:39.710547 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:39.713655 26613 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:39.715446 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:39.716431 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 3013) took 1326 ms. Trace:
I20260709 12:11:39.705798 26469 rpcz_store.cc:276] 0709 12:11:37.685407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.020407 (+335000us) service_pool.cc:224] Handling call
0709 12:11:38.020678 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:38.085083 (+ 64405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:38.085121 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:38.085598 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:11:39.116307 (+1030709us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b1800337e40. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:11:39.201257 (+ 84950us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:39.201302 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.644779 (+443477us) spinlock_profiling.cc:243] Waited 42.5 ms on lock 0x7b54002dc154. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:39.644841 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:39.644885 (+    44us) raft_consensus.cc:1685] finished
0709 12:11:39.644897 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.645989 (+  1092us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23278,"raft.queue_time_us":21580,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":4059,"spinlock_wait_cycles":108839936,"thread_start_us":84739,"threads_started":1,"wal-append.queue_time_us":1303132}
I20260709 12:11:39.649641 31298 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:39.719463 26617 rpcz_store.cc:276] 0709 12:11:38.551170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.551458 (+   288us) service_pool.cc:224] Handling call
0709 12:11:38.551830 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:38.552107 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:38.570232 (+ 18125us) log.cc:844] Serialized 14 byte log entry
0709 12:11:39.712158 (+1141926us) log.cc:844] Serialized 14 byte log entry
0709 12:11:39.718721 (+  6563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:39.718773 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:39.718824 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.718889 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.718996 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":578225,"prepare.queue_time_us":18444,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":553061,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"thread_start_us":588607,"threads_started":2,"wal-append.queue_time_us":164883}
I20260709 12:11:39.699141 31284 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:39.755875 26616 rpcz_store.cc:276] 0709 12:11:38.353428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.353591 (+   163us) service_pool.cc:224] Handling call
0709 12:11:39.679611 (+1326020us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54001b0654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:39.679737 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":778832128}
W20260709 12:11:39.771876 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.755857 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:39.763159 26545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.018s	sys 0.029s
I20260709 12:11:39.763235 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:39.772686 26545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.018s	sys 0.029s
I20260709 12:11:39.764634 27134 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:39.772924 27165 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
W20260709 12:11:39.803277 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 47533.3us
I20260709 12:11:39.807164 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:39.807243 26617 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:39.745113 31095 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.744684 30756 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:39.811817 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:39.678197 31321 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:39.823077 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:39.825439 26618 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:11:39.748827 31262 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:39.830258 27166 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 10: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:39.751786 30863 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:39.771044 31078 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:39.764892 30896 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:39.770637 31265 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:39.839983 26622 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 15. Current term is 16. Ops: []
W20260709 12:11:39.822093 31201 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.766s	user 0.013s	sys 0.000s
W20260709 12:11:39.822520 31359 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:11:39.860487 26621 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:39.747738 31263 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.788681 31346 consensus_queue.cc:1059] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:11:39.831135 31284 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:39.835000 31290 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:39.812376 30991 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:39.784044 31298 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:39.774650 31291 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.876559 26615 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:39.741225 31349 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:39.852385 31265 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:39.861935 31078 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:39.851063 30756 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:11:39.888473 26617 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: []
I20260709 12:11:39.850330 30863 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.840632 31262 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:39.908804 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.890076 27161 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:39.865178 31201 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.886029 31265 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.846607 31170 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:39.889101 31243 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:39.961122 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:39.965080 26615 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 15: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:39.966512 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:39.969856 26539 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:39.952061 31304 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:39.881671 30991 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:39.985946 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 507162us
I20260709 12:11:39.978868 31267 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:39.989183 31170 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.031991 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:40.032893 26540 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:40.036412 26544 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:40.037633 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:40.038322 26544 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:40.038172 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:40.038970 26543 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:40.039232 26548 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:40.039345 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.040858 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3143) took 1044 ms. Trace:
I20260709 12:11:40.042824 26588 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:40.043712 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:40.044698 26544 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:39.994968 31339 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:40.041388 26467 rpcz_store.cc:276] 0709 12:11:38.996554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.266786 (+270232us) service_pool.cc:224] Handling call
0709 12:11:39.335911 (+ 69125us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:39.339076 (+  3165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:39.339128 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:39.351289 (+ 12161us) log.cc:844] Serialized 26 byte log entry
0709 12:11:39.825397 (+474108us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:39.825459 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.825556 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:40.040565 (+215009us) raft_consensus.cc:1685] finished
0709 12:11:40.040593 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.040781 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24624,"raft.queue_time_us":9458,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":6747,"thread_start_us":392788,"threads_started":1,"wal-append.queue_time_us":639223}
I20260709 12:11:40.037712 31267 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:40.053282 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 288710us
I20260709 12:11:40.038414 31321 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:40.061012 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:40.063509 26548 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:40.061012 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:40.068387 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 261090us
W20260709 12:11:40.062036 31376 log.cc:927] Time spent T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:11:40.071893 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:40.072902 26548 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:40.076581 27134 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:40.078598 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:40.082767 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:40.083496 26544 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:40.087203 26439 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:40.084648 27134 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:40.068773 31338 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:40.102533 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:40.077498 31257 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:40.094844 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 321836us
I20260709 12:11:40.065721 31267 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:40.073375 31388 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.093441 31411 ts_tablet_manager.cc:933] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:40.122862 26588 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:40.138808 27165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:57562
I20260709 12:11:40.139573 27165 raft_consensus.cc:606] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:11:40.100066 31256 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:40.101130 31263 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:40.114064 31262 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:40.148586 26439 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:40.132959 31381 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 12:11:40.118048 31396 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.122221 31349 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:40.174961 31389 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:11:40.183772 31267 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:40.184882 31384 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
W20260709 12:11:40.185607 31286 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.002s
I20260709 12:11:40.127415 30991 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:40.188841 31296 consensus_meta.cc:287] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.590s	user 0.006s	sys 0.004s
I20260709 12:11:40.189330 31296 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:40.190209 26541 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:40.155493 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:40.121513 30863 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:40.118257 31405 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.123790 31271 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.129958 31201 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:40.166195 31319 consensus_meta.cc:287] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.002s
I20260709 12:11:40.162770 31398 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:40.202747 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:40.143496 31393 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:40.133005 31397 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 12:11:40.162933 31385 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:11:40.144058 31256 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:40.122905 31060 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 12:11:40.210623 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:40.186075 31286 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:40.205778 31241 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.003s
I20260709 12:11:40.197562 30991 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:40.206375 31393 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.220839 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:40.213729 31387 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:11:40.224802 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:40.212713 31398 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:40.214334 31256 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.234980 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:40.221671 31321 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:40.240192 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:40.225600 31393 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:40.241169 31412 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:11:40.244401 26614 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:11:40.254848 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:40.245142 31267 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:40.259406 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.221238 31241 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.223537 30991 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.278709 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:40.279409 26471 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:40.281865 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.283413 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:40.284380 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:40.285113 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:40.285467 26466 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:40.279323 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:40.286840 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:40.287285 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:40.287268 26472 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:40.287894 26469 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:40.288630 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:40.281174 27134 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:40.290141 26469 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:40.292824 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:40.293439 26473 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:40.292373 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:40.298225 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:40.298974 26469 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:40.257402 31296 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.254292 31095 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.299021 31278 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:40.303511 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:40.286248 30988 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:40.347417 30988 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:40.276983 30665 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.317934 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3142) took 1351 ms. Trace:
W20260709 12:11:40.318595 31410 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:11:40.286332 31273 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.320472 30991 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:40.322940 31296 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.364974 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:40.364801 31273 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:40.365551 26470 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.367092 31273 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:40.323702 31408 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:11:40.329598 26619 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:40.330715 31095 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:40.331141 31241 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:40.289549 31208 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:40.336706 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:40.378959 26464 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:40.380160 26464 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:40.304684 31286 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:40.340863 31406 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:11:40.335486 31278 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.345012 31256 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:40.386765 26470 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:40.257705 31265 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:40.348822 26465 rpcz_store.cc:276] 0709 12:11:38.966365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.232919 (+266554us) service_pool.cc:224] Handling call
0709 12:11:39.233371 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:39.246077 (+ 12706us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:39.352193 (+106116us) log.cc:844] Serialized 14 byte log entry
0709 12:11:39.971533 (+619340us) log.cc:844] Serialized 14 byte log entry
0709 12:11:39.975818 (+  4285us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:39.976525 (+   707us) log.cc:844] Serialized 26 byte log entry
0709 12:11:39.976710 (+   185us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:39.976996 (+   286us) log.cc:844] Serialized 14 byte log entry
0709 12:11:39.998649 (+ 21653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.998755 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:40.227779 (+229024us) spinlock_profiling.cc:243] Waited 7.73 ms on lock 0x7b4800080058. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507b003aa1 00007f507affab37 00007f507affa9ca 00007f507b0f226f 00007f507b0f1f37 00007f507b10655c 00007f507b106508 00007f507b106488 00007f507b106443 00007f507b1056ec 00007f507a02fa96
0709 12:11:40.317697 (+ 89918us) raft_consensus.cc:1685] finished
0709 12:11:40.317722 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.317868 (+   146us) inbound_call.cc:177] Queueing success response
0709 12:11:40.321176 (+  3308us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b18002826a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
Metrics: {"mutex_wait_us":23055,"prepare.queue_time_us":95766,"prepare.run_cpu_time_us":157,"prepare.run_wall_time_us":162,"raft.queue_time_us":32283,"raft.run_cpu_time_us":5781,"raft.run_wall_time_us":1064351,"spinlock_wait_cycles":46083712,"thread_start_us":461983,"threads_started":1,"wal-append.queue_time_us":662409}
I20260709 12:11:40.334028 31398 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.363693 26466 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:40.363946 26472 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:11:40.364053 26471 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:40.367188 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 3021) took 1006 ms. Trace:
I20260709 12:11:40.390513 26613 rpcz_store.cc:276] 0709 12:11:39.360532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.387462 (+ 26930us) service_pool.cc:224] Handling call
0709 12:11:40.351717 (+964255us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b5400267854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:40.367119 (+ 15402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":594730240}
I20260709 12:11:40.391521 26473 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:11:40.289580 31356 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:40.376531 26467 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:11:40.381750 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 94695.5us
I20260709 12:11:40.397373 31356 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.398641 26513 leader_election.cc:400] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15.
I20260709 12:11:40.399663 31225 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:40.292410 31267 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:40.399996 31356 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:40.402257 31267 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:40.388728 31208 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.395069 31256 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:40.388402 31278 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.396564 31405 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:40.404790 31405 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.399880 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:40.407469 31405 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:40.408316 31290 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:40.408509 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:40.408970 31290 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:40.376981 31296 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:40.410938 31296 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:40.411373 31296 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.409978 31290 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:40.411774 31296 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:40.410260 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:40.414512 31208 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:40.417120 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:40.419644 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:40.420571 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 77169.1us
I20260709 12:11:40.421339 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:40.421789 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:40.389824 30988 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:40.422595 31201 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:40.423161 31201 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:40.424041 31201 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.427395 27163 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:40.370839 30665 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.421674 31405 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:40.439814 27162 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:40.421505 31356 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:40.445544 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:40.427057 31349 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:40.454558 31298 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:40.455559 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:40.456260 26540 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.455809 31095 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:40.457653 31095 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:40.458065 31256 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.458647 31256 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.439795 31241 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:40.464433 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:40.464712 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:40.468516 26542 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:40.465453 26540 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:40.466621 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:40.439766 30988 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:40.475796 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:40.478277 26471 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:40.479562 26467 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:40.480815 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:40.456275 31265 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:40.481485 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:40.467397 31349 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:11:40.482216 31409 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 0.351s	user 0.000s	sys 0.003s
I20260709 12:11:40.482869 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:40.482812 31349 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.483654 26473 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:40.481657 26467 raft_consensus.cc:2410] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:11:40.478880 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:40.458065 31095 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.446147 31171 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:11:40.445334 31208 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:11:40.474849 31356 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:40.443645 31405 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.513129 31095 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.493830 30988 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:40.460544 31393 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:40.477228 31304 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:11:40.507604 31241 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:40.557459 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 78668.5us
I20260709 12:11:40.512373 30991 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 12:11:40.561146 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 66475.8us
I20260709 12:11:40.552796 31256 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:40.564535 27133 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:40.553076 31201 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:40.539249 31286 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:11:40.522853 31272 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:11:40.561259 31262 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:40.574362 30665 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:40.583155 31272 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:40.583500 31280 raft_consensus.cc:3055] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:40.563934 31411 tablet_copy_client.cc:323] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.66:40567
I20260709 12:11:40.584314 31280 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:40.579190 31356 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.585628 31280 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:40.587522 31280 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.590453 31393 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:40.560963 31395 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:11:40.590969 31264 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:40.591414 31264 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:40.592324 31264 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:40.592417 31241 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.583633 31272 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:40.602519 31296 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.575836 31396 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:40.557998 31278 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:40.610441 31278 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:40.611052 31270 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:40.614261 31396 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:40.630003 31396 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:40.635300 31405 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:40.638309 31296 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:40.672699 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.682691 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:40.688984 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3138) took 1915 ms. Trace:
I20260709 12:11:40.692480 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:40.692975 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:40.695798 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2277) took 1615 ms. Trace:
I20260709 12:11:40.696285 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:40.700935 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:40.703460 26547 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:40.706106 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:40.706297 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:40.711578 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:40.598928 31262 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:40.724462 31262 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.725980 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 731) took 1062 ms. Trace:
I20260709 12:11:40.580639 30988 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.726580 26621 rpcz_store.cc:276] 0709 12:11:39.651917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.870511 (+218594us) service_pool.cc:224] Handling call
0709 12:11:40.367620 (+497109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:40.367832 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:40.367860 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:40.367909 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:40.367948 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.368007 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.713429 (+345422us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b5400267850. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:40.713680 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1142317952}
I20260709 12:11:40.729929 26548 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 11: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:40.574936 31201 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.734359 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:40.735481 26544 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.737633 31201 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:40.738880 31284 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.741577 31284 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.742468 31272 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.715808 26468 rpcz_store.cc:276] 0709 12:11:38.773501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.041228 (+267727us) service_pool.cc:224] Handling call
0709 12:11:39.645058 (+603830us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.704536 (+ 59478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.688264 (+983728us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b54002dc150. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:40.688666 (+   402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1387657984}
I20260709 12:11:40.751128 31417 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.757807 26541 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:40.758297 31417 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.746001 31284 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:40.751187 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:40.788165 31273 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:40.790555 26546 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:40.795835 27161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 743) took 1226 ms. Trace:
I20260709 12:11:40.796519 27161 rpcz_store.cc:276] 0709 12:11:39.569177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.571372 (+  2195us) service_pool.cc:224] Handling call
0709 12:11:39.571855 (+   483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.954524 (+382669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.795095 (+840571us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400604854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:40.795564 (+   469us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646392064}
I20260709 12:11:40.786098 26548 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:40.804924 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:40.805887 31213 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:40.806229 26468 raft_consensus.cc:2393] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 9: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:11:40.809646 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 122855us
W20260709 12:11:40.813849 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 102801us
I20260709 12:11:40.815423 30892 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:40.822134 30991 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:40.789527 31273 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.829586 26542 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:11:40.831368 26541 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:40.716603 26545 rpcz_store.cc:276] 0709 12:11:39.080417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.080592 (+   175us) service_pool.cc:224] Handling call
0709 12:11:39.081013 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:39.132135 (+ 51122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:39.132177 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:39.132701 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:11:39.773208 (+640507us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:39.773265 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.694530 (+921265us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b540037f0d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:40.694633 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:40.694762 (+   129us) raft_consensus.cc:1685] finished
0709 12:11:40.694783 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.695407 (+   624us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18036,"raft.queue_time_us":21680,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":8243,"spinlock_wait_cycles":74954496,"thread_start_us":640147,"threads_started":1,"wal-append.queue_time_us":747356}
I20260709 12:11:40.863965 26468 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:40.864013 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:40.864862 31273 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:40.870996 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:40.867975 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:40.848769 30991 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.876497 31417 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:40.880267 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:40.879561 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:40.882315 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:40.880157 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:40.872219 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:40.887856 31120 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:40.883234 31060 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.904861 31208 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:11:40.907008 31120 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.907222 31060 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:40.908552 26464 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 15: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:40.909353 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:40.910905 26619 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.911105 27161 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:40.913201 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 403948us
I20260709 12:11:40.914536 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:40.915934 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:40.917716 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:40.919183 27160 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:40.907346 31208 consensus_queue.cc:1243] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:40.916155 31254 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.878307 30991 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:40.921104 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.909837 31120 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:40.941085 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:40.943122 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:40.943539 31029 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:40.944515 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:40.942325 31120 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:40.945562 31120 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.944396 31029 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:40.933601 26544 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:40.937464 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:40.909859 31060 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:40.957813 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:40.961071 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:40.968665 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:40.970870 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:40.974593 27162 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
W20260709 12:11:40.975677 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.978572 26466 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:40.980080 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:40.987269 26539 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:40.978988 26614 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:40.984658 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 135182us
I20260709 12:11:40.983727 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:40.990033 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:40.987603 26467 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:11:40.981487 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:40.983170 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:40.997326 26470 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:41.019443 26620 raft_consensus.cc:2410] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:11:41.019284 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 45313.7us
I20260709 12:11:41.019670 26543 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 15: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:40.978300 31272 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.983376 27161 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:41.021687 31263 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:41.032612 31263 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:41.033104 31263 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:41.016129 31120 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:41.034328 31263 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:41.035202 31120 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.036144 31263 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:41.036051 31120 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:41.022140 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.019129 26621 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:40.989004 31264 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.981650 31254 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:41.044914 26471 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:41.045783 26619 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:41.046368 30991 raft_consensus.cc:2764] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:40.985589 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:41.047976 31029 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:41.025998 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 70960.1us
I20260709 12:11:41.027226 31319 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:41.027449 31405 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.028537 31213 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:41.029574 31427 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.030259 26588 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:41.031664 26540 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:41.019407 26616 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:11:41.048372 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 88310us
I20260709 12:11:41.069491 26472 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:41.049088 31290 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:41.051213 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:41.053577 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:41.053331 30991 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:41.054021 26620 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:41.073252 31290 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:41.073752 31290 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.055979 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:41.079948 30988 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:41.047258 31254 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:40.995630 31095 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:41.001935 31432 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.063s	user 0.000s	sys 0.003s
I20260709 12:11:41.061920 26544 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:11:41.004356 31241 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:41.083678 31241 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:41.085191 31241 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:41.086719 31241 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:41.087497 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.085232 31095 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:41.089661 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:41.095590 26472 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:11:41.107733 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:41.108721 26467 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:41.126573 26472 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:41.134788 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:41.145911 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:41.152132 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:41.153460 26466 raft_consensus.cc:2410] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:41.153805 26468 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:11:41.160606 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.162089 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:41.175392 26621 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:11:41.176339 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:41.181605 31183 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:11:41.182605 31434 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:11:41.182618 31183 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:41.194710 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:41.202641 26467 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
W20260709 12:11:41.203754 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 150333us
I20260709 12:11:41.204869 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:41.207648 30902 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:41.208091 30902 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:41.208467 30902 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:41.209673 26547 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:41.210361 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:41.211018 26545 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:11:41.211616 31356 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:41.212325 31356 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:41.208330 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:41.211215 26548 pending_rounds.cc:85] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 6
I20260709 12:11:41.216751 26548 pending_rounds.cc:107] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:41.217123 26548 raft_consensus.cc:2889] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:41.210937 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:41.181605 31435 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:11:41.228574 27163 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:11:41.232270 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.232072 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:41.235821 31095 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:41.167665 31427 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:41.236506 31095 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:41.236740 31208 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:41.237048 31095 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.237336 31208 raft_consensus.cc:697] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:41.238969 26539 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:41.238582 31208 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:41.235921 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 205809us
I20260709 12:11:41.159379 31405 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:41.255455 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:41.196631 31120 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:41.299077 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:41.307822 26546 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:41.309667 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:41.366555 26543 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:11:41.375103 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.379778 26558 tablet_copy_service.cc:140] P ac3ac2181aa941229a758ccf6b5607cd: Received BeginTabletCopySession request for tablet 953d8c981a6c459f8b7f3dbbb66fda45 from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:44706)
I20260709 12:11:41.380609 31397 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.380817 26558 tablet_copy_service.cc:161] P ac3ac2181aa941229a758ccf6b5607cd: Beginning new tablet copy session on tablet 953d8c981a6c459f8b7f3dbbb66fda45 from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:44706: session id = 3262bf0553e543eea76794fc529a9acc-953d8c981a6c459f8b7f3dbbb66fda45
I20260709 12:11:41.381304 31397 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:41.412488 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 153127us
W20260709 12:11:41.414562 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.388543 30892 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.427711 26546 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:41.373381 31183 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:41.427603 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:41.431667 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:41.448047 26541 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:41.456049 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 220993us
W20260709 12:11:41.459601 31440 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:11:41.433766 30991 consensus_queue.cc:1243] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:41.476542 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:41.477152 31270 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:41.478173 31060 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:11:41.483801 31397 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:41.494938 26543 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:11:41.521405 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:41.522617 26541 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:41.528613 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:41.543694 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:41.556182 31263 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:41.558846 26621 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 14: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:41.562732 26622 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 8.
I20260709 12:11:41.565153 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:41.575835 26616 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:11:41.578358 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:41.582052 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.584218 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:41.586784 31213 raft_consensus.cc:3055] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:41.587289 31213 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:41.588379 31213 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:41.592036 30892 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:41.592501 30892 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:41.593838 31060 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:41.594748 31060 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.595427 31060 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:41.597851 31060 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:41.598628 27134 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:41.599464 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 107185us
I20260709 12:11:41.600751 31264 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:41.601476 31264 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:41.576390 26616 pending_rounds.cc:85] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 8
I20260709 12:11:41.603672 26616 pending_rounds.cc:107] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:11:41.603943 26616 raft_consensus.cc:2889] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:41.607827 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:41.608923 27162 raft_consensus.cc:2410] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:11:41.638845 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 176678us
I20260709 12:11:41.644368 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:41.657315 30988 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.657552 31405 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:41.658082 30988 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:41.660735 30988 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:41.661425 30988 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.661515 26621 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:11:41.661922 30988 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:41.664522 30988 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:41.666318 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:41.666721 26547 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:41.666757 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:41.667042 26544 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:11:41.668826 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.668828 26539 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:41.669968 31208 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.672968 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:41.673291 31290 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.599s	user 0.015s	sys 0.001s
I20260709 12:11:41.673954 31290 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:41.682876 31280 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:41.683305 31262 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:41.683879 31262 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:41.684243 26545 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:41.685127 31262 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:41.691084 31262 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.614828 26620 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:41.685447 31264 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:41.684258 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:41.684267 31280 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:41.686107 31290 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:41.689572 31356 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:41.685572 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:41.705003 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:41.711988 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:41.699447 31280 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:41.711181 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:41.716956 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:41.711113 31241 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.717725 31280 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:41.700882 30988 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.713601 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:41.701159 31095 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:41.761416 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 284964us
I20260709 12:11:41.762679 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:41.763906 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:41.760531 31280 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.722616 31241 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:41.771162 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:41.773218 26467 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
W20260709 12:11:41.772022 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 50285.4us
I20260709 12:11:41.776722 26621 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:41.737284 30988 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:41.780848 30988 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:41.784889 31449 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 12:11:41.787212 31445 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:11:41.787343 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 95572.4us
I20260709 12:11:41.789860 31290 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:41.800190 31319 raft_consensus.cc:993] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:11:41.800316 31356 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:41.801100 31319 raft_consensus.cc:1081] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:11:41.769192 31272 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:41.801712 31272 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.802248 31272 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:41.808338 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:41.808367 26472 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:11:41.778290 30991 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:41.817446 31270 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.820209 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:41.813289 30991 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:11:41.835155 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 72611.7us
W20260709 12:11:41.838542 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.843116 31028 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:41.843674 31028 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:41.843573 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:41.844790 31028 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:41.845831 31028 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.833554 30991 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:41.897918 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 59127.8us
I20260709 12:11:41.904500 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:41.912225 26439 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:41.873718 31449 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:41.885838 31270 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:41.921428 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:41.920730 26439 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:41.914029 31183 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:41.917006 31270 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.917714 31449 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:41.925486 31405 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:41.947232 31449 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.945238 31270 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:41.937525 31095 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:41.954217 26438 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.632s (SENT) [suppressed 1 similar messages]
I20260709 12:11:41.945636 31427 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:41.947695 31453 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:11:41.953312 30902 consensus_meta.cc:287] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.744s	user 0.015s	sys 0.002s
I20260709 12:11:41.948139 31405 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:41.958962 31451 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:41.975270 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:41.974707 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:41.977427 27162 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:41.950516 31183 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:41.976347 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:41.975301 31451 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:41.981070 31451 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.982059 31213 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.984472 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:41.985291 26613 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:11:41.989876 26619 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:41.984658 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:41.991879 27163 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:41.967235 31453 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.971329 31405 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:41.977349 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:41.963919 31290 raft_consensus.cc:697] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:41.963462 31241 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:11:41.998692 26620 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:41.998968 31457 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:41.999032 26621 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:11:41.993018 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 203553us
W20260709 12:11:41.999979 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 229667us
I20260709 12:11:41.997049 31453 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:41.971885 30902 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.002187 31284 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:42.043982 31319 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:42.044473 31284 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:42.046499 31446 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.267s	user 0.010s	sys 0.010s
I20260709 12:11:42.013067 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:42.048125 26467 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:11:42.011107 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:42.048646 31272 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:42.051716 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.012454 26514 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:42.011143 26619 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:42.017036 31396 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.017526 31465 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:42.017637 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:42.018101 30892 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.018474 31464 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:42.021031 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:42.007213 31457 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:11:42.023015 31454 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:42.024683 31095 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:42.030738 26466 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:54414
I20260709 12:11:42.081459 26466 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:42.081851 26466 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.032174 30902 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:42.037184 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:42.039189 26558 tablet_copy_source_session.cc:215] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:42.042975 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:42.051512 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:42.016057 31241 consensus_queue.cc:1243] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:42.079967 31208 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:11:42.062420 26616 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:42.075564 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.089963 31448 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:42.075503 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 54535.8us
I20260709 12:11:42.094756 30892 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:42.094972 31208 consensus_queue.cc:1243] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:42.097465 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:42.076432 31457 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:42.102685 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 65642us
I20260709 12:11:42.121089 31456 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:42.121415 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:42.102957 27161 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:42.127285 26469 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 12:11:42.101164 26619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:11:42.128453 26468 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15. Ops: [10.7-14.9]
I20260709 12:11:42.128604 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:42.129055 31183 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:42.129385 26469 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.126324 26470 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:11:42.072319 31396 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:42.121666 31456 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.151665 31459 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:42.152364 26465 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:42.153721 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:42.154687 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:42.154834 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:42.094101 31270 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.156564 26470 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:42.149818 31456 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.158735 31270 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:42.057209 31451 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.099381 31095 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:42.179350 31284 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:42.119393 31448 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.184613 31448 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:42.180094 31095 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.152202 31459 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.078066 31465 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:42.175748 31272 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:42.177223 31463 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.164963 31183 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:42.178527 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:42.130234 31280 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:42.167865 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 155649us
I20260709 12:11:42.208961 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:42.213683 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2296) took 1004 ms. Trace:
W20260709 12:11:42.213734 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.192324 31459 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:42.190840 26469 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:42.186959 26466 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:42.228691 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 215195us
W20260709 12:11:42.248577 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.208225 31183 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:42.260634 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 356335us
I20260709 12:11:42.120088 31290 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:42.271989 26466 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:42.276901 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:42.277932 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:42.283213 26545 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:42.285168 26544 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:11:42.287374 26543 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:11:42.287956 26543 pending_rounds.cc:85] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 6
I20260709 12:11:42.288249 26543 pending_rounds.cc:107] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:42.288586 26543 raft_consensus.cc:2889] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:42.288326 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:42.289342 26539 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.312777 26547 raft_consensus.cc:1217] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Deduplicated request from leader. Original: 9.6->[10.7-14.9]   Dedup: 10.7->[12.8-14.9]
I20260709 12:11:42.268919 31183 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.315979 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:42.319252 26547 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15. Ops: [10.7-14.9]
I20260709 12:11:42.320802 26541 raft_consensus.cc:1217] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Deduplicated request from leader. Original: 5.5->[11.6-15.7]   Dedup: 11.6->[15.7-15.7]
I20260709 12:11:42.321571 26541 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: [11.6-15.7]
I20260709 12:11:42.274011 31208 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.330204 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:42.330204 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:42.296161 26558 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:44706 (request call id 749) took 1016 ms. Trace:
I20260709 12:11:42.214325 26542 rpcz_store.cc:276] 0709 12:11:41.208850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.232965 (+ 24115us) service_pool.cc:224] Handling call
0709 12:11:41.296335 (+ 63370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:41.371910 (+ 75575us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:41.588779 (+216869us) log.cc:844] Serialized 14 byte log entry
0709 12:11:41.824271 (+235492us) log.cc:844] Serialized 14 byte log entry
0709 12:11:41.825042 (+   771us) log.cc:844] Serialized 14 byte log entry
0709 12:11:42.213279 (+388237us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:42.213330 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:42.213381 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.213450 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.213621 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":679184,"prepare.run_cpu_time_us":152,"prepare.run_wall_time_us":2381,"raft.queue_time_us":582140,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":165,"thread_start_us":768767,"threads_started":3,"wal-append.queue_time_us":371755}
I20260709 12:11:42.345587 26543 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:42.320007 31356 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:11:42.348707 26541 pending_rounds.cc:85] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 8
I20260709 12:11:42.356451 26541 pending_rounds.cc:107] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:11:42.356866 26541 raft_consensus.cc:2889] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:42.354328 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 233727us
W20260709 12:11:42.360865 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:42.361477 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:42.361884 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:42.369554 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.372610 26615 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:42.379000 26439 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:42.380864 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:42.335966 31208 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:42.378271 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 47693.2us
W20260709 12:11:42.386005 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 264697us
I20260709 12:11:42.338343 26558 rpcz_store.cc:276] 0709 12:11:41.264259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.374750 (+110491us) service_pool.cc:224] Handling call
0709 12:11:42.274647 (+899897us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:42.379374 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:42.394708 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 185868us
I20260709 12:11:42.375888 31469 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.421020 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:42.427248 26617 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:42.430380 26619 raft_consensus.cc:606] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:11:42.431041 26619 raft_consensus.cc:614] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:42.433444 31453 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.434243 31448 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:42.435561 31465 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:42.436365 31477 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.437028 31477 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:42.442674 31396 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:42.445302 31286 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.445888 31286 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.446275 31286 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.431327 26514 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:42.448969 31456 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:42.453377 31456 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:42.454281 31456 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:42.455482 31456 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.455981 31456 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:42.391955 31467 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:42.456431 31456 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.403039 31304 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.485941 26621 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 20: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:42.415588 31272 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.409322 31451 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:42.475358 30991 consensus_meta.cc:287] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.570s	user 0.008s	sys 0.006s
I20260709 12:11:42.457541 31264 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:11:42.500811 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 121903us
W20260709 12:11:42.499672 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 94979.8us
I20260709 12:11:42.485183 30902 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:42.415321 31463 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 12:11:42.511688 31467 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:42.497833 31272 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.527894 31476 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:42.528435 31476 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:42.529518 31476 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.410477 31469 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.546599 27133 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:42.550064 26539 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:42.503780 30991 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.531850 31476 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.497673 31304 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:42.552290 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 121089us
I20260709 12:11:42.535785 31272 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.533782 31474 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:42.570248 31356 raft_consensus.cc:2955] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:11:42.520697 31264 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:42.582943 31396 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:42.583524 31396 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:42.583992 31396 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.544904 31397 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.585166 31264 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:42.598964 31474 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:42.600948 31487 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:42.602452 31280 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:42.593804 31494 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:11:42.626307 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 140260us
W20260709 12:11:42.646641 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.649394 26616 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:42.577132 31449 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.625s	user 0.012s	sys 0.001s
I20260709 12:11:42.677861 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:42.683084 27162 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:42.586825 31465 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:42.542362 30902 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:42.683462 27162 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:42.682502 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:42.671203 31457 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.514s	user 0.018s	sys 0.000s
I20260709 12:11:42.694358 31304 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:42.694864 30991 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:42.683287 31280 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:42.695139 31453 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:42.696267 31486 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:42.685555 31028 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:11:42.692304 31463 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:11:42.693377 31405 consensus_meta.cc:287] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.690s	user 0.013s	sys 0.000s
I20260709 12:11:42.693902 31477 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:42.663465 31397 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:42.722527 31405 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.697078 31457 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.724659 31397 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:42.708321 30902 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:42.725934 31457 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:42.688680 31449 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.728783 31449 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:42.708564 31280 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:42.698102 31213 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:11:42.731573 31213 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:42.731781 26622 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:42.732125 31213 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:42.704779 31183 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:42.735263 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:42.736739 31183 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:42.733500 31213 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:42.698506 31466 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.738570 31263 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:42.739140 31213 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:42.739214 31466 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:42.740067 30991 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:42.739061 31453 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:42.750097 31449 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:42.751176 31453 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:42.752475 31453 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:42.751246 31461 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.720s	user 0.002s	sys 0.006s
I20260709 12:11:42.751236 31474 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:42.755007 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:42.756057 31405 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:42.756163 31263 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:42.757115 31263 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:42.757344 31486 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:42.758152 31263 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.759543 31272 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.766214 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:42.722052 31396 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:42.767300 26466 raft_consensus.cc:2410] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:42.767794 31272 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:42.768716 31396 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:42.763707 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:42.772866 31459 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:42.775326 31459 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:42.776264 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.776639 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:42.776288 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:42.779111 31241 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:42.779593 31241 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:42.759979 31486 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:42.686128 31487 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:42.760917 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.784484 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:42.783288 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 259256us
I20260709 12:11:42.786439 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:42.779171 26539 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 13: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:42.809024 26473 raft_consensus.cc:2368] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10.
I20260709 12:11:42.781913 27162 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:42.809916 27162 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.810441 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:42.811321 26466 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:42.813366 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:42.813630 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:42.813941 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:42.814595 26548 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:42.814872 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:42.813696 26544 raft_consensus.cc:1217] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Deduplicated request from leader. Original: 7.5->[10.6-12.7]   Dedup: 10.6->[12.7-12.7]
I20260709 12:11:42.815871 26544 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
W20260709 12:11:42.816723 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 311609us
W20260709 12:11:42.817044 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 156027us
I20260709 12:11:42.821004 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:42.821521 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:42.827754 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:42.828413 26543 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:42.829442 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:42.831614 26545 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 11: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:42.699781 31465 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.109s
W20260709 12:11:42.832852 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.830003 26473 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:42.842592 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:42.842787 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.851672 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:42.852717 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:42.852487 26473 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:11:42.859808 31489 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:42.860857 31489 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.862108 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:42.860010 31464 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:42.863181 31464 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.866897 31464 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:42.868767 31489 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:42.866806 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:42.871001 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:42.873245 26543 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:42.876757 26469 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:42.878513 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:42.878916 26514 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:42.879434 26539 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.827400 31451 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.827157 31262 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:42.883401 26469 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:42.883854 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:42.883962 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:42.886914 26473 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 11: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:11:42.888186 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 64875.3us
I20260709 12:11:42.888996 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:42.850979 31448 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.850920 30892 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:42.826947 31457 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:11:42.819417 31284 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:11:42.780702 31241 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.913856 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:42.916601 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:42.916903 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:42.917738 27167 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:42.903364 26616 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:42.903281 26621 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:42.892608 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:42.832269 31304 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:11:42.880230 31264 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:42.833909 30902 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:11:42.922784 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:42.927340 26467 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:42.929159 26473 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 11: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:42.925230 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:42.925230 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:42.886548 31489 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:42.938874 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:42.904314 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:42.934003 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:11:42.938562 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.940521 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:42.943826 26473 raft_consensus.cc:2368] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15.
I20260709 12:11:42.943781 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:42.947060 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:42.948534 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:42.951086 26617 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.892165 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:42.942230 31473 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:42.880671 31495 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
W20260709 12:11:42.953030 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 117427us
I20260709 12:11:42.954386 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:42.781350 31467 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.886251 31451 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.955643 26539 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:42.956877 27163 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 11: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:42.958895 26466 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:11:42.942607 31280 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:42.906225 31448 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.946784 31241 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.914903 31262 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:42.963536 31213 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:43.008496 27162 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:42.965678 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:42.974028 31503 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:42.954974 31286 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:42.977164 31208 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:42.978705 31466 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:43.019045 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:42.979007 31497 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:42.943353 27161 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:11:42.939031 31489 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:42.959560 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:42.961297 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:42.985790 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:43.031108 26539 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:11:42.983691 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:42.954610 31396 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:42.989342 26548 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:11:42.952670 31397 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.992853 31469 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:42.937583 30892 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:42.998620 31405 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:42.999048 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:42.999830 31451 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:42.999848 31499 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:43.001247 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:43.001963 31447 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.994050 26467 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:43.009756 26469 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.011981 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:43.014460 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:42.982646 31280 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:43.021996 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 105157us
I20260709 12:11:43.034415 26546 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 13: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:43.041687 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:43.043493 26547 raft_consensus.cc:3055] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:43.033425 31489 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:43.046629 26615 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.018477 31464 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:43.041337 31396 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.051386 26466 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:43.026450 31356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:44692 (request call id 19) took 4659 ms. Trace:
I20260709 12:11:43.050858 31319 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:43.052660 31469 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:43.053262 31501 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.042342 31397 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:43.027549 31497 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:11:43.045022 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 85576.7us
I20260709 12:11:43.063447 26539 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:43.063344 31270 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:43.058422 26547 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:43.032295 31028 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.008898 31272 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:11:43.064661 31280 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.041002 31474 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.071379 26471 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:43.057010 27163 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.068801 26621 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:11:43.076644 31464 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:43.085508 31464 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:43.124878 31502 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:43.086344 30902 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:11:43.124686 31447 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:43.132464 31447 raft_consensus.cc:3055] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:43.064035 31483 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:43.082337 26472 raft_consensus.cc:2955] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:11:43.072862 31396 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.077661 31270 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:43.079308 26547 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:43.124745 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:43.077222 31397 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.032701 31503 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:43.092320 27133 leader_election.cc:400] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15.
I20260709 12:11:43.086699 31411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953d8c981a6c459f8b7f3dbbb66fda45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:43.137452 26547 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.132874 31447 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:43.137497 27133 leader_election.cc:403] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 12:11:43.146519 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 70518.2us
I20260709 12:11:43.129233 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:43.083474 31028 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:43.135298 31483 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:43.153162 26471 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:43.153358 31483 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:43.071964 31356 rpcz_store.cc:276] 0709 12:11:38.365229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.367408 (+  2179us) service_pool.cc:224] Handling call
0709 12:11:38.532965 (+165557us) log.cc:844] Serialized 506 byte log entry
0709 12:11:43.024755 (+4491790us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24415,"raft.queue_time_us":242027,"raft.run_cpu_time_us":2051,"raft.run_wall_time_us":44810,"spinlock_wait_cycles":1792,"thread_start_us":252671,"threads_started":2}
W20260709 12:11:43.139214 31505 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:11:43.139925 31496 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
W20260709 12:11:43.172598 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 168559us
I20260709 12:11:43.168857 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:43.077479 31469 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:43.156554 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:43.141607 30892 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:43.154217 31028 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:43.196317 26469 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:43.152061 31502 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:43.160573 31286 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:43.203773 26615 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:11:43.167776 31495 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:43.202791 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:43.079919 31501 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:43.211678 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:43.150945 31474 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:43.212558 26617 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:43.140230 31447 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:43.197576 31304 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.202620 31262 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:43.236663 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:43.239841 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:43.207415 31483 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:43.243432 31504 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260709 12:11:43.245437 31512 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:11:43.246845 31447 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.247404 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:43.248924 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:43.249557 26541 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:43.253849 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:43.254642 26541 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:43.228107 31459 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:43.259174 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.259745 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:43.235064 31509 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.263797 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:43.266888 26619 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:11:43.240605 31448 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:43.269351 31262 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:43.274024 31481 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.589s	user 0.003s	sys 0.000s
W20260709 12:11:43.279961 31511 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.255s	user 0.002s	sys 0.000s
I20260709 12:11:43.281484 31501 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:43.263245 31286 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:43.282739 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 79060.1us
I20260709 12:11:43.283684 31469 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:43.282199 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:43.288589 27163 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
W20260709 12:11:43.269438 31456 consensus_meta.cc:287] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.771s	user 0.007s	sys 0.005s
I20260709 12:11:43.292445 26547 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 13. (term mismatch)
I20260709 12:11:43.300473 26547 pending_rounds.cc:85] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 12
I20260709 12:11:43.295428 31262 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:43.301244 26547 pending_rounds.cc:107] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 12:11:43.301576 26547 raft_consensus.cc:2889] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:43.303395 31262 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:43.305474 31513 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:11:43.307300 31516 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:11:43.236984 31270 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:43.309260 31319 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15.
W20260709 12:11:43.308346 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.310645 31502 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:43.311895 31476 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.001s
I20260709 12:11:43.307199 31503 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:43.296984 31286 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:43.319198 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:43.319892 26622 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.320740 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:43.292197 31459 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:43.323241 31469 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:43.323330 31459 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:43.201809 31497 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:43.328025 26540 consensus_meta.cc:287] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.000s
I20260709 12:11:43.320482 31396 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:43.322108 26514 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:43.328617 26540 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:11:43.326700 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:43.330921 31469 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:43.335428 31356 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:43.319211 31286 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.338764 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:43.340051 31356 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:43.341004 31356 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:43.341387 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.341899 31521 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:43.342320 31521 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:43.342650 31464 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:43.343122 31464 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:43.343289 31521 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:43.344590 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.344081 31464 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:43.345469 31464 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.344764 31521 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.345901 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 752) took 1254 ms. Trace:
W20260709 12:11:43.342330 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.215404 31495 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:43.351823 26587 leader_election.cc:400] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10.
I20260709 12:11:43.352280 26587 leader_election.cc:403] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:43.353657 26470 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:43.346309 26620 rpcz_store.cc:276] 0709 12:11:42.091162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.091754 (+   592us) service_pool.cc:224] Handling call
0709 12:11:42.095095 (+  3341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.327059 (+231964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.327090 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:42.329666 (+  2576us) log.cc:844] Serialized 26 byte log entry
0709 12:11:42.461479 (+131813us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:42.461535 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.461638 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:43.273399 (+811761us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:43.345543 (+ 72144us) raft_consensus.cc:1685] finished
0709 12:11:43.345566 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.345813 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2214,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":3976,"spinlock_wait_cycles":4420608,"thread_start_us":327894,"threads_started":2,"wal-append.queue_time_us":192413}
I20260709 12:11:43.359419 27164 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 15: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:43.355029 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:43.360823 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:43.360885 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:43.368075 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:43.371495 26472 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:43.373775 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:43.373942 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:43.375349 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.375746 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:43.355515 31262 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10.
I20260709 12:11:43.327966 31456 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:43.350769 31280 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:43.365316 31453 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:11:43.370842 31290 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:43.366711 31497 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.387760 31304 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.394582 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:43.396927 26469 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:11:43.398988 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:43.399430 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:43.411074 26469 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:43.396139 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:43.416339 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:43.419318 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:43.420410 26469 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:43.421620 26473 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:43.378736 31469 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:43.433084 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:43.419201 31453 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:43.462266 31485 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:11:43.418987 31449 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:43.416039 31427 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:43.478166 31427 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:43.478575 31500 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:43.478796 31427 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.485066 26472 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:43.417574 31503 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.422359 31290 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:43.464227 31262 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:43.498627 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.486898 31449 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:43.413278 31397 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:43.486931 31509 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:43.522770 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:43.526801 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 147498us
I20260709 12:11:43.529706 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:43.532203 31095 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.535136 31241 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:43.535650 31241 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.535992 26514 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:43.536036 31241 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:43.536893 31290 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:43.537480 26514 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:43.538626 31466 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.539440 31466 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:43.541127 27164 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:43.542557 26617 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:11:43.542963 26617 pending_rounds.cc:85] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 8
I20260709 12:11:43.543170 26617 pending_rounds.cc:107] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:11:43.543409 26617 raft_consensus.cc:2889] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:43.545614 31495 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:43.548552 31524 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:11:43.557221 26617 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:11:43.558238 26617 pending_rounds.cc:85] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 6
I20260709 12:11:43.558724 26617 pending_rounds.cc:107] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:11:43.555430 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:43.559168 26617 raft_consensus.cc:2889] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:43.510329 31262 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:43.487392 31469 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:43.550185 31272 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:43.525019 31509 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:43.496380 31503 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:43.526419 31447 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:11:43.593297 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:43.594101 26616 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:43.598888 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:43.598556 27163 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:43.612813 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:43.567775 31262 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.550887 31489 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:43.613838 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:43.587034 31509 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.561316 31304 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:11:43.614775 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:43.629209 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:43.630697 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:43.612491 30991 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:43.529862 31453 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:43.640064 31489 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:43.599646 31396 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:43.641534 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:43.642918 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:43.656446 27163 raft_consensus.cc:2368] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 11. Current term is 12.
I20260709 12:11:43.644016 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:43.645458 31456 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:43.645776 31525 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.121s	user 0.000s	sys 0.003s
I20260709 12:11:43.647866 31469 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:43.651595 26619 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 12:11:43.674768 26619 pending_rounds.cc:85] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 5
I20260709 12:11:43.675139 26619 pending_rounds.cc:107] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 12:11:43.675424 26619 raft_consensus.cc:2889] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:43.651628 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:43.643154 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:43.657801 31397 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:43.653474 31502 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:43.657258 30991 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.657513 26622 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:11:43.680276 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:43.663713 31506 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:43.666585 26615 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:43.678320 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:43.680878 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 56289.5us
I20260709 12:11:43.651098 31280 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:43.650286 31459 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:11:43.684435 30991 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:43.806593 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:43.772658 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.771961 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:43.620855 31449 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:43.806731 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 105059us
I20260709 12:11:43.682925 31506 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:43.816078 26544 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:43.697448 31486 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.807091 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:43.815925 26622 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:43.772576 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:43.832847 26545 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:43.810236 26617 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:43.696635 31456 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:43.828039 26472 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:43.829308 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:43.807987 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.806915 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:43.684273 31502 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:43.836989 31506 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:43.837680 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:43.838680 26615 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:43.852463 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:43.839154 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.839435 31284 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:11:43.852092 26543 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 20: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:43.842592 31486 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:43.845147 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:43.817592 31513 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:11:43.861555 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:43.814446 31397 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:43.857831 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.861845 26541 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:43.853300 26622 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:43.868745 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:43.869385 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:43.871950 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:43.847694 31456 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:43.870513 26544 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:43.879645 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:43.882107 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:43.865785 31286 consensus_meta.cc:287] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.003s
I20260709 12:11:43.884766 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:43.885499 26543 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:43.889030 31521 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.006s
I20260709 12:11:43.899503 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:43.877282 31456 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.900403 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:43.908066 31459 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.908950 31506 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:43.870036 31483 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
W20260709 12:11:43.916180 31536 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:11:43.948350 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:43.948515 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:43.867887 31397 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:43.953137 26541 raft_consensus.cc:2410] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:43.953013 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:43.952387 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 80566.6us
I20260709 12:11:43.891891 31286 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:43.953397 31528 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 12:11:43.966907 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:43.974963 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:43.975668 31262 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:43.976003 31427 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:43.978333 31427 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:43.978641 31262 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:43.976337 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:43.978505 31411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56894 (request call id 535) took 3925 ms. Trace:
I20260709 12:11:43.999739 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2189) took 1225 ms. Trace:
I20260709 12:11:44.000569 26547 rpcz_store.cc:276] 0709 12:11:42.773993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.777836 (+  3843us) service_pool.cc:224] Handling call
0709 12:11:42.778167 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:43.302077 (+523910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.999370 (+697293us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54001117d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:43.999649 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609774464}
I20260709 12:11:43.999352 31411 rpcz_store.cc:276] 0709 12:11:40.058544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.064365 (+  5821us) service_pool.cc:224] Handling call
0709 12:11:40.145321 (+ 80956us) ts_tablet_manager.cc:934] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
0709 12:11:40.458882 (+313561us) spinlock_profiling.cc:243] Waited 5.16 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5072fd00ac 00007f507be2a9a9 00007f5072fec69b 00007f5072fe9caa 00007f5072fe9bd2 00007f507b04e131
0709 12:11:42.942484 (+2483602us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:11:43.492785 (+550301us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:43.492956 (+   171us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:11:43.943436 (+450480us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:11:43.977698 (+ 34262us) tablet_replica.cc:206] Creating consensus instance
0709 12:11:43.978140 (+   442us) ts_tablet_manager.cc:989] Replica registered.
0709 12:11:43.978369 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":9230,"spinlock_wait_cycles":11877760,"tablet-copy.queue_time_us":28428,"thread_start_us":434731,"threads_started":2}
I20260709 12:11:44.003271 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 758) took 1078 ms. Trace:
I20260709 12:11:44.003834 26621 rpcz_store.cc:276] 0709 12:11:42.924822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.925002 (+   180us) service_pool.cc:224] Handling call
0709 12:11:44.002980 (+1077978us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b5400195354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:44.003143 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315836160}
I20260709 12:11:44.011070 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:44.011518 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:44.012087 27164 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 13: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:44.011138 26545 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:44.013968 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:44.015125 26543 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:44.016214 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:44.017040 26544 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:44.017227 26548 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:44.012778 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:44.023871 26539 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:44.028887 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:44.029978 26543 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:44.035833 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:44.048950 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.961880 31284 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:11:44.054499 26547 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:44.058372 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:43.961387 31499 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:11:44.077481 30902 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:44.077351 31469 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:44.077353 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:44.082844 31411 tablet_copy_client.cc:806] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:44.083699 31411 tablet_copy_client.cc:670] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:44.084959 31397 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:44.089028 26543 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:44.051468 26617 raft_consensus.cc:2955] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:11:44.096037 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:44.058159 31497 consensus_meta.cc:287] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.641s	user 0.021s	sys 0.002s
I20260709 12:11:44.097559 31262 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:44.097887 31502 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:44.097564 31095 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:44.098634 31095 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:44.062795 31286 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:44.099506 31095 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:44.066560 31474 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:44.068853 30988 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:44.100931 30988 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:44.046710 31447 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 12:11:44.101907 30988 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:44.103106 30988 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.104012 31487 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:44.104741 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:44.107055 31522 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.935s	user 0.004s	sys 0.000s
I20260709 12:11:44.108892 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:44.109692 26614 raft_consensus.cc:2368] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15.
I20260709 12:11:44.110927 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2408) took 1153 ms. Trace:
I20260709 12:11:44.111382 26613 rpcz_store.cc:276] 0709 12:11:42.957400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.957498 (+    98us) service_pool.cc:224] Handling call
0709 12:11:42.957842 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.991785 (+ 33943us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.991842 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:43.012818 (+ 20976us) log.cc:844] Serialized 26 byte log entry
0709 12:11:43.171536 (+158718us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:43.171583 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.171677 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:44.106343 (+934666us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:44.110575 (+  4232us) raft_consensus.cc:1685] finished
0709 12:11:44.110596 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.110864 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39001,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":16205,"spinlock_wait_cycles":3422464,"thread_start_us":136549,"threads_started":1,"wal-append.queue_time_us":138472}
W20260709 12:11:44.072330 31241 consensus_meta.cc:287] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.535s	user 0.012s	sys 0.004s
I20260709 12:11:44.072975 31500 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:44.076454 26471 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:44.076839 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2406) took 1156 ms. Trace:
I20260709 12:11:44.053440 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:44.095942 30892 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:44.060639 26514 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:44.130662 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 70145.8us
W20260709 12:11:44.130827 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 77495.7us
I20260709 12:11:44.131511 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:44.131650 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:44.132722 26514 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:44.114964 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 146709us
I20260709 12:11:44.135048 26514 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:11:44.123667 26470 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.021s	sys 0.030s
I20260709 12:11:43.994624 31486 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:44.114905 31544 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 12:11:44.136237 26470 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.022s	sys 0.030s
I20260709 12:11:44.142903 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:44.140941 31509 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:44.145645 31466 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:44.145779 31465 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:44.146531 31466 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:44.147042 31509 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:44.136721 31497 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.145141 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:44.125548 26618 rpcz_store.cc:276] 0709 12:11:42.920304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.962073 (+ 41769us) service_pool.cc:224] Handling call
0709 12:11:42.962567 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.963031 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.963066 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:42.963569 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:11:43.534511 (+570942us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b1800470140. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:11:44.076194 (+541683us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b1800470140. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5075c824bc 00007f5072fd048b 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1
0709 12:11:44.076370 (+   176us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:44.076401 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.076482 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:44.076532 (+    50us) raft_consensus.cc:1685] finished
0709 12:11:44.076544 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.076669 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43071,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":4662,"spinlock_wait_cycles":12102912,"thread_start_us":59303,"threads_started":1,"wal-append.queue_time_us":59696}
I20260709 12:11:44.151463 31488 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:44.170679 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:44.139499 31487 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.167595 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:44.182873 31456 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:44.184787 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:44.168835 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:44.186592 26466 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:44.137003 31500 consensus_queue.cc:1243] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:44.187639 31356 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.188159 31356 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:44.148806 31497 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:44.190246 31497 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.150731 30988 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:44.175580 31286 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:44.191322 31286 consensus_queue.cc:1243] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:44.177590 31272 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:44.159641 31465 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.153651 31503 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:44.187172 31290 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:44.190282 31356 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:44.192200 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2185) took 1403 ms. Trace:
I20260709 12:11:44.173336 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:44.186138 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:44.193960 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:44.132833 31241 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:44.203902 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:44.172230 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:44.204577 26466 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.206645 26438 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:44.212538 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:44.214288 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:44.214784 26514 leader_election.cc:400] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 11. Current term is 12.
I20260709 12:11:44.215257 26547 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.215505 26514 leader_election.cc:403] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:44.218720 26542 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:44.203158 26468 rpcz_store.cc:276] 0709 12:11:42.789224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.790174 (+   950us) service_pool.cc:224] Handling call
0709 12:11:42.814558 (+ 24384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.833761 (+ 19203us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:42.880261 (+ 46500us) log.cc:844] Serialized 14 byte log entry
0709 12:11:43.655562 (+775301us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b18001177c0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a23a 00007f50760e4a2a
0709 12:11:43.963496 (+307934us) log.cc:844] Serialized 14 byte log entry
0709 12:11:43.966788 (+  3292us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:43.967312 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:11:43.967461 (+   149us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:43.967495 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.967731 (+   236us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:44.191966 (+224235us) raft_consensus.cc:1685] finished
0709 12:11:44.191993 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.192135 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33539,"prepare.queue_time_us":47878,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":6376,"raft.queue_time_us":57435,"raft.run_cpu_time_us":413,"raft.run_wall_time_us":14595,"spinlock_wait_cycles":5381504,"thread_start_us":307315,"threads_started":2,"wal-append.queue_time_us":1028286}
I20260709 12:11:44.191918 31272 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.223366 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:44.223690 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:44.230733 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:44.205174 31476 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.200193 31465 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:44.247922 31465 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.253050 31208 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:44.255375 30902 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:44.255939 30902 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:44.257861 31456 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:44.258294 26547 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:44.218008 31095 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.262593 31502 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.209698 31488 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:11:44.264750 26546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 762) took 1403 ms (client timeout 1625 ms). Trace:
I20260709 12:11:44.264487 31488 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:44.265344 26546 rpcz_store.cc:269] 0709 12:11:42.861674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.861813 (+   139us) service_pool.cc:224] Handling call
0709 12:11:44.264451 (+1402638us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54003377d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:44.264631 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394126592}
I20260709 12:11:44.267221 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3182) took 1367 ms. Trace:
I20260709 12:11:44.235289 31489 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:44.267755 26473 rpcz_store.cc:276] 0709 12:11:42.899534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.964166 (+ 64632us) service_pool.cc:224] Handling call
0709 12:11:42.964473 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:43.457066 (+492593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.266951 (+809885us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b54001a8954. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:44.267149 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1045022592}
I20260709 12:11:44.269080 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:44.269732 26473 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:44.237524 26620 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:44.240465 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:44.241231 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:44.272642 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:44.243029 31508 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.244488 31270 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.247226 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:44.267318 26546 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:44.217340 31503 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:43.381091 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:44.279706 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:44.279986 26473 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:11:44.228080 31356 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:44.301580 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:44.302301 26613 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:44.280766 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:44.304296 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 80997.1us
I20260709 12:11:44.305661 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:44.217818 31509 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:11:44.209319 31290 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:44.233547 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:44.320554 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:44.327093 26617 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.270424 30988 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 11. Current term is 12.
I20260709 12:11:44.336359 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:44.340745 26613 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:44.347433 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:44.348675 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 115230us
I20260709 12:11:44.349591 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:44.325431 26466 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:44.277513 31502 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.320066 31028 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:44.336126 26439 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:44.310734 31500 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:44.356045 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:44.370885 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:44.374670 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:44.379846 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 246710us
W20260709 12:11:44.380446 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.397893 26588 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:44.395138 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:44.398955 26613 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:44.360266 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:44.399830 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:44.298147 31508 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:44.401114 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:44.402304 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:44.403156 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 772) took 1010 ms. Trace:
I20260709 12:11:44.400576 26618 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
W20260709 12:11:44.404961 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44807.9us
I20260709 12:11:44.337538 31463 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.421638 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:44.419203 26466 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:11:44.419282 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:44.403632 26548 rpcz_store.cc:276] 0709 12:11:43.392428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.392566 (+   138us) service_pool.cc:224] Handling call
0709 12:11:43.416213 (+ 23647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:44.018557 (+602344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.402885 (+384328us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b54000b4354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:44.403079 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1381767552}
I20260709 12:11:44.423952 26439 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:44.433238 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:44.370548 31478 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.372567 31486 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:44.369937 31500 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:44.403477 31284 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:44.360200 31456 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.394654 31483 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.342818 31095 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 12:11:44.456734 26617 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:44.394155 31548 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:44.461979 30988 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.465209 31448 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:11:44.467935 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.402890 31499 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:44.436317 31474 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:44.496253 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:44.496182 26466 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:44.436375 31183 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.496730 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:44.450158 31427 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:44.459143 31528 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:11:44.499600 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 150086us
I20260709 12:11:44.521190 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:44.499621 31509 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 12:11:44.456589 31467 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:44.439186 31503 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:44.436882 31319 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.520893 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:44.593422 26622 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:11:44.456283 31263 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:44.477542 31411 tablet_copy_client.cc:538] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:44.525259 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:44.477617 31545 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:44.459282 31500 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.398217 31502 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:44.459496 31284 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.529644 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:44.433013 31459 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:44.543215 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 145850us
W20260709 12:11:44.532150 30991 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.697s	user 0.014s	sys 0.003s
I20260709 12:11:44.581563 26621 raft_consensus.cc:2376] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10. Re-sending same reply.
W20260709 12:11:44.547225 31524 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:11:44.589381 26514 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:44.550446 31448 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:44.586587 31427 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.586282 31241 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:44.603803 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:44.601322 31397 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:44.595405 31263 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:44.592500 31561 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.600660 31503 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:44.591287 31464 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:11:44.604957 31284 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.623633 31427 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.605108 31459 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.609642 31319 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.592000 31499 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:44.724116 31499 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:44.722218 31502 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:44.650063 31561 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:44.728073 31555 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
W20260709 12:11:44.728557 31556 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 12:11:44.654186 31474 raft_consensus.cc:697] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:44.731873 31474 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:44.651368 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 62096.8us
I20260709 12:11:44.734208 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2203) took 1039 ms. Trace:
I20260709 12:11:44.641600 31263 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:44.614225 30991 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:44.710505 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 63a71194fb3446e6b7b3135fde882816: Illegal state: Replica aaadfdd9ca9f424c91505f9b43876233 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
W20260709 12:11:44.711380 31558 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 12:11:44.712172 31562 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:11:44.714826 31483 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:44.715023 31564 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:11:44.662799 31290 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:44.652129 31486 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:11:44.717409 31567 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:44.717847 31319 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:44.719097 31560 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260709 12:11:44.719183 31572 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:11:44.718923 31448 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:44.719790 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 77722us
I20260709 12:11:44.720537 31571 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:44.653985 31241 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.748334 31483 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:44.734684 26469 rpcz_store.cc:276] 0709 12:11:43.695328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.696461 (+  1133us) service_pool.cc:224] Handling call
0709 12:11:43.696841 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:43.699994 (+  3153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:43.700043 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:43.817240 (+117197us) log.cc:844] Serialized 26 byte log entry
0709 12:11:44.110492 (+293252us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b180041c9e0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:11:44.210278 (+ 99786us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:44.210314 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.210382 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:44.733863 (+523481us) raft_consensus.cc:1685] finished
0709 12:11:44.733885 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.734126 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4107,"raft.queue_time_us":97681,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":13072,"spinlock_wait_cycles":12096384,"thread_start_us":98498,"threads_started":1,"wal-append.queue_time_us":488943}
I20260709 12:11:44.640587 31548 raft_consensus.cc:697] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:44.660105 30988 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:44.739576 31183 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:11:44.736033 31508 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:44.660293 31467 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.663730 31459 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:44.752347 26541 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:11:44.739208 31506 consensus_meta.cc:287] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.793s	user 0.013s	sys 0.000s
I20260709 12:11:44.753680 26439 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:44.641520 31397 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:44.775198 27167 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:11:44.782716 26546 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 12. Current term is 13. Ops: [12.12-12.12]
W20260709 12:11:44.802336 31465 consensus_meta.cc:287] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.000s
I20260709 12:11:44.783488 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:44.784941 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:44.792305 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:44.793248 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:44.796097 26616 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:44.656709 31566 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.129s
I20260709 12:11:44.801194 31290 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:44.810068 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:44.842175 26618 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.814105 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:44.842979 26621 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:44.819422 26619 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:44.842509 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:44.822196 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:44.827319 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:44.804564 31483 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:44.834471 31270 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.003s
W20260709 12:11:44.835490 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 81944.1us
I20260709 12:11:44.848676 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:44.849938 26439 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:44.748091 31503 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:44.726210 31499 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:11:44.839000 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:44.803491 30988 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:44.841094 26542 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:44.844501 26621 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:44.853940 26614 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 15: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:44.832595 31448 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.861904 26541 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 20: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:44.866111 26468 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:44.803891 31241 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:44.872592 26617 raft_consensus.cc:1217] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[9.6-15.9]   Dedup: 10.7->[13.8-15.9]
I20260709 12:11:44.873045 31241 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:44.873311 26617 pending_rounds.cc:85] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 7
I20260709 12:11:44.873715 26617 pending_rounds.cc:107] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:11:44.874002 26617 raft_consensus.cc:2889] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:44.867791 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:44.887995 26514 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:44.894177 31502 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:44.898612 31557 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 12:11:44.899272 31570 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.899888 31570 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:44.901786 31284 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:44.902504 31577 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:44.902933 31502 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:44.903792 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.904502 31575 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:44.905156 31575 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:44.906548 31578 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:44.907235 31578 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:44.907392 31569 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:44.907991 31569 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:44.908282 31578 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:44.843334 31506 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:44.903244 31577 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:44.835835 31465 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:44.849057 31280 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
W20260709 12:11:44.918874 31497 consensus_meta.cc:287] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.723s	user 0.011s	sys 0.006s
I20260709 12:11:44.934423 31574 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:44.933547 31397 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:44.946496 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 134675us
W20260709 12:11:44.918797 30902 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.662s	user 0.014s	sys 0.000s
I20260709 12:11:44.963275 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:44.958966 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 91273.6us
I20260709 12:11:44.965096 27134 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:44.968056 31502 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:44.921201 31521 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:44.969435 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3052) took 1404 ms. Trace:
W20260709 12:11:44.930022 31272 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.694s	user 0.013s	sys 0.005s
I20260709 12:11:45.012262 26547 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:44.961952 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:45.012621 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:44.843276 31580 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:45.014227 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:45.013226 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 51388.3us
I20260709 12:11:45.019876 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:44.925233 31319 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:45.031462 26619 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:44.959865 31574 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.927116 31466 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 12:11:45.023177 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:45.012091 26620 rpcz_store.cc:276] 0709 12:11:43.565286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.565507 (+   221us) service_pool.cc:224] Handling call
0709 12:11:43.565903 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:44.274940 (+709037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.969234 (+694294us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b540003c354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:44.969381 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1536087424}
I20260709 12:11:44.959817 31569 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:45.022586 31571 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:44.970189 31576 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:44.925115 31506 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:45.083896 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 64680.3us
I20260709 12:11:44.847198 31290 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:44.964855 31284 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:45.085587 26439 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:44.868870 31486 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:44.960891 31570 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:45.046304 31476 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.774s	user 0.010s	sys 0.004s
I20260709 12:11:45.011562 31449 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.092846 31449 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:45.087020 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 55158.3us
I20260709 12:11:45.088824 31498 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:45.017032 31580 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:44.962572 31497 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:45.022915 31272 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:44.968786 31502 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:45.011633 30902 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:45.061172 31574 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:45.089413 31585 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:11:45.074165 31571 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:45.063928 30991 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:45.098241 31476 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.926734 31548 consensus_queue.cc:237] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:45.094606 31270 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:45.099313 31570 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:11:45.129055 31284 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:45.096807 31575 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:45.131842 31427 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:45.139853 31449 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:45.140892 31506 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:45.141666 31272 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:45.147657 31577 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:45.148402 31571 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.150667 31411 tablet_bootstrap.cc:492] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:11:45.151707 31465 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:45.162185 26618 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:45.154168 31270 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.102320 31508 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:45.181802 26465 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:45.184163 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:45.121603 31573 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:45.104375 31580 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.192224 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:45.164247 26471 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:45.187894 31570 consensus_queue.cc:1243] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 15.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:45.210827 26618 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:45.212518 31568 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.163s
I20260709 12:11:45.213776 31568 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:45.214210 31568 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:45.215379 31568 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:45.197404 31270 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.186472 31284 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:45.216984 31568 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:45.224841 31577 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:45.258524 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 52646.2us
I20260709 12:11:45.202695 31508 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:45.248445 31588 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.250238 31506 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.202477 31573 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:45.260155 31589 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:45.285722 31284 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:45.269408 31290 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:45.262354 31459 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:45.309284 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 344252us
I20260709 12:11:45.310925 31427 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:45.282217 31589 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:45.311851 31589 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:45.268138 31577 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:45.312371 31597 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:11:45.276053 31588 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:45.314208 31577 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:45.305193 31497 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:45.315591 31588 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:45.317878 27134 leader_election.cc:400] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15.
I20260709 12:11:45.318886 27134 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:45.320201 27134 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:45.278856 31506 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:45.280709 31483 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:45.323559 27134 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:45.322515 31427 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.328051 27160 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:45.329103 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:45.329979 27164 raft_consensus.cc:2368] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14.
I20260709 12:11:45.330061 31573 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:45.325816 31590 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:45.331698 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.334640 31502 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:45.335892 31571 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:45.340828 31571 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:45.358783 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:45.316016 31459 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:45.342252 31574 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:45.343813 31483 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:45.347141 27160 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:45.326088 30902 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:45.372184 31579 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:45.323423 31577 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.343711 31580 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:45.359472 27167 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:45.363299 31589 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:45.363839 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:45.365221 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:45.363881 27164 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:45.372695 31579 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:45.377580 31579 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:45.369663 31574 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:45.379835 26588 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:45.384167 31579 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.384859 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:45.385571 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:45.395607 31506 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:45.396119 30902 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:45.388427 31589 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:45.396982 31263 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.653s	user 0.012s	sys 0.000s
I20260709 12:11:45.397470 31263 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:45.400498 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:45.401181 26622 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:45.402166 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:45.405282 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:45.405987 26618 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
W20260709 12:11:45.407135 31500 consensus_meta.cc:287] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.800s	user 0.014s	sys 0.003s
I20260709 12:11:45.407629 31500 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:45.407145 31263 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:45.408787 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:45.409505 26618 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.376029 31508 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:45.411224 31559 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.835s	user 0.003s	sys 0.007s
I20260709 12:11:45.411156 31270 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:45.413514 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2206) took 1295 ms. Trace:
I20260709 12:11:45.414342 31500 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:45.414583 26467 rpcz_store.cc:276] 0709 12:11:44.117937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.118100 (+   163us) service_pool.cc:224] Handling call
0709 12:11:44.118465 (+   365us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:44.134369 (+ 15904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:44.134422 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:44.138858 (+  4436us) log.cc:844] Serialized 52 byte log entry
0709 12:11:44.426562 (+287704us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:44.426597 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.426682 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:45.410534 (+983852us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:45.413158 (+  2624us) raft_consensus.cc:1685] finished
0709 12:11:45.413183 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:45.413446 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11131,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":5700,"spinlock_wait_cycles":10387200,"thread_start_us":148994,"threads_started":1,"wal-append.queue_time_us":303340}
I20260709 12:11:45.419919 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:45.430588 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:45.434034 31587 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:45.417495 31508 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.434552 31587 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.435041 31587 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.434886 31508 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:45.438141 31508 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:45.429950 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 700) took 1286 ms. Trace:
I20260709 12:11:45.439751 27134 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:45.441783 31580 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:45.440677 26618 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:11:45.439666 26471 rpcz_store.cc:276] 0709 12:11:44.144297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.144486 (+   189us) service_pool.cc:224] Handling call
0709 12:11:44.147651 (+  3165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:45.201536 (+1053885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.429646 (+228110us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540027a6d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:45.429868 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2330007936}
I20260709 12:11:45.450564 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:45.452611 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:45.456036 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2209) took 1205 ms. Trace:
I20260709 12:11:45.456456 26468 rpcz_store.cc:276] 0709 12:11:44.250847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.296597 (+ 45750us) service_pool.cc:224] Handling call
0709 12:11:44.325142 (+ 28545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:44.871124 (+545982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.455765 (+584641us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b54001c0f54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:45.455971 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1230572928}
I20260709 12:11:45.450817 31577 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:45.460251 31577 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:45.460837 31270 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:45.462673 27134 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:45.506428 31608 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:45.507016 31608 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:45.507886 31608 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:45.460701 31577 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:45.519748 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:45.520040 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:45.504277 31581 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.523869 31547 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:11:45.525817 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:45.526299 31547 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:45.526718 31547 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:45.527170 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:45.527812 26618 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.527511 31547 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:45.529122 31547 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:45.534219 31595 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.441s	user 0.002s	sys 0.000s
I20260709 12:11:45.536327 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:45.537175 31606 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 12:11:45.537675 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:45.539050 26616 raft_consensus.cc:2368] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14.
I20260709 12:11:45.539822 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:45.541328 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:45.542711 27160 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 13: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:45.543635 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:45.544847 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:45.545682 26616 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:45.547173 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:45.548118 26622 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 16: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:45.549955 26613 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:45.549860 31587 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:45.550549 31581 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:45.552793 26622 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:45.553467 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:45.547976 31561 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:45.559044 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:45.559856 26613 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:45.563705 26618 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:11:45.565608 26546 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:45.567313 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:45.571439 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:45.571923 27166 raft_consensus.cc:2368] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12.
I20260709 12:11:45.574016 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:45.575785 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:45.575753 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:45.578042 26467 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:45.560652 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:45.580075 26539 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:11:45.584410 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:45.585328 31502 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:11:45.586270 31613 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:11:45.589399 31577 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:45.593976 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:45.594718 26469 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:45.598743 26539 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:45.600970 26539 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:45.602095 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:45.617409 26470 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:45.582142 31574 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.619414 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:45.617018 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:45.621112 26464 raft_consensus.cc:2410] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:11:45.622963 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3205) took 1216 ms. Trace:
I20260709 12:11:45.623386 26465 rpcz_store.cc:276] 0709 12:11:44.406123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.406251 (+   128us) service_pool.cc:224] Handling call
0709 12:11:44.439942 (+ 33691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:45.196543 (+756601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.622725 (+426182us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b54001ff4d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:45.622903 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1705675008}
I20260709 12:11:45.622855 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:45.627650 26472 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 16: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:45.581816 31483 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.591284 31578 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.572717 31586 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:45.639351 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:45.644313 26542 raft_consensus.cc:2410] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:11:45.581383 31573 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:45.642907 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:45.645063 26546 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:45.617436 31497 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:45.646200 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.580510 31456 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 12:11:45.686721 26465 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:45.589444 31546 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 12:11:45.689002 26465 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:45.643365 31488 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.713898 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:45.715333 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:45.719667 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:45.719836 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:45.720381 26548 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
I20260709 12:11:45.721432 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:45.721560 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:45.714852 31565 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:45.742749 26467 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:11:45.723171 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:45.752723 31469 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.753247 26546 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:45.754299 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:45.722781 26465 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:45.755582 26465 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.757915 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2338) took 1750 ms. Trace:
I20260709 12:11:45.758795 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:45.753274 31469 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:45.759558 27164 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:11:45.761436 31469 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:45.749646 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:45.748773 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:45.763667 26548 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 11: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:45.758356 26540 rpcz_store.cc:276] 0709 12:11:44.007958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.015432 (+  7474us) service_pool.cc:224] Handling call
0709 12:11:44.015812 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:44.016171 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:44.016199 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:44.016702 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:11:44.335518 (+318816us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:44.335559 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.335631 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:45.755878 (+1420247us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b24002b3508. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072e739c4 00007f5072e71acb 00007f507302cdc9 00007f507302ca55 00007f507302bfb0 00007f5075ca2488 00007f5075ca2be8 00007f5075c7a398 00007f5075c7576a 00007f5075c74bb6
0709 12:11:45.757556 (+  1678us) raft_consensus.cc:1685] finished
0709 12:11:45.757578 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:45.757839 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":809,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":7325,"spinlock_wait_cycles":39401216,"thread_start_us":206725,"threads_started":1,"wal-append.queue_time_us":439967}
I20260709 12:11:45.723680 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:45.724465 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.744969 26616 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:45.688464 31589 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.723234 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:45.776832 26465 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:45.777487 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:45.775429 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 153639us
W20260709 12:11:45.792073 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.780136 26439 leader_election.cc:400] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14.
I20260709 12:11:45.779992 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:45.643806 31483 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:45.798425 26439 leader_election.cc:403] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:11:45.800676 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:45.801625 26466 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:45.722447 31474 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:45.752007 31565 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:45.642164 31574 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:45.805732 26615 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:45.780205 31028 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.680753 31573 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:45.811194 26439 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:45.798431 31589 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:45.814924 26464 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:45.805608 31456 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:45.897828 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 86753us
I20260709 12:11:45.657279 31586 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:45.848479 26470 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:45.903959 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:45.884011 31483 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:45.915993 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:45.773168 31500 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:45.916721 26622 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:45.915387 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:45.920099 26616 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:11:45.896678 31577 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:45.880775 31565 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:45.882452 31574 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:45.767823 31488 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:45.929639 31589 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:45.930421 31464 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:45.930548 31286 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.946647 31573 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:45.814476 31478 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 12:11:45.816814 31497 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.107s
I20260709 12:11:45.949385 31586 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:45.901973 31502 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:45.918138 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:45.918354 31546 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:45.811626 31474 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:45.927459 31483 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:11:45.970589 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 52534.8us
I20260709 12:11:45.844029 30988 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:45.976560 31546 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:45.953895 31500 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:45.963019 31286 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:45.974675 31574 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:45.962786 31464 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:45.980715 31502 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:46.023121 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3076) took 1221 ms. Trace:
I20260709 12:11:46.003960 30988 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.018086 31574 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.028580 26617 rpcz_store.cc:276] 0709 12:11:44.801656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.850938 (+ 49282us) service_pool.cc:224] Handling call
0709 12:11:44.851332 (+   394us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:11:44.927450 (+ 76118us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:45.165605 (+238155us) log.cc:844] Serialized 14 byte log entry
0709 12:11:45.260362 (+ 94757us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:45.261317 (+   955us) log.cc:844] Serialized 52 byte log entry
0709 12:11:45.261521 (+   204us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:45.261573 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.536468 (+274895us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:46.022779 (+486311us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b540003be54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:46.022837 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:46.022883 (+    46us) raft_consensus.cc:1685] finished
0709 12:11:46.022897 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:46.023057 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52588,"prepare.queue_time_us":327406,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":59817,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":27785,"spinlock_wait_cycles":59842048,"thread_start_us":203196,"threads_started":2,"wal-append.queue_time_us":89518}
I20260709 12:11:45.978358 31483 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
W20260709 12:11:46.042488 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 119321us
I20260709 12:11:46.055418 31474 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:46.056537 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:46.062297 31500 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:46.063789 31488 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:46.068094 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.063707 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:46.070613 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:46.038026 31574 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.088266 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:46.089723 26615 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:11:46.104427 26439 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:46.107537 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:11:46.087164 31547 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.558s	user 0.012s	sys 0.002s
I20260709 12:11:46.108146 26438 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:46.112126 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:46.039994 31546 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:46.116773 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:46.117591 26540 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:46.104493 31028 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:46.112965 26539 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.114039 26542 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:46.109877 31624 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.115309 31625 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:46.106675 31478 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:46.128015 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:46.133245 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:46.133543 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:46.134167 26546 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.135090 26548 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:46.138121 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:46.119095 31547 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.138854 26540 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:46.139036 26542 raft_consensus.cc:2410] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:11:46.143988 26540 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:11:46.139595 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.107213 31568 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:11:46.143363 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:46.128463 31625 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.144819 26540 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:46.153100 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:46.153805 26544 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:11:46.154850 26540 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.087687 31502 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:46.162696 26540 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:46.128778 31624 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:46.165889 26539 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:46.170089 26472 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:11:46.151005 31286 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:46.171017 27161 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:46.173255 26546 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:11:46.174502 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:46.175232 26546 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:46.180323 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:46.181404 26539 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 16: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:46.180339 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:46.137899 31626 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.184098 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:46.178157 31456 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14.
I20260709 12:11:46.185585 31497 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:46.185858 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:46.187074 31483 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:46.142468 31464 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:46.142933 31028 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:46.188436 26615 raft_consensus.cc:2376] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13. Re-sending same reply.
I20260709 12:11:46.199374 26543 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.164714 31625 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:46.187064 26546 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:46.143164 31478 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:46.147663 31547 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:46.212555 31601 log.cc:927] Time spent T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.928s	user 0.002s	sys 0.000s
I20260709 12:11:46.194099 31626 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:46.214197 26614 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:46.227555 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2427) took 1262 ms. Trace:
W20260709 12:11:46.228394 31618 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
I20260709 12:11:46.229364 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:46.219161 26371 catalog_manager.cc:5697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 11 to 14, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 14 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:11:46.231529 31467 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:11:46.231773 31478 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:46.153115 31629 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:46.220391 31581 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:46.232532 31629 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:46.184617 31630 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:46.194101 26617 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
W20260709 12:11:46.234241 31616 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.339s	user 0.001s	sys 0.001s
I20260709 12:11:46.234977 31629 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:46.236443 31615 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
W20260709 12:11:46.240487 31603 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.946s	user 0.002s	sys 0.000s
I20260709 12:11:46.227943 26614 rpcz_store.cc:276] 0709 12:11:44.965551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.965711 (+   160us) service_pool.cc:224] Handling call
0709 12:11:45.020159 (+ 54448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:46.214034 (+1193875us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b540030b9a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f5076051dc0 00007f50760dc1c0 00007f50760dd231 00007f50760d9d8f 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c
0709 12:11:46.227283 (+ 13249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:46.227493 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7263488}
I20260709 12:11:46.226786 31466 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:46.242584 31587 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:46.242363 31466 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:46.211845 31624 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:46.244604 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2431) took 1232 ms. Trace:
I20260709 12:11:46.245026 26619 rpcz_store.cc:276] 0709 12:11:45.011981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.086055 (+ 74074us) service_pool.cc:224] Handling call
0709 12:11:45.098954 (+ 12899us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:45.121129 (+ 22175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:45.121163 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:45.141908 (+ 20745us) log.cc:844] Serialized 52 byte log entry
0709 12:11:45.204808 (+ 62900us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:45.204851 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.204922 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:46.239883 (+1034961us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:46.244302 (+  4419us) raft_consensus.cc:1685] finished
0709 12:11:46.244324 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:46.244537 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19490,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":25978,"spinlock_wait_cycles":2324736,"thread_start_us":62461,"threads_started":1,"wal-append.queue_time_us":110170}
I20260709 12:11:46.214272 31547 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:46.246922 31573 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:46.247339 31573 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:46.248198 31573 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:46.249467 31573 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.249752 31286 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:46.244650 31466 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:46.254108 26514 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:46.191000 31489 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.599s	user 0.003s	sys 0.035s
I20260709 12:11:46.265916 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:46.268679 27163 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:11:46.267059 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2345) took 1514 ms. Trace:
I20260709 12:11:46.269899 26547 rpcz_store.cc:276] 0709 12:11:44.752864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.830657 (+ 77793us) service_pool.cc:224] Handling call
0709 12:11:44.830954 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:45.012724 (+181770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:46.266806 (+1254082us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400105ed4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:46.266994 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416488832}
I20260709 12:11:46.270464 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:46.271761 26514 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:46.256350 26543 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:46.274742 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:46.258841 26588 leader_election.cc:400] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12.
I20260709 12:11:46.278406 26588 leader_election.cc:403] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:46.260062 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:46.280303 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.266673 30991 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:11:46.284080 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.266114 26371 catalog_manager.cc:5697] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:46.267215 31478 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:46.274691 31498 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:46.315688 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 56993.3us
I20260709 12:11:46.266181 31575 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:46.299435 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 156130us
I20260709 12:11:46.294205 26439 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:46.319324 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:46.283634 31286 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:46.264806 31489 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.676s	user 0.003s	sys 0.036s
I20260709 12:11:46.286602 31626 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:46.287328 31467 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:46.283383 31447 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:11:46.339891 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 45779.5us
I20260709 12:11:46.290563 31561 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.281757 30991 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:46.275415 31459 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:11:46.318524 31488 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.316042 31498 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.353353 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:46.346683 31630 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:46.378813 26547 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:46.355336 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:46.380784 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:46.356112 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:46.355365 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:46.382522 26540 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.351505 31566 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:11:46.362836 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 43637.5us
I20260709 12:11:46.391407 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:46.318851 30988 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:46.327426 31464 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.327960 31575 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:46.339468 31453 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:46.372351 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 88424.3us
I20260709 12:11:46.399889 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:46.373787 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.315102 31540 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:11:46.375823 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:46.376981 26541 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:46.317589 31478 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:46.347095 31286 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:46.384692 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:46.390165 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:46.350795 31467 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.395533 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:46.397028 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:46.402683 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:46.410491 26619 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17. Ops: [12.7-16.9]
I20260709 12:11:46.409795 26466 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:46.417886 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:46.408206 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:46.412439 26467 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:46.394244 31626 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:46.409263 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:46.392679 31498 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:46.367444 31447 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:46.401593 26544 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:11:46.393182 31630 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:46.390903 31566 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:46.391723 31565 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.420487 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:46.453701 26464 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:46.456192 31624 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.368203 31546 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:46.373821 31561 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:46.477022 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:46.467825 26540 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:46.375804 31574 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:46.501621 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 81212.5us
I20260709 12:11:46.397022 31263 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.451093 31456 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:46.399435 31270 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:11:46.409602 31478 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:46.536923 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:46.392052 31488 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:46.544287 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:46.475234 31575 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:46.399102 30988 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:46.452926 31467 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.408779 31578 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.131s
I20260709 12:11:46.549835 27162 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.550503 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:46.408366 31464 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:46.555563 26620 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:46.468871 31356 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:11:46.456406 31459 consensus_queue.cc:1059] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 12:11:46.557473 26616 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:46.493209 31630 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.561987 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:46.564113 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:46.564602 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:46.419507 31453 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:46.476385 31625 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:46.477079 31626 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:46.596546 26546 raft_consensus.cc:2410] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:46.519889 31634 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.523473 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:46.648172 26619 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:11:46.473973 31540 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 12:11:46.566427 31581 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:11:46.622359 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 57861.6us
I20260709 12:11:46.447422 31286 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:46.623538 31356 consensus_queue.cc:1243] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 15.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:46.549754 31624 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:11:46.517266 31565 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:46.643060 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 191771us
I20260709 12:11:46.598003 31500 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.599896 30991 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:46.654843 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 338343us
W20260709 12:11:46.599479 31595 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:46.661643 27162 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:46.663266 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:46.780967 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:46.669973 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:46.712123 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 196658us
W20260709 12:11:46.744890 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.782089 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:46.659834 31453 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:46.797951 31639 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.798781 31639 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:46.807525 31488 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:46.808372 31639 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:46.809540 31464 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:46.812376 31626 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:46.812918 27162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 692) took 1260 ms. Trace:
I20260709 12:11:46.813287 27162 rpcz_store.cc:276] 0709 12:11:45.520559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.520690 (+   131us) service_pool.cc:224] Handling call
0709 12:11:46.544107 (+1023417us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:11:46.781133 (+237026us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38877952}
I20260709 12:11:46.814893 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:46.815666 26619 raft_consensus.cc:2368] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 10. Current term is 11.
I20260709 12:11:46.817802 26619 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:46.820319 27163 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:46.822719 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:46.823239 31634 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:46.825572 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 162422us
I20260709 12:11:46.644191 31587 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:46.869679 27134 leader_election.cc:400] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 10. Current term is 11.
I20260709 12:11:46.872124 27134 leader_election.cc:403] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:46.875245 31639 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:46.875909 31639 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:46.876415 31639 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:46.910521 26470 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:46.916745 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 47103.4us
I20260709 12:11:46.822728 31582 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:11:46.921648 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 95147us
W20260709 12:11:46.883411 31573 consensus_meta.cc:287] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.634s	user 0.005s	sys 0.009s
W20260709 12:11:46.926738 31489 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.012s	sys 0.028s
I20260709 12:11:46.886165 31456 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:46.939762 26473 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17. Ops: [12.7-16.9]
I20260709 12:11:46.937084 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:46.916610 31453 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.966521 26465 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:46.966940 26464 raft_consensus.cc:2368] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16.
I20260709 12:11:46.967957 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:46.781098 31500 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:46.923457 31459 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:11:46.942785 31447 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:47.005820 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:46.983050 31262 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.011s	sys 0.041s
I20260709 12:11:46.914287 31630 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:47.006908 26464 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.011483 31457 raft_consensus.cc:3055] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:46.927973 31641 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 12:11:47.017508 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:47.020241 31637 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
I20260709 12:11:46.941838 31626 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:11:47.023977 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:47.047940 26465 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
W20260709 12:11:47.036407 26513 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.523s (SENT) [suppressed 15 similar messages]
I20260709 12:11:47.042075 31580 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:11:47.045897 31614 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.164s	user 0.021s	sys 0.018s
I20260709 12:11:46.987282 31456 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:47.057698 31580 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:47.059111 31456 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:47.059051 31580 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.061462 31580 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.028013 31566 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.063090 31566 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:47.066092 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:47.067976 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:47.069123 26465 raft_consensus.cc:2410] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:11:46.898533 31478 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:46.992228 31574 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:47.010020 31262 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.011s	sys 0.042s
I20260709 12:11:46.980585 31453 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.054162 26472 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 15: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:47.075076 31453 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:47.072469 31581 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.076622 31581 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:47.084018 31581 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:47.084239 31478 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:47.115010 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 461266us
I20260709 12:11:47.024971 31457 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:47.016425 31561 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:47.087986 31648 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.050535 31568 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:47.085522 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:47.170607 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:47.243783 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 374264us
I20260709 12:11:47.088505 31540 consensus_queue.cc:1059] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
W20260709 12:11:47.139567 31643 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.130s	user 0.001s	sys 0.001s
I20260709 12:11:47.289808 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:47.293727 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:47.236774 31625 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:47.236850 31463 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:47.296415 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:47.307412 31467 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.710s	user 0.009s	sys 0.001s
W20260709 12:11:47.310041 31651 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:11:47.310952 31650 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:47.286844 31466 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:47.293934 31655 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:47.237702 31581 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 10. Current term is 11.
W20260709 12:11:47.313959 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 277590us
I20260709 12:11:47.266297 31521 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:47.325325 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:47.312815 31498 consensus_meta.cc:287] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.816s	user 0.011s	sys 0.000s
I20260709 12:11:47.318743 31456 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.325778 31489 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.330047 31466 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.324797 31467 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.322152 31566 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:11:47.349138 26543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 780) took 3124 ms (client timeout 1612 ms). Trace:
I20260709 12:11:47.348594 26371 catalog_manager.cc:5697] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:47.354799 26545 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:47.237130 31648 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.256263 31568 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:47.324170 31463 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.356555 31629 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:47.358567 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:47.362998 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3101) took 1088 ms. Trace:
I20260709 12:11:47.365639 26465 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
W20260709 12:11:47.367552 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 122902us
W20260709 12:11:47.323402 31263 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.779s	user 0.007s	sys 0.004s
I20260709 12:11:47.387601 26469 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:47.368013 26464 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:47.373368 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:47.394450 26471 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
W20260709 12:11:47.374715 26543 rpcz_store.cc:269] 0709 12:11:44.224211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.240971 (+ 16760us) service_pool.cc:224] Handling call
0709 12:11:47.348886 (+3107915us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b540018bfd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:47.349031 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4432603008}
I20260709 12:11:47.395015 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:47.382017 31635 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.760s	user 0.000s	sys 0.008s
I20260709 12:11:47.388048 26615 rpcz_store.cc:276] 0709 12:11:46.274287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.276236 (+  1949us) service_pool.cc:224] Handling call
0709 12:11:46.276617 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:46.314985 (+ 38368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:46.315017 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:46.323875 (+  8858us) log.cc:844] Serialized 26 byte log entry
0709 12:11:46.606075 (+282200us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:46.606143 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:46.606241 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:47.361986 (+755745us) raft_consensus.cc:1685] finished
0709 12:11:47.362238 (+   252us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.362914 (+   676us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15308,"raft.queue_time_us":93207,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":9498,"thread_start_us":214642,"threads_started":1,"wal-append.queue_time_us":570431}
I20260709 12:11:47.394804 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:47.400538 26464 raft_consensus.cc:2368] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13.
I20260709 12:11:47.322817 31565 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:47.398680 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:47.371512 31456 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.406556 26465 raft_consensus.cc:2368] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16.
I20260709 12:11:47.378364 31547 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:47.384933 31500 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:47.370900 31498 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.410946 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:47.369364 31521 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.387040 31629 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:47.374181 31489 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.416610 26471 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:47.399411 31263 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12.
W20260709 12:11:47.424388 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 290666us
I20260709 12:11:47.366786 31655 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:47.409797 31565 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.379390 31566 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:47.435631 26464 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:47.415324 31483 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:47.419451 31630 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:47.454586 26618 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:47.416677 31547 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.467986 31466 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:47.468281 31659 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:11:47.468647 31466 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:47.468783 31547 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:47.469532 31664 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:47.470168 31664 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:47.471975 31500 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:47.472638 31500 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.469251 31466 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:47.558138 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 130154us
I20260709 12:11:47.448669 31665 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:47.559688 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 133844us
I20260709 12:11:47.464740 31656 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 12:11:47.566310 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 790) took 1212 ms. Trace:
I20260709 12:11:47.566921 26546 rpcz_store.cc:276] 0709 12:11:46.354193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.355057 (+   864us) service_pool.cc:224] Handling call
0709 12:11:47.566008 (+1210951us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54000b4d54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:47.566221 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497526656}
I20260709 12:11:47.472714 31664 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:47.437072 31565 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:47.573637 31665 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:47.578878 31641 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:47.579675 31641 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:47.580149 31665 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:47.581053 31661 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:11:47.581251 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3100) took 1307 ms. Trace:
I20260709 12:11:47.581635 26617 rpcz_store.cc:276] 0709 12:11:46.274018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.275474 (+  1456us) service_pool.cc:224] Handling call
0709 12:11:46.275744 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:46.276020 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:46.650690 (+374670us) log.cc:844] Serialized 14 byte log entry
0709 12:11:47.580874 (+930184us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:47.580930 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:47.580982 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.581058 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.581188 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":545386,"prepare.queue_time_us":390375,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"thread_start_us":715499,"threads_started":2,"wal-append.queue_time_us":629712}
W20260709 12:11:47.580348 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.464495 31483 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:47.580006 31641 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:47.586344 31639 consensus_meta.cc:287] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.709s	user 0.003s	sys 0.011s
I20260709 12:11:47.592640 31500 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:47.589109 30902 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:47.591405 31657 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:11:47.589250 31208 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:47.592374 31466 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:47.608404 31483 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:47.599218 31566 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:47.636857 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:47.609613 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.609681 31648 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:47.602945 31580 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:47.611657 31641 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.613390 31521 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:47.613953 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2346) took 2860 ms. Trace:
I20260709 12:11:47.643589 26545 rpcz_store.cc:276] 0709 12:11:44.753186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.842194 (+ 89008us) service_pool.cc:224] Handling call
0709 12:11:47.354532 (+2512338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:47.375985 (+ 21453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.613634 (+237649us) spinlock_profiling.cc:243] Waited 2.49 s on lock 0x7b540018bfd0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:47.613837 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5723169664}
I20260709 12:11:47.550275 31629 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:47.609077 30988 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:47.647675 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:47.634774 31655 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:47.632529 31667 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:47.655233 31629 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.656776 31565 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:47.651763 31648 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:47.657121 31568 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:47.651892 31463 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:47.648886 31580 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:47.646059 31263 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.635609 31500 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:11:47.658885 31456 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:47.635238 31208 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:11:47.631815 30902 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:47.660926 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:47.631913 31639 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.661747 31447 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.670353 26469 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:47.676061 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:47.677312 30902 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:47.678529 31208 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:47.680656 31639 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:47.672889 31263 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:47.683962 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 716090us
I20260709 12:11:47.666692 31467 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:47.666947 31648 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:47.697855 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:47.696914 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:47.663120 30988 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:11:47.686533 31500 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:47.703603 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:47.702777 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:47.662840 31667 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.706986 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:47.708467 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:47.710816 31639 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:47.711416 31639 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.711807 31639 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.716044 31580 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:47.698351 31466 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:47.682829 31447 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.718725 31561 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:47.719414 31561 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:47.719871 31561 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.720106 31447 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:47.696002 31489 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:47.709141 31647 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:47.721292 31647 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.721748 31647 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.700942 31648 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.706784 31208 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:47.727288 31208 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:47.728518 31208 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.729807 31639 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.731194 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:47.738420 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 176541us
I20260709 12:11:47.732360 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:47.739867 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:47.697855 31498 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:47.741026 26513 leader_election.cc:400] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13.
I20260709 12:11:47.741416 26513 leader_election.cc:403] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:47.742874 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:47.743992 26543 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 14: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:47.745930 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:47.747150 26547 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 16: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:47.749176 26513 leader_election.cc:400] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16.
I20260709 12:11:47.749218 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:47.749840 26513 leader_election.cc:403] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:47.707333 31673 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:47.752319 26513 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:47.755613 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:47.738252 31467 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:47.708541 31575 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:11:47.757822 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:47.746503 31453 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:47.765713 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:47.750659 31655 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:47.750772 30988 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:47.750456 31565 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.755030 31489 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.762748 31498 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:47.774770 31667 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:47.778740 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:47.768744 31670 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:47.780596 31670 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:47.771062 31466 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:47.786541 31667 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:47.755746 31672 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:47.788308 31672 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:47.788419 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:47.788828 31672 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.788436 31457 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:47.790570 31263 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:47.791035 31457 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.796450 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 719) took 1383 ms. Trace:
I20260709 12:11:47.796507 26465 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:47.797102 26472 rpcz_store.cc:276] 0709 12:11:46.413185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.413332 (+   147us) service_pool.cc:224] Handling call
0709 12:11:47.796148 (+1382816us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b54001fefd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:47.796338 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1256315136}
I20260709 12:11:47.799271 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:47.800141 31453 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:47.802168 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:47.799270 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.805908 26469 raft_consensus.cc:2376] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13. Re-sending same reply.
I20260709 12:11:47.806725 27162 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:47.803295 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:47.807811 26468 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:47.808271 31632 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:47.809094 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:47.803218 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:47.755462 31673 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.808357 26621 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:47.808881 31632 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:47.787007 31466 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.803751 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:47.764209 31467 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:47.781678 31670 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:47.813525 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:47.815357 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:47.812101 31673 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.802181 31453 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.772123 30988 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.802923 31498 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.815568 31679 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:47.824056 31548 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.830615 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:47.818408 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:47.817011 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:47.832074 26616 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 16: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:47.826797 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:47.816123 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3098) took 1542 ms. Trace:
I20260709 12:11:47.828312 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:47.832774 26540 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:47.833081 26539 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:11:47.824541 31679 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.829186 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:47.834978 26543 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:47.802755 31447 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.836143 31447 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:47.838836 26613 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:47.831369 26546 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:47.839816 31639 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:47.840442 31447 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:47.842639 31561 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.844242 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:47.844072 31632 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.750636 31581 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 12:11:47.845949 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:47.846655 26472 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:11:47.846560 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:47.847457 26469 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:11:47.847779 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:47.848294 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:47.848964 26469 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:47.850983 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:47.851162 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:47.804571 31500 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.852270 31500 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.848398 26472 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:47.823956 31580 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:47.852953 26469 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:47.856395 26469 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:47.861279 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:47.862819 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:47.867681 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:47.868160 31632 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.869894 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:47.871311 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:47.872205 26545 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:47.890636 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:47.891760 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:47.816797 31466 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.820446 31467 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.823410 30988 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:47.907658 31638 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.097s	user 0.006s	sys 0.025s
I20260709 12:11:47.916822 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:47.921792 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:47.930224 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:47.930305 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:47.923246 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:47.933058 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:47.874759 26614 rpcz_store.cc:276] 0709 12:11:46.273442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.279139 (+  5697us) service_pool.cc:224] Handling call
0709 12:11:46.292926 (+ 13787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:46.293136 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:46.560144 (+267008us) log.cc:844] Serialized 14 byte log entry
0709 12:11:47.565270 (+1005126us) spinlock_profiling.cc:243] Waited 8.15 ms on lock 0x7b1800306700. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5072fefa40 00007f5072fea4e4 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287 00007f50760f5208
0709 12:11:47.813084 (+247814us) log.cc:844] Serialized 14 byte log entry
0709 12:11:47.815364 (+  2280us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:47.815410 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:47.815454 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.815923 (+   469us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.816052 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66689,"prepare.queue_time_us":623577,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":5111,"raft.queue_time_us":632203,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":2025,"spinlock_wait_cycles":18755328,"thread_start_us":847565,"threads_started":3,"wal-append.queue_time_us":531887}
I20260709 12:11:47.934712 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:47.873414 31447 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:47.968003 26469 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:47.956442 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:47.963881 26473 raft_consensus.cc:2410] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:11:47.949275 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:47.966866 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:47.962373 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:47.977382 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 54218.6us
W20260709 12:11:47.978446 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.979302 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:47.823894 31498 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.855193 31580 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.917274 31463 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:47.987066 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:47.971701 27166 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:47.862156 31548 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:47.998950 27160 raft_consensus.cc:2410] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:11:47.930151 31028 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:47.984985 31411 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:47.961488 31489 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16.
W20260709 12:11:47.929980 31638 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.119s	user 0.006s	sys 0.025s
I20260709 12:11:47.936379 31456 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.981107 31547 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:47.983845 31453 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.984073 31208 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:11:48.021139 26466 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:48.000180 31575 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:11:47.994851 31509 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:47.936215 31630 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.967684 31677 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 12:11:48.006104 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:48.008210 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:48.072392 26620 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:11:47.991418 31629 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:11:48.018747 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:48.019979 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:47.952836 31648 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.002339 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:48.008937 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:48.084393 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:48.004091 31263 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 12:11:48.133404 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:48.133802 31263 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:48.074769 31630 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:48.085114 27159 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:48.134356 26616 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:11:48.117151 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:48.121250 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 204315us
I20260709 12:11:48.116211 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:48.097191 31548 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:48.144686 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 119030us
I20260709 12:11:47.989923 31447 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:48.022110 31547 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.119092 31672 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:48.013712 31028 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:48.119707 31561 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:48.118938 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:48.113003 31411 tablet_bootstrap.cc:492] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:11:48.246279 27168 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
W20260709 12:11:48.123484 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 121250us
I20260709 12:11:48.252751 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:48.133710 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:48.004022 31463 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.023751 31500 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:48.114285 27162 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:48.260095 27162 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:48.133242 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:48.260908 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:48.261430 26620 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.141139 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:48.070144 31667 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:48.144140 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:47.994743 31457 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:11:48.024919 31456 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.164633 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:48.166713 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:48.172240 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:48.173677 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:48.173875 31648 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:48.143874 31647 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.176580 31498 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:48.178421 31630 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:48.178979 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:48.179217 31580 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:48.133322 31677 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:48.134356 31263 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:48.179852 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:48.178138 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:48.336591 26548 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:48.179854 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:48.338027 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:48.248833 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:48.254508 30988 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:48.258113 26469 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 16: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:48.264650 27167 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:48.265993 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:48.266808 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:48.268584 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:48.271636 31561 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:48.342720 26615 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 13: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:48.273706 31463 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:48.275134 31672 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:48.275851 31679 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:48.259439 31673 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:48.277719 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 251818us
W20260709 12:11:48.278476 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:48.284854 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 368144us
I20260709 12:11:48.324106 27162 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:48.332499 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:48.333846 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 348805us
I20260709 12:11:48.338716 26541 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:48.283847 31208 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:48.363075 31208 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.363564 31208 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:48.364464 31673 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:48.364969 27162 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.350421 31540 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:48.366215 31630 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.366801 31630 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.368887 26542 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 14: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:48.369315 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:48.369711 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:48.369045 31630 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:48.372311 31456 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:48.372936 26545 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 16: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:48.373317 31263 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.373843 31447 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:48.374349 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:48.374719 31263 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.375093 26464 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:11:48.376111 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:48.376678 26464 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:11:48.377573 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:48.378149 31647 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:48.340570 26470 raft_consensus.cc:2410] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:48.340713 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:48.373987 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:48.362499 26620 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:48.380052 26545 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 9.
I20260709 12:11:48.380581 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:48.381704 26539 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:11:48.382721 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:48.341405 26467 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 15: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:48.250160 31565 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13.
I20260709 12:11:48.343168 30988 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:48.325584 31500 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:48.326057 31667 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:11:48.346807 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 80899.3us
I20260709 12:11:48.258775 31466 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:48.348793 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:48.350536 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:48.408639 26548 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:48.357175 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:48.357245 26439 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:48.354270 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:48.499119 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 144917us
I20260709 12:11:48.499972 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:48.501339 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:48.384135 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:48.503019 30988 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:48.503443 30988 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:48.503801 30988 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.348209 31561 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.389016 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:48.505964 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:48.405138 26543 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:48.406910 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:48.482877 27162 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:48.457877 26548 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:48.408631 26469 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:48.445845 26541 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
W20260709 12:11:48.482888 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:48.509497 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 152323us
W20260709 12:11:48.509846 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.445421 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:48.395592 31689 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:11:48.454676 31028 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:48.495612 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:48.359033 31580 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.442262 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:48.516613 26541 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:48.396695 31411 tablet_bootstrap.cc:492] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:11:48.527815 31411 ts_tablet_manager.cc:1403] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 3.377s	user 0.059s	sys 0.072s
I20260709 12:11:48.528654 27159 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 15: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:48.348287 31467 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.467185 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3234) took 1237 ms. Trace:
I20260709 12:11:48.531669 26465 rpcz_store.cc:276] 0709 12:11:47.229335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.659896 (+430561us) service_pool.cc:224] Handling call
0709 12:11:47.796306 (+136410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:47.797293 (+   987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.466914 (+669621us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54001fefd0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:48.467106 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312752384}
I20260709 12:11:48.460971 26544 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 13: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:48.474993 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:48.483628 31699 log.cc:927] Time spent T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:11:48.400305 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:48.535396 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 135197us
I20260709 12:11:48.473814 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:48.507313 27168 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:48.513520 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:48.514247 26548 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:48.471356 31638 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:48.409327 31500 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:48.516095 31630 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:48.516333 31498 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:48.524900 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:48.525210 26540 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:48.556403 27162 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:48.526635 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:48.528719 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:48.537010 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 63295.3us
I20260709 12:11:48.558566 26438 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:48.557482 26622 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:48.559725 31638 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.560585 31561 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:48.540658 31639 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:48.561757 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:48.562515 26613 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:11:48.563328 31695 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:48.565215 31695 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:48.565325 31497 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:48.566493 31629 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:48.530645 31580 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.566946 31629 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:48.568007 31629 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:48.569350 31629 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.570931 31466 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:48.571352 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:48.572968 31624 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:48.573680 31624 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:48.540845 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:48.543020 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:48.574736 27166 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:11:48.514904 31698 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:48.508505 31566 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:48.575875 31561 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:48.576498 31561 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.576884 31561 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.577087 31467 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:48.510322 31565 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.578083 31565 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:48.573902 31500 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:48.575155 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:48.580466 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:48.580869 31647 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:48.581473 31647 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.581938 31647 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:48.582803 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:48.583398 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:48.583751 26465 raft_consensus.cc:2410] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:11:48.584053 26470 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:11:48.584969 31673 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:48.575944 31566 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.587039 31566 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:48.560545 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:48.588620 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:48.589795 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:48.570921 31625 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:48.556469 31630 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:48.592386 31630 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:48.547335 31694 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:11:48.598573 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:48.603325 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.539623 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:48.604524 31467 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:48.604997 31467 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.605449 31467 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:48.606998 31565 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:48.609467 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:11:48.610517 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 70999.9us
I20260709 12:11:48.611557 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:48.612520 31565 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:48.613036 31565 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.613445 31565 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:48.614825 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:48.615655 31677 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:48.616029 31677 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.616360 31677 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.598088 31208 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.619407 26617 raft_consensus.cc:2393] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:48.623656 31521 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:48.624069 31521 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:48.624737 31677 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.625037 31521 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.626322 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:48.627187 31540 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:48.627568 31540 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.627903 31540 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:48.633549 31641 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:48.636221 31208 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:48.636838 31575 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:48.637293 31575 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:48.637665 31575 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:48.637730 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:48.638571 26547 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 16: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:11:48.605149 26618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 777) took 1824 ms (client timeout 1644 ms). Trace:
W20260709 12:11:48.642714 26618 rpcz_store.cc:269] 0709 12:11:46.780536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.780663 (+   127us) service_pool.cc:224] Handling call
0709 12:11:48.604934 (+1824271us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b540037b254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:48.605060 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1491760000}
I20260709 12:11:48.644351 26540 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:48.645324 31411 raft_consensus.cc:359] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.647365 26540 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:11:48.647312 31411 raft_consensus.cc:740] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:11:48.649356 31411 consensus_queue.cc:260] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:11:48.652590 31411 ts_tablet_manager.cc:1434] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.124s	user 0.003s	sys 0.007s
I20260709 12:11:48.658898 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:48.659168 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:48.661672 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:48.663326 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:48.664927 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:48.665604 26470 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:11:48.666188 26618 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:48.665896 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:48.666980 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:48.667307 26622 raft_consensus.cc:2368] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 13. Current term is 14.
I20260709 12:11:48.667284 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:48.667766 26470 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:48.668819 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:48.669126 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:48.665859 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:48.671538 26620 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 13: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:48.535910 30988 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.668291 26615 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:48.675812 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:48.676690 26471 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.662431 26465 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:11:48.678623 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:48.679270 26465 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.626202 31521 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.693586 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:48.684660 27133 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:48.697746 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:48.701211 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:48.702037 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:48.702877 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:48.705832 26618 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17. Ops: [12.7-16.9]
I20260709 12:11:48.706825 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:48.702135 26472 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 16: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:48.710294 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:48.711714 30988 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:48.713722 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:48.712852 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:48.569370 31580 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:48.668270 31028 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:48.721954 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:48.680321 31654 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.725113 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:48.562179 31638 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:48.733176 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:48.734186 26473 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 13: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:11:48.735531 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.713809 31453 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:48.726807 31632 consensus_meta.cc:287] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.858s	user 0.014s	sys 0.000s
I20260709 12:11:48.681174 31500 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:11:48.740964 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:48.634248 31647 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.704241 31672 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:11:48.744426 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:48.777009 26465 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:11:48.778182 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:48.779357 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:48.716240 31540 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.788059 26468 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 14: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:48.762768 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:48.791565 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:48.794103 31498 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:48.794664 31498 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:48.795061 31498 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:48.748114 31453 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.718374 31664 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:48.748955 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:48.760205 26472 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:48.761909 26548 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 16: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:48.738554 26618 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:48.810689 26542 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 13: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:11:48.805495 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.805392 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:48.784904 31678 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:11:48.809353 31453 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:48.808777 31466 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:48.813280 31466 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.813467 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:48.813793 31466 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:48.814690 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:48.825745 26548 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:48.828249 31498 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.828532 31453 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:48.834887 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:48.739547 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.737327 31654 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:48.807873 31668 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:11:48.841559 26615 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:48.720906 31667 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.849174 31498 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:48.882648 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:48.888850 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 184775us
I20260709 12:11:48.889729 26618 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:48.837779 31500 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:48.911592 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:48.912011 26618 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:48.909601 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:48.920274 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.848093 31561 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:48.888321 31453 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:48.907409 31590 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:11:48.957170 31208 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:48.948633 31668 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:11:48.915081 31500 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:11:48.985248 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 300703us
W20260709 12:11:48.988281 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 312621us
I20260709 12:11:48.947131 31447 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:48.957969 31208 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:48.952068 31677 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:48.994364 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:49.000591 26470 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:49.001660 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:49.008241 26466 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:49.012286 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:49.012353 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:49.019500 26472 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:11:49.023276 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:49.026512 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:49.032752 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2472) took 1161 ms. Trace:
I20260709 12:11:48.977015 31467 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:49.061266 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 154879us
I20260709 12:11:49.071139 31568 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:49.085191 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 58818.2us
I20260709 12:11:48.999588 31447 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:49.005313 31672 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 12:11:49.093055 26543 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 16: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:11:49.094369 31705 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:49.038367 31677 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.037914 31710 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:49.100981 26471 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:49.079387 31568 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:49.088286 31647 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:49.119383 26546 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:49.119553 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.090375 31718 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:49.146273 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3255) took 1224 ms. Trace:
I20260709 12:11:49.181042 31208 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:49.033349 26617 rpcz_store.cc:276] 0709 12:11:47.870982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.673118 (+802136us) service_pool.cc:224] Handling call
0709 12:11:48.673440 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:48.673706 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:11:48.695736 (+ 22030us) log.cc:844] Serialized 14 byte log entry
0709 12:11:49.032019 (+336283us) log.cc:844] Serialized 14 byte log entry
0709 12:11:49.032274 (+   255us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:49.032342 (+    68us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:49.032407 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.032501 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.032670 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6417,"prepare.queue_time_us":32875,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":3035,"raft.queue_time_us":78353,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":6865,"thread_start_us":312028,"threads_started":2,"wal-append.queue_time_us":327806}
I20260709 12:11:49.153891 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 784) took 1008 ms. Trace:
I20260709 12:11:49.197499 26548 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:49.202955 26621 rpcz_store.cc:276] 0709 12:11:48.145984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.691172 (+545188us) service_pool.cc:224] Handling call
0709 12:11:48.691655 (+   483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:48.692096 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:48.692142 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:48.708649 (+ 16507us) log.cc:844] Serialized 26 byte log entry
0709 12:11:48.913669 (+205020us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:48.913712 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.913776 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:49.153636 (+239860us) raft_consensus.cc:1685] finished
0709 12:11:49.153658 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.153821 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":542,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":17819,"thread_start_us":178423,"threads_started":1,"wal-append.queue_time_us":350111}
W20260709 12:11:49.185617 31641 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.001s
I20260709 12:11:49.186215 31722 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:49.104802 31540 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:49.206561 26467 rpcz_store.cc:276] 0709 12:11:47.921882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.390813 (+468931us) service_pool.cc:224] Handling call
0709 12:11:48.391151 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:48.391544 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:48.391577 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:48.391960 (+   383us) log.cc:844] Serialized 26 byte log entry
0709 12:11:48.820628 (+428668us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b1800365740. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:11:49.005574 (+184946us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:49.005641 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.005757 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:49.145962 (+140205us) raft_consensus.cc:1685] finished
0709 12:11:49.145981 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.146204 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2251,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":13986,"spinlock_wait_cycles":4593408,"thread_start_us":184680,"threads_started":1,"wal-append.queue_time_us":697921}
W20260709 12:11:49.201107 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 811535us
W20260709 12:11:49.139338 31707 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.061s	user 0.002s	sys 0.001s
I20260709 12:11:49.104902 31710 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:49.121459 31565 consensus_meta.cc:287] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.002s
I20260709 12:11:49.104668 31709 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.214341 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:49.221513 26619 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:49.221680 26514 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:49.133417 31629 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.000s
I20260709 12:11:49.223027 26514 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:11:49.114183 31263 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.739s	user 0.014s	sys 0.000s
W20260709 12:11:49.128364 31566 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.003s
W20260709 12:11:49.215672 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 203528us
I20260709 12:11:49.217007 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:49.148777 31467 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:49.218017 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.150931 31568 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:49.135049 31654 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:49.142701 31561 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:49.217098 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:49.252452 27159 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:49.146818 31447 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:49.217828 31565 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:49.255797 31565 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:49.260721 31547 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:49.262084 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2365) took 1111 ms. Trace:
I20260709 12:11:49.250665 31566 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:49.262647 26544 rpcz_store.cc:276] 0709 12:11:48.150828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.154898 (+  4070us) service_pool.cc:224] Handling call
0709 12:11:49.261839 (+1106941us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54000b5254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:49.262018 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285523328}
I20260709 12:11:49.225513 26514 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:49.202479 31718 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:49.247411 31498 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:49.225724 31638 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:49.232790 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 125788us
I20260709 12:11:49.262194 26542 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:49.265668 26514 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:49.284723 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2382) took 1013 ms. Trace:
I20260709 12:11:49.246836 26614 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:11:49.124357 31466 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:49.267649 26588 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:49.252326 31575 consensus_meta.cc:287] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.614s	user 0.011s	sys 0.002s
W20260709 12:11:49.234140 31630 consensus_meta.cc:287] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.002s
I20260709 12:11:49.298276 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:49.300197 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:49.295485 26541 rpcz_store.cc:276] 0709 12:11:48.271157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.518089 (+246932us) service_pool.cc:224] Handling call
0709 12:11:48.518466 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:48.591970 (+ 73504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:48.592008 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:48.592051 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:48.592083 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.284476 (+692393us) spinlock_profiling.cc:243] Waited 73.3 ms on lock 0x7b5400104fd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:49.284521 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.284645 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168516864}
I20260709 12:11:49.303871 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:49.308661 26617 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:49.309679 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:49.304499 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:49.233935 31673 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:49.224269 31710 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:49.279239 31718 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:49.226042 31521 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:49.313272 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:49.319787 27134 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:49.321113 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:49.289029 31565 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:49.297619 31498 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:49.305452 31489 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:49.331172 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:49.317982 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:49.318787 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:49.333838 26618 raft_consensus.cc:2410] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:49.113215 31500 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:49.324044 26587 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:11:49.336549 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 89670.6us
I20260709 12:11:49.298358 26468 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:11:49.311977 31722 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:49.328704 31561 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:49.297442 31638 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:49.357379 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 46046.2us
I20260709 12:11:49.330039 31677 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:49.317121 31726 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.314325 31575 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:49.360734 31521 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.362883 31638 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:49.316233 31630 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:49.363242 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:49.368902 30988 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:49.403123 30988 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:49.330505 31498 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.346657 31722 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:49.409255 31722 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.348313 31641 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:49.414639 31641 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:49.415115 31641 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.416962 31566 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:49.336038 31565 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:49.424214 31565 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:49.429293 31466 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:49.430547 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.432534 31575 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:49.438133 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:49.360210 31727 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:49.441856 31727 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:49.402772 31521 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:49.396811 31676 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:49.408640 31630 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:49.452350 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 48490.7us
I20260709 12:11:49.404145 30988 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:49.464324 30988 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.464731 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:49.468143 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:49.442375 31727 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.470144 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:49.476467 26541 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 16: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:49.445784 31540 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:49.470144 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:49.478384 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:49.482570 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:49.479962 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:49.483527 26543 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:11:49.465241 31489 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:11:49.481783 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:49.484988 26621 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:49.474855 26371 catalog_manager.cc:5697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:49.447840 31521 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:49.473376 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 85671.4us
W20260709 12:11:49.489272 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 152037us
W20260709 12:11:49.494527 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.497761 26540 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:49.498781 26547 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:49.499639 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:49.501921 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:49.502319 26543 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:49.469486 31566 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:49.483242 26617 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:49.462983 31467 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.504868 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:49.507820 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:49.508054 26547 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:49.509300 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:49.510319 26544 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:49.512423 27133 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:49.485786 31540 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:49.514782 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:49.518092 26621 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:11:49.473527 31453 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:11:49.523414 31540 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:49.525017 31540 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:49.527386 31672 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:49.528589 31672 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:49.528954 31672 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:49.530086 31672 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:49.519889 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:49.482219 26514 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:49.531193 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:49.532357 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:49.553179 26540 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:49.553570 26547 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:11:49.554212 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:49.555163 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:49.556201 26544 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 13: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:49.518573 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:49.519412 31447 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:49.519438 31664 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:49.520823 31728 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:49.571090 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 571217us
I20260709 12:11:49.543968 31641 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:49.552671 26546 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 14
W20260709 12:11:49.564034 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.521075 31709 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:49.572805 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:49.569090 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 86983.3us
I20260709 12:11:49.574668 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:49.469698 31676 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:49.603274 26620 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:49.608007 31704 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.530s	user 0.005s	sys 0.000s
I20260709 12:11:49.571127 31728 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:49.613433 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2379) took 1449 ms. Trace:
I20260709 12:11:49.575348 31698 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:49.578907 31548 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:11:49.611680 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:49.620910 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.555085 30991 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:11:49.621521 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.624503 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:49.624439 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:49.624897 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:49.625392 26472 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.571201 31691 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:11:49.603978 31672 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:49.618861 26539 rpcz_store.cc:276] 0709 12:11:48.163635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.509065 (+345430us) service_pool.cc:224] Handling call
0709 12:11:48.509411 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:48.512347 (+  2936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:48.512391 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:48.517374 (+  4983us) log.cc:844] Serialized 26 byte log entry
0709 12:11:48.885076 (+367702us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:48.885137 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.885249 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:49.607208 (+721959us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:49.613032 (+  5824us) raft_consensus.cc:1685] finished
0709 12:11:49.613062 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.613349 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11038,"raft.queue_time_us":4851,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":14966,"spinlock_wait_cycles":6762752,"thread_start_us":312953,"threads_started":1,"wal-append.queue_time_us":441035}
I20260709 12:11:49.626624 26467 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:49.623208 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 81855.6us
I20260709 12:11:49.629412 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:49.651226 26470 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:49.627844 26473 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:49.651481 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:49.655265 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:49.656145 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 83621.6us
I20260709 12:11:49.656641 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3254) took 1741 ms. Trace:
I20260709 12:11:49.657330 26466 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:11:49.658349 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:11:49.659394 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 86673.1us
I20260709 12:11:49.660178 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:49.660666 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:49.661027 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:49.617383 31630 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:49.616842 31497 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.657023 26464 rpcz_store.cc:276] 0709 12:11:47.915272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.389166 (+473894us) service_pool.cc:224] Handling call
0709 12:11:48.447162 (+ 57996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:48.447481 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:48.687291 (+239810us) log.cc:844] Serialized 14 byte log entry
0709 12:11:48.722643 (+ 35352us) log.cc:844] Serialized 14 byte log entry
0709 12:11:48.823017 (+100374us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b18003ae820. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:11:49.618546 (+795529us) log.cc:844] Serialized 14 byte log entry
0709 12:11:49.634857 (+ 16311us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:49.634944 (+    87us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:49.635018 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.635126 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.656569 (+ 21443us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1584240,"prepare.queue_time_us":69565,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":855006,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":19877,"spinlock_wait_cycles":5548416,"thread_start_us":307309,"threads_started":2,"wal-append.queue_time_us":30660}
I20260709 12:11:49.615291 26471 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:49.579561 31453 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:11:49.620415 31728 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.664842 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:49.665808 31733 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:49.619664 31457 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.672120 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:49.622457 31629 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.707067 31629 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:49.709542 31629 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:49.717563 31710 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:49.683030 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:49.733047 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.685431 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:49.750207 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 64885.3us
I20260709 12:11:49.751736 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:49.681567 31720 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.662631 31566 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:11:49.690586 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:49.662003 31580 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:49.680387 31497 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:49.680492 31630 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:49.726689 31727 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:49.574106 31447 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:49.695475 31731 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:11:49.673388 30991 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:49.675518 31483 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:49.785573 31561 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:49.785684 31483 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:49.786201 31561 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:49.786530 31483 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.787274 31561 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:49.788525 31561 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.699589 30902 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.794257 30988 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:49.794760 30988 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:49.795672 30988 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:49.796990 30988 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:49.702664 26619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 3108) took 1845 ms (client timeout 1856 ms). Trace:
I20260709 12:11:49.703437 26546 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:49.704950 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 787) took 1558 ms. Trace:
I20260709 12:11:49.772480 31467 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:49.627249 31456 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:49.710646 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:49.664206 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:49.711128 31667 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:49.718739 31590 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:49.719851 31641 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:49.721186 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:49.681357 26472 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:49.730705 26470 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
W20260709 12:11:49.844489 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:49.730157 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 51819us
I20260709 12:11:49.846058 26514 leader_election.cc:400] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 13. Current term is 14.
I20260709 12:11:49.673229 31709 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:49.686970 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:49.848078 26473 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:49.759253 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:49.848937 27161 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:49.759280 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:49.709712 31718 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:49.657541 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:49.851733 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 194249us
I20260709 12:11:49.853528 26439 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:49.763017 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 102919us
I20260709 12:11:49.765930 27166 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:49.768349 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:49.854676 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:49.758638 31500 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:49.765323 31466 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.855584 31466 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:49.856696 31691 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.857824 31466 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:49.779794 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.792970 26467 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:11:49.706032 31457 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:49.798041 26619 rpcz_store.cc:269] 0709 12:11:47.857289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.891514 (+ 34225us) service_pool.cc:224] Handling call
0709 12:11:49.702478 (+1810964us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400196754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:49.702594 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3056558976}
I20260709 12:11:49.799510 26622 rpcz_store.cc:276] 0709 12:11:48.146976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.690109 (+543133us) service_pool.cc:224] Handling call
0709 12:11:48.690777 (+   668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:49.446640 (+755863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.446676 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:49.446721 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:49.446755 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.704721 (+257966us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b540020a654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:49.704766 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.704893 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1737783552}
I20260709 12:11:49.783772 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3264) took 1112 ms. Trace:
I20260709 12:11:49.863077 26469 rpcz_store.cc:276] 0709 12:11:48.671630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.671748 (+   118us) service_pool.cc:224] Handling call
0709 12:11:48.672047 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:48.672261 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:48.712871 (+ 40610us) log.cc:844] Serialized 14 byte log entry
0709 12:11:49.547336 (+834465us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b18002a28c0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5072fefa40 00007f5072fea4e4 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287 00007f50760f5208
0709 12:11:49.782975 (+235639us) log.cc:844] Serialized 14 byte log entry
0709 12:11:49.783298 (+   323us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:49.783368 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:49.783435 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.783530 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.783697 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10843,"prepare.queue_time_us":224961,"prepare.run_cpu_time_us":126,"prepare.run_wall_time_us":7474,"raft.queue_time_us":834889,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":14673,"spinlock_wait_cycles":2904832,"thread_start_us":235109,"threads_started":1}
I20260709 12:11:49.813858 26620 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:49.846540 26514 leader_election.cc:403] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:49.855846 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:49.865203 26439 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:49.866055 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:49.801280 27168 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:49.847684 26371 catalog_manager.cc:5697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 7 to 15, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 15 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:49.868010 31691 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:49.870278 31263 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:49.871563 26471 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:49.877424 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:49.877823 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:49.879731 26540 raft_consensus.cc:2376] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11. Re-sending same reply.
I20260709 12:11:49.880892 30988 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 13. Current term is 14.
I20260709 12:11:49.883147 30988 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:49.883634 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:49.806056 31566 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:49.806469 31673 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:49.891929 26615 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:49.891974 26546 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:49.845074 31667 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:11:49.909649 31734 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:11:49.912096 31447 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:49.863128 31548 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:49.919052 31548 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:49.922637 26558 tablet_copy_service.cc:342] P ac3ac2181aa941229a758ccf6b5607cd: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-953d8c981a6c459f8b7f3dbbb66fda45 received from {username='slave'} at 127.0.0.1:44706
I20260709 12:11:49.923274 31489 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:49.923408 26558 tablet_copy_service.cc:434] P ac3ac2181aa941229a758ccf6b5607cd: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-953d8c981a6c459f8b7f3dbbb66fda45 on tablet 953d8c981a6c459f8b7f3dbbb66fda45 with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:49.923810 31489 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:49.924260 31489 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:49.862046 31500 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:49.927595 31500 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:49.892542 31028 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:11:49.887018 31632 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:49.930900 31632 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:49.931306 31632 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.932613 31676 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:49.933152 31724 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:49.939239 31667 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:49.879108 31730 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.861419 31456 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:49.859963 31467 raft_consensus.cc:697] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:49.886144 31580 raft_consensus.cc:2764] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:11:49.941167 31730 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:49.908183 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:49.954241 26548 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:11:49.902772 26514 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:49.986704 26371 catalog_manager.cc:5697] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 8 to 14, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 14 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:49.988384 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 85732.3us
I20260709 12:11:49.989286 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:49.952406 31667 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.961184 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:49.973014 26615 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:11:49.850986 31498 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:49.991781 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 83716.3us
I20260709 12:11:49.880206 31502 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
W20260709 12:11:49.994369 31722 consensus_meta.cc:287] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.585s	user 0.011s	sys 0.000s
I20260709 12:11:50.055666 26543 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:49.899921 31566 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:50.049872 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.064004 30988 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:49.960103 31677 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:49.960005 31624 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:11:50.004530 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 124896us
I20260709 12:11:49.996335 31641 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:50.059648 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.088675 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:50.043466 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 157009us
W20260709 12:11:50.048404 31734 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:11:50.066083 26543 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:11:50.092723 26619 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:50.074745 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.084995 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:50.064563 31677 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:50.044234 31580 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:50.110973 26620 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:50.060388 31565 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:50.056237 31664 consensus_queue.cc:1059] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:11:50.119313 31718 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:50.120126 31718 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:50.120905 31718 consensus_queue.cc:1243] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:50.123395 31677 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.124737 31677 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.097944 31641 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:50.086876 31624 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:50.103897 31630 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:50.137688 31624 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.138306 31747 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:50.138697 31745 consensus_queue.cc:1059] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:50.139156 31624 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.143476 31654 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:50.143987 31654 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:50.144909 31654 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:50.146047 31654 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:50.147462 31741 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:11:50.062512 31722 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:50.154610 26614 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:50.161841 26547 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:50.128060 31730 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:50.104588 31453 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:11:50.107635 31726 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:11:50.127542 31540 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:50.163906 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 499781us
I20260709 12:11:50.130946 31641 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.109853 31262 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:11:50.065773 31456 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.127872 31580 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:50.179728 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 183710us
I20260709 12:11:50.164847 31735 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:50.193823 31735 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:50.195235 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:50.181332 31447 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:11:50.184033 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 194842us
I20260709 12:11:50.069476 31590 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:50.186231 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:50.134804 31746 raft_consensus.cc:3055] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:50.211491 31746 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:50.212556 31746 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:50.214033 31746 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.126538 31467 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:50.226691 31672 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.568s	user 0.006s	sys 0.007s
I20260709 12:11:50.227952 31710 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:50.231159 31521 raft_consensus.cc:3055] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:50.231827 31521 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:50.232995 31521 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.205693 31447 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:50.190613 31722 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:50.202879 31457 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:50.177816 31483 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.260071 26371 catalog_manager.cc:5697] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:50.262006 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.271135 27162 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
W20260709 12:11:50.274515 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.264966 26616 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:11:50.277858 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:50.280149 31735 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:50.278489 31521 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.249517 31726 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:50.239674 31698 consensus_meta.cc:287] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.620s	user 0.013s	sys 0.000s
I20260709 12:11:50.282790 31698 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:50.276628 31575 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.283885 31575 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:50.210963 31547 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:50.285100 31547 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:50.285508 31547 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:50.289942 31679 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:50.290455 31679 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:50.134174 31497 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:50.219015 31750 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:50.291642 31720 consensus_meta.cc:287] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.002s
I20260709 12:11:50.292323 31720 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:50.223541 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:50.270021 31457 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:50.293422 26546 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:11:50.293742 31457 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:11:50.280736 31263 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:50.260282 31548 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:50.291350 31679 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.219818 31749 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:50.295849 31749 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.239427 31498 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:50.296236 31457 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:50.249538 31727 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:50.282191 31726 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:50.296216 31679 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.239059 31566 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:50.247484 31739 log.cc:927] Time spent T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:11:50.236438 31262 raft_consensus.cc:3055] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:50.298269 31749 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:50.300241 31262 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:50.284526 31709 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:50.210167 26438 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:50.304854 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 94771.9us
W20260709 12:11:50.267361 31728 consensus_meta.cc:287] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.534s	user 0.005s	sys 0.009s
I20260709 12:11:50.306034 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:50.209333 26514 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:50.301124 31262 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:50.308835 26616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 785) took 2162 ms (client timeout 1636 ms). Trace:
I20260709 12:11:50.312305 30988 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:50.317512 31262 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:50.318364 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:50.320290 31750 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:50.320736 31750 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:50.316326 26616 rpcz_store.cc:269] 0709 12:11:48.146340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.268305 (+121965us) service_pool.cc:224] Handling call
0709 12:11:50.308572 (+2040267us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b540009f1d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:50.308733 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4426872704}
W20260709 12:11:50.313197 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 105345us
W20260709 12:11:50.323604 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.324565 26514 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:50.325588 30988 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:50.326038 30988 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.326367 30988 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.262770 31483 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:50.263574 31580 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:50.234357 31590 raft_consensus.cc:697] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:50.321084 31750 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:50.331660 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:50.305323 31575 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:50.344280 26514 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:50.259791 31632 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.352041 26514 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:50.356446 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 262323us
I20260709 12:11:50.360792 27163 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:11:50.316670 31624 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:50.339339 31548 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:50.366425 26371 catalog_manager.cc:5697] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 8 to 11, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 11 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:50.368216 26371 catalog_manager.cc:5697] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:50.369508 26371 catalog_manager.cc:5697] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:50.243613 31447 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.347007 31566 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:50.334585 31489 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:50.360564 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:50.316116 31728 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:50.349648 30988 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:50.409209 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 300509us
I20260709 12:11:50.298166 31726 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.381152 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:50.413223 26615 raft_consensus.cc:2368] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17.
I20260709 12:11:50.384536 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:50.414424 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 47015.5us
I20260709 12:11:50.414826 26619 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:50.416025 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:50.386447 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:50.417852 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:50.388738 26621 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:50.419744 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:50.420619 26621 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:11:50.406518 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:50.408427 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47969.7us
W20260709 12:11:50.364699 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 260868us
I20260709 12:11:50.362253 31498 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:50.411118 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:50.349287 31580 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:11:50.429282 26622 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 16: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:50.429322 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:50.424976 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:50.430317 30988 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:50.429042 26620 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:11:50.425685 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:50.374753 31548 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:50.453025 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:50.454535 26547 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:50.424899 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:50.353971 31483 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 12:11:50.414415 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:50.435320 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:50.456135 26621 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:50.454842 26371 catalog_manager.cc:5697] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 7 to 10, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 10 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:50.411665 31754 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:11:50.407585 31624 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:50.412424 31630 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:50.462961 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:50.465956 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:50.467586 27162 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 14: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:50.434918 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:50.471644 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:50.472169 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:50.472488 26468 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:50.472985 26471 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:50.471542 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:50.474752 26467 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:50.478250 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.461898 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:50.491480 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 56655us
I20260709 12:11:50.492652 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:50.494692 26471 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:50.434664 31561 consensus_meta.cc:287] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.646s	user 0.013s	sys 0.002s
I20260709 12:11:50.429054 31749 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:50.434295 30991 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:50.503371 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.424985 31498 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:50.429101 31566 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:50.568498 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:50.569222 27168 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:50.570375 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:50.571772 26473 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:50.571925 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:50.572567 26472 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
W20260709 12:11:50.577798 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.569696 26468 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:11:50.523638 26469 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:50.527499 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:50.497560 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:50.581718 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 84272.2us
I20260709 12:11:50.489621 31629 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:50.584733 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 225497us
I20260709 12:11:50.499253 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:50.586937 26621 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 14: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:50.588936 27168 raft_consensus.cc:1217] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 12:11:50.589645 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:50.590333 26543 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:50.592784 26547 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:50.593701 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:11:50.502321 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.557174 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:50.457360 31548 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.451584 31575 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:50.565266 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:50.566792 30991 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:50.566567 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.568787 31498 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:50.596568 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.597580 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:50.598762 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:50.599261 26466 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:50.599538 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:50.565891 31677 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:50.498055 31726 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:50.600080 30902 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:50.613902 26465 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:50.556988 31691 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:50.615264 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 214375us
I20260709 12:11:50.488557 31748 consensus_queue.cc:1059] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.174s
I20260709 12:11:50.590147 27168 raft_consensus.cc:2955] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 LEARNER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:11:50.456719 31654 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:11:50.629509 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.606928 31749 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:50.569443 31630 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:50.434055 31698 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.132s
I20260709 12:11:50.634222 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:50.634222 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:50.628536 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:11:50.635465 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 216999us
I20260709 12:11:50.636202 26469 raft_consensus.cc:2368] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16.
W20260709 12:11:50.662828 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.613154 26616 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 12: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:50.601768 31676 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:50.562548 31641 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.565815 26467 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:11:50.651059 26513 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:50.655443 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:50.632344 30991 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.664713 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:50.665784 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:50.668195 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.635505 31453 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.638695 31575 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:50.620327 31724 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:11:50.456882 31590 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:50.669368 26468 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:50.643149 31540 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:50.664572 31497 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.664772 31457 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.667929 31580 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:50.705418 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:50.667644 31677 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:50.707370 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:50.724771 26465 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:11:50.720867 26622 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:11:50.731566 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:50.699445 31632 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:50.734299 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 65450.9us
I20260709 12:11:50.649513 31624 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.738508 26587 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:50.692698 30902 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:50.668365 31654 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:50.670107 31676 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:50.744325 26514 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:11:50.746187 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.683617 31453 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.755963 26514 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:50.756240 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:50.738049 31466 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:50.763867 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:50.764953 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.741786 31751 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.714851 31540 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.760979 31575 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.772228 31502 raft_consensus.cc:3055] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:50.773561 31757 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:11:50.751438 31632 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:50.715875 31497 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.679701 31566 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:50.779870 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.718312 31457 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:50.765154 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:50.781339 26464 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:11:50.793725 26464 pending_rounds.cc:85] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 7
I20260709 12:11:50.794091 26464 pending_rounds.cc:107] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:11:50.781620 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:50.748158 31639 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:50.763927 31500 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:50.721125 31580 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:50.789438 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 134152us
I20260709 12:11:50.797155 26464 raft_consensus.cc:2889] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:50.823799 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:50.764025 31263 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:11:50.787321 26616 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:50.820605 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:50.830489 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:50.761166 31755 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:50.778019 31466 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.831656 31466 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:50.832904 31540 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:50.825960 31677 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.834091 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:50.786645 31691 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:50.770300 31561 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:50.741592 31756 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.158s
I20260709 12:11:50.790086 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:50.822878 26621 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:50.780405 31489 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:50.831507 31755 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.784940 31766 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:50.786706 31502 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:50.743520 31749 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:50.842664 31761 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:11:50.845537 31521 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.564s	user 0.012s	sys 0.000s
I20260709 12:11:50.843922 31467 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:50.847476 31746 consensus_meta.cc:287] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.617s	user 0.011s	sys 0.000s
I20260709 12:11:50.843698 31691 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:50.853063 31755 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.787671 31751 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:50.857550 31547 consensus_meta.cc:287] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.002s
I20260709 12:11:50.852319 31639 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.820931 31632 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.878737 26473 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:11:50.851752 31500 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:50.842576 30902 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.893584 26471 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.880681 31691 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.883194 31521 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:50.900329 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 110330us
W20260709 12:11:50.890323 31262 consensus_meta.cc:287] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.002s
I20260709 12:11:50.908650 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:50.884889 31768 raft_consensus.cc:2764] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 12:11:50.909256 31758 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:11:50.911427 31654 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:50.917189 31453 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:50.898854 31773 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:50.884690 31547 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.904218 31540 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:50.887996 31639 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:50.906688 31456 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:50.893749 31502 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:50.934412 31497 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:50.935009 31502 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:50.937134 31629 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:50.940842 31639 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:50.944270 31547 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:50.913549 31521 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:50.947057 31751 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:50.913312 31722 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:50.950695 31763 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.187s	user 0.001s	sys 0.001s
I20260709 12:11:50.928756 31540 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.947158 31521 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:50.955835 31679 consensus_meta.cc:287] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.652s	user 0.012s	sys 0.001s
I20260709 12:11:50.950836 31639 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:50.951045 31722 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:50.964326 31540 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.960829 31676 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:50.978914 31466 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:50.969430 31580 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:50.972718 31722 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:50.982371 31466 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:50.991860 31548 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.000185 31548 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:51.000469 31709 raft_consensus.cc:3055] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:50.972421 31639 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:50.993721 31750 consensus_meta.cc:287] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.638s	user 0.013s	sys 0.000s
I20260709 12:11:50.931442 31773 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:51.005333 31709 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:51.014089 31773 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:51.009364 31750 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:51.016749 31750 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:51.018553 31785 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.060s	user 0.001s	sys 0.001s
I20260709 12:11:51.048290 26464 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:50.886667 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 61482.1us
I20260709 12:11:50.966969 26614 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:11:51.055733 26468 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:51.057377 26470 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:51.061246 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 230670us
I20260709 12:11:51.072134 31489 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
W20260709 12:11:51.085368 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 434201us
I20260709 12:11:51.103135 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:51.107013 30991 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.107962 26514 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:51.131294 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 48817.7us
I20260709 12:11:51.134864 26613 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 13: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:11:51.142696 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 52338.8us
I20260709 12:11:51.143632 31466 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:51.144421 30991 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:51.144508 31466 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:51.146898 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:51.147258 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:51.147323 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.148319 26546 raft_consensus.cc:2368] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17.
I20260709 12:11:51.148713 26548 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 14: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:11:51.150094 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.152268 26466 raft_consensus.cc:2368] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15.
I20260709 12:11:51.155637 26547 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:11:51.155416 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.156252 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.156026 31709 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:51.157096 26544 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 15: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:51.157277 26543 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:51.159312 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:51.160567 26465 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:51.164561 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:51.165864 31630 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:51.166676 31630 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:51.167801 31749 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:51.168452 31749 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.168998 31749 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.166939 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.167613 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:51.170025 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:51.170442 26544 raft_consensus.cc:2376] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13. Re-sending same reply.
I20260709 12:11:51.155285 27134 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:51.176936 26617 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:51.177341 31793 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:51.178629 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.180217 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:51.180923 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:51.181172 26469 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.181906 26614 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.174288 30991 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.183982 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.171802 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:51.165904 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.174072 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:51.186686 26621 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:51.174939 26473 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:51.188316 31498 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.541s	user 0.014s	sys 0.003s
I20260709 12:11:51.189072 31498 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.191654 31698 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.192662 31698 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.195242 31639 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:51.171710 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:51.196431 26468 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:51.183854 30991 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.162010 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:51.185149 26548 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:51.196669 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:51.198755 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.202898 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:51.203661 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:51.197253 31709 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:51.207007 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:51.211674 26465 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:11:51.212850 31561 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:51.213784 31561 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:51.217499 31561 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:51.218616 31466 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:51.219882 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.224077 31641 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:51.231773 31756 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:51.232791 31756 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:51.234506 31632 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:51.240835 26464 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 12:11:51.241001 31691 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.243367 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:51.244438 26620 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
W20260709 12:11:51.234869 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:51.245865 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 79693.9us
I20260709 12:11:51.250941 30988 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:51.241425 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:51.252386 31789 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:51.253039 26619 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
I20260709 12:11:51.254284 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:51.254560 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:51.257408 31447 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:11:51.254556 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.260550 31457 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:51.261827 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.262123 26468 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:51.253355 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.263929 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:51.264762 26617 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:51.265208 31735 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:51.265682 31735 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:51.267071 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.267733 31728 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:51.268296 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.270140 31457 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.270969 31457 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:51.271267 31735 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:51.273192 31735 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:51.277164 31457 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:51.278533 31489 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.270958 30991 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:51.279402 31489 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.250093 26513 leader_election.cc:400] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16.
I20260709 12:11:51.280946 26513 leader_election.cc:403] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:11:50.788704 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:51.290257 26547 raft_consensus.cc:2410] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:51.292646 31498 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:51.294988 31718 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:51.296489 31489 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:51.297313 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 100981us
I20260709 12:11:51.297849 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.301512 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:51.301854 26621 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 10.
I20260709 12:11:51.301087 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.308820 26469 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:51.308971 26547 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:11:51.310087 26614 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:11:51.314481 26617 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:11:51.315238 26539 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:11:51.317293 31698 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:51.319298 31691 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:51.319542 31565 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:51.320096 31565 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:11:51.320386 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 70653.6us
I20260709 12:11:51.331347 31521 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16.
W20260709 12:11:51.337327 31796 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.130s	user 0.001s	sys 0.001s
W20260709 12:11:51.342506 31794 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.146s	user 0.003s	sys 0.000s
I20260709 12:11:51.347245 31667 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:51.349211 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:51.321386 31565 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:51.324016 31718 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.355119 31718 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.325554 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:51.320850 31540 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:51.316936 31749 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.350848 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:51.362327 31718 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:51.366257 26548 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:51.174082 31755 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:51.385200 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.384550 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.389935 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:51.367455 31691 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:51.394079 26547 raft_consensus.cc:2368] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14.
I20260709 12:11:51.397274 26617 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 15: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:51.395783 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:51.394701 31698 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:51.399791 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:51.401175 31698 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:51.401412 26539 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:11:51.401968 31540 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:51.402469 31698 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.404053 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:51.405504 31792 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.254s	user 0.002s	sys 0.000s
I20260709 12:11:51.406368 26545 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:51.406623 26469 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:11:51.376066 31630 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.424541 27168 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:11:51.429373 31565 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:51.434576 26647 heartbeater.cc:646] Failed to heartbeat to 127.24.179.126:41797 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.24.179.126:41797 timed out after 15.000s (SENT)
W20260709 12:11:51.442852 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 92264.9us
I20260709 12:11:51.447247 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.448630 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.450826 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:51.451283 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:51.452724 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.453989 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.459507 30902 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:51.425889 26470 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:51.452955 26587 leader_election.cc:400] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15.
I20260709 12:11:51.465621 26587 leader_election.cc:403] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 12:11:51.454447 31795 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.194s	user 0.000s	sys 0.004s
I20260709 12:11:51.449968 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:11:51.475278 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.478873 26473 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:51.427284 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 2493) took 1037 ms. Trace:
I20260709 12:11:51.493769 26548 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:51.493556 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:51.474581 31691 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:51.496423 31691 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.496846 31691 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.498615 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 804) took 1066 ms. Trace:
I20260709 12:11:51.493584 26543 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:51.504962 26539 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 10: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:51.505821 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.490726 26613 rpcz_store.cc:276] 0709 12:11:50.390214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.390415 (+   201us) service_pool.cc:224] Handling call
0709 12:11:51.415221 (+1024806us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400196754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:51.427200 (+ 11979us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568845696}
I20260709 12:11:51.518087 30902 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:51.527931 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 123540us
W20260709 12:11:51.537060 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 84290.4us
I20260709 12:11:51.534415 26547 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:51.540359 26439 leader_election.cc:400] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17.
I20260709 12:11:51.540910 26439 leader_election.cc:403] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:11:51.546770 31677 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.540755 31466 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.547658 31677 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.499032 26616 rpcz_store.cc:276] 0709 12:11:50.432071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.828685 (+396614us) service_pool.cc:224] Handling call
0709 12:11:50.829185 (+   500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:50.964327 (+135142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.964360 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:50.965705 (+  1345us) log.cc:844] Serialized 26 byte log entry
0709 12:11:51.219531 (+253826us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:51.219613 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.230511 (+ 10898us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.453674 (+223163us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:51.498132 (+ 44458us) raft_consensus.cc:1685] finished
0709 12:11:51.498155 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.498443 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42046,"raft.queue_time_us":22974,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":8731,"spinlock_wait_cycles":63048448,"thread_start_us":199116,"threads_started":2,"wal-append.queue_time_us":293626}
I20260709 12:11:51.540446 31498 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.570009 26471 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
W20260709 12:11:51.574251 26438 leader_election.cc:336] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.783s (SENT)
I20260709 12:11:51.575670 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:51.551358 31457 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.578099 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:51.578533 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:51.579440 27164 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.582746 31726 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15.
I20260709 12:11:51.591874 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:51.595402 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:51.566322 31749 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:51.600541 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 47941us
W20260709 12:11:51.607293 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 59291.3us
I20260709 12:11:51.599987 26439 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:51.609668 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.610369 31502 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17.
I20260709 12:11:51.610517 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:51.616461 27162 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:51.618193 31667 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.619241 31630 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:51.619004 31667 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:51.605932 31457 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:51.624353 31722 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.590s	user 0.018s	sys 0.006s
I20260709 12:11:51.615447 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:51.608476 31498 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.624893 31632 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:51.625371 31766 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.604970 31718 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:51.590044 31755 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:51.614567 31756 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:51.632786 31718 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.636341 31718 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:51.632893 27163 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:11:51.642673 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:51.612336 31677 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:51.644244 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 50232.1us
I20260709 12:11:51.612946 30902 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:51.641975 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:51.651862 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:51.655860 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:51.656708 26614 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:11:51.657140 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.657838 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:51.659924 26617 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:51.660979 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:51.613042 31466 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.668749 31466 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:51.669114 31769 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:51.638159 31722 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:51.653970 31801 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:11:51.670748 26618 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:51.671149 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:51.671669 31722 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:51.671965 26614 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 15: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:51.646587 31756 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:11:51.651079 31766 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.673628 31498 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:51.674876 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 2272) took 1087 ms. Trace:
I20260709 12:11:51.675289 26471 rpcz_store.cc:276] 0709 12:11:50.587160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.631848 (+ 44688us) service_pool.cc:224] Handling call
0709 12:11:51.674617 (+1042769us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54000a4e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:51.674793 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533555584}
I20260709 12:11:51.676802 26467 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:11:51.669710 31457 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:51.679592 27164 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:51.681989 26514 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:51.683444 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:51.684572 26544 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:51.630553 31726 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:11:51.687386 31726 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:51.687775 31726 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:51.688548 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.680882 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:51.696240 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 129691us
I20260709 12:11:51.701355 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:51.705029 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 55434.5us
I20260709 12:11:51.707984 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:51.709863 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:51.688885 31726 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.702806 31521 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:51.720598 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 56677.3us
I20260709 12:11:51.700580 31769 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:51.722065 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:51.722890 31561 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:51.722846 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:51.717907 31457 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:11:51.706528 30902 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:11:51.716416 31756 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:51.744284 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.744894 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.744350 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2495) took 1345 ms. Trace:
I20260709 12:11:51.749699 31208 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.747639 26545 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:11:51.751350 26547 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 13: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:51.744573 27134 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:51.750311 26514 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:51.752436 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.728646 31709 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:51.750304 31208 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:51.754871 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.750301 31667 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:51.748950 26618 rpcz_store.cc:276] 0709 12:11:50.394118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.394274 (+   156us) service_pool.cc:224] Handling call
0709 12:11:51.247760 (+853486us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b5800049298. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5eee 000000000036eb39 00007f507b0291e0 00007f507b0f20c4 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:11:51.248152 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.671176 (+423024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.736596 (+ 65420us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b540020ab54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:51.739093 (+  2497us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":976258048}
I20260709 12:11:51.742158 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:51.769642 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44917.6us
I20260709 12:11:51.770089 31624 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.771209 31028 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:51.772948 26547 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:11:51.774149 31624 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:51.774647 31624 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:51.774765 31728 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:51.776086 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.778684 31565 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.779652 26467 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:51.775655 31624 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.785180 31498 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:51.786615 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:51.787487 26470 raft_consensus.cc:2368] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13.
I20260709 12:11:51.787539 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:51.788411 26465 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 14: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:51.746495 31735 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:51.746711 31756 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.741034 31561 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:51.794406 27162 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:51.799099 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:51.799605 26467 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:51.767344 31709 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:51.804409 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:51.783452 31747 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:51.831123 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:51.830008 26467 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
W20260709 12:11:51.831089 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 52918.1us
I20260709 12:11:51.834384 26514 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:51.843902 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:51.847000 26542 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:51.789932 31766 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:51.788934 31769 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.804737 31722 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.799834 31756 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:51.804121 31624 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.832005 31747 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.802070 30902 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.794049 31735 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:51.803054 31540 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.833763 31709 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:51.861390 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.861917 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:51.862195 31805 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:11:51.862630 31667 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:51.863536 31720 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:51.863873 26514 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:51.897627 31540 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.898640 31667 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:51.899099 31667 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.899454 31667 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:51.900075 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:51.868534 26472 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:51.902561 31489 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:51.903494 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:51.904299 26472 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:51.904829 31489 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:51.905213 26439 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:51.871963 26587 leader_election.cc:400] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14.
I20260709 12:11:51.886716 31722 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.906605 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:51.861424 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:51.908018 26466 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:11:51.908195 31722 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:51.908833 31722 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.799811 31726 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.910434 31566 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.893790 26467 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 15: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:51.910975 31566 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:51.911623 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:51.912220 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.860996 31677 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.912361 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:51.913203 31566 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:51.893904 31735 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:51.913759 31566 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.898074 31720 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:51.891547 31747 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.914671 31566 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.915309 31720 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.916664 31720 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.916918 31566 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:51.894251 30902 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.873545 31691 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.912900 31677 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.893321 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:51.867372 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:51.913908 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:51.925669 26466 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:51.905261 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:51.927462 26544 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:11:51.927922 26472 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 12:11:51.930614 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 43604.5us
I20260709 12:11:51.930859 26467 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:51.900146 31540 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:51.865989 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:51.937165 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:51.942222 26617 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:11:51.938436 26613 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:51.939172 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:51.944716 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:51.946678 26621 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:51.947475 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:51.909466 31489 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.963714 26467 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:51.968307 26466 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17. Ops: []
W20260709 12:11:51.969017 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 197317us
I20260709 12:11:51.932765 31502 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.982741 26615 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:11:51.983392 26614 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:51.985911 26439 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:51.909466 31722 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.966827 26464 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:11:51.944276 31457 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.943841 31728 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:51.989120 26470 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:11:51.963362 31540 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:51.965094 31782 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:51.936492 31756 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.991281 31502 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.002908 26439 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:51.997370 31540 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:52.015988 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 109443us
I20260709 12:11:52.004444 31457 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.997830 31782 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:51.999409 31489 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:51.967236 31561 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.042294 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:52.019385 31540 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:52.042987 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:52.045461 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:52.050964 31814 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.051713 31814 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:52.054737 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 148237us
I20260709 12:11:52.054975 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:52.055799 26539 raft_consensus.cc:2368] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17.
W20260709 12:11:52.056429 27133 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.614s (SENT) [suppressed 18 similar messages]
I20260709 12:11:52.023061 31782 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.063755 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:52.050040 31521 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.051563 26541 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:11:52.063386 31804 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:11:52.080904 26542 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
W20260709 12:11:52.085346 26367 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57048 (request call id 303) took 27396 ms (client timeout 15000 ms). Trace:
I20260709 12:11:52.085530 27162 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:52.086994 31812 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.087641 31812 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.090653 26545 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 15: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:52.091626 31208 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:52.090099 31812 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:52.093521 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 76152.4us
I20260709 12:11:52.063333 30902 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:52.101543 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:52.102464 27168 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:11:52.103289 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:52.092440 31777 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:52.104974 27164 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:11:52.105670 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:52.107939 27162 raft_consensus.cc:2410] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:11:52.081557 31624 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:52.106958 27164 pending_rounds.cc:85] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 7
I20260709 12:11:52.092306 31208 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:11:52.116708 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:52.126420 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 125324us
I20260709 12:11:52.115422 27164 pending_rounds.cc:107] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:11:52.131377 27164 raft_consensus.cc:2889] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:52.138418 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 102623us
I20260709 12:11:52.139084 31502 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.139350 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:52.140676 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:52.121337 31735 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.141973 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:52.143164 31735 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.117147 31814 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.138986 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:52.143448 31489 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.144213 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:52.146163 31802 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 0.477s	user 0.003s	sys 0.004s
I20260709 12:11:52.149789 31565 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.151312 31457 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.079337 31728 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.152324 31502 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:11:52.152426 31823 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:52.153290 27163 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:52.128221 31691 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:52.151804 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 48618.3us
I20260709 12:11:52.103996 31630 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:52.167562 26613 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:52.166620 26439 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:52.189163 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47300.8us
I20260709 12:11:52.155563 31624 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:11:52.172938 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.117899 31777 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:11:52.169567 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 52060.1us
W20260709 12:11:52.191430 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 122652us
I20260709 12:11:52.165088 31677 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:52.165542 31756 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:52.173385 31749 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:52.194068 31824 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:52.212037 31749 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 11 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:52.213066 31749 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.175554 31812 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.197192 31624 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:52.218551 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 62477.7us
I20260709 12:11:52.218757 31483 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:52.219404 31483 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:52.220127 31667 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.220438 31483 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:52.085887 26367 rpcz_store.cc:269] 0709 12:11:24.667274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.669475 (+  2201us) service_pool.cc:224] Handling call
0709 12:11:52.042382 (+27372907us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:39.401840 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:39.452201 (+ 50361us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:39.452247 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:11:39.452265 (+    18us) tablet.cc:662] Decoding operations
0709 12:11:39.559774 (+107509us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:39.559882 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:39.559918 (+    36us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:11:39.810563 (+250645us) tablet.cc:701] Row locks acquired
0709 12:11:39.812578 (+  2015us) write_op.cc:260] PREPARE: finished
0709 12:11:39.838782 (+ 26204us) write_op.cc:270] Start()
0709 12:11:39.851887 (+ 13105us) write_op.cc:276] Timestamp: P: 1783599099833263 usec, L: 0
0709 12:11:39.854823 (+  2936us) op_driver.cc:348] REPLICATION: starting
0709 12:11:39.997385 (+142562us) log.cc:844] Serialized 8652 byte log entry
0709 12:11:40.462834 (+465449us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:40.606328 (+143494us) op_driver.cc:464] REPLICATION: finished
0709 12:11:40.980560 (+374232us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b18002d83e0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:11:40.980886 (+   326us) write_op.cc:301] APPLY: starting
0709 12:11:40.981039 (+   153us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:41.478491 (+497452us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:41.478545 (+    54us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:41.983979 (+505434us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:41.984417 (+   438us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=0,mrs_lookups=0
0709 12:11:41.984481 (+    64us) write_op.cc:312] APPLY: finished
0709 12:11:41.985127 (+   646us) log.cc:844] Serialized 196 byte log entry
0709 12:11:42.369105 (+383978us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:42.386910 (+ 17805us) write_op.cc:454] Released schema lock
0709 12:11:42.402988 (+ 16078us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:42.419019 (+ 16031us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:42.419062 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1001214,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":319410,"apply.run_cpu_time_us":135022,"apply.run_wall_time_us":1438132,"cfile_cache_hit":90,"cfile_cache_hit_bytes":95999,"num_ops":22,"prepare.queue_time_us":242987,"prepare.run_cpu_time_us":11846,"prepare.run_wall_time_us":728136,"raft.queue_time_us":90571,"raft.run_cpu_time_us":19047,"raft.run_wall_time_us":348433,"replication_time_us":727060,"spinlock_wait_cycles":97102336,"thread_start_us":844946,"threads_started":5,"wal-append.queue_time_us":516380,"wal-append.run_cpu_time_us":65404,"wal-append.run_wall_time_us":2529010}]]}
I20260709 12:11:52.198320 31755 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:52.208045 31709 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:52.210427 31718 consensus_meta.cc:287] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.573s	user 0.012s	sys 0.001s
I20260709 12:11:52.210959 31756 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.211316 31565 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.223326 26514 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:52.233729 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:52.242108 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:52.244735 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:52.231519 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:52.245374 26615 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:52.241935 31718 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.209056 31747 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.222332 31755 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:52.265000 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:52.266711 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:52.267463 27161 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:11:52.268222 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:52.269332 27166 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 14: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:52.269240 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:52.270035 27164 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
W20260709 12:11:52.270931 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.273223 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:52.274356 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 80661.2us
I20260709 12:11:52.276665 31822 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:52.277326 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:52.278601 31728 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.279197 31728 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.279805 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:52.279939 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:52.281133 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:52.276979 26617 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:52.282015 26615 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 14: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:52.282215 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:52.244621 31756 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.285722 31727 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.254876 31565 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.249085 31698 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:52.214221 31812 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:52.298486 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 67876.6us
W20260709 12:11:52.297341 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.281545 31521 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.281427 31728 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:52.303007 26439 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:52.303817 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 193492us
I20260709 12:11:52.306994 26468 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:52.307032 26588 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:52.244840 31825 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.244279 31028 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 12:11:52.313197 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 90551.2us
I20260709 12:11:52.254983 31540 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.309350 31457 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.321909 31830 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:11:52.324025 31709 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.298970 31823 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.297382 31624 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:52.249534 31489 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:11:52.341634 26615 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:52.299352 31698 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.331434 26438 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:52.349807 26613 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:52.335691 31720 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:52.336661 31756 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:52.352698 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 70590.2us
I20260709 12:11:52.349634 31698 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:52.349946 31502 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:52.359254 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:52.360460 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:52.347036 31823 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.362969 31630 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:52.363435 31823 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.341606 31457 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.368832 31457 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:52.334991 31521 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.372609 26622 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:11:52.373755 31521 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.374130 26588 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:52.374788 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 71925.5us
I20260709 12:11:52.375229 31677 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:52.375900 31828 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:52.375962 31677 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:52.377341 31677 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.375353 26588 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:52.363560 31630 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.375641 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:52.381717 26617 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:11:52.393792 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:52.394767 26619 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:52.400931 31540 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:52.381448 31755 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.401706 31718 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:52.402144 31755 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.403226 31747 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.403939 31747 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:52.404524 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:52.404912 31747 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:52.405375 31747 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.404449 31632 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:52.404409 31624 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.402290 31722 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:52.349279 31777 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.406284 31632 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:52.408310 31632 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.386409 31828 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:52.410082 31632 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.383334 31838 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.411505 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:52.411782 31667 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.412237 26622 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:11:52.398686 26587 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:52.414836 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:52.419456 31502 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:52.419471 31028 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:52.420284 31028 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.420279 31828 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:52.420701 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:52.421240 31828 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:52.420785 31502 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.381705 31749 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.438503 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:52.438674 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52507.8us
I20260709 12:11:52.427584 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:52.429458 27134 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:52.440696 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 80301.1us
I20260709 12:11:52.442765 27134 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:52.447199 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:52.448040 26619 raft_consensus.cc:2368] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 17. Current term is 18.
W20260709 12:11:52.450428 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.452883 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:52.420885 31028 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.457741 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:52.455497 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:52.456877 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:52.459741 27163 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:52.459107 26468 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 14: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:52.457067 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:52.461673 31825 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:52.467914 31825 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.468369 31825 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:52.469280 31827 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:52.469751 31827 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.470091 31827 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.471490 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:52.472458 26464 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 17: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:52.475273 26513 leader_election.cc:400] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13.
I20260709 12:11:52.476848 26513 leader_election.cc:403] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:52.452908 31814 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:52.480618 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:52.483917 26467 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:52.488432 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:52.488945 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:52.462123 31735 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:52.489604 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:52.492349 26513 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:52.489630 27134 leader_election.cc:400] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 17. Current term is 18.
I20260709 12:11:52.501574 27134 leader_election.cc:403] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:11:52.464066 31769 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:52.502441 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:52.502712 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:52.474749 31667 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.508343 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:52.509059 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:52.509958 26620 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:11:52.504186 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:52.511137 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:52.511832 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:52.500356 26470 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:52.502843 26541 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:52.444653 31749 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.499033 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:52.503428 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:52.511550 26464 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:11:52.513881 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:52.441905 31782 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.504761 26514 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:52.511138 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:52.496892 26619 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:11:52.503126 26465 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:11:52.514202 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:52.480715 31561 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:52.518419 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:52.513931 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:52.519147 26473 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:52.520982 26622 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 17: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:52.521472 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:52.422305 31828 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.490269 31814 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.525135 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:52.499217 31498 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.527180 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:52.500916 31735 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.530555 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:52.530827 26473 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:52.538205 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:52.541570 27164 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:52.512102 31722 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.481185 31777 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:11:52.539597 26546 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:52.539543 26472 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:11:52.488708 31830 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 12:11:52.544502 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52218.2us
I20260709 12:11:52.546643 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:52.548717 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:52.558604 26464 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:52.550729 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:52.489336 31817 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 12:11:52.517912 31540 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:52.561803 31540 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.562122 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:52.563521 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:52.564131 31540 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:52.564329 31565 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.518129 31667 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.566624 31667 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:52.544826 31822 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:52.521435 31630 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.548310 31722 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.569093 31630 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.567183 31822 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.546164 31735 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.570667 31822 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.539404 31838 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.576877 27163 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:11:52.564359 26472 raft_consensus.cc:2410] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:11:52.539072 31814 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.545727 31521 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:52.578373 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:52.560484 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:52.579352 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:52.570081 31722 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:52.573987 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:52.580448 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:52.578684 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:52.583081 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:52.585243 26543 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:52.590492 26465 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:52.592024 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:52.597194 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:52.598647 31718 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:52.556902 31769 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:11:52.577023 31691 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:52.581228 31815 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 17. Current term is 18.
I20260709 12:11:52.589843 31630 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:52.621692 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:52.648586 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 70319.5us
I20260709 12:11:52.575886 31830 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:52.596081 31826 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
W20260709 12:11:52.665306 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 71010us
W20260709 12:11:52.657838 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 100757us
I20260709 12:11:52.680397 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:52.666772 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3153) took 1080 ms. Trace:
I20260709 12:11:52.667959 26542 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 17: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:52.662259 26473 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:11:52.673563 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:52.669651 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:52.681430 26621 rpcz_store.cc:276] 0709 12:11:51.586015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.587658 (+  1643us) service_pool.cc:224] Handling call
0709 12:11:51.588056 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.947644 (+359588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.666439 (+718795us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b5400032d54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:52.666689 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":824318848}
I20260709 12:11:52.683683 26541 raft_consensus.cc:2410] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:52.684504 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:52.686733 26514 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:52.688858 26470 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:52.679804 31830 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:52.691042 31830 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.679584 31630 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.692420 31830 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:52.692658 31630 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.694151 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:52.694927 26539 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:52.695472 31466 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:52.666132 31632 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:52.697038 31466 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:52.697201 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:52.697476 31466 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.697922 31466 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.657076 31838 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.668254 31722 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:52.699877 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:52.657569 31832 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.671548 31718 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.708015 26541 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:11:52.676039 31566 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:52.676189 31691 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.705778 31632 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.703717 31498 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13.
I20260709 12:11:52.714740 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:52.714464 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 139928us
I20260709 12:11:52.715579 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:52.683107 31521 raft_consensus.cc:697] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:52.720659 26539 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:11:52.678951 31766 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:11:52.713543 31722 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.712323 31838 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.728858 31848 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:52.730135 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:52.732388 26588 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:52.714711 31718 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:52.735903 31521 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.738329 31755 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.740283 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:52.744107 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:52.684448 31747 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.715090 31727 raft_consensus.cc:3055] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:52.718087 31691 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:52.683626 31698 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.717657 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:52.759596 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:52.765723 26621 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:11:52.772141 26472 raft_consensus.cc:2410] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:52.753211 31722 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.722281 31566 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.776067 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:52.752038 31848 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.722070 31756 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:11:52.753767 31840 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.779349 26438 leader_election.cc:400] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17.
I20260709 12:11:52.752756 31749 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.783241 26467 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:52.786484 27133 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:52.796118 31777 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:52.796772 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:52.797545 31838 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.762432 31727 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:52.787879 31848 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.762488 31632 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:52.801810 31632 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.804358 31632 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:52.806262 31028 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.807469 31827 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.808784 31028 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:52.809754 26471 raft_consensus.cc:2368] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15.
I20260709 12:11:52.809815 31566 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.790751 31747 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.791422 31812 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:52.777794 31720 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.762689 31677 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:52.807590 31825 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.833128 31825 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:52.810096 26469 raft_consensus.cc:2368] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 13. Current term is 14.
I20260709 12:11:52.788903 26545 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 17: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:52.834673 26613 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 14: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:52.809826 31827 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:52.840111 31832 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:52.826063 31826 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.841934 31720 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:52.845294 31677 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:52.845932 31722 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:52.776290 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 89651us
I20260709 12:11:52.848472 31677 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:52.827353 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:52.828832 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 53713.4us
I20260709 12:11:52.813861 31834 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:11:52.846644 31720 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.847052 31466 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.846881 31630 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.849141 31782 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.849527 26514 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:52.822834 26467 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:11:52.851742 31722 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:52.876782 26514 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:52.795498 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 77916.9us
I20260709 12:11:52.883581 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:52.862483 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:52.862649 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 117727us
I20260709 12:11:52.868016 31498 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:52.871897 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:52.893275 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:52.868850 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:52.905113 26473 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:52.898635 26439 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:52.901659 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:52.917757 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:52.918644 26473 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:52.920315 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:52.921344 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:52.881512 31769 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.922326 26465 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:11:52.887902 31489 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:52.846007 31735 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.937569 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:52.868742 31827 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:11:52.895471 31756 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.953874 31747 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:52.940100 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:52.956336 31483 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:52.956856 31483 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:52.957993 31483 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.959359 31483 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:52.960347 31850 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.409s	user 0.005s	sys 0.000s
I20260709 12:11:52.944377 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:52.962946 26615 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:52.902251 31498 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.965399 31630 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:52.966176 31498 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:52.966879 26616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 3156) took 1326 ms (client timeout 1577 ms). Trace:
I20260709 12:11:52.901662 31566 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:11:52.967437 31566 consensus_queue.cc:1243] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:11:52.967303 26616 rpcz_store.cc:269] 0709 12:11:51.640956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.641118 (+   162us) service_pool.cc:224] Handling call
0709 12:11:52.966653 (+1325535us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b5400196754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:52.966792 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1703548672}
I20260709 12:11:52.897148 31822 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.970736 26544 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 14: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:52.940997 31769 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.913168 31632 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:52.972538 31632 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.972923 31769 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:52.906677 31728 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:52.974459 31735 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.900277 31749 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:52.975301 27133 leader_election.cc:400] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15.
I20260709 12:11:52.975522 31749 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.975744 27133 leader_election.cc:403] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:11:52.975996 31749 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.977802 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:52.905927 31667 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:11:52.938867 31722 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:52.979022 31722 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:52.979616 26619 raft_consensus.cc:2368] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17.
I20260709 12:11:52.910203 31825 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:52.980167 31825 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.979995 31722 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.980929 31840 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.972939 31632 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:52.919813 31766 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:11:52.982887 31766 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:52.983227 31766 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:52.975328 31691 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.984071 31766 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.985045 31814 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.980577 31825 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.985949 31691 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:52.986919 31822 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.978415 26470 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.946795 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:52.989548 31718 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:52.990353 26540 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.991225 31735 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.991824 31735 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:52.993472 31498 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:52.994719 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:52.995201 31466 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.997141 31735 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:52.997639 26470 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:53.001214 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:52.952373 31720 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:52.998076 31727 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:53.003335 31727 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:53.007453 31466 raft_consensus.cc:1064] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:11:53.008579 26547 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:52.985451 31766 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:53.010843 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:53.020982 31632 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:53.021600 26540 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:52.938270 31489 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.030223 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:52.901011 31858 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.129s
I20260709 12:11:52.945287 31782 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:53.033735 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:53.042487 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:53.042063 26466 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:11:53.044178 26465 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 15: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:53.074903 26614 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:11:53.077493 27162 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:53.077725 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 180252us
I20260709 12:11:53.080319 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:53.081184 26619 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:53.088315 27161 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:53.064970 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:53.089597 27166 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:53.090490 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:53.091361 26470 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:53.093273 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:53.094321 26467 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 13: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:53.032784 31489 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:53.109663 26473 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:11:53.110916 26469 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:53.041738 31858 consensus_queue.cc:1243] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 17.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:53.121065 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:53.121834 26614 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:53.041636 31782 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.116832 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:53.123996 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:53.117085 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:53.117664 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:53.124791 26464 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 17: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:53.130254 26615 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 15: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:53.129313 31667 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:53.133730 31667 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:53.134363 31848 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:53.135265 31814 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:53.136133 31667 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:53.136504 26464 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:11:53.087915 31817 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:53.141057 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:53.141729 26614 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:53.141661 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:53.142383 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:53.142622 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:53.143117 26465 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:11:53.143491 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:53.145309 26546 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:11:53.147764 26473 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:53.148298 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:53.149658 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:53.150707 26622 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: [15.9-17.10]
I20260709 12:11:53.152865 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:53.153067 26545 raft_consensus.cc:2368] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17.
W20260709 12:11:53.130054 31802 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:11:53.156592 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:53.157037 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:53.157559 31848 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:53.161626 26546 raft_consensus.cc:2368] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16.
I20260709 12:11:53.166519 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:53.124502 31782 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:53.170306 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:53.171144 26544 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.173280 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:53.174345 26548 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 14: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:53.176203 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:53.178020 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:53.178772 26546 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:53.180069 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:53.142623 31824 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.203661 26614 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:53.142663 31667 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.200137 26514 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:53.142504 31846 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:53.168922 31720 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.232478 26438 leader_election.cc:400] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17.
I20260709 12:11:53.233021 26438 leader_election.cc:403] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:11:53.228193 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:53.235126 26548 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:11:53.237223 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:53.242580 31830 raft_consensus.cc:2764] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:11:53.243337 31632 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:53.245260 31502 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17.
W20260709 12:11:53.279173 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.246340 26547 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:11:53.221414 31868 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:53.235034 31846 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:53.256031 31866 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:11:53.217372 31828 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:53.260911 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 333972us
I20260709 12:11:53.314559 27166 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
W20260709 12:11:53.266211 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 257733us
I20260709 12:11:53.273065 26438 leader_election.cc:400] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16.
I20260709 12:11:53.268137 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:53.228343 31565 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:53.251914 31825 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:53.293089 26544 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
W20260709 12:11:53.302049 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.307467 31489 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:53.224969 31824 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:53.264137 31720 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:53.233814 31667 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:53.153676 31817 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:53.317461 26438 leader_election.cc:403] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:11:53.303213 31868 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:53.359517 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 91460.3us
I20260709 12:11:53.360389 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:53.352164 31457 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:53.276712 31747 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.361536 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:53.366760 26542 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:53.367225 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:53.357607 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 84699us
I20260709 12:11:53.370060 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:53.372233 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:53.376816 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:53.276558 31821 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:11:53.377800 26615 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:53.320103 31826 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.346629 31565 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:53.386757 26541 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:11:53.394629 31521 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:53.395481 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:53.395278 31521 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:53.397015 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:53.397869 31521 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:53.399466 31874 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:11:53.400154 27159 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:53.367624 31769 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:53.365428 31868 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.403698 26620 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:11:53.359181 31502 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.392717 31540 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:53.411072 31540 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:53.412559 26543 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:11:53.381465 26614 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:53.415969 31747 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:53.377394 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:53.371347 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 56351.1us
I20260709 12:11:53.378539 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:53.418599 26469 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:11:53.393404 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:53.420930 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:53.421787 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:53.422595 31028 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.422670 31677 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:53.423476 31677 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:53.423533 31028 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:53.424575 31028 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:53.424479 31677 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:53.425101 31028 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:53.320683 31828 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:53.426071 31028 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:53.428905 31828 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:53.357515 31718 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:53.429929 31565 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.385313 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:53.431908 26470 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.433668 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:53.435284 26544 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.304702 31749 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:53.441282 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:53.443887 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:53.366961 31722 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:53.363291 31457 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:53.444993 26546 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:11:53.412324 31540 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:53.443472 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:53.442951 31848 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:11:53.482796 26544 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:11:53.464118 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:53.464830 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:53.464900 27159 pending_rounds.cc:85] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 8
I20260709 12:11:53.485082 27159 pending_rounds.cc:107] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:11:53.485363 27159 raft_consensus.cc:2889] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:53.466281 26539 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:53.450870 31483 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:53.466050 27161 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:11:53.488525 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 45139.2us
I20260709 12:11:53.392096 31756 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:53.484910 27160 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:53.430474 31667 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:53.492885 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:53.489713 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:53.500841 26544 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:53.478953 26470 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:11:53.497219 26514 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:53.505638 26619 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:53.506884 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:53.510627 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 45882.6us
I20260709 12:11:53.468633 31722 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.511691 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:53.513991 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:53.516870 26540 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 17: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:53.523856 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:53.487743 31858 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.500712 31747 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:53.528259 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:53.504782 31727 consensus_meta.cc:287] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.005s
I20260709 12:11:53.442844 31521 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:11:53.524840 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:53.532003 26621 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.532706 26622 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:53.532003 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:53.533527 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:53.534155 26547 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:53.532682 26548 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:53.505129 31815 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:53.468828 31823 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:11:53.521557 31722 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:53.546444 31839 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:11:53.546895 31853 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:53.547380 31870 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:53.548313 31886 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:53.556143 26621 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:11:53.507836 31755 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 12:11:53.556978 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 74890.5us
I20260709 12:11:53.506281 31826 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:53.558732 27165 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:11:53.557191 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:53.550573 31863 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:53.579190 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:53.580389 26622 raft_consensus.cc:2393] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:53.569144 27165 pending_rounds.cc:85] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 10
I20260709 12:11:53.583033 27165 pending_rounds.cc:107] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:11:53.583412 27165 raft_consensus.cc:2889] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:53.569861 26621 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:53.541852 31815 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:53.541980 31028 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:11:53.556563 31747 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:53.627465 31815 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:53.641322 27166 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:53.643800 31870 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:53.645403 26622 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: [12.7-18.10]
I20260709 12:11:53.645406 31863 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:53.582290 31457 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:53.556479 31718 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.630638 31853 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:53.628775 31869 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:53.629916 31727 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.671569 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:53.672804 26540 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 14: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:53.678097 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:53.679077 26543 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:53.684315 31890 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:11:53.684834 31884 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:11:53.689174 26619 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:53.688894 31868 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:53.690757 31749 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:53.684839 31890 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:53.694026 31890 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:53.695744 31890 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:53.698948 31881 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:11:53.699708 31632 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:53.700240 31632 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:53.701318 31632 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:53.691437 31466 consensus_queue.cc:237] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:53.711889 31826 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:53.715659 31698 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:53.716958 31747 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:53.656747 31863 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:53.719149 31863 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:53.656701 31821 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.728871 31821 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:53.731240 31821 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:53.732816 31502 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16.
I20260709 12:11:53.681833 31727 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:53.737465 31727 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:53.670231 31720 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:53.683168 31824 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:53.670568 31489 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:53.759240 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:53.789011 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:53.789819 26542 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:53.674150 31457 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:53.792487 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 292259us
I20260709 12:11:53.797070 26470 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:53.795068 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:53.794152 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:53.677078 31825 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:53.803035 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 43935.4us
I20260709 12:11:53.683939 31853 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:53.806689 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:53.811458 26469 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:53.813081 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:53.813762 26473 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:53.811331 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:53.815893 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:53.816491 26468 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:53.662645 31718 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:53.660140 31782 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:53.789431 31872 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.398s	user 0.000s	sys 0.001s
I20260709 12:11:53.821187 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:53.822134 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:53.823508 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 333865us
I20260709 12:11:53.826941 26470 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:53.830474 26465 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 12:11:53.831974 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:53.843083 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:53.833513 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:53.843665 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:53.844489 26471 raft_consensus.cc:2410] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:53.835160 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:53.837738 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:53.800912 27160 raft_consensus.cc:2393] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 11: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:53.823619 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:53.839917 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:53.843556 26465 pending_rounds.cc:85] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 8
I20260709 12:11:53.846112 26465 pending_rounds.cc:107] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:11:53.846164 26619 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:11:53.846474 26465 raft_consensus.cc:2889] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:53.846704 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:53.844410 26614 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:11:53.848820 27168 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:53.850039 26613 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:53.792590 31755 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:53.855648 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:53.819591 31870 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:53.858968 26439 leader_election.cc:400] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17.
I20260709 12:11:53.883903 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:53.859802 26464 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:53.860097 31853 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:53.860991 27162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 589) took 1307 ms. Trace:
I20260709 12:11:53.861274 27168 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:53.866036 31502 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:53.845304 31632 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.886157 27162 rpcz_store.cc:276] 0709 12:11:52.553786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.553917 (+   131us) service_pool.cc:224] Handling call
0709 12:11:52.554221 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:53.078168 (+523947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:53.860682 (+782514us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b540071acd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:53.860888 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1202830592}
W20260709 12:11:53.884752 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 46162.5us
W20260709 12:11:53.881937 31859 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:11:53.900969 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:53.901939 26614 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:11:53.903518 26439 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:53.909862 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:53.886900 31870 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.891103 31823 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.890950 31502 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.889771 31890 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.856753 31824 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 12:11:53.856909 31561 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:11:53.921099 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:53.913659 27134 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:53.917622 26613 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:53.933386 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 426690us
I20260709 12:11:53.947726 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:53.896617 31756 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:11:53.918478 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 396292us
I20260709 12:11:53.956812 26469 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
W20260709 12:11:53.957156 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.951881 27134 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:53.888813 31755 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:53.958072 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:53.961882 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:53.916963 31870 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.964866 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:53.924320 31502 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:53.973450 31727 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:53.920756 31540 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:53.919456 31720 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:53.925961 31868 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:53.974702 31709 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:53.928450 31483 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:53.971988 31777 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:11:54.005160 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:54.007881 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 46138.8us
I20260709 12:11:53.932001 31890 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:53.955042 31832 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:54.030426 31828 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:11:54.046139 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 142748us
I20260709 12:11:54.013877 31540 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.025200 31720 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.006762 31727 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:54.069089 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:54.026230 31709 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:54.074154 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:54.073984 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 68929.9us
I20260709 12:11:54.032480 31823 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:53.979390 31756 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:54.058449 31832 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.091681 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:54.108003 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.072789 31540 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.075935 31720 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.121179 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:54.120174 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:54.082193 31727 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.075397 31561 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.084579 31886 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:54.126452 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:54.085086 31823 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.138595 26548 raft_consensus.cc:2410] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:11:54.088081 31782 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:54.137243 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2310) took 1241 ms. Trace:
I20260709 12:11:54.089061 31718 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:54.083323 31709 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:54.115172 31832 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.078899 31828 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:54.145843 26466 rpcz_store.cc:276] 0709 12:11:52.884898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.896356 (+ 11458us) service_pool.cc:224] Handling call
0709 12:11:52.929603 (+ 33247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:53.065624 (+136021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:54.126469 (+1060845us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400314cd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:54.126687 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257718656}
I20260709 12:11:54.125149 31826 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:54.158459 26539 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:11:54.136665 31824 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.112200 31698 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:11:54.142958 31823 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:54.174680 31896 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:11:54.175480 26469 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:11:54.175864 31899 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.164s
I20260709 12:11:54.177733 31908 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:54.180899 31521 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:54.181361 31521 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:11:54.183915 31909 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:11:54.184839 26514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.023s	sys 0.010s
W20260709 12:11:54.185235 26514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.023s	sys 0.010s
W20260709 12:11:54.185534 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 688421us
I20260709 12:11:54.148535 31897 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.127177 31830 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
W20260709 12:11:54.170789 31565 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.737s	user 0.012s	sys 0.002s
I20260709 12:11:54.196540 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2434) took 1042 ms. Trace:
I20260709 12:11:54.167724 31483 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:54.194674 31906 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:11:54.213445 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:54.196323 31905 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:54.240530 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 84902.2us
I20260709 12:11:54.152921 31566 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:11:54.141848 31561 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:54.234478 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:54.163350 31667 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:11:54.207481 31766 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.188400 31824 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:54.238930 26539 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:11:54.194589 31840 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.213s	user 0.006s	sys 0.009s
I20260709 12:11:54.163954 31815 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:54.244894 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:54.257711 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44384.3us
I20260709 12:11:54.259469 26468 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:11:54.223853 26545 rpcz_store.cc:276] 0709 12:11:53.153720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:53.217197 (+ 63477us) service_pool.cc:224] Handling call
0709 12:11:53.217598 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:53.217839 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:11:53.250612 (+ 32773us) log.cc:844] Serialized 14 byte log entry
0709 12:11:54.196020 (+945408us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b18000aeb20. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5075c824bc 00007f5072fd048b 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287
0709 12:11:54.196136 (+   116us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:54.196190 (+    54us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:54.196237 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:54.196312 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:54.196473 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66644,"prepare.queue_time_us":36389,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":69722,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":46262,"spinlock_wait_cycles":7146880,"thread_start_us":132732,"threads_started":2,"wal-append.queue_time_us":242157}
I20260709 12:11:54.267805 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:54.271200 26514 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:54.290707 26548 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:11:54.263659 31908 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:54.307097 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:54.308127 26548 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 15: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:54.229312 31565 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:54.309418 27160 raft_consensus.cc:2410] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:54.240166 31917 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:11:54.288638 31840 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15.
I20260709 12:11:54.287467 31894 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.299383 31667 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.306624 31853 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:54.334414 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.330183 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:54.317886 31466 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:54.348835 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:54.325735 31825 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:54.326072 31925 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.349851 26548 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
W20260709 12:11:54.339221 31722 consensus_meta.cc:287] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.770s	user 0.012s	sys 0.000s
I20260709 12:11:54.352067 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:54.361421 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:54.351332 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:54.343731 31466 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.371483 26466 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 17: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:54.367432 31720 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:54.338780 31894 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:54.368510 31565 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:54.372478 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:54.376935 26470 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:54.374792 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:54.378212 26465 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.375581 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:54.380595 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:54.381879 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:54.383098 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 77809.9us
I20260709 12:11:54.383322 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:54.386883 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:54.375699 31722 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:54.393429 31922 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.393980 31922 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:54.394810 26613 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 17: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:54.395431 31828 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:54.402745 31915 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.375885 31466 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:54.403431 31915 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:54.392973 31903 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:54.404582 31903 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:54.405019 31903 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.406211 31891 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:54.407819 31720 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:54.372280 31825 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:54.415743 31825 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:54.422811 31755 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:54.345611 31853 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:54.413828 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:54.436619 26467 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 12:11:54.353353 31899 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:54.374574 31895 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:54.385843 31910 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.063s	user 0.002s	sys 0.000s
I20260709 12:11:54.479406 26542 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:11:54.472580 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 156388us
I20260709 12:11:54.351181 31826 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:54.348744 31667 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:54.499850 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:54.342526 31832 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:54.493443 31908 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:54.506801 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:54.474793 31840 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:54.387730 31858 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 12:11:54.512436 26469 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:11:54.556985 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:54.557811 26469 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:11:54.537555 26613 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:54.537158 27164 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:11:54.528661 31691 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
W20260709 12:11:54.563512 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 171825us
I20260709 12:11:54.568920 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:54.574661 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:54.502807 31565 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:54.575485 26619 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:11:54.535562 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:54.580729 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45293.7us
W20260709 12:11:54.586786 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.375475 31925 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:54.591321 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:54.598173 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:54.562562 31821 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:11:54.504071 31917 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:11:54.600226 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:54.562840 31830 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:54.599436 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:54.567611 31755 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:54.497120 31899 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:54.619267 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:54.589418 31901 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.585199 31858 consensus_queue.cc:1243] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 17.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:54.614750 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:54.643738 26613 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.502058 31895 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:54.609368 31483 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:54.639576 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.634284 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:54.640110 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:54.645519 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:54.657892 26468 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:11:54.615016 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:54.601101 31824 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:54.661345 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:54.656769 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:54.651314 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:54.657003 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:54.717682 27168 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 15: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
W20260709 12:11:54.718698 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 61778.3us
I20260709 12:11:54.612139 31722 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:54.618080 31915 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:54.624855 31561 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:54.603488 31565 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:54.576611 31840 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:54.627489 31566 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:54.637858 31934 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:54.646919 31922 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:54.647528 31691 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:54.560724 31826 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:54.614337 31853 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:54.661990 31483 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:54.747565 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:54.614526 31718 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 12:11:54.625355 31830 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:54.713733 31777 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.661458 31828 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:54.759725 26613 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:11:54.761299 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:54.721447 31824 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:54.728340 31930 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:54.758672 27167 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 LEARNER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:54.657994 31858 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 12:11:54.636196 31540 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:54.768009 26622 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:11:54.762414 31727 consensus_meta.cc:287] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.619s	user 0.011s	sys 0.001s
I20260709 12:11:54.733570 31782 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.899525 31928 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:54.900067 31928 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.899827 31782 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:54.900486 31928 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.774556 26621 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
W20260709 12:11:54.781589 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 180526us
I20260709 12:11:54.781834 26543 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 15: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:54.722352 31755 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:54.907321 31894 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:54.907502 31755 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:54.766712 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 133775us
I20260709 12:11:54.908272 31561 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:54.908864 31561 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:54.777662 31457 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.975s	user 0.011s	sys 0.003s
I20260709 12:11:54.636548 31908 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:54.910732 31939 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:54.912318 31939 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:54.759091 31934 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:11:54.775382 31709 consensus_meta.cc:287] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.614s	user 0.012s	sys 0.000s
W20260709 12:11:54.767658 31632 consensus_meta.cc:287] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.872s	user 0.015s	sys 0.000s
I20260709 12:11:54.887782 31930 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:54.776446 31502 consensus_meta.cc:287] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.780s	user 0.011s	sys 0.003s
W20260709 12:11:54.916319 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.902102 31782 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:54.758685 31566 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:54.990955 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 75875.2us
I20260709 12:11:54.878242 31483 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.021631 26468 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:55.025036 26618 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:11:54.775455 31691 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:54.907593 31946 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:55.034266 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:11:55.047950 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 155286us
I20260709 12:11:55.034812 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:55.007436 31853 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:55.023850 31814 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:55.031095 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:55.049214 26468 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:55.045857 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:55.051303 26543 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.926476 31934 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:55.050580 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:55.029422 31930 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:55.086109 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:55.090698 26468 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:55.035843 31932 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 12:11:55.086658 27161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 733) took 1018 ms. Trace:
W20260709 12:11:55.095444 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 61284.2us
I20260709 12:11:55.096859 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:55.031001 31747 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.099453 26613 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
W20260709 12:11:55.101191 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.055104 31853 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:55.012794 31502 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.042320 31917 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:11:55.110590 26469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.035s	sys 0.048s
W20260709 12:11:55.122054 26469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.035s	sys 0.048s
I20260709 12:11:55.107527 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:55.123409 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:55.124202 26469 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:55.124455 26468 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:55.125626 31892 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.125988 31931 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:55.127059 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:55.029915 31709 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:54.925635 31727 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:54.897706 31777 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.109366 31943 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:54.915970 31828 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.100523 31718 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:55.104251 31766 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:54.891676 31824 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
W20260709 12:11:55.131548 26465 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.742s	user 0.012s	sys 0.001s
I20260709 12:11:55.114905 26543 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:55.191859 26465 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:55.114563 31747 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.135223 26514 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:55.192770 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 57694.4us
I20260709 12:11:55.193750 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:55.137844 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:55.195832 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 58077.8us
I20260709 12:11:55.121922 31863 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.149551 26469 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:11:55.153044 26466 raft_consensus.cc:2393] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:55.080999 31814 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.126355 31892 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.178498 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:55.213644 26546 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
W20260709 12:11:55.137343 31937 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.369s	user 0.001s	sys 0.000s
I20260709 12:11:55.173440 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:55.218158 26613 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:11:55.179126 27162 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:55.099094 27161 rpcz_store.cc:276] 0709 12:11:54.068575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.068836 (+   261us) service_pool.cc:224] Handling call
0709 12:11:54.083423 (+ 14587us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:54.201444 (+118021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:54.201496 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:54.227309 (+ 25813us) log.cc:844] Serialized 26 byte log entry
0709 12:11:54.494695 (+267386us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:54.494741 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:54.497058 (+  2317us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:55.086275 (+589217us) raft_consensus.cc:1685] finished
0709 12:11:55.086307 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:55.086553 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3224,"raft.queue_time_us":174301,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":15000,"thread_start_us":299366,"threads_started":2,"wal-append.queue_time_us":760165}
I20260709 12:11:55.199620 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:55.212095 31677 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:55.211509 31935 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:55.237851 26468 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 17: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:55.203008 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:55.196470 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:55.239943 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 43548.7us
I20260709 12:11:55.137708 31735 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:55.244158 26540 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:11:55.244031 31735 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.088333 31928 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.246315 31677 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:55.136711 31917 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.246817 31677 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.248086 31928 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.178704 31943 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.249754 31830 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:55.141443 31561 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:55.216686 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2536) took 1055 ms. Trace:
I20260709 12:11:55.136314 31817 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:55.083782 31946 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.248821 31952 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:55.252075 31952 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:55.252480 31952 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:55.253234 31946 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:55.250818 26614 rpcz_store.cc:276] 0709 12:11:54.161023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.161226 (+   203us) service_pool.cc:224] Handling call
0709 12:11:54.172079 (+ 10853us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:54.219896 (+ 47817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:54.219931 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:54.239912 (+ 19981us) log.cc:844] Serialized 26 byte log entry
0709 12:11:54.290602 (+ 50690us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:54.290670 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:54.290800 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:55.216440 (+925640us) raft_consensus.cc:1685] finished
0709 12:11:55.216472 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:55.216624 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77073,"raft.queue_time_us":45341,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":28847,"thread_start_us":24765,"threads_started":1,"wal-append.queue_time_us":383568}
W20260709 12:11:55.255405 31903 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.850s	user 0.012s	sys 0.004s
I20260709 12:11:55.255488 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:55.256316 26614 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:11:55.256060 31903 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:55.257139 31927 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.620s	user 0.000s	sys 0.001s
I20260709 12:11:55.257953 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:55.174437 31722 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:55.258683 31722 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.259076 31722 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.259413 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:55.168025 31566 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.172024 31691 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:55.158232 31828 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:55.262326 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:55.177384 31899 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.174646 31895 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.235301 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:55.142345 31908 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 12:11:55.248764 31917 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:55.251478 31944 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:11:55.174247 31540 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:55.219542 27163 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:55.220712 31766 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:55.216907 31846 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.240864 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:55.351294 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 110525us
I20260709 12:11:55.221455 31565 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:55.275104 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:55.246134 31735 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:55.221895 31894 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:55.276733 26546 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:55.198189 31718 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.228475 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:55.366436 31899 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:55.366801 26613 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:55.367053 31899 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.367925 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:55.368789 26613 raft_consensus.cc:2410] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:11:55.228566 31931 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:55.250840 31943 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:55.283385 27161 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:11:55.370034 31894 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.282924 31934 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.370538 31894 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:55.370455 31931 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.262223 31814 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:55.283749 26470 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:55.283881 31903 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:55.337103 31950 log.cc:927] Time spent T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:11:55.246155 31709 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.339143 31892 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.221999 31853 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.278090 31935 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:55.349678 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:55.362835 31540 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:55.369421 31899 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.384537 26468 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: [12.7-18.10]
I20260709 12:11:55.378125 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:55.404117 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 129077us
I20260709 12:11:55.420714 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:55.377141 31828 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.423344 26470 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
W20260709 12:11:55.429081 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 80432.7us
I20260709 12:11:55.429703 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:55.425565 26588 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:55.366285 31718 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:55.424582 26514 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:55.430511 26470 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:11:55.436622 26546 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:11:55.346623 31930 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.467600 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:55.444749 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:55.420634 31868 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:55.468593 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:55.487437 26468 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
W20260709 12:11:55.491397 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 57503.2us
I20260709 12:11:55.491695 31943 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:55.488898 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:55.427592 31540 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:55.453080 31886 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:55.502168 31817 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:55.498167 31943 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:55.486907 31868 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:55.470248 31901 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:55.503700 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:55.445142 31561 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:55.504520 27161 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19. Ops: []
I20260709 12:11:55.504678 27163 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:55.427516 31735 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:55.470485 31903 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:11:55.495029 31935 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.485927 31766 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.508515 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:55.507651 31870 consensus_meta.cc:287] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.528s	user 0.012s	sys 0.005s
I20260709 12:11:55.471002 31853 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.503026 31945 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
I20260709 12:11:55.531430 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:55.583680 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 75229.2us
I20260709 12:11:55.525154 31925 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:55.499107 31502 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.523736 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:55.599655 26620 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 12: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:55.586194 31735 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.532867 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:55.517692 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:55.513275 31466 consensus_meta.cc:287] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.110s	user 0.010s	sys 0.007s
I20260709 12:11:55.526590 31934 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:55.444787 31828 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.544600 31901 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.511768 31943 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:55.543779 31483 consensus_meta.cc:287] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.000s
I20260709 12:11:55.513276 31868 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:55.528154 31823 consensus_meta.cc:287] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.339s	user 0.014s	sys 0.000s
I20260709 12:11:55.627720 31823 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.511250 31817 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:55.630772 31817 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:55.634910 26473 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 15: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:55.522614 31709 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 12:11:55.636415 26472 raft_consensus.cc:2410] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 12:11:55.636652 31823 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.637084 31632 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.637639 31632 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.639314 31930 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.639986 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:55.641776 26620 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: [15.9-17.10]
I20260709 12:11:55.597597 31870 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.645052 26615 raft_consensus.cc:2393] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 13: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:11:55.651988 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.651476 26619 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:55.511019 31886 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.605208 27163 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 16: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:55.539669 31938 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:55.540325 31698 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:11:55.538609 31747 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.592826 26469 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:55.535655 31815 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.541062 31667 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.509550 31677 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.663391 31894 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.609234 31466 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.612964 31934 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.613535 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:55.591917 31727 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:55.581537 31952 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.620297 31898 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:55.620595 31901 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.620937 31540 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.626582 31483 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.662637 31886 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:55.658936 27164 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 727) took 2627 ms (client timeout 1957 ms). Trace:
I20260709 12:11:55.672477 27159 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:55.672552 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2338) took 1112 ms. Trace:
I20260709 12:11:55.654680 31858 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:11:55.675532 26620 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:55.703738 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2345) took 1521 ms. Trace:
I20260709 12:11:55.707165 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:55.708007 26544 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:55.704257 26539 rpcz_store.cc:276] 0709 12:11:54.182323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.182546 (+   223us) service_pool.cc:224] Handling call
0709 12:11:54.182915 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:54.266058 (+ 83143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:55.703429 (+1437371us) spinlock_profiling.cc:243] Waited 55.5 ms on lock 0x7b54002373d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:55.703647 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127757056}
I20260709 12:11:55.682441 27167 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 13: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:55.684811 26621 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 16: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:55.684397 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:55.709167 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:55.689522 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 833) took 1423 ms. Trace:
W20260709 12:11:55.688226 27164 rpcz_store.cc:269] 0709 12:11:53.028958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:53.029154 (+   196us) service_pool.cc:224] Handling call
0709 12:11:55.656311 (+2627157us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540060de54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:55.656453 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3015470336}
I20260709 12:11:55.713727 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:55.698112 26469 rpcz_store.cc:276] 0709 12:11:54.560442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.592349 (+1031907us) service_pool.cc:224] Handling call
0709 12:11:55.592692 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:55.672121 (+ 79429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:55.672455 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:55.716290 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:55.717041 26544 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.664312 31938 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:55.720466 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:55.721750 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.666146 31698 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:55.714530 26542 rpcz_store.cc:276] 0709 12:11:54.265919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.266906 (+   987us) service_pool.cc:224] Handling call
0709 12:11:54.292057 (+ 25151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:54.496013 (+203956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:55.689225 (+1193212us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400397bd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:55.689432 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429609216}
I20260709 12:11:55.678910 31677 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:55.722771 26541 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:55.727283 26469 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:55.735836 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:55.734330 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:55.698376 31858 consensus_queue.cc:1243] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 18.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:55.693970 31939 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.742938 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:55.738895 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:55.696017 31846 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:55.694626 31848 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.680639 31466 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.699193 31894 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:55.699191 31828 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:55.699463 31943 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.684484 31952 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:55.748855 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:55.749191 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:55.681380 31824 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.678910 31890 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:55.688041 31483 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.781984 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:55.783223 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:55.733994 26544 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:55.784428 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:55.785287 26544 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 17: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:55.785961 26544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:11:55.690474 31735 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.786345 26464 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:11:55.737293 31825 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.002s	sys 0.015s
W20260709 12:11:55.787240 31825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.003s	sys 0.015s
I20260709 12:11:55.740554 31769 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.680137 31934 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.787772 31769 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.788504 26539 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:55.789443 31934 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:55.777199 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:55.786723 26544 raft_consensus.cc:606] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:11:55.790007 31698 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.790844 26544 raft_consensus.cc:614] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:55.791129 31698 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:55.685112 31898 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.786242 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2336) took 1226 ms. Trace:
I20260709 12:11:55.790558 26542 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 15: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:55.694069 31722 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.773836 31677 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:55.786537 31938 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.798379 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:55.804695 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:55.795502 26467 rpcz_store.cc:276] 0709 12:11:54.559845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.341059 (+781214us) service_pool.cc:224] Handling call
0709 12:11:55.341466 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:55.341934 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:55.341976 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:55.342670 (+   694us) log.cc:844] Serialized 26 byte log entry
0709 12:11:55.650705 (+308035us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:55.650754 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:55.650834 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:55.785995 (+135161us) raft_consensus.cc:1685] finished
0709 12:11:55.786017 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:55.786163 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1883,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":20436,"thread_start_us":307523,"threads_started":1,"wal-append.queue_time_us":403649}
I20260709 12:11:55.806538 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3207) took 1196 ms. Trace:
I20260709 12:11:55.806571 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:55.772114 31747 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:55.809187 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:55.753293 31709 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 12:11:55.769264 31858 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:11:55.784446 31943 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:55.790024 31769 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:55.769042 31939 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.825104 31898 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:55.826624 31828 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:55.775789 31914 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 12:11:55.811614 31889 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:55.776049 31848 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.771826 31817 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.811393 31825 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:55.811189 31890 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:55.840085 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2339) took 1263 ms. Trace:
I20260709 12:11:55.831648 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:55.837558 27165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:57562
I20260709 12:11:55.828750 31938 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:55.775942 31846 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.841873 26544 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:55.844247 26545 raft_consensus.cc:2410] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:11:55.841923 27165 raft_consensus.cc:606] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:55.842172 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 141630us
I20260709 12:11:55.840598 26468 rpcz_store.cc:276] 0709 12:11:54.577373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.598731 (+1021358us) service_pool.cc:224] Handling call
0709 12:11:55.610613 (+ 11882us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:55.610996 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:55.611027 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:55.611507 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:11:55.799128 (+187621us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:55.799837 (+   709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:55.799932 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:55.839804 (+ 39872us) raft_consensus.cc:1685] finished
0709 12:11:55.839829 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:55.840010 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":6031,"thread_start_us":145372,"threads_started":1,"wal-append.queue_time_us":195076}
I20260709 12:11:55.846841 31722 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:55.847530 31817 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:55.850262 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:55.852202 26543 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 15: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:55.817466 31747 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:55.859076 31972 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:11:55.859443 31832 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.856658 31817 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.863535 31817 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.865985 31817 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:55.868069 31848 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:55.868789 27160 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56886 (request call id 814) took 2030 ms (client timeout 1907 ms). Trace:
W20260709 12:11:55.869392 27160 rpcz_store.cc:269] 0709 12:11:53.838308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:53.846330 (+  8022us) service_pool.cc:224] Handling call
0709 12:11:55.868505 (+2022175us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54003b6ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:55.868681 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1048707840}
I20260709 12:11:55.872308 31870 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:55.872593 31846 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.875061 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3333) took 1486 ms. Trace:
I20260709 12:11:55.875566 26465 rpcz_store.cc:276] 0709 12:11:54.388712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.200572 (+811860us) service_pool.cc:224] Handling call
0709 12:11:55.200903 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:55.201121 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:55.227565 (+ 26444us) log.cc:844] Serialized 14 byte log entry
0709 12:11:55.874352 (+646787us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b18002f9860. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5075c824bc 00007f5072fd048b 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a23a
0709 12:11:55.874596 (+   244us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:55.874656 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:55.874765 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:55.874852 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:55.874985 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27196,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":1583,"spinlock_wait_cycles":46249600,"thread_start_us":45787,"threads_started":1,"wal-append.queue_time_us":181906}
I20260709 12:11:55.851395 31825 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:55.879263 31825 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.882313 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3205) took 1285 ms. Trace:
I20260709 12:11:55.882864 26622 rpcz_store.cc:276] 0709 12:11:54.596475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.898964 (+302489us) service_pool.cc:224] Handling call
0709 12:11:54.899395 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:55.175879 (+276484us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:55.276675 (+100796us) log.cc:844] Serialized 14 byte log entry
0709 12:11:55.428589 (+151914us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:55.428670 (+    81us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:55.428748 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:55.882011 (+453263us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b540037a854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:55.882063 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:55.882238 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1283,"prepare.queue_time_us":201514,"prepare.run_wall_time_us":42,"raft.queue_time_us":1443,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":7732,"spinlock_wait_cycles":652376704,"thread_start_us":250540,"threads_started":2,"wal-append.queue_time_us":228217}
I20260709 12:11:55.833932 31868 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.888458 31868 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.807053 26613 rpcz_store.cc:276] 0709 12:11:54.610344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.369373 (+759029us) service_pool.cc:224] Handling call
0709 12:11:55.372348 (+  2975us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:55.372585 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:55.654826 (+282241us) log.cc:844] Serialized 14 byte log entry
0709 12:11:55.806175 (+151349us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:55.806230 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:55.806274 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:55.806341 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:55.806479 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14605,"prepare.queue_time_us":362948,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":3479,"raft.queue_time_us":3282,"thread_start_us":387656,"threads_started":2}
I20260709 12:11:55.890640 31747 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:55.892303 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:55.867868 31521 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.895728 31521 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:11:55.894765 26615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 821) took 2074 ms (client timeout 1915 ms). Trace:
W20260709 12:11:55.898577 26615 rpcz_store.cc:269] 0709 12:11:53.820700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:53.820926 (+   226us) service_pool.cc:224] Handling call
0709 12:11:55.894508 (+2073582us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b5400269154. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:55.894686 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4146258176}
I20260709 12:11:55.902697 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:55.904258 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:55.905048 27164 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:11:55.902786 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:55.908816 26615 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:55.912122 26588 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:55.913378 26544 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:11:55.913564 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:55.914495 26540 raft_consensus.cc:2393] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:55.924752 27160 raft_consensus.cc:2368] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13.
I20260709 12:11:55.927979 26588 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:55.928073 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:55.929895 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:55.930001 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:55.930255 31890 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.930886 27160 raft_consensus.cc:2393] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 13: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:55.930794 31890 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.932963 31890 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:55.927345 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:55.933816 26615 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:55.930925 27164 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 16: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:55.935442 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:55.937080 31890 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:55.926676 31720 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 12:11:55.940333 31720 consensus_queue.cc:1243] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:11:55.940846 31720 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:55.941154 31720 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:55.943102 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:55.945040 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:55.945576 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:55.945757 26621 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:55.946725 26614 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:55.946941 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:55.949071 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:55.951027 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:55.952771 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:55.953385 26540 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:11:55.954926 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:55.872673 31939 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:55.956938 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:55.957829 26543 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.954998 26615 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:55.877991 31886 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:55.960368 31914 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:55.968645 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:11:55.953835 26438 connection.cc:256] RPC call timeout handler was delayed by -1.388161719999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
I20260709 12:11:55.971717 26620 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:55.974836 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:55.938506 31868 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:55.941956 31720 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.977219 31863 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:55.978704 26615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:11:55.981084 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:55.972714 31817 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:55.982349 26615 raft_consensus.cc:606] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:11:55.982683 26613 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 15: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:55.974287 31823 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.990700 26615 raft_consensus.cc:614] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:55.983819 26543 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:55.972460 31870 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:11:55.997037 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:56.000767 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:55.997264 31823 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:55.998575 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:55.999969 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:55.996740 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:56.000267 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:55.984542 31817 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.007516 26543 raft_consensus.cc:2393] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:56.005106 26514 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:55.979936 31868 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:56.018894 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:56.020646 26543 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 15: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:55.984647 31939 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
W20260709 12:11:55.982864 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 133158us
I20260709 12:11:55.997517 31720 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:55.985081 31824 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:11:56.021932 26540 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:11:56.011373 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:56.030108 27166 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:57562
I20260709 12:11:56.082644 27166 raft_consensus.cc:606] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:11:56.083207 27166 raft_consensus.cc:614] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:56.023068 31698 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:56.034000 27159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 734) took 1578 ms. Trace:
I20260709 12:11:56.026862 31483 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:56.030295 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 2332) took 1918 ms. Trace:
I20260709 12:11:56.035801 26548 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 12:11:56.085971 26548 pending_rounds.cc:85] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 8
I20260709 12:11:56.086359 26548 pending_rounds.cc:107] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:11:56.086694 26548 raft_consensus.cc:2889] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:56.087064 26548 pending_rounds.cc:107] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:11:56.087303 26548 raft_consensus.cc:2889] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:56.036098 31466 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:56.036940 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2538) took 1539 ms. Trace:
I20260709 12:11:56.028515 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:56.089600 26618 rpcz_store.cc:276] 0709 12:11:54.497730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.498116 (+   386us) service_pool.cc:224] Handling call
0709 12:11:54.510826 (+ 12710us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:55.031846 (+521020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.036643 (+1004797us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b5400345b54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:56.036873 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1181792000}
I20260709 12:11:56.039628 26616 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:11:56.024129 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:56.091058 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:56.091385 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:56.040197 26470 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:56.041697 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:56.093053 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:56.093657 26470 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.041720 26465 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:56.095027 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:56.095700 26465 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 17: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:56.045301 31521 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:11:56.074551 31977 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.219s	user 0.000s	sys 0.002s
I20260709 12:11:56.047324 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:56.113729 26464 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 15: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:11:56.051505 31929 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.482s	user 0.003s	sys 0.000s
I20260709 12:11:56.052613 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:56.020025 31747 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:56.115083 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:56.057482 27162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 601) took 1142 ms. Trace:
I20260709 12:11:56.059567 31886 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:56.063115 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:56.063714 31948 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:56.005581 31848 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:56.067790 31868 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:56.008744 31817 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:56.024220 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:55.985190 31502 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
W20260709 12:11:56.029060 31960 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.559s	user 0.003s	sys 0.000s
I20260709 12:11:56.031260 31823 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:56.130929 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:56.096721 31894 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.086088 31846 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.084539 27159 rpcz_store.cc:276] 0709 12:11:54.455460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.455643 (+   183us) service_pool.cc:224] Handling call
0709 12:11:55.656460 (+1200817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:55.695409 (+ 38949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.033778 (+338369us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540060de50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:56.033935 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2662035328}
I20260709 12:11:56.085341 26473 rpcz_store.cc:276] 0709 12:11:54.111499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.111710 (+   211us) service_pool.cc:224] Handling call
0709 12:11:56.030063 (+1918353us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54001a8954. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:56.030206 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3477361408}
I20260709 12:11:56.010376 31903 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:56.097559 26468 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 13: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:56.046384 26620 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:11:56.098840 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:56.077616 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:56.136584 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:56.102510 31709 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.111769 27134 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:56.117890 31863 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:56.116240 27162 rpcz_store.cc:276] 0709 12:11:54.914644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.914876 (+   232us) service_pool.cc:224] Handling call
0709 12:11:54.915257 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:55.219201 (+303944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.057176 (+837975us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b5400604854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:56.057411 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":606208384}
I20260709 12:11:56.115011 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:56.118592 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:56.119202 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:56.120221 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:56.122877 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:56.125047 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:56.126636 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 63612.7us
I20260709 12:11:56.125885 31848 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.151289 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:56.148151 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:56.148479 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.152668 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:56.153427 26473 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
W20260709 12:11:56.153692 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 76179.5us
I20260709 12:11:56.089413 31466 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:56.109197 31521 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:56.114070 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:56.156773 26616 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:56.128496 31825 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:56.110837 31698 raft_consensus.cc:697] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:56.142095 26464 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:56.171627 26619 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:11:56.174414 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:56.154989 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:56.129288 31747 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:56.157752 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:56.139533 26617 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:11:56.147768 26465 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:56.164194 26616 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:11:56.190109 26514 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:56.155530 26470 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:11:56.165207 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:56.191206 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:56.191840 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:56.148438 31886 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:56.140486 31893 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:56.140650 31868 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:56.156430 31848 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:56.196604 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:56.197391 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:56.193310 26621 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:56.167315 31823 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:56.141543 31863 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:56.165365 31858 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:56.220916 26468 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:11:56.148959 31709 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:56.200701 31908 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:11:56.208387 31985 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:11:56.215219 26471 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 17: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:56.156049 31903 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:56.146675 31846 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:56.141101 31948 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:56.169760 31870 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:56.138562 31894 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:56.212502 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:56.216711 31667 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:56.236327 31903 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:56.240350 31846 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:56.217183 31823 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.242758 31823 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:56.217443 31938 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:11:56.222129 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:56.206331 31521 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:56.283030 26466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 3326) took 1918 ms (client timeout 2455 ms). Trace:
I20260709 12:11:56.192679 31483 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:56.173702 31722 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:11:56.216904 31489 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:56.234464 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:11:56.331877 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 97543.8us
I20260709 12:11:56.333336 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:56.220063 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2342) took 2109 ms. Trace:
I20260709 12:11:56.333940 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:56.273782 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:56.279171 26618 raft_consensus.cc:2410] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:11:56.334694 26471 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
W20260709 12:11:56.315071 26466 rpcz_store.cc:269] 0709 12:11:54.364570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.382456 (+ 17886us) service_pool.cc:224] Handling call
0709 12:11:56.282790 (+1900334us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b540025a3d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:56.282960 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675587328}
I20260709 12:11:56.225342 31886 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:56.287762 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3209) took 1370 ms. Trace:
I20260709 12:11:56.336093 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:56.267398 31904 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 1.633s	user 0.003s	sys 0.000s
I20260709 12:11:56.254279 31840 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:56.296618 31823 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:56.311228 31667 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:56.325874 31863 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:56.262956 31943 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:56.328251 31709 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:56.328807 31747 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:56.316212 31939 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:11:56.224679 31466 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:56.225255 31853 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 12:11:56.380344 31521 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.346228 26614 rpcz_store.cc:276] 0709 12:11:54.917457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.409802 (+492345us) service_pool.cc:224] Handling call
0709 12:11:55.946523 (+536721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:55.947199 (+   676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.287379 (+340180us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b54003a4b50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:56.287640 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1233403136}
I20260709 12:11:56.423256 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:56.303329 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:56.424278 26473 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:56.347900 31502 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.313267 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:56.267582 31825 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.376832 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:56.377104 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:56.308096 31890 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:56.332221 31979 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 12:11:56.300653 31889 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:56.334347 26547 rpcz_store.cc:276] 0709 12:11:54.106500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.109003 (+  2503us) service_pool.cc:224] Handling call
0709 12:11:54.127417 (+ 18414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:54.150213 (+ 22796us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:54.150262 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:54.150981 (+   719us) log.cc:844] Serialized 26 byte log entry
0709 12:11:54.346883 (+195902us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:54.346945 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:54.347048 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:56.050797 (+1703749us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:56.192475 (+141678us) raft_consensus.cc:1685] finished
0709 12:11:56.192496 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:56.215343 (+ 22847us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22256,"raft.queue_time_us":29055,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":7028,"spinlock_wait_cycles":6451584,"thread_start_us":135478,"threads_started":1,"wal-append.queue_time_us":343215}
I20260709 12:11:56.392959 26464 raft_consensus.cc:2368] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18.
I20260709 12:11:56.393043 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:56.393292 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:56.442510 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 222646us
I20260709 12:11:56.331987 31483 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:56.399855 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:56.444419 26466 raft_consensus.cc:2410] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:11:56.345093 31905 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.404273 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:56.448966 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:56.449899 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 45724.8us
I20260709 12:11:56.405678 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:56.451323 26619 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:11:56.380332 31769 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:56.412590 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:56.331058 31698 consensus_queue.cc:237] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:56.417637 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:56.431217 31863 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:56.425097 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.384171 31938 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:56.462744 31890 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:56.463178 31938 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.463989 31890 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:11:56.463732 31938 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:56.464393 31890 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:56.465341 31890 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:56.466025 31938 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:56.432473 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55438.6us
I20260709 12:11:56.467314 27166 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:57562
I20260709 12:11:56.395844 31943 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:56.435333 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:56.445145 26471 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 15: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:56.445170 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:56.446934 31677 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:56.279897 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 2326) took 2448 ms. Trace:
I20260709 12:11:56.472721 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:56.422269 31777 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:56.485548 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 257137us
I20260709 12:11:56.430150 31891 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:56.457643 26614 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 15: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:56.458830 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:56.453137 31769 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:56.459885 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:56.426908 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:56.434904 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:56.514560 27160 raft_consensus.cc:2376] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15. Re-sending same reply.
I20260709 12:11:56.467939 27166 raft_consensus.cc:606] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:11:56.515436 27166 raft_consensus.cc:614] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:56.442884 26545 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:11:56.444868 31889 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:56.470889 26473 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:56.477892 26470 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:56.518991 26470 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
W20260709 12:11:56.523007 31984 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:11:56.448340 31988 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.419978 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:56.524382 26616 raft_consensus.cc:2393] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:56.454257 31466 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.459105 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:56.434921 31502 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:56.433645 31521 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:56.467069 31840 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:56.495565 31890 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:56.525050 26471 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:11:56.525271 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.479875 26472 rpcz_store.cc:276] 0709 12:11:53.831429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:53.831610 (+   181us) service_pool.cc:224] Handling call
0709 12:11:56.279573 (+2447963us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54002db754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:56.279783 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4121971584}
I20260709 12:11:56.469419 31917 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:56.528904 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:56.526050 31769 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:56.535969 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:56.509646 31821 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.870s	user 0.019s	sys 0.018s
I20260709 12:11:56.443816 31825 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:56.556725 26472 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:11:56.539366 26545 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:11:56.457837 31905 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:56.507270 31891 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:56.511559 31489 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:11:56.552959 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:56.479624 31677 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:56.542786 31908 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:11:56.533507 31988 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:56.556906 31989 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:11:56.550617 31840 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:56.542472 31935 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:11:56.562186 26466 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: [15.9-17.10]
I20260709 12:11:56.571485 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:56.553319 26514 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:56.493402 31893 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:56.555574 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:56.484701 31667 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:56.558532 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2344) took 1465 ms. Trace:
I20260709 12:11:56.566128 26547 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:11:56.479132 31886 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:56.584170 26471 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:56.560500 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:56.592805 26470 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:11:56.596539 31935 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:56.597216 31566 consensus_queue.cc:1059] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:56.555320 26620 raft_consensus.cc:2410] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:11:56.598839 26469 rpcz_store.cc:276] 0709 12:11:55.093446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.736657 (+643211us) service_pool.cc:224] Handling call
0709 12:11:55.737065 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:55.737498 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:55.737543 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:55.738146 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 12:11:55.840914 (+102768us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:55.840943 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:55.840992 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:56.558257 (+717265us) raft_consensus.cc:1685] finished
0709 12:11:56.558291 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:56.558472 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3376,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":2566,"thread_start_us":65345,"threads_started":1,"wal-append.queue_time_us":228402}
I20260709 12:11:56.571781 31677 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:56.571035 31823 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:56.648522 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2346) took 2119 ms. Trace:
I20260709 12:11:56.652935 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:56.562266 31821 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.919s	user 0.020s	sys 0.018s
W20260709 12:11:56.591190 31986 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.271s	user 0.001s	sys 0.001s
I20260709 12:11:56.584214 31943 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:56.564875 31483 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:56.568397 31948 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:56.598596 31893 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.579136 31840 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:56.653129 26548 rpcz_store.cc:276] 0709 12:11:54.529604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.529859 (+   255us) service_pool.cc:224] Handling call
0709 12:11:54.568941 (+ 39082us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:56.087689 (+1518748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.648283 (+560594us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54003971d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:56.648463 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3372428928}
I20260709 12:11:56.665675 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:56.688414 26469 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:56.666956 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 129279us
I20260709 12:11:56.600499 26514 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:56.577725 31988 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:56.692862 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.581686 31521 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:56.566159 31905 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:56.670374 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:56.584527 31817 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:56.579813 31848 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:56.650115 31868 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:56.670003 31823 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.685077 31483 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:56.695490 31828 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:11:56.696647 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.575596 31908 raft_consensus.cc:3055] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:56.701102 31502 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:56.660122 31821 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:56.684626 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:56.737252 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:56.683238 31566 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:11:56.696465 31893 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:56.766000 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:56.766780 26542 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:56.702652 31894 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:56.787865 26469 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:11:56.790951 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:56.761089 31521 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:56.757138 31908 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:56.794626 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:56.795109 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:56.797109 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 196676us
I20260709 12:11:56.801394 26548 raft_consensus.cc:2393] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 13: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:56.802901 26514 leader_election.cc:400] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13.
I20260709 12:11:56.803452 26469 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:11:56.803718 26514 leader_election.cc:403] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:56.802831 27133 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:56.765555 31828 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:56.810714 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:56.813067 26469 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:11:56.757802 31823 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:56.760143 31483 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:56.818725 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:56.809720 31948 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:56.841817 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:56.848990 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:56.811399 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:56.566784 31891 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:56.821646 26514 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:56.868721 31891 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:56.869669 31709 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:56.806900 31894 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13.
I20260709 12:11:56.872879 31894 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:56.873413 31894 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:56.873869 31894 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:56.838598 31667 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:11:56.875380 31667 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:56.875761 31667 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:56.876968 31747 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
W20260709 12:11:56.826869 31997 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 12:11:56.827495 31993 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 12:11:56.830922 31998 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:11:56.819340 31821 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:56.831722 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:56.905601 26548 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:11:56.906949 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:56.907981 26548 raft_consensus.cc:2410] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:11:56.908414 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:56.909183 27163 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:56.832774 31868 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:56.860387 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:56.863735 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2446) took 1951 ms. Trace:
I20260709 12:11:56.841904 32008 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:56.839071 31948 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:56.876782 31667 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:56.879207 26470 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 13: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:56.799391 31825 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:56.895639 31981 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.869s	user 0.003s	sys 0.002s
I20260709 12:11:56.899430 31848 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:56.935895 31993 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:11:56.938416 27162 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:56.924829 26546 rpcz_store.cc:276] 0709 12:11:54.911856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.484313 (+572457us) service_pool.cc:224] Handling call
0709 12:11:55.484818 (+   505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:55.499046 (+ 14228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:55.508858 (+  9812us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:56.276957 (+768099us) spinlock_profiling.cc:243] Waited 960 us on lock 0x7b2c0005b0f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:11:56.277540 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 12:11:56.495402 (+217862us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:56.495458 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.495578 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:56.841142 (+345564us) raft_consensus.cc:1685] finished
0709 12:11:56.841169 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:56.863629 (+ 22460us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7073,"raft.queue_time_us":7229,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"spinlock_wait_cycles":2208640,"thread_start_us":217341,"threads_started":1,"wal-append.queue_time_us":428540}
I20260709 12:11:56.955862 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2354) took 1347 ms. Trace:
I20260709 12:11:56.964704 26539 rpcz_store.cc:276] 0709 12:11:55.608573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.789218 (+180645us) service_pool.cc:224] Handling call
0709 12:11:55.789544 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:55.851711 (+ 62167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:55.851744 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:55.853950 (+  2206us) log.cc:844] Serialized 26 byte log entry
0709 12:11:55.929492 (+ 75542us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:55.935064 (+  5572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.263613 (+328549us) spinlock_profiling.cc:243] Waited 61.8 ms on lock 0x7b54002378d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:56.263687 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:56.894892 (+631205us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:56.955544 (+ 60652us) raft_consensus.cc:1685] finished
0709 12:11:56.955579 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:56.955773 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":3536,"spinlock_wait_cycles":229324928,"thread_start_us":66203,"threads_started":1,"wal-append.queue_time_us":123080}
W20260709 12:11:56.977509 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 166261us
W20260709 12:11:56.977782 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 156198us
I20260709 12:11:56.972110 32008 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.981528 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:56.983227 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.987620 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:56.990927 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:56.991675 26468 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:56.977296 31667 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:56.996295 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:56.999296 26439 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:56.995529 27133 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:56.987573 31905 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:56.986615 31952 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.008812 26439 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:57.035606 31952 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:57.011557 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:57.016115 31999 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:57.036782 26371 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39184 (request call id 161) took 18180 ms (client timeout 15000 ms). Trace:
I20260709 12:11:57.037536 31988 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:57.038172 31999 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:57.038594 31948 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:57.039770 31948 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:57.015404 31996 raft_consensus.cc:2955] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:11:57.040166 31948 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:57.041728 31709 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:57.042695 31709 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:57.037259 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:57.043322 31709 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:57.044690 26439 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:57.021543 31824 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:57.045742 31824 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:56.988328 31848 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:11:57.046793 31824 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:57.047626 31848 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:57.048105 31824 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:57.048190 31848 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:57.049475 31848 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:56.986256 32008 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:57.016176 31908 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:57.059659 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3340) took 1018 ms. Trace:
I20260709 12:11:57.012838 31905 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:57.050834 32010 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.002911 31747 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:11:57.006381 32000 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:57.052507 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:57.075443 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:57.024819 31769 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:57.004434 31632 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:57.053594 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:57.054601 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:57.080739 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:57.062783 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:57.062898 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:57.082239 26539 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:11:57.063688 26548 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:11:57.006039 31502 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.060122 26467 rpcz_store.cc:276] 0709 12:11:56.041526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.041805 (+   279us) service_pool.cc:224] Handling call
0709 12:11:56.042149 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:56.042640 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:56.042682 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:56.043190 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 12:11:56.189264 (+146074us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:56.438862 (+249598us) log.cc:844] Serialized 14 byte log entry
0709 12:11:57.052112 (+613250us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b1800288760. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5075c824bc 00007f5072fd048b 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287
0709 12:11:57.052268 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.052349 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:57.052392 (+    43us) raft_consensus.cc:1685] finished
0709 12:11:57.059425 (+  7033us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.059599 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10941,"prepare.queue_time_us":376633,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":164645,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":18029,"spinlock_wait_cycles":52682624,"thread_start_us":521540,"threads_started":3,"wal-append.queue_time_us":187526}
I20260709 12:11:57.010149 31817 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:57.073248 26542 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:11:57.127404 26540 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:11:57.058682 31948 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:57.051414 32002 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:57.129223 31948 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:57.079228 31999 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:57.131078 31632 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:57.058322 26468 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:57.086668 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:57.069214 31483 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:57.037240 26371 rpcz_store.cc:269] 0709 12:11:38.856328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.856526 (+   198us) service_pool.cc:224] Handling call
0709 12:11:57.036570 (+18180044us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:51.122236 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:51.125922 (+  3686us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:51.126022 (+   100us) write_op.cc:435] Acquired schema lock
0709 12:11:51.126087 (+    65us) tablet.cc:662] Decoding operations
0709 12:11:51.175056 (+ 48969us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:51.175185 (+   129us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:51.175235 (+    50us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:11:51.203317 (+ 28082us) tablet.cc:701] Row locks acquired
0709 12:11:51.203376 (+    59us) write_op.cc:260] PREPARE: finished
0709 12:11:51.203646 (+   270us) write_op.cc:270] Start()
0709 12:11:51.203831 (+   185us) write_op.cc:276] Timestamp: P: 1783599111203554 usec, L: 0
0709 12:11:51.203875 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 12:11:51.205181 (+  1306us) log.cc:844] Serialized 4367 byte log entry
0709 12:11:51.354971 (+149790us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5072fd00ac 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b
0709 12:11:52.144523 (+789552us) spinlock_profiling.cc:243] Waited 9.75 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:52.473724 (+329201us) op_driver.cc:464] REPLICATION: finished
0709 12:11:52.623509 (+149785us) write_op.cc:301] APPLY: starting
0709 12:11:52.656367 (+ 32858us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:52.851193 (+194826us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:52.851244 (+    51us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:52.993871 (+142627us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:52.994192 (+   321us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 12:11:52.994263 (+    71us) write_op.cc:312] APPLY: finished
0709 12:11:53.030249 (+ 35986us) log.cc:844] Serialized 105 byte log entry
0709 12:11:53.034792 (+  4543us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:53.041386 (+  6594us) write_op.cc:454] Released schema lock
0709 12:11:53.064470 (+ 23084us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:53.132407 (+ 67937us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:53.132447 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5737318,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":149375,"apply.run_cpu_time_us":21356,"apply.run_wall_time_us":508836,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50063,"num_ops":11,"prepare.queue_time_us":212156,"prepare.run_cpu_time_us":69329,"prepare.run_wall_time_us":413191,"raft.queue_time_us":168265,"raft.run_cpu_time_us":27028,"raft.run_wall_time_us":121583,"replication_time_us":1250478,"spinlock_wait_cycles":77158144,"thread_start_us":456021,"threads_started":4,"wal-append.queue_time_us":425131,"wal-append.run_cpu_time_us":71201,"wal-append.run_wall_time_us":2598402}]]}
I20260709 12:11:57.095460 31848 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:57.161481 31914 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:57.162319 31914 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:57.164943 31914 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:57.095580 31894 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:57.098003 32008 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:57.074548 32000 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.180644 32000 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:57.182199 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.101085 31521 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:57.182998 31521 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:57.184419 31863 consensus_meta.cc:287] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.716s	user 0.017s	sys 0.005s
I20260709 12:11:57.185096 26470 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:11:57.185333 31894 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:57.103241 31823 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:57.104640 31988 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:57.107915 31893 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:57.073982 31840 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:57.117350 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:57.117982 26621 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:57.119138 31769 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:57.118888 31677 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:57.122548 26467 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:57.125538 26472 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:57.066557 31905 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.079542 31709 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:57.199059 26614 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:11:57.212272 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:57.214020 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:57.215644 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:57.216248 26619 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:57.221832 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:57.222637 26620 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
W20260709 12:11:57.231026 31890 consensus_meta.cc:287] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.672s	user 0.018s	sys 0.003s
W20260709 12:11:57.235793 31889 consensus_meta.cc:287] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.697s	user 0.015s	sys 0.009s
I20260709 12:11:57.239138 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:57.236474 31889 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:57.251296 26620 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:57.252478 31889 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:57.261029 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2454) took 1305 ms. Trace:
I20260709 12:11:57.261546 26547 rpcz_store.cc:276] 0709 12:11:55.955177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.469193 (+514016us) service_pool.cc:224] Handling call
0709 12:11:56.487675 (+ 18482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:56.599148 (+111473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.260787 (+661639us) spinlock_profiling.cc:243] Waited 75.4 ms on lock 0x7b54003377d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:57.260961 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173443456}
I20260709 12:11:57.272127 31853 raft_consensus.cc:3055] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:57.272639 31853 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:57.272984 26613 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:57.273587 31853 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:57.218261 26615 raft_consensus.cc:2955] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:11:57.313094 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 835) took 1315 ms. Trace:
W20260709 12:11:57.304654 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 323124us
I20260709 12:11:57.317550 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:57.319099 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3344) took 1270 ms. Trace:
I20260709 12:11:57.319548 26466 rpcz_store.cc:276] 0709 12:11:56.048940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.458371 (+409431us) service_pool.cc:224] Handling call
0709 12:11:56.558459 (+100088us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:56.587052 (+ 28593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.314695 (+727643us) spinlock_profiling.cc:243] Waited 79.3 ms on lock 0x7b54002db250. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:57.319018 (+  4323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182388992}
I20260709 12:11:57.313565 26617 rpcz_store.cc:276] 0709 12:11:55.998128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.007081 (+  8953us) service_pool.cc:224] Handling call
0709 12:11:56.137386 (+130305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:56.188451 (+ 51065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.312852 (+1124401us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400195350. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:57.313013 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262935296}
I20260709 12:11:57.330029 26619 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:11:57.276666 31828 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:57.330878 31677 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:57.356153 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:57.357677 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:57.362780 26622 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: [12.7-18.10]
I20260709 12:11:57.315644 31894 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:11:57.376231 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:57.376274 31891 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:57.377014 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:57.377942 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:57.419723 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:11:57.419931 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 43803.7us
I20260709 12:11:57.420850 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:57.378675 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:57.379730 26547 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:11:57.354017 31868 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.378715 31939 consensus_queue.cc:1059] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:11:57.381140 31565 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:57.381448 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.386888 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:57.337604 31853 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.388685 26618 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:11:57.392990 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:57.394680 26544 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:57.396346 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:57.435122 26514 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:57.403923 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 408479us
I20260709 12:11:57.413501 26541 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:57.356187 31667 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:57.380213 31846 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.446673 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:57.419615 26466 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:57.424171 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:57.425536 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:57.449783 26548 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:11:57.347287 31766 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:57.440235 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:57.450968 26546 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:57.426800 31821 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:57.454728 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:57.423468 31893 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:57.468151 31893 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:57.439316 31677 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:57.469013 31893 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:57.442996 26539 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 11: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:57.427250 31891 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:57.424288 31989 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:11:57.440423 31886 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:57.472165 31886 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:57.474678 31939 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:57.475250 31939 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:57.475934 27162 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:57.476190 31939 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:57.477049 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:57.477938 27160 raft_consensus.cc:2410] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 15 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:11:57.478571 31766 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:57.437933 31868 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:57.481145 31868 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:57.469841 31677 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:57.479054 31766 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.431062 31889 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:57.397871 31996 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:11:57.481930 31846 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:57.482750 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:57.514149 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:57.483378 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 59317.8us
I20260709 12:11:57.514912 26621 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:57.515530 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:57.446259 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:57.483603 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:57.516371 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 70222.6us
W20260709 12:11:57.440207 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 364836us
I20260709 12:11:57.518456 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:57.454762 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:57.468220 31840 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:57.495049 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 438961us
W20260709 12:11:57.497720 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.510182 26546 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:11:57.451951 32008 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:57.532136 26588 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:57.533556 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:57.523785 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:57.538808 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:57.521464 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:57.525085 26439 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:57.474273 31886 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:57.550426 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:57.551221 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:57.552111 26472 raft_consensus.cc:2410] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:11:57.551975 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:57.552959 26619 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:57.544179 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:57.555320 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:57.555980 26465 raft_consensus.cc:2368] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13.
I20260709 12:11:57.557934 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:57.511620 31821 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:57.573458 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:57.574555 27166 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 13: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:57.450152 31667 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:57.577069 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:57.577484 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:57.579568 27160 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:57.581001 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:57.584784 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:57.585427 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.584836 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:57.579974 27160 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:11:57.592303 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 60280.6us
I20260709 12:11:57.545969 32001 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:57.545807 31823 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:57.617188 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2378) took 1075 ms. Trace:
I20260709 12:11:57.617651 26469 rpcz_store.cc:276] 0709 12:11:56.541635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.066768 (+525133us) service_pool.cc:224] Handling call
0709 12:11:57.080086 (+ 13318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:57.080395 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:57.080436 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:57.081074 (+   638us) log.cc:844] Serialized 26 byte log entry
0709 12:11:57.425337 (+344263us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:57.425417 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.425484 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:57.616903 (+191419us) raft_consensus.cc:1685] finished
0709 12:11:57.616930 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.617122 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":268404,"threads_started":1,"wal-append.queue_time_us":423872}
I20260709 12:11:57.619386 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:57.578349 31868 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:11:57.535073 31889 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:57.607988 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:57.638273 26620 raft_consensus.cc:2410] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:11:57.639314 26542 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
W20260709 12:11:57.585822 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.609259 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:57.578878 27162 raft_consensus.cc:2955] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:11:57.598680 27160 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:57.647464 27160 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:57.601385 32019 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:57.611290 32024 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:11:57.534473 31521 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:57.568848 31890 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:57.607263 31828 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:57.614532 31709 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:57.615757 32000 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:57.564225 32008 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:57.625113 31893 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:57.626628 32017 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:57.632359 31677 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:57.632660 31667 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:57.560576 31863 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:57.634011 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:57.605794 26465 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 12:11:57.607120 32022 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:57.654429 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:57.610946 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:57.657505 32019 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:11:57.706830 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52534.2us
I20260709 12:11:57.679622 31828 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:57.662138 26438 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.173s (SENT) [suppressed 11 similar messages]
I20260709 12:11:57.673115 31891 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:57.712565 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 50490.1us
I20260709 12:11:57.663198 26619 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:11:57.664335 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:57.670076 26546 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:57.716773 26439 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:57.681627 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:57.657002 31858 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:57.700738 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:57.658783 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:57.723274 26465 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:57.723598 26470 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 17: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:11:57.724236 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 168978us
W20260709 12:11:57.726598 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.725013 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:57.732024 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:57.732297 27133 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:57.725791 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:57.734526 26619 raft_consensus.cc:2410] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:11:57.734587 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:57.735080 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:57.703617 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:57.703464 26621 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:11:57.706151 26471 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:57.669385 31821 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:57.708123 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:57.656064 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 93198.2us
W20260709 12:11:57.654165 31840 consensus_queue.cc:1175] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac3ac2181aa941229a758ccf6b5607cd" responder_term: 17 status { last_received { term: 17 index: 12 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 16. Current term is 17. Ops: [16.12-16.12]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:57.710332 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:57.718689 26542 raft_consensus.cc:2410] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:57.652707 31817 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:11:57.738807 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:57.739476 26621 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:57.740772 26470 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:57.747936 26469 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:57.742093 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:57.752960 26621 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 14. Current term is 15. Ops: [13.8-14.9]
I20260709 12:11:57.759658 26618 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:57.759692 26619 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:11:57.760460 26619 pending_rounds.cc:85] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 12
I20260709 12:11:57.760699 26619 pending_rounds.cc:107] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:11:57.760926 26619 raft_consensus.cc:2889] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:57.711449 32019 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.770175 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:57.722112 31828 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:57.810993 31848 consensus_meta.cc:287] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.621s	user 0.016s	sys 0.000s
I20260709 12:11:57.770807 31722 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.772768 31521 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:57.779145 31825 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 12:11:57.813725 32015 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.394s	user 0.000s	sys 0.002s
I20260709 12:11:57.766711 31935 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:57.817579 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3218) took 1909 ms. Trace:
I20260709 12:11:57.710175 32022 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:57.820267 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2377) took 1292 ms. Trace:
I20260709 12:11:57.820125 31821 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:57.720959 31945 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:57.821408 31897 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:57.744517 31565 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:57.821900 31897 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:57.803836 31952 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:57.826475 31948 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:57.747227 31988 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:57.855729 31988 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:57.855940 31908 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.856243 31988 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.856874 31988 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:57.859026 32000 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:57.725883 31863 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:57.793725 31889 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:57.776885 31846 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:57.827347 32008 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:57.862460 32008 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:57.863142 32008 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:11:57.863638 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:57.827740 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 59489.6us
I20260709 12:11:57.865177 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 766) took 1163 ms. Trace:
I20260709 12:11:57.828325 31991 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:57.829155 32032 raft_consensus.cc:3055] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:57.748382 31823 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:57.840379 27160 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 12:11:57.768597 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:57.849488 31897 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:57.820689 26473 rpcz_store.cc:276] 0709 12:11:56.527954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.879446 (+351492us) service_pool.cc:224] Handling call
0709 12:11:56.879887 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:56.880319 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:56.880359 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:56.892739 (+ 12380us) log.cc:844] Serialized 26 byte log entry
0709 12:11:57.143620 (+250881us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:57.143673 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.143774 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:57.813077 (+669303us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:57.819943 (+  6866us) raft_consensus.cc:1685] finished
0709 12:11:57.819966 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.820201 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3147,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":14167296,"thread_start_us":250470,"threads_started":1,"wal-append.queue_time_us":436446}
I20260709 12:11:57.818042 26622 rpcz_store.cc:276] 0709 12:11:55.908583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.910277 (+  1694us) service_pool.cc:224] Handling call
0709 12:11:55.910645 (+   368us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:11:57.400796 (+1490151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.817236 (+416440us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b540003c354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:57.817508 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3320684800}
I20260709 12:11:57.851923 31858 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.821127 32022 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:57.822813 31565 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:57.852995 31893 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:57.865603 26471 rpcz_store.cc:276] 0709 12:11:56.702125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.091567 (+389442us) service_pool.cc:224] Handling call
0709 12:11:57.091873 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:57.747021 (+655148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.864930 (+117909us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54000dc0d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:57.865112 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404672256}
I20260709 12:11:57.766260 26465 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
I20260709 12:11:57.883507 26513 leader_election.cc:400] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18.
W20260709 12:11:57.930387 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 64810.3us
I20260709 12:11:57.931425 26622 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:57.931854 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:57.753430 32017 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:11:57.837766 31905 consensus_meta.cc:287] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.000s
I20260709 12:11:57.939504 26618 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:57.941321 26513 leader_election.cc:400] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13.
I20260709 12:11:57.941895 26513 leader_election.cc:403] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:57.921157 27160 pending_rounds.cc:85] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 11
I20260709 12:11:57.942689 27160 pending_rounds.cc:107] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 12:11:57.943135 27160 raft_consensus.cc:2889] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:57.925535 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 396991us
I20260709 12:11:57.833950 31766 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:57.933681 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:57.933756 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:57.934644 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:57.886093 31720 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:11:57.922807 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 154346us
I20260709 12:11:57.886241 32032 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:57.946332 26614 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:57.921228 31863 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:57.927811 31825 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:57.921973 31823 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:57.936465 31817 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.924448 31858 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.983637 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:57.947335 26618 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:11:57.985405 26622 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 16: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:57.930558 32022 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:57.898535 31846 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:11:57.980773 27134 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:57.929714 31893 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:57.938354 31897 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:57.996857 26514 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:11:57.989930 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 245846us
W20260709 12:11:57.998381 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 259680us
I20260709 12:11:57.899073 31853 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.086s
W20260709 12:11:58.010484 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:57.983480 32030 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:11:57.937415 31945 consensus_queue.cc:1175] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "01a57027214a411e80874ac7febd628b" responder_term: 17 status { last_received { term: 17 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 17 index: 11 } }
I20260709 12:11:57.979244 31891 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:57.945811 32001 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:57.928838 31868 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 12:11:57.979136 32028 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.268s	user 0.002s	sys 0.000s
I20260709 12:11:57.935487 31722 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.010823 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:58.022733 31893 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:58.023973 31893 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.021157 32037 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:58.028692 32037 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:57.978382 31905 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:58.030586 32032 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:58.034691 31863 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:58.035457 31828 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:58.036803 31905 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:58.007364 31817 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:58.040179 31817 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:57.999740 32022 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:58.011582 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:57.927238 32019 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:57.982836 32017 raft_consensus.cc:697] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:57.989693 31894 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13.
W20260709 12:11:58.016299 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 264761us
I20260709 12:11:57.989051 31825 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:57.999926 31823 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:58.011300 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:58.041565 26622 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 14: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:58.044874 26618 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:58.045567 26615 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: [13.11-15.12]
I20260709 12:11:58.047633 26613 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:58.064335 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 53161.1us
I20260709 12:11:58.025251 31886 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:58.004053 31521 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:11:58.065222 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:58.064157 27133 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:11:58.044108 31828 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:58.040560 31948 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:11:58.074859 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:58.081823 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:58.187888 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 190993us
W20260709 12:11:58.186897 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 119311us
I20260709 12:11:58.194501 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:58.195447 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:58.201272 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:58.202140 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:58.205749 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 141693us
I20260709 12:11:58.063064 31891 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:58.063382 31825 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:58.215035 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.219483 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2378) took 2154 ms. Trace:
I20260709 12:11:58.223762 26545 rpcz_store.cc:276] 0709 12:11:56.064622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.560879 (+496257us) service_pool.cc:224] Handling call
0709 12:11:56.561201 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:56.561641 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:56.561677 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:56.564305 (+  2628us) log.cc:844] Serialized 26 byte log entry
0709 12:11:57.254545 (+690240us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b180030ca00. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:11:57.518276 (+263731us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:57.518322 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.518413 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:57.854162 (+335749us) spinlock_profiling.cc:243] Waited 8.99 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:11:58.219210 (+365048us) raft_consensus.cc:1685] finished
0709 12:11:58.219240 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:58.219403 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1187,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":5687,"spinlock_wait_cycles":72810624,"thread_start_us":263521,"threads_started":1,"wal-append.queue_time_us":1071678}
I20260709 12:11:58.228744 26617 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:11:58.048396 31722 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:58.230942 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:58.204582 31824 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:58.186545 32042 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:58.234323 26618 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:58.242818 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:58.067260 31905 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.164s
W20260709 12:11:58.309556 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 66809us
I20260709 12:11:58.244915 31821 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:58.051143 32001 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:58.218734 31891 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:58.320935 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 307877us
I20260709 12:11:58.310423 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:58.301371 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 295116us
I20260709 12:11:58.220963 31489 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
W20260709 12:11:58.305629 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 322086us
I20260709 12:11:58.357208 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:58.317010 31817 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:58.235074 31677 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:58.349857 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:58.387915 26472 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 13: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:58.355243 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:58.230492 32045 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 12:11:58.358470 26513 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:11:58.247285 32036 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 12:11:58.359266 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:58.315523 31824 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.360514 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:58.401316 26470 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:11:58.402848 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:58.361073 26471 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 12:11:58.360445 32017 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:58.361388 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:58.362679 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:58.365123 32031 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:58.365798 32044 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:58.318831 32034 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:58.237908 31540 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 12:11:58.221853 32022 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:58.366518 31868 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:58.368610 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:58.419500 26469 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
W20260709 12:11:58.369496 31908 consensus_meta.cc:287] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.001s
W20260709 12:11:58.370324 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.376976 31720 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:11:58.378918 32050 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:11:58.322899 31891 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.316450 31821 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:58.391499 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:58.399861 32042 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.351886 31722 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:58.406693 31824 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:58.411648 32045 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:58.412370 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:58.414983 32031 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:58.416033 32044 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:58.416723 32034 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:58.354354 31889 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:58.446995 26545 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
W20260709 12:11:58.447486 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.449515 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:58.407621 32019 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:58.446156 26467 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
W20260709 12:11:58.421016 32047 consensus_queue.cc:1175] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aaadfdd9ca9f424c91505f9b43876233" responder_term: 15 status { last_received { term: 12 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 14. Current term is 15. Ops: [13.8-14.9]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:11:58.480094 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.486140 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:58.443488 31720 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.492779 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:58.535271 26465 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 13: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:11:58.460551 32000 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.459438 31821 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:58.468474 32045 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:58.534328 27162 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:58.537798 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:58.542831 27166 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:58.539070 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:11:58.479755 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 121377us
I20260709 12:11:58.546924 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:11:58.551333 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 476554us
I20260709 12:11:58.520869 31889 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:58.556967 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:58.560391 27160 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:11:58.526723 31677 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:58.527226 32044 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:58.557690 27166 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:11:58.520529 31905 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:11:58.582154 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:58.582798 27162 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:11:58.550570 31914 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:58.593096 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 54119.3us
I20260709 12:11:58.508726 32031 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:58.469537 32042 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:58.566146 31889 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:58.604913 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 52474.7us
I20260709 12:11:58.551427 32067 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:58.582314 31521 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:58.547816 32000 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:58.621270 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:58.621930 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:11:58.622684 32058 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:11:58.627609 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:58.624045 31824 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:58.619174 32070 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:58.625628 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:58.636831 27163 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:11:58.639261 27160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:57562
I20260709 12:11:58.642951 32022 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.656179 27165 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:11:58.659725 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:58.661051 27164 raft_consensus.cc:2410] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:58.635951 31908 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:58.667918 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.601537 31914 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:58.638916 32070 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:58.700129 27165 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:58.654878 32063 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.663578 32067 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:11:58.703212 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 154466us
I20260709 12:11:58.554291 32034 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:58.733783 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 127538us
W20260709 12:11:58.666914 31893 consensus_meta.cc:287] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.642s	user 0.012s	sys 0.000s
I20260709 12:11:58.636025 31521 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:58.700462 31988 consensus_meta.cc:287] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.843s	user 0.009s	sys 0.003s
I20260709 12:11:58.835575 26588 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:58.782243 32066 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 12:11:58.783339 32060 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:58.784226 32075 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:58.659458 32044 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:58.786108 31817 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:58.787001 32052 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 12:11:58.921454 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:58.914242 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 367389us
I20260709 12:11:58.790719 32076 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:58.791468 32056 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.793041 31828 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:58.793987 32072 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:58.795156 31540 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:58.803560 31769 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:58.806169 32042 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:58.661079 31677 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:58.807499 32061 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
W20260709 12:11:58.808429 32053 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.260s	user 0.000s	sys 0.000s
I20260709 12:11:58.816123 31914 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:58.855644 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:58.832311 32063 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:58.895408 26617 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 12. Current term is 13. Ops: [11.10-12.11]
I20260709 12:11:58.895218 26588 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:11:58.701768 32070 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:58.910001 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 118075us
W20260709 12:11:58.847177 31858 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.819s	user 0.013s	sys 0.000s
I20260709 12:11:58.913024 27134 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:59.054167 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 141246us
I20260709 12:11:59.055060 31905 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.033092 32086 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.056003 32086 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:59.056970 31891 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.001s
I20260709 12:11:59.057476 31914 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:59.058286 31914 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:59.057592 31891 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:58.832865 31863 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:58.927654 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:58.928253 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:58.928684 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:59.058350 32086 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.065631 26468 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:58.970240 32083 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:58.921595 31840 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.067332 31840 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.069779 31840 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:58.899927 31988 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.003907 27160 raft_consensus.cc:606] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
W20260709 12:11:58.986573 32074 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:11:58.980882 32081 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.072654 31988 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.072466 32081 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:58.919872 31824 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:59.018805 31823 consensus_meta.cc:287] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.946s	user 0.007s	sys 0.006s
I20260709 12:11:59.000686 31521 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:59.075058 31823 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.059319 31914 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:58.980443 32091 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:11:59.076535 26466 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:59.077157 32091 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.077575 32091 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:11:59.005664 31897 consensus_meta.cc:287] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.984s	user 0.013s	sys 0.000s
I20260709 12:11:59.062887 31863 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:58.993773 32059 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:59.061113 31891 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.078919 32059 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.064105 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:59.003196 32088 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:59.080387 26464 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:59.080853 32088 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.064426 26470 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:59.077732 31823 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.082501 31891 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.083295 32088 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:59.083155 31891 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.059512 31858 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.024035 32031 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.086649 31891 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.034960 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:11:59.044663 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.095794 26473 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
W20260709 12:11:59.046900 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 151825us
I20260709 12:11:59.047536 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:58.779323 32054 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:59.067052 32083 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:58.970048 32056 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:58.937866 32076 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.074119 31824 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.063051 32042 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:58.833691 32067 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.031232 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:11:59.030437 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.112303 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:59.114285 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:11:59.115068 26514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.007s	sys 0.010s
W20260709 12:11:59.115626 26514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.007s	sys 0.010s
W20260709 12:11:59.116016 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 619010us
W20260709 12:11:59.118278 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:59.076647 31825 consensus_meta.cc:287] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.837s	user 0.012s	sys 0.001s
I20260709 12:11:59.122440 26473 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:11:59.121477 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 74060.6us
I20260709 12:11:59.130765 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:59.132613 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:59.136813 26465 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:11:59.139071 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:59.209335 26467 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:11:59.210633 26464 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:59.138860 31720 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.000s
I20260709 12:11:59.120328 32031 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.120312 32022 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:59.131560 31897 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.211162 32044 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:59.136103 31521 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:59.136340 31988 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:59.260767 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.134632 32073 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:59.138026 32000 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.207180 31905 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.227995 31769 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:59.164759 31840 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 12:11:59.135818 31825 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.137714 32042 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.286618 32078 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:59.226715 31720 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.286775 32040 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:11:59.135020 32054 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:59.298789 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 162312us
I20260709 12:11:59.335258 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:59.267987 31677 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:59.276261 31540 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.238229 32031 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.246665 31897 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:11:59.304908 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 174213us
I20260709 12:11:59.264854 31521 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.275044 31905 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.340497 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:59.340997 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:59.310590 32081 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:59.341722 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 174573us
I20260709 12:11:59.346240 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:59.347697 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:59.271538 32073 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.357059 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:11:59.348747 31821 consensus_meta.cc:287] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.795s	user 0.012s	sys 0.001s
I20260709 12:11:59.357836 26621 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:59.344246 32022 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.341126 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:59.341498 31677 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:59.365114 26618 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.343163 32110 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.365975 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:11:59.369485 31521 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.346240 31988 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:11:59.370854 31988 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.371388 31988 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.373613 31988 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.376909 26618 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:11:59.382006 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:59.346462 31540 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.402040 26618 raft_consensus.cc:2410] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:11:59.413755 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:11:59.343315 32078 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.414602 26618 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.348454 32000 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:11:59.367213 31677 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:59.416889 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 50983.5us
I20260709 12:11:59.363926 32081 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:11:59.383144 31824 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:11:59.420502 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 69905us
I20260709 12:11:59.379546 32104 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:11:59.428706 26622 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:11:59.443517 26618 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:11:59.433378 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:11:59.446475 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.366956 31821 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.460624 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:59.462757 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:59.463295 26548 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:59.421597 32063 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:59.345752 32040 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.430333 31945 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.470095 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:59.470248 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:59.471879 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:59.472855 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:59.477046 26548 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 16: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:59.474620 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:59.477173 26540 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.477627 26546 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:11:59.431983 32076 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:59.461285 32067 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:59.450320 32081 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.488716 32081 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:59.488607 32091 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.462030 32056 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.481261 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:59.480440 31945 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.383544 32110 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.498867 32091 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:11:59.500161 32107 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:11:59.502338 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:59.503356 26616 raft_consensus.cc:2410] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:11:59.504009 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 849) took 1869 ms. Trace:
I20260709 12:11:59.504416 26620 rpcz_store.cc:276] 0709 12:11:57.634593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.730087 (+ 95494us) service_pool.cc:224] Handling call
0709 12:11:59.503792 (+1773705us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b5400345654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:59.503948 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1815228800}
I20260709 12:11:59.505367 26616 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:59.506271 32110 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.508685 32042 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:59.508893 31905 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.483203 32109 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:59.509780 32109 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:11:59.510377 31858 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:59.510762 32109 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.471990 32022 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:59.515796 32070 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.518340 32108 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.518298 32022 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.519973 27161 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: []
W20260709 12:11:59.517987 32097 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:11:59.537814 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:59.502120 32073 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.479849 32063 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.608989 26539 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:59.519042 32108 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:11:59.521808 32098 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 12:11:59.522188 32090 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 12:11:59.520695 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:11:59.553848 26542 raft_consensus.cc:2410] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:59.542836 26548 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:11:59.619421 26618 raft_consensus.cc:2410] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:11:59.564558 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.483240 32054 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.516598 32078 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:59.621299 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:11:59.523861 32102 log.cc:927] Time spent T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 12:11:59.522894 32101 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:11:59.615806 26540 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:11:59.616489 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:59.519701 32099 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.622975 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:59.522321 32022 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.517283 32117 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:59.642292 26539 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
W20260709 12:11:59.645895 32033 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.669s	user 0.007s	sys 0.011s
I20260709 12:11:59.616021 31996 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.654486 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:59.654670 31996 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.656164 31840 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:59.656973 31996 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.657085 32080 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:59.658126 32080 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:59.658728 32080 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:59.645977 32095 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 12:11:59.662907 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:59.663690 26473 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:11:59.653694 32040 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:59.668934 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:59.669677 26473 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:11:59.671108 32108 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:59.662938 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:59.672365 32017 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:59.624341 32054 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:59.673511 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:11:59.621869 31853 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:59.674764 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.674880 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:11:59.689700 26473 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.639750 32070 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:59.675616 32008 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:59.681516 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:59.696456 26546 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 16: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:11:59.618547 32063 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.667320 32022 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:59.690258 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:59.691841 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:59.693186 31905 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:59.664960 31821 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:59.674103 32117 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:11:59.698302 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:59.702482 26472 raft_consensus.cc:2410] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:11:59.649318 32099 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.702559 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:59.688213 31945 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:59.710314 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:59.711583 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:59.712337 26468 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:11:59.716987 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:59.717715 26468 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:11:59.735183 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3245) took 2398 ms. Trace:
I20260709 12:11:59.735828 26613 rpcz_store.cc:276] 0709 12:11:57.317898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.320995 (+  3097us) service_pool.cc:224] Handling call
0709 12:11:57.573116 (+252121us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5800049298. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:11:57.573308 (+   192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:58.064874 (+491566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.716139 (+1651265us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b54002602d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:11:59.716384 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1120947968}
I20260709 12:11:59.737896 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 2394) took 1362 ms. Trace:
I20260709 12:11:59.738348 26545 rpcz_store.cc:276] 0709 12:11:58.357429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.358961 (+  1532us) service_pool.cc:224] Handling call
0709 12:11:59.719369 (+1360408us) spinlock_profiling.cc:243] Waited 55.7 ms on lock 0x7b5400236ed4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:11:59.719509 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128165248}
W20260709 12:11:59.712939 31889 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.090s	user 0.014s	sys 0.000s
I20260709 12:11:59.745319 31889 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.746753 26617 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 14: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:11:59.747805 31889 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:59.739547 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:59.704016 32008 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 13 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:11:59.695061 31853 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.687625 32045 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.737465 32017 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:59.749554 26468 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:11:59.708549 32044 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:59.766945 31848 raft_consensus.cc:3055] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:59.706566 32022 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.776597 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:59.780777 32099 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:11:59.782768 32127 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:11:59.774300 31848 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:59.773880 26473 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:11:59.788988 26514 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:59.790091 32108 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:59.791852 32108 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:59.794090 26473 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:11:59.794595 26473 pending_rounds.cc:85] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 8
I20260709 12:11:59.794989 26473 pending_rounds.cc:107] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:11:59.795302 26473 raft_consensus.cc:2889] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:59.795192 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:11:59.796366 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:59.776855 32045 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:59.799003 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:59.799681 26548 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:11:59.778594 32063 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.800796 26543 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:59.804198 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:59.804914 26543 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:11:59.805171 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:59.788514 31698 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.794785 31853 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.788058 31905 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:11:59.808790 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 118597us
I20260709 12:11:59.807130 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:59.809468 26514 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:59.812145 26543 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:59.812978 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:59.816260 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:59.817592 26544 raft_consensus.cc:2410] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:11:59.783295 32117 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.828022 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:59.828442 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:11:59.828811 26473 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:11:59.829387 26546 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:11:59.814215 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:59.836488 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:11:59.837376 27160 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.826237 31853 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:59.853657 27160 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:11:59.854707 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:59.855093 32092 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:59.810837 31698 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.856233 32044 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:59.856832 32044 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.870684 31853 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:59.871930 31853 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.874562 32092 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:59.875047 31905 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.875730 32092 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.883481 26545 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:11:59.807237 32008 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.895176 32022 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.843786 32063 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:59.844651 32131 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:59.899164 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:59.902819 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:59.903673 26473 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:11:59.826015 31848 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.858294 31698 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.911149 31848 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.919404 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:59.901070 31677 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.924389 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:59.900123 31945 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.929383 26621 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:59.929323 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:11:59.929405 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:11:59.931639 27160 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:11:59.932360 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:59.939505 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:11:59.940317 31540 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:59.941171 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:59.942534 31521 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:59.943943 31766 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:59.944303 26513 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:59.944595 31766 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:59.945935 31891 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:59.946353 31891 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:59.946655 31698 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:59.946785 31891 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.947321 31698 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:11:59.948272 31698 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.901337 32131 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:59.950474 32044 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.951535 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:59.903261 32063 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.956571 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:59.957228 32044 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.957384 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:59.933815 32128 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:59.955124 31766 consensus_queue.cc:1243] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:11:59.958225 31521 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:59.936244 31945 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.967145 31521 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:11:59.967653 31521 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.968720 31863 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:11:59.968931 31945 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:11:59.969305 32086 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:11:59.969755 32086 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:11:59.970119 32086 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:11:59.952684 32131 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.961562 31677 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:11:59.976996 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:59.907691 32080 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:11:59.998536 31945 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:00.004460 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 47994.6us
I20260709 12:12:00.005156 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:11:59.999804 31521 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:00.000857 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:00.011029 31824 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:00.012991 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:00.013737 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:00.015053 27165 raft_consensus.cc:2410] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:12:00.011035 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:00.017867 32080 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:00.020345 31891 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:11:59.983629 32044 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:00.023109 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:11:59.993235 32117 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:12:00.024573 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:00.015157 32064 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.397s	user 0.008s	sys 0.020s
I20260709 12:12:00.026827 32042 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:00.026995 32106 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:00.027455 32057 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:00.027805 32112 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:12:00.046133 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:00.028782 31891 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:00.007745 32022 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:00.013069 31824 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.043179 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:00.050514 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:00.051265 26547 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:00.043156 32064 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.425s	user 0.008s	sys 0.021s
I20260709 12:12:00.047540 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:00.039849 31853 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:00.063748 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:00.065613 26546 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.040187 32042 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.064666 26544 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:00.044929 31823 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:00.052053 31824 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.100941 26619 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:00.101115 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:00.101428 26619 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:00.040412 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:00.102753 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 62438.6us
I20260709 12:12:00.049278 32022 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.064699 32106 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:00.111610 26546 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:00.051288 32057 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.074580 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2395) took 1707 ms. Trace:
I20260709 12:12:00.116051 26613 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:00.116135 26466 rpcz_store.cc:276] 0709 12:11:58.367021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.367168 (+   147us) service_pool.cc:224] Handling call
0709 12:11:58.367528 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.077271 (+709743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.074301 (+997030us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b54001c0a54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:00.074511 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1630141824}
I20260709 12:12:00.117355 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:00.076714 32121 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.388s	user 0.001s	sys 0.000s
W20260709 12:12:00.081506 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.091610 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3257) took 2111 ms. Trace:
I20260709 12:12:00.092326 31720 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:00.103997 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:00.102180 26619 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:00.109962 32044 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:00.069126 32064 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:00.110980 32063 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:00.111500 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.059159 31677 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.113685 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:00.118467 26615 rpcz_store.cc:276] 0709 12:11:57.980852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.992750 (+ 11898us) service_pool.cc:224] Handling call
0709 12:11:57.993129 (+   379us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:58.065227 (+ 72098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.091256 (+2026029us) spinlock_profiling.cc:243] Waited 52 ms on lock 0x7b5400267854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:00.091532 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119691136}
I20260709 12:12:00.119441 26619 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:00.131320 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:00.131901 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:00.121227 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:00.068830 32042 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:00.133399 32063 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:00.133582 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:00.133857 32063 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:00.134286 32063 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:00.134675 31489 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:00.135116 31489 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.135468 31489 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.139988 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:00.122615 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:00.061431 31521 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:00.123541 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:00.125011 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:00.067859 31853 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:00.125854 26547 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:00.126688 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:00.143069 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:00.127058 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:00.128135 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:00.120290 27134 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:00.112671 32022 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.144534 26539 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:12:00.122684 31840 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.146524 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:00.157208 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:00.160329 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:00.161018 26547 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:00.145372 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:00.148120 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:00.111599 32128 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:00.122028 32057 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:00.166795 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:00.167552 27164 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:00.119911 32080 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.170217 27162 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:00.147091 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:00.154961 27160 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:00.171137 27168 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:00.146263 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:00.167834 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:00.124631 31565 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:00.124378 32064 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:00.164053 26615 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 12. Current term is 13. Ops: [11.10-12.11]
I20260709 12:12:00.139321 31905 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:00.166918 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:00.197474 26546 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:00.152663 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:00.115571 32093 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:00.168691 26619 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:12:00.140000 32106 raft_consensus.cc:697] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:00.172129 26543 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:00.154285 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:00.145576 31698 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:00.151727 31853 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:00.198978 26619 pending_rounds.cc:85] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 12
I20260709 12:12:00.208889 26619 pending_rounds.cc:107] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:12:00.174357 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:00.203312 26539 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:00.204704 26620 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:00.209836 26618 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 11.
I20260709 12:12:00.207230 26547 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:00.209183 26619 raft_consensus.cc:2889] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:00.211091 26547 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:00.155786 32037 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:00.212512 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:00.144631 31677 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:00.238036 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:00.150625 31667 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 12:12:00.231961 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.238992 26618 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:00.219636 26614 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:00.241911 27166 raft_consensus.cc:2393] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 12: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
W20260709 12:12:00.220396 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.229909 27164 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:00.244469 26539 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 11.
I20260709 12:12:00.246891 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:00.250738 27164 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:57562
I20260709 12:12:00.207643 31848 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:00.205560 31698 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.169531 31566 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:00.164831 31840 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:00.200680 32093 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:00.196143 31709 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:00.169582 32128 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:00.197319 32080 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:00.237341 32064 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:00.205996 31905 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:00.253840 31848 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.256660 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:00.257989 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 58320us
I20260709 12:12:00.261210 31840 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:00.272101 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:00.330372 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:00.276754 26547 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:00.332561 26547 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:00.277518 31709 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:00.339148 31709 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:00.277622 31566 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.340130 31566 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:00.282069 26514 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:00.343477 31667 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:00.277139 32093 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:00.288910 32046 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 1.967s	user 0.006s	sys 0.000s
I20260709 12:12:00.349455 32001 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.350070 32001 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:00.289912 31897 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:00.343582 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 61588us
I20260709 12:12:00.352739 32001 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:00.353639 31891 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:00.354647 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:00.356074 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:00.356420 31766 raft_consensus.cc:3055] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:00.356534 32108 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:00.356909 31766 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:00.357296 32108 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:00.358145 32108 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:00.357779 31766 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:00.358565 31945 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:00.358979 31945 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:00.359227 31766 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.359753 31945 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:00.361052 31945 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.296109 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:00.297206 32083 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:00.298220 32031 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:00.301311 27161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 745) took 1681 ms. Trace:
I20260709 12:12:00.365602 27161 rpcz_store.cc:276] 0709 12:11:58.620173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.622532 (+  2359us) service_pool.cc:224] Handling call
0709 12:11:58.622865 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.520378 (+897513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.301079 (+780701us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b54006cfcd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:00.301251 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2062681472}
I20260709 12:12:00.308216 31848 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:00.257860 27162 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:00.319350 32106 consensus_queue.cc:237] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:00.384833 32001 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:00.385514 32001 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:00.388087 32001 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:00.391767 31709 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.392738 31709 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:00.394752 32001 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:00.267298 31823 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:00.287065 26613 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:12:00.322746 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:00.398177 26466 raft_consensus.cc:2410] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 16 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:12:00.399156 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:00.400418 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:00.281339 31698 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:00.271261 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:00.403824 26619 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:12:00.407253 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:00.408599 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:00.406718 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:00.409850 26466 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:00.411470 31698 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:00.414275 31698 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:00.415231 31709 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:00.255293 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:00.416324 26614 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:00.418067 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:00.420312 32001 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:00.421058 32001 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:00.421633 32001 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:00.422242 32077 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:00.423085 32077 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:00.418756 26466 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:00.424774 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:00.426534 32077 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:00.428892 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 70707.2us
W20260709 12:12:00.429019 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 172459us
I20260709 12:12:00.431983 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:00.433254 26514 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:00.434557 26514 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:00.430385 26547 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:12:00.444904 26547 pending_rounds.cc:85] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 10
I20260709 12:12:00.445382 26547 pending_rounds.cc:107] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:12:00.445870 26547 raft_consensus.cc:2889] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:00.445106 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:00.450583 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:00.430882 32064 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.430900 31823 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:00.460193 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:00.466167 26514 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:00.448040 32092 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:00.472431 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3383) took 1350 ms. Trace:
I20260709 12:12:00.517323 26470 rpcz_store.cc:276] 0709 12:11:59.121596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.123232 (+  1636us) service_pool.cc:224] Handling call
0709 12:11:59.123505 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:59.210128 (+ 86623us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:59.352932 (+142804us) log.cc:844] Serialized 14 byte log entry
0709 12:11:59.430359 (+ 77427us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:59.460502 (+ 30143us) log.cc:844] Serialized 26 byte log entry
0709 12:11:59.460655 (+   153us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:59.460688 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.076070 (+615382us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:00.472076 (+396006us) spinlock_profiling.cc:243] Waited 86.1 ms on lock 0x7b54002599d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:00.472155 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:00.472201 (+    46us) raft_consensus.cc:1685] finished
0709 12:12:00.472215 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.472363 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13932,"prepare.queue_time_us":249358,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":102630,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":7020,"spinlock_wait_cycles":264283264,"thread_start_us":166961,"threads_started":2,"wal-append.queue_time_us":261395}
I20260709 12:12:00.449450 31848 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:00.450906 31766 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:00.474824 32069 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 1.855s	user 0.010s	sys 0.006s
I20260709 12:12:00.478368 26543 raft_consensus.cc:2410] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:12:00.479516 32059 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:00.482577 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 779) took 1138 ms. Trace:
I20260709 12:12:00.488896 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:00.531709 26467 rpcz_store.cc:276] 0709 12:11:59.344525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.344692 (+   167us) service_pool.cc:224] Handling call
0709 12:11:59.345054 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.481959 (+1136905us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b18003f2860. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5075c824bc 00007f5072fd048b 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f50760d2060 00007f50760d2bfb 00007f50760dd64b
0709 12:12:00.482136 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:12:00.482164 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:00.482211 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:00.482245 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.482319 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.482501 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5809,"raft.queue_time_us":36840,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":11171,"spinlock_wait_cycles":4114816,"thread_start_us":74918,"threads_started":1}
I20260709 12:12:00.534598 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:00.453145 31863 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:00.485143 31489 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:00.449884 32088 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:12:00.489347 26540 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 12. Current term is 13. Ops: []
W20260709 12:12:00.460960 32145 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:12:00.457091 31897 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:00.492260 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:00.539902 26466 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.496771 31677 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:00.499423 31905 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:00.500828 27165 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 752) took 1756 ms (client timeout 2126 ms). Trace:
I20260709 12:12:00.501794 31825 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:00.469348 32112 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:12:00.502914 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 778) took 1880 ms. Trace:
W20260709 12:12:00.505004 32142 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 12:12:00.509065 32063 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:00.513036 32057 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:00.514806 32128 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:00.461094 32031 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:12:00.520386 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:00.525156 31667 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:00.520533 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 54467.8us
W20260709 12:12:00.534723 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45948us
W20260709 12:12:00.499459 32143 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:12:00.505999 32042 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:00.542790 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:00.544847 26465 rpcz_store.cc:276] 0709 12:11:58.622497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.622669 (+   172us) service_pool.cc:224] Handling call
0709 12:11:58.623014 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:59.137254 (+514240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.502524 (+1365270us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54000dc0d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:00.502830 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1181006080}
I20260709 12:12:00.555073 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:00.540639 32044 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:00.555750 26465 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:00.542305 27165 rpcz_store.cc:269] 0709 12:11:58.744950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.855219 (+110269us) service_pool.cc:224] Handling call
0709 12:12:00.500535 (+1645316us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b54003b6ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:00.500747 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2237980928}
I20260709 12:12:00.550268 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:00.453336 32117 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:00.552021 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:00.552786 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:00.560243 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:00.561491 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:00.560338 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:00.564792 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:00.568616 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:00.568954 26438 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:00.572520 32138 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:00.573097 32138 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:00.580343 26514 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:00.565461 26470 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:12:00.588513 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:00.573562 32138 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:00.575050 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:00.594364 26465 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:00.546756 31863 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:00.597203 26470 raft_consensus.cc:2410] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:12:00.590478 26466 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:12:00.601405 26473 raft_consensus.cc:2368] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17.
I20260709 12:12:00.597095 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:00.604943 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 2574) took 1265 ms. Trace:
I20260709 12:12:00.605592 26617 rpcz_store.cc:276] 0709 12:11:59.339921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.340090 (+   169us) service_pool.cc:224] Handling call
0709 12:12:00.604629 (+1264539us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54001b0654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:00.604853 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":909734656}
I20260709 12:12:00.607039 26615 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:00.613559 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:00.614626 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:00.615187 26467 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
I20260709 12:12:00.615582 26465 raft_consensus.cc:2410] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:12:00.594964 31766 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:00.618062 32086 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.003s
I20260709 12:12:00.618621 32086 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:00.619760 26468 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:00.620899 32086 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:00.620986 31863 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:00.549002 32001 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:00.563910 32117 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.625010 32001 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:00.625468 32117 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.627615 31988 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:00.628186 31988 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:00.630342 32088 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:00.630543 31988 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:00.559376 31566 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:00.633103 27159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 843) took 1578 ms. Trace:
I20260709 12:12:00.633481 31823 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:00.634052 31823 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.634449 31823 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:00.634737 26544 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 17: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:12:00.635452 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.638229 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:00.638890 26540 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:00.632306 31988 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.643690 31489 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:00.647442 26548 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:12:00.633574 27159 rpcz_store.cc:276] 0709 12:11:59.055218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.055834 (+   616us) service_pool.cc:224] Handling call
0709 12:11:59.056178 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.201050 (+144872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:59.201099 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:59.201178 (+    79us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:59.201226 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.632859 (+1431633us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54006ce3d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:00.632906 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.633044 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332512512}
I20260709 12:12:00.643729 26465 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:00.650969 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.651484 26465 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:00.559203 32044 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:00.654330 26465 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: [15.7-19.9]
I20260709 12:12:00.587735 31667 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:00.588600 32059 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:00.664189 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:00.659299 26545 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:00.657742 26546 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:12:00.673703 26466 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:00.612445 31948 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:00.681042 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.688725 26588 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:00.695336 26546 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:00.699988 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:00.700814 26617 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:12:00.711457 26546 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: []
W20260709 12:12:00.674425 31824 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.002s
I20260709 12:12:00.660830 32044 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.663101 32059 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:00.722676 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:00.725006 26621 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:12:00.726107 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:00.728849 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:00.729671 27159 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
W20260709 12:12:00.731143 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.733059 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:00.733978 27159 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:12:00.677937 31948 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:12:00.714097 32087 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 1.678s	user 0.006s	sys 0.003s
I20260709 12:12:00.740777 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:00.659287 31825 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:12:00.703234 32077 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:00.753931 27134 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:00.756594 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 142145us
I20260709 12:12:00.676009 32001 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:12:00.767635 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:00.770797 31825 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:00.772959 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:00.739581 32059 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:00.776000 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 777) took 2281 ms. Trace:
I20260709 12:12:00.818035 26471 rpcz_store.cc:276] 0709 12:11:58.494561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.494740 (+   179us) service_pool.cc:224] Handling call
0709 12:11:58.529818 (+ 35078us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:58.608202 (+ 78384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:58.608250 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:58.609054 (+   804us) log.cc:844] Serialized 52 byte log entry
0709 12:11:59.119764 (+510710us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:59.358298 (+238534us) log.cc:844] Serialized 14 byte log entry
0709 12:11:59.367610 (+  9312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.369283 (+  1673us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:00.645281 (+1275998us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:00.775624 (+130343us) raft_consensus.cc:1685] finished
0709 12:12:00.775747 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.775909 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9602,"prepare.queue_time_us":308229,"raft.queue_time_us":279802,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":59319,"spinlock_wait_cycles":9968768,"thread_start_us":678030,"threads_started":3,"wal-append.queue_time_us":361636}
I20260709 12:12:00.777704 32042 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:00.752300 31948 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:00.789693 27134 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:00.808019 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 204411us
I20260709 12:12:00.809017 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:00.773798 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:00.782097 31823 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:00.828814 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:00.763839 32022 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.596s	user 0.012s	sys 0.000s
I20260709 12:12:00.763715 31566 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:00.720688 31824 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:00.740361 32093 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:00.763175 32034 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
W20260709 12:12:00.823028 32161 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:12:00.838222 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:00.785365 32083 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:12:00.836742 32149 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:12:00.807845 31825 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:12:00.853911 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 46395.2us
I20260709 12:12:00.830651 31848 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:00.862969 26464 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:00.871361 26472 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:12:00.847535 26546 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:00.868706 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:00.837831 32106 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:00.839578 32128 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:00.875465 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:00.878165 26546 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:00.872426 26464 raft_consensus.cc:2955] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:12:00.885605 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 117322us
I20260709 12:12:00.888499 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:00.841758 32022 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:00.855990 32083 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:00.912482 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:00.913995 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.916508 26546 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:00.879011 32063 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:00.927022 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:00.928803 26547 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 11: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:00.923914 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:00.933300 26546 raft_consensus.cc:2368] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 12. Current term is 13.
I20260709 12:12:00.882233 32128 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:00.933041 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:00.903070 32131 consensus_meta.cc:287] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.928s	user 0.012s	sys 0.005s
I20260709 12:12:00.937538 32173 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:12:00.942052 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:00.942971 26547 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 21: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:00.943876 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:00.944999 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:00.945134 32147 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:12:00.948450 31824 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:00.950129 32148 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:12:00.955822 26467 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:00.932551 31853 consensus_meta.cc:287] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.691s	user 0.010s	sys 0.003s
I20260709 12:12:00.992431 26547 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 13: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:00.993552 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:00.942216 32173 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:00.994973 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:01.002061 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:00.928455 32083 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.940443 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:01.014935 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 146308us
I20260709 12:12:01.040580 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:01.015172 26546 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 17: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:00.957226 32128 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.980348 32078 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.000458 32173 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:01.002636 32077 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:00.936470 32117 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:00.940708 32131 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:01.000574 31853 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:01.055498 32174 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:12:01.130256 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 82243.5us
I20260709 12:12:01.078476 32173 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.153270 26544 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
W20260709 12:12:01.124517 32160 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:12:01.160213 26470 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:01.162443 27164 raft_consensus.cc:606] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:01.163092 27164 raft_consensus.cc:614] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:01.164036 27167 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:00.939277 31825 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:01.173137 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:01.173858 26544 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:01.094537 32177 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:01.136897 32093 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:01.136705 31823 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:01.140651 32174 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:01.184549 26544 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:12:01.074204 32078 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:01.206177 32110 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 12:12:01.206715 32174 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:01.208184 32174 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:01.208385 27163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 847) took 1053 ms. Trace:
I20260709 12:12:01.161474 32175 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:12:01.208866 27163 rpcz_store.cc:276] 0709 12:12:00.154655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.154775 (+   120us) service_pool.cc:224] Handling call
0709 12:12:00.155159 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.308315 (+153156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.308346 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:00.308389 (+    43us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:00.308420 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.208096 (+899676us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54006a68d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:01.208151 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.208315 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351684352}
I20260709 12:12:01.196566 31825 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.210454 32073 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:01.210907 32073 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:01.211911 32073 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:01.213335 32073 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:01.198128 32001 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
W20260709 12:12:01.214941 32162 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:12:01.196450 32177 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:01.227612 26540 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 12:12:01.228143 26540 pending_rounds.cc:85] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 10
I20260709 12:12:01.228386 26540 pending_rounds.cc:107] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:12:01.228626 26540 raft_consensus.cc:2889] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:01.228783 31988 consensus_meta.cc:287] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.000s
I20260709 12:12:01.228971 26540 pending_rounds.cc:107] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:12:01.231398 26540 raft_consensus.cc:2889] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:01.229022 26543 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:01.191460 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:01.176123 31897 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.236197 26547 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:01.193503 32165 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 12:12:01.201098 32022 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:01.230149 31853 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:01.247321 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.242029 31677 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:12:01.255398 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 114574us
I20260709 12:12:01.256420 31897 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:01.261763 32117 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:01.255105 31828 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:01.191375 32077 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:01.254877 32104 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:01.271935 32177 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:01.272819 32078 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:01.274966 31948 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:01.277170 31948 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:01.278587 32138 consensus_meta.cc:287] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.633s	user 0.012s	sys 0.000s
I20260709 12:12:01.279374 32104 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:01.301506 32104 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:01.305469 32104 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:01.306730 32057 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:01.294076 32173 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:01.310896 32169 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:12:01.312855 32173 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:01.349224 26370 catalog_manager.cc:5697] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 9 to 10, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 10 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:01.234086 26546 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:01.235621 26544 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:12:01.370939 26543 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:12:01.371912 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:01.373245 26539 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:01.375797 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.292320 32059 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:01.380896 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.381573 31897 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:01.381891 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.371781 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:01.291687 32080 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:01.304090 32083 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:01.304304 32128 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:01.409046 32128 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:01.287748 32131 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:01.287037 32138 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:01.299328 32150 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.514s	user 0.001s	sys 0.000s
I20260709 12:12:01.382133 32059 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:01.412842 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2403) took 1082 ms. Trace:
I20260709 12:12:01.389531 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2487) took 1358 ms. Trace:
I20260709 12:12:01.414615 26542 rpcz_store.cc:276] 0709 12:12:00.041204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.041401 (+   197us) service_pool.cc:224] Handling call
0709 12:12:00.048691 (+  7290us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:00.049246 (+   555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.049294 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:00.050591 (+  1297us) log.cc:844] Serialized 52 byte log entry
0709 12:12:00.122156 (+ 71565us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:00.150198 (+ 28042us) log.cc:844] Serialized 14 byte log entry
0709 12:12:00.153429 (+  3231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.153529 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.307684 (+1154155us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b18003fbec0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:12:01.382676 (+ 74992us) raft_consensus.cc:1685] finished
0709 12:12:01.382845 (+   169us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.384719 (+  1874us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5435,"prepare.queue_time_us":51877,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":3643,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":23974,"spinlock_wait_cycles":8686848,"thread_start_us":71095,"threads_started":1,"wal-append.queue_time_us":194322}
I20260709 12:12:01.396777 26370 catalog_manager.cc:5697] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 9 to 12, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 12 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:01.421689 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 860) took 1306 ms. Trace:
I20260709 12:12:01.422308 26613 rpcz_store.cc:276] 0709 12:12:00.114827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.117113 (+  2286us) service_pool.cc:224] Handling call
0709 12:12:01.421103 (+1303990us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b540037a354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:01.421366 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388639616}
I20260709 12:12:01.270714 31828 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:01.427306 31828 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:01.429487 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2400) took 1130 ms. Trace:
I20260709 12:12:01.430130 26468 rpcz_store.cc:276] 0709 12:12:00.298788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.298918 (+   130us) service_pool.cc:224] Handling call
0709 12:12:00.300842 (+  1924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.620157 (+319315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.428799 (+808642us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b540006a4d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:01.429229 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":733010816}
W20260709 12:12:01.431934 26622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 2578) took 2080 ms (client timeout 1596 ms). Trace:
W20260709 12:12:01.432560 26622 rpcz_store.cc:269] 0709 12:11:59.351775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.356749 (+  4974us) service_pool.cc:224] Handling call
0709 12:12:01.431372 (+2074623us) spinlock_profiling.cc:243] Waited 70.9 ms on lock 0x7b5400345b54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:01.431623 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163020544}
I20260709 12:12:01.413435 26470 rpcz_store.cc:276] 0709 12:12:00.330592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.601916 (+271324us) service_pool.cc:224] Handling call
0709 12:12:00.602350 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.162113 (+559763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.412123 (+250010us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b54001a8454. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:01.412627 (+   504us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1282365184}
I20260709 12:12:01.430119 31828 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.414247 32138 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:01.399122 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 138193us
I20260709 12:12:01.463235 32075 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:01.471239 32083 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:01.472218 32083 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:01.472965 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:01.473495 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:01.473168 32083 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:01.475061 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:01.476140 27160 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:01.476540 27159 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:01.477927 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.478874 32198 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:01.479882 31540 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:01.480531 32198 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:01.480988 32198 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:01.481061 31540 raft_consensus.cc:3055] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:01.481524 31540 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:01.482715 27166 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:12:01.486919 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:01.422328 26370 catalog_manager.cc:5697] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 4 to 7, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 7 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:01.496054 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:01.504040 32080 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.508522 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:01.509759 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.464324 32075 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:01.520747 27163 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:01.527664 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:01.528796 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:01.530879 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:01.531258 26468 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:01.528934 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:01.532255 26614 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:01.530011 26617 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:12:01.508587 32080 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:01.535120 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:01.536067 26613 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:01.532069 32138 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:01.539786 32138 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:01.544607 32075 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:01.545748 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:01.546568 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.539458 31540 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:01.548416 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:01.494889 32198 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:01.558143 27163 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:01.563426 32083 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:01.564702 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3282) took 1369 ms. Trace:
I20260709 12:12:01.565171 26615 rpcz_store.cc:276] 0709 12:12:00.195793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.206850 (+ 11057us) service_pool.cc:224] Handling call
0709 12:12:00.606747 (+399897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.613042 (+  6295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.564284 (+951242us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b54001b0650. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:01.564514 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":918169344}
I20260709 12:12:01.566682 26548 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:01.567721 32092 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:01.568292 32092 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:01.571038 27166 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:01.588037 32044 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.848s	user 0.008s	sys 0.012s
I20260709 12:12:01.588806 32044 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:01.590323 26473 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:01.592604 32194 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:01.593478 27164 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57562 (request call id 14) took 1430 ms. Trace:
I20260709 12:12:01.593748 32194 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:01.596378 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2398) took 1298 ms. Trace:
I20260709 12:12:01.596060 32193 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:01.596818 26472 rpcz_store.cc:276] 0709 12:12:00.298114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.299225 (+  1111us) service_pool.cc:224] Handling call
0709 12:12:00.299518 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:00.871991 (+572473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.595715 (+723724us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b54003156d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:01.596178 (+   463us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1314307968}
I20260709 12:12:01.594025 27164 rpcz_store.cc:276] 0709 12:12:00.164534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.250461 (+ 85927us) service_pool.cc:224] Handling call
0709 12:12:01.592961 (+1342500us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b5400221354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d4853 00007f507b0a260a 00007f50746287d4 00007f5074628762 00007f5074628691 00007f507462860c 00007f50746278c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:01.593169 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2094670208}
I20260709 12:12:01.603860 26588 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:01.607561 32077 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:01.608238 32077 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:01.608860 32077 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:01.612571 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.613855 32193 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:01.613277 32080 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:01.615437 32193 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:01.616595 32032 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:01.618185 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2404) took 1285 ms. Trace:
W20260709 12:12:01.620155 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.570195 32092 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:01.644954 32193 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:01.646901 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:01.647388 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:01.647864 26615 raft_consensus.cc:2368] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16.
I20260709 12:12:01.648898 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:01.649042 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:01.649802 26466 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:01.650554 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:01.651319 26620 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.651546 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:01.652335 26466 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:12:01.654578 32138 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:01.655725 32092 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:01.658118 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:01.664024 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:01.665608 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:01.667008 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:01.668637 27164 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:01.668550 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:01.671015 31709 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:01.671401 31766 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:01.671602 26620 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:12:01.673218 26469 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:01.675792 32044 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:01.632187 26467 rpcz_store.cc:276] 0709 12:12:00.333093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.616015 (+282922us) service_pool.cc:224] Handling call
0709 12:12:00.616321 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.956448 (+340127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.617628 (+661180us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b540035f2d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:01.617987 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":780188544}
I20260709 12:12:01.678645 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:01.681552 26472 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.576617 26370 catalog_manager.cc:5697] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 10 to 11, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 11 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:12:01.685297 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:01.685981 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:01.686582 26539 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:01.671033 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:01.687445 26614 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:01.690412 26370 catalog_manager.cc:5697] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 8 to 10, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 10 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:12:01.691710 32077 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:01.695923 26615 raft_consensus.cc:2393] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 15: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:01.700925 31540 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.703289 32198 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:01.715626 26617 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:12:01.719497 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:01.718715 31667 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:01.733966 31667 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:01.735532 31667 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:01.739455 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45882.9us
I20260709 12:12:01.750494 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
W20260709 12:12:01.746991 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 50470.7us
I20260709 12:12:01.759016 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:01.766100 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:01.774778 26622 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:12:01.774927 26614 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 15: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:01.775285 26622 pending_rounds.cc:85] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 11
I20260709 12:12:01.775641 26622 pending_rounds.cc:107] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:12:01.775943 26622 raft_consensus.cc:2889] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:01.777763 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.784461 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:01.785260 27167 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.787048 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:01.787920 27159 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:12:01.791049 31825 consensus_queue.cc:1059] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:12:01.792050 26620 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:01.792284 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:01.792765 31825 raft_consensus.cc:3055] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:01.793355 31825 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:12:01.798828 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 127966us
I20260709 12:12:01.799409 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:01.800437 26513 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:01.800956 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:01.807458 32077 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:01.809513 32044 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:01.810345 32044 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:01.812645 32044 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:01.812774 26466 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:12:01.814669 26470 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:01.814527 26547 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:01.773319 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:01.816473 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:01.819275 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:01.820329 26470 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:01.820845 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:01.821489 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:01.821897 26464 raft_consensus.cc:2410] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:12:01.822414 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:01.822840 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:01.823834 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:01.825186 32044 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:01.826347 32157 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:12:01.827167 32044 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 12 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:12:01.827440 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 54572.4us
I20260709 12:12:01.828347 32044 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:01.829674 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:01.844048 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 43885.4us
I20260709 12:12:01.791111 27134 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:01.845145 31565 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:01.863631 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:01.858774 27167 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:01.873698 26613 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:01.875093 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:01.875064 26472 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
W20260709 12:12:01.875279 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48869.3us
W20260709 12:12:01.879613 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 89081.9us
I20260709 12:12:01.865386 32194 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:01.890067 32077 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:01.881402 32080 raft_consensus.cc:2764] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:01.895923 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:01.883244 31565 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:01.900568 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:01.846553 31825 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:01.907554 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 120877us
I20260709 12:12:01.907002 31521 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:12:01.909893 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 77290.8us
I20260709 12:12:01.910179 31521 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:01.911032 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:01.911681 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:01.912917 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:01.913133 32188 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:01.914124 31521 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:01.914806 32188 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:01.915268 32059 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:01.915913 32059 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:01.916224 32088 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:01.916442 26622 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:01.916947 32088 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:01.917057 32059 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:01.919238 31825 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.913149 32174 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:01.922612 26513 leader_election.cc:400] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17.
I20260709 12:12:01.925431 26513 leader_election.cc:403] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:12:01.926765 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:01.897523 32194 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:01.927258 31698 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17.
I20260709 12:12:01.929949 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:01.930884 27167 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:01.933907 26548 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:01.931577 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:01.932650 26539 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:01.927152 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:01.932636 26546 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:01.936424 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:01.937436 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:01.938107 26466 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.938247 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:01.941468 27159 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:01.941613 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:01.943156 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:01.944224 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:01.944530 31698 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.946285 31698 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:01.945379 26514 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:01.945331 31945 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:01.926846 27134 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:01.931165 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:01.887712 32138 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:12:01.918273 32088 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:01.979391 26622 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:01.980094 26616 raft_consensus.cc:2410] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 12:12:01.981072 31945 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:01.981802 32011 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:01.983911 31846 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:01.980685 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:02.003412 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:01.992363 31945 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:02.006489 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:02.007277 31945 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:02.007758 32131 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:02.008509 32131 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:02.008808 31945 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:02.007818 31565 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:01.986799 31828 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:02.023152 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:02.024783 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:02.029089 32031 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.029922 32031 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:02.031026 32011 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:02.032634 32031 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:02.032343 32011 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:02.036957 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.041483 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:02.042810 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:02.043114 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:02.043871 26617 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:02.046837 26468 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:02.022030 32188 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:02.024835 31828 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:02.057024 26541 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:12:02.009696 32131 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:02.049012 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52388.5us
I20260709 12:12:02.060014 26588 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:02.060288 26464 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:02.065358 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:02.068703 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:02.069217 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 142247us
I20260709 12:12:02.069325 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:02.072265 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:02.076901 26466 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:12:02.057286 31828 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:02.081948 26588 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:02.086208 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:02.058938 32138 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.081562 31709 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.100318 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:02.095135 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:02.094429 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:02.072294 32174 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:02.107577 32116 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.108222 32116 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:02.111069 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:02.112376 32177 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:02.104964 32188 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:02.114830 26473 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 21: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:02.115448 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:02.118235 26514 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:02.114985 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:02.114337 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:02.119940 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:02.120270 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:02.130947 27159 raft_consensus.cc:2393] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 15: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:02.134452 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:02.059291 32083 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:12:02.119511 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:02.135864 26618 raft_consensus.cc:2410] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
W20260709 12:12:02.136600 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.138175 26614 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:12:02.144160 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:02.145344 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:02.145826 32194 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:02.147598 31667 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:02.148329 31667 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:02.118548 32077 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:02.150972 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:02.152153 26541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 858) took 2689 ms (client timeout 1630 ms). Trace:
I20260709 12:12:02.152814 32189 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:02.154191 32032 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:02.116801 32188 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:02.158718 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:02.163865 27167 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
W20260709 12:12:02.152613 26541 rpcz_store.cc:269] 0709 12:11:59.462341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.462512 (+   171us) service_pool.cc:224] Handling call
0709 12:12:02.151849 (+2689337us) spinlock_profiling.cc:243] Waited 2.58 s on lock 0x7b540018bfd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:02.152007 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5926747904}
I20260709 12:12:02.165226 32031 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:12:02.172567 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:02.149695 31667 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:02.173370 26618 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:12:02.175457 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:02.178578 32092 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:02.179313 32092 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:02.127120 32174 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:02.202008 26617 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:02.212404 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:02.213399 26466 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:12:02.193157 32174 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:02.137658 31709 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:02.220633 31709 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:02.226809 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 112575us
I20260709 12:12:02.228261 26587 leader_election.cc:400] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 12. Current term is 13.
I20260709 12:12:02.228652 26587 leader_election.cc:403] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:12:02.234454 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:02.235630 26439 connection.cc:256] RPC call timeout handler was delayed by -1.9747790210001313s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
I20260709 12:12:02.239670 31948 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.240419 31948 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:02.243587 32116 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:02.244549 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:02.190287 31698 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:02.208938 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:02.169267 32077 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:02.263039 26464 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:02.203388 32031 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:02.277869 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:02.155697 32138 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:02.299158 26466 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:02.312929 26541 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:02.274626 32075 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:02.318761 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:02.346094 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:02.378798 31766 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:02.327014 26514 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:02.330847 32044 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:02.402014 32044 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:02.405143 32044 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:02.415010 26547 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:02.349869 32177 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 12. Current term is 13.
I20260709 12:12:02.324818 32031 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:02.430073 32210 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 12:12:02.432610 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 109859us
I20260709 12:12:02.339250 32075 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:02.444271 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 125619us
I20260709 12:12:02.431641 31766 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.422890 31948 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:02.485102 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.511045 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:02.425794 32077 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:02.496857 32198 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.793s	user 0.017s	sys 0.001s
I20260709 12:12:02.474155 31945 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:02.475481 32044 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:02.530083 26547 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 12:12:02.529531 26439 connection.cc:256] RPC call timeout handler was delayed by -1.1230165399999805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
W20260709 12:12:02.531848 26439 connection.cc:256] RPC call timeout handler was delayed by -1.0122874989999673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
I20260709 12:12:02.526155 31891 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:02.537705 31891 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:02.498991 31766 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:02.541265 31945 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:02.542656 32044 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:02.544615 32092 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:02.545388 32092 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:02.545742 32044 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:02.552894 32031 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:02.556298 32138 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:02.551729 32075 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:02.537750 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 91890us
I20260709 12:12:02.557694 31945 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:02.559924 31766 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:02.546001 32092 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:02.558023 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:02.564450 32092 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:02.570945 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:02.575469 31766 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:02.576856 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:02.579087 31945 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:02.580626 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:12:02.610122 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 530956us
I20260709 12:12:02.617138 31945 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:02.617713 31945 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:02.618232 31945 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:02.528496 32179 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:02.613200 31948 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:02.625599 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 54861.1us
I20260709 12:12:02.626348 32075 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.634915 26619 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
W20260709 12:12:02.636320 26468 consensus_meta.cc:287] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.003s
I20260709 12:12:02.636930 26468 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
W20260709 12:12:02.650593 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 380331us
I20260709 12:12:02.635901 32032 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:02.657091 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:02.669281 27164 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 12:12:02.673087 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 51650.7us
I20260709 12:12:02.673494 31948 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:02.675004 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:02.675441 32174 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:02.675962 32044 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:02.676528 32044 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:02.676913 32044 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:02.675868 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:12:02.682415 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 62002.3us
I20260709 12:12:02.685242 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:02.694164 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 466133us
I20260709 12:12:02.695310 26469 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 19: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:12:02.684669 31667 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.028s	sys 0.049s
I20260709 12:12:02.678324 32174 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:02.709501 26468 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
W20260709 12:12:02.697438 31667 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.028s	sys 0.049s
I20260709 12:12:02.728998 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:02.730270 26464 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 16: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:02.733032 26472 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:02.733366 26616 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:12:02.742734 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.742964 32078 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:12:02.747673 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 3301) took 1217 ms. Trace:
I20260709 12:12:02.753465 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:02.702788 32138 raft_consensus.cc:2764] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 12:12:02.728557 31825 consensus_meta.cc:287] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.809s	user 0.016s	sys 0.000s
I20260709 12:12:02.751015 26619 rpcz_store.cc:276] 0709 12:12:01.530074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.530285 (+   211us) service_pool.cc:224] Handling call
0709 12:12:02.747402 (+1217117us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b5400196254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:02.747573 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2292543232}
I20260709 12:12:02.722111 31540 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:02.753127 31828 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.623s	user 0.011s	sys 0.000s
I20260709 12:12:02.703433 32131 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 12:12:02.752612 32032 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:02.807853 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:02.767927 32075 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.807457 32031 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:12:02.765988 32078 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:02.835224 31769 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:12:02.763180 32059 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:12:02.808714 32032 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:02.843832 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 114954us
I20260709 12:12:02.809063 31766 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:02.863123 32075 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:02.865651 32075 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:02.866494 32224 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:02.778592 31540 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:02.869640 31540 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:02.870942 27164 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:12:02.872864 32078 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:02.876147 32078 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:02.861843 31698 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.879590 31698 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:02.882761 31766 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:02.788228 32083 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:12:02.787972 31828 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:02.894999 31828 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:02.886019 31766 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:02.914511 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:02.910333 31698 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:02.826882 32230 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 12:12:02.915973 32044 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:02.959237 32044 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:02.961408 26470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.028s	sys 0.022s
W20260709 12:12:02.968152 26470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.028s	sys 0.022s
I20260709 12:12:02.954685 31540 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:12:02.974704 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 67575.7us
W20260709 12:12:02.982781 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 308609us
I20260709 12:12:03.029757 26588 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:02.968346 32230 consensus_queue.cc:1243] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:03.046548 27133 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:03.054656 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 360555us
I20260709 12:12:03.056674 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:03.065387 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:03.068298 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:03.068622 27133 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:03.052744 31565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.012s	sys 0.033s
I20260709 12:12:03.072733 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:03.073529 26620 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:12:03.073596 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:03.051566 31540 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:03.077668 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:03.069841 26439 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:03.077584 26513 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:03.061169 32224 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.060395 32198 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:03.073877 31565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.013s	sys 0.034s
I20260709 12:12:03.043406 31945 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:03.062990 32083 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:03.062810 32011 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:03.051502 32157 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:12:03.100759 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:03.105535 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:03.083220 31828 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:03.111411 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:03.104038 26620 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:03.094676 31540 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:12:03.133864 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 59068.3us
I20260709 12:12:03.104027 32188 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:03.106534 32244 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:03.097608 32224 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:03.145102 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:03.157281 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 109726us
I20260709 12:12:03.100111 32198 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:03.159839 31846 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:03.160437 31846 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.160807 31846 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.160964 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:03.162138 32080 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:12:03.165839 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 109207us
I20260709 12:12:03.113888 32075 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:12:03.160725 32217 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
W20260709 12:12:03.170933 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 59650.7us
I20260709 12:12:03.174201 31766 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.185750 31766 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:03.116062 32011 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:03.191485 31766 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:03.175632 32080 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:03.176206 32252 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:03.192890 32011 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:03.192306 31540 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:03.192685 32252 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:03.176585 32231 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:03.178313 31565 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:03.195514 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:03.184799 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:03.175173 32223 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:12:03.195362 26616 raft_consensus.cc:2410] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:03.207044 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:03.211601 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:03.213743 26514 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:03.213861 26618 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 12:12:03.220278 27133 connection.cc:256] RPC call timeout handler was delayed by -1.1027221320000535s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
I20260709 12:12:03.264288 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:03.265796 32233 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:12:03.170141 32188 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:03.268107 31945 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:03.268862 32188 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:03.192356 32080 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:03.223793 32231 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:03.262120 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:03.264685 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 46162.5us
I20260709 12:12:03.271245 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3313) took 1115 ms. Trace:
I20260709 12:12:03.221478 32077 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:03.221840 31698 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:03.218007 32157 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:03.274809 26614 rpcz_store.cc:276] 0709 12:12:02.156118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.156669 (+   551us) service_pool.cc:224] Handling call
0709 12:12:02.172052 (+ 15383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:02.258000 (+ 85948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:02.258034 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:02.260886 (+  2852us) log.cc:844] Serialized 26 byte log entry
0709 12:12:02.805984 (+545098us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:02.806063 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:02.806183 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:03.270961 (+464778us) raft_consensus.cc:1685] finished
0709 12:12:03.270984 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:03.271166 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30706,"raft.queue_time_us":80235,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":29507,"thread_start_us":417984,"threads_started":1,"wal-append.queue_time_us":741359}
I20260709 12:12:03.296195 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2523) took 1007 ms. Trace:
I20260709 12:12:03.212968 31766 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.262504 32224 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:03.271876 31709 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.304673 31709 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:03.281661 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:03.282516 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:03.309358 26439 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:03.282862 32078 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:03.283344 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:03.284866 32080 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:03.222886 32011 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:03.288834 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:03.278100 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 93492.6us
I20260709 12:12:03.221750 31565 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:03.294251 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:03.277737 32092 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.296694 26546 rpcz_store.cc:276] 0709 12:12:02.288581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.288759 (+   178us) service_pool.cc:224] Handling call
0709 12:12:02.328403 (+ 39644us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:02.408457 (+ 80054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:02.408497 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:03.030738 (+622241us) spinlock_profiling.cc:243] Waited 8.6 ms on lock 0x7b2c0005b0f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:12:03.064608 (+ 33870us) log.cc:844] Serialized 52 byte log entry
0709 12:12:03.167136 (+102528us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:12:03.167174 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.167242 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:03.286577 (+119335us) raft_consensus.cc:1685] finished
0709 12:12:03.286599 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:03.296112 (+  9513us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19141,"raft.queue_time_us":25987,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":132,"spinlock_wait_cycles":19780480,"thread_start_us":62401,"threads_started":1,"wal-append.queue_time_us":193300}
W20260709 12:12:03.318341 32238 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:12:03.318778 32229 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.115s
W20260709 12:12:03.319223 32232 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:12:03.320830 32231 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:03.322551 32246 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:12:03.323803 31709 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:03.217728 32075 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.079s
W20260709 12:12:03.328491 32240 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.078s	user 0.004s	sys 0.002s
I20260709 12:12:03.333695 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:03.337522 32011 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:03.340204 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:03.340744 26544 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:03.299368 32077 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:03.374917 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:03.375893 27160 raft_consensus.cc:2393] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:03.376147 32246 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:03.376035 32077 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:03.376798 32246 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:03.348532 26545 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:12:03.351065 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 56562.6us
I20260709 12:12:03.352239 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:03.341215 32230 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.287014 32252 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:03.367385 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:03.356837 31846 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:03.311599 31766 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:03.387254 27166 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:12:03.387961 26543 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 14: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:03.380038 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:03.337796 32157 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:03.389029 26546 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.341807 32032 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:03.397892 31565 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:03.379907 32011 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.399209 26439 leader_election.cc:400] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16.
I20260709 12:12:03.399679 32198 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:03.406070 31891 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:03.402513 32175 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:03.406858 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:03.401993 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:03.414584 26548 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:03.415453 31846 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:03.417536 32248 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.152s	user 0.001s	sys 0.001s
I20260709 12:12:03.418056 27166 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:03.401192 32231 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:03.418809 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:03.431283 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 62908.2us
I20260709 12:12:03.436264 26439 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:03.378165 32246 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:03.435505 27165 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:12:03.431550 31945 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:03.436412 32231 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:03.439643 32083 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:03.409902 32157 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:03.442152 32088 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:03.457259 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:03.421298 32254 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:12:03.456642 32246 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.447101 31846 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:03.456826 32032 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:03.487782 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 75438.1us
I20260709 12:12:03.488250 26464 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 12 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:03.488216 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:03.448835 32223 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
W20260709 12:12:03.514848 32251 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.411s	user 0.000s	sys 0.003s
I20260709 12:12:03.514500 31846 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:03.516638 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:03.516987 31846 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:03.517412 26547 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 13: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:03.451380 31945 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:03.518369 26544 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: [14.9-15.10]
W20260709 12:12:03.499910 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 51122.2us
I20260709 12:12:03.480564 31709 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:03.528802 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:03.529261 26614 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:03.529654 31945 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:03.530284 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:03.531234 26622 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:03.531234 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:03.534819 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:03.534982 32157 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:03.535745 26621 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:03.502919 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:03.536557 26545 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 13: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:03.503980 26472 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:03.535769 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:03.504941 32271 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 12:12:03.506301 31948 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:03.507365 26467 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:03.509161 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:03.513247 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3433) took 1268 ms. Trace:
I20260709 12:12:03.513662 32231 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:03.475646 32198 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:12:03.537320 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:03.538304 26546 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:03.541838 26473 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:03.546288 26539 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:03.550019 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:03.551421 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:03.554975 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:03.555655 26542 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:03.542251 26465 rpcz_store.cc:276] 0709 12:12:02.244658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.296020 (+ 51362us) service_pool.cc:224] Handling call
0709 12:12:02.362905 (+ 66885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:02.498893 (+135988us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:12:02.550085 (+ 51192us) log.cc:844] Serialized 14 byte log entry
0709 12:12:03.033991 (+483906us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:03.034095 (+   104us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:03.034198 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.512843 (+478645us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400314cd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:03.512897 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:03.513062 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19365,"prepare.queue_time_us":35993,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":36309,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":15109,"spinlock_wait_cycles":280873600,"thread_start_us":466109,"threads_started":1,"wal-append.queue_time_us":527893}
I20260709 12:12:03.558115 32231 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.559140 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:03.559602 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:03.561440 31766 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:03.497947 32175 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.563155 27133 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:03.566607 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:03.566771 26464 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:03.570303 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:03.574712 26471 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:03.594564 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:03.599893 26622 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.580962 31709 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:03.653129 26614 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:03.592744 31948 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.672482 32256 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.677222 26542 raft_consensus.cc:2410] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 12:12:03.679240 32235 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.140s	user 0.000s	sys 0.002s
I20260709 12:12:03.682073 26587 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:03.682176 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:03.686604 32256 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:03.689131 32277 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:12:03.663565 32282 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:03.690785 32282 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:03.691684 32268 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:12:03.693838 32282 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:03.695730 32092 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:03.698629 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 210031us
I20260709 12:12:03.699800 32246 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:03.699980 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:03.702768 32246 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:03.705132 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 157048us
I20260709 12:12:03.706411 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:03.706429 31709 consensus_queue.cc:1059] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:03.708308 31709 raft_consensus.cc:3055] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:03.708770 31709 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:03.709095 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:03.706594 32264 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:12:03.709120 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:03.729195 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:03.717950 26622 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:12:03.737641 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:03.737457 32198 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:03.738052 26439 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:03.739010 31521 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.754307 31521 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:03.756762 31521 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:03.686738 32059 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:03.740586 32256 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:03.717235 32092 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:12:03.709903 31709 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:03.589993 32175 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:03.747330 32138 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:03.713886 32246 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:03.749008 31945 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:03.750294 32083 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:03.774134 32157 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:03.780280 32083 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:03.758668 32059 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:03.763577 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:03.783062 27167 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.765317 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:03.765568 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:03.784657 26613 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:03.770010 26546 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260709 12:12:03.747980 32237 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.481s	user 0.001s	sys 0.002s
I20260709 12:12:03.773389 26514 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:03.774708 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:03.775906 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:03.769400 31698 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:03.793046 27165 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:12:03.770982 32138 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:03.771137 32044 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.796103 32059 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:03.802070 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 124048us
I20260709 12:12:03.806530 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:03.999436 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 192966us
W20260709 12:12:03.903365 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.914466 32059 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:03.835290 32279 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.141s	user 0.000s	sys 0.003s
W20260709 12:12:03.911645 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.010094 32246 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:04.010844 32246 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:04.013413 32246 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:04.016192 32231 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:03.910123 31948 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:03.806891 32083 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:03.825335 32131 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 12:12:03.847203 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:03.804688 31709 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:04.002887 32256 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:04.023921 32231 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:12:04.025056 32274 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
W20260709 12:12:03.883817 27133 leader_election.cc:336] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.677s (SENT)
I20260709 12:12:04.026613 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:03.847157 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:04.028214 26621 raft_consensus.cc:2410] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 12:12:03.830698 32044 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:03.768816 32092 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:12:03.839746 32175 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:03.804124 32032 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:03.935415 27167 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
W20260709 12:12:03.844552 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 62482.5us
I20260709 12:12:04.045188 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:03.843108 32252 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.790681 32254 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:03.888378 32230 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:04.019905 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:04.087396 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 67577.9us
I20260709 12:12:04.089651 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:04.044234 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 80163.3us
I20260709 12:12:04.090636 31948 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:04.091305 31948 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:04.091848 31891 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:04.092469 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:04.092270 31948 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:04.093415 26469 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 18: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:04.094533 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:04.095393 26464 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:12:04.097051 26466 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:04.099704 32044 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:04.104228 32011 consensus_meta.cc:287] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.690s	user 0.013s	sys 0.000s
I20260709 12:12:04.104826 32011 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:04.070634 31846 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
W20260709 12:12:04.108251 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 50148.8us
I20260709 12:12:03.980581 32138 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:04.108325 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 262932us
I20260709 12:12:04.109283 32138 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.042923 32092 consensus_queue.cc:1243] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 19.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:12:04.110600 32280 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:04.072871 32252 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:04.111986 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:04.114522 26470 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:12:04.126279 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:04.076629 32253 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:04.130566 26439 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:04.132750 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:04.139948 32083 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.141498 32271 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:04.143175 32230 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:04.143771 31565 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.146817 26466 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:04.148344 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:04.092497 31891 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:04.147619 32288 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:12:04.153688 31891 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:04.156708 26439 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:04.156306 32044 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:04.145412 32253 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.124545 32175 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:12:04.168902 26464 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:04.126099 31540 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:12:04.121658 31828 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:12:04.144986 32292 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:04.167101 26469 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:04.184665 32287 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.184901 32221 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:12:04.187427 26439 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:04.186354 32011 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:04.189947 32223 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:04.199416 32284 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.495s	user 0.002s	sys 0.000s
I20260709 12:12:04.201442 32281 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:04.183276 32230 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:04.171531 32253 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.154789 31565 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:04.208928 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.209463 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:04.238158 26469 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.212617 26439 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:04.207113 32288 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:12:04.247803 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.216826 32080 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.278275 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:04.283812 26464 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
W20260709 12:12:04.280696 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 68211.5us
I20260709 12:12:04.213624 32281 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:04.272728 31540 raft_consensus.cc:3055] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:12:04.293561 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 183403us
I20260709 12:12:04.296586 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:04.315883 26541 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:04.276341 32231 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:04.272287 32288 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:04.273005 32287 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:04.286445 32230 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:12:04.333256 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 47957.6us
I20260709 12:12:04.337230 32288 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:04.341557 32288 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:04.345105 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:04.351794 26544 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:04.357666 26514 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:04.363866 31565 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:04.365348 32011 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:04.365972 32011 raft_consensus.cc:697] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:04.367287 32011 consensus_queue.cc:237] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:04.371392 32281 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:04.372869 32281 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.376158 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:04.376845 32272 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:04.292088 31540 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:04.386255 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:04.394610 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 510838us
I20260709 12:12:04.413023 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:04.413749 26471 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.397452 26469 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:04.403942 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:04.418035 26464 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 16: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:04.419281 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:04.419885 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:04.421308 26464 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:04.408412 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:04.424201 26470 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:12:04.426043 26470 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 13. Current term is 14. Ops: [10.10-13.12]
I20260709 12:12:04.408450 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:04.430106 26618 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:04.435055 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:04.438764 27167 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:04.441118 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:04.441725 26473 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:04.286412 32080 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:04.443240 27165 raft_consensus.cc:2368] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14.
I20260709 12:12:04.443583 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:04.443954 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:04.446556 27164 raft_consensus.cc:1217] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Deduplicated request from leader. Original: 11.10->[13.11-13.11]   Dedup: 13.11->[]
I20260709 12:12:04.447036 26620 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:04.447274 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:04.447826 26613 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:04.447101 27164 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:12:04.450577 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:04.451347 26472 raft_consensus.cc:2376] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16. Re-sending same reply.
I20260709 12:12:04.458999 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:04.461388 26616 pending_rounds.cc:85] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 6
I20260709 12:12:04.461858 26616 pending_rounds.cc:107] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 15.7
I20260709 12:12:04.462181 26616 raft_consensus.cc:2889] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:04.462594 26616 pending_rounds.cc:107] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260709 12:12:04.462888 26616 raft_consensus.cc:2889] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:04.463263 26616 pending_rounds.cc:107] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 19.9
I20260709 12:12:04.463527 26616 raft_consensus.cc:2889] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:04.467437 26464 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 18: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:04.468251 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:04.468181 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:04.460034 26615 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:04.474449 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:04.478832 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:04.479022 26619 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:04.479010 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:04.435623 32288 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:04.433838 31565 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:04.517524 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:04.521462 26439 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:04.523152 26613 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:04.516208 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:04.526500 26439 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:04.528997 26468 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
W20260709 12:12:04.486231 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.434598 32271 consensus_queue.cc:1243] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:12:04.448513 32299 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.481848 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:04.481070 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:04.519696 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:04.540042 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.535324 26464 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:04.541003 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:04.544291 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:04.548869 26439 leader_election.cc:400] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14.
I20260709 12:12:04.549413 26439 leader_election.cc:403] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:04.550508 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:04.552603 26614 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 17: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:04.553972 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:04.555184 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 95988.2us
I20260709 12:12:04.559448 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:04.551645 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:04.562237 26620 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:12:04.565591 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:04.569327 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 272834us
I20260709 12:12:04.570969 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:04.571369 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:04.574518 26622 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:12:04.523905 32280 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:04.517817 32288 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:04.582242 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:04.526955 31565 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.533703 32221 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:04.594095 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:04.603528 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:04.595288 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:04.558905 31948 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:04.532025 31891 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:04.611773 26619 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 12:12:04.557601 31698 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:04.558737 32179 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:04.613433 26619 pending_rounds.cc:85] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 6
I20260709 12:12:04.585017 32280 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:04.555902 32175 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:04.538779 32231 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:04.603312 32288 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.613327 26622 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:04.633280 26622 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:04.616765 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:04.605573 26614 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:12:04.635217 26614 pending_rounds.cc:85] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 9
I20260709 12:12:04.635600 26614 pending_rounds.cc:107] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:12:04.635937 26614 raft_consensus.cc:2889] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:04.636083 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:04.621443 26619 pending_rounds.cc:107] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 12:12:04.636942 26619 raft_consensus.cc:2889] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:04.604630 32300 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:04.640887 26615 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:12:04.482848 32252 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:04.596508 32044 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:04.631351 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:04.601854 31565 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.637763 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:04.643298 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:04.583583 32138 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:12:04.628440 32175 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:04.557667 32299 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:04.581403 31863 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
W20260709 12:12:04.695180 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 57494us
W20260709 12:12:04.694181 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 97979.2us
I20260709 12:12:04.617630 31891 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:12:04.722682 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 79495.6us
I20260709 12:12:04.723487 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:12:04.706883 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 71632.5us
I20260709 12:12:04.639694 32221 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:04.692787 26622 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:04.718403 26468 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:04.722864 26514 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:04.622999 32131 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 12:12:04.597648 31540 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:04.626096 31709 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
W20260709 12:12:04.740993 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.743415 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:04.744021 26622 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:04.747427 26470 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:04.749538 26540 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:04.628876 32179 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:04.760138 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:04.749543 26513 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.514s (SENT) [suppressed 9 similar messages]
I20260709 12:12:04.757863 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:04.761044 26473 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:04.723562 32231 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:04.759593 26543 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:04.753623 27165 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:04.759145 26468 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:04.726217 31891 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.766894 26614 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:04.771617 26468 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:12:04.745342 32131 consensus_queue.cc:1243] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 12:12:04.787420 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 156134us
I20260709 12:12:04.744993 32293 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:04.794848 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:04.799122 26473 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:12:04.799067 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:04.794837 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:04.716084 32011 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:12:04.790751 31698 raft_consensus.cc:697] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:04.808068 26622 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:12:04.826078 26622 pending_rounds.cc:85] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 8
I20260709 12:12:04.827585 26468 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:04.730288 32044 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:04.764683 32221 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:04.835886 26622 pending_rounds.cc:107] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:12:04.836110 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:04.836366 26622 raft_consensus.cc:2889] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:04.836777 26473 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:12:04.788676 32272 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:04.839373 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:04.851217 32138 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:04.851882 32138 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:04.852466 32138 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.854298 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:04.819557 31540 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.823299 32322 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.856954 26547 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:04.803211 32287 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:04.831707 32295 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:04.748332 32280 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:04.903060 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:04.923552 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:04.931530 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:04.955724 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.845548 32297 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:04.981171 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:04.992027 32288 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.006565 27161 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:12:05.007707 32316 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:12:05.009423 32288 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:05.009727 32310 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.286s
W20260709 12:12:05.011713 32260 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.084s	user 0.003s	sys 0.004s
I20260709 12:12:05.012374 32309 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:05.013136 32309 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:04.863511 32308 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.394s
W20260709 12:12:04.997469 32311 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260709 12:12:04.826320 32175 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:05.023379 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 192315us
I20260709 12:12:04.902951 32322 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:05.017102 26619 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:04.902514 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:04.902274 32092 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:04.895157 32080 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:05.043458 27162 raft_consensus.cc:2393] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
W20260709 12:12:05.036780 26471 consensus_meta.cc:287] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.595s	user 0.012s	sys 0.000s
I20260709 12:12:05.049706 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:05.016515 32288 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:05.024612 32280 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.082857 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:04.905095 31863 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.144s
I20260709 12:12:05.086221 26543 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:04.864631 32221 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:05.042673 32092 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:05.047896 32301 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:05.101272 31863 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:05.052223 32295 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.101822 32328 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:12:05.103282 32302 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.485s	user 0.004s	sys 0.000s
I20260709 12:12:05.041700 32310 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:12:05.078528 32175 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:05.054216 32308 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:05.082445 32288 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:12:05.097249 32311 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:12:05.082497 32314 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:05.107345 32092 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.051095 26471 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:12:05.119228 32301 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 15 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:05.135396 32314 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:05.165297 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.042950 31698 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.152683 26439 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:05.183000 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:05.014384 32309 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.140094 32230 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14.
I20260709 12:12:05.187048 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3445) took 1098 ms. Trace:
W20260709 12:12:05.197706 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 398687us
I20260709 12:12:05.173209 31709 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:05.180779 32179 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:05.204200 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 191528us
I20260709 12:12:05.213265 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:05.118284 32308 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:05.207577 26467 rpcz_store.cc:276] 0709 12:12:04.088593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.088765 (+   172us) service_pool.cc:224] Handling call
0709 12:12:04.089255 (+   490us) raft_consensus.cc:1471] Updating replica for 5 ops
0709 12:12:04.089816 (+   561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:04.089846 (+    30us) raft_consensus.cc:1539] Triggering prepare for 5 ops
0709 12:12:04.098941 (+  9095us) log.cc:844] Serialized 130 byte log entry
0709 12:12:04.326579 (+227638us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:12:04.326626 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:04.326694 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:05.049444 (+722750us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:05.152131 (+102687us) raft_consensus.cc:1685] finished
0709 12:12:05.152155 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:05.186950 (+ 34795us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4804,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"spinlock_wait_cycles":369334656,"thread_start_us":227110,"threads_started":1,"wal-append.queue_time_us":434203}
W20260709 12:12:05.189173 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 51461.3us
W20260709 12:12:05.205863 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 456257us
I20260709 12:12:05.114702 32295 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.220505 32333 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.221212 32340 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:05.222113 32221 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:05.221263 32044 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:05.227558 32322 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:05.227748 32281 consensus_meta.cc:287] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.854s	user 0.014s	sys 0.002s
W20260709 12:12:05.233902 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:05.235597 27167 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.002s	sys 0.013s
W20260709 12:12:05.230335 32083 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.080s	user 0.008s	sys 0.008s
W20260709 12:12:05.233678 32318 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
W20260709 12:12:05.235146 31667 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.003s	sys 0.012s
W20260709 12:12:05.247437 27167 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.003s	sys 0.013s
I20260709 12:12:05.152069 32301 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.254851 27166 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:12:05.257488 27166 pending_rounds.cc:85] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 11
I20260709 12:12:05.257791 27166 pending_rounds.cc:107] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:12:05.258071 27166 raft_consensus.cc:2889] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:05.258626 31667 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.004s	sys 0.013s
W20260709 12:12:05.264765 32317 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:12:05.242003 32340 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:05.214418 31709 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.212922 32288 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:05.284889 32352 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:05.285246 32288 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.286126 32352 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:05.286867 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:05.288694 26548 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:12:05.291570 32340 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:05.292670 32320 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.293290 32320 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.272703 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:05.264788 26511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.005s	sys 0.014s
W20260709 12:12:05.295249 26511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.005s	sys 0.014s
I20260709 12:12:05.296078 32320 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:05.298924 31948 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.299526 31948 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:05.301736 31948 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:05.303467 31667 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.304004 31667 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.254086 32221 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:05.313759 32343 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:05.313834 31667 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:05.245982 32333 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.315323 31709 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:05.316601 32333 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:05.333926 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:05.335196 32319 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:05.335887 32319 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.337375 32231 raft_consensus.cc:3055] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:05.337867 32231 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:05.339473 32295 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:05.339879 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:05.340600 26622 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:12:05.262601 31891 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.343539 31891 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:05.347174 32314 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:05.350714 32286 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:12:05.351343 31565 consensus_meta.cc:287] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.635s	user 0.008s	sys 0.004s
I20260709 12:12:05.351989 31565 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:05.353364 26542 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 18: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:05.355051 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:05.351289 32286 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:12:05.357352 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44962.6us
W20260709 12:12:05.357401 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 144209us
I20260709 12:12:05.360625 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:05.369534 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 130457us
I20260709 12:12:05.372038 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:05.376874 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:05.377636 26471 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:05.379940 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:05.383140 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:05.384020 26614 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:05.385174 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:05.385834 26614 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:05.387535 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:05.387794 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:05.388541 26614 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:12:05.354880 31948 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.377679 31891 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.379554 32295 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.374799 32319 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:05.410965 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:05.390928 32300 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:05.396333 32322 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:05.377540 32256 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 12:12:05.409498 32253 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.131s	user 0.012s	sys 0.002s
I20260709 12:12:05.436571 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:05.451457 32353 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:12:05.419214 32322 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:05.453163 32322 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.455893 32320 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:05.457795 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:05.449788 32221 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:12:05.395673 31667 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.025s
W20260709 12:12:05.462414 32138 consensus_meta.cc:287] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.004s
I20260709 12:12:05.462920 32138 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:05.465373 32138 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:05.449980 31846 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:05.467523 32320 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:05.471971 32092 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:05.473232 31667 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:05.474758 26547 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:05.396469 32231 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:05.415695 31945 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:12:05.452656 32308 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:05.412719 32295 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.452140 31565 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:05.480015 32092 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:05.419852 32286 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:05.481446 32286 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.417940 32300 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.484560 32300 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:05.484771 31540 consensus_meta.cc:287] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.604s	user 0.005s	sys 0.005s
I20260709 12:12:05.476886 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:05.490113 26466 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:05.412441 31709 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.396195 32345 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:12:05.408190 31891 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:05.401660 31948 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:05.499864 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:05.490856 32319 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:05.493991 32092 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.514329 27133 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:05.516467 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:05.517442 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:05.533505 32223 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:05.519258 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:05.534166 26471 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:05.527629 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:05.527057 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:05.534207 26470 raft_consensus.cc:2376] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15. Re-sending same reply.
I20260709 12:12:05.535141 26544 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:12:05.529346 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:05.535981 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:05.418812 32355 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 12:12:05.539237 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:05.539790 26473 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 18: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:05.537441 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:05.540575 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:05.540797 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:05.542836 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:05.543067 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:05.498505 31891 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.543879 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:05.543985 26470 raft_consensus.cc:2410] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:12:05.545562 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:05.547329 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.546540 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:05.536661 32353 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:05.536909 31698 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:05.550540 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:05.496657 31709 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.536602 32092 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.553560 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:05.563760 26616 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 17: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:05.504271 32253 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.557004 26614 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:05.550189 32301 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:05.557266 26513 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:05.554968 26470 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:12:05.538583 32319 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.549587 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:05.571758 32353 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.572775 32288 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.573669 31709 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:05.540985 32083 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:12:05.554710 31698 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.576370 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:05.561424 31565 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:05.579784 31846 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:05.580855 32253 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:05.582178 32293 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.011s	sys 0.000s
I20260709 12:12:05.582093 26541 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:05.693172 26439 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:05.564466 32092 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.810941 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 885) took 1284 ms. Trace:
I20260709 12:12:05.816009 26619 rpcz_store.cc:276] 0709 12:12:04.526335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.679554 (+153219us) service_pool.cc:224] Handling call
0709 12:12:04.680597 (+  1043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:05.033413 (+352816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.810634 (+777221us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b5400345654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:05.810861 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":773301120}
W20260709 12:12:05.810551 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 117512us
W20260709 12:12:05.602998 32305 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.996s	user 0.004s	sys 0.000s
I20260709 12:12:05.815158 26471 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:12:05.597330 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:05.736824 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.785670 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 2446) took 1043 ms. Trace:
W20260709 12:12:05.619621 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:05.823918 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 226681us
W20260709 12:12:05.826313 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.682861 32077 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:05.640563 31948 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:05.594533 32256 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.640496 32369 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:05.776686 32366 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:12:05.574620 32301 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.607683 27165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 874) took 1008 ms. Trace:
I20260709 12:12:05.721598 27164 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 764) took 1314 ms. Trace:
I20260709 12:12:05.610915 32177 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:05.805949 26614 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:12:05.596402 32337 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.823567 26466 rpcz_store.cc:276] 0709 12:12:04.742151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.743021 (+   870us) service_pool.cc:224] Handling call
0709 12:12:05.333712 (+590691us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b5800011198. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:12:05.785435 (+451723us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54002de1d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:05.785590 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359411200}
I20260709 12:12:05.860670 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:05.858701 27165 rpcz_store.cc:276] 0709 12:12:04.599259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.599513 (+   254us) service_pool.cc:224] Handling call
0709 12:12:04.617628 (+ 18115us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:04.764760 (+147132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.607234 (+842474us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54006054d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:05.607578 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":301342976}
I20260709 12:12:05.867331 26542 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:12:05.865314 27164 rpcz_store.cc:276] 0709 12:12:04.405235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.405515 (+   280us) service_pool.cc:224] Handling call
0709 12:12:04.405911 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:04.452988 (+ 47077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.719281 (+1266293us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b54003b6ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:05.719594 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93159296}
W20260709 12:12:05.827636 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.821262 26439 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:05.647711 32315 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.859s	user 0.001s	sys 0.001s
I20260709 12:12:05.575798 31863 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:05.814435 32293 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.012s	sys 0.000s
W20260709 12:12:05.858156 32303 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 1.312s	user 0.004s	sys 0.000s
I20260709 12:12:05.828202 31846 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:05.816200 31698 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:05.849419 26543 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.807829 31565 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:05.582792 32355 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:05.617470 32175 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.643508 32138 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:05.909863 32308 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:05.910290 32138 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.912743 32138 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:05.649240 32272 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:05.913396 32272 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:05.915606 32331 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.650s	user 0.000s	sys 0.001s
I20260709 12:12:05.813454 32299 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:05.810372 32374 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:05.918025 32374 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:05.851616 32312 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 1.212s	user 0.003s	sys 0.000s
I20260709 12:12:05.919605 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3451) took 1816 ms. Trace:
I20260709 12:12:05.919989 26465 rpcz_store.cc:276] 0709 12:12:04.103507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.122438 (+ 18931us) service_pool.cc:224] Handling call
0709 12:12:04.131700 (+  9262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:04.132026 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:04.132065 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:04.150791 (+ 18726us) log.cc:844] Serialized 26 byte log entry
0709 12:12:04.468130 (+317339us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:04.468175 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:04.468246 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:05.681093 (+1212847us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:05.919264 (+238171us) raft_consensus.cc:1685] finished
0709 12:12:05.919287 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:05.919528 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331272960,"thread_start_us":262412,"threads_started":1,"wal-append.queue_time_us":384277}
I20260709 12:12:05.870051 32077 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.886561 32355 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.922801 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2623) took 1404 ms. Trace:
I20260709 12:12:05.924561 32077 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:05.923267 26615 rpcz_store.cc:276] 0709 12:12:04.518443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.641852 (+123409us) service_pool.cc:224] Handling call
0709 12:12:04.688956 (+ 47104us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:04.736494 (+ 47538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:04.736533 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:04.737158 (+   625us) log.cc:844] Serialized 52 byte log entry
0709 12:12:04.976686 (+239528us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:04.998774 (+ 22088us) log.cc:844] Serialized 14 byte log entry
0709 12:12:04.999217 (+   443us) log.cc:844] Serialized 14 byte log entry
0709 12:12:05.010262 (+ 11045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.010341 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:05.914972 (+904631us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:05.922562 (+  7590us) raft_consensus.cc:1685] finished
0709 12:12:05.922585 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:05.922737 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47476,"prepare.queue_time_us":38880,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":62,"raft.queue_time_us":82036,"raft.run_cpu_time_us":451,"raft.run_wall_time_us":31133,"spinlock_wait_cycles":9316096,"thread_start_us":167029,"threads_started":1,"wal-append.queue_time_us":488511}
I20260709 12:12:05.870671 32293 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:05.595099 32328 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.868678 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:05.860499 32301 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:05.859896 32177 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:05.817997 32288 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:05.870849 32286 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:05.868839 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 47671.6us
W20260709 12:12:06.002054 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 60254us
I20260709 12:12:05.931241 26473 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260709 12:12:05.883025 32368 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 12:12:05.934921 26543 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 12:12:05.940795 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 72216.9us
I20260709 12:12:06.012404 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:06.013034 31858 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:06.013204 31521 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.013676 31858 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:05.930250 32374 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.932994 27134 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:05.876619 32364 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:05.938354 32280 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.851s	user 0.016s	sys 0.002s
I20260709 12:12:05.874364 32322 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:05.859215 32369 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.959887 32355 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:05.947639 32328 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:05.962262 32295 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:05.979442 32375 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:12:05.950068 32175 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:05.984865 32340 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:05.872525 32337 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:05.873669 31863 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.015203 32343 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.006163 26439 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:06.013749 31521 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.050522 26465 pending_rounds.cc:85] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 10
I20260709 12:12:06.050911 26465 pending_rounds.cc:107] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:12:06.051142 26465 raft_consensus.cc:2889] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:06.015844 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 82884.7us
I20260709 12:12:06.017237 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:06.027256 32370 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:05.952356 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3339) took 2409 ms. Trace:
I20260709 12:12:06.005048 32254 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:06.036582 26473 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:05.979988 32379 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:06.043066 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:06.043406 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:06.046697 27166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 655) took 2274 ms. Trace:
I20260709 12:12:05.942863 32138 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:06.017525 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:06.021121 32364 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:06.051353 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:06.071249 27161 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:06.065467 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:06.072780 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.070025 27166 rpcz_store.cc:276] 0709 12:12:03.762805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.763600 (+   795us) service_pool.cc:224] Handling call
0709 12:12:03.775547 (+ 11947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:05.262162 (+1486615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.030882 (+768720us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540071af54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:06.037381 (+  6499us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3401169152}
I20260709 12:12:06.061849 26617 rpcz_store.cc:276] 0709 12:12:03.537964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.538170 (+   206us) service_pool.cc:224] Handling call
0709 12:12:03.550706 (+ 12536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:03.773909 (+223203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:03.773960 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:03.778233 (+  4273us) log.cc:844] Serialized 26 byte log entry
0709 12:12:04.286071 (+507838us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:04.286106 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:04.286182 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:05.583138 (+1296956us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:05.938755 (+355617us) raft_consensus.cc:1685] finished
0709 12:12:05.938789 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:05.946781 (+  7992us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58961,"raft.queue_time_us":115670,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":3723,"spinlock_wait_cycles":383987456,"thread_start_us":574597,"threads_started":2,"wal-append.queue_time_us":658844}
I20260709 12:12:06.010512 32286 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.044317 32355 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:06.077472 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:06.078325 26546 raft_consensus.cc:2368] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18.
I20260709 12:12:06.002825 31565 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.069635 32379 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.066444 32254 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:06.083443 31863 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:06.094213 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:06.087608 32371 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.160s	user 0.000s	sys 0.004s
I20260709 12:12:06.096562 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:06.080042 32363 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.066421 32295 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 12:12:06.022467 32293 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.073777 32364 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.079723 32319 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.061764 32343 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.089493 32353 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:06.087539 32349 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:06.095127 32379 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:06.096113 31828 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
W20260709 12:12:06.153580 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.131822 32059 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:06.155941 26542 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:12:06.158495 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.087756 32138 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.094972 32355 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.165378 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:06.168242 32389 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:06.175294 32389 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:06.175848 32389 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:06.179777 32328 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.178188 31846 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:06.229743 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:06.234361 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 80528.1us
W20260709 12:12:06.232833 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 226743us
I20260709 12:12:06.185868 32288 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:06.229302 32375 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:12:06.226672 32131 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:06.250681 27133 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:06.258598 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:06.258800 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:06.233911 32369 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:06.252904 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:12:06.276712 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:06.277307 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:06.277667 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:06.278048 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:06.255997 32300 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.771s	user 0.010s	sys 0.003s
I20260709 12:12:06.247426 32280 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:06.297235 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:06.298216 26613 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:06.300776 26613 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:06.306098 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:06.249889 32398 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.168265 32177 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.316264 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:06.321149 26613 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:06.263964 32080 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:06.335359 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:06.268344 32353 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:06.281481 32327 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:06.286049 32295 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:06.347169 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:06.261584 31846 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 12:12:06.313295 32383 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:06.359157 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 100439us
I20260709 12:12:06.314451 32198 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:06.319839 32337 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:06.362039 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:06.326992 32397 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 12:12:06.357424 32390 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:12:06.329245 32286 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:06.266671 32131 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.319413 32370 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:06.357218 32295 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.348588 32328 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:06.319830 32280 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.390326 32080 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:06.364811 32327 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:06.313915 32300 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.374958 32177 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:06.397183 32393 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:12:06.421576 26613 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:06.398926 32295 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.258042 32388 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.098s
I20260709 12:12:06.358027 32353 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.381989 32198 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:06.424486 31891 consensus_meta.cc:287] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.870s	user 0.014s	sys 0.000s
I20260709 12:12:06.404546 32080 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:06.468694 32080 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:06.471957 32392 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:12:06.476912 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3468) took 1872 ms. Trace:
W20260709 12:12:06.447618 32272 consensus_meta.cc:287] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.001s
I20260709 12:12:06.477387 26464 rpcz_store.cc:276] 0709 12:12:04.604475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.607355 (+  2880us) service_pool.cc:224] Handling call
0709 12:12:04.607690 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:04.864794 (+257104us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:05.104651 (+239857us) log.cc:844] Serialized 14 byte log entry
0709 12:12:05.362502 (+257851us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:05.362591 (+    89us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:05.362660 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.476610 (+1113950us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54001c1e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:06.476666 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.476835 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1847,"prepare.queue_time_us":131221,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":54635,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":590662912,"thread_start_us":348957,"threads_started":3,"wal-append.queue_time_us":153150,"wal-append.run_cpu_time_us":1471,"wal-append.run_wall_time_us":1079285}
I20260709 12:12:06.478798 32272 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.479812 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:06.480166 32280 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:06.480477 26464 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 20.
I20260709 12:12:06.449746 27159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 661) took 1856 ms. Trace:
I20260709 12:12:06.376586 32383 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.399503 32319 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:12:06.463474 32400 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.141004 32363 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.463033 32327 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.415246 32328 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.400436 32370 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.466647 32138 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:06.467446 32343 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.467357 31891 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:06.486032 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 122141us
I20260709 12:12:06.484671 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:06.572460 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:06.482748 27159 rpcz_store.cc:276] 0709 12:12:04.593707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.601430 (+  7723us) service_pool.cc:224] Handling call
0709 12:12:04.620958 (+ 19528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:05.002727 (+381769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:05.002776 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:05.002844 (+    68us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:05.002896 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.449492 (+1446596us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b54003b7754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:06.449545 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.449679 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":877303040}
I20260709 12:12:06.329455 32398 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.159063 32349 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.495568 27161 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:12:06.491161 32198 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:06.572623 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 88147.8us
W20260709 12:12:06.490983 32256 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.634s	user 0.006s	sys 0.006s
I20260709 12:12:06.575572 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:06.579128 27167 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:12:06.492707 31945 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:12:06.526577 31698 consensus_meta.cc:287] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.644s	user 0.013s	sys 0.000s
I20260709 12:12:06.491767 32400 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.631826 26619 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
W20260709 12:12:06.565599 32092 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.745s	user 0.013s	sys 0.002s
W20260709 12:12:06.633674 32301 consensus_meta.cc:287] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.677s	user 0.011s	sys 0.000s
I20260709 12:12:06.638145 26473 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:12:06.587339 26617 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:06.574914 32413 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:06.592422 32131 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.634553 32256 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:06.583069 32404 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:06.648532 32092 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.725368 32349 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.726769 32406 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.727489 32406 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.731057 32300 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:06.732774 32407 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:12:06.733558 32304 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 1.959s	user 0.003s	sys 0.002s
W20260709 12:12:06.736284 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.736537 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2449) took 1737 ms. Trace:
W20260709 12:12:06.736846 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:06.737396 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.737010 26541 rpcz_store.cc:276] 0709 12:12:04.999344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.047064 (+ 47720us) service_pool.cc:224] Handling call
0709 12:12:05.047526 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:05.806691 (+759165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.736257 (+929566us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b54001121d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:06.736466 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1228662144}
I20260709 12:12:06.668179 32293 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:06.685729 32404 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:06.740294 32398 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:06.741185 32400 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.742478 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3354) took 2682 ms. Trace:
I20260709 12:12:06.742843 31891 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.744047 32272 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:06.769515 26621 rpcz_store.cc:276] 0709 12:12:04.059706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.059932 (+   226us) service_pool.cc:224] Handling call
0709 12:12:04.104854 (+ 44922us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:04.105328 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:04.105364 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:04.105933 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 12:12:04.323819 (+217886us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:04.323891 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:04.324021 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:06.732986 (+2408965us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:06.742113 (+  9127us) raft_consensus.cc:1685] finished
0709 12:12:06.742140 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.742383 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1364,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":29852928,"thread_start_us":217381,"threads_started":1,"wal-append.queue_time_us":540385}
I20260709 12:12:06.776746 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3485) took 1254 ms. Trace:
I20260709 12:12:06.751385 32328 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.749384 31863 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.779055 31863 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.781688 31863 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.671535 32413 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:06.784039 32389 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.608s	user 0.011s	sys 0.000s
I20260709 12:12:06.697072 32355 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:06.784554 32389 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.785444 32370 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.786751 32363 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.763200 32083 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:06.790956 32083 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.792253 32413 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:06.793165 32083 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:06.794106 32340 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.745s	user 0.008s	sys 0.004s
I20260709 12:12:06.794850 32353 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:06.764436 32404 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:06.768784 32293 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.777252 26468 rpcz_store.cc:276] 0709 12:12:05.522624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.555079 (+ 32455us) service_pool.cc:224] Handling call
0709 12:12:05.555509 (+   430us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:12:05.562275 (+  6766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:05.562322 (+    47us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:12:05.569495 (+  7173us) log.cc:844] Serialized 78 byte log entry
0709 12:12:05.855974 (+286479us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:05.998450 (+142476us) log.cc:844] Serialized 14 byte log entry
0709 12:12:06.001587 (+  3137us) log.cc:844] Serialized 14 byte log entry
0709 12:12:06.085748 (+ 84161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.085864 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:06.768376 (+682512us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b240011a9f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072e739c4 00007f5072e71acb 00007f507302cdc9 00007f507302ca55 00007f507302bfb0 00007f5075ca2488 00007f5075ca2be8 00007f5075c7a398 00007f5075c7576a 00007f5075c74bb6
0709 12:12:06.776467 (+  8091us) raft_consensus.cc:1685] finished
0709 12:12:06.776494 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.776674 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19179,"prepare.queue_time_us":318031,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":78,"raft.queue_time_us":153914,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":27413,"spinlock_wait_cycles":45271552,"thread_start_us":404722,"threads_started":3,"wal-append.queue_time_us":333244}
I20260709 12:12:06.801285 32293 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:06.802268 32364 consensus_meta.cc:287] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.663s	user 0.009s	sys 0.001s
I20260709 12:12:06.802874 32364 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.764178 32319 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:06.777990 32080 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.805167 32319 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.807715 32319 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:06.808525 32080 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.751358 26438 leader_election.cc:400] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18.
I20260709 12:12:06.639474 31945 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.809630 26438 leader_election.cc:403] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:12:06.811354 31945 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.640789 31698 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.813513 31698 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.767086 32092 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.763304 32343 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:06.767722 32415 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:06.730116 32406 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:06.758276 32032 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:06.666991 32301 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.710474 32256 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.794879 26472 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:06.821957 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3489) took 1296 ms. Trace:
W20260709 12:12:06.816576 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 65427.6us
W20260709 12:12:06.830426 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 165983us
I20260709 12:12:06.822424 26471 rpcz_store.cc:276] 0709 12:12:05.525703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.828883 (+303180us) service_pool.cc:224] Handling call
0709 12:12:05.848074 (+ 19191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:06.243585 (+395511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:06.243616 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:06.244066 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 12:12:06.527240 (+283174us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:06.527312 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.814882 (+287570us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400069ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:06.814935 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:06.814994 (+    59us) raft_consensus.cc:1685] finished
0709 12:12:06.815012 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.821868 (+  6856us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14657,"raft.queue_time_us":74779,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5376,"spinlock_wait_cycles":464664448,"thread_start_us":424676,"threads_started":2,"wal-append.queue_time_us":402379}
I20260709 12:12:06.834869 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:06.818497 32400 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:06.844223 27162 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 13: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:06.814774 32343 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.851704 26514 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:06.841113 32353 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.845403 31945 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:06.784117 32295 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.843289 32406 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.820967 32032 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.827198 32177 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:06.863487 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3488) took 1338 ms. Trace:
I20260709 12:12:06.818492 32415 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.840607 32092 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:12:06.867981 32301 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:06.833472 32256 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.869257 32389 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.873386 26470 rpcz_store.cc:276] 0709 12:12:05.524995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.593052 (+ 68057us) service_pool.cc:224] Handling call
0709 12:12:05.595361 (+  2309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:05.640770 (+ 45409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:05.640833 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:05.641656 (+   823us) log.cc:844] Serialized 26 byte log entry
0709 12:12:05.830191 (+188535us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:05.857902 (+ 27711us) log.cc:844] Serialized 14 byte log entry
0709 12:12:05.858144 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.858228 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:06.812295 (+954067us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b18002de7a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fbb2a6 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1
0709 12:12:06.813661 (+  1366us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b18002de7a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:12:06.863257 (+ 49596us) raft_consensus.cc:1685] finished
0709 12:12:06.863281 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.863419 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44753,"prepare.queue_time_us":29304,"raft.queue_time_us":44516,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":6771,"spinlock_wait_cycles":18595584,"thread_start_us":188057,"threads_started":1,"wal-append.queue_time_us":217896}
I20260709 12:12:06.869562 32353 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:06.877116 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.874406 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:12:06.875921 32374 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.847s	user 0.009s	sys 0.004s
I20260709 12:12:06.870541 32412 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:06.885281 32415 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:06.885288 32032 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:06.886307 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:06.894618 32348 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.587s	user 0.002s	sys 0.001s
I20260709 12:12:06.872709 32406 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.898762 26514 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:06.889823 32412 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:06.902946 32404 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.905460 32322 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.905592 32404 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.880079 32177 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.908605 26514 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:06.909150 31891 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:06.911890 32428 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:12:06.912899 32428 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:06.913307 32428 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:06.913884 32295 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.908315 32412 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:06.915126 32412 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.918244 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 809) took 1375 ms. Trace:
I20260709 12:12:06.918633 32032 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:06.919271 32032 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.919912 32032 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:06.920607 32343 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:06.923244 32256 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.925612 32353 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.909576 32175 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:06.928638 32406 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.913434 32254 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:06.910137 32379 consensus_meta.cc:287] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.758s	user 0.012s	sys 0.000s
I20260709 12:12:06.918742 26465 rpcz_store.cc:276] 0709 12:12:05.542885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.921406 (+378521us) service_pool.cc:224] Handling call
0709 12:12:05.921785 (+   379us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:06.062250 (+140465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:06.062283 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:06.068004 (+  5721us) log.cc:844] Serialized 52 byte log entry
0709 12:12:06.589767 (+521763us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:06.639756 (+ 49989us) log.cc:844] Serialized 14 byte log entry
0709 12:12:06.692629 (+ 52873us) log.cc:844] Serialized 14 byte log entry
0709 12:12:06.748093 (+ 55464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.917807 (+169714us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54000dc0d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:06.917856 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:06.917995 (+   139us) raft_consensus.cc:1685] finished
0709 12:12:06.918013 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.918172 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97506,"prepare.queue_time_us":78571,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":85,"raft.queue_time_us":158026,"raft.run_cpu_time_us":448,"raft.run_wall_time_us":41451,"spinlock_wait_cycles":390015744,"thread_start_us":498325,"threads_started":1,"wal-append.queue_time_us":691715}
I20260709 12:12:06.886957 32374 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.914196 32428 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.946805 32379 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:06.964350 32379 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.966660 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:06.954279 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:06.967470 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:06.953593 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:06.958832 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:06.968308 26545 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 12: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:06.968344 26617 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.968674 26616 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:06.968847 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:06.960376 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:06.961776 32353 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:06.969586 26542 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:06.968112 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:06.961479 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:06.969992 26614 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:06.973862 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:06.974114 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:06.977082 26614 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:06.977950 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:06.978655 26619 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:06.983793 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:06.973114 32254 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.986086 32369 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:06.986814 32369 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:06.987284 32374 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.989085 32369 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:06.991056 32400 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18.
I20260709 12:12:06.992797 32177 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:06.994221 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.002218 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:07.003937 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.007328 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.007858 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.009564 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:07.010649 27164 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:07.027326 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.028414 26542 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:07.008523 26540 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
W20260709 12:12:07.034050 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.033965 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:06.995500 32428 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:07.036393 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.039839 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.001436 32400 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:07.040794 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.041376 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:07.041751 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.042187 26544 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 16: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:07.041468 26541 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:07.042712 26542 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:07.051921 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:07.040609 26540 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:07.060750 26544 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:12:07.067272 26545 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:07.052445 32177 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.055207 32271 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.076249 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.077240 26545 raft_consensus.cc:2410] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:12:07.060983 32400 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:07.084090 27162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 665) took 1072 ms. Trace:
I20260709 12:12:07.086930 26617 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:07.086676 27162 rpcz_store.cc:276] 0709 12:12:06.011378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.012039 (+   661us) service_pool.cc:224] Handling call
0709 12:12:07.083819 (+1071780us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b540077c754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:07.083989 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1902397824}
W20260709 12:12:07.085331 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45060.2us
I20260709 12:12:07.091017 26616 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
W20260709 12:12:07.088757 26472 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 3478) took 1572 ms (client timeout 1514 ms). Trace:
I20260709 12:12:07.098814 32175 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:07.100667 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:07.102738 26472 rpcz_store.cc:269] 0709 12:12:05.513600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.513822 (+   222us) service_pool.cc:224] Handling call
0709 12:12:07.085302 (+1571480us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54000690d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:07.085431 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2877713152}
I20260709 12:12:07.106364 26545 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:07.110512 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:07.113879 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:07.114529 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.114621 32341 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:07.115172 32341 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:07.115633 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:07.116042 32341 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:07.116919 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:07.119216 32345 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:07.119565 27162 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:07.118280 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:07.120366 27167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 879) took 1066 ms. Trace:
W20260709 12:12:07.121222 32307 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 2.426s	user 0.001s	sys 0.003s
I20260709 12:12:07.135499 31521 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:07.122802 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:07.137917 32384 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:07.138352 32384 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.138751 32384 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:07.125201 27164 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 12:12:07.139981 27164 pending_rounds.cc:85] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 12
I20260709 12:12:07.140273 27164 pending_rounds.cc:107] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 12:12:07.140517 27164 raft_consensus.cc:2889] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:07.133312 32345 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.141928 32345 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:07.126004 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.143389 26438 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:07.144589 32230 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:07.145011 32230 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.145334 32230 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:07.148869 32388 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.149446 32388 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:07.103569 32175 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:07.154737 31858 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:07.155771 32175 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:07.080353 32177 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:07.157138 32433 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:12:07.157927 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2549) took 2299 ms. Trace:
I20260709 12:12:07.158281 32177 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:07.158349 26547 rpcz_store.cc:276] 0709 12:12:04.858789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.901101 (+ 42312us) service_pool.cc:224] Handling call
0709 12:12:05.016446 (+115345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:05.475311 (+458865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:07.157654 (+1682343us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54003386d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:07.157834 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053489024}
I20260709 12:12:07.134907 27167 rpcz_store.cc:276] 0709 12:12:06.054279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.054466 (+   187us) service_pool.cc:224] Handling call
0709 12:12:06.578868 (+524402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:06.594862 (+ 15994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:07.120168 (+525306us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b540056bb50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:07.120305 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1161997568}
I20260709 12:12:07.082271 32271 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:05.230212 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:07.117226 32341 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:07.145401 32272 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:07.163393 27168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 669) took 1131 ms. Trace:
I20260709 12:12:07.163825 27168 rpcz_store.cc:276] 0709 12:12:06.032294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.032760 (+   466us) service_pool.cc:224] Handling call
0709 12:12:06.050972 (+ 18212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.163329 (+112357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:06.163363 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:06.163411 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:06.163459 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:07.163034 (+999575us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54006cf054. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:07.163084 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:07.163219 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257880320}
W20260709 12:12:07.167637 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.130992 32434 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:07.168253 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.175184 32254 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:07.176556 26619 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:07.178184 32388 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:07.178344 32280 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:07.178623 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:07.192332 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:07.178823 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:07.178995 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:07.149484 32032 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:07.127511 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.182741 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:07.183110 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:07.197130 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:07.197928 27167 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:12:07.183871 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:07.171069 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 52918.9us
W20260709 12:12:07.184885 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.171994 26514 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:07.161132 32271 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:07.202409 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.203816 31521 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:07.204546 31521 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:12:07.204682 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.170761 32434 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:07.205086 31521 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:07.205582 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:07.204879 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:07.208635 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:07.211234 27166 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:07.199157 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:07.212991 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:07.215334 26514 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:07.216298 26514 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:07.220036 32353 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:07.202795 32280 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:07.220573 32353 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:07.221066 32353 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:07.221092 32231 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:07.222708 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:07.222986 32258 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:07.223381 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:07.223692 32343 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:07.224005 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:07.224038 27162 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 12.
I20260709 12:12:07.215670 26438 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:07.222543 32138 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:07.224849 27163 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:07.227131 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:07.227803 27159 raft_consensus.cc:2368] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 12. Current term is 13.
I20260709 12:12:07.228484 26544 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:12:07.190276 32254 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:07.228713 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:07.228956 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:07.224339 32343 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:07.235935 32343 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:07.229785 32369 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:07.239516 32369 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.239174 32254 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:07.239943 32369 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:07.241397 32383 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:07.242085 27168 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
W20260709 12:12:07.222585 32406 consensus_queue.cc:1175] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac3ac2181aa941229a758ccf6b5607cd" responder_term: 14 status { last_received { term: 14 index: 9 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:07.248821 32400 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:07.251032 32032 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:07.222577 31858 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:07.251533 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.251818 31858 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.252269 31858 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:07.246273 32345 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:07.222257 32280 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:07.233413 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:07.255291 32345 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:07.203962 32044 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:07.255892 32044 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.256294 32044 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:07.256327 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:07.234544 32258 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:07.259153 32258 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:07.234721 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:07.231976 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:07.262854 26617 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:07.264520 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.241636 32254 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:07.205478 32388 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:07.267026 32388 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.267131 32379 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:07.267498 32388 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:07.268148 26467 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:07.270991 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3476) took 1895 ms. Trace:
I20260709 12:12:07.272125 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:07.271435 26467 rpcz_store.cc:276] 0709 12:12:05.375788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.375945 (+   157us) service_pool.cc:224] Handling call
0709 12:12:05.391702 (+ 15757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:07.268552 (+1876850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:07.270690 (+  2138us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b54002dda54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:07.270914 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4314676608}
W20260709 12:12:07.282644 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 55955.7us
I20260709 12:12:07.285146 32032 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:07.270993 32230 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:07.290035 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:07.285063 32386 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 1.023s	user 0.002s	sys 0.000s
I20260709 12:12:07.291908 32032 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:07.301613 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 803) took 2884 ms. Trace:
W20260709 12:12:07.295017 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.304132 26514 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:07.293975 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:07.308068 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:07.308799 26464 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.310911 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:07.311995 26473 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:07.294673 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:07.296649 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 65246.5us
W20260709 12:12:07.294647 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 60359.4us
I20260709 12:12:07.321857 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:07.323473 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:07.334484 26617 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:12:07.335444 26619 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:07.340157 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:07.341300 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.342347 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:07.302083 26469 rpcz_store.cc:276] 0709 12:12:04.417537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.420850 (+  3313us) service_pool.cc:224] Handling call
0709 12:12:04.421192 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:04.421856 (+   664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:04.421888 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:05.981207 (+1559319us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b2c000327f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:12:05.981736 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 12:12:06.091438 (+109702us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:06.130780 (+ 39342us) log.cc:844] Serialized 14 byte log entry
0709 12:12:06.131001 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.131101 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:07.284311 (+1153210us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:07.301368 (+ 17057us) raft_consensus.cc:1685] finished
0709 12:12:07.301392 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:07.301518 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35883,"prepare.queue_time_us":60001,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":11136,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":4415,"spinlock_wait_cycles":51500672,"thread_start_us":109217,"threads_started":1,"wal-append.queue_time_us":206764}
I20260709 12:12:07.343565 26472 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 16: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:07.343871 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:07.344152 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:07.341225 26439 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:07.346110 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:07.347082 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:07.348330 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:07.343181 26618 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:07.349157 26466 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.358474 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.358922 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:07.347121 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.367300 26547 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:12:07.367600 32231 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:12:07.368636 32231 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:07.369037 32231 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:07.370016 32032 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:07.371258 27161 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:07.372500 32231 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:07.373845 32231 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:07.374775 32436 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:07.338526 32320 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:07.375419 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:07.360240 32080 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 12:12:07.381592 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:07.347653 32059 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:07.359391 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:07.385223 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:07.404222 26614 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:07.389515 26464 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:07.331211 32175 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.388070 27134 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:07.393951 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:07.332122 32382 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.204s	user 0.008s	sys 0.027s
W20260709 12:12:07.429328 32382 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.315s	user 0.008s	sys 0.027s
I20260709 12:12:07.411772 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.430963 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.412047 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.413163 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.418853 27168 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:07.434381 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.441417 31521 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:07.447355 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:07.448208 26542 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:07.464808 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 123671us
I20260709 12:12:07.466408 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:07.421877 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.419662 26466 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:07.420629 32295 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:07.421155 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.485661 26547 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
W20260709 12:12:07.402599 32430 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.489s	user 0.003s	sys 0.000s
I20260709 12:12:07.421515 32436 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:07.423173 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.484122 32396 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:07.423698 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.424237 32175 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:07.373752 32353 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:07.298058 32369 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:07.475965 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:07.477548 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:07.506956 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:07.507543 26466 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 16: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:07.507285 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.495617 31521 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:07.417265 32059 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:07.425923 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:07.502527 27168 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:07.482373 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.391419 31891 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:07.517191 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:07.540357 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:12:07.546334 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 120483us
I20260709 12:12:07.484915 32198 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.502972 32396 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.565869 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:07.551893 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:07.504148 32356 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:07.498615 32437 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.559990 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:07.507958 32295 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 15 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:07.581190 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:07.582113 26466 raft_consensus.cc:2410] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:12:07.564529 26514 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:07.574908 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:07.555680 31846 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:07.590938 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 50679.8us
I20260709 12:12:07.571010 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.560526 26471 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 16: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:07.519220 32059 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.571465 26513 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:07.583806 26468 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:12:07.545964 32345 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:07.568529 26542 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:12:07.509964 32044 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:07.609637 26465 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:12:07.611197 26465 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 19. Ops: []
I20260709 12:12:07.545552 32436 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:12:07.587411 26614 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:07.592116 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:07.568663 31521 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:07.567260 32434 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:07.566521 31891 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:07.546905 32384 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:07.618650 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:07.574059 32396 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:07.588861 32400 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:07.555471 32177 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 12:12:07.597218 31846 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:07.668084 26468 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:07.613700 32256 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:07.655753 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:07.668974 26466 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:12:07.656689 26541 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:12:07.661000 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:07.672712 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.673367 26439 leader_election.cc:400] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 12. Current term is 13.
I20260709 12:12:07.616771 32391 raft_consensus.cc:2764] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
W20260709 12:12:07.644876 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.582492 32437 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:07.683192 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:07.654098 32434 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:07.575515 32198 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:07.614719 26542 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:07.595734 32271 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 12:12:07.671608 32230 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:07.637964 32345 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:07.673686 26541 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 16: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:07.602609 31565 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 12:12:07.666289 32254 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:07.724079 32254 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:07.729058 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.689309 26439 leader_election.cc:403] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:07.670084 31846 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:07.734380 26473 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:07.663828 32400 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:07.733050 32356 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:12:07.691421 32434 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:07.709718 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.678512 32409 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:07.663563 32252 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:12:07.722957 32436 raft_consensus.cc:2764] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:12:07.696050 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.744874 26546 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:12:07.748258 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.682945 31858 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:07.666354 32092 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:12:07.738317 32400 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:07.755880 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:07.758948 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:07.760617 26466 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:07.759656 26621 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:07.739640 32353 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:07.743830 32409 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:07.738502 26542 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:07.711973 32044 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:07.720278 32352 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.680488 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:07.790959 26472 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 19: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:07.751137 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:07.751323 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:07.752337 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:07.753033 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:07.730769 26541 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:12:07.754172 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:07.762980 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:07.764422 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:07.731366 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 58220.2us
I20260709 12:12:07.767258 26620 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:12:07.736794 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:07.697425 32295 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:07.762913 32175 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:07.733518 31891 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:07.876394 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:07.880194 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 461402us
I20260709 12:12:07.886613 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:07.792634 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:07.889411 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:07.890014 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:07.798434 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.874337 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:07.891613 26473 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:07.770093 32343 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.008s	sys 0.016s
I20260709 12:12:07.892052 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:07.904090 26464 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:12:07.904729 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:07.905074 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:07.763219 32436 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:07.857012 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:07.905750 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:07.791810 26470 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:12:07.906622 26621 raft_consensus.cc:2410] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:12:07.906850 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:07.790179 32258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.019s	sys 0.014s
I20260709 12:12:07.904990 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:07.894773 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:07.791918 32412 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.020s	sys 0.025s
I20260709 12:12:07.907503 26470 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:07.916252 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:07.907469 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:07.908784 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:07.790882 32409 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:07.904198 26618 raft_consensus.cc:2410] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:12:07.922046 26622 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:07.913208 26613 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:07.908123 26616 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:12:07.913622 26620 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:07.905551 32230 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:07.910035 32258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.022s	sys 0.022s
W20260709 12:12:07.917738 32412 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.020s	sys 0.026s
I20260709 12:12:07.893107 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:07.903522 32343 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.011s	sys 0.029s
I20260709 12:12:07.862044 32384 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:07.931445 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:07.892489 32271 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:07.843969 32254 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:07.948930 26473 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
W20260709 12:12:07.940004 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:07.931746 32388 consensus_meta.cc:287] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.661s	user 0.012s	sys 0.002s
I20260709 12:12:07.838510 32352 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:07.946620 32437 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:07.947254 32345 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:07.921936 32382 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.947374 32384 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:07.947976 32271 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:07.956732 26470 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
I20260709 12:12:07.959165 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:07.959625 32353 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:07.962728 32434 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:07.933377 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:07.965384 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:07.964813 32400 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:08.052549 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:07.967166 32280 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:07.969527 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:07.932703 32230 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:07.971520 32364 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:07.972332 32369 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:07.978497 26367 catalog_manager.cc:5697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 9 to 12, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 12 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:07.979779 27168 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:57562
I20260709 12:12:08.052554 32384 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:07.982319 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:08.069430 26471 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:12:07.983651 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:08.070458 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:08.070838 26620 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:07.988445 32059 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:07.989879 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:07.908901 32436 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:07.990824 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:08.074374 26613 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:07.930191 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:07.995445 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 422709us
I20260709 12:12:08.076712 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:07.981508 32231 consensus_meta.cc:287] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.015s
I20260709 12:12:08.005541 32198 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:08.015293 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 408670us
I20260709 12:12:08.079468 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:08.081838 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:08.017221 32416 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.080s	user 0.012s	sys 0.011s
W20260709 12:12:08.082661 32416 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.146s	user 0.012s	sys 0.011s
W20260709 12:12:08.049499 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 462787us
I20260709 12:12:08.049449 32382 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:08.061887 32230 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:08.053697 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:08.093569 26470 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 15: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:08.062604 27168 raft_consensus.cc:606] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:08.051071 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:08.094031 27168 raft_consensus.cc:614] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:07.981448 31858 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:08.063637 26621 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:08.069504 26465 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:08.056253 32280 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:08.031461 32388 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:08.084299 32059 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:08.085021 26469 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 20. Ops: []
I20260709 12:12:08.086489 32428 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:08.094791 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:08.134241 26542 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:12:08.089721 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:08.090261 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:08.090952 32396 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:08.092581 32384 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:08.094666 26473 raft_consensus.cc:2410] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:12:08.008266 31846 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:08.083117 32436 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:08.159475 32436 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:08.160845 26473 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 12:12:08.099581 32352 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:08.100896 31858 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:08.163148 26467 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:08.136514 32231 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.164579 32231 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:08.102749 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:08.138742 32299 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.166764 26471 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:08.167006 32299 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:08.103735 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.103945 26513 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:08.105438 32400 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:08.060109 32434 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:08.107380 32271 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:08.169070 32230 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:08.172283 26468 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 17: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:08.110811 26472 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:08.175815 27168 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:57562
I20260709 12:12:08.176729 27168 raft_consensus.cc:606] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:12:08.177213 27168 raft_consensus.cc:614] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:08.113209 26470 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:08.124950 26620 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:08.137061 26539 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:08.179541 26367 catalog_manager.cc:5697] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 6 to 12, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 12 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:08.181350 26367 catalog_manager.cc:5697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:08.110743 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:12:08.183672 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 73016.1us
I20260709 12:12:08.184388 32280 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:08.184966 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:08.185681 32280 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:08.186664 32271 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:08.188632 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:08.186792 32434 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:08.190450 26469 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 16. Ops: [14.13-14.13]
I20260709 12:12:08.196050 26613 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:08.196887 26539 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:08.240089 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:08.241992 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:08.196995 26367 catalog_manager.cc:5697] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 12 to 13, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 13 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:08.199273 26471 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:12:08.203671 32388 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:08.205037 26370 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57044 (request call id 313) took 43209 ms (client timeout 15000 ms). Trace:
I20260709 12:12:08.139937 32356 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 12. Current term is 13.
I20260709 12:12:08.209949 31521 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:08.243871 26367 catalog_manager.cc:5697] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 13 to 16, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 16 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:08.201823 32382 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:08.151019 32364 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:08.249285 26541 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:08.213917 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:08.199126 32446 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:12:08.215145 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:08.254196 26545 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:08.221434 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:08.225082 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:08.116811 32198 raft_consensus.cc:2764] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 12:12:08.210139 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 106268us
I20260709 12:12:08.267343 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:08.269378 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:08.269798 26514 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:08.240196 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:08.243337 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:08.271361 26620 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:08.245766 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:08.213713 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:08.247022 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:08.248147 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:08.250203 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:08.209334 31858 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:08.275849 26544 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 20: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:08.264199 27161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "541724f47bb04d5185dd369750546cbf"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:57562
I20260709 12:12:08.277163 27161 raft_consensus.cc:606] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:12:08.277702 27161 raft_consensus.cc:614] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:08.265894 31846 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:08.236822 32434 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:08.235522 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 46958.8us
I20260709 12:12:08.250658 26543 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:08.139518 32409 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:08.274075 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:08.279512 26367 catalog_manager.cc:5697] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:08.290251 31521 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:08.240972 32436 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:08.292805 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:08.310830 26367 catalog_manager.cc:5697] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 8 to 12, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 12 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:08.315249 26514 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:08.315490 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:08.237236 32400 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:12:08.270707 32252 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:08.323550 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:08.318888 26469 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:08.317963 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:08.280936 32356 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:08.327147 26541 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:08.327468 27161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:57562
I20260709 12:12:08.332827 27161 raft_consensus.cc:606] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:12:08.291149 32080 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.328964 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:08.337530 26539 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:12:08.307650 32032 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:08.327816 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.335022 26544 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:08.307972 32434 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:08.307816 32436 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.319010 32256 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:08.344233 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:08.276325 32364 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:08.322749 32198 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:08.360399 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:08.329948 32188 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:08.321439 32447 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:08.337342 32177 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:08.354031 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:08.387353 26469 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:08.331899 32356 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.341663 32252 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:08.329602 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:08.368300 26543 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:08.371614 26464 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:12:08.355144 26470 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:08.321194 26367 catalog_manager.cc:5697] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index -1 to 9, term changed from 11 to 13, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added, now has a pending config: VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65), VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66), VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67), VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 13 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } } pending_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:08.382081 31858 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:08.390920 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:08.404348 26468 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:08.345477 32080 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:08.410171 26622 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:08.350018 32231 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:08.361819 32400 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:08.412861 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 83316.5us
I20260709 12:12:08.321269 32323 consensus_queue.cc:1059] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:12:08.362726 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:08.414280 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:08.402472 26547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.009s	sys 0.026s
I20260709 12:12:08.350221 32436 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:08.349063 32256 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:08.348558 32271 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:08.399653 32356 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:08.402777 26614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.016s	sys 0.026s
W20260709 12:12:08.450371 26614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.017s	sys 0.026s
W20260709 12:12:08.416155 26547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.009s	sys 0.026s
I20260709 12:12:08.416204 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:08.380858 32447 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:08.422643 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:08.437186 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.395044 26473 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:08.399416 32188 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:08.442090 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:08.443085 26543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:12:08.395849 32032 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:08.449324 27160 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 12:12:08.243911 26370 rpcz_store.cc:269] 0709 12:11:24.995298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.998580 (+  3282us) service_pool.cc:224] Handling call
0709 12:12:08.204870 (+43206290us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:02.522078 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:02.575195 (+ 53117us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:02.575252 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:12:02.575284 (+    32us) tablet.cc:662] Decoding operations
0709 12:12:02.576119 (+   835us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:02.576217 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:02.576248 (+    31us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:12:02.576929 (+   681us) tablet.cc:701] Row locks acquired
0709 12:12:02.576982 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:12:02.577155 (+   173us) write_op.cc:270] Start()
0709 12:12:02.577299 (+   144us) write_op.cc:276] Timestamp: P: 1783599122577088 usec, L: 0
0709 12:12:02.577337 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:12:02.578154 (+   817us) log.cc:844] Serialized 2089 byte log entry
0709 12:12:03.378606 (+800452us) op_driver.cc:464] REPLICATION: finished
0709 12:12:03.511499 (+132893us) write_op.cc:301] APPLY: starting
0709 12:12:03.511647 (+   148us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:03.738105 (+226458us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:03.738263 (+   158us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:03.802706 (+ 64443us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:03.955505 (+152799us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 12:12:03.977871 (+ 22366us) write_op.cc:312] APPLY: finished
0709 12:12:04.063284 (+ 85413us) log.cc:844] Serialized 57 byte log entry
0709 12:12:04.063585 (+   301us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:04.063738 (+   153us) write_op.cc:454] Released schema lock
0709 12:12:04.063827 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:04.064521 (+   694us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:04.064577 (+    56us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":54674,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":82171,"apply.run_cpu_time_us":13383,"apply.run_wall_time_us":584093,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25007,"num_ops":5,"prepare.queue_time_us":676161,"prepare.run_cpu_time_us":34103,"prepare.run_wall_time_us":343486,"raft.queue_time_us":135882,"raft.run_cpu_time_us":9579,"raft.run_wall_time_us":120393,"replication_time_us":764854,"thread_start_us":717352,"threads_started":4,"wal-append.queue_time_us":499677,"wal-append.run_cpu_time_us":18765,"wal-append.run_wall_time_us":2000606}]]}
I20260709 12:12:08.455889 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:08.461723 26542 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:08.383437 32198 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:08.461925 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:08.441187 32256 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:08.471519 31521 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:08.473551 26539 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:08.449834 32400 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:08.482295 32258 raft_consensus.cc:3055] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:08.482882 32258 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:08.483302 32400 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:08.483898 32258 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:08.472525 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:08.417563 32448 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:08.409565 32175 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 12:12:08.410064 32388 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
W20260709 12:12:08.447680 26466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.009s	sys 0.038s
W20260709 12:12:08.491276 26466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.010s	sys 0.038s
I20260709 12:12:08.455386 32437 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:08.487201 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 83071.4us
I20260709 12:12:08.460336 32447 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:08.500545 26439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.015s	sys 0.026s
W20260709 12:12:08.500936 26439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.015s	sys 0.026s
I20260709 12:12:08.447765 32177 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.053s
W20260709 12:12:08.501607 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 585395us
I20260709 12:12:08.501856 26367 catalog_manager.cc:5697] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 8 to 14, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 14 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:08.503377 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:08.498942 26438 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:08.505543 26619 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.006s	sys 0.026s
W20260709 12:12:08.506997 26619 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.007s	sys 0.027s
I20260709 12:12:08.511888 26367 catalog_manager.cc:5697] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 12 to 14, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 14 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:08.516317 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:08.517608 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:08.519170 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:08.525043 26542 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:08.499590 32295 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.012s	sys 0.039s
I20260709 12:12:08.455319 32271 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:08.537768 26367 catalog_manager.cc:5697] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 7 to 16. New cstate: current_term: 16 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:08.521517 31891 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.017s	sys 0.016s
I20260709 12:12:08.545090 26367 catalog_manager.cc:5697] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 11 to 15, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 15 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:08.481761 32323 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
W20260709 12:12:08.517319 32320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.016s	sys 0.017s
I20260709 12:12:08.503762 32230 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:08.533032 32295 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.012s	sys 0.040s
W20260709 12:12:08.574829 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.573186 32388 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:08.579524 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 76249us
I20260709 12:12:08.523574 32272 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:08.536974 32175 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:12:08.550208 31891 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.017s	sys 0.017s
I20260709 12:12:08.608453 26542 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:08.591374 26439 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:08.596490 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:08.584760 32320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.017s	sys 0.017s
I20260709 12:12:08.537734 32457 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:12:08.611119 26615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.008s	sys 0.026s
W20260709 12:12:08.612186 26546 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.017s	sys 0.017s
I20260709 12:12:08.595854 26367 catalog_manager.cc:5697] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 9 to 12, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 12 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:08.616006 26615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.008s	sys 0.026s
I20260709 12:12:08.560770 32409 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:08.602701 32175 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:08.619865 26439 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:08.620239 26546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.018s	sys 0.018s
W20260709 12:12:08.668323 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 48571.5us
I20260709 12:12:08.669485 26439 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:08.620976 26548 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:12:08.621152 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:08.578258 32032 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:08.674717 32396 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:08.675273 32198 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:08.676894 32271 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:08.623883 32388 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:08.624550 32457 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 19 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:08.685523 32457 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:08.632370 32453 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:08.644891 32352 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:12:08.652181 32449 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:12:08.504137 32252 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:08.656983 32258 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:08.661763 32364 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:08.663335 32080 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:08.674546 32409 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:12:08.622763 26436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.018s	sys 0.019s
I20260709 12:12:08.679138 26439 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:08.680845 32299 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:08.720842 26436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.019s	sys 0.019s
I20260709 12:12:08.696791 26545 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:08.703596 26540 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
W20260709 12:12:08.708815 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.542938 32188 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:08.715567 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 273552us
I20260709 12:12:08.607406 32384 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 12:12:08.682991 32175 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:08.727806 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:08.694214 31846 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:08.740089 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 61089us
I20260709 12:12:08.693929 32352 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:08.749179 26439 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:08.749362 26469 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:12:08.743319 26468 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:12:08.744813 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:08.751756 26470 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 19: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:08.745386 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:08.754792 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 293579us
I20260709 12:12:08.756666 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:08.756306 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:08.759053 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 300689us
I20260709 12:12:08.689564 32453 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:08.756306 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:08.759202 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:08.763809 26473 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 17: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:08.766495 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:08.770824 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:08.772753 26439 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:08.747684 32230 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.753669 32428 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.753461 32364 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:08.778640 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:08.782081 32437 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:08.784154 26470 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260709 12:12:08.788348 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.789470 32445 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:08.790165 32445 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:08.793159 32445 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:08.762188 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:08.759574 32382 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:08.799096 32080 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:08.803689 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:08.813311 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.777156 32175 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:08.810828 32445 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:08.778612 32177 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:08.776906 32409 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:08.781478 32198 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:08.830690 26541 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 12:12:08.820068 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:08.859972 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:08.841955 26464 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
W20260709 12:12:08.894208 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 74204.3us
I20260709 12:12:08.812194 32231 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:08.826107 32450 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 12:12:08.901618 32231 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:08.902315 32450 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:08.902786 32450 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:08.902643 32231 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:08.904139 32231 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:08.903796 32450 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:08.905121 32450 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:08.814677 32428 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:08.838635 32300 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 12:12:08.923247 32300 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:08.923698 32300 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:08.924322 32428 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:08.924607 32300 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:08.841629 32364 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:08.843158 32461 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:08.926923 32474 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:08.927634 32474 raft_consensus.cc:697] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 13 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:08.840714 32456 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:08.928380 32456 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:08.928682 32474 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:08.929364 32456 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:08.930755 32456 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:08.934819 32476 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:12:08.832427 32280 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.595s	user 0.011s	sys 0.000s
I20260709 12:12:08.787850 32230 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:08.842521 32080 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:08.838313 31891 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:12:08.907577 32468 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:12:08.858044 32382 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:08.845297 32453 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:08.941879 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:08.926239 32300 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:08.964047 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 68299.4us
W20260709 12:12:08.974834 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:09.027307 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 85575.7us
I20260709 12:12:08.819597 32412 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.132s
W20260709 12:12:09.023164 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 375123us
I20260709 12:12:08.936007 32477 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:09.028653 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:09.032066 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:09.045571 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:09.046638 26615 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:09.012503 32396 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:09.010040 32080 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:08.906643 32475 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.121s
I20260709 12:12:08.819172 32352 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:08.899657 32445 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.012771 31891 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:09.018172 32437 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.058143 26543 raft_consensus.cc:606] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
W20260709 12:12:09.057607 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 284977us
I20260709 12:12:08.926990 32364 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.013270 32299 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.037s
W20260709 12:12:09.120560 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.121989 26439 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:09.081100 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 52541.8us
I20260709 12:12:09.035696 32280 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:09.110193 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:09.127960 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 630377us
W20260709 12:12:09.138190 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.141932 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:09.142520 26439 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:09.146884 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 114884us
I20260709 12:12:09.149416 26514 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:09.106233 27166 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.000s	sys 0.040s
W20260709 12:12:09.153424 27166 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.000s	sys 0.048s
I20260709 12:12:09.154341 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:09.154979 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:09.163026 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:09.166599 31521 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:09.167104 31521 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:09.062641 32080 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:09.088727 32032 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.038338 32198 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 12:12:09.170755 26439 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:09.174800 31521 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:09.127264 32409 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:09.129165 32479 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:09.136844 32280 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:09.148074 32457 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:09.147599 32272 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:09.197355 31521 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:09.169118 31565 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:09.161677 32451 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:09.170146 32254 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.169813 32379 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:09.208635 32280 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:09.174713 32382 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.139380 32437 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.204638 32032 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.233139 32494 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:09.248584 32490 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:12:09.259016 32470 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 12:12:09.205849 32409 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:09.262678 32497 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:09.252182 32452 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:09.263227 32497 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:09.263531 32452 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:09.263701 32497 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:09.259758 32352 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:09.266494 32434 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.903s	user 0.013s	sys 0.001s
I20260709 12:12:09.267071 32434 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.268288 26619 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:09.269467 31846 consensus_meta.cc:287] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.001s
I20260709 12:12:09.258855 32177 consensus_queue.cc:1059] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:12:09.284042 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 73377.8us
W20260709 12:12:09.282192 32436 consensus_meta.cc:287] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.863s	user 0.004s	sys 0.005s
I20260709 12:12:09.352414 26619 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 12:12:09.285410 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:09.372871 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:09.373760 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 224602us
W20260709 12:12:09.378154 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:09.278373 32256 consensus_meta.cc:287] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.787s	user 0.009s	sys 0.000s
I20260709 12:12:09.211951 32272 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.197942 32500 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:09.226621 32299 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:09.407739 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 297638us
W20260709 12:12:09.386636 32356 consensus_meta.cc:287] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.921s	user 0.014s	sys 0.000s
I20260709 12:12:09.269586 32434 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:09.233161 32379 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:09.277040 32501 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:09.416507 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:09.412820 32198 raft_consensus.cc:3055] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:09.339916 32494 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:09.470762 27168 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:57562
W20260709 12:12:09.440383 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.380086 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:09.286082 31846 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:09.446444 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3414) took 1223 ms. Trace:
I20260709 12:12:09.354064 32409 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:09.424800 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:09.463430 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:09.420341 32272 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:09.450657 32447 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.923s	user 0.012s	sys 0.001s
W20260709 12:12:09.470438 26472 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.049s	sys 0.054s
W20260709 12:12:09.474063 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 94094.5us
I20260709 12:12:09.475941 26614 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:09.406181 32436 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.449436 32230 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:09.478737 26615 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:12:09.530797 26615 pending_rounds.cc:85] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 10
I20260709 12:12:09.531275 26615 pending_rounds.cc:107] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:12:09.531596 26615 raft_consensus.cc:2889] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:09.375502 31565 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 12:12:09.436442 32299 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.438009 32475 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.287483 32254 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:09.443950 32032 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:09.486785 26472 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.050s	sys 0.054s
I20260709 12:12:09.476375 26616 raft_consensus.cc:3055] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:09.544232 26616 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:09.487854 32447 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.477200 26617 rpcz_store.cc:276] 0709 12:12:08.223025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.223149 (+   124us) service_pool.cc:224] Handling call
0709 12:12:08.223459 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.280898 (+ 57439us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:08.752679 (+471781us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.372602 (+619923us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:09.372669 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:09.372719 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.446095 (+ 73376us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b5400032854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:09.446168 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.446351 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151416,"prepare.queue_time_us":342218,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":196780,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":26968,"spinlock_wait_cycles":109591424,"thread_start_us":866874,"threads_started":2}
W20260709 12:12:09.501363 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.420377 32256 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.459321 32198 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:12:09.510615 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 296711us
I20260709 12:12:09.571821 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:09.475592 32501 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:12:09.491202 32448 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.983s	user 0.011s	sys 0.003s
I20260709 12:12:09.208937 31891 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.602336 31565 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:09.539247 32379 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:09.603166 31565 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.603899 32379 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:09.604347 32256 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:09.604995 32256 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:09.605674 31565 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:09.605528 32256 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.482971 32489 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.606549 32436 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:09.606766 32489 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.607710 32497 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:09.609797 32489 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:09.610009 32497 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:09.276227 32452 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:09.484503 32188 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:09.451282 32356 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:09.518091 32450 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.613s	user 0.015s	sys 0.001s
I20260709 12:12:09.510645 32477 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:09.626375 32477 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.549751 32364 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:09.555759 32492 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:12:09.631649 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 174583us
I20260709 12:12:09.531704 32445 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:09.632640 32356 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:09.545380 26616 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.633363 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2456) took 2206 ms. Trace:
I20260709 12:12:09.633759 26466 rpcz_store.cc:276] 0709 12:12:07.426777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.761764 (+334987us) service_pool.cc:224] Handling call
0709 12:12:07.762256 (+   492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.493219 (+730963us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:12:08.727222 (+234003us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.093368 (+366146us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:09.134895 (+ 41527us) log.cc:844] Serialized 26 byte log entry
0709 12:12:09.135071 (+   176us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:09.135305 (+   234us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.141232 (+  5927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.141324 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:09.281553 (+140229us) spinlock_profiling.cc:243] Waited 6.85 ms on lock 0x7b180027b7a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fbb2a6 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1
0709 12:12:09.283586 (+  2033us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b180027b7a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:12:09.633115 (+349529us) raft_consensus.cc:1685] finished
0709 12:12:09.633140 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.633295 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9060,"prepare.queue_time_us":367435,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":90,"raft.queue_time_us":14111,"raft.run_cpu_time_us":484,"raft.run_wall_time_us":65636,"spinlock_wait_cycles":29267712,"thread_start_us":1246895,"threads_started":3,"wal-append.queue_time_us":659744}
I20260709 12:12:09.635573 32452 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:09.637514 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3519) took 1281 ms. Trace:
I20260709 12:12:09.638121 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:09.638020 26472 rpcz_store.cc:276] 0709 12:12:08.355902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.356336 (+   434us) service_pool.cc:224] Handling call
0709 12:12:08.384814 (+ 28478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.400779 (+ 15965us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:08.820414 (+419635us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.547438 (+727024us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:09.547496 (+    58us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:09.547543 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.637221 (+ 89678us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b54000a50d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:09.637284 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.637440 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20129,"prepare.queue_time_us":453117,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":7309,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"spinlock_wait_cycles":36208384,"thread_start_us":1123645,"threads_started":2,"wal-append.queue_time_us":736978}
I20260709 12:12:09.640271 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:09.642103 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:09.642825 26466 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:09.643150 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:09.643909 26614 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:12:09.644238 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:09.645434 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:09.646426 32508 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:09.646746 32175 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:09.646998 32508 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.647341 32175 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:09.647576 32508 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.648561 32175 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:09.649745 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.649876 32175 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.633898 26616 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:09.651734 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.652792 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:09.563164 27166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 681) took 1338 ms. Trace:
I20260709 12:12:09.540849 32299 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:09.575268 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 90542.3us
W20260709 12:12:09.576458 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 86870.8us
I20260709 12:12:09.665314 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:09.548972 32456 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:09.580943 32437 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:09.581246 32502 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:12:09.582249 32509 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:09.583714 32513 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:12:09.585984 32488 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:12:09.587008 26465 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:09.680979 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:09.587814 32500 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:09.684372 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:09.591765 26464 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:12:09.567034 32494 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:09.687135 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.597451 26470 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:09.598564 32254 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:09.599077 26468 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
W20260709 12:12:09.599170 32503 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:12:09.599486 26469 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:09.599740 32447 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:09.601908 32507 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:09.450192 32490 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:12:09.547382 32475 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:09.610520 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.489188 32271 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:09.610622 32253 consensus_queue.cc:1175] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aaadfdd9ca9f424c91505f9b43876233" responder_term: 15 status { last_received { term: 15 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 15 index: 10 } }
I20260709 12:12:09.611899 32256 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:09.603219 32501 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:09.594189 32231 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.690s	user 0.012s	sys 0.001s
W20260709 12:12:09.605594 32300 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.000s
I20260709 12:12:09.624758 32448 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:09.676318 32080 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:09.721583 32080 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:09.722317 27160 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:09.700590 32515 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:12:09.654471 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:09.655465 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:09.658670 26543 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:09.667024 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:09.667642 26546 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:09.669863 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:09.670244 27167 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 15 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:09.673206 26587 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:09.676630 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:09.675519 26472 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:09.672829 26513 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:09.682189 26544 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:09.684458 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:09.592794 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:09.728338 26473 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:09.654704 27166 rpcz_store.cc:276] 0709 12:12:08.224508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.225812 (+  1304us) service_pool.cc:224] Handling call
0709 12:12:08.244717 (+ 18905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.245010 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:08.569437 (+324427us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.562660 (+993223us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:09.562741 (+    81us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:09.562807 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.562901 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.563082 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16559,"prepare.queue_time_us":377364,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":20742,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":14248,"thread_start_us":1272845,"threads_started":3,"wal-append.queue_time_us":705128}
W20260709 12:12:09.730851 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 57728.4us
I20260709 12:12:09.689066 26468 pending_rounds.cc:85] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 10
W20260709 12:12:09.689258 26439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.025s	sys 0.042s
I20260709 12:12:09.689975 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:09.697011 32507 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.688495 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:09.693990 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:09.694936 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:09.697391 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:09.700217 26620 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:09.703204 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:09.739916 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:09.703842 26616 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 12:12:09.702502 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:09.740815 26616 pending_rounds.cc:85] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 10
I20260709 12:12:09.709259 32198 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:09.723822 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.744349 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:09.684182 32500 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:09.485684 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3412) took 1267 ms. Trace:
I20260709 12:12:09.724139 27168 raft_consensus.cc:606] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:09.748449 27168 raft_consensus.cc:614] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:09.691579 32513 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 19 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:09.679625 32456 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.732576 26468 pending_rounds.cc:107] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 16.11
W20260709 12:12:09.732642 26439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.025s	sys 0.042s
I20260709 12:12:09.690157 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:09.732846 26613 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:09.733491 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 60728.3us
I20260709 12:12:09.733834 26545 raft_consensus.cc:2376] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16. Re-sending same reply.
I20260709 12:12:09.694433 32188 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:12:09.743993 32300 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:12:09.759100 26547 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:09.772954 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:09.773527 32509 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:09.754009 32500 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.744215 32448 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:09.774163 32509 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.736411 26541 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:09.774857 32500 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:09.750054 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:09.776300 32513 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.740302 26614 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:09.749130 32434 consensus_queue.cc:1059] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:12:09.779325 26614 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:09.779801 32434 raft_consensus.cc:3055] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:09.768379 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3516) took 1417 ms. Trace:
W20260709 12:12:09.780386 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 609676us
I20260709 12:12:09.780803 26471 rpcz_store.cc:276] 0709 12:12:08.350842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.351099 (+   257us) service_pool.cc:224] Handling call
0709 12:12:08.351585 (+   486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.358497 (+  6912us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:08.704456 (+345959us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.080399 (+375943us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:09.081096 (+   697us) log.cc:844] Serialized 26 byte log entry
0709 12:12:09.081290 (+   194us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:09.081341 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.081443 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:09.768096 (+686653us) raft_consensus.cc:1685] finished
0709 12:12:09.768127 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.768296 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32656,"prepare.queue_time_us":495136,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":9084,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":18820,"thread_start_us":649505,"threads_started":2,"wal-append.queue_time_us":659198}
I20260709 12:12:09.751281 26469 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:09.782749 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:09.747825 32337 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:09.783516 26618 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:09.784010 32337 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:09.752948 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:09.786607 26622 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:12:09.784013 32272 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.752377 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:09.738606 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:09.748276 26621 rpcz_store.cc:276] 0709 12:12:08.218569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.218903 (+   334us) service_pool.cc:224] Handling call
0709 12:12:08.219347 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.219647 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:08.703483 (+483836us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.136354 (+432871us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.485277 (+348923us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:09.485338 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:09.485397 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.485489 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.485620 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":407921,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":79,"raft.queue_time_us":196488,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":18145,"thread_start_us":1238623,"threads_started":3,"wal-append.queue_time_us":589357}
I20260709 12:12:09.703238 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:09.742115 26615 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:09.743237 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:09.788897 26468 raft_consensus.cc:2889] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:09.734381 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:09.754135 26465 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:09.746078 26470 raft_consensus.cc:2410] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:12:09.753268 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:09.792121 26464 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 15: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:09.755899 27159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 685) took 1517 ms. Trace:
I20260709 12:12:09.752205 32231 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:12:09.792863 26613 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
W20260709 12:12:09.795658 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48314.8us
I20260709 12:12:09.741130 26616 pending_rounds.cc:107] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 12:12:09.797962 26616 raft_consensus.cc:2889] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:09.774784 32448 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:09.806963 32448 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:09.796865 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:09.800071 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 56918.6us
I20260709 12:12:09.752439 32518 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:12:09.829911 32514 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:09.830503 32231 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:09.831012 32231 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:09.830642 32514 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:09.792620 27159 rpcz_store.cc:276] 0709 12:12:08.239010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.239601 (+   591us) service_pool.cc:224] Handling call
0709 12:12:08.252435 (+ 12834us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.258095 (+  5660us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:08.568853 (+310758us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.030194 (+461341us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:09.184168 (+153974us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b2c00135838. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:12:09.215918 (+ 31750us) log.cc:844] Serialized 26 byte log entry
0709 12:12:09.216086 (+   168us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:09.216119 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.216191 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:09.755599 (+539408us) raft_consensus.cc:1685] finished
0709 12:12:09.755697 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.755837 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1885,"prepare.queue_time_us":364616,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":36,"raft.queue_time_us":2237,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":3577,"spinlock_wait_cycles":9442560,"thread_start_us":731535,"threads_started":2,"wal-append.queue_time_us":887241}
W20260709 12:12:09.832053 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.831974 32231 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.833084 32198 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.833379 32231 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:09.834877 32437 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:09.835301 32437 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:09.836501 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:09.802475 32396 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:09.837051 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:09.802740 32337 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:09.838265 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:09.780253 32434 raft_consensus.cc:740] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:09.839423 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:09.839475 32434 consensus_queue.cc:260] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:09.840340 26621 raft_consensus.cc:2410] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 16 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
I20260709 12:12:09.744867 32507 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.786137 32280 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.841107 32356 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:09.756390 32451 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:12:09.798543 32450 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:09.847059 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:09.848039 26470 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:12:09.849078 32504 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 12:12:09.773170 32300 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:09.849689 32300 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:09.769860 32475 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:09.856179 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:09.869513 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:09.870350 27167 raft_consensus.cc:2393] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 16: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:09.828147 32436 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:09.836202 32437 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:09.842258 32445 consensus_queue.cc:1059] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:09.816521 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:09.848141 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:09.884302 26615 raft_consensus.cc:2410] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:12:09.852350 26620 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 16: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:09.853219 26465 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:09.821062 32521 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 12:12:09.816221 32524 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.054s	user 0.001s	sys 0.003s
I20260709 12:12:09.853701 26614 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:09.850616 32300 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.857474 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:09.855017 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:09.895809 26613 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:09.866681 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:09.825631 26617 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:09.854930 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:09.854189 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:09.878041 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:09.880336 31565 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:09.897507 31565 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.898026 31565 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:09.884461 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:09.887775 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:09.888095 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:09.890360 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:09.900511 26615 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:09.900713 27163 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:12:09.854768 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:09.841121 32434 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:09.901895 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:09.900511 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.908210 26615 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 18: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:09.902984 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:09.880728 32451 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 12:12:09.903975 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:09.907390 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:09.908749 27163 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:09.907714 26514 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:09.913030 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:09.909173 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 45733.4us
I20260709 12:12:09.914060 26613 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 15: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:09.913264 26618 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 15: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:09.914789 26587 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:09.916576 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:09.920169 26465 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:09.921057 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:09.875890 32436 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:09.921542 26439 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:09.921742 26472 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
W20260709 12:12:09.924244 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 70161.6us
I20260709 12:12:09.934911 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:09.935360 26438 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:09.936535 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:09.918517 32504 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:09.941560 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:09.941691 32504 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.918710 32447 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.942703 32458 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:09.943178 32458 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.942869 32447 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:09.943568 32458 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:09.944005 32504 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:09.945127 32447 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:09.945641 32522 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.896976 32188 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:12:09.923623 32271 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:09.946154 32522 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.947278 32489 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:09.947640 32489 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:09.948079 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:09.941896 32092 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:09.941352 32364 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:09.948436 32489 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.949214 32364 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:09.950184 32364 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:09.875231 32490 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:12:09.953454 32400 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:09.912180 32258 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:12:09.955090 32188 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:09.922699 32437 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:09.955931 32258 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:09.956354 32258 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:09.957290 32258 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.961894 32379 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:09.962608 32379 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:09.963243 32092 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:09.963685 32092 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:09.964062 32092 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:09.911423 32475 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:09.966549 32489 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.967190 32445 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:09.967330 32518 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:09.968701 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 47264us
W20260709 12:12:09.968619 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 60770.6us
I20260709 12:12:09.848433 32299 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:09.910979 31846 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.971505 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:09.973053 31565 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:09.980175 32400 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.968165 32518 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:09.971632 26514 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:09.986712 27161 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 12:12:09.987396 27161 pending_rounds.cc:85] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 13
I20260709 12:12:09.987718 27161 pending_rounds.cc:107] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:12:09.988040 27161 raft_consensus.cc:2889] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:09.998857 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 57756.6us
I20260709 12:12:09.923442 32391 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.887315 32416 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 12:12:10.010823 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:09.938045 32436 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.014665 31565 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:10.015504 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.011680 26472 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:09.890990 32256 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 12:12:10.017771 26439 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.020949 26614 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:10.022346 26619 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 12:12:10.024230 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.024367 26614 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:10.032837 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:09.971804 32258 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.064118 27165 raft_consensus.cc:2368] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19.
W20260709 12:12:10.061669 27133 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 2.156s (SENT) [suppressed 12 similar messages]
I20260709 12:12:10.033932 27161 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:12:10.041812 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:10.067942 26543 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 17: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:10.041977 32271 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:10.042353 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.043402 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:10.069489 26539 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:12:10.043787 26547 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:10.070420 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.073035 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.074352 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:10.075119 27161 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:12:10.045470 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:10.046005 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:10.076910 26468 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:10.046377 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:10.077217 26588 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:10.046828 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:10.078351 26470 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 16: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:10.049302 32450 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.079205 32450 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:10.050226 32513 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:10.050773 26439 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.059584 32280 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:10.060635 32080 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:10.083144 32513 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.084195 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.085358 32497 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:10.085565 26439 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.083097 32080 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:10.087638 32080 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:10.088915 32080 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.090612 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:10.092003 32231 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:10.092486 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.093497 32231 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:10.094128 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.095258 32396 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:10.096446 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:10.097602 32396 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:10.100781 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.076999 26469 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:10.010586 32300 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:10.120493 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:10.123219 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:10.106321 26439 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:10.125569 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 77199.9us
I20260709 12:12:10.127235 26472 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
W20260709 12:12:10.108191 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44326.3us
I20260709 12:12:10.064203 32451 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:10.132346 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:10.133540 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.139758 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:10.063385 32379 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:10.102360 32396 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:12:10.129963 32493 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:12:10.106743 32504 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:10.003719 31846 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:10.155160 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:10.164281 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:10.145506 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:10.104074 32447 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:10.161808 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.065550 32495 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.119s
I20260709 12:12:10.136595 32400 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:10.036705 32391 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:10.152194 32509 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:10.143788 31858 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:10.185935 32497 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:10.155529 32517 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:10.128012 32498 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 12:12:10.158731 32396 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:10.166812 32451 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:10.181422 32513 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:10.180549 32494 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:10.180889 32456 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:10.187453 32522 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:10.193547 32272 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:10.201164 32396 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.223409 32299 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:10.227049 32518 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:10.229226 31891 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.232884 32396 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:10.235668 32396 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:10.239605 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.240706 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 107195us
I20260709 12:12:10.244057 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:10.245270 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:10.246353 26467 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 17: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:10.251856 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:10.254976 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:10.256093 26472 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 17: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:10.261646 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:10.262630 26468 raft_consensus.cc:2376] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17. Re-sending same reply.
I20260709 12:12:10.263856 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:10.264797 26468 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 15: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:10.265892 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:10.266798 26467 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:10.276619 26547 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:10.278888 26547 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:10.215452 32517 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:10.199782 31858 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:10.280407 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:10.281149 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:10.281512 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:10.285547 26473 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 15: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:10.282290 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:10.290781 27163 raft_consensus.cc:2410] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:12:10.205293 32450 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:10.297451 26471 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 16: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:10.294661 26439 leader_election.cc:400] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19.
I20260709 12:12:10.298683 26439 leader_election.cc:403] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:12:10.295665 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.295892 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.304641 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:10.305377 27163 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.273566 32396 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:12:10.303845 32522 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:12:10.282451 32448 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:10.339542 32534 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:12:10.347570 32253 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:10.348241 32253 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:10.349416 32253 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:10.350972 32531 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:12:10.351768 32253 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:10.356628 32507 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.000s
W20260709 12:12:10.361217 32526 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.594s	user 0.005s	sys 0.000s
I20260709 12:12:10.366943 26616 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:10.306492 32451 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:10.357080 32458 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:10.385478 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 310202us
I20260709 12:12:10.391690 27163 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
W20260709 12:12:10.400585 32508 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.750s	user 0.009s	sys 0.006s
I20260709 12:12:10.401198 32508 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:10.402526 27164 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:10.368531 32507 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:10.409075 32507 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:10.393006 32391 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:10.413159 32536 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:12:10.365331 32517 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:10.399472 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.422571 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.422477 26467 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:12:10.407037 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:10.423182 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:10.429881 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 356950us
I20260709 12:12:10.430979 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.426994 32539 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:10.434473 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 357326us
W20260709 12:12:10.435801 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.436149 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.437052 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:10.437220 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:10.433967 32271 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:10.438301 32252 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:10.438580 32539 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.438354 32506 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:10.439284 32396 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.439404 32506 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:10.439839 32396 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:10.440305 32506 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:10.441538 32506 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.441973 32396 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:10.442996 31858 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:10.447049 32448 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:10.447481 32458 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:10.448649 32450 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:10.451386 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:10.402796 32532 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 12:12:10.407111 32198 consensus_meta.cc:287] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.574s	user 0.008s	sys 0.007s
I20260709 12:12:10.455422 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:10.456110 26622 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:10.455852 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.457413 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:10.437882 27163 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:10.458144 26543 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:10.458834 32542 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:10.459580 32475 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:10.460007 32475 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.460348 32475 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:10.461937 32504 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:10.464357 32537 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:12:10.459457 26439 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.466878 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:10.468268 26613 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:10.466049 32272 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.475571 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:10.458611 27133 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:10.469343 32396 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.469600 32546 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:10.480908 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.482290 26613 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:10.486718 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:10.486989 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.488595 26613 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:10.488647 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.482017 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:10.465585 32445 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:12:10.471925 32437 consensus_meta.cc:287] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.001s
I20260709 12:12:10.495041 26622 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
I20260709 12:12:10.496935 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:10.498792 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:10.498793 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:10.504127 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:10.506404 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:10.483407 32231 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:10.499727 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:10.501814 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:10.507563 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:10.507833 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:10.484802 32542 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:10.517516 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:10.516042 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:10.523849 26543 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:12:10.519745 26548 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 19: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:10.524505 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:10.524643 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:10.525154 26469 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:10.492591 32448 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:10.455813 32092 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:10.487951 32295 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:10.515338 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:10.529331 26470 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.521955 26466 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:10.477037 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.495667 32508 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:10.494678 32518 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:10.492259 32504 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:10.528236 26540 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:12:10.495255 32198 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:10.510150 26541 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:10.540769 26618 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:10.546985 32514 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:10.548849 32539 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:10.550303 26618 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:10.499835 26588 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:10.509732 32434 consensus_meta.cc:287] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.585s	user 0.012s	sys 0.000s
I20260709 12:12:10.531788 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:10.552142 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 52400.3us
I20260709 12:12:10.552687 26543 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.531994 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:10.553191 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:10.533831 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 56866.5us
I20260709 12:12:10.497749 32546 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:12:10.538648 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 52710.5us
I20260709 12:12:10.569217 26439 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:10.483609 32272 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:10.532917 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:10.493755 32396 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:10.562805 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:10.567021 26546 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:10.570295 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:10.498018 32458 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:12:10.554591 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:10.497013 32445 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:10.574316 26613 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 15: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:10.571595 26545 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 20: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:10.531862 32542 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:12:10.583523 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.539736 32337 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.599519 32396 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:10.592607 32494 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:10.582952 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.601853 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:10.535869 32437 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:10.594023 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:10.571231 32518 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:10.609035 26543 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:12:10.613644 26619 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:12:10.615476 26470 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:12:10.616111 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:10.600477 32489 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.632s	user 0.012s	sys 0.000s
I20260709 12:12:10.583047 32295 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:10.623395 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:10.621646 26613 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:10.620961 26439 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:10.624258 26616 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:10.595927 32508 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:10.604072 32436 consensus_meta.cc:287] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.002s
I20260709 12:12:10.600472 32494 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:10.603679 32080 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:10.643236 32554 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:12:10.585109 32299 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:12:10.618148 32518 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.592375 32400 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:12:10.621979 32092 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:10.644670 32563 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:10.659010 32272 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:10.573793 32546 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:10.668849 26614 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:10.626849 32522 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19.
I20260709 12:12:10.620400 32437 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:10.651371 32494 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.663439 32518 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.646754 32501 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:12:10.688758 32542 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:10.645576 32436 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:10.696038 32436 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:10.697144 26617 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.690779 32337 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:10.676324 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45000.1us
W20260709 12:12:10.676647 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 55803.3us
I20260709 12:12:10.662757 32175 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:10.677651 32080 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:12:10.710023 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 108210us
I20260709 12:12:10.711299 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:10.714551 26439 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:10.666699 32513 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:12:10.675539 32563 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:10.724766 26621 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:12:10.724413 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.728278 26617 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:10.711021 32175 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:10.710294 32295 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 19 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:10.730880 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:10.721695 32364 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:10.721042 32522 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:10.748952 32571 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:10.729460 32080 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:12:10.767223 32562 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:12:10.764756 32542 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:10.771024 32559 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:12:10.775231 27164 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 693) took 1098 ms. Trace:
I20260709 12:12:10.774852 32563 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:10.779379 32295 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:10.782707 32175 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:10.767849 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:10.785434 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 54648.4us
I20260709 12:12:10.787366 32510 raft_consensus.cc:2764] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 12:12:10.768249 32557 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:12:10.806687 27164 rpcz_store.cc:276] 0709 12:12:09.676509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.676631 (+   122us) service_pool.cc:224] Handling call
0709 12:12:09.676975 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:10.403010 (+726035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.774991 (+371981us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b540056bb54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:10.775167 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1668000512}
W20260709 12:12:10.811219 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 43524.9us
I20260709 12:12:10.817296 26587 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:10.817982 26614 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:10.819469 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:10.822511 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:10.823036 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:10.823324 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:10.822726 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:10.790035 32364 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.823253 26541 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:10.825732 26465 raft_consensus.cc:2368] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17.
I20260709 12:12:10.825462 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:10.827315 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:10.830077 26543 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 17: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:10.805133 32445 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:10.804734 32522 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.833886 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:10.834988 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.835853 26471 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:10.836640 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.819681 32436 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:10.789999 32518 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:10.830978 32364 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:10.820991 32571 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:12:10.839365 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.835235 32434 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.825196 32507 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:10.830629 32506 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:10.837309 32448 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:10.807734 32475 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:10.843225 32436 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.834717 32175 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.812376 32542 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:10.833470 32522 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:10.837222 32032 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.923602 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:10.860258 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.854419 27164 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 12:12:10.844964 32504 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:10.825630 32272 consensus_queue.cc:1175] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "01a57027214a411e80874ac7febd628b" responder_term: 15 status { last_received { term: 14 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:10.834079 32458 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:12:10.884228 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:10.940621 26471 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 15: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:10.884572 32475 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:10.885278 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:10.913107 32489 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.887830 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:10.889462 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:10.873014 32436 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:10.867120 32434 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:10.898475 31846 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:10.898880 32510 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:10.868820 32080 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:10.852787 32437 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:10.900736 31891 consensus_meta.cc:287] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.671s	user 0.006s	sys 0.010s
I20260709 12:12:10.901150 32508 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:10.832549 32566 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:12:10.868364 32477 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:10.902891 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:10.927326 27164 pending_rounds.cc:85] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 13
W20260709 12:12:10.928537 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 68406.5us
I20260709 12:12:10.986832 27164 pending_rounds.cc:107] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 12:12:10.987206 27164 raft_consensus.cc:2889] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:10.987381 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:10.989358 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:10.885928 32506 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:10.934769 32507 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:10.978339 26539 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:10.924985 32032 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:10.952739 32490 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:11.001637 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:10.951557 32489 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:10.996042 26543 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:10.964841 32231 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.976300 32458 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.008419 32501 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.009989 32231 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.010233 32458 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.010318 32501 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.010972 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:11.012326 32231 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:11.012553 32458 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:11.012585 32501 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:10.997131 32437 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:12:10.995103 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.003893 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:11.004823 26615 raft_consensus.cc:2410] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:12:11.005280 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:11.018371 26471 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:11.018725 26546 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:12:11.018721 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:10.970327 32510 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.019482 26618 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:11.001363 32504 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:11.018008 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:11.033044 26620 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:12:11.021627 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:11.036093 26616 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:11.022018 26439 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:11.024852 32253 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:11.025535 32506 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.007107 32573 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:12:11.016068 32542 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:11.027961 32518 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:11.030113 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:11.037302 26587 leader_election.cc:400] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17.
I20260709 12:12:11.046732 26587 leader_election.cc:403] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:12:11.046808 27164 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:11.049564 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:11.052023 26439 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:11.054754 26439 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:11.059022 32400 raft_consensus.cc:3055] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:11.059542 32400 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:11.060811 32231 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:11.060508 32400 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.061269 32231 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.061672 32231 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:11.063657 27164 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:11.066259 26588 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:11.032009 32504 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.005733 32490 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.055136 32542 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:11.071796 32518 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:11.074699 32518 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:11.075400 32489 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:11.075603 32032 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:11.078912 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:11.054880 32437 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17.
I20260709 12:12:11.079746 26622 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:12:11.081334 27134 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:11.052412 32458 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:11.099005 26471 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:12:11.100378 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:11.070128 32501 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:11.073421 32504 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:11.101418 32574 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:11.051354 32253 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.102625 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:11.067286 32507 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:12:11.116775 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:11.085726 32510 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:11.095964 32566 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:11.120631 26471 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:11.092633 32458 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.044967 32494 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.118611 26468 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:11.111515 32501 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.120760 32566 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:11.126808 32566 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:11.131426 32364 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.132216 26468 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:11.135208 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:11.119381 32574 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:11.138051 32556 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.507s	user 0.003s	sys 0.001s
I20260709 12:12:11.138895 26465 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:11.123769 32458 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:11.142294 32566 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.145326 32566 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:11.117666 32506 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:11.150710 32506 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:11.152168 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:11.125972 32434 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:11.155609 32564 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:11.156127 32564 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:11.156390 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:11.157011 26622 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:11.157867 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:11.158771 26616 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 16: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:11.152184 32506 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.152403 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 2669) took 1307 ms. Trace:
I20260709 12:12:11.160318 26621 rpcz_store.cc:276] 0709 12:12:09.844863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.846806 (+  1943us) service_pool.cc:224] Handling call
0709 12:12:11.152217 (+1305411us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b5400033254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:11.152341 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1699764608}
I20260709 12:12:11.157015 32564 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.166107 26466 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:11.156585 32231 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.167475 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:11.168568 32434 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:11.169104 32434 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.169544 32434 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:11.171618 32253 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:11.075642 32518 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.138207 32574 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:11.175721 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:12:11.176977 32560 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.534s	user 0.002s	sys 0.000s
I20260709 12:12:11.177155 32574 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:11.177742 32574 raft_consensus.cc:697] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:11.180912 32364 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:11.182565 32498 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.182623 32490 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:11.183413 32490 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.183264 32498 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.183641 32550 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:11.184021 32490 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.185520 32498 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:11.190905 26621 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:11.195565 26622 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:12:11.164836 32501 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:11.199652 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:11.208979 26514 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:11.204855 32258 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:11.182101 32574 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:11.216368 32584 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:12:11.218860 32494 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:11.221397 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:11.222154 26622 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:11.222528 32577 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.209s	user 0.002s	sys 0.000s
I20260709 12:12:11.223760 32231 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:11.227890 32504 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.228487 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:11.229161 26614 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:11.231410 32451 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.235123 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 3453) took 1101 ms. Trace:
I20260709 12:12:11.234855 32436 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.235563 26617 rpcz_store.cc:276] 0709 12:12:10.133366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.163988 (+ 30622us) service_pool.cc:224] Handling call
0709 12:12:11.234978 (+1070990us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b540037ad54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:11.235068 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1223901952}
I20260709 12:12:11.241238 32494 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:11.248227 26617 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 12:12:11.258644 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:11.258917 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:11.186337 32490 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:11.277662 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:11.283859 26622 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:11.283998 26620 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:11.242296 32434 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.203799 32522 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.274973 32569 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:12:11.298457 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:11.265458 32436 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:11.288313 26439 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:11.294272 32588 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:12:11.308314 32396 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:11.286428 26614 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:11.303509 32522 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:11.304072 32494 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:12:11.295151 32458 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.282783 32504 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:11.305270 26470 raft_consensus.cc:2368] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18.
I20260709 12:12:11.306062 32569 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:11.306560 32364 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:11.328866 32364 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:11.329272 32364 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:11.311300 26622 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:11.305562 32175 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.330745 32175 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.333135 32175 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:11.313494 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:11.334250 26614 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:11.337234 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 2487) took 1057 ms. Trace:
I20260709 12:12:11.337766 26539 rpcz_store.cc:276] 0709 12:12:10.281925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.282062 (+   137us) service_pool.cc:224] Handling call
0709 12:12:11.336968 (+1054906us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b54002f7bd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:11.337120 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591764736}
I20260709 12:12:11.330086 32364 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:11.340874 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.341853 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:11.344002 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:11.344301 26472 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:11.346588 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:11.347294 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:11.313567 26439 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:11.316588 32434 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:11.310859 32356 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:11.320349 32501 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.350175 32458 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:11.347671 32416 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.351022 32416 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.351476 26616 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:12:11.351883 26472 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:11.352052 32501 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:11.321689 32451 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:11.323575 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:11.358680 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:11.359035 26469 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:11.359419 26472 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:11.324324 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:11.325142 26620 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:12:11.326596 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:11.326722 32569 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:11.327524 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:11.354120 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:11.355074 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:11.355756 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:11.363179 26618 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:11.364737 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:11.365657 26617 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 17: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:11.356855 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:11.357549 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:11.347036 32541 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.377116 32541 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.361789 32494 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:11.378734 32494 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:11.379520 32541 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:11.379681 32494 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:11.382365 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 215309us
I20260709 12:12:11.358161 32092 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.384487 27134 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:11.384940 32092 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.386729 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:11.387455 32092 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:11.388104 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:11.388835 27168 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:11.390283 27165 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:11.390635 32258 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:11.391445 32258 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.375981 32569 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.392494 32416 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:11.392798 32569 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:11.393513 32231 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:11.384238 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:11.391770 26588 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:11.390702 32550 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.401280 26545 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:11.401170 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:11.388113 26543 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:11.402004 26546 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:11.398380 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:11.373154 26614 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:11.393761 32258 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:11.399562 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:11.410884 26547 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:11.375162 26513 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:11.400624 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:11.374780 26618 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:11.362887 32364 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:11.403203 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:11.386678 32510 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:11.400665 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:11.416342 26464 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:11.352815 32356 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:11.357673 32504 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:11.362341 32175 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:11.402720 26548 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:11.433192 26618 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:12:11.434329 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:11.434314 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:11.413834 26469 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:11.415076 26542 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:11.403919 26541 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:11.417550 26619 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:11.412608 26544 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:11.440205 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:11.427294 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:11.441167 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:11.428712 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53692.8us
I20260709 12:12:11.432655 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:11.437285 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.442122 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:11.442467 26615 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:11.441787 26544 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:11.406143 32188 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.406539 32434 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:11.445758 26618 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:11.439747 26514 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:11.415629 32198 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:11.449249 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:11.416393 32544 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.456411 32544 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.457278 32542 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:11.433084 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:11.459758 26616 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:11.450006 26547 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:11.448279 32434 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:11.454635 32589 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:12:11.468345 26546 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:12:11.423410 32504 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:11.447564 32445 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.412240 32550 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.426819 32513 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:11.457952 32542 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.462581 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:11.435799 32451 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:11.445461 32510 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 15 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:11.436990 32175 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:11.447791 32518 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:11.448127 32541 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:11.477973 26547 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:11.480867 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:11.499990 26542 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:11.508783 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:11.471091 32231 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:11.469918 32489 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:11.480275 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:11.463917 32434 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:11.446462 32092 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:12:11.447276 32567 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:12:11.509375 26547 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:11.502197 32593 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:12:11.525523 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:11.526674 26546 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:11.459923 32188 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.471294 32504 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:11.528502 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47746.8us
I20260709 12:12:11.529770 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:11.531539 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:11.537119 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 56920.1us
I20260709 12:12:11.523854 32231 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.537871 32396 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:11.544001 32564 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:11.523331 32258 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
W20260709 12:12:11.550115 32578 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.536s	user 0.003s	sys 0.000s
I20260709 12:12:11.553431 32566 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:11.510457 32175 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.540323 26547 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:11.558646 32506 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:11.563272 26617 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:11.501713 32498 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:12:11.570168 26546 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:11.498958 32445 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.582345 32445 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:11.568586 32518 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:11.583702 32518 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.562598 32490 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:11.586687 32506 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:11.504805 32517 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 12:12:11.505364 32513 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.576807 32544 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:11.536585 32356 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.559734 32497 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:11.560107 32573 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:11.578845 32542 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:11.579499 32539 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 12:12:11.580283 32498 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:11.590552 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:11.604543 27164 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:12:11.602602 32323 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:12:11.599104 32497 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:11.611214 32497 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.586755 32490 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:11.618741 32490 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.620496 32490 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:11.620889 32188 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:11.622735 32400 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.597045 32506 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:11.627351 32579 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.601s	user 0.001s	sys 0.003s
I20260709 12:12:11.608330 32573 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:11.630662 32539 consensus_queue.cc:1243] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 12:12:11.630961 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.631556 32539 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:11.631848 32299 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:11.632023 32539 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:11.632437 32299 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.632966 32539 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.635185 32508 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:11.639951 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:11.643005 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:11.637235 32299 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:11.646306 27165 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:11.603904 32498 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:11.634316 32539 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:11.630970 32573 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.641247 32508 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.637676 32510 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:11.666350 32513 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:11.668212 32550 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:11.707556 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 234954us
I20260709 12:12:11.711898 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:11.727593 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:11.728929 26618 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:12:11.709861 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:11.737474 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:11.739284 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:11.740062 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:11.741112 27168 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:11.741516 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:11.742661 27161 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:11.743182 26588 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:11.747838 27134 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:11.714160 26546 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:12:11.753732 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:11.755039 26546 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:11.769177 26514 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:11.770911 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:11.772064 26587 leader_election.cc:400] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18.
I20260709 12:12:11.795784 26587 leader_election.cc:403] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:11.776777 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:11.781134 26541 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 12:12:11.800429 32080 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:11.801196 32080 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:11.801766 32080 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:11.650449 32231 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:11.666690 32498 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.834617 32498 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.844008 32272 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.845031 32272 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.848976 32272 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:11.849043 27161 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:12:11.851022 32436 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:11.851235 32092 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.851711 32436 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.851900 32412 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:11.852702 32437 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18.
I20260709 12:12:11.853012 32412 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:11.853869 32437 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:11.854972 32416 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:11.852308 32436 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.859814 32489 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:11.860528 32489 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.861037 32489 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:11.852310 32092 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.850888 32188 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:11.863572 32188 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.865304 32092 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:11.867596 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:11.868067 26471 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:11.864286 32494 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.911687 26543 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:12:11.871702 32412 consensus_queue.cc:1243] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:12:11.865338 32501 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.926945 32188 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:11.943833 32452 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:11.948138 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.948371 32541 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:11.956079 32458 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:11.978359 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 240063us
I20260709 12:12:11.969763 32494 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.980409 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3556) took 1549 ms. Trace:
I20260709 12:12:11.989017 32508 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:11.991087 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.991940 32458 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.970806 32541 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:12.008163 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 3559) took 1123 ms. Trace:
I20260709 12:12:12.018551 26468 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:12.015043 32501 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:12.016062 26467 rpcz_store.cc:276] 0709 12:12:10.430647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.468229 (+ 37582us) service_pool.cc:224] Handling call
0709 12:12:10.468536 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:10.468716 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:11.758551 (+1289835us) spinlock_profiling.cc:243] Waited 6.48 ms on lock 0x7b18004a8c00. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5075c824bc 00007f5072fd048b 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f5079ad23c7 00007f50760e49a7 00007f50760f40bf
0709 12:12:11.758855 (+   304us) log.cc:844] Serialized 14 byte log entry
0709 12:12:11.969869 (+211014us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:11.969988 (+   119us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:11.970195 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.979781 (+  9586us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:11.980158 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25959,"prepare.queue_time_us":101971,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":4328,"raft.queue_time_us":71955,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":226,"spinlock_wait_cycles":14914304,"thread_start_us":270055,"threads_started":2}
I20260709 12:12:12.030184 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:12.035326 32541 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:12.037117 32541 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:12.023729 26465 rpcz_store.cc:276] 0709 12:12:10.884177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.885013 (+   836us) service_pool.cc:224] Handling call
0709 12:12:12.007706 (+1122693us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54003151d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:12.007956 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444154240}
I20260709 12:12:12.043143 32494 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:12.043867 26470 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:12.047269 32501 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:12.048846 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:12.051576 32198 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:12.052485 32198 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:11.997478 32434 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:12.033989 32458 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:12.049165 32575 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 1.102s	user 0.004s	sys 0.001s
W20260709 12:12:12.057878 26544 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.612s	user 0.002s	sys 0.024s
W20260709 12:12:12.058274 26539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.003s	sys 0.010s
W20260709 12:12:12.059311 32364 consensus_meta.cc:287] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.010s
W20260709 12:12:12.061213 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 292664us
I20260709 12:12:12.070537 26544 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:12:12.074307 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:12.075620 26618 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 18: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:12:12.078514 26539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.004s	sys 0.010s
W20260709 12:12:12.083907 32504 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.517s	user 0.012s	sys 0.009s
I20260709 12:12:12.084574 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:12.085547 32497 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.085811 32506 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:12.085863 32272 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:12.087117 32272 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:12.087488 32272 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.087898 32272 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:12.084436 32504 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.091241 32504 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:12.092224 26613 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:12.092682 32175 consensus_meta.cc:287] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.518s	user 0.004s	sys 0.013s
I20260709 12:12:12.093184 32175 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.094766 32198 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:12.095419 32198 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:12.095981 32198 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.087965 32497 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:12.105543 26613 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:12:12.087831 32356 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.132602 26619 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:12.120241 26468 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
W20260709 12:12:12.120965 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.125994 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:12.126329 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:12.127593 26470 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:12:12.087570 32506 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:12.129626 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:12.131258 32434 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:12.131892 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:12.128288 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:12.098320 32198 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:12.099331 26545 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:12.140456 26618 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:12.146092 26545 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:12.154814 32508 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.155220 32175 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:12.155555 32508 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:12.162166 26615 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:12.167188 27168 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:12.157053 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:12.161846 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.156770 26621 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:12.139008 32506 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:12.160337 26545 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:12.161109 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:12.164165 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:12.158761 32495 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:12.191973 32495 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.192034 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:12.192467 32495 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.192900 26615 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:12.180197 27161 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 12:12:12.193969 27161 pending_rounds.cc:85] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 14
I20260709 12:12:12.194271 27161 pending_rounds.cc:107] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 12:12:12.194605 27161 raft_consensus.cc:2889] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:12.186357 32436 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:12.157303 32356 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.197568 32436 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:12.197702 32356 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:12.189272 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:12.189525 26545 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:12.190062 32299 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.203063 32299 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:12.167924 32198 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:12.190550 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:12.206769 26616 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:12.208846 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:12.209784 32541 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:12.190582 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:12.212357 26614 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 15: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:12.191355 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:12.190239 26467 raft_consensus.cc:2368] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23.
I20260709 12:12:12.166633 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:12.164175 32508 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:12.230006 26543 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:12.163991 32080 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:12.234512 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:12.239864 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.206385 32198 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:12.253054 32504 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.253796 32504 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:12.255690 26439 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:12.256335 32504 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:12.256671 32497 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:12.257333 32497 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:12.247249 32364 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:12.258334 32364 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.258618 32497 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.266059 27161 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:12.267935 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:12.268885 26467 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
W20260709 12:12:12.270352 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.271291 26545 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:12.272662 26439 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:12.274840 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:12.277402 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:12.280364 32600 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.281108 32600 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:12.283443 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:12.283989 32032 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:12:12.284307 26548 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:12.284677 32541 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.284575 32458 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:12.285331 32541 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:12.287195 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:12.287854 26547 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.288020 32541 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:12.290195 32364 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:12.291105 32396 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:12:12.292642 26541 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 12:12:12.296308 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:12.270807 32504 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:12:12.297662 32437 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:12.299111 32489 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:12.283458 32600 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:12.301229 32198 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:12.313542 32564 consensus_meta.cc:287] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.769s	user 0.006s	sys 0.011s
I20260709 12:12:12.315275 27165 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:12.288323 32080 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:12.320995 32609 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.068s	user 0.003s	sys 0.000s
W20260709 12:12:12.324311 32610 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:12:12.324496 32272 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.325647 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:12.242290 32175 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:12.327270 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 54668.4us
I20260709 12:12:12.321462 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:12.330257 26547 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:12.339514 26546 raft_consensus.cc:2368] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23.
I20260709 12:12:12.301469 32489 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:12.336638 26544 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:12.262826 32506 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:12.337762 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 64150.3us
I20260709 12:12:12.339823 26548 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:12.347261 26620 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:12.349684 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:12.350878 27161 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:12.351552 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:12.354561 27163 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.354786 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:12.353860 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:12.354451 32457 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:12.357844 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:12.355891 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:12.355479 27165 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
W20260709 12:12:12.361644 32623 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.075s	user 0.000s	sys 0.002s
I20260709 12:12:12.363924 32364 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:12.364588 32364 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:12.365031 32364 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:12.358299 32457 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.366921 32457 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:12.364018 27168 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:12.375269 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:12.376107 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:12.376804 27163 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
W20260709 12:12:12.377552 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 56410.8us
I20260709 12:12:12.379344 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:12.380820 26621 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:12:12.382678 27161 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:12:12.383131 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:12.372341 32299 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:12.350239 32175 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.388504 26467 raft_consensus.cc:2368] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 16. Current term is 17.
I20260709 12:12:12.387529 32504 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:12.389268 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 2711) took 1029 ms. Trace:
I20260709 12:12:12.391244 26587 leader_election.cc:400] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23.
I20260709 12:12:12.391546 26587 leader_election.cc:403] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:12:12.380016 32437 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:12.389753 26613 rpcz_store.cc:276] 0709 12:12:11.356411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.356586 (+   175us) service_pool.cc:224] Handling call
0709 12:12:12.374962 (+1018376us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b5400196254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:12.385619 (+ 10657us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1666971520}
I20260709 12:12:12.390110 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:12.350646 32198 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 12:12:12.395747 32518 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:12.359433 32489 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:12:12.396198 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:12.408341 32458 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.409186 32494 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:12.377377 32451 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:12.409885 32494 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.410531 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:12.411291 26473 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:12:12.412094 26468 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:12.409004 32458 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.412495 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:12.412918 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:12.413246 26469 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:12.414276 26466 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 10. (term mismatch)
I20260709 12:12:12.414279 32458 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:12.414716 32434 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23.
I20260709 12:12:12.414898 26466 pending_rounds.cc:85] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 9
I20260709 12:12:12.415269 26466 pending_rounds.cc:107] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 20.10
I20260709 12:12:12.412384 32494 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:12.415536 26466 raft_consensus.cc:2889] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:12.409919 32451 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:12.417073 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:12.417218 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:12.417989 26470 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:12:12.418226 32494 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:12.418826 32437 raft_consensus.cc:697] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:12.419183 32494 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:12.409446 32400 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:12.420094 32437 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:12.420359 32494 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.410533 32504 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:12.412029 32396 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:12.377103 32573 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:12.386003 32506 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:12.424515 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:12.390269 32490 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.631s	user 0.020s	sys 0.000s
I20260709 12:12:12.428462 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:12.432440 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.384104 32272 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:12.434723 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:12.429675 32396 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:12.450783 27163 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:12.454982 27163 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:12.453675 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:12.421020 32400 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:12.463780 26468 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:12.464996 32489 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:12.465582 32489 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.466060 32489 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:12.468539 32231 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:12.468675 32563 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:12.469337 32231 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.469519 32563 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:12.475344 32622 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:12:12.476016 32231 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:12.477429 32445 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 12:12:12.478482 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:12.479329 26465 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
I20260709 12:12:12.480862 26465 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:12.458312 32434 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:12.484206 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:12.438112 32518 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:12:12.484503 32610 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.079s	user 0.000s	sys 0.002s
I20260709 12:12:12.440243 32356 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:12.494035 27168 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:12.455530 32396 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.488894 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:12.492096 26469 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:12.512712 26588 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:12.513615 32434 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:12.514008 32434 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.514354 32434 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.507288 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:12.525671 27163 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:12.529531 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:12.530033 27163 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:12.533342 32518 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.535159 26548 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 12:12:12.535956 32356 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.537436 32436 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.538050 32436 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:12.539212 26367 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39184 (request call id 162) took 16429 ms (client timeout 15000 ms). Trace:
I20260709 12:12:12.460866 32573 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.540261 32436 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:12.541807 32573 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:12.542809 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:12.543594 27168 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
W20260709 12:12:12.544986 32080 consensus_queue.cc:1175] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aaadfdd9ca9f424c91505f9b43876233" responder_term: 18 status { last_received { term: 18 index: 14 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:12.538669 32504 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:12.417030 32451 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.556805 27163 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
W20260709 12:12:12.560247 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.552788 26588 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:12.561493 27163 pending_rounds.cc:85] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 13
W20260709 12:12:12.562527 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 120521us
I20260709 12:12:12.565274 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:12.569082 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:12.569533 27163 pending_rounds.cc:107] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 12:12:12.573884 27163 raft_consensus.cc:2889] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:12.576050 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:12.580569 26548 raft_consensus.cc:2410] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 12:12:12.597221 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 168854us
I20260709 12:12:12.566689 32436 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:12.568926 32451 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:12.595227 32501 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:12.570649 32231 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.600116 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:12.604209 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2646) took 1185 ms. Trace:
I20260709 12:12:12.554077 32364 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.574330 32356 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:12.601792 26514 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:12.608023 26540 pending_rounds.cc:85] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 12
I20260709 12:12:12.614234 26540 pending_rounds.cc:107] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 12:12:12.614544 26540 raft_consensus.cc:2889] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:12.561952 32497 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:12.612802 32231 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:12.607095 32501 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:12.618656 32632 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:12.602000 32436 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.623168 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:12.623536 32564 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:12.624259 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:12.626745 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:12.627460 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:12.653800 32416 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:12.629352 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:12.539660 26367 rpcz_store.cc:269] 0709 12:11:56.110136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.133503 (+ 23367us) service_pool.cc:224] Handling call
0709 12:11:56.335686 (+202183us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b540007d354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076044090 00007f50760e2f3a 00007f507be98e9c 00007f507bf9704e 00007f507a4582a4 00007f507a458232 00007f507a458161 00007f507a4580dc 00007f507a457392 00007f507441548c 00007f50744148c6
0709 12:12:12.538965 (+16203279us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:09.254757 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:09.255306 (+   549us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:09.255340 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:12:09.255356 (+    16us) tablet.cc:662] Decoding operations
0709 12:12:09.256569 (+  1213us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:09.256628 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:09.256661 (+    33us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:12:09.257701 (+  1040us) tablet.cc:701] Row locks acquired
0709 12:12:09.257718 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:12:09.257892 (+   174us) write_op.cc:270] Start()
0709 12:12:09.258031 (+   139us) write_op.cc:276] Timestamp: P: 1783599129257838 usec, L: 0
0709 12:12:09.258052 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:12:09.381465 (+123413us) log.cc:844] Serialized 5447 byte log entry
0709 12:12:09.722277 (+340812us) op_driver.cc:464] REPLICATION: finished
0709 12:12:10.187612 (+465335us) write_op.cc:301] APPLY: starting
0709 12:12:10.189969 (+  2357us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:10.544526 (+354557us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:10.544641 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:10.781447 (+236806us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:10.784781 (+  3334us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 12:12:10.785684 (+   903us) write_op.cc:312] APPLY: finished
0709 12:12:10.814829 (+ 29145us) log.cc:844] Serialized 121 byte log entry
0709 12:12:10.871642 (+ 56813us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:10.923836 (+ 52194us) write_op.cc:454] Released schema lock
0709 12:12:10.934839 (+ 11003us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:10.953051 (+ 18212us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:10.954482 (+  1431us) write_op.cc:454] Released schema lock
0709 12:12:12.048186 (+1093704us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
Metrics: {"mutex_wait_us":784767,"reported_tablets":26,"spinlock_wait_cycles":71717120,"child_traces":[["op",{"apply.queue_time_us":437185,"apply.run_cpu_time_us":30849,"apply.run_wall_time_us":768010,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58415,"num_ops":13,"prepare.queue_time_us":598272,"prepare.run_cpu_time_us":24690,"prepare.run_wall_time_us":255566,"raft.queue_time_us":97772,"raft.run_cpu_time_us":77650,"raft.run_wall_time_us":682529,"replication_time_us":464015,"spinlock_wait_cycles":5938944,"thread_start_us":1262031,"threads_started":5,"wal-append.queue_time_us":346510,"wal-append.run_cpu_time_us":10973,"wal-append.run_wall_time_us":1056515}]]}
I20260709 12:12:12.632826 32364 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:12.633371 26466 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
W20260709 12:12:12.636612 32578 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:12:12.640995 32495 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.641830 32400 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:12.644044 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 136990us
I20260709 12:12:12.644450 27166 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 15 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:12.645215 32434 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:12.657356 26467 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
W20260709 12:12:12.665925 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.606911 32272 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 12:12:12.605646 26542 rpcz_store.cc:276] 0709 12:12:11.415061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.587988 (+172927us) service_pool.cc:224] Handling call
0709 12:12:11.706075 (+118087us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:11.707417 (+  1342us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:11.708250 (+   833us) log.cc:844] Serialized 14 byte log entry
0709 12:12:11.935904 (+227654us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:11.957443 (+ 21539us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b1800141e80. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:12:12.030588 (+ 73145us) log.cc:844] Serialized 26 byte log entry
0709 12:12:12.030756 (+   168us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:12.031013 (+   257us) log.cc:844] Serialized 14 byte log entry
0709 12:12:12.056291 (+ 25278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.056369 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:12.129202 (+ 72833us) spinlock_profiling.cc:243] Waited 63.5 ms on lock 0x7b4800270258. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507b003aa1 00007f507affab37 00007f507affa9ca 00007f507b0f226f 00007f507b0f1f37 00007f507b10655c 00007f507b106508 00007f507b106488 00007f507b106443 00007f507b1056ec 00007f507a02fa96
0709 12:12:12.323549 (+194347us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:12.484184 (+160635us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b24002b33e8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072e739c4 00007f5072e71acb 00007f507302cdc9 00007f507302ca55 00007f507302c09d 00007f5075c5e10e 00007f5075c7588c 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221
0709 12:12:12.599979 (+115795us) raft_consensus.cc:1685] finished
0709 12:12:12.600002 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:12.600135 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33503,"prepare.queue_time_us":199557,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":3479,"raft.queue_time_us":177886,"raft.run_cpu_time_us":3685,"raft.run_wall_time_us":176400,"spinlock_wait_cycles":186919808,"thread_start_us":211051,"threads_started":1,"wal-append.queue_time_us":530763}
I20260709 12:12:12.654361 32501 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:12.702596 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:12.685580 26514 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:12.677038 32437 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:12.671968 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:12.655671 32436 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.667610 32416 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.713224 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:12.714032 26541 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
I20260709 12:12:12.716943 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:12.717945 26545 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:12:12.652158 32497 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.706328 32175 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:12.733197 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:12.734316 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:12.738795 26618 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:12.715236 32416 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:12.750784 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:12.752640 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:12.679440 32564 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:12.743112 27133 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:12.746996 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:12.728087 32544 raft_consensus.cc:2764] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:12:12.778630 26621 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:12.797420 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:12.774271 26464 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:12.783609 26468 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:12.777944 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:12.764248 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:12.790709 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 190653us
I20260709 12:12:12.730738 32632 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.804422 26620 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 16: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:12.807148 26587 leader_election.cc:400] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23.
I20260709 12:12:12.802286 26614 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:12.774906 32434 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:12.801995 32621 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.276s	user 0.002s	sys 0.000s
I20260709 12:12:12.758924 32600 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:12:12.799616 32570 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:12.820771 26468 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:12:12.815501 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:12.802776 32356 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:12.823274 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.812950 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:12.805939 32032 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:12.829144 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:12.829831 32634 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:12:12.831326 32636 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:12:12.834950 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 62207.3us
I20260709 12:12:12.836469 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:12.839836 32231 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:12.841285 32563 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:12.843321 26614 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:12.844003 32489 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.844588 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:12.845893 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:12.814589 32451 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:12.847289 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:12.851303 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.846797 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:12.804575 32632 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.854449 26614 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 18: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:12.868491 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:12.868551 26464 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:12:12.873454 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:12.874198 26467 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.848310 32497 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:12.880072 26620 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 18: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:12.883162 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:12.877058 32636 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:12.886686 32636 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.856817 32400 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:12.888643 32400 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.889196 32636 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:12.881285 32272 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:12.890241 32272 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:12.890480 32495 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:12.891384 32272 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.894629 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:12.895637 26541 raft_consensus.cc:2410] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:12:12.850229 32614 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:12.898716 26618 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:12.846334 32489 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:12.879806 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:12.857231 32490 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:12.908952 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 177127us
I20260709 12:12:12.852860 32457 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:12.935242 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 219838us
I20260709 12:12:12.928051 32636 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:12.938601 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 62972.7us
I20260709 12:12:12.852144 32434 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.053s
W20260709 12:12:12.948002 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 120182us
I20260709 12:12:12.957829 26467 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:12.961966 26539 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:12:12.905823 32614 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.853663 32356 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:12.968994 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:12.967790 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:12.968955 32636 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:12.973366 26471 raft_consensus.cc:2368] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17.
I20260709 12:12:12.977669 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:12.970072 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:12.969090 32614 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.986583 32639 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:12.987112 32356 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:12.987393 32639 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:12.991257 32633 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 12:12:12.995510 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 48058.7us
I20260709 12:12:12.999181 26541 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 13: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:12:12.980054 32630 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.251s	user 0.001s	sys 0.001s
I20260709 12:12:12.951116 32504 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:13.006765 27133 leader_election.cc:400] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 16. Current term is 17.
I20260709 12:12:12.990159 32639 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:13.004323 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:12.974098 32570 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.009579 27133 leader_election.cc:403] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:12:13.009703 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:12.975252 32364 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:13.017436 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:13.018843 32504 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:13.019817 26621 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:12:13.019858 32570 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:13.022238 32299 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 16. Current term is 17.
I20260709 12:12:13.023130 32299 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:13.023737 32570 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:13.024248 32299 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:13.024663 32299 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:13.025561 32299 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:13.027319 32640 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:12:13.027200 32356 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:13.015239 32364 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.014969 32434 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:13.035091 32434 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:13.039094 27168 raft_consensus.cc:2410] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:12:13.021631 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:13.039753 32497 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:12:13.053272 32544 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:13.053915 32544 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:13.055452 32356 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:13.055970 32356 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.056336 32356 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:13.058616 32631 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 12:12:13.061331 32457 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:12.973703 32494 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:12:13.073217 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:13.075747 26469 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:13.034337 32364 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:13.078500 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:13.042960 32175 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:13.086637 26465 raft_consensus.cc:2376] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19. Re-sending same reply.
I20260709 12:12:13.097581 26539 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:13.097548 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:13.013003 32636 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:13.078148 32564 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:13.098373 26469 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:12:13.110687 26541 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:13.084995 32451 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:13.094822 32573 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.119695 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:13.068545 32416 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:13.123428 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:13.123870 26541 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:13.117852 32299 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:13.124467 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:13.137100 26471 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:13.124614 32510 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:13.139421 32510 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.139799 32510 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:13.125406 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:13.142711 26619 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:13.143646 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:13.144966 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:13.146064 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:13.126848 32451 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:13.128177 32632 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:13.128574 32518 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:12:13.129171 32635 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 12:12:13.108664 32497 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:13.119338 32544 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:13.138128 32629 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.486s	user 0.001s	sys 0.003s
I20260709 12:12:13.138468 32567 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:12:13.207178 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.207873 26545 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:13.138916 32379 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:13.147362 32434 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:13.209023 32379 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:13.211752 32544 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:13.126699 32636 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:13.148180 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:13.218786 26614 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.151216 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:13.220319 26469 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:13.176172 32504 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:13.154621 26465 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:13.133744 32641 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:12:13.156730 32272 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.224257 32272 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:13.163111 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.163866 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.227401 26543 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:13.164387 32451 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:13.228255 32636 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:13.228734 32434 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:13.228822 32636 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:13.229506 32434 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:13.230924 32518 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.231434 32379 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:13.231968 32434 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:13.175494 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.232623 26539 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:13.176259 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:13.233453 27159 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.235296 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:13.239116 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:13.180636 32497 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:13.181133 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:13.239657 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 53315us
I20260709 12:12:13.241106 26439 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:13.241359 32497 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:13.242919 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:13.244259 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:13.182003 27166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 701) took 1548 ms. Trace:
I20260709 12:12:13.244832 26620 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
W20260709 12:12:13.244911 32501 consensus_meta.cc:287] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.000s
I20260709 12:12:13.183001 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:13.245456 32501 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:13.246194 26468 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:13.245052 27166 rpcz_store.cc:276] 0709 12:12:11.633828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.641040 (+  7212us) service_pool.cc:224] Handling call
0709 12:12:11.728371 (+ 87331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:12.694926 (+966555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:13.181729 (+486803us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b540071acd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:13.181921 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2105816960}
I20260709 12:12:13.183288 27164 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:13.184269 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.099393 32080 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 12:12:13.185590 32494 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:13.249284 32614 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:13.189736 32231 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:13.160578 32396 consensus_meta.cc:287] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.607s	user 0.013s	sys 0.000s
I20260709 12:12:13.250686 32231 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:13.251020 32396 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:13.251413 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:13.252213 26543 raft_consensus.cc:2368] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17.
I20260709 12:12:13.253010 32231 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:13.254240 26543 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:13.254613 26470 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:12:13.111070 32175 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:13.149350 32573 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:13.204902 32627 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.526s	user 0.002s	sys 0.000s
I20260709 12:12:13.211880 32032 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:13.213660 26366 catalog_manager.cc:5697] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:13.231554 32518 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:13.239243 32636 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:13.253096 32396 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:13.285102 26615 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:13.153914 26619 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:13.255503 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.179172 32400 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:13.191284 32506 consensus_meta.cc:287] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.741s	user 0.011s	sys 0.001s
I20260709 12:12:13.273943 32437 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 12:12:13.297215 32510 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:13.297520 26366 catalog_manager.cc:5697] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:13.288515 32451 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:13.298882 32451 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:13.299546 26366 catalog_manager.cc:5697] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:12:13.300078 32356 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:13.301129 32451 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:13.301139 26366 catalog_manager.cc:5697] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:13.304278 32501 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:13.307279 32573 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:13.308970 32175 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:13.310612 32541 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:13.310936 32518 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:13.311198 32541 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:13.305507 26366 catalog_manager.cc:5697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 11 to 12, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 12 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:13.311795 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 192162us
I20260709 12:12:13.313431 32541 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:13.313954 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:13.314821 32272 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:13.315012 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.316232 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.317344 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.315269 26366 catalog_manager.cc:5697] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 10 to 11, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 11 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:12:13.324208 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.325798 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:13.325696 26366 catalog_manager.cc:5697] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:13.256913 27159 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:13.259505 26471 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:13.261848 26466 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
W20260709 12:12:13.269034 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.330453 32600 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:13.273418 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.250280 32494 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:13.206180 32436 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:13.271010 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:13.283380 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.270928 26465 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:13.291823 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:13.293592 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:13.326754 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.320490 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.173807 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:13.342828 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 182435us
I20260709 12:12:13.344310 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:13.346078 27133 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:13.347070 32379 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:13.348526 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:13.349417 32379 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:13.335525 32494 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.349834 32379 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:13.350317 32494 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:13.350485 32379 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.316238 32614 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:13.351550 32434 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:13.352162 32434 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:13.353119 32434 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:13.331048 32600 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:13.355962 26587 leader_election.cc:400] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17.
I20260709 12:12:13.356768 32600 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:13.333768 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:13.358106 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.333906 26544 raft_consensus.cc:2368] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19.
I20260709 12:12:13.334344 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.342439 26542 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:13.364924 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.279500 32364 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:13.293171 32564 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:13.356896 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:13.371845 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.372529 26545 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:13.372534 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:13.361588 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:13.376760 26616 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:12:13.376361 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:13.380597 26541 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:12:13.347088 32080 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:13.382104 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.338198 26469 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:13.385483 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:13.388662 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:13.389616 32506 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:13.389899 32504 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:13.390125 32506 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.390486 32504 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:13.391192 32504 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:13.376842 32272 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:13.376986 32445 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:13.392727 32445 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:13.393200 32445 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:13.394960 26464 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 18: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:13.395377 26548 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:13.396916 26542 raft_consensus.cc:2410] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:12:13.391314 27164 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 15: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:13.390690 32506 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:13.389272 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:13.411962 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:13.374168 32600 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:13.417620 26469 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:13.420311 26471 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:13.434815 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:13.445091 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:13.442281 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:13.382779 32356 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:13.447424 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:13.449321 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 155870us
I20260709 12:12:13.455440 26540 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:13.392736 32416 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:13.459026 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.462488 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.468055 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:13.473639 32494 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:13.476452 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:13.476781 32379 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:13.453135 32632 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:13.483570 32436 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:13.490586 26614 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:13.424103 32614 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.500612 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:13.502674 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 318146us
I20260709 12:12:13.451747 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:13.506302 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 140360us
I20260709 12:12:13.452072 32636 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:13.511384 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 55793us
I20260709 12:12:13.511994 32490 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:13.507870 32633 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:12:13.530632 32379 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:13.531157 32639 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:13.532747 26366 catalog_manager.cc:5697] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 7 to 8, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 8 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:13.527442 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 60074.7us
W20260709 12:12:13.543560 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 175439us
I20260709 12:12:13.547183 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:13.547950 27164 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:12:13.548199 27159 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:12:13.541301 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 297495us
W20260709 12:12:13.540757 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 89079.5us
I20260709 12:12:13.571597 26513 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:13.544469 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:13.579265 32652 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:12:13.579762 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:13.570788 32518 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:13.538457 32614 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:13.586697 26542 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:12:13.588014 32614 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:13.590788 32510 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:13.542479 32636 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:13.594481 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:13.595157 32490 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:13.596869 32657 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:13.597663 32490 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:13.613798 26438 leader_election.cc:400] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17.
I20260709 12:12:13.620046 26438 leader_election.cc:403] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:12:13.625043 32659 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17.
I20260709 12:12:13.631104 32659 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:13.643725 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:13.634780 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:13.613198 26540 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
W20260709 12:12:13.653753 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 109373us
I20260709 12:12:13.658833 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:12:13.659106 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 116242us
I20260709 12:12:13.659998 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:13.660341 32416 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:13.661108 32416 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:13.648375 32497 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:12:13.661880 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:13.667711 27163 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:13.594231 32636 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:13.674741 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:13.675665 27163 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:13.644541 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:13.675781 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:13.634994 32434 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.717278 32632 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:13.673581 32490 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:13.715883 32659 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:13.651842 32570 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:13.711483 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:13.823623 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 103140us
I20260709 12:12:13.775498 32518 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:13.669274 32299 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:12:13.815634 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 269763us
I20260709 12:12:13.879364 26439 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:13.891511 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:13.903270 32614 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:13.828974 32632 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:13.859428 32659 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:13.913544 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:13.887786 32494 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:13.935981 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 224556us
I20260709 12:12:13.941604 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:13.942497 27161 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 18: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
W20260709 12:12:13.937067 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 113782us
I20260709 12:12:13.944674 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:13.946239 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:13.948757 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:13.949440 26614 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.951157 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:13.957129 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:13.957894 26619 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:13.909375 32364 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:13.913852 32632 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:13.959416 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:13.875415 32434 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:13.966517 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:13.911880 32567 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:13.900556 32299 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:13.923178 32659 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:14.022112 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 62795.3us
W20260709 12:12:14.022768 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.008945 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:14.024906 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:14.024048 26619 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:13.979468 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:13.980729 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:13.907511 32570 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:14.027489 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48139.2us
I20260709 12:12:14.028506 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:13.972676 26366 catalog_manager.cc:5697] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:14.003327 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:14.027343 26620 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:12:14.024024 26472 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:12:13.970901 32400 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:13.928090 32175 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 12:12:13.980594 32494 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:13.974713 32614 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.030717 26366 catalog_manager.cc:5697] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 8 to 11, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 11 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:14.029762 26616 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:14.122728 32614 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:14.125219 32614 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:13.981341 32437 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:14.045789 26614 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:13.980793 32567 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:14.126813 32567 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:14.129768 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:13.956761 32231 consensus_queue.cc:1059] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 12:12:14.067790 26438 leader_election.cc:400] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19.
I20260709 12:12:14.036154 32198 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:14.033070 32416 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:14.130350 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:14.131982 32416 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.132042 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:14.132509 32416 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:14.130458 27163 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.133103 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:14.073597 26540 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:12:14.134505 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:14.069169 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:14.074688 26541 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:12:14.135437 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 66357.6us
W20260709 12:12:14.136056 32665 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:12:14.136526 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:14.137773 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2534) took 1046 ms. Trace:
I20260709 12:12:14.138589 32680 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:14.139122 32680 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:14.131418 32231 raft_consensus.cc:3055] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:14.140487 32231 raft_consensus.cc:740] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:14.140194 32680 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:14.141484 32231 consensus_queue.cc:260] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:14.131556 26438 leader_election.cc:403] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 12:12:14.143283 32669 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 12:12:14.143471 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 77557.4us
I20260709 12:12:14.131083 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:14.145143 27161 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 18: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:14.033663 32681 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.083282 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:14.022552 32495 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:12:14.061302 32364 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:14.087976 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:14.092715 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:14.093122 32434 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:14.093628 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:14.166980 26548 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:14.094326 32660 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 12:12:14.069581 32490 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:14.105332 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:14.110519 32574 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:14.114804 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:14.145326 32457 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:14.131721 32198 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:14.144596 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:14.131703 27166 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:14.132740 27159 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:14.010142 32541 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:14.225327 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:14.147827 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:14.182188 26472 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 18: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:14.191594 26539 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:14.138129 26470 rpcz_store.cc:276] 0709 12:12:13.091693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:13.267961 (+176268us) service_pool.cc:224] Handling call
0709 12:12:13.285220 (+ 17259us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:13.321908 (+ 36688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:13.321946 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:13.330709 (+  8763us) log.cc:844] Serialized 52 byte log entry
0709 12:12:13.503809 (+173100us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:13.505386 (+  1577us) log.cc:844] Serialized 14 byte log entry
0709 12:12:13.505679 (+   293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:13.506888 (+  1209us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:14.137569 (+630681us) raft_consensus.cc:1685] finished
0709 12:12:14.137593 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:14.137713 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":160,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":47543,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":237,"thread_start_us":172669,"threads_started":1,"wal-append.queue_time_us":581381}
I20260709 12:12:14.237115 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:14.237423 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 323969us
I20260709 12:12:14.239332 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:14.162227 32614 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:14.241907 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 94147.4us
I20260709 12:12:14.243155 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:12:14.208462 32504 consensus_meta.cc:287] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.817s	user 0.013s	sys 0.001s
I20260709 12:12:14.246368 27165 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:14.237898 26544 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:14.182634 32231 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:14.216718 32506 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.774s	user 0.013s	sys 0.001s
W20260709 12:12:14.235410 32445 consensus_meta.cc:287] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.842s	user 0.009s	sys 0.005s
W20260709 12:12:14.285852 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 135716us
I20260709 12:12:14.225457 32198 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:14.289912 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:14.225332 32434 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.288821 27163 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
W20260709 12:12:14.299039 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 154557us
I20260709 12:12:14.300354 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:14.302199 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:14.312139 26548 raft_consensus.cc:2410] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:12:14.236513 32364 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.246580 32400 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:14.249975 32494 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:14.332257 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:14.287353 32639 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:14.339496 26548 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.339416 32639 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.189874 32681 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:14.286424 32356 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:14.311299 32661 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:14.340253 32639 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.353721 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:14.285027 32504 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:14.371397 26539 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:14.308730 32445 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:14.296083 32506 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:14.343262 32656 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:14.377146 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:14.383709 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:14.384517 26539 raft_consensus.cc:2410] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:12:14.311046 32379 consensus_queue.cc:1059] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:12:14.380820 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2741) took 1144 ms. Trace:
I20260709 12:12:14.358450 32661 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.399031 32661 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:14.398702 26622 rpcz_store.cc:276] 0709 12:12:13.229714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:13.253533 (+ 23819us) service_pool.cc:224] Handling call
0709 12:12:13.253878 (+   345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:13.254336 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:13.254368 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:13.254983 (+   615us) log.cc:844] Serialized 52 byte log entry
0709 12:12:13.504164 (+249181us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:13.504212 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:13.504280 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:14.373716 (+869436us) raft_consensus.cc:1685] finished
0709 12:12:14.373748 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:14.373925 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12487,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":16464,"thread_start_us":248795,"threads_started":1,"wal-append.queue_time_us":436318}
I20260709 12:12:14.401535 32676 raft_consensus.cc:3055] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:14.402015 32676 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:14.352337 32494 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:14.402956 32676 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:14.403378 32494 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:14.404428 32676 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:14.312300 32434 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:14.355690 32356 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.393276 26544 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:14.408492 32356 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.409417 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:14.396998 26618 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:14.410734 26544 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:12:14.373481 32451 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.412804 26613 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:12:14.414958 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:14.425055 26548 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:14.348897 32567 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:14.388578 32656 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:14.367108 32364 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:14.394145 32657 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:14.427132 32541 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:14.378201 32490 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:14.467566 32656 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.474436 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:14.475972 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:14.518978 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:14.435753 32451 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:14.517977 32677 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.439s	user 0.008s	sys 0.002s
I20260709 12:12:14.519886 32506 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:14.511458 32681 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:14.513072 32570 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:14.760917 32574 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:14.510978 27159 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:14.509137 32541 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:14.814975 32699 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.333s	user 0.007s	sys 0.000s
I20260709 12:12:14.445890 26548 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 12:12:14.511988 26470 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:14.837340 26548 pending_rounds.cc:85] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 11
I20260709 12:12:14.524562 26539 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:14.837762 26548 pending_rounds.cc:107] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 18.12
W20260709 12:12:14.764724 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 381070us
I20260709 12:12:14.838155 26548 raft_consensus.cc:2889] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:14.838440 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:14.839771 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:14.771625 26467 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:12:14.508401 26468 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:14.818259 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:14.767477 32632 consensus_meta.cc:287] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.759s	user 0.014s	sys 0.000s
I20260709 12:12:14.762324 32272 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:14.762573 26472 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
W20260709 12:12:14.833514 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 396425us
W20260709 12:12:14.853996 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 470003us
I20260709 12:12:14.857122 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:14.858108 26548 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 18: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:14.859102 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:14.861279 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:14.867539 26541 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.003s	sys 0.020s
W20260709 12:12:14.868186 26541 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.003s	sys 0.020s
W20260709 12:12:14.873312 26545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.013s	sys 0.017s
W20260709 12:12:14.875556 26545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.013s	sys 0.017s
I20260709 12:12:14.876318 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:14.851845 32687 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.373s	user 0.000s	sys 0.007s
I20260709 12:12:14.830317 32570 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:14.834017 32506 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:14.880467 26544 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:14.881979 26588 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:14.852643 32272 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:14.888077 32702 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:14.896299 32702 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.896760 32702 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:14.897753 32567 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:14.888540 32661 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:14.895563 32692 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:14.912046 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:14.906229 32692 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.858515 32632 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:14.840492 32574 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:14.919140 32445 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:14.914827 26542 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.017s	sys 0.017s
W20260709 12:12:14.914881 26438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.028s	sys 0.019s
W20260709 12:12:14.971850 26438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.028s	sys 0.020s
I20260709 12:12:14.923569 32504 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:14.899268 32506 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:14.874174 26514 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:14.988919 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 133999us
I20260709 12:12:14.990630 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:14.978869 26540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.005s	sys 0.013s
W20260709 12:12:14.991947 26540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.005s	sys 0.013s
I20260709 12:12:14.974298 32707 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:12:14.981905 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 679780us
W20260709 12:12:14.973320 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.892874 32570 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.001865 32708 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:12:15.002261 32676 consensus_meta.cc:287] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.597s	user 0.020s	sys 0.000s
I20260709 12:12:15.002959 32676 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:15.003140 32570 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:15.003780 32676 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:14.986768 32683 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.004998 32681 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:15.005143 32683 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.005636 32681 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:15.006641 32681 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.007699 32683 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:15.008381 32683 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:15.008435 32506 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:15.008906 32683 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:15.009253 32703 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:12:15.009383 32506 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:15.013458 32639 consensus_meta.cc:287] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.626s	user 0.005s	sys 0.005s
W20260709 12:12:15.015290 32356 consensus_meta.cc:287] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.606s	user 0.007s	sys 0.014s
I20260709 12:12:15.015938 32356 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:15.020701 32416 consensus_meta.cc:287] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.888s	user 0.012s	sys 0.006s
I20260709 12:12:15.021390 32416 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:15.023087 32659 consensus_meta.cc:287] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.992s	user 0.011s	sys 0.004s
I20260709 12:12:15.023720 32659 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:14.993333 32231 consensus_meta.cc:287] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.705s	user 0.015s	sys 0.000s
I20260709 12:12:15.026625 32656 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:15.027489 32198 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.689s	user 0.011s	sys 0.003s
I20260709 12:12:15.027206 32707 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.027971 32198 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.029199 32656 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:14.977551 32032 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.993139 32489 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:14.924888 32692 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.002588 32708 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:14.998625 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:15.004675 32702 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.043116 26466 raft_consensus.cc:2410] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 12:12:14.970306 26542 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.017s	sys 0.017s
I20260709 12:12:15.033973 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:14.942817 32689 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:12:14.994771 32457 consensus_meta.cc:287] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.762s	user 0.014s	sys 0.000s
I20260709 12:12:14.999287 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:14.948952 32700 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:15.072829 27159 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
W20260709 12:12:15.042160 32678 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.077s	user 0.005s	sys 0.000s
W20260709 12:12:15.035624 32685 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.677s	user 0.000s	sys 0.001s
W20260709 12:12:15.071807 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 189887us
I20260709 12:12:15.083568 26546 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 17: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:12:15.069463 32436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.024s	sys 0.024s
I20260709 12:12:15.014129 32639 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.044144 32445 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:15.030248 32198 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:15.030109 32707 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:15.001044 32504 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 12:12:15.032684 32451 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:14.983614 32272 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.031366 32710 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:15.097280 32416 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:15.125357 32718 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:15.038838 32636 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:15.010159 32506 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.032712 32574 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:15.099684 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 99921.4us
I20260709 12:12:15.009398 32683 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.061988 32676 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:15.084022 32457 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19.
W20260709 12:12:15.093377 32436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.025s	sys 0.025s
I20260709 12:12:15.035385 32632 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:15.093266 32700 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.065975 32032 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.092806 32686 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:15.070541 32489 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.120910 32445 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:12:15.084558 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 85361.2us
I20260709 12:12:15.140496 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2526) took 1743 ms. Trace:
I20260709 12:12:15.176440 26514 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:15.160351 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:15.160872 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 65816.9us
I20260709 12:12:15.083717 32689 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.165820 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:15.130429 32356 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:15.131225 32544 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:15.181131 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:15.181252 27159 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:15.176198 26547 rpcz_store.cc:276] 0709 12:12:13.388711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:13.422989 (+ 34278us) service_pool.cc:224] Handling call
0709 12:12:13.450630 (+ 27641us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:13.526814 (+ 76184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:13.526847 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:13.538929 (+ 12082us) log.cc:844] Serialized 26 byte log entry
0709 12:12:13.694733 (+155804us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:13.694775 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:13.694846 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:15.005995 (+1311149us) spinlock_profiling.cc:243] Waited 5.41 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:15.128216 (+122221us) raft_consensus.cc:1685] finished
0709 12:12:15.128253 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:15.131727 (+  3474us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100542,"raft.queue_time_us":76260,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":5733,"spinlock_wait_cycles":12433664,"thread_start_us":26851,"threads_started":1,"wal-append.queue_time_us":263774}
I20260709 12:12:15.181969 32714 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:12:15.168063 32680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.001s	sys 0.018s
I20260709 12:12:15.125913 32710 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.195542 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:15.202734 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:15.169126 32574 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:15.208103 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2682) took 1135 ms. Trace:
I20260709 12:12:15.178165 32686 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.208616 26542 rpcz_store.cc:276] 0709 12:12:14.072923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.073056 (+   133us) service_pool.cc:224] Handling call
0709 12:12:14.083607 (+ 10551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:14.083860 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:15.071925 (+988065us) log.cc:844] Serialized 14 byte log entry
0709 12:12:15.207418 (+135493us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:15.207736 (+   318us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:15.207803 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:15.207874 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:15.208023 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11,"prepare.queue_time_us":750744,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"thread_start_us":1060312,"threads_started":2}
I20260709 12:12:15.178383 32661 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:15.166205 32636 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.167375 32676 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.197248 32718 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:15.197834 32656 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:15.200500 32451 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:15.203878 32680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.001s	sys 0.018s
W20260709 12:12:15.246013 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.212436 32567 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:15.238704 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:12:15.239756 26439 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.67:42217 timed out after 1.604s (SENT) [suppressed 2 similar messages]
I20260709 12:12:15.255970 27166 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 15: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:15.216243 32686 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:15.197149 32714 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.264461 32725 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:15.265134 32725 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.265960 32714 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:15.258520 32724 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.259035 27167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 926) took 1655 ms. Trace:
I20260709 12:12:15.259646 32676 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:15.260025 32712 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:12:15.260461 32728 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:15.292407 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2694) took 1133 ms. Trace:
I20260709 12:12:15.292557 32728 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.293022 26540 rpcz_store.cc:276] 0709 12:12:14.159092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.198640 (+ 39548us) service_pool.cc:224] Handling call
0709 12:12:14.199040 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:14.393483 (+194443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:14.393546 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:14.419699 (+ 26153us) log.cc:844] Serialized 26 byte log entry
0709 12:12:14.992508 (+572809us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:14.992565 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:14.992653 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:15.292044 (+299391us) raft_consensus.cc:1685] finished
0709 12:12:15.292077 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:15.292307 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4601,"raft.queue_time_us":167696,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":16786,"thread_start_us":704891,"threads_started":2,"wal-append.queue_time_us":692396}
I20260709 12:12:15.295812 32728 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:15.260923 32032 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:15.253336 32726 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:15.267653 32725 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:15.268289 32689 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:15.201208 32445 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.269182 32708 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:15.270833 32702 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:15.320513 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:15.271629 32636 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:15.196565 32544 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.272733 32700 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:15.250749 32356 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:12:15.258046 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55071.2us
W20260709 12:12:15.274190 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 366129us
I20260709 12:12:15.277576 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:15.281313 27159 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:15.281268 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:15.240581 32632 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:15.301087 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:15.297029 32451 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:15.302821 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:15.304982 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:15.305820 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:15.409001 26467 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:15.220481 32400 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:12:15.326972 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:15.217274 32574 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.322257 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:15.282213 27167 rpcz_store.cc:276] 0709 12:12:13.545830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:13.546078 (+   248us) service_pool.cc:224] Handling call
0709 12:12:13.546623 (+   545us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:13.847655 (+301032us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:13.847705 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:13.882122 (+ 34417us) log.cc:844] Serialized 26 byte log entry
0709 12:12:14.032703 (+150581us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:14.032819 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:14.032970 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:15.034832 (+1001862us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:15.194108 (+159276us) raft_consensus.cc:1685] finished
0709 12:12:15.194140 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:15.200941 (+  6801us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68251,"raft.queue_time_us":105145,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":23290,"spinlock_wait_cycles":111816064,"thread_start_us":404855,"threads_started":2,"wal-append.queue_time_us":369146}
I20260709 12:12:15.218016 32494 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.083s
I20260709 12:12:15.277050 32570 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.284082 32639 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:15.302022 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:15.408818 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 169087us
I20260709 12:12:15.200587 32701 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.112s
I20260709 12:12:15.269250 32506 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:15.412395 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:15.413642 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:15.423110 26472 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.322049 32445 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:15.430323 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 206486us
W20260709 12:12:15.417397 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 78448us
W20260709 12:12:15.418179 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.419538 26465 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 12:12:15.431861 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:15.433210 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:15.437026 26514 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:12:15.437712 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 101510us
I20260709 12:12:15.419540 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:15.417001 26620 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:15.424350 26616 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:15.322505 32725 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:15.429538 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:15.442230 26464 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:15.440578 26469 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:15.444082 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:15.444933 26469 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
I20260709 12:12:15.403225 32710 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:15.452313 26471 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:15.448779 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:15.453276 26468 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:12:15.456156 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:15.460644 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:15.441841 32676 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:15.297698 32724 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.464275 26616 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 18: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:15.467492 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:15.467659 32705 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:15.469323 26467 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:15.470291 32698 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:15.471248 32732 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:12:15.485792 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:15.487229 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:15.487685 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2695) took 1328 ms. Trace:
I20260709 12:12:15.488444 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:15.489207 26616 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 17: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:15.480796 27165 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:15.488090 26545 rpcz_store.cc:276] 0709 12:12:14.159417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.198412 (+ 38995us) service_pool.cc:224] Handling call
0709 12:12:14.230887 (+ 32475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:14.876016 (+645129us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:14.902838 (+ 26822us) log.cc:844] Serialized 14 byte log entry
0709 12:12:15.127780 (+224942us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:15.130761 (+  2981us) log.cc:844] Serialized 26 byte log entry
0709 12:12:15.130968 (+   207us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:15.131021 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:15.131397 (+   376us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:15.487475 (+356078us) raft_consensus.cc:1685] finished
0709 12:12:15.487497 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:15.487625 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":102129,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":158918,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":2170,"spinlock_wait_cycles":11645824,"thread_start_us":824552,"threads_started":2,"wal-append.queue_time_us":312705}
I20260709 12:12:15.490378 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:15.413825 32356 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.478295 26617 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:15.492077 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:15.492620 26617 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:15.493477 32451 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.310570 32726 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.494771 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:15.495589 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:15.499986 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:15.495658 32574 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:15.418349 32632 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.455997 32661 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:15.496488 32639 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:15.456261 32436 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
W20260709 12:12:15.499984 32735 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:12:15.463843 32416 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:15.453004 32506 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:12:15.506881 27167 raft_consensus.cc:2368] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18.
I20260709 12:12:15.507849 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 2550) took 1029 ms. Trace:
I20260709 12:12:15.509104 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:15.532534 26469 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:15.493237 32356 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:15.533633 26616 raft_consensus.cc:2410] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:12:15.534214 32692 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.534911 32726 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:15.507153 32698 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.536731 32692 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:15.537655 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:15.538353 26471 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:15.538690 26473 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:12:15.531627 26466 rpcz_store.cc:276] 0709 12:12:14.478981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.479140 (+   159us) service_pool.cc:224] Handling call
0709 12:12:15.497021 (+1017881us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54001c0f54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:15.507773 (+ 10752us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":614621056}
I20260709 12:12:15.502113 32080 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:15.540275 32080 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.463621 32689 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:12:15.549527 32639 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.551083 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:15.553251 32639 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:15.554694 32356 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:15.555269 32356 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:15.555785 32356 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:15.553601 32718 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:15.563005 32718 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:15.563481 32718 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:15.515455 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:15.501269 32299 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:15.448025 32725 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.477547 32724 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:15.435621 32570 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.573778 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:15.577783 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:15.578840 26617 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:15.547914 32632 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:15.587188 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:15.588145 27159 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.588385 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:15.589800 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:15.591622 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:15.592991 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 70785.2us
I20260709 12:12:15.593039 32720 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.594090 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:15.595744 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:15.596575 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:15.591647 26588 leader_election.cc:400] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18.
I20260709 12:12:15.597671 26588 leader_election.cc:403] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:15.603246 32400 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:15.604004 32400 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:15.605007 32682 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:15.596254 32574 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:15.605111 32725 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:15.611833 27159 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:15.584719 26464 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
I20260709 12:12:15.606560 32692 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18.
I20260709 12:12:15.618187 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:15.619498 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:15.589897 32567 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:15.620239 27167 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
W20260709 12:12:15.622874 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.610052 32698 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:15.623159 32506 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:15.623867 32506 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:15.624694 32682 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:15.624774 32506 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.625757 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:15.627053 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:15.628628 32743 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:15.629092 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:15.630251 32745 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:15.630707 32745 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:15.630779 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:15.631680 32745 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.632661 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:15.633296 32745 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.634902 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:15.635893 26617 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:15.636559 32725 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:15.637161 32725 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.647320 32725 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:15.605197 32400 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.650610 32567 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:15.651772 32567 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.653250 32715 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:15.651810 32364 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:15.653878 32715 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:15.642642 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:15.606994 32705 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:15.638814 32080 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:15.612511 32656 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:15.663280 32656 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:15.664400 32656 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.665957 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:15.606787 32720 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.667248 32175 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:15.668488 32698 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.668352 32720 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:15.668689 32175 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:15.669135 32698 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.564666 32718 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.670661 32175 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:15.672008 32689 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:15.638731 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:15.685099 26620 raft_consensus.cc:2410] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 18 because replica has last-logged OpId of term: 17 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 12:12:15.638294 32570 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:15.693204 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3520) took 1370 ms. Trace:
I20260709 12:12:15.699779 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:15.693758 26618 rpcz_store.cc:276] 0709 12:12:14.323270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.323528 (+   258us) service_pool.cc:224] Handling call
0709 12:12:14.323843 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:14.410470 (+ 86627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:15.692912 (+1282442us) spinlock_profiling.cc:243] Waited 72.8 ms on lock 0x7b5400032854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:15.693124 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167506176}
I20260709 12:12:15.709336 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:15.711161 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:15.715437 27134 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:15.720593 26620 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 12:12:15.718236 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 255312us
I20260709 12:12:15.727538 26472 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:15.737751 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:15.681941 32457 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:15.741469 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:15.745414 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:15.746181 26543 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:15.746727 32032 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:15.705910 32705 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:15.751693 26514 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:15.713505 32541 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:15.720271 32416 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:15.759112 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:15.760795 26620 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:12:15.738778 32080 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:15.759073 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 152413us
I20260709 12:12:15.708102 32720 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:12:15.749938 32032 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.704829 32686 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.763353 32416 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.750689 32457 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.836210 26541 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:12:15.813294 32032 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:15.814913 32400 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:15.846743 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:15.863991 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 105968us
I20260709 12:12:15.866178 32739 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.847877 32698 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:15.866832 32739 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.772344 32541 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.826810 32416 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:15.879719 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 149859us
I20260709 12:12:15.758486 32715 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:15.888335 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:15.846517 32700 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:12:15.927783 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:15.929795 27167 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:12:15.927294 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:15.928472 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:15.936595 27166 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 17: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:15.862895 32400 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:15.941175 32755 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:12:15.943054 32752 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:12:15.885365 32705 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:15.927490 32724 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:15.950143 32457 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:15.956339 32541 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:15.893347 32739 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:15.961125 26613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 3524) took 1607 ms (client timeout 1802 ms). Trace:
I20260709 12:12:15.961449 32686 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:15.962248 32715 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:15.942150 32757 log.cc:927] Time spent T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:12:15.986152 26540 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
W20260709 12:12:15.990442 26613 rpcz_store.cc:269] 0709 12:12:14.353243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.353442 (+   199us) service_pool.cc:224] Handling call
0709 12:12:15.960792 (+1607350us) spinlock_profiling.cc:243] Waited 53.3 ms on lock 0x7b5400346a54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:15.960967 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122558208}
I20260709 12:12:15.985071   302 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:15.988467 32632 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:16.036023 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 188093us
W20260709 12:12:16.042961 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 293785us
I20260709 12:12:16.045542 26613 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:16.056102 26613 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:16.025395 32689 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:16.066533 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.069386 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.070128 26540 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:12:16.070700 32400 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:16.057951 32632 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.073271 32632 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:16.070365 32541 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:12:16.074560 32541 raft_consensus.cc:3055] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:16.075081 32541 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:16.076174 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.076081 32541 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.077256 26543 raft_consensus.cc:2410] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 12:12:16.077814 32541 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:16.081739 32489 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:16.090170 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:16.091862 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:16.092265 32682 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:16.092821 32682 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:16.094574 32457 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:16.095109 32457 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:16.095633 32457 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:16.096385 32656 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:16.097995 32656 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:16.093833 32682 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.098996 32656 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.052783 32700 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:16.099906 32682 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:16.100555 32700 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.089214 26614 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:16.001154 32724 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:16.105034 32724 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:16.070158 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:16.113814 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:15.985721 32356 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:16.111164 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:16.118062 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 48026.5us
I20260709 12:12:16.119853 26513 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:16.142987 26464 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:16.143682 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.150267 26542 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:12:16.152206 26472 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:16.155958 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.158308 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.159663 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.160259 26464 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:16.129365 32400 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:16.161774 32400 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.130579 32686 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.162206 32400 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:16.162456 32686 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:16.165042 32686 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:16.166369 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:16.129396 32495 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:16.158181 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.177184 26544 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:16.130088 32745 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:16.179577 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.185892 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:16.133401 32489 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:16.201444 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:16.201436 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.202131 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.203392 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:16.168608 32495 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:16.208015 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.210311 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.214874 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:16.212879 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:16.219841 26471 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:16.195442 32489 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:16.226346 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.197964 32700 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:16.227116 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:16.228936 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.229171 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:16.178435 32567 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:12:16.233553 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:16.234622 26471 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:16.197364 32032 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:16.253551 26471 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:12:16.231326 32489 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:16.258306 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.258685 32356 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:16.259582 26467 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 18: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:16.269445 32272 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.276971 32659 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:16.281765 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:16.287140 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 957) took 1101 ms. Trace:
I20260709 12:12:16.287806 26622 rpcz_store.cc:276] 0709 12:12:15.185584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:15.193222 (+  7638us) service_pool.cc:224] Handling call
0709 12:12:15.211309 (+ 18087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:15.274146 (+ 62837us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:15.274180 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:15.274234 (+    54us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:15.274276 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:16.278380 (+1004104us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b5400269154. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:16.286807 (+  8427us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:16.287052 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143975808}
I20260709 12:12:16.293990 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:16.295135 26540 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 13: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:16.296352 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:16.239766 32700 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:16.311193 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.314034 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.315740 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:16.318292 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:16.328676 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.255533 32434 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:16.328851 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:16.336619 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:16.322062 32683 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.155s	user 0.015s	sys 0.000s
I20260709 12:12:16.340059 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:16.342208 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.338867 26542 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 17: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:16.309384 32700 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:16.355482 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.358048 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.364398 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:16.371397 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.376518 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.217510 32767 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.143s
I20260709 12:12:16.354347 32700 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:16.386230 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.387997 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.394948 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:16.395665 26539 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:16.349938 32683 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:16.399811 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.398614 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:16.403743 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 250100us
I20260709 12:12:16.406078 32495 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:16.415524 32457 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.420123 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.420773 26466 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:16.421561 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.422348 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.423126 26464 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:16.424615 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.425522 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:16.425555 26540 raft_consensus.cc:2368] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16.
I20260709 12:12:16.420398 32683 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:16.427924 26468 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 15: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:16.428412 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:16.430457 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.432574 26547 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 18: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:12:16.432598 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 219818us
W20260709 12:12:16.448217 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 180908us
I20260709 12:12:16.449576 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.449853 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:16.452112 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.452116 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.453258 26468 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 23: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:16.457119 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.458345 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.458643 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:16.458902 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.459602 26468 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:12:16.459277 27165 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:16.418375 32457 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:16.459769 26541 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:16.461310 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:16.466773 26539 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:12:16.470345 26468 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 12:12:16.428996 32434 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 12:12:16.432130 32739 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:16.473794 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:16.474785 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.478039 26464 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:16.475821 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:16.478659 27165 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:16.479136 26468 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:16.449595 32724 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:16.451779 32754 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:12:16.478060 32416 consensus_meta.cc:287] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.001s
I20260709 12:12:16.480161 32198 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:12:16.489743   315 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:12:16.508193 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.466213 32695 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:12:16.499650 32032 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:16.519189 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:16.522825 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.523857 26539 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:12:16.483577 32697 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:12:16.526774 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.512262 32198 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:16.491778 32724 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:16.495229 32754 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:16.504026 32416 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.541201 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.504406 32739 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:12:16.546573 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.529911 32723 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:16.550736 32723 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.551334 32723 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:16.554963   317 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 12:12:16.555363   309 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 12:12:16.556641   314 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:12:16.561899 32272 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:16.542162 32434 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:12:16.563452 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 73852.9us
W20260709 12:12:16.569690 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.574765 26547 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:12:16.577766 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:16.551364   318 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:12:16.582041 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.572335 32379 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.587484 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.591786 32379 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:16.593606 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.585152 32434 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:16.595816 32379 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:16.582046 32198 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.599347 32754 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:16.602466 32416 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:16.602466 32451 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:16.603194 32451 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:16.604133 32451 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.605180 32451 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:16.606619 32701 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:16.607023 32701 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:16.607831 32701 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.609052 32701 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:16.583823 32457 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
W20260709 12:12:16.601100 32715 consensus_meta.cc:287] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.000s
I20260709 12:12:16.612588 26543 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:12:16.613360   330 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.613950   330 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.616374   330 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:16.617383 32639 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:16.618762 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.620158 32639 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:16.617185 32739 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:16.621191 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.608767 32400 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.624007 32400 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:16.623744 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.624933 32639 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:16.625734 32739 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:16.625818 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.627532 32739 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:16.628402 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.629631 32739 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:16.630446 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.633824 32639 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:16.634078 32739 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:16.634552 32639 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:16.636178 32544 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:16.635977 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.636782 26468 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:16.637185 32739 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:16.637392 32639 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:16.642988 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:16.643390 27166 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:16.643828 27163 raft_consensus.cc:2393] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 14: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
W20260709 12:12:16.646137 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 57450.7us
I20260709 12:12:16.589778 32272 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:16.646992 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 955) took 1468 ms. Trace:
I20260709 12:12:16.647392 32504 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.648077 32504 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.648875 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:16.649513 26619 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:16.649883 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:16.650830 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:16.651329 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:16.651901 26615 raft_consensus.cc:2376] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18. Re-sending same reply.
I20260709 12:12:16.647563 26621 rpcz_store.cc:276] 0709 12:12:15.179053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:15.179226 (+   173us) service_pool.cc:224] Handling call
0709 12:12:15.179550 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:15.239794 (+ 60244us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:12:15.412383 (+172589us) log.cc:844] Serialized 14 byte log entry
0709 12:12:15.617941 (+205558us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:15.618002 (+    61us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:15.618067 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:16.646745 (+1028678us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b540037a854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:16.646792 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:16.646931 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53,"prepare.queue_time_us":223848,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":222,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"spinlock_wait_cycles":142674432,"thread_start_us":359638,"threads_started":2,"wal-append.queue_time_us":337888}
I20260709 12:12:16.649906 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:16.656026 26622 raft_consensus.cc:2410] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 18 because replica has last-logged OpId of term: 17 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 12:12:16.656394 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:16.658033 32504 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:16.658254 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:16.659174 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:16.659859 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:16.660535 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:16.661391 32510 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:16.661518 26546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 937) took 1879 ms (client timeout 1607 ms). Trace:
I20260709 12:12:16.661839 32510 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:16.662091 32754 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:16.662050 26546 rpcz_store.cc:269] 0709 12:12:14.782562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.793901 (+ 11339us) service_pool.cc:224] Handling call
0709 12:12:16.661288 (+1867387us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b540018b5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:16.661391 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":539795712}
I20260709 12:12:16.668473 27165 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:16.579748 32700 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.662453 32510 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:16.665105 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:16.671641 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:16.672190 32636 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.667179 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:16.672729 32636 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.671913 26615 raft_consensus.cc:2393] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 14: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:16.673360 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:16.674890 26545 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:16.690841 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.671639 32670 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:16.681591 32753 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.861s	user 0.002s	sys 0.000s
W20260709 12:12:16.682447   316 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.176s	user 0.003s	sys 0.000s
I20260709 12:12:16.675891 32700 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:16.683432 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:16.661806 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.685012 26619 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:16.704404 26588 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.688055 26621 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:12:16.688900 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:16.705443 27159 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:12:16.647084 32272 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.712509 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.690683 26614 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 18: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:16.690579 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:16.714013 26588 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.697917 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:12:16.714475 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52744us
I20260709 12:12:16.717244 32379 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:16.717152   329 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:16.718582 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:16.719198 26614 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:16.719509 32272 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.699405 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.682267 32489 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.702308 27166 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:16.704775 26613 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:16.705790 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:16.705791 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:16.706966 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.708191 27168 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:16.703431 32175 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:16.709115 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:16.737198 26620 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:12:16.738174 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:16.738747 26620 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:16.702047 32670 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.693948 32636 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:16.745378 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:16.710156 32724 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:16.746532 32636 raft_consensus.cc:2764] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:12:16.711051 32731 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:16.711483 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:16.693194 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:16.731887 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:16.716739 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:16.733021 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.746951 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.749897 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:16.750600 26539 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:16.750566 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.752991 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:16.734845 27134 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.741921 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:16.743463 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:16.754431   307 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:16.755324 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:16.757933 32636 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:16.758647 32494 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:16.758973 32724 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:16.740865   329 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:16.761163 26621 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:16.747658 32731 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:16.763031 32731 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:16.763834 32489 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:16.759294 32494 raft_consensus.cc:697] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:16.764994 32494 consensus_queue.cc:237] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.766191   324 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:16.766654   324 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:16.766968 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:16.767921 26615 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:16.753199 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:16.744445 26614 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:12:16.770924 26614 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:12:16.771643 26439 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.772395 26614 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:12:16.754448 26587 leader_election.cc:400] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16.
I20260709 12:12:16.773852 26587 leader_election.cc:403] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:12:16.775853 26439 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:16.777415 26614 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:16.777117 32400 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:16.780834 32457 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:16.781296 32457 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.781188 32726 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:16.781765 32457 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:16.782222 32726 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:16.782717 32726 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:16.783658 32726 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.784925 32726 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:16.780843   305 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:16.786983   305 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.787355   305 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:16.748656 32639 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:16.751157 32718 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:16.794697 32670 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:16.741192 32659 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:16.796120 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:16.723948 32739 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 12:12:16.796761 26547 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:16.797672 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 316532us
I20260709 12:12:16.797818 32686 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:16.798379 32686 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:16.798612 32510 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:16.800632 32686 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:16.800820 32510 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:16.801577 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:16.802136 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.802644   321 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:16.803197   321 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:16.805284   321 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:16.805403 26546 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:16.806710 27165 raft_consensus.cc:2393] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 18: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:16.807215 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:16.808008 26619 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:16.811326 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.801446 32541 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.813624 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.813568 32541 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:16.814247 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:16.814955 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:16.815836 32541 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:16.817888 32379 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:16.819372 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:16.820106 26546 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:16.820220 26465 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 16: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:12:16.821134   323 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.305s	user 0.000s	sys 0.002s
W20260709 12:12:16.822732 26473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 3614) took 1542 ms (client timeout 1802 ms). Trace:
W20260709 12:12:16.823143 26473 rpcz_store.cc:269] 0709 12:12:15.280816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:15.280962 (+   146us) service_pool.cc:224] Handling call
0709 12:12:16.822573 (+1541611us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54000dcad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:16.822674 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":459047168}
I20260709 12:12:16.823848 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:12:16.824862 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 44821.9us
I20260709 12:12:16.822285 32379 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:16.827208 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 3526) took 1368 ms. Trace:
I20260709 12:12:16.827601 26616 rpcz_store.cc:276] 0709 12:12:15.458329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:15.494513 (+ 36184us) service_pool.cc:224] Handling call
0709 12:12:16.826963 (+1332450us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b5400194954. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:16.827131 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63342848}
I20260709 12:12:16.830950 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.779664 26439 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:16.832993 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 53445.5us
I20260709 12:12:16.834056 26468 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:16.835659 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 100947us
I20260709 12:12:16.837523 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.837850 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 942) took 2053 ms. Trace:
I20260709 12:12:16.830744 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.839108 26546 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:12:16.840294 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.838224 26548 rpcz_store.cc:276] 0709 12:12:14.784167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.870092 (+ 85925us) service_pool.cc:224] Handling call
0709 12:12:14.870532 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:14.870793 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:14.870828 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:16.290246 (+1419418us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b2c0005b0f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:12:16.290848 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 12:12:16.426504 (+135656us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:16.464587 (+ 38083us) log.cc:844] Serialized 14 byte log entry
0709 12:12:16.790114 (+325527us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b18004568e0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5072fefa40 00007f5072fea4e4 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287 00007f50760f5208
0709 12:12:16.790343 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:16.790456 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:16.820506 (+ 30050us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:16.837625 (+ 17119us) raft_consensus.cc:1685] finished
0709 12:12:16.837649 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:16.837789 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1438,"prepare.queue_time_us":39062,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":3822,"raft.queue_time_us":327441,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"spinlock_wait_cycles":16150016,"thread_start_us":112996,"threads_started":1,"wal-append.queue_time_us":164076}
I20260709 12:12:16.843534 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.844085 26620 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:16.841205 26546 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:12:16.846539 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.848734 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.849771 26546 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:16.850966 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.839860 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.854609 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.855713 26472 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:16.856212 26472 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:16.751941 32272 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:16.855552 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:16.858054 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.845431 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:16.844874 26548 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 16: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:16.863227 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:16.864005 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 111067us
I20260709 12:12:16.865507 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:16.872571 26547 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:12:16.874727 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:16.874571 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.876058 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.878180 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:16.881047 26466 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 16: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:16.885175 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:16.842728 32574 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:16.891670 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:16.846215 32632 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:16.846581 32724 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:16.901494 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:16.846446 32754 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:16.874454 27133 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:16.889605 26472 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:16.904835 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:16.905458 26472 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:16.900903 26616 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:12:16.847261 32636 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16.
I20260709 12:12:16.902638 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:16.881731 32715 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:16.846720 32489 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:12:16.845726 32659 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:12:16.854493 32400 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 12:12:16.940707 26472 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
W20260709 12:12:16.941642 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.903263 32743 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:16.956256 26472 pending_rounds.cc:85] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 12
I20260709 12:12:16.956691 26472 pending_rounds.cc:107] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:12:16.956951 26472 raft_consensus.cc:2889] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:16.910912 32574 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:16.954802 32715 raft_consensus.cc:697] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:16.890717 32731 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:16.914865 32632 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:16.958139   329 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:16.924948 32434 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:16.967648   302 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:12:16.969235 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 132055us
I20260709 12:12:16.972134 32747 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:16.975190 32715 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:16.976296 26514 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:17.001617 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:17.008315 26514 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:17.010068 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:16.979442 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 105078us
I20260709 12:12:16.954916   341 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:16.907975 32175 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:12:16.913311 32726 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 21.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:12:16.906579 26619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:12:17.018066 26619 raft_consensus.cc:606] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:12:16.959013 32743 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:17.018126 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:17.015920 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:17.018224 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:16.991812 32760 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:16.994127 32434 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.958019 32723 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:17.027091 26514 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:16.957723 32656 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 12:12:17.024605 32490 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:17.019946 32705 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:17.047964 26514 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:17.016877   341 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:17.022974 32743 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:17.063818 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:17.035895 32489 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:17.106235 26471 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:12:17.043028 32434 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:17.111263 26615 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:17.109579 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 45878.7us
I20260709 12:12:17.015645   305 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:17.136592 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 136801us
I20260709 12:12:17.108937 32614 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:17.135731 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:17.058167   302 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:17.065573   341 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:17.114830 32681 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:17.158510 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:17.159188 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 145502us
I20260709 12:12:17.162227 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:17.165158 27133 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:17.167376 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:17.144459 32709 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:17.170624 32733 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 1.855s	user 0.008s	sys 0.008s
I20260709 12:12:17.172178 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:17.175740 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:17.177209 27133 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:17.180512 32731 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:17.166946 32747 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:17.169801 32489 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:12:17.192579   337 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.149s	user 0.003s	sys 0.000s
I20260709 12:12:17.135250 32632 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:17.187134 32689 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.175194 32614 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:17.170825 32681 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:17.065526 32574 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:17.181916 32745 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:17.181938   350 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:17.188442 32696 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:17.187175 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:17.245450 32490 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:17.246137 32490 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:17.246304   305 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:17.246786 32490 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:17.248310 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 61304.3us
I20260709 12:12:17.248332 26588 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:17.231611 32510 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:17.235046 32689 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:17.255920 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:17.257369 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:17.257990 27167 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:17.241087   350 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.242650 32709 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:12:17.278081   343 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.115s	user 0.001s	sys 0.001s
I20260709 12:12:17.278843 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:17.280021   345 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:12:17.280264 32457 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:17.266778   350 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:17.271741 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:17.282618 26464 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:17.272924 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:17.252727 32510 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.280690 32696 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:17.270198   354 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:17.273909 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:17.272929 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:17.256129 32175 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:17.295503 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:17.297040 26547 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 12:12:17.280709   331 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:12:17.301955 32731 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:17.306794 32731 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:17.292722 32510 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:17.321599   338 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.095s	user 0.000s	sys 0.002s
I20260709 12:12:17.322351   349 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.323087   349 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:17.327586 32731 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:17.328148 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:17.309679 32614 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.310240 32723 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:17.297941 32681 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:17.352228   342 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:12:17.317263 32457 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:17.355513 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:17.356319 26547 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:17.296432   302 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:12:17.288491 32709 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:17.330215   347 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 12:12:17.351888 32701 consensus_meta.cc:287] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.742s	user 0.014s	sys 0.003s
W20260709 12:12:17.323092   336 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:12:17.296525 32696 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:17.351325 32724 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:17.348018   349 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:17.379388 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:17.329474   350 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:17.428002 32691 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:17.428746 32691 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:17.391914   349 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:17.468093 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2769) took 2008 ms. Trace:
I20260709 12:12:17.468794 26617 rpcz_store.cc:276] 0709 12:12:15.459957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:15.989288 (+529331us) service_pool.cc:224] Handling call
0709 12:12:16.828538 (+839250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:16.828764 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:16.829028 (+   264us) log.cc:844] Serialized 14 byte log entry
0709 12:12:16.981120 (+152092us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:16.981204 (+    84us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:16.981303 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:16.981410 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:17.467748 (+486338us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b5400194950. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:17.467981 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":559,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":143,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":10478,"spinlock_wait_cycles":1840060800,"thread_start_us":151562,"threads_started":1,"wal-append.queue_time_us":232811}
I20260709 12:12:17.450730   349 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:17.497197 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.516088 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:17.517920 26514 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:17.519253 32489 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:17.500663 32437 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.521219 32489 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:17.521637 32437 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:17.525204 32437 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:17.527192 32721 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:17.528903 32721 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:17.552522   350 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:17.501215   349 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:17.560379 26469 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:17.567867 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:17.569116 26619 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:17.572278 32709 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:17.574098 26617 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:17.578594 32709 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:17.579358 32709 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:17.581867 32709 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:17.583539 26619 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:12:17.587109 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:17.597498 26616 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:17.601326 26616 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:12:17.613848 26621 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:17.561514 32696 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:17.567996   350 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.592649 32691 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:17.630353 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:17.645268 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:17.652530 26619 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:17.662490 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:17.667034 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55736us
I20260709 12:12:17.668282 27167 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:17.670081 32760 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:17.694336 26514 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:17.693629   360 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 12:12:17.720191 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:17.720885 26547 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:17.696409   341 consensus_meta.cc:287] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.529s	user 0.013s	sys 0.002s
I20260709 12:12:17.724794 26542 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:17.654322 32709 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:12:17.691139 32356 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:17.706527   330 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:17.662639   350 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:17.743646 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:17.711719 32684 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:17.695502 32681 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:12:17.698624   302 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:12:17.711779 32697 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:12:17.711943 32231 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 12:12:17.734263   312 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.751230 32684 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:17.797199 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:17.741500   330 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:17.761492 32721 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.734519   341 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:17.811901 26547 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:12:17.813058 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:17.775034 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:17.746652 32356 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:17.783166 32701 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:17.801779 32684 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:17.777845 32724 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:12:17.835500 26539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:12:17.796373   312 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:17.838901 26539 raft_consensus.cc:606] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:12:17.823225 32709 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:17.840193 26539 raft_consensus.cc:614] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:17.824872 32743 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.698s	user 0.014s	sys 0.000s
I20260709 12:12:17.819249 32721 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:17.848910   312 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:17.850968 26539 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:17.824561 32701 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:17.873756 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:17.884740 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:17.902536 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 142428us
I20260709 12:12:17.904969 27133 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:17.908119   355 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:17.908629 32721 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:17.908742   355 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 15 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:17.909823   355 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:17.894490 32689 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.628s	user 0.013s	sys 0.000s
I20260709 12:12:17.914563 32489 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.914942 32689 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:17.915234 32489 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:17.917073 26541 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:17.917760 32489 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:17.918452 32689 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:17.920578 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:17.923233 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:17.924809   349 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:17.925480 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:17.844520 32709 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:17.920825 32510 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.575s	user 0.007s	sys 0.004s
I20260709 12:12:17.943292 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:17.864810 32743 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:17.898092 32356 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:18.011113 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.014209 26469 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
W20260709 12:12:17.963269 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.862941   330 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:18.020946   324 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.028906 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:18.031267 26547 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:18.069388 26547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:12:18.070039 26547 raft_consensus.cc:606] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:12:18.032660 32709 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:18.034039   364 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 12:12:17.952373 32510 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:18.012372 32437 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.035799   348 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 21.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:18.038939 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:18.041359   368 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:12:18.048813 32600 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:18.053674 27165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 826) took 1369 ms. Trace:
I20260709 12:12:18.056978 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3658) took 1243 ms. Trace:
I20260709 12:12:18.067095   350 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:18.089179 26546 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:18.094556 27165 rpcz_store.cc:276] 0709 12:12:16.684513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.741566 (+ 57053us) service_pool.cc:224] Handling call
0709 12:12:18.053242 (+1311676us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b5400603954. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:18.053514 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120564480}
I20260709 12:12:18.095937 26464 rpcz_store.cc:276] 0709 12:12:16.818626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.818784 (+   158us) service_pool.cc:224] Handling call
0709 12:12:16.819055 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:17.282999 (+463944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.056548 (+773549us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54000f41d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:18.056879 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1065613184}
I20260709 12:12:18.120705 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.091312   330 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:18.094199 32600 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:18.098613 32700 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:12:18.181464 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 83183.4us
I20260709 12:12:18.192358 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:18.102029 32567 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:18.103561   341 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:18.156786   377 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:18.162705   348 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:18.198864   374 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:12:18.091065 32437 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:18.201680   373 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 12:12:18.202481   376 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:12:18.204434 32510 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:18.214517 32567 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:18.201680   383 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:12:18.216475 32684 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.217976   349 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:18.239210 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:18.228937 32689 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:18.197167 32700 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:18.266113 32745 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:18.266662 32745 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:18.267980 32745 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.270449 32684 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:18.279304   375 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:18.283171   355 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:18.290527 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:18.295477 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2722) took 1500 ms. Trace:
I20260709 12:12:18.295696   355 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:18.291355   379 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:12:18.297700   379 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:12:18.297780 32490 consensus_meta.cc:287] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.044s	user 0.014s	sys 0.001s
I20260709 12:12:18.298458   355 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:18.282943 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:18.278025   388 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:18.289149 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:18.299898 26614 raft_consensus.cc:2393] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 14: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:18.299494   388 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:18.300110 32656 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:18.301831   388 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:18.281343 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:18.303612 32726 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:18.304386 32726 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.238626 32701 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:18.298182   379 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:18.296042 26615 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:18.310045 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:18.289779 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2720) took 1495 ms. Trace:
I20260709 12:12:18.295971 26543 rpcz_store.cc:276] 0709 12:12:16.794748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.818421 (+ 23673us) service_pool.cc:224] Handling call
0709 12:12:18.294564 (+1476143us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:12:18.294850 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.295072 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:18.295097 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:18.295141 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:18.295184 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.295247 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.295403 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26361088}
I20260709 12:12:18.314827   388 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.033s
W20260709 12:12:18.310704   370 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 12:12:18.291463   380 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:12:18.229943   348 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.356348 27165 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:18.272404 32437 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:18.344915 26540 rpcz_store.cc:276] 0709 12:12:16.794147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.806956 (+ 12809us) service_pool.cc:224] Handling call
0709 12:12:18.288634 (+1481678us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:12:18.288987 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.289271 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:18.289315 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:18.289390 (+    75us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:18.289450 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.289534 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.289692 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51555072}
I20260709 12:12:18.227226   377 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.282375 32684 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:18.313803 32457 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:18.276715 32567 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:18.367959 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:18.371083 26540 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:18.353245   375 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:18.298767 32490 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:18.380119 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 74381.4us
I20260709 12:12:18.365103 32709 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.365000 32684 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.383747 26540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:12:18.384714 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:18.387122 26540 raft_consensus.cc:606] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:12:18.371513 32726 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:18.365389 32437 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:18.365537 32743 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:18.384753 27134 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:18.387557 27168 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:18.397357 26548 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:18.400156 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.405820 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3563) took 1116 ms. Trace:
I20260709 12:12:18.388170 32684 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:18.375047 32457 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.406253 26620 rpcz_store.cc:276] 0709 12:12:17.289613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.306923 (+ 17310us) service_pool.cc:224] Handling call
0709 12:12:17.307361 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:17.307629 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:17.307658 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:17.308169 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:12:17.803006 (+494837us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:17.803050 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.803130 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:18.405599 (+602469us) raft_consensus.cc:1685] finished
0709 12:12:18.405620 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.405759 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":494394,"threads_started":1,"wal-append.queue_time_us":780634}
I20260709 12:12:18.410629 27134 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:12:18.403496   385 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:12:18.396822   396 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:12:18.409757   386 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:12:18.404583 32726 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:18.405395   341 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:18.396317 32709 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.439172 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:18.449483 26544 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 16: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:12:18.450078 26544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2721) took 1655 ms (client timeout 1843 ms). Trace:
I20260709 12:12:18.430142   396 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.454936   329 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:18.455608   329 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:18.456672   396 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:18.456887   329 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.440737   375 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:18.432958 32639 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:18.404879 32437 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:18.423785 32434 consensus_meta.cc:287] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.272s	user 0.016s	sys 0.001s
W20260709 12:12:18.450616 26544 rpcz_store.cc:269] 0709 12:12:16.794455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.807236 (+ 12781us) service_pool.cc:224] Handling call
0709 12:12:18.438939 (+1631703us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:12:18.449995 (+ 11056us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27900288}
I20260709 12:12:18.424057   350 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:18.469036 27168 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:18.476511 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:18.381964   379 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.484721 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3541) took 1815 ms. Trace:
I20260709 12:12:18.467702   350 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.489914 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:18.458587 32700 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:18.480763 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:18.475044   396 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:18.447404 32726 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.484673   302 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:18.486956 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:18.472147 32639 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.499886 27167 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:18.492152 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.489845 26613 rpcz_store.cc:276] 0709 12:12:16.668871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.670899 (+  2028us) service_pool.cc:224] Handling call
0709 12:12:16.704588 (+ 33689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:16.725050 (+ 20462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.484506 (+1759456us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b5400194e50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:18.484660 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76613888}
I20260709 12:12:18.491904 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:18.502437 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:18.503193 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:18.503882 32490 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:18.504386   330 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:18.499511   397 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:18.505155   330 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.505326   397 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.504452 32639 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:18.507742   397 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:18.491732   350 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:18.507767   330 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:18.510744 26588 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:18.511847 32400 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:18.512449 26588 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:18.513002 32400 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:18.513437 32400 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:18.515522 32726 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:18.514318 32400 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:18.517148   396 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.517455 32400 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:18.519491 32639 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:18.520238 32639 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.519709 32457 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:18.521071 32639 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:18.522888 27168 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:18.523492   390 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:18.523963   390 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.524333   390 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:18.526968 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:18.527190   330 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.527787   330 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.528522 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:18.529933 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.530282   330 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:18.531409 32709 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:18.532413 26620 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:18.536005 32437 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:18.502094   302 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:18.537711   302 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:18.538152 26613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:12:18.538875 26613 raft_consensus.cc:606] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:12:18.539300 26613 raft_consensus.cc:614] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:18.539466 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:18.540261 26544 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:18.541276 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2728) took 1744 ms. Trace:
I20260709 12:12:18.541817 26545 rpcz_store.cc:276] 0709 12:12:16.796390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.809431 (+ 13041us) service_pool.cc:224] Handling call
0709 12:12:17.130292 (+320861us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:12:17.130593 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:17.254581 (+123988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:17.254621 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:17.254664 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:17.254703 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.541031 (+1286328us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400396cd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:18.541089 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.541216 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331650816}
I20260709 12:12:18.517395 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:18.538888   302 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:18.547788 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:18.548601 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:18.555554 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:18.549369 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:18.556810 26547 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:12:18.493049   329 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:18.569931 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:18.572208 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.472225 32434 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.516635   348 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:18.584450 27167 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:18.519296 32670 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:18.608516 32434 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:18.588896 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:18.615633 26622 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 18: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:18.616364 32457 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:18.617007 32457 raft_consensus.cc:697] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:18.621745   324 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:18.623806   390 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.563370 32709 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.628247 32709 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.626153   390 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:18.632148 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.633064 26469 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:18.614208 32656 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:18.651369   396 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:18.723896   396 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.734179 27161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 947) took 1736 ms. Trace:
I20260709 12:12:18.738781 26617 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:12:18.740379 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.738956 27161 rpcz_store.cc:276] 0709 12:12:16.997409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.997581 (+   172us) service_pool.cc:224] Handling call
0709 12:12:16.998043 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:16.998341 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:17.017149 (+ 18808us) log.cc:844] Serialized 14 byte log entry
0709 12:12:18.485826 (+1468677us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b1800291ee0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a23a 00007f50760e4a2a
0709 12:12:18.732810 (+246984us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:18.732888 (+    78us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:18.732965 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.733574 (+   609us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.733765 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18598,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":5957,"raft.queue_time_us":129,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":2143,"spinlock_wait_cycles":5329280,"thread_start_us":246535,"threads_started":1}
I20260709 12:12:18.747349   393 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:18.617981 32457 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:18.724565   396 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:18.748073   393 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.754572   393 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:18.735502   339 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:18.757979 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.745159 32709 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:18.764914 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.766788 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:18.767136 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:18.770009 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:18.770961 26614 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:18.771654 26619 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:18.772291 26617 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:18.761272 32691 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:18.775660   405 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:18.783284   405 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:18.757577   388 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:18.760255   393 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:18.792971 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:18.777979   396 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:18.820833 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.821239 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:18.764642 32639 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:18.822101 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 269314us
I20260709 12:12:18.824266 32639 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:18.798741   405 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:18.778483 32691 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:18.852645 32691 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:18.828598 26616 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:12:18.853791 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:18.826025 32636 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.854871 32636 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.856613 32657 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:18.806795   393 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.858379 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:18.825876 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:18.831624 26617 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:18.836207 32656 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:18.836733 32457 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.828553   350 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:18.843392 32400 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:18.847294 32231 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:18.848424 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 967) took 1091 ms. Trace:
I20260709 12:12:18.848618 32574 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:18.849875   375 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:18.896530 32231 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.899067 32231 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:18.803107   388 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:18.861197 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.862764 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:18.878369 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:18.880710 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:18.882135 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:18.883721 26542 rpcz_store.cc:276] 0709 12:12:17.757986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.094194 (+336208us) service_pool.cc:224] Handling call
0709 12:12:18.158818 (+ 64624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.351325 (+192507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:18.351389 (+    64us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:18.351455 (+    66us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:18.351518 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.848175 (+496657us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54002387d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:18.848223 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.848362 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441798400}
I20260709 12:12:18.886075 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:18.906093 27167 raft_consensus.cc:2393] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 15: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:18.893517 32574 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:18.910693 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47998.6us
I20260709 12:12:18.858084 32684 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:18.909062 27159 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:12:18.916261   348 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:18.908068 32670 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:18.923332 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:18.924366 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:18.874420   405 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:18.926765 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:18.941579 26544 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:18.934168 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:18.922492 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:18.950987 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:18.951625 26542 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:18.869020   396 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.064s
I20260709 12:12:18.956485 26466 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:12:18.874943 32656 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:18.958101 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:18.886706   341 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:12:18.883891 32457 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:18.960477 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.961282 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.962775 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.963397 26464 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:18.964193 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.964516 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.965265 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.965890 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.965986 26468 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:18.943434   390 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:18.969463   393 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:18.969861 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:18.970363 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:18.971287 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.971854   388 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:18.971959 32434 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:18.972229 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.973441 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:18.933054 32574 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:18.974939 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.975422 32684 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:18.976099 32574 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:18.976161 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:18.967346   390 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.942346   405 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:18.958043 32636 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:18.977344   390 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:18.949079 32657 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.977532 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.949127 32437 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.978055 32657 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.978747 32437 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.980387 32657 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:18.980831 32437 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:18.949846 32670 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:18.981747 26472 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:18.983003 32670 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:18.977572   405 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.983953 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.984161 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:18.933488   348 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:18.985206 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.986722   348 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:18.990376 32656 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:18.991662 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.987824   348 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:18.994006 32457 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:18.998222 26544 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:12:18.999878 26621 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:18.992961 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:19.001353 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:18.978762 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.958981 32231 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:19.005344 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:18.984242   350 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:19.006879 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.008555 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:18.986722 32504 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:19.010746 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:19.012042 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:19.013674 32670 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:19.014011 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:19.015046 32437 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:19.016592 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:19.017270 26466 raft_consensus.cc:2410] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:12:19.022266 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:19.026358 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.026849 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:19.027072 26619 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:19.027467 27167 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:12:19.028048 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.028589 26619 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:12:19.029352 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.029655 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:19.029844 26619 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:19.030726 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.032358 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:19.034487 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.012316   396 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:12:19.039427 26439 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:19.023793 32437 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:19.012850 32231 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.039610 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:19.041898 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:19.037021 32504 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:19.038093 32656 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 12:12:19.052273 32656 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:19.052738 32656 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:19.056402 32231 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:19.057251 26470 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:19.061674   341 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:19.062479   341 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.064874   341 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:19.047091 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:19.066813   341 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:19.076450 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:19.064502   390 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.068363 26439 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:19.072203 32670 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:19.072762   396 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:19.073133   388 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:19.080466 26615 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:12:19.053244 32657 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:19.078781   396 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.083055 32657 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.082669 32656 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.083534 32657 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:19.083892 32656 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:19.083976   390 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:19.085434   388 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.079001   341 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.084965   396 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:19.122093   341 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:19.127274 26622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 3560) took 1854 ms (client timeout 2234 ms). Trace:
W20260709 12:12:19.127810 26622 rpcz_store.cc:269] 0709 12:12:17.272909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.273623 (+   714us) service_pool.cc:224] Handling call
0709 12:12:19.127056 (+1853433us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400267d54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:19.127207 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3044262144}
I20260709 12:12:19.104342 32400 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:19.134297 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:19.134603 32400 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.135036 32400 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:19.104390   339 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:19.136648 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:19.136996   339 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.046468 32567 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:19.079628   329 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:19.137316 26469 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.137632   329 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:19.138139   329 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.087153 32504 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:19.137245 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.141570 26616 raft_consensus.cc:2368] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21.
I20260709 12:12:19.110260 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:19.142357 32504 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:19.142752 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:19.143829 32504 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:19.145392 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:19.120677 32489 raft_consensus.cc:993] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:12:19.120810   388 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:19.130019 26618 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:19.150636 26439 leader_election.cc:400] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21.
I20260709 12:12:19.151151 26439 leader_election.cc:403] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:19.148070 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:19.148747 26542 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:19.152922 26469 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:19.113409 32494 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:19.155242 32723 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.137562 32567 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:19.169256 32723 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.168226 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:19.183182 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2729) took 1890 ms. Trace:
I20260709 12:12:19.150110   417 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.166536   396 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.186328   393 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:19.186204   396 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.186857   393 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.187280   393 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:19.188476   396 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:19.163828   352 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:19.189311   352 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.191543   352 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:19.155520   390 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:19.192286   390 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.182883 32567 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.194684   390 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:19.197227 32745 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.183645 26541 rpcz_store.cc:276] 0709 12:12:17.292371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.292590 (+   219us) service_pool.cc:224] Handling call
0709 12:12:17.292937 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:17.917474 (+624537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.182883 (+1265409us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54002373d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:19.183109 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434960128}
I20260709 12:12:19.156227 32231 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:12:19.201130 32437 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:19.202071 32723 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:19.205430 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:19.177814 32494 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.207149   393 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.207867   302 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:19.208426   302 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:19.209350   302 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.164296 32489 raft_consensus.cc:1081] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:12:19.209379   393 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:19.213310   393 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:19.213802   393 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.214870 32682 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:19.214769   417 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.215499 32682 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.216053   393 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:19.217214   417 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:19.219929   405 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:19.222636 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.150332 32504 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:19.218111 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:19.217581 32682 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:19.226502   388 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:19.227150   388 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.229629   388 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:19.222167   405 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:19.200541 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52986.7us
I20260709 12:12:19.225986 27166 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:19.232868 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:19.182046 32497 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.237669 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.238433 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.238947 32231 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21.
I20260709 12:12:19.239933 26621 raft_consensus.cc:2410] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 19 because replica has last-logged OpId of term: 17 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 12:12:19.241570 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.242718 26541 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:19.244376 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:19.244930 26472 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:19.245586 26620 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
W20260709 12:12:19.246546 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.256955 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.257795 26541 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:19.260555 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.261536 26541 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 8.
I20260709 12:12:19.247610   405 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:19.251564   311 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.249254 32497 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.271663 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:19.275815 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.253649 32657 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.296664 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:19.269282 32760 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.537s	user 0.027s	sys 0.009s
I20260709 12:12:19.300818 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:19.276405 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:19.298596 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:19.300369 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.297677 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:19.304272 26468 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:19.305548 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:19.304184 26539 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:19.311137 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:19.313462 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:19.316321 32657 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:19.318511 32504 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:19.319702 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:19.320477 26544 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:19.308274 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:19.325228 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:19.325934 26617 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:19.332744 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:19.333493 27166 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:19.333297 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:19.266314 32567 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.280365   302 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:19.337373 26544 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
W20260709 12:12:19.301973 32760 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.576s	user 0.028s	sys 0.009s
I20260709 12:12:19.339711 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:19.368752 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:19.368995 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:19.370290 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:19.335660 26617 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:12:19.352380 32504 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:19.353024 32567 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:19.353168   405 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:19.353791   339 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.372054 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:19.376935 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:19.364797 26621 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:19.358893 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 153537us
I20260709 12:12:19.376724 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.379568 26472 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:19.382661 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:19.383653 32497 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:19.369127 32760 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:19.385071 32760 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.385847 26468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43606
I20260709 12:12:19.386627 26468 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:19.387086 26468 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:19.388302 32600 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.389461 32600 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:19.393039 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:19.380046   324 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:12:19.394047 26466 raft_consensus.cc:2410] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 12:12:19.394245   324 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:19.394737   324 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:19.395649 26468 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.395931 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:19.396649 32494 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:19.396626 26466 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:19.397719 26468 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:19.398593 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:19.398792   379 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.377828 32632 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:19.399618 32632 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.400012 32632 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:19.400043 32715 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:19.400673 32715 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.401480 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.374962   396 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:19.402851   396 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.402909 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:19.403075 32715 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:19.375240   352 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:19.404963 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.404659 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:19.406142 26465 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.403318   396 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:19.409379 26619 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:19.269336   311 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.409569 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:19.421612 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:19.422183 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45325us
I20260709 12:12:19.422802 27167 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 17: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:19.423815 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:19.426934 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.371078   302 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.431317 26622 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:19.432613 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:19.432807   422 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:19.414109 26472 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 17. Current term is 18. Ops: [15.13-17.14]
I20260709 12:12:19.436025 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:19.416431 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.417152 27159 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:19.419102 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.411257   352 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:19.413216 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:19.438347 26468 raft_consensus.cc:2410] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:12:19.439414 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:19.440056 26541 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.416093 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:19.439288 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:19.443224 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:19.436767 26472 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:12:19.444867 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:19.446132 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:19.446821 27167 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:19.447738 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:19.435276   422 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:19.449505 27161 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:19.450208 27166 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:12:19.452471 26465 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
I20260709 12:12:19.453389 27133 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:19.452603 26472 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 19: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:19.455150 26514 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:19.455555 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.404639   405 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:19.432834   302 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:19.466699 26617 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:12:19.442319 32721 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:19.485072 27167 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:19.473266 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:19.504139 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:19.448637   352 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.504770 26465 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:12:19.465257 26514 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:19.506769 26541 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:19.510624 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:19.459386 32696 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:19.457937   388 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:19.496289 32698 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:19.465093 32657 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 12:12:19.459770   422 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.512118 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:19.553372 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2733) took 1834 ms. Trace:
I20260709 12:12:19.512707   302 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:19.577953 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 65913.4us
W20260709 12:12:19.512126 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 46972.2us
I20260709 12:12:19.568272 32698 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.583676 32632 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.586900 32698 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:19.465525   423 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:19.512434 32724 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:19.523159 26472 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:19.550750 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:19.592305 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:19.464531   424 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:19.568511 26548 rpcz_store.cc:276] 0709 12:12:17.719281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.719857 (+   576us) service_pool.cc:224] Handling call
0709 12:12:17.720171 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.404370 (+684199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.553084 (+1148714us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54003377d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:19.553286 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1556932864}
I20260709 12:12:19.456858   404 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:19.501072 32721 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.512755 26617 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:19.576776 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2730) took 1865 ms. Trace:
I20260709 12:12:19.591842 26588 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:19.593062 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:19.605063 26546 rpcz_store.cc:276] 0709 12:12:17.710969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.711147 (+   178us) service_pool.cc:224] Handling call
0709 12:12:17.711466 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.099418 (+387952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.576457 (+1477039us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b540037fad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:19.576706 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":868167424}
I20260709 12:12:19.605995 26464 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:19.606678 26546 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:19.594625 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:19.603480 27167 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:19.603802 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:19.612633 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.613262 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.614094 26548 raft_consensus.cc:2368] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20.
I20260709 12:12:19.498378   351 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 12:12:19.544764   390 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.616616 26547 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:12:19.616750 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.618850   390 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.613376 26616 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:19.615185 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:19.612509 32721 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.621245   390 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:19.621466 32437 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:19.602638 32724 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:19.621909   390 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:19.622186 32724 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:19.622565 26621 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:19.623919 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.624245 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.624930 26617 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 16: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:19.625238 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.625934 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:19.626297 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.626780 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.627611 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.628859 32632 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:19.590533   423 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.639395 32721 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:19.642357 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.642669   339 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:19.577435   388 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:19.643612   388 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:19.647496 26543 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:19.653617 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:19.599002   341 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:19.673133 26464 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:19.646893 32721 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:19.524698   329 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.713433 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:19.712867 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:19.646281   427 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.067s	user 0.003s	sys 0.000s
W20260709 12:12:19.649426 32400 consensus_meta.cc:287] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.000s
I20260709 12:12:19.653467   372 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.577167 32696 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.622182 32437 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:19.567565   405 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.740512 26614 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 18: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:19.649926   324 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.639395 32724 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.732079   341 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:19.756738 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.758348 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.768384 26544 raft_consensus.cc:2368] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21.
I20260709 12:12:19.774669 27165 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:12:19.729758 32400 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.772732 32682 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:12:19.734946   372 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.782776 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.759234   377 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:19.788616 32682 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:12:19.793795 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 201558us
I20260709 12:12:19.799283 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:19.805068 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:19.782243 32745 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:12:19.790822 32682 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:19.842536 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.843258   324 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:19.843917 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:19.844666 26540 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.846876   422 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:19.847602 32272 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:19.853303 32400 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:19.855813 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.856792 26542 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:19.858011 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.859354 26542 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 22: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:19.860649 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.861940   335 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:19.862088 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.862519   335 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:19.863536   335 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.864759   335 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.805898 32632 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:19.866703 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.863528 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.868086 26542 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:19.817785 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:19.865770   388 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.896016 26544 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:19.910455 26544 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:12:19.896595 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 304833us
I20260709 12:12:19.867357   329 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:19.912443 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2796) took 2602 ms. Trace:
I20260709 12:12:19.912964 26618 rpcz_store.cc:276] 0709 12:12:17.311772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.451267 (+139495us) service_pool.cc:224] Handling call
0709 12:12:19.129719 (+1678452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.155274 (+ 25555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.912202 (+756928us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b5400267d50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:19.912377 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3859000576}
I20260709 12:12:19.911958 26544 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:19.915577 26543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 2591) took 1367 ms (client timeout 1618 ms). Trace:
I20260709 12:12:19.915977 26544 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:19.920166 26539 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:12:19.921365 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:19.921800 26615 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:19.922649   388 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:19.923780 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.925438   372 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:19.925678 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:19.926211 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.926522 26618 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:19.927022 26620 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 17: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:19.928196 32696 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:19.901028 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.930295 26618 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 8. Current term is 9. Ops: []
I20260709 12:12:19.907291 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:19.916070 26543 rpcz_store.cc:269] 0709 12:12:18.548051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.548340 (+   289us) service_pool.cc:224] Handling call
0709 12:12:19.915383 (+1367043us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400140354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:19.915511 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2509498240}
I20260709 12:12:19.796398 32490 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:19.905310 32691 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:19.931538 26548 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 16: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:19.938550 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:19.896469 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:19.932381 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.933722 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.940585 26621 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:19.941805 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:19.945116 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.940057 26539 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:19.948429 26544 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
W20260709 12:12:19.940150 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.949870 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.955056 26548 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 19: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:19.955637 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:19.955881 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:19.956318 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:19.952375 26543 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 17: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:19.951431 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:19.900573   367 raft_consensus.cc:993] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:12:19.957584 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.958212 26539 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:12:19.959534 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:19.933231 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:19.961436   423 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:19.961982 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 64526.1us
I20260709 12:12:19.962863   429 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:19.962931 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:19.963675   429 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:19.964301 26588 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:19.964675   429 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.966054 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:19.966598   391 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:19.966917 26621 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 18: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:19.967095   391 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.967556   391 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.968962 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:19.970674   367 raft_consensus.cc:1081] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:12:19.953291   416 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:12:19.972324 32724 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:19.972801 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:19.973170 32231 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:19.973661 32231 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:19.953235   350 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:19.974524 32231 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.974944   350 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.976377 32494 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:19.976862 32494 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:19.976791   416 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:19.974819 32574 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:19.977658   350 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:19.977705   416 consensus_queue.cc:1243] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:19.978643 32574 raft_consensus.cc:3055] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:19.981428   388 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:19.977440 32494 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:19.979259   422 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:19.982234   422 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:19.982142   388 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.983393   422 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.984664   388 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:19.984794   422 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.951706   372 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.946034   329 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:19.986557   329 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.986794 32682 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.988197 32682 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.988330 26547 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:19.989609   329 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:19.989826 26547 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:19.981559 32574 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:19.950798 32490 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:19.991343 32494 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.992458 26613 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:19.993250 32490 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:19.993595   424 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:19.993885 32494 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:19.960105 32657 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:19.946360 32691 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:19.996054 26548 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:20.018973 26466 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:20.018118 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:20.020423 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.952059 32696 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:20.027249 32497 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:20.027048 32691 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:20.027695 32497 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:20.028162 32691 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.028599 32497 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.029673 32497 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.011734 32490 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.032982 32490 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.035851 32490 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:20.037101 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:20.038249 26471 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 18: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:19.999056 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:19.985827   372 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:19.806978   341 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:20.002046 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:20.049412 26544 raft_consensus.cc:2410] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 19 because replica has last-logged OpId of term: 17 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 12:12:19.935129 26540 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
I20260709 12:12:20.050765 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:20.052219 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:20.008263 26539 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:12:20.049768 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:20.056757 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:20.023590 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:20.047062 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:20.038740 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:20.060211 26469 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:20.064002 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:20.072000 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.074062 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:20.074949 27165 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:12:20.066300 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:20.078110 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:20.079078 26542 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:20.069624 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 110202us
I20260709 12:12:20.083921 26543 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:20.084203 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:20.019341 32657 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:20.084203 26514 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:20.087541 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:20.088126 26544 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:20.089390 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:20.033021   311 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:19.991515 32574 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.092309 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:20.096463 27167 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:20.097122 27134 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:20.105891 27134 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:20.111096 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:20.112157 26469 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:20.114668 26547 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:20.115123 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:20.119820 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:20.123795 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:20.124460 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:20.083292 32682 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.113993 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:20.103902   396 consensus_meta.cc:287] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.662s	user 0.012s	sys 0.000s
W20260709 12:12:20.127856 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 153596us
I20260709 12:12:20.089568 32657 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:20.090986 32721 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.130280 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:20.049727 32696 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.110924 32723 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:20.141677 26542 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:20.121198   390 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:20.133204 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:20.109772 32715 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:20.110232   335 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:20.133268 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:20.100373   405 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:20.090962   431 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:20.133172 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:20.112692   432 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:20.126773   324 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:12:20.142114 26439 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:20.175071 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:20.186921 26514 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:20.176162 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:20.187839 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 45797.2us
W20260709 12:12:20.188735 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 189610us
I20260709 12:12:20.150156 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:20.126551   388 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:12:20.191099 26471 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 17. Current term is 18. Ops: [15.13-17.14]
I20260709 12:12:20.187218 26616 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:20.147939   390 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.190138 26469 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:20.191680 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:20.178750 32721 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:20.192883 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.136421 32574 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:20.194614   431 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:20.194468 32709 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:12:20.244321 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.195003   405 raft_consensus.cc:697] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:20.126116   311 consensus_queue.cc:1059] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:12:20.197413 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:20.198752 26514 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:20.261277 26467 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:20.187963 26614 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:20.138295 32437 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:12:20.192343 32231 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:20.262562 32231 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:20.262663 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:20.262706 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:20.243899 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:20.238585 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.239691 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:20.263301 32231 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:20.266713 32541 raft_consensus.cc:3055] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:20.245601 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:20.141337   396 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.252802   372 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:20.253073   433 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.226s	user 0.003s	sys 0.000s
W20260709 12:12:20.254542 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.254885 32656 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:20.256596   436 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:20.145711 32494 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.078s
W20260709 12:12:20.259935 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.175877 32504 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 12:12:20.231870   390 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:20.230533   424 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:12:20.268659 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 70002.4us
W20260709 12:12:20.316177 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.343636 26514 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:20.345278 32231 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.268863 27133 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:20.351289 32231 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:20.271386 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:20.272114 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 125969us
I20260709 12:12:20.323392 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:20.204766 32715 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.274923 27159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 965) took 1133 ms. Trace:
I20260709 12:12:20.238575   329 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:20.282637 26473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 3674) took 2334 ms (client timeout 1534 ms). Trace:
W20260709 12:12:20.380337 26473 rpcz_store.cc:269] 0709 12:12:17.942660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.942819 (+   159us) service_pool.cc:224] Handling call
0709 12:12:20.276422 (+2333603us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b54002de6d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:20.276568 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4996642048}
I20260709 12:12:20.258924 32721 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:20.284320 32698 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:20.283912   325 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.286986   436 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.300598 32494 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:12:20.301780   434 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:12:20.270766 32747 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:20.269902 32541 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:20.271607 32724 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:20.350991 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 74940us
I20260709 12:12:20.308568 26622 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:12:20.354826 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:20.351414 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 82670.3us
I20260709 12:12:20.412107 26438 leader_election.cc:400] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20.
I20260709 12:12:20.412544 26438 leader_election.cc:403] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:20.413867 26438 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:20.279204 32457 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:20.376569 32231 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.417299 32231 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:20.275017   416 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:20.278766   377 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:20.199635   352 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.010s	sys 0.035s
I20260709 12:12:20.359704 27159 rpcz_store.cc:276] 0709 12:12:19.141183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.141322 (+   139us) service_pool.cc:224] Handling call
0709 12:12:19.141659 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.437031 (+295372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.274652 (+837621us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b54006a68d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:20.274855 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":633140480}
I20260709 12:12:20.384068 26467 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:12:20.284230 32656 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.392858 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:20.392891 32715 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.319398 32567 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:20.307889   396 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:20.320966   404 raft_consensus.cc:3055] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:12:20.332842 32696 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:20.316694 32692 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:20.358785   388 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.393850 32745 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:20.411856 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:20.365828 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 215739us
I20260709 12:12:20.457281 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:20.417958 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:20.442931 32494 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:20.435917 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:20.437634 32747 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:12:20.415318 32724 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:20.397563   329 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:20.319476   405 consensus_queue.cc:237] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.399468 32698 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.398968   325 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:20.431986   352 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.010s	sys 0.035s
W20260709 12:12:20.451256 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 179967us
I20260709 12:12:20.435855   377 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:20.419759   432 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:20.459584 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47854.3us
I20260709 12:12:20.503587 32696 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:20.461284 26438 leader_election.cc:400] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21.
I20260709 12:12:20.517004 32724 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:20.438953 26366 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57052 (request call id 306) took 44379 ms (client timeout 15000 ms). Trace:
I20260709 12:12:20.464370 32457 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:20.465248   440 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:12:20.470680   445 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:20.479107 26541 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:20.480093 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:20.481494 26464 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:20.541648 26543 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.483758 26471 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 12:12:20.485303   436 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:20.486207 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.487448 26542 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:20.493245   396 consensus_queue.cc:1059] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:20.495960   350 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:20.423691 32400 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:12:20.559289 32400 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:20.559706 32400 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:20.560527 32400 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.561939 32400 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:20.445204 32567 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:20.432561 32657 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.563769 32567 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.564954 32657 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:20.533257   422 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:12:20.450613   404 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:20.566418   404 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:20.567502 32698 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:20.567689   404 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:20.567819 26543 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:20.569197   325 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:20.454101 32692 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:20.570749 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:20.570931   329 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:20.571269 32692 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.572582 32692 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:20.519908 27159 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:20.574788 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:20.575565 26541 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:20.453403   447 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:20.433457   416 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:20.424899 32670 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:20.525069 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:12:20.577751 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 52764.5us
I20260709 12:12:20.579964 32656 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:20.580067   416 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:20.580636 32656 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:20.581180 32656 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 19 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:20.529646 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:20.582836   329 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:12:20.583074 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 53527us
I20260709 12:12:20.583498   329 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:20.583993 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:20.584542   329 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:20.532467 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 71348.5us
I20260709 12:12:20.586071 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:20.482510 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:20.586611 26438 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:20.587041 26470 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 19: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:20.587733   377 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:20.587941   335 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:20.588304   377 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.588691   335 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:20.589561 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:20.463855 26514 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:20.590837 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 127117us
I20260709 12:12:20.591647 26514 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:20.591883 32760 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:20.592309 32760 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:20.592764 26514 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:20.593113 32760 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:20.593941 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:20.594643 32745 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:20.595321 32745 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:20.595922 32745 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:20.597163 32632 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:20.534228   432 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:20.590710 32437 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:20.599123 32437 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:20.599898   432 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:20.548205   431 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:20.600015 32437 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:20.549665 32731 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:20.550959   396 raft_consensus.cc:3055] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:20.552254 32715 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:20.503119 32721 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.554550   445 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:20.501791   391 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:20.534749 32696 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:12:20.534825 26366 rpcz_store.cc:269] 0709 12:11:36.053154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.054565 (+  1411us) service_pool.cc:224] Handling call
0709 12:11:36.294291 (+239726us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540007d354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076044090 00007f50760e2f3a 00007f507be98e9c 00007f507bf9704e 00007f507a4582a4 00007f507a458232 00007f507a458161 00007f507a4580dc 00007f507a457392 00007f507441548c 00007f50744148c6
0709 12:12:20.432013 (+44137722us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:15.118078 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:15.123953 (+  5875us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:15.125259 (+  1306us) write_op.cc:435] Acquired schema lock
0709 12:12:15.125295 (+    36us) tablet.cc:662] Decoding operations
0709 12:12:15.442138 (+316843us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:15.458695 (+ 16557us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:15.460859 (+  2164us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:12:15.469044 (+  8185us) tablet.cc:701] Row locks acquired
0709 12:12:15.469104 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:12:15.469299 (+   195us) write_op.cc:270] Start()
0709 12:12:15.469489 (+   190us) write_op.cc:276] Timestamp: P: 1783599135469225 usec, L: 0
0709 12:12:15.469515 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:12:15.470303 (+   788us) log.cc:844] Serialized 4029 byte log entry
0709 12:12:15.881174 (+410871us) op_driver.cc:464] REPLICATION: finished
0709 12:12:16.359425 (+478251us) write_op.cc:301] APPLY: starting
0709 12:12:16.379691 (+ 20266us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:16.619906 (+240215us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:16.620067 (+   161us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:16.783313 (+163246us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:16.783677 (+   364us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 12:12:16.783732 (+    55us) write_op.cc:312] APPLY: finished
0709 12:12:16.784123 (+   391us) log.cc:844] Serialized 97 byte log entry
0709 12:12:16.854812 (+ 70689us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:16.873599 (+ 18787us) write_op.cc:454] Released schema lock
0709 12:12:16.894648 (+ 21049us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:16.984228 (+ 89580us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:16.993684 (+  9456us) write_op.cc:454] Released schema lock
0709 12:12:17.249993 (+256309us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b540007d354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d732a 00007f507605cf14 00007f507605cec3 00007f507605ce38 00007f507605cdf3 00007f507605c0dc 00007f5076085e16 00007f507606dcbb 00007f507605839d 00007f507605bd75
Metrics: {"mutex_wait_us":14123,"reported_tablets":50,"spinlock_wait_cycles":335505664,"child_traces":[["op",{"apply.queue_time_us":444772,"apply.run_cpu_time_us":19390,"apply.run_wall_time_us":609733,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45887,"num_ops":10,"prepare.queue_time_us":836544,"prepare.run_cpu_time_us":30049,"prepare.run_wall_time_us":804146,"raft.queue_time_us":1108,"raft.run_cpu_time_us":99466,"raft.run_wall_time_us":1395775,"replication_time_us":411426,"spinlock_wait_cycles":47144832,"thread_start_us":767182,"threads_started":4,"wal-append.queue_time_us":370636,"wal-append.run_cpu_time_us":4670,"wal-append.run_wall_time_us":1932818}]]}
I20260709 12:12:20.545965   444 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 12:12:20.332206 26365 catalog_manager.cc:5697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 14 to 17, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 17 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:20.233186 32723 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:20.536530   352 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:20.458596 32541 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:20.602730 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:20.605913 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:20.606526 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:20.616866 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:20.617440 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:20.619639 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:20.623579 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:20.625813 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:20.628934 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:20.628646 26439 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:20.631028 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45022.9us
I20260709 12:12:20.593806   390 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.643952 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:20.565040 32567 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:20.688673 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 82310.5us
W20260709 12:12:20.691000 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 73680us
I20260709 12:12:20.601676   396 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:20.601608 32437 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.691829 26514 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:20.603792 32698 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:20.692428 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:20.627628 32696 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:20.621598   423 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:20.661334 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:20.658512 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:20.693295 27167 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
W20260709 12:12:20.643237 32691 consensus_meta.cc:287] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.615s	user 0.013s	sys 0.001s
W20260709 12:12:20.693878 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 65343.6us
I20260709 12:12:20.642756 32760 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:20.650413   388 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:20.723258 26615 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 21: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:20.720045 26514 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:20.710122   311 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:20.748898 26514 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:20.717021   447 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:20.692902 32721 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:20.582141 32656 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:20.709950   325 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:20.715389 32541 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:20.752902 26618 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:20.687163   352 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.758662 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:20.756846 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:20.724509 32745 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:20.760329 26613 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:20.732709   454 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:12:20.776577 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.781579 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:20.754993   379 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:20.687440   443 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.108s
I20260709 12:12:20.722333 32698 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:20.712363   432 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
W20260709 12:12:20.802745 32497 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.767s	user 0.011s	sys 0.004s
I20260709 12:12:20.787859 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:20.829488 26469 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:20.788512 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:20.830621 26472 raft_consensus.cc:2368] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17.
I20260709 12:12:20.831790 26472 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: [13.10-15.11]
I20260709 12:12:20.790622 26468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43606
I20260709 12:12:20.794458 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:20.832854 26468 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:20.833264 26468 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:20.804785 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:20.805672 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:20.781920 27134 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:20.806826 26616 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17. Ops: [16.12-16.12]
W20260709 12:12:20.809082 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.809746 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:20.811172 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:20.816598 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:20.761060 32721 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.759294 32544 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:20.836511 26547 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:20.801630   372 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:20.819500 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.755405 32574 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:12:20.786743 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:20.826360 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 117191us
I20260709 12:12:20.818780   423 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:20.851178   350 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:20.851527   423 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.798290 32731 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:20.851997   350 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.816336 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:20.892784 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 76527.4us
I20260709 12:12:20.815199   379 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.766607 32272 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:20.844395 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:20.844974 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 63177.2us
I20260709 12:12:20.707690   445 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.852615 32731 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.799355   454 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:20.814836 32724 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:20.839051 32721 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.843219   372 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.900380   350 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.859815   391 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:20.946575 27159 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:20.951635 32731 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:20.954443   454 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:20.955227   417 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:20.907852 32696 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:20.955686   417 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:20.956614   417 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.957366 32696 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:20.960332 32724 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:20.861722 26365 catalog_manager.cc:5697] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:20.963582 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:20.963174 26365 catalog_manager.cc:5697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 16 to 17, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 17 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:20.964155 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:20.964747   390 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:20.963636 32745 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:12:20.964965 26365 catalog_manager.cc:5697] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 11 to 19, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 19 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:20.966883 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:20.904778   379 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:20.958124   417 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.968238 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:20.966125 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:20.924717 32272 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.972832 32272 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:20.975601 26513 leader_election.cc:400] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17.
I20260709 12:12:20.975966 26513 leader_election.cc:403] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:20.975622 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:20.977200 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:20.784487   396 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:20.852092   423 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:20.882512 32494 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20.
I20260709 12:12:20.883098 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:20.988796 26464 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:20.989071 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:20.884863 26472 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:20.991541 26472 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:20.888077 26468 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:20.992767 26466 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:20.993045 26473 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:20.825629 32698 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:21.019963 26468 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:20.898623 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 135350us
I20260709 12:12:21.022688 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:20.887058   460 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:12:21.023645 27165 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 12:12:20.910769 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:21.024099 27165 pending_rounds.cc:85] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 13
I20260709 12:12:21.024389 27165 pending_rounds.cc:107] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 12:12:21.024643 27165 raft_consensus.cc:2889] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:21.024957 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:20.915828 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:20.893000   456 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:12:20.944218 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:20.944932   372 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.797851 32723 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:21.041095 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:20.975404 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:21.045836 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:21.046814 26621 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:20.860862   352 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:20.977051 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:20.863072   335 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.979039 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:20.904224 32747 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:20.981360 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:20.983397 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:21.079890 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 96683.3us
I20260709 12:12:21.080953 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:21.007799 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:21.010907 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:21.025667 26469 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
W20260709 12:12:21.026104 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.083463 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:21.084139 26469 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:21.084296 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:21.084987 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:21.085464 26469 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:21.085528 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:21.023828 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:21.033413 32231 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:21.050168 27165 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:12:20.991914 32696 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17.
I20260709 12:12:21.036523 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:21.043088 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:21.075711 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 44217.9us
W20260709 12:12:21.076241 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55250.1us
I20260709 12:12:21.029467   329 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.019722   416 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:21.089980 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:21.087121 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:21.095358 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:21.090953 32231 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:21.090991 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:21.090508 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:21.096266 26471 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:12:21.094363 26545 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:21.087822 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:21.098719 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:21.092087 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:21.100348 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:21.101282 26543 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 24: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:21.102485 32231 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:21.109818 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:21.092087 32544 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:21.089242   352 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:21.091149   311 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:21.128656 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:21.116071 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:21.114553 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:21.116071 26513 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:21.122814 26465 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 19 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:21.119891 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:21.098749 32457 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:21.103554 32657 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:21.106623   388 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:21.105809   391 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:21.116690   341 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:21.121716   447 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:21.194571 26467 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 12:12:21.195166 26467 pending_rounds.cc:85] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 10
I20260709 12:12:21.195466 26467 pending_rounds.cc:107] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:12:21.195791 26467 raft_consensus.cc:2889] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:21.154829 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:21.152887   391 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:21.157738 32691 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:21.153505 32656 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:12:21.162482 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.153842   469 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:21.212766 26616 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:12:21.104525   463 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 12:12:21.215389   463 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:21.215799   463 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:21.216684   463 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:21.170905   480 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:21.221701 32682 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:21.222157 32682 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:21.223088 32682 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:21.224300 32682 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:21.135807   352 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:21.244611 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 90151.5us
I20260709 12:12:21.246596 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:21.130769 32696 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:21.147275 26365 catalog_manager.cc:5697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 4 to 15, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 15 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:21.206728   391 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:21.102370   329 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:21.230608 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 116237us
I20260709 12:12:21.297416 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:21.232760 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 116781us
I20260709 12:12:21.298597 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:21.218282   463 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:21.257387 26548 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:21.271627 26471 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:12:21.314069 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:21.316236 26546 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:21.299860 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:21.234706 26545 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 12:12:21.194330   447 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.327958 26545 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:21.332629 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:21.251811 32745 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:12:21.306864 32437 consensus_meta.cc:287] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.587s	user 0.009s	sys 0.001s
I20260709 12:12:21.350108 26620 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:12:21.269520   443 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:21.318347   478 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:12:21.299685   473 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:21.372927 26539 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:21.308348   422 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:21.328330 32457 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:21.319413   341 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:21.341187   447 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:21.345870 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 229539us
I20260709 12:12:21.327584   311 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.327967   469 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.380884 26621 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
W20260709 12:12:21.389078 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 59143.3us
I20260709 12:12:21.396234 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:21.400635 26619 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:21.401738 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:21.296166 32696 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:21.361691   404 consensus_queue.cc:1059] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 12:12:21.363886   390 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:21.370898 32670 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:12:21.370522 32497 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.417903 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:21.421222 27166 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 12:12:21.423231 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.363371   431 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 12:12:21.422178   471 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:12:21.428318   470 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:12:21.372367 32747 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 12:12:21.361665 32745 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:21.436259 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.349236   351 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
W20260709 12:12:21.436765 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 106119us
I20260709 12:12:21.348939 32721 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:21.420539 32457 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:21.457211 32541 consensus_meta.cc:287] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.675s	user 0.012s	sys 0.004s
I20260709 12:12:21.429062 32497 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:21.483345   479 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:12:21.483971 32497 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:21.410447   311 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:21.486912 32760 consensus_meta.cc:287] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.732s	user 0.005s	sys 0.005s
I20260709 12:12:21.488543   396 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:21.480837   350 consensus_meta.cc:287] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.001s
I20260709 12:12:21.489360   350 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:21.429060   422 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:21.442782   390 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:21.492439   350 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:21.510882 26365 catalog_manager.cc:5697] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 12 to 13, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 13 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:12:21.519781   484 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:12:21.413936   469 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:21.524837 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.462585 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:21.538826 26618 raft_consensus.cc:2368] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 18. Current term is 19.
I20260709 12:12:21.563306 32541 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:21.565133   481 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:21.565559   481 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:21.566385   481 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:21.567824   481 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:21.572685 32721 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:21.573599   454 consensus_meta.cc:287] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.003s
I20260709 12:12:21.574188   454 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:21.577332   454 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:21.579509 32745 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:21.581918 32544 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:21.588133   423 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.571s	user 0.013s	sys 0.013s
I20260709 12:12:21.598009 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:21.600694 27166 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:21.598682 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 157310us
I20260709 12:12:21.578118   454 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.584367   335 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 12:12:21.605422 32696 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:21.598665 26365 catalog_manager.cc:5697] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 9 to 10, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65), VOTER ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66), VOTER aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67), VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 13 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:21.608508   469 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:21.608332 26365 catalog_manager.cc:5697] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 14 to 18, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 18 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:21.589332   424 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:12:21.609783   390 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:21.611008   372 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.001s
I20260709 12:12:21.611554   372 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:21.605584   454 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:21.601358   490 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.616297   454 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:21.616442   490 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:21.618508   329 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:21.621237   379 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.653s	user 0.007s	sys 0.005s
I20260709 12:12:21.621086   391 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:21.621749   379 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:21.600615 32760 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.627244 32745 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.627444 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:21.627606 32760 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:21.628080 27159 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:12:21.627878 32745 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:21.629863 32760 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:21.625988 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 163491us
I20260709 12:12:21.630611   372 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:21.631906 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:21.632975   379 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:21.617455 32698 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.587s	user 0.008s	sys 0.002s
I20260709 12:12:21.633683   379 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:21.633780 32698 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:21.636862 32698 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:21.638146   490 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:21.638706 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:21.641283 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:21.642050 27161 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:21.626528   341 raft_consensus.cc:697] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:21.604578   352 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:21.630052   367 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.643432   352 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:21.643472   367 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:21.643720   341 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:21.644191   352 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:21.646023   367 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:21.603030 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:21.648602 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:21.648895 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 45950.8us
I20260709 12:12:21.649442 27159 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 19: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:21.630200 32745 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:21.650441   372 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:21.650758 32745 consensus_queue.cc:1059] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:21.646695   352 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:21.651895 32745 raft_consensus.cc:3055] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:21.652267 32745 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:21.653699 32721 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:21.654055   391 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:21.604995   423 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:21.657691 26539 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:21.659322 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:21.682976 26542 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:21.683251 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:21.660138 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:21.684520 26546 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:21.685703 26468 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:21.685830 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:21.686762 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:21.660568 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 238978us
I20260709 12:12:21.662482 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:21.687700 26621 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:12:21.609984 26365 catalog_manager.cc:5697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 15 to 22, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 22 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:21.690635 26545 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:21.692677 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:21.693320 26469 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:21.692050 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:21.694782 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:21.695489 27159 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:21.679977 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:21.697113 26613 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:21.680379 26472 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:21.664994 26467 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 12:12:21.683856 26544 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:12:21.702872 26467 pending_rounds.cc:85] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 10
I20260709 12:12:21.703379 26467 pending_rounds.cc:107] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:12:21.703724 26467 raft_consensus.cc:2889] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:21.705531 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:21.706490 27166 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:21.666568 26471 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:12:21.727052 26471 pending_rounds.cc:85] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 9
I20260709 12:12:21.727380 26471 pending_rounds.cc:107] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:12:21.727664 26471 raft_consensus.cc:2889] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:21.726034 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:21.689231 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:21.729117 26539 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:21.730276 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:21.731056 26539 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 24: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:21.730882 32504 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:21.731971 32504 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:21.687947 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:21.732580 32504 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:21.707844 26545 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:21.692123 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:21.737090 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:21.711602 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:21.743505 26465 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:21.707875 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:21.700107 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:21.708743 26439 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:21.693099 26588 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:21.711042 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:21.745956 26467 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:21.713142 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:21.715953 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:21.672880   491 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.185s	user 0.000s	sys 0.007s
I20260709 12:12:21.747709 27159 raft_consensus.cc:2410] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 19 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:12:21.715466 26621 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:21.722339 26547 raft_consensus.cc:2368] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23.
I20260709 12:12:21.749476 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:21.722570 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:21.653180 32745 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:21.754215 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44112.5us
W20260709 12:12:21.755461 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 46813.9us
I20260709 12:12:21.757189 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:21.757927 26617 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:21.758958 26473 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 17: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:12:21.801268 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 58438.5us
I20260709 12:12:21.801601 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:21.802027 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 109013us
I20260709 12:12:21.803764 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:21.804625 26621 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:21.647882   311 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:21.815384 26469 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:21.821007 26621 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
I20260709 12:12:21.837733 26617 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 17: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:21.714870   480 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:21.820039 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 65095.6us
I20260709 12:12:21.841233 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:21.842013 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 84537.6us
I20260709 12:12:21.721983 32724 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.858207 26539 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:21.856961 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:21.735416   463 raft_consensus.cc:2764] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 12:12:21.819176 32574 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:21.838765   329 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:21.864984 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:21.855989   465 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:12:21.717949   391 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.131s
I20260709 12:12:21.842270   473 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:21.886062 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:21.888260 26466 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:21.888085 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:21.799360   429 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:12:21.894219 26467 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:21.889031 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:21.859419 32731 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.895653 26468 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:21.859366   311 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.857463 32567 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 12:12:21.903859   494 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.906878   494 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:21.907449 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:21.909628   493 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:21.864943   443 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:12:21.910264   493 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:21.893899   473 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.884923   329 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:21.910885   473 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:21.911049   329 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:21.911334   493 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:21.864126 32724 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:21.912850   311 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:21.902253   495 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.914739   495 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:21.876574   482 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:12:21.917281   423 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:21.848281 32682 consensus_queue.cc:1059] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:12:21.902217 32574 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.919102 32574 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:21.918841 26365 catalog_manager.cc:5697] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:21.905848 32723 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:12:21.920814 26365 catalog_manager.cc:5697] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:21.922262 32574 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:21.923302 32731 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:21.956315 27164 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:21.854537   480 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:21.859501 32272 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.266s
I20260709 12:12:22.184378 26613 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:22.195662 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:22.197218 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 309215us
I20260709 12:12:22.197374 26617 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
W20260709 12:12:22.128895   390 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.027s	sys 0.020s
I20260709 12:12:22.184427 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:22.188966 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:22.196915 26615 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:22.192207 26514 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:22.198827 26539 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:22.186022 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2864) took 1145 ms. Trace:
I20260709 12:12:22.216168 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:22.222568 26620 rpcz_store.cc:276] 0709 12:12:21.040219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.045100 (+  4881us) service_pool.cc:224] Handling call
0709 12:12:21.091152 (+ 46052us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:21.350557 (+259405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.989340 (+638783us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54003a4654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:22.185959 (+196619us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589782912}
I20260709 12:12:22.207038 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:22.224390 26621 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:22.205334 32497 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:22.229945 32497 raft_consensus.cc:697] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:22.190886 32692 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:22.232051 32692 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:22.201408   500 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.221773   481 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:22.225315   417 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.234354 32692 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:22.239540 32692 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.239993 32692 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:22.222884   447 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.807s	user 0.021s	sys 0.000s
I20260709 12:12:22.241988 32692 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:22.193964   445 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:12:22.201915   390 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.029s	sys 0.021s
I20260709 12:12:22.235388   481 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.247211   451 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:12:22.238888 32724 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:22.238258   480 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:22.236974   311 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:22.234967   500 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:22.259832   481 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:22.242020   447 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.256922   341 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:22.237759   417 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.267210 32724 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.332958 32724 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.338744   500 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:22.257480   445 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:22.353612   417 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:22.356400   447 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:22.330569   494 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:22.331708   495 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:22.332041   341 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.335520 32731 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:22.373885   445 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:22.409191   341 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:22.393460   473 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.453027   473 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:21.952535 26365 catalog_manager.cc:5697] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:22.503783 26365 catalog_manager.cc:5697] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:22.508288 26365 catalog_manager.cc:5697] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:22.523370 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 324942us
I20260709 12:12:22.534698 26464 raft_consensus.cc:2368] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20.
I20260709 12:12:22.194778 26467 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
W20260709 12:12:22.545807 26513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.009s	sys 0.009s
W20260709 12:12:22.554008 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:22.554697 26473 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.000s	sys 0.009s
W20260709 12:12:22.559041 26513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.009s	sys 0.009s
W20260709 12:12:22.565487 26547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2769) took 1599 ms (client timeout 1939 ms). Trace:
W20260709 12:12:22.566349 26547 rpcz_store.cc:269] 0709 12:12:20.965712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.966555 (+   843us) service_pool.cc:224] Handling call
0709 12:12:22.564786 (+1598231us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b54003971d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:22.565183 (+   397us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1735616768}
W20260709 12:12:22.571308 26473 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.000s	sys 0.010s
I20260709 12:12:22.573900 26621 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
W20260709 12:12:22.574730 26587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.017s	sys 0.029s
W20260709 12:12:22.575294 26587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.017s	sys 0.029s
W20260709 12:12:22.575745 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 730361us
I20260709 12:12:22.376461 32724 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:22.569854 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:22.602919   495 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:22.604245   508 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:22.609620 26514 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:22.237092 32497 consensus_queue.cc:237] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:22.626252   493 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.626833   500 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:22.626490   495 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.629817   502 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:22.626365 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:22.635079   502 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:22.637531   445 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.638605 32544 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:22.639581 32544 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:22.640743   508 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.610806   311 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:22.643139   311 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.645026   341 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.645910   341 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.646752   445 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.647815 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:22.649370   504 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:12:22.649758   445 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:22.650220   417 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:22.627408   493 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.651134   417 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.652869   493 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:22.653517   493 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.653628   417 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:22.631107 32682 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.654990   493 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.655309 32682 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:22.658578 26588 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:22.604637   481 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.661602 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:22.638213 32731 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:22.680856 32457 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.662310 26539 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 8.
W20260709 12:12:22.680120 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 71002.5us
I20260709 12:12:22.691710 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:22.691785 26514 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:22.662909   481 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:22.649622 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:22.669541 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:22.646155   311 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:22.698323 32544 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:22.673041 26540 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:22.693796   481 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:22.695297   508 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:22.679656   379 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.662683   480 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:22.629918   500 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:22.713959 26465 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.963s	user 0.002s	sys 0.021s
I20260709 12:12:22.714915   417 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.714640 32457 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.715734 32541 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:22.715893 32544 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:22.717396 32670 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:22.728147 32670 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:12:22.712641 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 134220us
I20260709 12:12:22.717154   379 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:22.721920   508 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.721834 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:22.725730 26465 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:12:22.723636   500 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:22.727169 32457 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:22.729741 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:22.724066   502 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:22.717211   447 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.725260   481 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:22.740495 26618 raft_consensus.cc:2410] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:12:22.735553   493 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:22.746136 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 122621us
I20260709 12:12:22.746588   417 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:22.747203   379 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:22.749380 26546 consensus_meta.cc:287] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.064s	user 0.024s	sys 0.045s
I20260709 12:12:22.733150 32544 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.751618 26539 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20. Ops: []
W20260709 12:12:22.755278 26585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.004s	sys 0.007s
I20260709 12:12:22.758632   447 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:22.765233   447 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:22.768424   417 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:22.768227   508 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.771593 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:22.729854 32670 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.776162 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:22.776803 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:22.777082 27161 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:22.777633 27166 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:22.772668 27159 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 9.
I20260709 12:12:22.778895 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:22.779696 26622 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 9.
I20260709 12:12:22.781014   495 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:22.781836   495 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:22.782497   493 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:22.783342   493 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.785488 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:22.786034   493 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:22.786690   445 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:22.789047 26546 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
W20260709 12:12:22.789769 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 83585.5us
I20260709 12:12:22.792181 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:22.792273 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:22.766276 32544 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:22.796424 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:22.797124 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:22.814379 27159 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:22.775497   481 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:22.800906 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:22.803520 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:22.802213 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:22.805011   468 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:22.805313 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:22.807679 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:22.815651 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 225104us
I20260709 12:12:22.806646   495 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.844280 26622 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 9: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:22.840691 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 2640) took 1183 ms. Trace:
I20260709 12:12:22.846374 26546 rpcz_store.cc:276] 0709 12:12:21.657696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.659887 (+  2191us) service_pool.cc:224] Handling call
0709 12:12:22.831109 (+1171222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:22.852833 27161 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:22.854923 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2642) took 1079 ms. Trace:
I20260709 12:12:22.755091   480 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:22.863327 26618 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
I20260709 12:12:22.845633   445 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:22.845064 32544 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:22.871021 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:22.855439 26542 rpcz_store.cc:276] 0709 12:12:21.658258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.684030 (+ 25772us) service_pool.cc:224] Handling call
0709 12:12:21.721599 (+ 37569us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:22.185494 (+463895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:22.185528 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:22.186045 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 12:12:22.703088 (+517043us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:22.711735 (+  8647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:22.724387 (+ 12652us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:22.724467 (+    80us) raft_consensus.cc:1685] finished
0709 12:12:22.724484 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:22.738006 (+ 13522us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116389,"raft.queue_time_us":120778,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":10968,"thread_start_us":358287,"threads_started":2,"wal-append.queue_time_us":473310}
I20260709 12:12:22.876052 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2663) took 1046 ms. Trace:
I20260709 12:12:22.874501 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:22.881753 26620 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:22.893380 32747 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.893446 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:22.894788 26619 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:22.894649 32747 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.897430 32747 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:22.899540 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:22.900605 26465 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
W20260709 12:12:22.903102   404 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.453s	user 0.035s	sys 0.056s
I20260709 12:12:22.908703   516 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:22.910043   516 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.912184   468 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:22.913156   341 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:22.913667 32721 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:22.914475 32721 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:22.915594 32541 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.916133 32541 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:22.917104 32721 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:22.856600   493 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:12:22.904894   404 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.470s	user 0.036s	sys 0.057s
I20260709 12:12:22.903472 26613 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
W20260709 12:12:22.936911 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 80719us
I20260709 12:12:22.940052   508 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:22.940236   445 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:22.883011 26473 rpcz_store.cc:276] 0709 12:12:21.812139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.812311 (+   172us) service_pool.cc:224] Handling call
0709 12:12:21.812804 (+   493us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:21.856070 (+ 43266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:21.856103 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:21.859930 (+  3827us) log.cc:844] Serialized 52 byte log entry
0709 12:12:22.572394 (+712464us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:22.597670 (+ 25276us) log.cc:844] Serialized 14 byte log entry
0709 12:12:22.810263 (+212593us) log.cc:844] Serialized 14 byte log entry
0709 12:12:22.811848 (+  1585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:22.839429 (+ 27581us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:22.839509 (+    80us) raft_consensus.cc:1685] finished
0709 12:12:22.839528 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:22.858482 (+ 18954us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78631,"prepare.queue_time_us":25150,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":108,"raft.queue_time_us":152474,"raft.run_cpu_time_us":528,"raft.run_wall_time_us":26823,"thread_start_us":798102,"threads_started":3,"wal-append.queue_time_us":564101}
I20260709 12:12:22.933408 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:22.961738 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:22.983059 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:22.984201 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:22.984834   480 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:22.985188 26514 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:22.985673   480 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:12:22.986680   379 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:22.986812 32567 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:22.987439   379 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.987968   379 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:22.988816   329 consensus_meta.cc:287] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.077s	user 0.007s	sys 0.025s
I20260709 12:12:22.991617   424 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:22.992129   424 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.992508   424 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:22.993152 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:22.986675 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2781) took 1126 ms. Trace:
I20260709 12:12:22.994324 26547 rpcz_store.cc:276] 0709 12:12:21.860271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.719779 (+859508us) service_pool.cc:224] Handling call
0709 12:12:22.743151 (+ 23372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:22.915788 (+172637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:22.915842 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:22.915923 (+    81us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:22.916013 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:22.986281 (+ 70268us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54003cf354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:22.986345 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:22.986562 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321398528}
I20260709 12:12:22.931097 32544 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:22.980690 32504 consensus_meta.cc:287] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.247s	user 0.013s	sys 0.015s
I20260709 12:12:22.999100 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2634) took 1709 ms. Trace:
I20260709 12:12:22.980607   466 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:22.986245   480 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:23.008934 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:22.989347   329 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.011889 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:23.008622   466 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.015836   489 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:23.017396 32715 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:23.026916   422 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.027746   422 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.031327   495 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:23.032176 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 984) took 1695 ms. Trace:
I20260709 12:12:23.006183   311 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:23.034564   311 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:23.034638   524 consensus_queue.cc:1059] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:23.036357   524 raft_consensus.cc:3055] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:23.035984   311 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.036751   524 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:23.038985 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:23.039342   468 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:23.039769 26469 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:23.040123   329 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:23.041260 26547 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 19: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:23.041442 32544 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:23.042073 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.042412 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:23.016010 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:23.016031 26465 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:23.013937   480 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:12:23.026127   466 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:23.016341 27161 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:23.013268 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:23.045302 26547 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:23.054592 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:23.018217   481 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:23.032680 26548 rpcz_store.cc:276] 0709 12:12:21.310743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.323700 (+ 12957us) service_pool.cc:224] Handling call
0709 12:12:21.324058 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:21.592276 (+268218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:21.592327 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:21.600441 (+  8114us) log.cc:844] Serialized 26 byte log entry
0709 12:12:21.859929 (+259488us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:22.870592 (+1010663us) log.cc:844] Serialized 14 byte log entry
0709 12:12:22.961552 (+ 90960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:22.989948 (+ 28396us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:22.995111 (+  5163us) raft_consensus.cc:1685] finished
0709 12:12:22.995131 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:23.006044 (+ 10913us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":934519,"prepare.queue_time_us":933830,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":45,"raft.queue_time_us":44367,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":16649,"thread_start_us":548616,"threads_started":3,"wal-append.queue_time_us":317675}
I20260709 12:12:23.057930 27166 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:12:23.061682 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:23.010618 32504 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.064474 32504 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:23.065593 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:23.066596 27159 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:12:23.070802 26544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 2632) took 1968 ms (client timeout 2291 ms). Trace:
W20260709 12:12:23.071338 26544 rpcz_store.cc:269] 0709 12:12:21.102192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.102497 (+   305us) service_pool.cc:224] Handling call
0709 12:12:23.046953 (+1944456us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b5400140354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:23.070568 (+ 23615us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1087153536}
I20260709 12:12:23.072141   516 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:23.072809 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2776) took 2053 ms. Trace:
I20260709 12:12:23.003129 26543 rpcz_store.cc:276] 0709 12:12:21.254425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.254877 (+   452us) service_pool.cc:224] Handling call
0709 12:12:21.255173 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:21.255347 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:21.308585 (+ 53238us) log.cc:844] Serialized 14 byte log entry
0709 12:12:21.635200 (+326615us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b18003e6b60. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:12:22.793607 (+1158407us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b18003e6b60. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5072fefa40 00007f5072fea4e4 00007f5072fea455 00007f5079ad23c7 00007f50760e49a7 00007f50760f40bf 00007f50760f4038
0709 12:12:22.794152 (+   545us) log.cc:844] Serialized 14 byte log entry
0709 12:12:22.862993 (+ 68841us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:22.876013 (+ 13020us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:22.926832 (+ 50819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:22.934853 (+  8021us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:22.963539 (+ 28686us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1177790,"prepare.queue_time_us":1533154,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":80,"raft.queue_time_us":22088,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":45165,"spinlock_wait_cycles":51837312,"thread_start_us":48608,"threads_started":1,"wal-append.queue_time_us":47449}
I20260709 12:12:23.073175 26541 rpcz_store.cc:276] 0709 12:12:20.992771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.007820 (+ 15049us) service_pool.cc:224] Handling call
0709 12:12:21.008308 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:21.008819 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:21.008856 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:21.009428 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 12:12:21.303642 (+294214us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:22.857105 (+1553463us) log.cc:844] Serialized 14 byte log entry
0709 12:12:23.008660 (+151555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:23.014291 (+  5631us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:23.024779 (+ 10488us) raft_consensus.cc:1685] finished
0709 12:12:23.024802 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:23.045637 (+ 20835us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1490255,"prepare.queue_time_us":1491296,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":19890,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":22503,"thread_start_us":331681,"threads_started":3,"wal-append.queue_time_us":496865,"wal-append.run_cpu_time_us":3840,"wal-append.run_wall_time_us":1204157}
I20260709 12:12:23.072620 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:23.076316 32721 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:23.076687   429 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:23.077052 32721 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.077620   429 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.082314 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.085108 26621 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:23.085306 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:23.076663 26544 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 18: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:23.003187   493 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.095480   493 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:23.096948 26622 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:23.037885   524 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.098639   524 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:23.098726 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.095350 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.100360 26613 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:23.100593 32682 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:23.086133   429 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:23.105613 27134 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:23.086118 26469 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
W20260709 12:12:23.113955 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 127541us
I20260709 12:12:23.118189 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.119057 26618 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:23.118849 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.120489 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:23.121560   388 raft_consensus.cc:3055] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:23.122031   388 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:23.122534 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:12:23.123359 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 108477us
I20260709 12:12:23.125212   463 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:23.125474   335 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:23.125764   463 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:23.126374   463 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.126261   335 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.128631 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:23.129042   335 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:23.130016 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:23.133332   391 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:23.133816   391 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.134179   391 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:23.134766 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:23.136734   379 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.136752 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:23.137702   451 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.139153   451 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.139971 32721 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:23.141477   451 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:23.137130 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:23.142928   429 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:23.141507 32745 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:23.162181   424 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.164731   424 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:23.169252 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:23.170383 32691 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:23.153874   480 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.170830   530 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:23.171479 26548 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 9.
I20260709 12:12:23.171607   530 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:23.170902 32691 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:23.172885 32691 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.175719 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:23.164393   429 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.156000   469 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:12:23.156066 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 50916.7us
I20260709 12:12:23.156894   388 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.160933 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2875) took 1444 ms. Trace:
I20260709 12:12:23.152858   391 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.180539 26547 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:23.185220 26472 raft_consensus.cc:2410] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:12:23.193898   480 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:23.088039   422 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:23.190933 27159 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:12:23.189572 26615 rpcz_store.cc:276] 0709 12:12:21.716766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.716987 (+   221us) service_pool.cc:224] Handling call
0709 12:12:22.196724 (+479737us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:22.205066 (+  8342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:23.160429 (+955363us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54001b0650. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:23.160711 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1102574976}
I20260709 12:12:23.201380 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:23.215658 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:23.217837 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:23.218111 26541 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.212925 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:23.219280 26473 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:23.179384   466 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.228048 26472 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 17: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:23.224241 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:23.237648 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 385524us
I20260709 12:12:23.194973   516 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:12:23.239454   379 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:23.239557 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:23.240288   473 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:23.240509   391 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:23.223034 32670 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:23.244918   466 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:23.210605   469 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 19 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:23.258868   451 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:23.259647   451 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.259963   469 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.172912   530 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.261736   429 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:23.258100   324 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:23.239487 32574 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.263093   324 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.263478 32574 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.265514   324 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:23.258280   329 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:23.253351 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:23.267110   329 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.275069 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:23.277307   329 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:23.278151 26539 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:23.271411 32670 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.272711 27134 leader_election.cc:400] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 18. Current term is 19.
W20260709 12:12:23.280349 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 72618.3us
I20260709 12:12:23.280650 32670 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:23.281518 27134 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:23.282238   480 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:23.272751 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2647) took 1089 ms. Trace:
I20260709 12:12:23.282799   480 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.283023   514 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:23.283368   480 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:23.283675   514 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.284140   514 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:23.284916   481 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:23.285615   481 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:23.286861 27133 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.569s (SENT) [suppressed 10 similar messages]
W20260709 12:12:23.288049 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 113180us
I20260709 12:12:23.258057   473 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.282908 26540 rpcz_store.cc:276] 0709 12:12:22.183879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.830319 (+646440us) service_pool.cc:224] Handling call
0709 12:12:22.880234 (+ 49915us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:22.880814 (+   580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:22.880842 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:22.888517 (+  7675us) log.cc:844] Serialized 26 byte log entry
0709 12:12:23.057221 (+168704us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:23.117563 (+ 60342us) log.cc:844] Serialized 14 byte log entry
0709 12:12:23.171217 (+ 53654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:23.171298 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:23.172366 (+  1068us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b4800270258. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507b003aa1 00007f507affab37 00007f507affa9ca 00007f507b0f226f 00007f507b0f1f37 00007f507b10655c 00007f507b106508 00007f507b106488 00007f507b106443 00007f507b1056ec 00007f507a02fa96
0709 12:12:23.272412 (+100046us) raft_consensus.cc:1685] finished
0709 12:12:23.272521 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:23.272684 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53284,"prepare.queue_time_us":60785,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":54732,"raft.run_cpu_time_us":2568,"raft.run_wall_time_us":287623,"spinlock_wait_cycles":36658048,"thread_start_us":66710,"threads_started":1,"wal-append.queue_time_us":271947}
I20260709 12:12:23.262156   451 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:23.292692 32698 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:23.293079   447 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:23.293256 32698 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:23.294566 26514 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:23.292918 26438 leader_election.cc:400] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23.
I20260709 12:12:23.296733 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:23.302455 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 88608.4us
I20260709 12:12:23.296370 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:23.266355 32574 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:23.307168 26473 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:23.310120   379 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:23.319721   379 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.323874   416 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.323684   391 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:23.324636   391 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.323884   417 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:23.325934 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:23.326076   417 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.326835 26467 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:23.324625   416 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.328351   417 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:23.329023   388 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:23.317375   466 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.329303   416 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:23.329905   391 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:23.329794   466 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.330679 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:23.331626   416 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:23.332234 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:23.333055   416 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:23.333454   416 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.333796   416 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.333956   466 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:23.320096   379 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.335059   443 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:23.335517   443 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.335882   443 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:23.339793 26465 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:23.342083 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:23.342819 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:23.343549 26470 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
I20260709 12:12:23.344118 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:23.344727 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:23.345788 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.346129   329 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:23.346535 26618 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:23.346624   329 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:23.346868 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:23.347136   329 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.347937 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:23.320808   422 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:23.351395 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.351212   422 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.352608   481 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:23.353304 27134 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:23.354605 27134 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:23.354897   524 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:23.355445   524 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.355837   524 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:23.356009   335 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:23.356572   335 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.356936   335 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.342864 26464 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 20.
I20260709 12:12:23.358659 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:23.354800   463 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.347270 26619 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 12:12:23.320397 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.362094 26472 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:12:23.370643 26541 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:23.354193   422 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:23.373668 27159 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 12:12:23.364501 26615 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:23.374662 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.380306 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.380918 26620 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:23.383303 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:23.379591 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:23.391583 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:23.391901 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:23.390168 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:23.394927 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 117655us
I20260709 12:12:23.343321   416 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.310269 32541 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.371068 32670 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:23.403470 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:23.373642   404 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:12:23.400168 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 113353us
I20260709 12:12:23.404461 26614 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:23.407243 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.396400 27166 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:12:23.407904 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.417822 26472 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:12:23.411710 26439 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:23.394649   488 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:23.411337 26617 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:23.403201 32670 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.424256 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:23.429664 26544 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:23.425886 26588 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:23.274225 32691 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.405485 32721 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:23.436067 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 54387.5us
I20260709 12:12:23.441524 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:23.442417 26539 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:23.443611 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.431896 32670 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:23.448575 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:23.449445 27159 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:23.453034 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:23.453583   416 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:23.454514 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:23.455946   463 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:23.458657   444 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:12:23.459398   444 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:23.460544   444 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.461977 32541 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:23.431597   466 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:23.463474   466 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.463940   466 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:23.438022   417 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:23.474356 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:23.447994 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:23.475792 26620 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.466511   431 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
W20260709 12:12:23.479691 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 53921.4us
I20260709 12:12:23.476822 26614 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:23.480966 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.477286 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:23.481639 26614 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
I20260709 12:12:23.476771 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.495013 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.495589 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.492877 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:23.493114 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:23.503175   514 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.508245 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:23.450135 32721 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:23.498193 27164 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:23.510651 26539 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:23.514117 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:23.413195 32698 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.438352   447 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:12:23.422305   404 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.515568 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:23.514868 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 78872.9us
I20260709 12:12:23.512247 26439 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:23.527187 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:23.528744 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:23.528771 26541 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:23.531814 27168 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:23.532091 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.533198 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.506383   514 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:23.525786 26542 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:23.509225   422 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:23.577270 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.513432   530 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:23.506340   335 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.580479 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:23.575989 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:23.582373 26543 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:23.516865   417 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:12:23.584381 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 153817us
W20260709 12:12:23.585712 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 53982.5us
I20260709 12:12:23.580142   422 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:12:23.597152 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 97689.6us
I20260709 12:12:23.597214 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:23.598207 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:23.599119 26541 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 18: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:23.602859 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:23.603562 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:23.610443   518 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:23.611002   518 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.611104   404 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:23.611495   518 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.612251 26513 leader_election.cc:400] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20.
I20260709 12:12:23.612609 26513 leader_election.cc:403] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:23.614723 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:23.614912 26620 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:23.615609 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:23.617290 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:23.618863 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:23.619274 32721 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.619513   530 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.620247 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:23.621657 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:23.622279 26464 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:23.627969 32670 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.634838 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:23.639410 32400 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:23.643098 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:23.644969 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:23.646852   416 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:23.647553   416 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:23.647202   417 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.648204 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:23.649029 27167 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:23.652266 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:23.653172 27160 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.654851 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:23.655715 27162 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.656190 32691 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:23.657174 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:23.618544   469 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:23.646718 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:23.659587 27161 raft_consensus.cc:2368] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18.
I20260709 12:12:23.650180 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:23.618238 27164 raft_consensus.cc:2368] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10.
I20260709 12:12:23.648614   416 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.674117 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:23.674472 26548 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:12:23.662873 27167 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:23.681326 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.681511 26544 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:12:23.584199 32731 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.682931 26615 raft_consensus.cc:2368] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10.
I20260709 12:12:23.682147 27168 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:23.666112 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:23.690092 26473 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:12:23.691007 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 56702.2us
I20260709 12:12:23.693300 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:23.695883 26439 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:23.600055   422 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.707892 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:23.716120 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:23.720247 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:23.719897 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:23.676599   530 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:23.742213 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 49170.4us
I20260709 12:12:23.743155 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:23.744817 26465 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:12:23.749012 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:23.752938   416 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:23.754894 27133 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:23.718500   463 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:23.756330   463 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.756759   463 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:23.757392   466 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.722810 32731 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.761461 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:23.762639 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:23.763496 26541 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 19: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:23.766362 26470 raft_consensus.cc:2368] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20.
W20260709 12:12:23.771675 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 134266us
I20260709 12:12:23.750082   324 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:23.693929   524 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.780664 26542 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:12:23.736819   447 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:23.749605   388 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.785300 26464 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:12:23.787554 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:23.785529 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:23.775115   503 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:23.795291   503 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:23.773837   445 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:23.803682 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:23.809303 32437 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:23.809888 32437 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:23.810359 32437 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:23.813746 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:23.791041 32698 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:23.825330 27159 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 20: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:23.773998   329 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.799568   503 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.800882   335 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:23.838490 26588 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:23.825290 32504 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:23.845999   524 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:23.798087 32574 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:23.796459   324 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:23.835950   473 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:23.859107 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.791787   379 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.869056 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:23.873765 26616 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:23.874641 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:23.828573   404 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:23.881732 26621 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.803423   447 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.807309   388 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.905531   422 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.901433   379 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:23.903427   329 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:23.905441   480 consensus_meta.cc:287] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.621s	user 0.005s	sys 0.006s
I20260709 12:12:23.906844   324 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.871394   506 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:23.824731   445 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.908473 27163 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:23.900878 26546 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:23.869406 32574 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.920790 27162 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:23.907612   388 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:23.921409 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 193894us
I20260709 12:12:23.892688   473 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:23.953568 32731 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:23.939436 32574 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:23.957412 26545 consensus_meta.cc:287] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.002s
I20260709 12:12:23.957854 26545 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:12:23.960237 27160 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
W20260709 12:12:23.975801 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 220987us
I20260709 12:12:23.949524   473 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:23.934291   480 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:23.939401   518 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:23.988662   466 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:23.989269   473 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:23.971022   506 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:24.025434 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:24.035259 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:24.039338 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:24.036243 26470 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:24.043766 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:24.044891 26471 raft_consensus.cc:2410] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:12:24.050745 26621 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
W20260709 12:12:24.035211   547 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:12:24.056689 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:24.050765 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 242263us
I20260709 12:12:24.065991 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:24.068535 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:24.069275 27167 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:24.075667 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:24.076565 26464 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 19: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:24.069662 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:24.086130 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:24.088058   551 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:12:24.099951 32670 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:24.106062   480 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:24.071080   431 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:24.107455   422 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:24.110883 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:24.111967 26621 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:24.113070   488 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.113161 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:24.113760   488 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:24.116185   488 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:24.118114 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:24.118822 26468 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
W20260709 12:12:24.118878 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 178342us
I20260709 12:12:24.119052 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:24.119910 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:24.121042 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:24.122696   530 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:24.122817 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:24.123739 32682 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:24.124182 32682 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:24.124536 32682 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:24.125638 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:24.111100   518 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:24.126420 26473 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.109882 26588 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:24.123119   530 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:12:24.128007 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 188996us
I20260709 12:12:24.134653 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:24.137925 26617 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:12:24.140101 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:24.084854   443 consensus_meta.cc:287] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.744s	user 0.010s	sys 0.003s
I20260709 12:12:24.074752 32504 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:24.146193 26548 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:24.082974 32721 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:24.158703 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:24.159569 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:24.165807 27161 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 10: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:24.163897 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:24.160180 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:24.162765 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:24.166796 26615 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:24.145282   547 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:12:24.167222 26514 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:24.167948 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:24.145143   530 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:24.172994 26514 leader_election.cc:400] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10.
I20260709 12:12:24.175164 26514 leader_election.cc:403] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:12:24.168821   447 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:24.164374   417 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
I20260709 12:12:24.172101   480 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:12:24.178162   417 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:24.178601   417 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:24.158771 32745 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:24.179925 32745 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:24.179594   417 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:24.180851 32745 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:24.148993   429 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:24.159060   443 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:24.172199   555 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.021s
I20260709 12:12:24.185647   443 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:24.186532   445 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:24.182585   463 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:24.191314 26615 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:24.176249 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:24.193300 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:24.193944 26617 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:24.169818   329 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:12:24.198745 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:24.199393 27166 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:24.168987   451 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:12:24.169528   311 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20.
W20260709 12:12:24.210309   554 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:12:24.211229   506 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:24.211333 32670 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:24.189836 32574 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:24.214666   516 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:24.225363   516 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:24.226974 32574 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:24.219081 26545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2777) took 2362 ms (client timeout 2239 ms). Trace:
W20260709 12:12:24.228191 26545 rpcz_store.cc:269] 0709 12:12:21.856258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.856685 (+   427us) service_pool.cc:224] Handling call
0709 12:12:24.218808 (+2362123us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400338bd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:24.218966 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3350427392}
I20260709 12:12:24.210912 26617 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:24.222759 26470 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 15: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:24.211069   473 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:24.234340   473 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:24.237639 32437 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:24.238935   480 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:24.189235   488 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:24.240201 27164 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 21: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:24.241457   463 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:24.244585 26473 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:24.226563   516 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:24.244696 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:24.244827 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 68711.7us
I20260709 12:12:24.263652 27166 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:24.273324   417 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:24.278527 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:24.280097 26617 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:24.288841 27161 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:12:24.288971 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:24.289891 26545 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:24.290208 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:24.255908 27134 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:24.282636 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:24.284951 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 73805.5us
I20260709 12:12:24.291986 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:24.286717 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:24.292837 27160 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:24.287111 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:24.294905 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:24.296223 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:24.297240 26548 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 18: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:24.308317 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:24.310261 26544 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:24.313834 27167 raft_consensus.cc:2368] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21.
I20260709 12:12:24.310846 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:24.310941 26588 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:24.249809 32574 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:24.314913 26615 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:24.316514 26541 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:24.325321 26588 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:24.328260 26616 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:24.242827 32504 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:24.343276 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:24.343494 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:24.344038 26622 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:24.344071 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:24.346943 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:24.348829 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:24.353792 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:24.354312 26587 leader_election.cc:400] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20.
I20260709 12:12:24.354843 26587 leader_election.cc:403] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:12:24.330035 32437 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:24.356842 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:24.361763 26619 raft_consensus.cc:2368] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20.
I20260709 12:12:24.361899 27160 raft_consensus.cc:2368] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20.
W20260709 12:12:24.345449 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 223096us
I20260709 12:12:24.363250 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:24.366807 26588 leader_election.cc:400] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21.
I20260709 12:12:24.367514 26588 leader_election.cc:403] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:12:24.362679 26621 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: [22.11-22.11]
I20260709 12:12:24.369436 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:24.315416 32574 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.373553 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:24.322516   516 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:24.374408 26613 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:24.318293   567 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:24.380050   561 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:24.384104 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:24.384528   561 raft_consensus.cc:697] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 18 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:24.384200 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:24.299326 32721 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 12:12:24.388634   518 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:24.389130   530 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:24.389477   518 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:24.390516   552 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:24.391152   552 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:24.391465 26615 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:12:24.392129   518 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:24.392118   552 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:24.392606   568 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:12:24.393980 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.375142   324 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 12:12:24.394959   568 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:24.395330   568 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:24.396157   568 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:24.397243   568 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:24.398171   553 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.398839   553 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:24.345400   451 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:24.344347 32670 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:24.381408 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:24.402042 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:24.403264 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:24.406327 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:24.413491 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 46916.6us
W20260709 12:12:24.422302 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 211063us
W20260709 12:12:24.427794 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 48094.1us
I20260709 12:12:24.429816 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:24.431068 26614 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:24.435563 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:24.439535 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:24.440776 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:24.441039 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48673.9us
I20260709 12:12:24.441812 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:24.378994   473 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:24.439999 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:24.441087 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:24.439733 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:24.377743 32574 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:24.353442   391 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.063s
I20260709 12:12:24.452781 26613 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:24.454694 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:24.458839 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:24.458855 26543 raft_consensus.cc:2368] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19.
I20260709 12:12:24.465317 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:24.411111   451 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:24.400720 32682 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:24.462070 26547 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:12:24.459327 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:24.462332 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:24.473249 26543 raft_consensus.cc:2393] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 16: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:24.474786   518 raft_consensus.cc:2764] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:12:24.472884 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:24.462685 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:24.466851 26539 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:24.478005 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:24.482734 26540 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.458633   463 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:24.487514 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:24.427507   445 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21.
I20260709 12:12:24.495165   530 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:24.463184   469 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:24.481938 32400 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:24.497037 26514 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:24.496732   561 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:24.498096 26438 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:24.469374   473 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:24.498353 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:24.500366 26439 leader_election.cc:400] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20.
I20260709 12:12:24.516319 26439 leader_election.cc:403] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:12:24.516381 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:24.498721 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:24.467944   379 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:24.481500   404 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:24.470592   451 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:24.517716 26546 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:24.520565 26439 leader_election.cc:400] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20.
I20260709 12:12:24.525454 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:24.520383 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:24.526855 26543 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:24.459293   555 consensus_queue.cc:1059] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 12:12:24.527333 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.528111 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:24.528491 26547 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:24.539499 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:24.486977   518 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:24.548070 26543 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:24.549151 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:24.551183 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:24.499629   422 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:24.562785 26540 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
W20260709 12:12:24.563364 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 89837us
I20260709 12:12:24.564733 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:24.564780 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 66510.9us
I20260709 12:12:24.568311 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:24.499505   553 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:24.499006   463 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:24.514382   560 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:24.571514 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 46167.2us
I20260709 12:12:24.575862 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:24.576576 26467 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:24.524128   447 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:24.576503 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:24.571969 27167 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 20: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:24.570638 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:24.528653   557 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:24.572532 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:24.569628 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:24.574762 26514 leader_election.cc:400] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 9 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10.
I20260709 12:12:24.589584 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:24.585139 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:24.611937 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 43731.8us
I20260709 12:12:24.548671   576 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:24.612982 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:24.613806 26472 raft_consensus.cc:2368] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19.
I20260709 12:12:24.582693 32437 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:24.615442 32437 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:12:24.615306 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 85512.1us
I20260709 12:12:24.616032 32437 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:24.617167 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:24.565135   311 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:24.619889 26546 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:24.586485   481 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:24.622494   481 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:24.623054   481 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.625423 26466 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:12:24.592509 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:24.630628 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:24.547097   488 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:24.633230 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:24.637082 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 108313us
I20260709 12:12:24.572275   555 consensus_queue.cc:1243] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 12:12:24.644176 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 74630.2us
I20260709 12:12:24.643956 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:24.539918   379 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:24.651994 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:24.587090   557 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:24.570379   416 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
W20260709 12:12:24.653555 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 61161.1us
I20260709 12:12:24.626199   570 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:24.660461 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:24.688383 26514 leader_election.cc:400] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18.
I20260709 12:12:24.674594 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:24.611354   444 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:24.658516   311 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:24.630812 32541 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:24.626171   576 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:24.673079 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:24.696512 26466 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 19: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:12:24.696550 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44701.2us
I20260709 12:12:24.697602 26546 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:24.698590 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:24.707767   575 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:12:24.715008   577 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 12:12:24.718127   582 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:12:24.583227   422 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:24.585731   560 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:24.657521   555 raft_consensus.cc:2764] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:12:24.732942   576 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:24.747649 26613 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:24.739513 32272 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:24.744392 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 83987.4us
I20260709 12:12:24.753509 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:24.749269   579 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:24.686251   557 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.764482 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:24.761014   480 consensus_meta.cc:287] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.002s
I20260709 12:12:24.778352 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:24.763844   404 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:24.767794   311 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:24.793310 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 168486us
I20260709 12:12:24.687877   473 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:24.730952   530 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 12:12:24.802227 26464 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:24.774130 32400 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:24.820509 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 131164us
I20260709 12:12:24.779881 32682 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:24.780592   555 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:24.790552   480 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 9. Current term is 10.
I20260709 12:12:24.846894   480 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:24.847321   480 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:24.825394 32698 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:12:24.849166 32698 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:24.849540 32698 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:24.850378 32698 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:24.786922   324 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:24.851984   324 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:24.793992   463 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:24.853263   417 consensus_meta.cc:287] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.556s	user 0.004s	sys 0.004s
I20260709 12:12:24.852972   324 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:24.799244   587 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:12:24.793293   422 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:24.854099   324 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.784950   570 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:24.829358   379 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:24.830557   601 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:24.830718   584 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:24.832397 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:24.834928   579 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:12:24.799516   503 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.927s	user 0.006s	sys 0.007s
I20260709 12:12:24.838868 26514 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:24.840583 32541 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.764367 32272 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:24.790269   488 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:24.843312 32400 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:24.844643   530 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:24.826850   518 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:24.881909 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 58144.7us
I20260709 12:12:24.730159   481 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:24.895381 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 63111us
I20260709 12:12:24.833926 32437 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:24.899164 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.916043 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:24.916569 26622 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.001s
I20260709 12:12:24.916956 26622 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
W20260709 12:12:24.899318 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 121050us
W20260709 12:12:24.901186 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 62455.8us
I20260709 12:12:24.856328   555 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:24.903815 26548 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10.
I20260709 12:12:24.918232 26439 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:24.919581 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:24.902148 32698 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.921797   481 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:24.925019 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:24.926587 26622 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:24.929018 26587 leader_election.cc:400] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19.
I20260709 12:12:24.929566 26587 leader_election.cc:403] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:12:24.918287   416 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.930801   416 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:24.931697 32272 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:24.918207 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:24.901721   579 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.900471   466 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:24.937093 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:24.938297 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:24.946605 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:24.923100   555 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:24.918341   429 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20.
I20260709 12:12:24.907748   503 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:24.940317   444 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19.
I20260709 12:12:24.965677 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:24.944525   553 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:24.939590   579 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:24.900890   584 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:24.948078   417 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:24.968611 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:24.911420 32541 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:24.969988 26546 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.959052 32745 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:24.971200 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:24.971388   600 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:24.971992   552 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:24.971808   601 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:24.972889   563 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:12:24.973582   570 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:24.966627 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:25.028225   592 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:25.033149   388 raft_consensus.cc:3055] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:25.034570   572 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:25.042738 26614 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:25.033998   447 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20.
I20260709 12:12:24.968233   530 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:25.079056 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 380525us
I20260709 12:12:25.083459 26547 raft_consensus.cc:2376] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13. Re-sending same reply.
W20260709 12:12:25.046128 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 59020.7us
I20260709 12:12:25.175357 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:25.116255 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 178026us
W20260709 12:12:25.117142 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 80479.9us
I20260709 12:12:25.177277 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:24.962054 32670 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:12:25.147801 26539 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 17: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:25.120723   568 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:25.131138   506 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:25.072518 32691 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 12:12:25.048692   451 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:25.204501 26618 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:25.144373   416 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:25.206971 26546 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:25.180258 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:25.143306   388 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:25.144589   600 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:25.160761   552 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.174453   560 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:25.160965 32745 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:25.173761   530 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:25.209118 32731 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:12:25.222815   417 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:25.273500   596 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:25.274643   596 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:25.275442   596 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:25.276374   596 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:25.276708   596 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:25.277467   388 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:25.278481   605 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:12:25.279248   388 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:25.282441   606 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.302s
I20260709 12:12:25.283485   417 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:25.237969 32682 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:25.287482 32682 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:25.289762 32682 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:25.260071 32745 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:25.292713 32745 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:25.295316 32400 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:25.297817   588 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 12:12:25.298739   604 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
W20260709 12:12:25.299701   595 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:12:25.252519   530 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:25.235491   506 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:25.308517   506 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:25.282606   602 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 12:12:25.310550 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.317430 26469 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:25.253274   416 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:25.383841 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:12:25.366544 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 165355us
I20260709 12:12:25.388645 26466 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 16. (term mismatch)
I20260709 12:12:25.391422 26466 pending_rounds.cc:85] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 15
I20260709 12:12:25.277588   596 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:25.328508 32574 consensus_meta.cc:287] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.847s	user 0.005s	sys 0.008s
I20260709 12:12:25.398694 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:12:25.324394   557 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.000s
I20260709 12:12:25.405705 26470 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:12:25.322546   563 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:25.380995   516 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.998s	user 0.013s	sys 0.000s
I20260709 12:12:25.408553 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:25.252688   552 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:25.391675 26466 pending_rounds.cc:107] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 24.16
W20260709 12:12:25.425905 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 218817us
I20260709 12:12:25.434217 26466 raft_consensus.cc:2889] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:25.380393 32437 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:25.430156 26587 leader_election.cc:400] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19.
I20260709 12:12:25.409495   503 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:25.446978 26465 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 11. (term mismatch)
I20260709 12:12:25.449069 26465 pending_rounds.cc:85] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 10
I20260709 12:12:25.449364 26465 pending_rounds.cc:107] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 22.11
I20260709 12:12:25.449668 26465 raft_consensus.cc:2889] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:25.439961 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:25.440081 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:25.451674 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:25.409860   560 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:25.446776 32721 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:25.468854 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:25.469794 26470 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:25.409665 32574 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:25.455629   596 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:25.455224   516 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:25.425165 32272 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
W20260709 12:12:25.449270 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 377233us
I20260709 12:12:25.493043 27167 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:25.496335 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:25.415518   557 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:25.497067 26470 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:25.503284 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:25.503965 27166 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:12:25.501907 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:25.513145 26622 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:12:25.465848   503 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:25.518020 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:25.500373 26466 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:25.430203   563 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:25.527597 27161 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:25.533182 26468 raft_consensus.cc:2368] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21.
I20260709 12:12:25.531862 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:25.489831 32541 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:25.541066 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:25.542101 26543 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:25.544179 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:25.499193   516 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:25.519683   584 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:25.449213   600 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:25.557271 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:25.549562 32721 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:25.563748 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:25.545814   451 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:25.552526   516 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:25.572642   613 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:12:25.573943   611 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:12:25.583834 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:25.587920   630 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:25.588796 32574 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:25.588614   630 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:25.566672 32721 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:25.562847   614 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.129s
I20260709 12:12:25.598055 32721 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:25.602615 32721 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:25.610083 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.621799   630 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:25.625324   555 consensus_meta.cc:287] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.661s	user 0.010s	sys 0.000s
I20260709 12:12:25.628345   557 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:25.636569   552 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:25.639075   612 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.187s	user 0.003s	sys 0.000s
I20260709 12:12:25.647403   563 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:25.615168   579 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.000s
I20260709 12:12:25.654315   579 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:25.657399   579 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:25.660117   324 consensus_meta.cc:287] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.777s	user 0.012s	sys 0.000s
W20260709 12:12:25.662362   576 consensus_meta.cc:287] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.896s	user 0.002s	sys 0.010s
I20260709 12:12:25.663079   576 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:25.666018   576 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:25.672451 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.626044   555 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:25.679569 27160 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:25.681620   555 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:25.683593 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 503382us
I20260709 12:12:25.684108 27164 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:25.684948 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:25.686669 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:25.682075   530 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:25.708318   530 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:25.708530   516 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:25.695976 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:25.694546   557 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:25.699265 26467 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:12:25.700065 26472 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 18: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:12:25.709232 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.709851 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:25.693394 26473 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 12:12:25.722718 27133 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:25.723147 26473 pending_rounds.cc:85] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 11
I20260709 12:12:25.723448 26473 pending_rounds.cc:107] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 12:12:25.723332 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:25.723713 26473 raft_consensus.cc:2889] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:25.718470 26540 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:25.719291 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:25.721460 26467 pending_rounds.cc:85] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 10
I20260709 12:12:25.730347 26467 pending_rounds.cc:107] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:12:25.733538 26545 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:12:25.734072 26467 raft_consensus.cc:2889] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:25.694996 32698 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.773s	user 0.007s	sys 0.007s
I20260709 12:12:25.806576 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:25.773496 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:25.987784 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 265167us
I20260709 12:12:25.735813 26545 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: [24.15-24.15]
I20260709 12:12:25.806120 26466 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:25.995760 27162 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:25.802824 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:25.902254 26468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 2706) took 1332 ms (client timeout 1720 ms). Trace:
W20260709 12:12:25.994856 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 230457us
I20260709 12:12:25.738133 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:25.807101 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:25.762259 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.783568 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:26.012588 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:26.013319 26613 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:25.805482 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:26.015400 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:26.016124 26613 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 21: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:26.017731 26622 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:26.018086   516 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:25.721630   552 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:12:25.861315   637 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 12:12:26.008149 26468 rpcz_store.cc:269] 0709 12:12:24.552793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.564434 (+ 11641us) service_pool.cc:224] Handling call
0709 12:12:25.885341 (+1320907us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b54003147d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:25.885504 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2207047936}
I20260709 12:12:26.029119 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:25.797865   469 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:26.018599   578 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.781554   555 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.990860   594 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:26.033681 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:26.027483 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:25.736447   576 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.034623 27168 raft_consensus.cc:2410] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:12:26.035234 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:25.861079   636 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.831523   585 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:26.034703 27163 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:25.731877   557 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:26.046864 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:26.051589 27163 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:26.053313 27159 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:26.021763   596 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.024s
I20260709 12:12:26.063441 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:26.064453 27168 raft_consensus.cc:2410] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 12:12:26.032048   552 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:26.039364   578 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:26.092124 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:26.051780   516 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:26.112376 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:26.043072   576 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:26.043467   555 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:26.113147 26468 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:12:26.115290 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:26.116233 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:26.117070 26470 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:26.119544 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:26.043768   594 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:26.070585   463 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.120776 27168 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:26.046062   636 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:26.112596 32698 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:26.108549   634 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:26.183442   634 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:26.184329   576 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:26.185747   634 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:26.170614 27165 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:26.177052   578 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:26.116887   530 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:26.124512   516 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:26.182528 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48484.6us
I20260709 12:12:26.148339   620 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:26.194132   552 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:26.185213   576 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:12:26.215241   634 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 12:12:26.223315   634 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:26.223688   634 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:26.224495   634 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:26.225699   634 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:26.123730   463 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:26.238929 27159 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
W20260709 12:12:26.231122   638 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.123s	user 0.001s	sys 0.001s
I20260709 12:12:26.242826 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:26.203478 32698 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:26.234068 27168 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
W20260709 12:12:26.244743 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 125477us
I20260709 12:12:26.213263   530 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:26.237706   555 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:26.251843 26514 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:26.253067 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:26.255074   579 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:26.255584   579 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:26.256831 27159 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:26.256476   579 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:26.258816   578 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:12:26.265753   641 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:12:26.274884 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:26.275915 27168 raft_consensus.cc:2410] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:12:26.259584   557 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:26.254015   600 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:12:26.295156   646 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.306720   557 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.307510   618 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.308974   584 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.322649   557 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:26.332187   557 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:26.320557   445 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:26.334923   445 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:26.320430   600 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:26.327781   516 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:26.318259   646 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:26.343988   578 raft_consensus.cc:697] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:26.324824   584 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:26.358218 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:26.359596 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:26.369827 26544 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:26.322974   618 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:26.370733 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:26.371407 26546 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:26.372036   618 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:26.372298 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:26.376891 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:26.373293   530 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:26.388615   445 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:26.389485   530 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:26.374221   463 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:26.407889 27160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1007) took 1257 ms. Trace:
I20260709 12:12:26.408429 27160 rpcz_store.cc:276] 0709 12:12:25.156525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.173592 (+ 17067us) service_pool.cc:224] Handling call
0709 12:12:25.205295 (+ 31703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:25.680050 (+474755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:26.407550 (+727500us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b54003b6ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:26.407785 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1090288896}
I20260709 12:12:26.348939   600 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:26.388351   646 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:26.398497   584 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:26.415663 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:26.432492 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:26.462447 26544 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
W20260709 12:12:26.464570 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 103274us
I20260709 12:12:26.464828 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:26.465607 26617 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:26.465478 26514 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:26.470956 26588 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:26.471351   445 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 12:12:26.469393   646 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:26.474218   503 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:26.477036   503 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:26.477521   503 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:26.478958   650 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:26.479508   650 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:26.481745   650 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:26.483785   503 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:26.485257   503 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:26.478307   480 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:26.487973 32698 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:26.475430 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:26.490237 27161 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
W20260709 12:12:26.496869 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.487993   480 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:26.498441 26619 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 12:12:26.505182 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:26.507426 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:26.507673 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:26.508201   603 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 1.280s	user 0.002s	sys 0.000s
I20260709 12:12:26.509035 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:26.509248   352 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:26.509968   352 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:26.511057   352 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:26.514041 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2822) took 1547 ms. Trace:
I20260709 12:12:26.514518 26543 rpcz_store.cc:276] 0709 12:12:24.966894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.967012 (+   118us) service_pool.cc:224] Handling call
0709 12:12:24.967313 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:25.542617 (+575304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:26.513752 (+971135us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b54001068d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:26.513964 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1312117120}
I20260709 12:12:26.517760 26617 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:26.504096 26514 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:26.520417 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:26.522989   607 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.285s	user 0.002s	sys 0.000s
I20260709 12:12:26.524158   553 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:26.524682   553 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:26.503014   578 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:26.525607   553 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:26.526453 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:26.530966 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:26.540906 26617 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:26.542604 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:26.543848 26619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:12:26.544641 26619 raft_consensus.cc:606] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:12:26.546366 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:26.544991 26619 raft_consensus.cc:614] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:26.531962   652 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:12:26.587538 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 67649.5us
I20260709 12:12:26.549973 32670 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.589238 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:26.600065 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:26.603847 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:26.598865   652 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.615022 27164 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:26.617018 26620 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 12:12:26.617970 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.623080 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:26.624604 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:26.626180 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:26.626183 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:26.589674   600 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:26.629462 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.641811 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:26.606735 32670 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:26.612250   652 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:26.691627 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:26.754665   600 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:26.760051 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:26.774978   503 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.778996   445 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.780084   445 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:26.776970   463 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.783542   463 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:26.782681   503 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:26.789486 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:26.791203   658 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:26.793969   660 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:26.796383 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 169015us
I20260709 12:12:26.776705   634 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.797618 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:26.786242   463 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:26.785588   445 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:26.801517 26514 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:26.808430   593 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:26.809274   593 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:26.809458 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3763) took 2134 ms. Trace:
I20260709 12:12:26.808532   463 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.818058   463 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:26.813439   503 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:26.812736 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2718) took 1280 ms. Trace:
I20260709 12:12:26.810057 26465 rpcz_store.cc:276] 0709 12:12:24.674729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.759008 (+ 84279us) service_pool.cc:224] Handling call
0709 12:12:24.775264 (+ 16256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:25.450132 (+674868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:26.809046 (+1358914us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54002db254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:26.809309 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1539991808}
I20260709 12:12:26.815490 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:26.795399   658 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:26.819592 26466 rpcz_store.cc:276] 0709 12:12:25.532153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.536391 (+  4238us) service_pool.cc:224] Handling call
0709 12:12:25.536705 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:26.019344 (+482639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:26.812477 (+793133us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54002db754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:26.812670 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":606169344}
I20260709 12:12:26.810801   636 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:26.809993   644 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.632s	user 0.001s	sys 0.000s
I20260709 12:12:26.799465   634 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:26.824105   663 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:26.812062   643 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.639s	user 0.000s	sys 0.002s
I20260709 12:12:26.824438   658 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:26.841658   664 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:12:26.848914   463 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:26.849678   463 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:26.852387   445 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:26.856220   570 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:26.859930 26472 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:12:26.861874 26548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 1003) took 2495 ms (client timeout 1791 ms). Trace:
W20260709 12:12:26.862340 26548 rpcz_store.cc:269] 0709 12:12:24.366979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.367133 (+   154us) service_pool.cc:224] Handling call
0709 12:12:26.861679 (+2494546us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54003980d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:26.861786 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1003266816}
I20260709 12:12:26.821193   480 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:12:26.803181   651 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:26.838797   634 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:26.876065 26469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 2703) took 2322 ms (client timeout 1944 ms). Trace:
W20260709 12:12:26.876777 26469 rpcz_store.cc:269] 0709 12:12:24.536288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.548832 (+ 12544us) service_pool.cc:224] Handling call
0709 12:12:26.858115 (+2309283us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b540027b0d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:26.858278 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1433318272}
I20260709 12:12:26.883987 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:26.898556 26613 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:26.850226   463 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:26.810321   593 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:26.917878 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:26.918704 27161 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:26.913235   466 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.921231 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:26.921916 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 69969us
W20260709 12:12:26.923308 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 100114us
I20260709 12:12:26.928990 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:26.916496   651 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.925113 27134 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:26.939735 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:26.946722 26616 raft_consensus.cc:3055] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:26.924808   600 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:26.923072 32698 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:26.949579 26539 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:26.947335 26616 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:26.956840 26616 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:26.958003 26616 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:26.976212 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:26.976725 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.977272 26469 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:12:26.982916 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2914) took 2500 ms. Trace:
I20260709 12:12:26.985910 26467 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:26.987188 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:26.983595 26614 rpcz_store.cc:276] 0709 12:12:24.453175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.453375 (+   200us) service_pool.cc:224] Handling call
0709 12:12:24.465194 (+ 11819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:25.155348 (+690154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:26.953294 (+1797946us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b5400194954. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:26.953490 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1327717760}
I20260709 12:12:26.925866   466 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:26.944434   666 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:26.941248   651 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:27.008706 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:27.011375 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 86302.3us
W20260709 12:12:27.012591 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 65057us
I20260709 12:12:27.013541 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:26.994791   668 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:27.016450 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:26.986876 32698 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:27.017172 26469 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:27.020803 26616 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 12:12:27.021127 26616 pending_rounds.cc:85] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 13
I20260709 12:12:27.021276 26616 pending_rounds.cc:107] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:12:27.021426 26616 raft_consensus.cc:2889] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:27.024360 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:27.035374   466 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:27.015024   634 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:26.985524   600 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:27.020308   674 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.057s	user 0.000s	sys 0.011s
I20260709 12:12:27.043082 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:27.043071   651 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:27.044507 26544 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: [24.15-24.15]
I20260709 12:12:27.045987 26539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:12:27.049563 26539 raft_consensus.cc:606] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:12:27.049971 26539 raft_consensus.cc:614] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:27.048298 26467 raft_consensus.cc:2376] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20. Re-sending same reply.
I20260709 12:12:27.051704 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2699) took 2516 ms. Trace:
I20260709 12:12:27.046854   634 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:27.053097   634 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:27.052129 26471 rpcz_store.cc:276] 0709 12:12:24.535168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.537573 (+  2405us) service_pool.cc:224] Handling call
0709 12:12:24.581309 (+ 43736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:24.586494 (+  5185us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:24.872902 (+286408us) log.cc:844] Serialized 14 byte log entry
0709 12:12:25.161332 (+288430us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:25.161395 (+    63us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:25.161465 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:27.051425 (+1889960us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b54002dda54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:27.051474 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:27.051608 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5631,"prepare.queue_time_us":158173,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":80338,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":61969,"spinlock_wait_cycles":10989440,"thread_start_us":496787,"threads_started":2,"wal-append.queue_time_us":511266,"wal-append.run_cpu_time_us":2062,"wal-append.run_wall_time_us":1171146}
I20260709 12:12:27.004136   652 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:27.057761 26542 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:27.047822 32272 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:27.057389   652 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:27.101456 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:27.046372 32698 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:27.103288 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:27.107461 32670 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:27.108701   594 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:27.020081   668 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:27.078217   391 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:27.111820 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:27.099900 32272 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:27.112389   444 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 12:12:27.113619   503 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:27.115309 32670 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:27.112658   463 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:27.119522   667 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:27.113175   670 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:12:27.122082 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:27.134331   668 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:27.135424 32272 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:27.165932 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:27.167263 27167 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:27.167472 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:27.168857 27164 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:27.171505 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:27.171540 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:27.131793   503 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:27.173962 26622 raft_consensus.cc:2393] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 16: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:12:27.169418 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 153500us
I20260709 12:12:27.132256 32670 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:27.118579   391 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:27.162434   431 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:27.177349 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:27.183751 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:27.192714 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:27.193507 27166 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:27.176827   444 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:27.197324   597 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:27.201180 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:27.202055   444 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:27.202072   658 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:12:27.202790 27162 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56886 (request call id 1009) took 1819 ms (client timeout 1862 ms). Trace:
W20260709 12:12:27.203292 27162 rpcz_store.cc:269] 0709 12:12:25.383329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.383511 (+   182us) service_pool.cc:224] Handling call
0709 12:12:27.202580 (+1819069us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b5400604854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:27.202697 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1151440256}
I20260709 12:12:27.203958   658 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:27.204402   658 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:27.204782   658 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:27.205430   473 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:27.206682 32731 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:27.207124 32731 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:27.208076 32731 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:27.208577   663 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.209199   663 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:27.209705 32731 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:27.202564   444 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:27.215619 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:27.216372 26467 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:27.164251   651 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:12:27.221577 26588 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:27.173702 32272 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:27.236620 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:27.239866 26588 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:27.176152   503 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:27.177552 32670 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:27.238416 32721 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:27.244848   600 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:27.245126 32721 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:27.245536 26614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3288c98248464af5b8f3227349002ec7"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:12:27.245859   473 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:27.246157 26614 raft_consensus.cc:606] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:12:27.219275   646 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:27.246587 26614 raft_consensus.cc:614] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:27.246917   646 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:27.247488 32721 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:27.248474   650 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:27.249080   646 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:27.244514   597 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:27.250126   597 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.250550   597 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:27.244503   660 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.253670   506 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:27.258338 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:27.195087   632 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:27.243189 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 59571.4us
W20260709 12:12:27.237753 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.221414   444 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:27.177018   666 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.086s
I20260709 12:12:27.243399   594 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:27.273610 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:27.274261 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:27.279260 27166 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:27.284430 26514 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:27.288391 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:27.289094 27160 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:27.289913 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:27.291779 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:27.299047 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:27.257540   660 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:27.283361   667 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:27.307618 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:27.291779   668 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:27.303184   480 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:27.278363   530 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:12:27.309959   422 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.331326   422 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:27.282232   594 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:27.310236   667 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:27.319619 32691 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:27.317111   668 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.351796 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:27.334167   422 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:27.352746 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:27.357595 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:27.357985 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:27.358773 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:27.360908 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:27.363778 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:27.365059 26621 raft_consensus.cc:2410] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:12:27.365792   422 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:27.366746   422 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:27.373957 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:27.351691   667 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:27.376108 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:27.376415   422 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:27.379617 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 83116.1us
I20260709 12:12:27.377477 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:27.376641   684 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 12:12:27.381796   642 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 1.208s	user 0.004s	sys 0.000s
I20260709 12:12:27.356977   668 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:27.381531   633 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:27.387179   633 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:27.387646   633 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:27.393384   466 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:27.395231 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:27.402915   466 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:27.403437   466 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.403877   466 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:27.401921   634 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:27.404604   594 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:27.404860 27166 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:27.408882   683 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.315s	user 0.002s	sys 0.000s
I20260709 12:12:27.396653 26514 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:27.414837   466 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:27.408896   634 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:27.412086 26514 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:27.416287   570 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:27.416983   570 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:27.417295   651 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:27.417795   651 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:27.418304   651 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:27.418458 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.421541   466 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:27.417546   646 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:12:27.410913   676 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.355s	user 0.000s	sys 0.002s
I20260709 12:12:27.403061 26439 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:27.269372   632 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:27.343998   669 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
W20260709 12:12:27.441265   561 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.261s	user 0.014s	sys 0.007s
I20260709 12:12:27.438016 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:27.459203   561 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.284s	user 0.014s	sys 0.007s
I20260709 12:12:27.459296   663 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:27.448200   444 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:27.449191   660 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:27.379699 32698 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:27.457286 32670 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:27.458966   690 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:12:27.460354 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:27.463634 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48235.7us
I20260709 12:12:27.477566 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:27.476748 26613 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:27.467254 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:27.447466   466 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:27.470464 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:27.482277 27166 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:27.450727   503 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:27.483891   707 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:27.485214   503 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:27.488641 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 52959.4us
I20260709 12:12:27.490947 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:27.417999   570 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:27.491988 26617 raft_consensus.cc:2410] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:12:27.491917 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:27.493667 26616 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:27.495520 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:27.495913   706 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:27.401928   633 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:27.500579 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:27.506143 27161 raft_consensus.cc:2376] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16. Re-sending same reply.
I20260709 12:12:27.516780   429 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.517576   429 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:27.533128   445 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:27.491477   444 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:27.487529   466 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:27.549057   466 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:27.520884 26588 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:27.553743 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 115817us
W20260709 12:12:27.559223 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 81754.5us
I20260709 12:12:27.562651 26514 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:27.557742 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:27.510900   707 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:27.481360 32698 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:27.573019   693 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:12:27.576367   632 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:27.551200   445 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:27.585163   445 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:27.557143   444 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:27.589047   444 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:12:27.566898   699 log.cc:927] Time spent T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 12:12:27.605137 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 48052.7us
W20260709 12:12:27.610736 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 50606.3us
I20260709 12:12:27.612026 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:27.628621 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:27.600649   633 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:27.635082 26613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:12:27.640435 26613 raft_consensus.cc:606] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:12:27.640829 26613 raft_consensus.cc:614] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:27.620026   669 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.620003   646 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.623227   480 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:27.624301   469 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:27.650409 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52265.8us
I20260709 12:12:27.595052   444 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:27.620560   712 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:27.599063   597 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:27.663573 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:27.631274   709 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:27.669277 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:27.669958 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:27.672783 26467 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:27.635263   651 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:27.700383 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:27.701814 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:27.702785 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:27.664059   633 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:27.666213   712 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:27.713407 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:27.666435   469 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:27.706089   719 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:27.663744   646 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:27.716351 26470 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:27.731884 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:27.677866   473 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:27.750988 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:27.668313   710 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:27.777381 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 45615.6us
I20260709 12:12:27.779672 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:27.752672 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 124093us
I20260709 12:12:27.758739 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:27.790702 26543 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:27.792222 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:27.661512   669 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:27.706947   707 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:27.823614 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48563.9us
W20260709 12:12:27.884837 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 92700us
I20260709 12:12:27.844038 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:27.719074   329 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:27.717293   712 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:27.764961   561 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:27.837457 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:27.767089   593 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.000s	sys 0.012s
I20260709 12:12:27.709049   668 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:27.794559   663 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:27.826115   713 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:27.876816 32731 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.908586 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:27.877885 32698 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:27.890172   466 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:27.946892 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:27.909624   593 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.000s	sys 0.016s
I20260709 12:12:27.825485   708 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 12:12:27.891268   706 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:27.902866   710 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:27.844172   473 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:27.951556 32731 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:27.965725   391 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:27.965957   466 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:27.966580 32731 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:27.919353   561 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:27.967248 32731 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.878194   667 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:27.968690 26617 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:27.969026   561 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:27.969905   667 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:27.970818   443 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.971302   429 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:27.971433   443 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:27.972373 26473 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:27.974117   443 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:27.975875   715 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 12:12:27.977078 27160 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:27.980333   720 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:12:27.981261   708 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:27.975770 26438 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:27.982702   597 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:27.983760   716 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:12:27.984047   706 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:27.984752   706 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:27.888298   696 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
W20260709 12:12:27.986351   705 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
I20260709 12:12:27.996681 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:27.997799 27166 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:12:27.967835 32731 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:27.947753   709 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:28.029407 26470 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:27.991613   646 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:27.905951   707 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:28.090543 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.105189 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.107191 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.111718 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:27.921538   329 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:28.129590 26616 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:28.034693   480 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.136826 26614 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:28.137631 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.138207 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:28.078186   709 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:28.143519 26548 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:28.149480 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.141541 26621 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 10.
I20260709 12:12:27.985843   706 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:28.151850 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.155972 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.025359 32698 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.115s
I20260709 12:12:28.185663 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.119478   713 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:12:28.200409 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 481852us
I20260709 12:12:28.158152 26613 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:28.136739   445 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:28.196864 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:28.193507 27133 leader_election.cc:336] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.791s (SENT)
W20260709 12:12:28.204000   655 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.006s	sys 0.007s
I20260709 12:12:28.221539 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:28.226722 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:28.197642   714 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.483s	user 0.001s	sys 0.000s
I20260709 12:12:28.226127 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:28.224304 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:28.231460 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:28.150038   480 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:28.192507   709 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:28.221568   650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.000s	sys 0.037s
I20260709 12:12:28.254750 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:28.198892   651 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:28.240806 32721 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:28.232654   561 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:12:28.273607 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 469385us
W20260709 12:12:28.232798   655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.006s	sys 0.008s
I20260709 12:12:28.222147 32698 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:28.241494   416 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:28.280057 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:28.291754 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.292603 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:12:28.272475   650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.000s	sys 0.038s
I20260709 12:12:28.207135   597 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:12:28.306900 26467 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.628s	user 0.011s	sys 0.002s
I20260709 12:12:28.275509 26613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:12:28.324373 26467 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:12:28.324589 26613 raft_consensus.cc:606] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:12:28.323844 26543 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:28.325131 26613 raft_consensus.cc:614] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:28.206004   445 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:28.313310 26548 raft_consensus.cc:2368] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20.
I20260709 12:12:28.323812 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.273065   669 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:28.325524 27162 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 10.
W20260709 12:12:28.302254   658 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.097s	user 0.015s	sys 0.000s
I20260709 12:12:28.351732 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.197932   710 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:28.361032 26547 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:28.364493 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:28.315791   681 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:12:28.205435   713 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:28.377592 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:28.378638 26548 raft_consensus.cc:2376] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 10. Re-sending same reply.
I20260709 12:12:28.316958   668 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:28.311290   728 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.368072   658 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:28.294356 32721 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:28.311815   469 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:28.404546 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 145610us
W20260709 12:12:28.406807 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.392272 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:28.328902 26546 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:28.423234 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:28.315131 32698 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:28.399240   711 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.513s	user 0.000s	sys 0.004s
I20260709 12:12:28.361282   655 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:12:28.360036   597 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:28.431934 26622 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:28.432471 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.366264   561 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.036s
I20260709 12:12:28.435015 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:28.420344   473 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:28.433476   578 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:28.315382   416 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:12:28.441987 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 181393us
I20260709 12:12:28.442449 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:28.430802   594 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.473778 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:28.477142 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 47407us
I20260709 12:12:28.518301 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.483844 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.435786 32731 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:28.502895 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:28.523743 27168 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:28.502964 27161 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:28.469833   699 log.cc:927] Time spent T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:12:28.441816   669 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:12:28.435225   576 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:12:28.399086   722 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 12:12:28.519290 26548 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
I20260709 12:12:28.471694   329 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:28.522085 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.522786 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:28.396539   728 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:28.503660   578 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.537693 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:28.545487 27164 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 804) took 1120 ms. Trace:
I20260709 12:12:28.514006   707 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:28.554528 27164 rpcz_store.cc:276] 0709 12:12:27.425211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.425373 (+   162us) service_pool.cc:224] Handling call
0709 12:12:27.425699 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:27.438632 (+ 12933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:27.438668 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:27.463954 (+ 25286us) log.cc:844] Serialized 26 byte log entry
0709 12:12:27.617728 (+153774us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:27.617792 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:27.617892 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:28.202793 (+584901us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:28.539557 (+336764us) raft_consensus.cc:1685] finished
0709 12:12:28.539580 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.545408 (+  5828us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":136,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":8768,"spinlock_wait_cycles":25175424,"thread_start_us":120855,"threads_started":1,"wal-append.queue_time_us":236926}
I20260709 12:12:28.503159   570 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 23.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
W20260709 12:12:28.556702 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 199334us
I20260709 12:12:28.558641 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.596484   445 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:28.599239 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.600169 26548 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:12:28.600435 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.520506   594 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:28.545377   646 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:28.551575   668 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:28.612115 27168 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:28.608698 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:28.557952   578 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:28.598068   695 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.622572   732 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:28.623194   732 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.622787   695 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:28.623620   732 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.624289   594 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:28.625337   695 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:28.599318   480 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:28.616259   658 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:28.628703   658 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:28.617136 26439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.990s	user 0.012s	sys 0.005s
W20260709 12:12:28.630477   725 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.236s	user 0.001s	sys 0.001s
W20260709 12:12:28.630631 26439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.012s	sys 0.006s
W20260709 12:12:28.631091 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 1.00461e+06us
I20260709 12:12:28.631884   648 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:28.632362 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:28.632467   648 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:28.633999   739 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:12:28.634698   728 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:28.635010   724 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:28.593083   416 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:28.635890   724 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:28.636475   416 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:28.637243   466 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:28.637637   466 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:28.639266   597 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:28.638855   466 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:28.614820   729 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:12:28.626643   730 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:12:28.625696 26547 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:28.615355 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:28.661480 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 46232.5us
I20260709 12:12:28.662263 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:28.657614 32721 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:28.658633 32698 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:28.658352   729 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:28.658869   704 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:28.545076   576 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:28.640720   668 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:28.659513   648 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:28.659667   466 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.642673 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:28.671805 27161 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
W20260709 12:12:28.695427 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.610599   646 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:12:28.702908 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 60300.8us
W20260709 12:12:28.700855 26438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.000s	sys 0.009s
W20260709 12:12:28.704063 26438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.000s	sys 0.009s
W20260709 12:12:28.714008 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.679593   695 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:28.739075   646 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:28.717796 26546 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:28.707800   748 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:28.743103 32670 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:28.743921 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:28.763644 26467 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: [17.10-19.11]
I20260709 12:12:28.765928   443 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:28.766533   443 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.766924   443 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:28.691582   704 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:28.769011 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:28.773510 26467 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:28.770123 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:28.775559 26470 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 15: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:28.778254   646 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:28.779250 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:28.781702 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:28.783177 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:28.784981 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.780051 26588 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:28.798153 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:28.799041 26470 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 21: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:12:28.799507 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 136897us
I20260709 12:12:28.757747 32698 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:28.752947   737 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:28.772723   748 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:28.806725 26471 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:28.813897   729 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:28.813614   748 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:28.780829   480 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.814946   480 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:28.815554   668 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:28.815886   732 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:28.779592   695 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:28.826978 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.772212   568 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:28.807487 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:28.827728 26541 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:28.810062 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:28.825423   576 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:28.825768   480 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:28.796617 32731 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:28.826225   732 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:28.828269 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:28.835033 26467 raft_consensus.cc:2410] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 25 because replica has last-logged OpId of term: 24 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 14.
W20260709 12:12:28.835554 26513 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.596s (SENT) [suppressed 12 similar messages]
I20260709 12:12:28.837260 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:28.832352 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:28.837440 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:28.838819 26468 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:28.830128 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:28.844254 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:28.843223 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:28.869091 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:28.870430 26467 raft_consensus.cc:2410] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:12:28.872906 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:28.877207 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.880949   578 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:28.833678   568 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:28.882733 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:28.883947   568 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:28.884407 26543 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 11: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:28.884195 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:28.885648 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:28.886049   760 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:28.829182   737 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:28.888245   760 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:28.888727   760 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:28.890020   737 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:28.892001   695 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:28.882733 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:28.897485   633 consensus_meta.cc:287] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.180s	user 0.011s	sys 0.000s
I20260709 12:12:28.865759 32731 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:28.898710 26470 raft_consensus.cc:2410] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 26 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
W20260709 12:12:28.891511 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 61492.2us
I20260709 12:12:28.900586 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:28.901427 26621 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:28.905205 26464 raft_consensus.cc:2410] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 21 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 12:12:28.906929 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:28.908063 26619 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:28.908795 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:28.950094   675 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:28.957064   675 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:28.958566   675 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:28.960698   675 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:28.940541 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.962193   669 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:28.910706 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:28.962739   669 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:28.963933 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:28.963775   669 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:28.964516   734 log.cc:927] Time spent T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.591s	user 0.000s	sys 0.002s
I20260709 12:12:28.968353 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:28.966037 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 65524.2us
I20260709 12:12:28.969378 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2727) took 1251 ms. Trace:
I20260709 12:12:28.969842   753 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:28.969923 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:28.889788   760 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:28.971797 27133 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:28.962227 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:28.972723   760 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:28.972828   561 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:28.973366   561 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.973825   561 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:28.971886 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.970257 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:28.975929 26467 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:28.969879 26545 rpcz_store.cc:276] 0709 12:12:27.718100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.718333 (+   233us) service_pool.cc:224] Handling call
0709 12:12:28.968577 (+1250244us) spinlock_profiling.cc:243] Waited 899 us on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:12:28.968790 (+   213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.969053 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:28.969079 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:28.969120 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:28.969158 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.969213 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.969318 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2067328}
I20260709 12:12:28.977180 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:28.977939 26467 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:12:28.978003 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.980381 26545 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:12:28.981367 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.972239 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.974524 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2721) took 1265 ms. Trace:
I20260709 12:12:28.951159 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:28.918877 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:28.991364 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:28.991434 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:28.982950 26542 rpcz_store.cc:276] 0709 12:12:27.709303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.711290 (+  1987us) service_pool.cc:224] Handling call
0709 12:12:27.765836 (+ 54546us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:27.910115 (+144279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:27.910233 (+   118us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:27.931210 (+ 20977us) log.cc:844] Serialized 52 byte log entry
0709 12:12:28.319578 (+388368us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:28.319639 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.974039 (+654400us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540018bad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:28.974093 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:28.974144 (+    51us) raft_consensus.cc:1685] finished
0709 12:12:28.974158 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.974445 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36061,"raft.queue_time_us":13073,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":11290,"spinlock_wait_cycles":275095936,"thread_start_us":288514,"threads_started":1,"wal-append.queue_time_us":402644}
I20260709 12:12:28.841822   752 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.997185 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:28.998610 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:28.982091 26545 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 13.
I20260709 12:12:29.002084 26617 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 20: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:29.002373 27168 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: [18.14-20.15]
I20260709 12:12:29.007905 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:29.008602 26621 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:12:29.014730 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:28.948354 26439 connection.cc:256] RPC call timeout handler was delayed by -1.1294788519999202s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260709 12:12:28.931620   712 consensus_meta.cc:287] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.027s	user 0.005s	sys 0.009s
I20260709 12:12:29.021955 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:29.022884 27162 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:29.016590 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:29.021426 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:28.897998   633 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:29.023805 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:29.031309 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:29.033747 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:29.034513 27162 raft_consensus.cc:2368] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20.
I20260709 12:12:29.026908 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:29.039638 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:29.040046 27160 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:29.040295 26465 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:29.010727   753 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:29.056713   753 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.057140   753 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:29.042956 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:29.047824 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:29.049830 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:29.050369 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:29.021034 32670 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:29.051800   756 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:29.052430 26468 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
I20260709 12:12:29.052623   444 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:12:29.047879   738 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.516s	user 0.000s	sys 0.001s
I20260709 12:12:29.036406   737 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:29.053591   709 consensus_meta.cc:287] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.750s	user 0.013s	sys 0.000s
I20260709 12:12:29.055078   416 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:29.056109 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:29.012382   473 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:29.050915 26514 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:29.066039 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:29.067914 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:29.075312 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:29.074368   444 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:29.077345   466 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:29.077404 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:29.056120   553 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:29.087718 26467 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:29.017222   443 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:28.950769 32731 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:29.070087   600 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:29.031535   712 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:29.017794   752 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:29.163973 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 113900us
W20260709 12:12:29.129583 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.130955 27164 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:29.127631 26620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
W20260709 12:12:29.189440 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 138621us
I20260709 12:12:29.199656 26620 raft_consensus.cc:606] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:12:29.200371 26620 raft_consensus.cc:614] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:29.186674 26544 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:29.185950 26545 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:29.078133   578 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:29.083750   737 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.199451 26514 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:29.128260 26439 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:29.206476 27162 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:29.218218 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:29.199064   576 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:29.204879 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:29.221122 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 92992us
I20260709 12:12:29.228338   578 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:29.228899   578 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.229260   578 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:29.206159   703 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 12:12:29.107897   709 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:29.196667 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:29.213048 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3705) took 1084 ms. Trace:
I20260709 12:12:29.128387   473 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.236739 26614 rpcz_store.cc:276] 0709 12:12:28.128183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.128321 (+   138us) service_pool.cc:224] Handling call
0709 12:12:28.128670 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.139975 (+ 11305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.212771 (+1072796us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b54003d8e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:29.212982 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9547648}
I20260709 12:12:29.218909 26465 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:29.210546   723 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:29.238121 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:29.239231 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:29.206589 27161 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:29.240247 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:29.182514   600 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:29.247486 26472 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:29.239383 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:29.218828 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:29.249451 26542 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:29.238518   473 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:29.241994   723 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:29.216467   670 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:29.242501   576 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:29.214504   613 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:29.208249 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:29.160185   755 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:29.253712   600 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:29.223855   422 raft_consensus.cc:2764] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 12:12:29.254683   570 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:12:29.260223   712 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:29.269733 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.276034 27160 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:29.277217   444 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:29.279812 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:29.286634 26465 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
W20260709 12:12:29.657297 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.234555   737 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:29.405326 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 188756us
W20260709 12:12:29.596571 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 391776us
I20260709 12:12:29.664101 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:29.668207 26513 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:29.526309 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.607863   695 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:12:29.609443   675 consensus_meta.cc:287] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.013s
I20260709 12:12:29.595602 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:29.604415 26542 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
W20260709 12:12:29.611528 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 403388us
I20260709 12:12:29.676769 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:29.657923 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:29.610162   561 consensus_meta.cc:287] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.631s	user 0.014s	sys 0.009s
I20260709 12:12:29.680008 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:29.681190 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:29.676838 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:29.649538 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:29.681895 26542 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:29.683085 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:29.398717   660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.515s	user 0.014s	sys 0.000s
W20260709 12:12:29.690562   660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.807s	user 0.015s	sys 0.005s
I20260709 12:12:29.664101   633 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:29.684041 26472 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:29.707350   702 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:29.707545   633 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:29.707870 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:29.656330   755 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:29.678568   695 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:29.708109   444 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:29.684365   561 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:29.708890   444 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:29.710048   755 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:29.708094   753 consensus_meta.cc:287] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.630s	user 0.014s	sys 0.005s
I20260709 12:12:29.710688 27168 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 18: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:29.713201   753 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:29.714493 27166 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:29.715655   753 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:29.710525   561 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:29.716709   660 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:29.717484   660 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:29.719079   443 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:29.703578   576 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:29.710739 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:29.711319   774 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:29.712206 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:29.731155 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:29.712093   771 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:12:29.710896   444 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:29.606074   670 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:29.710048   695 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:29.704250   597 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.834658 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:29.836424 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:29.837978 26472 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:29.839210 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:29.608981   613 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:29.887245 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:29.887979 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:29.891892 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:29.900611 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 1020) took 1398 ms. Trace:
I20260709 12:12:29.901253 26547 rpcz_store.cc:276] 0709 12:12:28.502118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.502413 (+   295us) service_pool.cc:224] Handling call
0709 12:12:29.900344 (+1397931us) spinlock_profiling.cc:243] Waited 82.5 ms on lock 0x7b54000b4d54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:29.900506 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189830528}
I20260709 12:12:29.888190 27159 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:29.946144 26465 raft_consensus.cc:2410] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 12:12:29.946561 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:29.953645 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:29.892056   660 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:29.875392   597 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:30.016474 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:30.019440   670 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:29.950721   752 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:30.021113   473 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.758s	user 0.012s	sys 0.005s
W20260709 12:12:30.022343   578 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.793s	user 0.008s	sys 0.004s
W20260709 12:12:30.030668   770 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:12:30.031615 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:30.034277   422 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:30.039059   723 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:30.148044 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 480622us
I20260709 12:12:30.264973 26619 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:30.271733 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 3714) took 1036 ms. Trace:
I20260709 12:12:30.249655 26616 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:12:30.256657 26473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 2744) took 2587 ms (client timeout 2105 ms). Trace:
I20260709 12:12:30.107898   473 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:30.119953   578 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:30.251932   660 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:30.250835 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:30.263319   553 consensus_meta.cc:287] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.069s	user 0.012s	sys 0.013s
W20260709 12:12:30.265452 26469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 2743) took 2596 ms (client timeout 1760 ms). Trace:
W20260709 12:12:30.288717 26469 rpcz_store.cc:269] 0709 12:12:27.668635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.669753 (+  1118us) service_pool.cc:224] Handling call
0709 12:12:30.123467 (+2453714us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001a7f54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:30.265264 (+141797us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2495138688}
I20260709 12:12:30.285466 26616 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:30.292066 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2966) took 1099 ms. Trace:
I20260709 12:12:30.292404 26616 rpcz_store.cc:276] 0709 12:12:29.192545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.284844 (+1092299us) service_pool.cc:224] Handling call
0709 12:12:30.285254 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.291781 (+  6527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.292005 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:30.265645 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 585714us
I20260709 12:12:30.267198 27159 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 11.
W20260709 12:12:30.269814 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:30.247778 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 579541us
I20260709 12:12:30.272169 26619 rpcz_store.cc:276] 0709 12:12:29.235597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.031202 (+795605us) service_pool.cc:224] Handling call
0709 12:12:30.271670 (+240468us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:30.273281 26473 rpcz_store.cc:269] 0709 12:12:27.668923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.669038 (+   115us) service_pool.cc:224] Handling call
0709 12:12:30.256333 (+2587295us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b5400314cd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:30.256548 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672750848}
I20260709 12:12:30.273689   568 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:12:30.274214   646 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.487s	user 0.019s	sys 0.014s
W20260709 12:12:30.274256   737 consensus_meta.cc:287] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.593s	user 0.013s	sys 0.000s
I20260709 12:12:30.296413 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:30.297577 26471 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:30.274565   329 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:30.305197 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:30.281927   391 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:30.301788   718 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.283959   778 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:30.284559   781 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:30.315421   576 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:30.318444   613 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:30.319595   613 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:30.315387   718 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:30.320622   613 consensus_queue.cc:1243] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:12:30.313935   329 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:30.323940   329 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:30.316913   391 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:30.328393   391 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:30.302778   568 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:30.330667   713 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:30.331774 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 926) took 1524 ms. Trace:
I20260709 12:12:30.289392   422 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:30.332242 26470 rpcz_store.cc:276] 0709 12:12:28.807093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.807223 (+   130us) service_pool.cc:224] Handling call
0709 12:12:30.331531 (+1524308us) spinlock_profiling.cc:243] Waited 68.8 ms on lock 0x7b54001c2354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:30.331700 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158135040}
I20260709 12:12:30.335610   781 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:30.292991   660 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:30.287173   775 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 12:12:30.365244 26614 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:30.365687 26548 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:30.356765 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2967) took 1115 ms. Trace:
I20260709 12:12:30.370088 26619 rpcz_store.cc:276] 0709 12:12:29.241679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.311505 (+1069826us) service_pool.cc:224] Handling call
0709 12:12:30.355997 (+ 44492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.356278 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:30.356318 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:30.356383 (+    65us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:30.356442 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.356518 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:30.356674 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:30.373971 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 98861.6us
I20260709 12:12:30.303225   780 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:30.344029   473 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:30.344269   778 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:30.376732 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:30.380076   778 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:30.375692   780 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:30.384811   780 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:30.386175 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:30.346259   773 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.742s	user 0.009s	sys 0.000s
I20260709 12:12:30.338255   781 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:30.343379   709 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:30.339965   723 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:30.411422 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.370544   636 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:30.400297 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:30.415536 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:30.415869 26619 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:12:30.400588   578 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:30.401615   660 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:30.310063   646 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 12:12:30.302098   737 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:30.413204 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 108139us
I20260709 12:12:30.417928 26547 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:30.331808   568 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:30.344630   422 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:30.388689   713 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:30.420046 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:30.422758 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:30.425031 26438 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:30.415395   636 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:30.427008 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:30.427747 26619 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:30.428368 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:30.412739   780 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:30.429769 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 124236us
I20260709 12:12:30.433530 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:30.434198 26542 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:12:30.435451 26542 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 12:12:30.436292 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 3801) took 1467 ms. Trace:
I20260709 12:12:30.436712 26465 rpcz_store.cc:276] 0709 12:12:28.969282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.681575 (+712293us) service_pool.cc:224] Handling call
0709 12:12:30.436060 (+754485us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54002de1d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:30.436224 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491563392}
I20260709 12:12:30.437470   597 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:30.431746 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:30.432216 27160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 821) took 1383 ms. Trace:
I20260709 12:12:30.421355   713 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.440284 27160 rpcz_store.cc:276] 0709 12:12:29.049214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.049576 (+   362us) service_pool.cc:224] Handling call
0709 12:12:30.431962 (+1382386us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b540071acd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:30.432129 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486927232}
I20260709 12:12:30.439749 26514 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:30.428937   781 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:30.427398   568 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:30.445266 26464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 3787) took 1604 ms (client timeout 1768 ms). Trace:
W20260709 12:12:30.445722 26464 rpcz_store.cc:269] 0709 12:12:28.840443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.843913 (+  3470us) service_pool.cc:224] Handling call
0709 12:12:30.445050 (+1601137us) spinlock_profiling.cc:243] Waited 42.2 ms on lock 0x7b54001c0554. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:30.445204 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96982400}
I20260709 12:12:30.421129   709 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 12:12:30.442202   784 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:30.446900 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:30.447166   709 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:30.447633   709 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:30.448519   709 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:30.449736   709 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:30.441903   713 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.433573   636 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:30.452554 26468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 928) took 1592 ms (client timeout 1808 ms). Trace:
W20260709 12:12:30.453015 26468 rpcz_store.cc:269] 0709 12:12:28.859970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.872608 (+ 12638us) service_pool.cc:224] Handling call
0709 12:12:30.452370 (+1579762us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54001a9854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:30.452492 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410960128}
I20260709 12:12:30.454159 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:30.455744 26438 leader_election.cc:400] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20.
I20260709 12:12:30.437976 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:30.457067   568 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:30.458046   737 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:30.464457 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3716) took 1213 ms. Trace:
I20260709 12:12:30.465185   718 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:30.467519 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:30.456266 26438 leader_election.cc:403] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:30.430749   422 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:30.465024 26621 rpcz_store.cc:276] 0709 12:12:29.250938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.347544 (+1096606us) service_pool.cc:224] Handling call
0709 12:12:30.347873 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.378106 (+ 30233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:30.378139 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:30.378181 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:30.378212 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.464135 (+ 85923us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b5400268754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:30.464184 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:30.464372 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69073792}
I20260709 12:12:30.472949 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2765) took 1596 ms. Trace:
I20260709 12:12:30.473953 26621 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: []
W20260709 12:12:30.475440 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 168022us
I20260709 12:12:30.476004 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:30.474376 26465 rpcz_store.cc:276] 0709 12:12:28.876799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.464032 (+1587233us) service_pool.cc:224] Handling call
0709 12:12:30.464397 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.464606 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:30.464635 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:30.464681 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:30.464721 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.464781 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:30.472886 (+  8105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:30.483457 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:30.483758 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:30.485054 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:30.488997 27165 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:30.499778 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3710) took 1275 ms. Trace:
I20260709 12:12:30.500757 26616 rpcz_store.cc:276] 0709 12:12:29.223993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.307828 (+1083835us) service_pool.cc:224] Handling call
0709 12:12:30.318226 (+ 10398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:30.318639 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:30.318670 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:30.319149 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 12:12:30.476241 (+157092us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:30.476290 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.476351 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:30.498973 (+ 22622us) raft_consensus.cc:1685] finished
0709 12:12:30.499072 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:30.499711 (+   639us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6075,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":156514,"threads_started":1,"wal-append.queue_time_us":173724}
W20260709 12:12:30.505061 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 111821us
I20260709 12:12:30.508005 26544 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:30.512754 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.512084 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:30.513448 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:30.514000 27160 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:30.516250 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:30.519930 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:30.521150   429 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:30.521765   429 raft_consensus.cc:697] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:30.474771   718 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20.
I20260709 12:12:30.528249 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:30.524786 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 57375.5us
I20260709 12:12:30.529247 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:30.529754 26439 leader_election.cc:400] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20.
I20260709 12:12:30.529599 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:30.474778   746 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:30.533581 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:30.531224 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:30.474956   648 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:30.504000   646 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:30.507936   568 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:30.542277 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:30.456664   780 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:30.552151 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:30.547031 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2766) took 1639 ms. Trace:
I20260709 12:12:30.548751 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:30.553730 26465 rpcz_store.cc:276] 0709 12:12:28.907735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.515526 (+1607791us) service_pool.cc:224] Handling call
0709 12:12:30.546494 (+ 30968us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.546684 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:30.546710 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:30.546751 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:30.546790 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.546856 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:30.546969 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:30.554543 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:30.555291 27159 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 11: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:30.555137 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:30.556133 26621 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:30.555517 26465 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:30.558092 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:30.558979 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3791) took 1607 ms. Trace:
I20260709 12:12:30.559648 26465 rpcz_store.cc:276] 0709 12:12:28.952076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.554926 (+1602850us) service_pool.cc:224] Handling call
0709 12:12:30.555224 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.558705 (+  3481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.558919 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:30.561673 26465 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 12:12:30.562161 26465 pending_rounds.cc:85] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 9
I20260709 12:12:30.574110 26465 pending_rounds.cc:107] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:12:30.563447   781 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:12:30.563282   429 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:30.550158   648 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:30.565647 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:30.532708   723 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:30.540426   675 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:30.567777 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:30.515470   752 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:30.503795   737 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:12:30.530705   709 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.574564 26465 raft_consensus.cc:2889] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:30.532812   469 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:30.591187   780 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:30.559065 27163 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:30.565752   753 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:12:30.593066 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3797) took 1635 ms. Trace:
I20260709 12:12:30.567202 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2759) took 1722 ms. Trace:
I20260709 12:12:30.550302   760 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:30.551306   561 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:30.598114 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:30.598963 26616 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
I20260709 12:12:30.547952   646 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:30.570004   718 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:30.588083 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:30.593700 26465 rpcz_store.cc:276] 0709 12:12:28.954272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.560755 (+1606483us) service_pool.cc:224] Handling call
0709 12:12:30.561169 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.589493 (+ 28324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.589710 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:30.603502 26544 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.551043   787 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
W20260709 12:12:30.605710 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 76578.9us
I20260709 12:12:30.594681 26469 rpcz_store.cc:276] 0709 12:12:28.844311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.298510 (+1454199us) service_pool.cc:224] Handling call
0709 12:12:30.306387 (+  7877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.306653 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:30.475880 (+169227us) log.cc:844] Serialized 14 byte log entry
0709 12:12:30.566826 (+ 90946us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:30.566879 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:30.566933 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.567007 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:30.567141 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5454,"prepare.queue_time_us":191560,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":3442,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":5165,"thread_start_us":227760,"threads_started":2,"wal-append.queue_time_us":115946}
W20260709 12:12:30.601612 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 50055.5us
I20260709 12:12:30.545948   746 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:30.604147 26465 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:30.608798 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3798) took 1640 ms. Trace:
I20260709 12:12:30.595458   760 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:30.607326 27134 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:30.602447   646 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:30.586913   713 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:30.596685 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:30.613936 26621 raft_consensus.cc:2410] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 12:12:30.609146 26465 rpcz_store.cc:276] 0709 12:12:28.968279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.603634 (+1635355us) service_pool.cc:224] Handling call
0709 12:12:30.603961 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.608538 (+  4577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.608741 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:30.614966 26465 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:12:30.615381 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3799) took 1646 ms. Trace:
I20260709 12:12:30.615571 26465 rpcz_store.cc:276] 0709 12:12:28.968652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.614541 (+1645889us) service_pool.cc:224] Handling call
0709 12:12:30.614796 (+   255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:30.615208 (+   412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.615342 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:30.616453 26465 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 12:12:30.616719 26465 pending_rounds.cc:85] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 15
I20260709 12:12:30.616869 26465 pending_rounds.cc:107] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 12:12:30.617010 26465 raft_consensus.cc:2889] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:30.604501   718 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:30.617470 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3802) took 1648 ms. Trace:
I20260709 12:12:30.619542 26465 rpcz_store.cc:276] 0709 12:12:28.969570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.616020 (+1646450us) service_pool.cc:224] Handling call
0709 12:12:30.616223 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.617295 (+  1072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.617432 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:30.587561   675 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:30.622280   718 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:30.596128   709 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:30.630515 26465 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:12:30.631655 26544 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
I20260709 12:12:30.639820 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3805) took 1669 ms. Trace:
I20260709 12:12:30.640216 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:30.641602 26544 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:30.593782   752 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:30.632980 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:30.612121   760 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:30.640218 26465 rpcz_store.cc:276] 0709 12:12:28.979670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.620693 (+1641023us) service_pool.cc:224] Handling call
0709 12:12:30.621089 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:30.639561 (+ 18472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.639767 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:30.651775 26465 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: [23.11-23.11]
I20260709 12:12:30.652509 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3808) took 1598 ms. Trace:
I20260709 12:12:30.652927 26465 rpcz_store.cc:276] 0709 12:12:29.054378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.651222 (+1596844us) service_pool.cc:224] Handling call
0709 12:12:30.651550 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:30.652261 (+   711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.652455 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:30.654299 26465 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:30.644757 26469 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:30.619709   753 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:30.649534 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:30.656823 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3803) took 1687 ms. Trace:
I20260709 12:12:30.654927 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3810) took 1470 ms. Trace:
I20260709 12:12:30.659533 26465 rpcz_store.cc:276] 0709 12:12:29.184925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.653703 (+1468778us) service_pool.cc:224] Handling call
0709 12:12:30.653991 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.654691 (+   700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.654875 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:30.659430 26469 rpcz_store.cc:276] 0709 12:12:28.969881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.619836 (+1649955us) service_pool.cc:224] Handling call
0709 12:12:30.644568 (+ 24732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.656482 (+ 11914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.656752 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:30.661983 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:30.663761   801 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:30.667069   648 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:30.670464 26544 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:30.642486   553 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 12:12:30.674268 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:30.675800 26544 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:30.658373   753 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.699247 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:30.701179 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:30.704231 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:30.704960 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:30.706527 26544 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:30.707782 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:30.708410 26544 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:30.709501 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:30.705015   561 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.711023   561 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:30.713317   561 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:30.713846   561 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:30.715476   774 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:30.715901   774 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:30.716034   469 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:30.716722   774 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:30.718031   774 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:30.719240 27161 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56886 (request call id 1029) took 1752 ms (client timeout 1765 ms). Trace:
W20260709 12:12:30.719779 27161 rpcz_store.cc:269] 0709 12:12:28.967118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.969995 (+  2877us) service_pool.cc:224] Handling call
0709 12:12:30.719075 (+1749080us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54003b6ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:30.719177 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529380224}
I20260709 12:12:30.720487   709 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:30.721944 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2753) took 1935 ms. Trace:
I20260709 12:12:30.722332 26466 rpcz_store.cc:276] 0709 12:12:28.786038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.786168 (+   130us) service_pool.cc:224] Handling call
0709 12:12:28.786501 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.892128 (+105627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:28.892164 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:28.892214 (+    50us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:28.892262 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.721713 (+1829451us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54003151d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:30.721762 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:30.721885 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242371968}
I20260709 12:12:30.675242   663 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:30.719338   713 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:30.725286 27165 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:30.728156 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2761) took 1855 ms. Trace:
I20260709 12:12:30.728966 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:30.730739 26470 rpcz_store.cc:276] 0709 12:12:28.872432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.333216 (+1460784us) service_pool.cc:224] Handling call
0709 12:12:30.333571 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.383137 (+ 49566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:30.383167 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:30.383210 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:30.383248 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.727869 (+344621us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b54001c1454. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:30.727919 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:30.728093 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113525504}
I20260709 12:12:30.680471   753 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:30.732275 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:30.729467   480 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:30.772378   752 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:30.752085 27163 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:30.737685 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:30.773716 26544 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:12:30.776160 27165 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.705942   787 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:30.714334   561 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:30.781936 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.735989   777 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
W20260709 12:12:30.783217 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.822096 27163 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:30.727825   802 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:30.781304   803 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:12:30.828719 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:30.703786   652 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:30.844002 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.736490 27161 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 12:12:30.748490 27133 leader_election.cc:336] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.967s (SENT)
I20260709 12:12:30.831378   709 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.786682 27165 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
W20260709 12:12:30.849066 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 317895us
I20260709 12:12:30.846091 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:30.863894   553 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:30.829751   800 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.749713   713 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:30.869251   802 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:12:30.783427   480 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.079s
I20260709 12:12:30.872926 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:30.846616   775 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:12:30.829957   723 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:30.874194 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:30.874732 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 930) took 1983 ms. Trace:
I20260709 12:12:30.838299   787 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:30.772432   530 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 12:12:30.880265 26619 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
W20260709 12:12:30.891333 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 139624us
I20260709 12:12:30.893247 26514 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:30.880232 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:30.783579   663 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.092s
I20260709 12:12:30.883548 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2965) took 1691 ms. Trace:
I20260709 12:12:30.883590 26468 rpcz_store.cc:276] 0709 12:12:28.891150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.466880 (+1575730us) service_pool.cc:224] Handling call
0709 12:12:30.467372 (+   492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:30.467633 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:30.467661 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:30.476261 (+  8600us) log.cc:844] Serialized 26 byte log entry
0709 12:12:30.679253 (+202992us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:30.679291 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.679364 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:30.874479 (+195115us) raft_consensus.cc:1685] finished
0709 12:12:30.874504 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:30.874663 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":132822,"threads_started":1,"wal-append.queue_time_us":211486}
I20260709 12:12:30.847146   648 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 21.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:12:30.879272   780 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:30.899727 26620 rpcz_store.cc:276] 0709 12:12:29.192253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.203638 (+ 11385us) service_pool.cc:224] Handling call
0709 12:12:29.234297 (+ 30659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:29.885779 (+651482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:29.885853 (+    74us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:29.885919 (+    66us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:29.885977 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.883288 (+997311us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b5400194454. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:30.883337 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:30.883480 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497593728}
I20260709 12:12:30.905357 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:30.883257   553 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 19 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:30.887707   675 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:30.888446   752 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:30.910080 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:30.913781 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:30.875245   652 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:30.916437   422 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:30.916540 26616 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 20.
I20260709 12:12:30.917012   422 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:30.917505   422 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:30.918438   652 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:30.918641   812 consensus_queue.cc:1059] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:30.919067   652 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:30.919514   812 consensus_queue.cc:1059] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:30.920169   652 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:30.917901   553 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:30.921171   652 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:30.880383   709 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:30.899178   746 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:30.881965   713 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:30.923882 26616 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:30.924777   709 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:30.922363   718 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:30.922549   787 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:30.941640   753 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:30.881639   800 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:30.904379   780 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:30.926887 27134 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:30.962285 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 67691.9us
I20260709 12:12:30.907826   568 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:30.922928   480 raft_consensus.cc:3055] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:12:30.966311 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 61001.2us
I20260709 12:12:30.961484   788 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 12:12:30.900928   723 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:30.972085 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:30.976639 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:30.978060 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:30.978745 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:30.979794 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:30.980954 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:30.979020 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:30.984887 26465 raft_consensus.cc:2376] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20. Re-sending same reply.
I20260709 12:12:30.985414   709 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:30.985791 27166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1033) took 1717 ms. Trace:
I20260709 12:12:30.985961 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:30.986469 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:30.986897 26465 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:30.986207 27166 rpcz_store.cc:276] 0709 12:12:29.268459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.268622 (+   163us) service_pool.cc:224] Handling call
0709 12:12:29.268996 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:29.715012 (+446016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.985522 (+1270510us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b5400604854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:30.985727 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1023887232}
I20260709 12:12:30.987797 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:30.988093   753 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:30.988821 26470 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:30.988631 26465 raft_consensus.cc:2410] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:12:30.990043   800 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:30.990670 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:30.992043   718 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:30.993563   744 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:30.994561   744 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:30.994904   744 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:30.995731   744 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:30.997074   744 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.997949   713 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:30.998745 26465 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:30.999404 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:31.000314 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:30.996214 27166 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:12:30.999260 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 103130us
I20260709 12:12:31.001377 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:31.001994 26616 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:31.004439 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:30.967619   780 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:31.003031 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:31.010744   568 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:30.970609   752 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:31.006886 26465 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:30.970150   480 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:31.016173 27133 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:30.986080   709 raft_consensus.cc:697] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:31.018187   568 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:31.021399   667 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:31.026284 26439 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:31.030684 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:31.030018   817 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:31.017807 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:30.930346   422 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:31.018932   752 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.018811   753 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:31.030123   469 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:31.030283   713 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:31.033671   817 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.026811   561 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:31.035523 26546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 1023) took 2439 ms (client timeout 1967 ms). Trace:
I20260709 12:12:31.054132 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:31.054613 26546 rpcz_store.cc:269] 0709 12:12:28.595770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.599811 (+  4041us) service_pool.cc:224] Handling call
0709 12:12:31.035328 (+2435517us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54000b4354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:31.035447 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266005376}
I20260709 12:12:31.056403 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:31.041097 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:31.054162   817 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:31.036088 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3696) took 3612 ms. Trace:
I20260709 12:12:31.060748 26622 rpcz_store.cc:276] 0709 12:12:27.423976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.426166 (+  2190us) service_pool.cc:224] Handling call
0709 12:12:27.426461 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.501504 (+1075043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.035813 (+2534309us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54001b0654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:31.036024 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2300355840}
I20260709 12:12:31.060987   713 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:31.033702   811 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:31.033078 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:31.037575 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2760) took 2166 ms. Trace:
I20260709 12:12:31.024094   704 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:31.043865   709 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:31.045480   480 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:31.046317   422 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:31.023948   760 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:31.028215   568 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:31.057976 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:31.041712 26616 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:31.026284 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:31.934926 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 908661us
I20260709 12:12:31.050351 27165 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: [18.14-20.15]
I20260709 12:12:31.053367 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:31.947238 27166 raft_consensus.cc:2410] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:12:31.051759 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:31.100346   813 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:12:31.105049   817 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:31.950949 27167 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
W20260709 12:12:31.392458 26614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 3719) took 1676 ms (client timeout 1579 ms). Trace:
W20260709 12:12:31.952030 26614 rpcz_store.cc:269] 0709 12:12:29.716399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.831478 (+115079us) service_pool.cc:224] Handling call
0709 12:12:31.392168 (+1560690us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b540037ad54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:31.392331 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1036791552}
I20260709 12:12:31.952634   817 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:31.400168 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.954334   819 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:31.954885   819 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:31.957017   819 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:31.401376   816 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:31.957801   816 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:31.960075   816 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:31.444996   530 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:31.063676 26473 rpcz_store.cc:276] 0709 12:12:28.871479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.300199 (+1428720us) service_pool.cc:224] Handling call
0709 12:12:30.442559 (+142360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.442770 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:30.506952 (+ 64182us) log.cc:844] Serialized 14 byte log entry
0709 12:12:30.526869 (+ 19917us) log.cc:844] Serialized 14 byte log entry
0709 12:12:30.527058 (+   189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:30.527101 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:30.527150 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.527214 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:31.037433 (+510219us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54002de1d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:31.037523 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6199,"prepare.queue_time_us":70087,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":11175,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":35302,"spinlock_wait_cycles":364098048,"thread_start_us":76903,"threads_started":2,"wal-append.queue_time_us":12859}
I20260709 12:12:31.960683   530 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:31.961524 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:31.961591   530 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:31.962299 26473 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:31.962800   530 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:31.963553 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:31.964289 26473 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:31.965274 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:31.471180 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:31.966694 26465 raft_consensus.cc:2376] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18. Re-sending same reply.
I20260709 12:12:31.967764 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:31.968457 26465 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:12:31.969398 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:31.970023 26465 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:31.481545 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:31.489151   352 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.974378   352 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:31.975898   561 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.976495   561 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:31.977283   352 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:31.503902   780 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:31.978921   561 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:31.979542   780 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:31.515925 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 464367us
W20260709 12:12:31.980387 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:31.519694   744 consensus_meta.cc:287] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.522s	user 0.017s	sys 0.000s
I20260709 12:12:31.070428   469 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:31.983639   469 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:31.985517   709 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:31.986377 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 3815) took 1009 ms. Trace:
I20260709 12:12:31.534471 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:31.986814 26469 rpcz_store.cc:276] 0709 12:12:30.977130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.981652 (+  4522us) service_pool.cc:224] Handling call
0709 12:12:31.986141 (+1004489us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b54003fc0d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:31.986298 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2295787904}
I20260709 12:12:31.987332 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2870) took 1309 ms. Trace:
I20260709 12:12:31.987764 26540 rpcz_store.cc:276] 0709 12:12:30.677608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.534139 (+856531us) service_pool.cc:224] Handling call
0709 12:12:31.987245 (+453106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:31.988152 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:31.988876 26469 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:31.539047 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2758) took 2696 ms. Trace:
I20260709 12:12:31.532305   760 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:31.556659   669 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:31.989543 26472 rpcz_store.cc:276] 0709 12:12:28.843520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.882021 (+1038501us) service_pool.cc:224] Handling call
0709 12:12:30.335002 (+452981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.335270 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:12:30.454755 (+119485us) log.cc:844] Serialized 14 byte log entry
0709 12:12:30.530694 (+ 75939us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:30.530747 (+    53us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:30.530795 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.530858 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:31.538804 (+1007946us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54001c2350. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:31.538962 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13938,"prepare.queue_time_us":171766,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":8815,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":14749,"spinlock_wait_cycles":1040557440,"thread_start_us":180580,"threads_started":2,"wal-append.queue_time_us":88642,"wal-append.run_cpu_time_us":2512,"wal-append.run_wall_time_us":1001158}
I20260709 12:12:31.544167 27164 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 817) took 2496 ms. Trace:
I20260709 12:12:31.545835 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:31.992801 26545 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 18: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:31.992318 27164 rpcz_store.cc:276] 0709 12:12:29.047802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.048350 (+   548us) service_pool.cc:224] Handling call
0709 12:12:29.048692 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:29.198151 (+149459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.543802 (+2345651us) spinlock_profiling.cc:243] Waited 82 ms on lock 0x7b540056bb54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:31.544056 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188519808}
I20260709 12:12:31.993230 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 1028) took 1097 ms. Trace:
I20260709 12:12:31.993607 26545 rpcz_store.cc:276] 0709 12:12:30.896338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.545514 (+649176us) service_pool.cc:224] Handling call
0709 12:12:31.993171 (+447657us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:31.568558 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:31.568825   774 consensus_meta.cc:287] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.844s	user 0.012s	sys 0.003s
W20260709 12:12:31.605964 26471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 2757) took 2781 ms (client timeout 2658 ms). Trace:
W20260709 12:12:31.995044 26471 rpcz_store.cc:269] 0709 12:12:28.827456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.827589 (+   133us) service_pool.cc:224] Handling call
0709 12:12:31.605730 (+2778141us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54001a9354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:31.605874 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3353125632}
W20260709 12:12:31.583102 26365 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39184 (request call id 163) took 14832 ms (client timeout 15000 ms). Trace:
I20260709 12:12:31.996219 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:31.996630 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:31.997062 26471 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 18: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:31.998036 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:31.609794   636 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:31.998896 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:31.624584 27159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 823) took 1068 ms. Trace:
I20260709 12:12:31.655539 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:32.000092 27159 rpcz_store.cc:276] 0709 12:12:30.556548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.557087 (+   539us) service_pool.cc:224] Handling call
0709 12:12:30.557507 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.668808 (+111301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:30.668854 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:30.668917 (+    63us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:30.668977 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.624264 (+955287us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54006aa254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:31.624324 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:31.624510 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255297408}
I20260709 12:12:31.645390 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:31.696036   704 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:31.660646   713 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:31.702551 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:31.714336   568 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:31.718031 26546 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:32.002580   713 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:31.671079   787 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:31.719946 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2744) took 2649 ms. Trace:
W20260709 12:12:31.697939 26548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 2729) took 2919 ms (client timeout 2177 ms). Trace:
I20260709 12:12:32.003436 26541 rpcz_store.cc:276] 0709 12:12:29.070573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.070866 (+   293us) service_pool.cc:224] Handling call
0709 12:12:31.038226 (+1967360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:31.038374 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:31.038474 (+   100us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:31.038542 (+    68us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:31.038570 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.038610 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:31.719677 (+681067us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b54000b4350. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:31.719833 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4282396032}
W20260709 12:12:32.004302 26548 rpcz_store.cc:269] 0709 12:12:28.778786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.778926 (+   140us) service_pool.cc:224] Handling call
0709 12:12:31.697662 (+2918736us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54003cfd54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:31.697840 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3482806528}
I20260709 12:12:31.742043 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:31.727967   781 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:32.005381 26619 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 20: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:32.005489   781 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:31.749936 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1008) took 3434 ms. Trace:
I20260709 12:12:32.006465   781 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:32.007661   781 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:31.748984 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:31.767529 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:31.038422 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:32.010711 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 972338us
I20260709 12:12:32.011005   774 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:32.011691   713 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:32.006305 26539 rpcz_store.cc:276] 0709 12:12:28.315579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.711420 (+2395841us) service_pool.cc:224] Handling call
0709 12:12:30.711751 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.919828 (+208077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:30.919859 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:30.919916 (+    57us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:30.919960 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.749695 (+829735us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54001117d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:31.749745 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:31.749868 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38210,"raft.queue_time_us":49951,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"spinlock_wait_cycles":472064384}
W20260709 12:12:31.787335   646 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.149s	user 0.013s	sys 0.004s
I20260709 12:12:31.776826   480 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:32.014565   774 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:32.015544   774 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:32.017859 27159 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:31.052321   648 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:32.018575   648 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:32.019404   648 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.019847 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.020414   648 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:32.020488 26545 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:32.021286 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2878) took 1160 ms. Trace:
I20260709 12:12:32.021611 26545 rpcz_store.cc:276] 0709 12:12:30.861239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.994262 (+1133023us) service_pool.cc:224] Handling call
0709 12:12:32.021217 (+ 26955us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:31.047957   752 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:31.799705 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.025520 26468 raft_consensus.cc:2410] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:12:32.025946 26547 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:32.026533 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2875) took 1318 ms. Trace:
I20260709 12:12:32.026842 26547 rpcz_store.cc:276] 0709 12:12:30.708362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.799198 (+1090836us) service_pool.cc:224] Handling call
0709 12:12:32.026463 (+227265us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:31.802613 27168 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 813) took 2781 ms (client timeout 1615 ms). Trace:
W20260709 12:12:32.027709 27168 rpcz_store.cc:269] 0709 12:12:29.011173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.014465 (+  3292us) service_pool.cc:224] Handling call
0709 12:12:31.791754 (+2777289us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b540077c754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:31.792014 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1598702848}
I20260709 12:12:32.028415 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 3823) took 1045 ms. Trace:
I20260709 12:12:31.841459   822 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.028867 26468 rpcz_store.cc:276] 0709 12:12:30.982789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.004202 (+ 21413us) service_pool.cc:224] Handling call
0709 12:12:32.028101 (+1023899us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000a50d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:32.028345 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2346075904}
I20260709 12:12:32.029351   822 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:31.842772   753 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:32.030750   753 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:32.033116   753 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:31.849646 26587 connection.cc:256] RPC call timeout handler was delayed by -2.6809005259999594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17600000000000002s for a response
I20260709 12:12:31.863106 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:32.034204 26587 connection.cc:256] RPC call timeout handler was delayed by -2.3704005259999121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
I20260709 12:12:32.034384 26542 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
W20260709 12:12:32.034826 26587 connection.cc:256] RPC call timeout handler was delayed by -1.6521824679998645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
I20260709 12:12:32.034987 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 1029) took 1005 ms. Trace:
W20260709 12:12:32.035171 26587 connection.cc:256] RPC call timeout handler was delayed by -1.5756824679999681s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
W20260709 12:12:32.035504 26587 connection.cc:256] RPC call timeout handler was delayed by -1.5756824679999681s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
I20260709 12:12:32.035363 26542 rpcz_store.cc:276] 0709 12:12:31.029824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.862725 (+832901us) service_pool.cc:224] Handling call
0709 12:12:32.034926 (+172201us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:32.035902 26587 connection.cc:256] RPC call timeout handler was delayed by -1.537882467999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 12:12:32.036216 26587 connection.cc:256] RPC call timeout handler was delayed by -1.5135824679998677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260709 12:12:32.036556 26587 connection.cc:256] RPC call timeout handler was delayed by -1.4991824679998444s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
W20260709 12:12:32.036806 26587 connection.cc:256] RPC call timeout handler was delayed by -1.3767824679998739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
W20260709 12:12:32.037062 26587 connection.cc:256] RPC call timeout handler was delayed by -1.3767824679998739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
I20260709 12:12:32.037159 27164 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:32.037364 26587 connection.cc:256] RPC call timeout handler was delayed by -1.3441802750000988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 12:12:32.037684 26587 connection.cc:256] RPC call timeout handler was delayed by -1.3441802750000988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260709 12:12:32.037858 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:31.858162 32731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.966s	user 0.006s	sys 0.021s
W20260709 12:12:32.038791 32731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.162s	user 0.007s	sys 0.021s
I20260709 12:12:32.039723 27167 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:31.889597   788 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.040314 26618 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: [18.14-20.15]
I20260709 12:12:32.040746   788 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.041992 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 2953) took 3135 ms. Trace:
I20260709 12:12:31.895983   553 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:32.043031 26618 rpcz_store.cc:276] 0709 12:12:28.906213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.906743 (+   530us) service_pool.cc:224] Handling call
0709 12:12:30.109821 (+1203078us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b5800049298. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:12:30.247855 (+138034us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:32.040736 (+1792881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.041725 (+   989us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54003d9854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:32.041923 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4134682752}
I20260709 12:12:32.043628   553 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:32.045845   553 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:31.903827   707 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.046573   707 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.047345   712 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:32.047896   712 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.048681   707 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:31.896142   613 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:32.049432   613 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:32.051941   613 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:31.905592   784 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.052810   784 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:31.910557 27134 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:31.995952 26365 rpcz_store.cc:269] 0709 12:12:16.754568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.755211 (+   643us) service_pool.cc:224] Handling call
0709 12:12:31.582972 (+14827761us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:22.757098 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:22.757930 (+   832us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:22.758010 (+    80us) write_op.cc:435] Acquired schema lock
0709 12:12:22.758056 (+    46us) tablet.cc:662] Decoding operations
0709 12:12:22.763371 (+  5315us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:22.763489 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:22.763527 (+    38us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:12:22.871966 (+108439us) tablet.cc:701] Row locks acquired
0709 12:12:22.872018 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:12:22.872197 (+   179us) write_op.cc:270] Start()
0709 12:12:22.872401 (+   204us) write_op.cc:276] Timestamp: P: 1783599142872127 usec, L: 0
0709 12:12:22.872421 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:12:22.873667 (+  1246us) log.cc:844] Serialized 5579 byte log entry
0709 12:12:23.483765 (+610098us) op_driver.cc:464] REPLICATION: finished
0709 12:12:23.586865 (+103100us) write_op.cc:301] APPLY: starting
0709 12:12:23.596421 (+  9556us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:23.938957 (+342536us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:23.939141 (+   184us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:24.374441 (+435300us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:24.494331 (+119890us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0709 12:12:24.494381 (+    50us) write_op.cc:312] APPLY: finished
0709 12:12:24.494852 (+   471us) log.cc:844] Serialized 129 byte log entry
0709 12:12:24.646567 (+151715us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:24.688178 (+ 41611us) write_op.cc:454] Released schema lock
0709 12:12:24.733475 (+ 45297us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:24.762501 (+ 29026us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:24.762546 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":47569,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":42772,"apply.run_cpu_time_us":57913,"apply.run_wall_time_us":1230827,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62591,"num_ops":14,"prepare.queue_time_us":69634,"prepare.run_cpu_time_us":28516,"prepare.run_wall_time_us":251388,"raft.queue_time_us":169031,"raft.run_cpu_time_us":13872,"raft.run_wall_time_us":68621,"replication_time_us":572058,"spinlock_wait_cycles":79744,"thread_start_us":331434,"threads_started":5,"wal-append.queue_time_us":514543,"wal-append.run_cpu_time_us":9507,"wal-append.run_wall_time_us":2266254}]]}
W20260709 12:12:32.055735 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 145268us
I20260709 12:12:31.929050   827 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:32.056211   713 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.056710   827 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:31.941592 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:31.400357   814 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:32.058008   814 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:31.940951   746 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:31.986152   709 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.059099 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:32.059433   746 raft_consensus.cc:697] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 18 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:32.059988 26469 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 14: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:31.988830 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:31.994021 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:31.570577 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 2731) took 2786 ms. Trace:
W20260709 12:12:32.000802 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 345370us
I20260709 12:12:31.991869 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:32.011902 26613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 2952) took 3111 ms (client timeout 1607 ms). Trace:
I20260709 12:12:32.013803   646 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:31.796439 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2871) took 1090 ms. Trace:
I20260709 12:12:31.812076 26369 catalog_manager.cc:5697] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 10 to 14, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 14 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
W20260709 12:12:31.821303 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.836620 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:31.869896 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:32.038611   744 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.884506 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:31.889506   800 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.056748   713 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:31.523859   723 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:32.002948 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2873) took 1296 ms. Trace:
W20260709 12:12:32.037954 26587 connection.cc:256] RPC call timeout handler was delayed by -1.1866802750000716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
I20260709 12:12:32.060449   746 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:32.198148 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:32.232079   707 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:32.232822 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:32.232748   707 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.233539 26473 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:32.224032   709 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:32.234684 26470 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
W20260709 12:12:32.235219 26587 connection.cc:256] RPC call timeout handler was delayed by -1.1866802750000716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
I20260709 12:12:32.235394   707 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:32.235642 26587 connection.cc:256] RPC call timeout handler was delayed by -1.128382467999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
I20260709 12:12:32.236059 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:32.236663   788 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:32.105767 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2868) took 1432 ms. Trace:
I20260709 12:12:32.104467 26548 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:32.238297 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2869) took 1565 ms. Trace:
I20260709 12:12:32.226702   613 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.150552   779 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.238754 26548 rpcz_store.cc:276] 0709 12:12:30.673301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.005114 (+1331813us) service_pool.cc:224] Handling call
0709 12:12:32.104042 (+ 98928us) spinlock_profiling.cc:243] Waited 97.2 ms on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:12:32.104270 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.238072 (+133802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.238243 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223582976}
I20260709 12:12:32.111660   816 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.239549   779 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.240111 26543 rpcz_store.cc:276] 0709 12:12:28.784600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.784724 (+   124us) service_pool.cc:224] Handling call
0709 12:12:31.570280 (+2785556us) spinlock_profiling.cc:243] Waited 94.3 ms on lock 0x7b54003980d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:31.570496 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216827648}
I20260709 12:12:32.240221   816 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.240952 26540 raft_consensus.cc:2410] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 25 because replica has last-logged OpId of term: 23 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 10.
I20260709 12:12:32.105880 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2879) took 1237 ms. Trace:
I20260709 12:12:32.241748 26545 rpcz_store.cc:276] 0709 12:12:30.865149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.022234 (+1157085us) service_pool.cc:224] Handling call
0709 12:12:32.101795 (+ 79561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.102015 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.102037 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:32.102081 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:32.102119 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.102180 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.102307 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:32.060966   760 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:32.243729   760 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 18 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:32.244798   760 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:32.230284 26544 rpcz_store.cc:276] 0709 12:12:30.705667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.732020 (+ 26353us) service_pool.cc:224] Handling call
0709 12:12:31.796106 (+1064086us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b540018bad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:31.796326 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91298688}
I20260709 12:12:32.239224   613 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:32.238843 26472 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:32.248131   613 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:32.061293 26467 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:32.248941   822 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:32.249239 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.234484   568 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:32.237618 26613 rpcz_store.cc:269] 0709 12:12:28.900338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.900478 (+   140us) service_pool.cc:224] Handling call
0709 12:12:31.702342 (+2801864us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b5800049298. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:12:32.011798 (+309456us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5911296}
I20260709 12:12:32.252751   744 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.153411 26464 raft_consensus.cc:2410] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 12:12:32.254297   724 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.254808   724 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.256250 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:32.257489 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:32.257797   724 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:32.258898 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 2881) took 1220 ms. Trace:
I20260709 12:12:32.259289 26540 rpcz_store.cc:276] 0709 12:12:31.038092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.988533 (+950441us) service_pool.cc:224] Handling call
0709 12:12:32.258673 (+270140us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54003971d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:32.258840 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414408448}
I20260709 12:12:32.260093 26546 rpcz_store.cc:276] 0709 12:12:30.706279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.057671 (+351392us) service_pool.cc:224] Handling call
0709 12:12:32.002881 (+945210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:32.229887 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:32.224583   784 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:32.266832 26465 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:32.060896 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:32.079245 26402 debug-util.cc:398] Leaking SignalData structure 0x7b08002b4280 after lost signal to thread 25296
I20260709 12:12:32.267558 26469 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
W20260709 12:12:32.268433 26402 debug-util.cc:398] Leaking SignalData structure 0x7b08003365c0 after lost signal to thread 26405
I20260709 12:12:32.268538 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:32.223500   827 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:32.269765   814 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:32.270036 26402 debug-util.cc:398] Leaking SignalData structure 0x7b08003388e0 after lost signal to thread 26497
W20260709 12:12:32.270835 26464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 2774) took 1871 ms (client timeout 1698 ms). Trace:
W20260709 12:12:32.271339 26464 rpcz_store.cc:269] 0709 12:12:30.399495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.446576 (+ 47081us) service_pool.cc:224] Handling call
0709 12:12:32.270537 (+1823961us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54001a7f54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:32.270724 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3922200320}
I20260709 12:12:32.238871 26369 catalog_manager.cc:5697] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 12 to 15, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 15 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:32.237460 26541 rpcz_store.cc:276] 0709 12:12:30.672958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.004692 (+1331734us) service_pool.cc:224] Handling call
0709 12:12:32.105070 (+100378us) spinlock_profiling.cc:243] Waited 99.7 ms on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:12:32.105245 (+   175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.105440 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.105463 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:32.105502 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:32.105540 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.105593 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.105708 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229346176}
W20260709 12:12:32.273849 26402 debug-util.cc:398] Leaking SignalData structure 0x7b08002b7ca0 after lost signal to thread 26572
W20260709 12:12:32.236094 26587 connection.cc:256] RPC call timeout handler was delayed by -1.1022824679998848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22060000000000002s for a response
W20260709 12:12:32.275183 26402 debug-util.cc:398] Leaking SignalData structure 0x7b08000eb740 after lost signal to thread 26646
W20260709 12:12:32.275260 26587 connection.cc:256] RPC call timeout handler was delayed by -1.0752824679998412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
W20260709 12:12:32.275727 26402 debug-util.cc:398] Leaking SignalData structure 0x7b0800379c60 after lost signal to thread 26647
W20260709 12:12:32.276026 26587 connection.cc:256] RPC call timeout handler was delayed by -1.0752824679998412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
I20260709 12:12:32.276883 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:12:32.277185 26402 debug-util.cc:398] Leaking SignalData structure 0x7b08002329a0 after lost signal to thread 27192
I20260709 12:12:32.278381   660 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:32.279820 26587 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:32.279978 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 3832) took 1238 ms. Trace:
W20260709 12:12:32.280494 26402 debug-util.cc:398] Leaking SignalData structure 0x7b08001334e0 after lost signal to thread 730
I20260709 12:12:32.280898 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:32.229221 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2880) took 1359 ms. Trace:
I20260709 12:12:32.283906   646 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:32.324637 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:32.325148 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.285142 26466 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:32.285485 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:32.237351 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:32.285868 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:32.289048   713 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:32.290961   712 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:32.329952 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3819) took 1351 ms. Trace:
I20260709 12:12:32.330751 26468 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:32.322486   669 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.296571   744 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:32.298673 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3817) took 1321 ms. Trace:
I20260709 12:12:32.333997 26464 rpcz_store.cc:276] 0709 12:12:30.977731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.297838 (+1320107us) service_pool.cc:224] Handling call
0709 12:12:32.298138 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.298317 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.298346 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:32.298410 (+    64us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:32.298449 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.298505 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.298614 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:32.301928 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:32.302738 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.303022   779 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:32.336294 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.303489 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:32.303929 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:32.299760 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:32.307798   530 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:32.318856 26472 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:32.273339 26369 catalog_manager.cc:5697] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:12:32.348860 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3828) took 1343 ms. Trace:
I20260709 12:12:32.349818 26472 rpcz_store.cc:276] 0709 12:12:31.005351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.347951 (+1342600us) service_pool.cc:224] Handling call
0709 12:12:32.348320 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.348501 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.348524 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:32.348568 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:32.348607 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.348657 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.348758 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:32.351908 26472 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:32.322486 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:12:32.322765 26402 debug-util.cc:398] Leaking SignalData structure 0x7b08003ac100 after lost signal to thread 790
W20260709 12:12:32.325950 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.356763 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.321884 26467 rpcz_store.cc:276] 0709 12:12:31.041139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.568228 (+527089us) service_pool.cc:224] Handling call
0709 12:12:32.279789 (+711561us) spinlock_profiling.cc:243] Waited 66.5 ms on lock 0x7b540035f2d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:32.279915 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152968448}
I20260709 12:12:32.358070 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.330382 26470 rpcz_store.cc:276] 0709 12:12:30.978274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.329131 (+1350857us) service_pool.cc:224] Handling call
0709 12:12:32.329442 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.329621 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.329646 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:32.329690 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:32.329727 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.329778 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.329894 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:32.326874 26620 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:32.326809 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 3829) took 1319 ms. Trace:
I20260709 12:12:32.360548 26466 rpcz_store.cc:276] 0709 12:12:31.007000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.043356 (+ 36356us) service_pool.cc:224] Handling call
0709 12:12:32.326747 (+1283391us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:32.328058 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:32.322105 32721 raft_consensus.cc:2764] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:12:32.334139   669 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:32.339147 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 59449.6us
I20260709 12:12:32.339810 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.373497 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:32.374233 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.340394 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.374933 26473 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:12:32.341637 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.237982   800 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:32.293829 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:32.268589 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:32.377257 26369 catalog_manager.cc:5697] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 12 to 15, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 15 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:12:32.383836 26465 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 20.
I20260709 12:12:32.383945 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:32.384199 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 90849.5us
I20260709 12:12:32.346341 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:32.321103 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:32.322852 26547 rpcz_store.cc:276] 0709 12:12:30.869878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.027516 (+1157638us) service_pool.cc:224] Handling call
0709 12:12:32.228743 (+201227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.228913 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.228936 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:32.228974 (+    38us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:32.229004 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.229059 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.229159 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:32.368925 26548 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:32.386062 26473 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:12:32.369474 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:32.372611 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:32.374668 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:32.377966 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.388249 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:32.378249 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 69425.9us
I20260709 12:12:32.391670 26542 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 11: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:32.392027 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.392719 26544 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
W20260709 12:12:32.392951 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.358065 26513 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:32.405090 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 47139.7us
I20260709 12:12:32.407299 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:32.359063   779 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.411538 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:32.417704 27133 leader_election.cc:336] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.808s (SENT)
I20260709 12:12:32.418006 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:32.412420 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:32.368352   812 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.414330 26465 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:12:32.415040 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.368526   352 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.420475 26471 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
I20260709 12:12:32.421471 26369 catalog_manager.cc:5697] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 6 to 13. New cstate: current_term: 13 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:12:32.347750   752 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:32.383008   744 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:32.430735 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:12:32.431561 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 46691.9us
I20260709 12:12:32.432031 26514 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:32.392514   816 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:32.434660   774 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:32.435082 26513 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:32.431156   352 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:32.358930   530 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.409785 32272 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:32.436235   752 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:32.436717   744 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:32.404040   822 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:32.506192 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.401255   724 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:32.440096   704 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:32.442205 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:32.516675 26614 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:32.419160   712 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:32.446557 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.471979 26369 catalog_manager.cc:5697] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 11 to 14, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 14 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:32.419404   660 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:32.427119   480 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:32.507565 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 72557.5us
I20260709 12:12:32.531189 26513 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:32.532828 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:32.442382 26473 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:32.509925 26620 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
W20260709 12:12:32.487389 26437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.012s	sys 0.028s
W20260709 12:12:32.534524 26437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.021s	sys 0.028s
I20260709 12:12:32.510598 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:32.483726 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 65776.9us
I20260709 12:12:32.438375   646 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:32.515228 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 70487.1us
I20260709 12:12:32.514050 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:32.544310 26439 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:32.509859   469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.011s	sys 0.036s
I20260709 12:12:32.550384 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:32.551116 26542 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:32.551302 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.475996   652 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:32.554875 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:32.555351 26369 catalog_manager.cc:5697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 11 to 13, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 13 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:32.535171 26469 raft_consensus.cc:2410] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:12:32.541273 26614 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:12:32.528959 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.424685   779 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:32.474937 32272 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:32.506415   466 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:32.475395   774 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:12:32.550235   469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.011s	sys 0.036s
I20260709 12:12:32.569320 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.570323 26547 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:32.506769   822 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:32.564527 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:32.574522 26540 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:32.520486   752 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:32.553813   819 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:32.577142 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:32.577699 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:32.589824 26541 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:12:32.553162   704 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:32.580506 26369 catalog_manager.cc:5697] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 10 to 13, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 13 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:32.594326 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:32.582780 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:32.584053 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:32.585723 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:32.595803 26614 raft_consensus.cc:2368] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21.
I20260709 12:12:32.585844 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:32.588169 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:32.596939 27162 raft_consensus.cc:2368] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21.
I20260709 12:12:32.596800 26613 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:12:32.565487 32272 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:32.595062 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.558456 32670 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:32.599841 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:32.602674 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:32.602531 27133 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:32.588202 26545 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
W20260709 12:12:32.573069   781 consensus_meta.cc:287] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.565s	user 0.006s	sys 0.007s
I20260709 12:12:32.604717 26541 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:12:32.605541 26542 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:12:32.605656 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:32.607308 26546 raft_consensus.cc:2410] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:32.569855   827 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.608059 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:32.614921   827 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.615466 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.569479   707 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.617377 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:32.618007   707 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.619530 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:32.620379 26620 raft_consensus.cc:2368] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18.
I20260709 12:12:32.609737 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:32.610702 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.621385 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:32.621745 26548 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:12:32.622148 26471 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:32.577224   822 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:32.624047 26369 catalog_manager.cc:5697] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:12:32.623884 26547 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:32.625273 27162 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:32.625473   849 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:32.625857   841 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 12:12:32.626665   839 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:12:32.612267 26465 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:32.640309 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:32.655361 26471 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:32.656433 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:32.657181 26614 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:32.647238 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:32.658953 26613 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:32.597892   724 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:32.665504 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.668637 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.669386 26542 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:32.671310 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:32.672020 26622 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:32.672456   352 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:32.671061 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:32.627408   469 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:32.622936   713 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:32.666198 26369 catalog_manager.cc:5697] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:12:32.683518 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:32.637715   707 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:32.685170 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:32.689445 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2877) took 1828 ms. Trace:
I20260709 12:12:32.593389   752 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:32.687628 26465 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 12:12:32.635906   466 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:32.687012 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:32.695117 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.684485 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.691174 26539 rpcz_store.cc:276] 0709 12:12:30.860925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.013650 (+1152725us) service_pool.cc:224] Handling call
0709 12:12:32.106445 (+ 92795us) spinlock_profiling.cc:243] Waited 92.1 ms on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:12:32.106622 (+   177us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:32.107044 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.107072 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:32.107814 (+   742us) log.cc:844] Serialized 52 byte log entry
0709 12:12:32.413346 (+305532us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:32.413392 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.413472 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:32.673265 (+259793us) raft_consensus.cc:1685] finished
0709 12:12:32.673297 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.689365 (+ 16068us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":126,"spinlock_wait_cycles":211761792,"thread_start_us":305107,"threads_started":1,"wal-append.queue_time_us":453788}
I20260709 12:12:32.697732 26614 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:32.702901 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:32.622176 32670 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.703140 26541 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:12:32.703238 26614 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:32.665316 26468 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
I20260709 12:12:32.705397 26369 catalog_manager.cc:5697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:32.706934 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 146774us
I20260709 12:12:32.688814   850 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.702139 26620 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:32.686681   724 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 21 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:32.707077 26614 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:32.712859 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 180133us
I20260709 12:12:32.698962 26622 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:32.733604 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:32.630686   744 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.733191 26369 catalog_manager.cc:5697] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 8 to 10, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 10 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:32.737059 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:32.711947   530 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:32.728075 26540 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:32.705595   466 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.704548   847 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:12:32.744588 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 127360us
I20260709 12:12:32.741569 26369 catalog_manager.cc:5697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 12 to 13, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 13 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:32.742681 26614 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:32.747175 26465 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 19 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:32.751230 27162 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:32.748231 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:32.743958 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:32.752538 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:32.741740   422 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:12:32.759280 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 358759us
I20260709 12:12:32.765588 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:32.769706 26614 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:32.778546 26540 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:12:32.778704 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.779053 26540 pending_rounds.cc:85] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 9
I20260709 12:12:32.779444 26540 pending_rounds.cc:107] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:12:32.779551 26539 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 18: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:32.779774 26540 raft_consensus.cc:2889] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:32.745424   847 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.780892 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.781780 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:32.782622 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:32.778538 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:32.745172   827 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:32.782924 26514 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:32.814509 26546 raft_consensus.cc:2410] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:12:32.814649 26541 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:32.706467   704 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.703811   774 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:32.760864   817 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:32.754597   819 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:32.743026   646 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 12:12:32.820528 26542 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:32.762039   712 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:32.742059   652 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:12:32.764016   578 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:32.813467 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:32.774596   422 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.738370   850 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:32.428440   812 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:32.813613   847 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:32.781353   480 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 12:12:32.837760   352 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:32.830381   779 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:32.873031 27162 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:32.838492   848 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:12:32.876636   845 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:12:32.839534   422 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:32.877592   850 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:32.871711   352 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:32.863494   668 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:32.866140   801 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:32.877403   466 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:32.883383   831 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:12:32.880843   848 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:32.822340   724 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.901275 32272 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.903909   848 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:32.904208   669 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:32.891796   352 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:32.905128   822 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:32.905736   469 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:32.898087   853 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.075s	user 0.000s	sys 0.003s
I20260709 12:12:32.909921   752 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:32.913467   822 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:32.891702   668 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.909204   812 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:32.915853   668 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:32.919808   848 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.922200   848 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:32.915563   422 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.923856   800 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:32.924893   422 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:32.930146   668 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:32.931100   847 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:32.932538   668 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:32.933326   847 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:32.893577   801 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:32.981223 26369 catalog_manager.cc:5697] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 7 to 12, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 12 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:32.993911 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.996551 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3837) took 1342 ms. Trace:
I20260709 12:12:32.836539 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:32.943537   801 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:33.015555 32670 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:32.996623 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3836) took 1343 ms. Trace:
I20260709 12:12:33.016722 26466 rpcz_store.cc:276] 0709 12:12:31.653052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.361543 (+708491us) service_pool.cc:224] Handling call
0709 12:12:32.361926 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:32.365944 (+  4018us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:32.365991 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:32.366609 (+   618us) log.cc:844] Serialized 26 byte log entry
0709 12:12:32.704506 (+337897us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:32.704552 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.704976 (+   424us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:32.902812 (+197836us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b4800080058. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507b003aa1 00007f507affab37 00007f507affa9ca 00007f507b0f226f 00007f507b0f1f37 00007f507b10655c 00007f507b106508 00007f507b106488 00007f507b106443 00007f507b1056ec 00007f507a02fa96
0709 12:12:32.995553 (+ 92741us) raft_consensus.cc:1685] finished
0709 12:12:32.995614 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.996379 (+   765us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3523,"raft.queue_time_us":6824,"raft.run_cpu_time_us":4395,"raft.run_wall_time_us":529473,"spinlock_wait_cycles":7495936,"thread_start_us":337540,"threads_started":1,"wal-append.queue_time_us":393122}
I20260709 12:12:33.012313 26470 rpcz_store.cc:276] 0709 12:12:31.653371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.364290 (+710919us) service_pool.cc:224] Handling call
0709 12:12:32.364780 (+   490us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:32.412368 (+ 47588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.412418 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:32.413145 (+   727us) log.cc:844] Serialized 52 byte log entry
0709 12:12:32.531331 (+118186us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:32.531374 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.531443 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:32.995527 (+464084us) raft_consensus.cc:1685] finished
0709 12:12:32.995609 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.996175 (+   566us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72528,"raft.queue_time_us":50588,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":11967,"thread_start_us":93685,"threads_started":1,"wal-append.queue_time_us":258207}
I20260709 12:12:33.025202 32272 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:33.007570 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 224539us
I20260709 12:12:33.025573 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 2785) took 1052 ms. Trace:
I20260709 12:12:33.022240 26470 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:33.032186 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.033212 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3834) took 1380 ms. Trace:
I20260709 12:12:33.038367 26548 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:33.038529 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 940) took 1047 ms. Trace:
I20260709 12:12:33.007604 26618 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
W20260709 12:12:33.039005 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 202399us
I20260709 12:12:33.041143 26464 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 12:12:32.933714   352 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.018298   801 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:33.006517 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 233986us
I20260709 12:12:33.051685 26514 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:33.056559   744 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:33.057494   744 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:33.057194 26369 catalog_manager.cc:5697] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 11 to 15, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 15 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:12:33.048512 26472 rpcz_store.cc:276] 0709 12:12:31.652381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.355308 (+702927us) service_pool.cc:224] Handling call
0709 12:12:32.355707 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:32.356064 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.356091 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:32.369280 (+ 13189us) log.cc:844] Serialized 26 byte log entry
0709 12:12:32.759128 (+389848us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:32.759180 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.759265 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:33.032633 (+273368us) raft_consensus.cc:1685] finished
0709 12:12:33.032680 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.033024 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33281,"raft.queue_time_us":9205,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":6679,"thread_start_us":339539,"threads_started":1,"wal-append.queue_time_us":489273}
I20260709 12:12:33.058238   744 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:33.059971 26369 catalog_manager.cc:5697] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 10 to 13, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 13 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:33.048943 26468 rpcz_store.cc:276] 0709 12:12:31.990695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.037605 (+ 46910us) service_pool.cc:224] Handling call
0709 12:12:33.037992 (+1000387us) spinlock_profiling.cc:243] Waited 99.7 ms on lock 0x7b54000db6d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:33.038245 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229257472}
I20260709 12:12:33.067560 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:33.033212   422 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.069162 32272 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:33.069372   422 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:33.073602   422 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:33.068336 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 941) took 1077 ms. Trace:
I20260709 12:12:33.048053 26469 rpcz_store.cc:276] 0709 12:12:31.972711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.268275 (+295564us) service_pool.cc:224] Handling call
0709 12:12:33.024985 (+756710us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54001c0f54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:33.025304 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610163456}
I20260709 12:12:33.073966   352 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:33.066220 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 300518us
I20260709 12:12:33.087632 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:33.086997 26369 catalog_manager.cc:5697] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:12:33.089603 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:33.093509 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:33.094558   873 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:33.094806   872 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:33.162955 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 69771us
I20260709 12:12:33.163336   874 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:33.163453   872 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:33.164222   874 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.164858   874 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.165282   872 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.097595 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:33.075858 26465 rpcz_store.cc:276] 0709 12:12:31.990978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.748296 (+757318us) service_pool.cc:224] Handling call
0709 12:12:32.761109 (+ 12813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.761326 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:12:32.784780 (+ 23454us) log.cc:844] Serialized 14 byte log entry
0709 12:12:33.067338 (+282558us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:33.067451 (+   113us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:33.067631 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.067772 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.068085 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52782,"prepare.queue_time_us":23474,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":1961,"raft.queue_time_us":53054,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":271,"thread_start_us":23475,"threads_started":1,"wal-append.queue_time_us":24369}
I20260709 12:12:33.103096 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:33.172109 27161 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:33.107192 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:33.173605 26618 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
W20260709 12:12:33.174089 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 67145.9us
I20260709 12:12:33.108218 32721 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:33.175577 32731 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:33.175712   873 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.176138 32721 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:33.176726 32721 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:33.176613   873 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:33.176146 32731 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.179128 32731 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:33.179519   873 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:33.111866 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3820) took 2130 ms. Trace:
I20260709 12:12:33.182780 26464 rpcz_store.cc:276] 0709 12:12:30.981944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.339156 (+1357212us) service_pool.cc:224] Handling call
0709 12:12:33.040364 (+701208us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:33.071415 (+ 31051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.111600 (+ 40185us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b54000db6d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:33.111798 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611476864}
I20260709 12:12:33.113237 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3835) took 1460 ms. Trace:
I20260709 12:12:33.174096 26618 pending_rounds.cc:85] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 12
I20260709 12:12:33.186077 26618 pending_rounds.cc:107] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:12:33.187080 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:33.187492 26618 raft_consensus.cc:2889] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:33.188165 26619 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:12:33.190177   873 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:33.166020 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:33.175630 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:33.194872 32272 raft_consensus.cc:2764] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:12:33.198918   873 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:12:33.200009 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 102817us
I20260709 12:12:33.153949   648 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:33.159487   847 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.161314   744 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.148144 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:33.200050   873 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:33.201251 26619 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:33.201283 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:33.184245 26467 rpcz_store.cc:276] 0709 12:12:31.652737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.358154 (+705417us) service_pool.cc:224] Handling call
0709 12:12:32.358499 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:32.365402 (+  6903us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:32.563911 (+198509us) log.cc:844] Serialized 14 byte log entry
0709 12:12:32.921787 (+357876us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b4800080058. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507b003aa1 00007f507affab37 00007f507affa9ca 00007f507b0f226f 00007f507b0f1f37 00007f507b10655c 00007f507b106508 00007f507b106488 00007f507b106443 00007f507b1056ec 00007f507a02fa96
0709 12:12:33.084630 (+162843us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:33.100574 (+ 15944us) log.cc:844] Serialized 26 byte log entry
0709 12:12:33.100871 (+   297us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:33.101433 (+   562us) log.cc:844] Serialized 14 byte log entry
0709 12:12:33.101741 (+   308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.101923 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:33.112773 (+ 10850us) raft_consensus.cc:1685] finished
0709 12:12:33.112799 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.113016 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141118,"prepare.queue_time_us":260434,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":92,"raft.queue_time_us":48169,"raft.run_cpu_time_us":3640,"raft.run_wall_time_us":553811,"spinlock_wait_cycles":7150976,"thread_start_us":690762,"threads_started":3,"wal-append.queue_time_us":301859}
I20260709 12:12:33.202196   847 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:33.205824 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:33.207062 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:33.207712 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:33.228212 26622 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:33.209405 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:33.212524 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:33.215263 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:33.215794 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:33.226686   713 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:33.234543   713 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:33.234709 27167 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 12:12:33.235074 26621 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:33.236222 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:33.222934 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:33.237381 26615 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:33.237591   847 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:33.221362   865 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.239053   865 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:33.243412   668 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:33.235059   713 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.231657   648 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.248087   648 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:33.249914   847 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:33.250102 27166 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:33.250841   847 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:33.251410   873 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.242081   865 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:33.253718   422 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:33.253991   871 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:33.254774   871 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:33.255818 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 50289.4us
I20260709 12:12:33.254207   422 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:33.226086 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 141431us
I20260709 12:12:33.235219   744 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:33.201246   874 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.261902 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:33.262553 26617 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 17
W20260709 12:12:33.262928 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.255470   871 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:33.264336 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:33.266718 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:33.265966 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:33.275200 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:33.276990   848 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:12:33.282024 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.278339   848 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:33.282687   848 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:33.278342   812 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:33.275352 26514 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:33.283349   812 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:33.283809   812 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:33.284578 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:33.286796   862 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:33.287302   862 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.287679   862 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:33.289687 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:33.290068   668 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:33.291247   668 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:33.291603   668 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.292044   668 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:33.294010   847 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:33.295675   863 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:33.296778   863 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:33.297142   863 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:33.298636   704 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:33.298794   814 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:33.299149   704 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.299314   814 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:33.299598   704 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.300622   814 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.301898 26615 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:33.302208   814 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:33.260684   422 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:33.309697   830 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:33.310215   830 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.298146   863 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.310619   830 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:33.312240 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 49850.5us
I20260709 12:12:33.279946   648 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 12:12:33.313545 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:33.318289 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 117206us
I20260709 12:12:33.314127 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:33.232613   801 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:33.312326   863 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:33.329830 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 98437us
I20260709 12:12:33.333498 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:33.333159 32731 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.329396   352 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:33.337735 26514 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:33.336542   744 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:33.343116   352 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:33.359838   352 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:33.363169   872 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:33.364212   872 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:33.365543   872 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:33.370864 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 57668us
I20260709 12:12:33.351145   744 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:33.366299 32721 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.374943 26617 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:33.372077 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:33.320863   848 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:33.358520   873 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:33.378695   744 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:33.358425   801 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:33.394995 26619 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:33.395321   827 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:33.395903   827 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:33.396384   827 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:33.384244   774 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:33.403046   816 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
W20260709 12:12:33.404488   881 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.077s	user 0.000s	sys 0.002s
I20260709 12:12:33.397450   817 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.405303   817 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:33.402143 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 68906.5us
I20260709 12:12:33.411808 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:33.412365 26617 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:33.406065   800 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:33.430084 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:33.431349 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:33.436378 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 49867.2us
I20260709 12:12:33.456075   849 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:33.417321 32670 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 12:12:33.437376   774 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:33.463016 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 48520.7us
I20260709 12:12:33.479980   817 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:33.481474 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 81565.8us
I20260709 12:12:33.468741 32272 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:12:33.480945   849 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:33.482409 27134 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:33.484522 27167 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:33.487924   652 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.488588   652 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:33.489748   849 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:33.490236   704 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:33.493050 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 149173us
I20260709 12:12:33.486380   800 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:33.502218   530 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:33.503690   530 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:33.503888   800 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.505074   530 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:33.505574   530 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:33.470862   874 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:33.511786 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:33.522475   669 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:33.523092   669 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:33.523840 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:33.524309   669 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.526350   788 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:33.526753   652 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:33.526928   788 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.527410   788 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:33.477509   713 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.535105   847 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:33.534884   530 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.535732   847 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:33.536422   530 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:33.536595   713 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:33.536885   847 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:33.522148   873 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:12:33.530843 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 48606.7us
I20260709 12:12:33.516083   862 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:33.543215 27134 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:33.544754   862 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:33.545719   859 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:33.547473   859 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:33.547387   352 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.548044   859 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:33.548491   859 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:33.551190   746 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:33.552789   668 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:33.549949   871 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.555456   668 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:33.556519   871 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:33.560550   830 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.564208   830 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:33.567181 32721 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:33.495600 32731 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:33.574177   713 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:33.526332   669 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:33.574203   779 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:33.587721 26439 leader_election.cc:400] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21.
I20260709 12:12:33.588311 26439 leader_election.cc:403] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:33.589057   873 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:12:33.591173   422 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:33.594679 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 117467us
I20260709 12:12:33.596746   724 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:33.550069   352 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:33.569928 32721 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:12:33.617735 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:33.614004   668 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:33.624595 26543 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:33.634972 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:33.558257   817 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:12:33.586134   827 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.638375 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:33.640583 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:33.627756   812 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.650378 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:33.646781 26548 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:12:33.659473 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:33.661388 26543 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 20: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:12:33.664103 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.670754 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:33.638465   668 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:33.674562 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 190248us
I20260709 12:12:33.665282   800 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:33.697388 26548 raft_consensus.cc:2410] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 21 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 9.
I20260709 12:12:33.704193 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:33.706990 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 212080us
I20260709 12:12:33.715601 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:33.705092   422 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:33.703043   788 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.729843   704 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:33.738446   888 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:33.743780   888 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.744077 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:33.744247   888 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:33.744340   873 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21.
I20260709 12:12:33.745363 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:33.739339   827 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:33.739863 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:33.748737   812 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:33.751658   830 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:33.752170   830 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:33.753201   830 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.753794   774 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:33.754249   774 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:33.754698   774 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:33.756291 32272 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:33.756738 32272 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:33.757537 26542 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:12:33.758890 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:33.759742 26546 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:33.759949 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:33.757822 32272 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:33.760473 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:33.760629 26541 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.761059 26545 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.761173   848 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:33.761547 32272 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:33.762899 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:33.763576 26544 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:33.765143   801 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:33.768684 26464 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:12:33.771487 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:33.771944 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:33.773267 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:33.774528 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:33.775202 26542 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:33.775970 26621 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:33.776820   788 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:33.777709   744 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.779147 26617 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:33.779942 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:33.780167 26471 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:33.780799 26469 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 21: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:33.781056 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:33.782823 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:33.783576 26468 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:12:33.783845   873 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.784477   873 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:33.779166 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:33.787422 26465 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 14: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:33.781999 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:33.787833 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:33.788343 26470 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:33.788473 26472 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
I20260709 12:12:33.789623   814 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:33.790253   814 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.791231 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:33.791932 26469 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:12:33.792593   814 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:33.773331   863 consensus_queue.cc:1059] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:12:33.794298   863 raft_consensus.cc:3055] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:33.794693   863 raft_consensus.cc:740] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:33.794827 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:33.790305   830 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:33.800493 26470 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:12:33.795732   863 consensus_queue.cc:260] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:33.803474 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:33.803475 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:33.809634 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:33.810488 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:33.810922   668 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:33.812628   859 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:33.814819 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:33.829710 26620 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 21: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:33.816715 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:33.818562 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:33.827239 26545 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:33.816084 27166 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:33.831629 26541 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:33.835458 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:33.846199 26469 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:33.834281 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 91767.6us
W20260709 12:12:33.839071 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 116545us
W20260709 12:12:33.834650 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 55700.1us
I20260709 12:12:33.782869   744 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:33.850915 26615 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.853655 26548 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:12:33.855818 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:33.857164   788 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:33.857754   788 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.860103   788 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:33.865155 26621 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:33.845593   872 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.874776 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:33.875046 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:33.851732 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:33.885156 26620 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:33.890522 26617 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 21: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:33.879496 26542 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:12:33.883574 26618 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:12:33.892361 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.885248 27161 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:33.888146 26615 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
W20260709 12:12:33.904244 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 67842.5us
W20260709 12:12:33.877987 27133 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.668s (SENT) [suppressed 23 similar messages]
I20260709 12:12:33.898175   827 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:33.898325   872 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.906878   422 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:33.913775   422 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:33.914197   422 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:33.914443 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:33.914906   872 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:33.895282   668 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:12:33.916038   800 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:33.916682   668 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:33.916730   800 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.917416   668 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:33.902931   530 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:33.918675   817 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:33.918499 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:33.919142   530 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.920812   800 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:33.919214   817 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.921461   530 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:33.922122   530 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:33.922605   704 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:33.922999   817 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:33.923415 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.919226   668 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.910069 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:33.938964 26548 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:33.930227 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:33.935698 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 57798.9us
W20260709 12:12:33.941959 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.897991   788 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:33.953536 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:33.948740 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:33.962222 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:33.963043 26618 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:12:33.963479   889 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 0.213s	user 0.002s	sys 0.000s
I20260709 12:12:33.967900 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:33.969691 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:33.974000 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:33.975051 26545 raft_consensus.cc:2410] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:12:33.975931 26439 leader_election.cc:400] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21.
I20260709 12:12:33.974236 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:33.978420 26548 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.982602   724 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:33.983608 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:33.905378   779 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:12:33.985030 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:33.943334   530 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:33.982540 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:33.996366 26613 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.909482   827 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:33.983150   724 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:34.003736 26544 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:33.988441 26616 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:12:33.953639   800 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:34.011626 26620 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:34.020843 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:34.020514 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 115550us
W20260709 12:12:34.024098 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 48319.4us
I20260709 12:12:33.998817   668 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:33.952042   788 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.007107   724 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:33.954329   774 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.035969 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:34.034934 26548 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 20.
I20260709 12:12:34.036875 26545 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:12:34.037063 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:34.017377   800 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.006351   873 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:34.040102 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:34.039239 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:34.042114 26544 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 17: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:34.046957 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:34.047996 32670 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:34.048497 32670 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:34.048925 32670 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:34.049710 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:34.051985 32721 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:34.052462 32721 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:34.052870 32721 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:34.054623   859 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:34.070052 26469 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:34.070689 26546 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 22: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:34.071008 26621 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:34.074769   530 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:34.081604 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:34.082067   891 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:12:34.082917 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:34.083779 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:34.086611   859 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:34.086733 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:34.088935   774 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:34.089677   746 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:34.090584   746 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:34.091531   746 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:34.091877   746 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:34.092733   746 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:34.093843   746 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:34.094918 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 52358.7us
I20260709 12:12:34.095927 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:34.097056   888 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.097458 26439 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:34.098034 26613 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:34.098646   817 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:34.099408   817 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:34.083787 26614 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 21: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:34.107050 26618 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:12:34.110914 26620 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:34.061524   873 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:34.099493   888 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:34.129029   788 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:34.129703   788 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:34.130345   863 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:34.134752 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 85168.1us
I20260709 12:12:34.139137 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:34.147778   848 raft_consensus.cc:3055] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:34.148331   848 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:34.149266   848 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.156935 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:34.175877   890 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:34.177320 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:34.177171   848 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:34.182934 26615 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:34.186134   774 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:34.120751   817 consensus_queue.cc:1059] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:12:34.188287   817 raft_consensus.cc:3055] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:34.188673   817 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:34.189878   817 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:34.191222   817 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:34.122723   422 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:34.195196 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 54182.6us
I20260709 12:12:34.197028   422 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:34.197662   859 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:34.198498   859 consensus_queue.cc:1243] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:34.199143   827 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:34.208276 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.208532 26439 leader_election.cc:400] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18.
I20260709 12:12:34.208861 26439 leader_election.cc:403] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:34.210032 26439 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:34.212437   827 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18.
I20260709 12:12:34.213229   827 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:34.216234   800 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:34.217851 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 78894.1us
I20260709 12:12:34.221230 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:34.222213 26613 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:12:34.222502   774 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:34.223047   774 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.224226   859 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:12:34.225764   779 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.226305   779 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:34.230527   779 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:34.197067 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:34.232585   859 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:34.233033 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:34.233285   859 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 20 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:34.233884   847 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:34.234314   847 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.234706   847 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:34.234792   859 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:34.265004 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:34.242976   873 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:34.270771   890 raft_consensus.cc:2764] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:12:34.279668 32272 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.272982   830 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:34.267776   422 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:12:34.293488 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:34.305469 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:34.292304   774 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:34.323122 32272 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.298475   352 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:34.326246 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 61389.7us
I20260709 12:12:34.284016   865 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 12:12:34.337743 32272 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:34.293926   830 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:34.339965 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 51280.6us
I20260709 12:12:34.323313   849 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:34.327347   352 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:34.348863 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:34.350695 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 51372.1us
I20260709 12:12:34.352555 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:34.311247 32721 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:34.368311 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.353557   352 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:34.373605 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:34.386847   907 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:12:34.363488   884 raft_consensus.cc:2764] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 12:12:34.366209 32670 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:34.390615 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:34.393325   908 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.127s	user 0.000s	sys 0.002s
W20260709 12:12:34.393622   901 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.129s	user 0.000s	sys 0.002s
I20260709 12:12:34.402590 26439 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:34.409480 26621 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
W20260709 12:12:34.413573   906 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.148s	user 0.002s	sys 0.000s
I20260709 12:12:34.414637   865 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:34.417738   900 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.150s	user 0.002s	sys 0.000s
I20260709 12:12:34.419870   830 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:34.391692 32670 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:34.473907   724 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.476379   724 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:34.444343   827 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:34.479125   865 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:34.443451 32721 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:34.482528 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 80079.1us
I20260709 12:12:34.483450 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:34.485461 26439 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:34.499423 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 379685us
W20260709 12:12:34.450037 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 102228us
W20260709 12:12:34.513286 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 164514us
I20260709 12:12:34.517760 26439 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:34.518419 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:34.438422   779 consensus_queue.cc:1059] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 12:12:34.532218 26439 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:34.526147   849 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:34.541540 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:34.522045   422 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:34.533442   774 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.526285   724 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:34.547996 27133 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:34.535758   873 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:12:34.540553   800 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:34.531276   830 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:12:34.559695   848 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.528043   847 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:34.559839   724 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.565811   848 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.558197   890 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:34.573789 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:34.574556 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:34.574934 26469 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:12:34.575074 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:34.575935 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:34.576597 26621 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:34.571507   724 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:34.582526 26622 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:34.561594   774 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.583030 26622 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:34.582201   352 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.585966 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:34.588023 26615 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 15: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:34.567440   800 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:34.592433   800 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.569638   873 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:34.574169   890 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:34.594832   890 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:34.567239   746 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:34.595166   873 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.599809   847 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:34.600986 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 57981.7us
I20260709 12:12:34.601815 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:34.603060 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:34.603803   913 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:34.604218   913 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:34.604619   913 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:34.604818 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:34.567050   912 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:34.583914 26622 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.610646   859 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:34.611559   859 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:34.609587   849 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:34.612481   849 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:34.612922   849 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:34.612577   859 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:34.617866   352 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:34.625201 26622 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:34.634714 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:34.635617 27161 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 22: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:34.636850 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:34.640457 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:34.642331 32721 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:34.644160   888 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:34.644661   888 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:34.645612   888 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.647799   848 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:34.650569 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 118293us
I20260709 12:12:34.675921 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:34.651415   774 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:34.629393 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:34.652815 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:34.653973 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:34.654778 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:34.654847 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:34.658970 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:34.659813 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:34.665510 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:34.666039 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:34.679991 26620 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:34.666623 26614 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:34.616370   847 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:12:34.681583 26621 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 20: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:34.682667 26619 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 20: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:34.683401 26616 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:34.685177 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:34.661671   724 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.687402 26514 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:34.677734   912 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:34.700470 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:34.700726   912 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.702788 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:34.703665 27164 raft_consensus.cc:2410] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:12:34.684142   422 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:34.683959   788 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 12:12:34.710150 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:34.710947 26544 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:34.711385   746 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:34.712126   352 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:34.714673 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:34.715415 26545 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:34.716594   874 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:34.717200   874 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.718771 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:34.719444 26542 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:34.711329   774 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:34.722617 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:34.722661 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.711004 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:34.731269 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:34.732122 26544 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:34.733261 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 156953us
I20260709 12:12:34.723933 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:34.719517   874 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:34.735610 26622 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:12:34.735077 26546 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:12:34.737565 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:34.658998   849 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:34.699518   888 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:34.745950 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:34.743467 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:34.726614   848 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:34.750379 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:34.751041 27167 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:34.746794 26542 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:34.760414   724 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:34.760788   849 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:34.764377 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:34.765305 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:34.766215 26471 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 21: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:34.766781 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:34.767556 26470 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 21: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:34.768503 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:34.769165 26464 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:12:34.746313   884 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:34.770586 26467 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 12:12:34.770723   884 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:34.771032 26467 pending_rounds.cc:85] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 14
I20260709 12:12:34.771279   884 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:34.754175   848 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.772527   848 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:34.772585 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:34.773491 26465 raft_consensus.cc:2410] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:12:34.760440 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:34.764556 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:34.775736 26468 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:34.776381 26439 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:34.776949 27161 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:34.772047 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:34.777266 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 66372.6us
I20260709 12:12:34.778270 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:34.779366 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:34.779929 26542 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:34.771392 26467 pending_rounds.cc:107] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 12:12:34.781872 26467 raft_consensus.cc:2889] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:34.783203 26469 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:34.803618 26472 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 17: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:34.736619   774 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.812686 26439 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:34.816622 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:34.819144 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.807404   912 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:34.832154 26545 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:34.820644 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:34.833084 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.828537 26542 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:34.832683 27164 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:34.836072 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:34.837786 26472 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:34.838308 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:34.839049 26469 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:34.839847 26543 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:34.840147 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:34.849123 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:34.852192 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:34.852908 26618 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:34.854035 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:34.855597 26619 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 17: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:34.834654   917 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:34.859692   917 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.862946 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:34.805142   913 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:34.866925 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:34.850668   788 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:34.847399   827 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:34.860134   917 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:34.887323 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:34.846817   911 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:34.888685   911 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:34.871084 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:34.891171   911 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:34.891860   530 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:34.891985 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:34.835693   668 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
W20260709 12:12:34.873071 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 59372.1us
I20260709 12:12:34.874814 26622 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:34.893473 26622 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:34.879096 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:34.894037 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:34.894243 26622 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.875039 26548 raft_consensus.cc:1217] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Deduplicated request from leader. Original: 11.9->[13.10-18.12]   Dedup: 13.10->[16.11-18.12]
I20260709 12:12:34.899669 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:34.887537   774 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:34.909761 27167 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:34.892830   779 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 12:12:34.896510 26548 pending_rounds.cc:85] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 10
I20260709 12:12:34.911197 26548 pending_rounds.cc:107] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 12:12:34.910375 26547 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
I20260709 12:12:34.907769 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:34.896088 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:34.912135 26548 raft_consensus.cc:2889] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:34.905519 26618 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:34.911463 26539 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:34.911413 27166 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:34.909111 26468 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:34.916231 26473 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:12:34.920547 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.921535 27161 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:34.932642 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:34.934319 26469 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:34.934653 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:34.935243   913 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:34.935380 26471 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:34.919476   704 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:34.936399   704 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.936712   863 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.937364 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:34.938095 26470 raft_consensus.cc:2368] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22.
I20260709 12:12:34.865324   912 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:34.907825   530 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:34.938700   912 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:34.936968 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:34.940232 26464 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:34.941031   912 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:34.941229 26473 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:34.911878   827 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:34.941903   801 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:34.915875   788 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 12:12:34.942332   801 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:34.943248   801 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:34.944566   801 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:34.945720 26622 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:34.940910 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:34.951509 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:34.952473 26544 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:34.953583 26439 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:34.954623 32721 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:34.937394   863 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:34.960901 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 43973.3us
I20260709 12:12:35.007201 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:34.911043   800 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:34.936785   704 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:34.960780   890 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.963891 27159 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26. Ops: []
I20260709 12:12:34.967594 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:34.968924   884 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.969472 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:35.011366 26470 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:35.011392 26464 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:34.970062 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:34.970631 26469 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:35.012827 26471 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:34.970755 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:34.971483 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:34.971427 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:34.977103 26472 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:35.013850 26468 raft_consensus.cc:2410] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:12:34.977278   917 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:34.954083 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:34.994029 26622 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:34.995690 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:34.997305   827 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:35.016963 26540 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:12:35.018460 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:34.997231   848 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:34.999024 26615 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:34.999634 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:35.019296 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:35.012454 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:35.000128 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:35.019994 26472 raft_consensus.cc:2376] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19. Re-sending same reply.
I20260709 12:12:35.001777 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:35.004493 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:35.022464 26542 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:35.011427 26546 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:35.022512 26620 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:35.007568 26539 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
I20260709 12:12:35.032655 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:35.051199 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:35.051499 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:35.051910 26469 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:35.052714 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:35.056365 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:35.056546 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:35.057375 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:35.058000 26468 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:35.057890 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:35.059180 26617 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: []
W20260709 12:12:35.059947 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47565us
I20260709 12:12:35.062232 26616 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:35.063210 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:35.063967 26464 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:35.064246 26541 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 12:12:35.016158   859 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:35.064859 26467 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:35.065223 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:35.068415   911 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:35.063423   422 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:35.070576   422 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:35.071014   422 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:35.064522   530 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:35.074352   530 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.074769   530 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:12:35.075188   929 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:12:35.075181 26466 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:12:35.068421 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:35.068297 26622 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:35.050077   827 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:35.059465   724 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:35.068005   830 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:35.088477 26471 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:35.090041 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:35.091306 26514 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:35.111915 26469 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
I20260709 12:12:35.124644 26470 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:35.091435   848 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:35.062809   874 consensus_queue.cc:1059] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:12:35.095616   917 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:35.095902 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 141920us
I20260709 12:12:35.100801 26468 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
I20260709 12:12:35.126729 26514 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:35.164077 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 98246.7us
I20260709 12:12:35.165795 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:12:35.165824 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 100678us
I20260709 12:12:35.075807   890 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:35.168731 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:35.124811   817 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:35.054080   912 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
W20260709 12:12:35.136322   929 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:12:35.106297   724 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:35.162123   888 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:35.106060   911 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 19 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:35.123651   830 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:35.248402   848 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:35.249815   848 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.250449   848 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:35.251369   884 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:35.208859   931 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:35.252444   931 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:35.252929   931 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:35.254638   926 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:12:35.257213   746 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:12:35.248524   911 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:35.262828   874 raft_consensus.cc:3055] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:35.263412   874 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:35.264469   874 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:35.268158   830 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:35.267532   827 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:35.271392   863 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:35.258275   920 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:35.275928   888 raft_consensus.cc:697] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:35.276925   888 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:35.281677 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.080232 32721 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.126s
I20260709 12:12:35.266098   874 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:35.286917 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 287329us
I20260709 12:12:35.215622   917 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:12:35.215386   724 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:35.289798 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 163130us
I20260709 12:12:35.161845   774 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.085s
I20260709 12:12:35.174158   744 raft_consensus.cc:2764] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:12:35.169838   913 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:35.313666 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:35.295040 26470 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
W20260709 12:12:35.324728 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 156110us
I20260709 12:12:35.328234 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:35.330200   849 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:35.330821   849 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:35.320896   913 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:35.333070   849 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:35.333142   913 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:35.328686 26513 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:35.335197 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 121776us
I20260709 12:12:35.339373 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:35.343032 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:35.354664 26616 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:35.358336 26614 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:35.288846   422 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:35.368641 26620 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:12:35.324558   668 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.376608 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:35.382792 26470 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:35.339076   873 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.395341 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:35.399957 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:35.403617 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 75058.4us
I20260709 12:12:35.404829 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:35.327706   848 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:35.407437   849 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:12:35.407709 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 70008.1us
I20260709 12:12:35.416083 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:35.406625   779 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:35.406543   817 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:12:35.465535   940 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:35.473881   884 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:12:35.474570   884 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:35.475860   884 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:35.477861   884 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:35.403283   873 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:35.479455   422 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:35.419358   849 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 22 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:35.480690   873 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:35.481084   849 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:35.394421   668 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:35.486572   668 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:35.458141 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:35.488713 26548 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 26: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:35.403728   911 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:35.498085 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 116414us
I20260709 12:12:35.407791   936 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
W20260709 12:12:35.492365 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 76572.5us
I20260709 12:12:35.457942   774 raft_consensus.cc:2764] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:12:35.506908 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:35.490622   800 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.498520   911 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:12:35.526449 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.507839   938 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:12:35.491608   530 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:35.538569 26544 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:12:35.553975 26540 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
W20260709 12:12:35.554944 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 143234us
I20260709 12:12:35.557646 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:35.497679   830 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:35.570315 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:35.573988 26548 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:35.558074   938 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:35.545863   937 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:35.580112 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:35.582933 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 256857us
I20260709 12:12:35.583748 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:35.584980 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:35.587175 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:35.588760 26540 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:35.546250   873 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:12:35.599903 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:35.532337   800 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:35.563074   912 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
W20260709 12:12:35.682816 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 97962us
I20260709 12:12:35.696120 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:35.559427   936 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:12:35.588625 32721 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.701860 26513 leader_election.cc:400] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22.
I20260709 12:12:35.702855 26513 leader_election.cc:403] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:35.708513 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:35.598964   946 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:35.676249   863 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:35.723138 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:35.765202 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:35.766038 26540 raft_consensus.cc:2393] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 18: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:35.759991 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:35.587581   937 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:35.773638 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.772783 26469 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:35.774768 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:35.702029   827 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:35.788470 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:35.789496 26470 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:35.692381   668 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:35.794517 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 211689us
I20260709 12:12:35.761739   920 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:35.805399   955 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:35.817698   920 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:35.817901   955 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.818372   955 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:35.818816   920 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:35.820289   920 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:35.805933   942 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:12:35.806313 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:35.827541 26621 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:35.807446   951 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 12:12:35.808332   943 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
W20260709 12:12:35.808566   941 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 12:12:35.809134 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:35.693465   938 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:35.816999   933 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
I20260709 12:12:35.707477   931 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:35.799904 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:35.772584   848 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:35.678930   911 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:35.836258 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:35.849361 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:35.712352 32721 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:35.861613 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 52608.9us
I20260709 12:12:35.871061 26540 raft_consensus.cc:2368] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21.
I20260709 12:12:35.875221 26470 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:35.836843 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:35.876638 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 273873us
I20260709 12:12:35.777932   724 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:35.884079 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:35.824576   946 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:35.887229 26469 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 21: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:35.888088 26466 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:35.890280   956 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:35.892056 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:35.893481   704 consensus_meta.cc:287] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.883s	user 0.011s	sys 0.000s
I20260709 12:12:35.895449 26541 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:35.896463 26468 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 19: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:35.897257   800 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:35.897994 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:35.898907 26548 raft_consensus.cc:2410] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 21 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 9.
I20260709 12:12:35.878182   888 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:35.899508   888 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:35.899960   888 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:35.904165 32721 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:35.826727   779 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.078s
I20260709 12:12:35.861687   668 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22.
I20260709 12:12:35.894055   704 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:35.880151   873 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:35.882198   530 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:35.914675   704 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:35.914130   873 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:35.923610   873 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:35.925213   873 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:35.925469   946 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:35.897394 26467 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: [17.10-20.12]
I20260709 12:12:35.935552   422 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:35.936141   422 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:35.937249   422 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:35.938983   957 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.939582   957 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:35.942035   957 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:35.943323   724 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:35.944487   422 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:35.945027 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:35.975523 26621 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:35.979125 26514 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:35.979344 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 270926us
I20260709 12:12:35.946717 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:35.948098 26543 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:35.949332 26545 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:35.952260   937 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:35.953984 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:35.954345 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:35.959242   830 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:35.961691 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:35.983424 26465 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:35.962299 26464 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:35.963182   788 raft_consensus.cc:3055] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:35.889453 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:36.000864 26471 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:36.002571 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:36.003877 26469 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 15: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:36.005401 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:35.896494   931 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:36.025099 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 135745us
W20260709 12:12:36.024502 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:36.027449 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.011656   779 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:36.011184   788 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:36.057631 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:36.059108 26467 pending_rounds.cc:85] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 13
I20260709 12:12:36.030124   830 raft_consensus.cc:2764] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
W20260709 12:12:36.030644   874 consensus_meta.cc:287] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.715s	user 0.011s	sys 0.001s
I20260709 12:12:36.062629 26467 pending_rounds.cc:107] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 12:12:36.066145 26467 raft_consensus.cc:2889] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:36.066953 26467 pending_rounds.cc:107] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 12:12:36.067598 26467 raft_consensus.cc:2889] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:36.006812   955 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:36.018011   937 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:12:36.084916 26469 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:36.080953 26546 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:36.088403 26539 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:36.101686 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:36.090137 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:36.099151 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:36.056900   888 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:35.994059 26547 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:12:36.106637 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:36.071249   530 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:36.105911 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.117245 26540 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:36.117570 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:36.070798   779 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:36.116179 26542 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:36.079151   827 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:36.079175   958 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.119939 26548 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:36.120430 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:36.123584 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:36.123940 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:36.123728 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:36.124430 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:36.131193 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:36.139055 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:36.139343 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:36.139674 26620 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:36.121315   931 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:36.133956 26542 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:36.133466   827 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:36.098066   945 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:12:36.141223 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:36.127435   913 consensus_meta.cc:287] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.794s	user 0.016s	sys 0.003s
I20260709 12:12:36.209270 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:36.213451 26471 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:36.131783 26546 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:12:36.139910 26614 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:12:36.143296 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:36.144866 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:36.146505   953 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.146817   962 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:36.147287   830 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:36.147578 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:36.149398 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:36.227540 27167 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:36.150107   801 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:36.171041   779 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:36.172084 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:36.121352   530 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:36.173466 26613 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:36.173976   888 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:36.175506   955 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:36.177889 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:36.178707 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:36.123360   788 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:36.199419 26469 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:12:36.206581 26545 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:36.188944 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:36.225487 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:36.230296 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 82814us
I20260709 12:12:36.277683 26472 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:36.231741 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:36.278909 26542 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:36.233219 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:36.280169   966 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.050s	user 0.000s	sys 0.003s
I20260709 12:12:36.280539 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:36.231562 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:36.236323 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:36.236992 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:36.238835 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:36.286278 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 97496.9us
I20260709 12:12:36.244002 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:36.270797 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:36.288067 26464 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:36.289407 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:36.289602 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:36.233032 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:36.248318 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:36.242697   970 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.079s	user 0.012s	sys 0.012s
I20260709 12:12:36.278110 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:36.287587 26539 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:36.290807 26544 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 15: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:36.292347 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:36.226778   962 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:36.298368 26613 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 15: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:12:36.233685   884 consensus_meta.cc:287] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.755s	user 0.013s	sys 0.009s
I20260709 12:12:36.276881   938 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:36.294360 26542 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:36.323359   938 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:36.295265 26619 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:36.299896 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:36.327680   964 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.088s	user 0.000s	sys 0.003s
I20260709 12:12:36.327844   830 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:36.294839   746 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:36.302336 26543 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:12:36.129747   958 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:36.307909   801 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:36.307947 26539 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 12:12:36.309850 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 73610.2us
I20260709 12:12:36.232291   863 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.316437 26613 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:36.322338 26470 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:12:36.317720 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:36.330439 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52436.1us
I20260709 12:12:36.348377 26472 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:36.349274 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:36.352622 27133 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:36.226171   931 raft_consensus.cc:697] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:36.237493   848 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:36.270020   873 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:36.369344 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.343662 26544 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:36.355540 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:36.225520   913 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:36.353137 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:36.373430 26439 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:36.374660 26439 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:36.326278   938 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:36.376696 26545 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 12:12:36.377154 26545 pending_rounds.cc:85] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 14
I20260709 12:12:36.377378 26545 pending_rounds.cc:107] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 12:12:36.377620 26545 raft_consensus.cc:2889] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:36.377904 26439 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:36.361785 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 44178.1us
I20260709 12:12:36.364115 26513 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:36.364715 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.234642   953 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:36.312376   962 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:36.467151 26464 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
W20260709 12:12:36.469030 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 105149us
I20260709 12:12:36.471637 26513 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:36.370735   955 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:36.478794 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:36.384867   830 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:36.483629 27161 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:12:36.486061 27168 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:36.486527   971 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.486937   944 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:36.487356   963 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:12:36.488085   967 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.059s	user 0.001s	sys 0.003s
I20260709 12:12:36.389617   800 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:36.357555   936 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.109s
I20260709 12:12:36.354104   801 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:36.388517   724 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:36.482784   956 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:36.384627   873 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:36.569741   953 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:36.513461 26473 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:36.360721   746 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.115s
I20260709 12:12:36.406649   774 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:36.358592   863 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:36.478107   884 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:36.574092   774 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:36.574697   884 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:36.576534 26473 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:36.576786   774 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:36.576975   884 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:36.489275   940 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:36.586503 26542 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:36.523483   800 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.550995   956 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:36.526365   830 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:36.552480   936 consensus_queue.cc:1243] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 12:12:36.668082 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 290239us
I20260709 12:12:36.669014 26439 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:36.669430 26465 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.659s	user 0.014s	sys 0.003s
I20260709 12:12:36.669935 26465 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:36.516948   971 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:36.588833   888 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:36.677135 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 225286us
I20260709 12:12:36.591717   884 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:36.660219   800 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:36.710793 26465 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 19. Current term is 20. Ops: []
W20260709 12:12:36.709123 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.725605 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2764) took 1339 ms. Trace:
I20260709 12:12:36.567900   931 consensus_queue.cc:237] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:36.704901   848 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:36.727392 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:36.726089 26541 rpcz_store.cc:276] 0709 12:12:35.378106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.378252 (+   146us) service_pool.cc:224] Handling call
0709 12:12:35.895254 (+517002us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.895939 (+   685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.717244 (+821305us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b54001059d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:36.717536 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1149496064}
I20260709 12:12:36.707865   944 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.711982   935 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:36.733210 26473 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 19: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:36.717499   955 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.718226   744 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:36.742252   932 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.270s
I20260709 12:12:36.743311   965 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:36.743392   961 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.279s
W20260709 12:12:36.744060   972 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:12:36.755065 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:36.718055   830 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:12:36.713375   888 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:36.744473   976 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:36.751330   940 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:36.791596   942 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:12:36.744624   968 raft_consensus.cc:2764] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:12:36.727520   884 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:36.763792   958 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:36.755908   744 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:36.757078   984 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:36.752210   955 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:36.728470   956 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:36.990898 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:36.990368 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 2800) took 1158 ms. Trace:
I20260709 12:12:36.740341   944 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.011606 26469 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:37.011489 26468 rpcz_store.cc:276] 0709 12:12:35.824286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.824417 (+   131us) service_pool.cc:224] Handling call
0709 12:12:36.982387 (+1157970us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b54002dbc54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:36.982546 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32519424}
I20260709 12:12:36.996995   987 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.235s
W20260709 12:12:36.997730   974 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.371s	user 0.002s	sys 0.000s
I20260709 12:12:36.998172   982 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:36.998760   960 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:12:37.000397   978 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
W20260709 12:12:37.001554   981 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.260s	user 0.000s	sys 0.000s
I20260709 12:12:37.002656   744 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:36.964231   863 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:37.023901 26469 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:12:36.760269   965 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:36.982847   801 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:37.012054   873 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:37.029480   983 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 12:12:36.821161   976 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.043138 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:37.044122   991 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.052372 27162 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 20 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:37.058056   992 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:37.044034   744 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.047189 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:37.062976   980 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:12:37.069892   788 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:37.071869   955 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:37.073843   888 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:37.076797   997 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:36.975431   848 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:37.092147 26437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.000s	sys 0.011s
W20260709 12:12:37.093371 26437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.001s	sys 0.012s
I20260709 12:12:37.092546   991 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.033406   982 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.112340   884 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:37.094774   744 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.116525   744 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:36.990360   984 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.120366   984 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:37.122058 27159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 865) took 1531 ms. Trace:
I20260709 12:12:37.093133   992 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.122555 27159 rpcz_store.cc:276] 0709 12:12:35.590550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.590698 (+   148us) service_pool.cc:224] Handling call
0709 12:12:35.676157 (+ 85459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:35.703837 (+ 27680us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:12:35.879717 (+175880us) log.cc:844] Serialized 14 byte log entry
0709 12:12:36.278991 (+399274us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:36.332514 (+ 53523us) log.cc:844] Serialized 26 byte log entry
0709 12:12:36.332675 (+   161us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:36.332710 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.332782 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:37.121806 (+789024us) raft_consensus.cc:1685] finished
0709 12:12:37.121831 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:37.121970 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":158503,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":32770,"raft.queue_time_us":119246,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":8986,"thread_start_us":460196,"threads_started":2,"wal-append.queue_time_us":412836}
I20260709 12:12:37.124773   992 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:37.128333   965 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:37.118762   884 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:37.135572   920 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:37.136075   920 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:37.136904   920 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:37.139246   422 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.133s	user 0.003s	sys 0.011s
I20260709 12:12:37.141392   976 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:37.142132   979 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.125s	user 0.002s	sys 0.008s
W20260709 12:12:37.146896 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 103846us
I20260709 12:12:37.148269 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2777) took 1203 ms. Trace:
I20260709 12:12:37.148690 26540 rpcz_store.cc:276] 0709 12:12:35.944639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.945523 (+   884us) service_pool.cc:224] Handling call
0709 12:12:35.945834 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:36.117679 (+171845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.148020 (+1030341us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54002f8ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:37.148208 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393749248}
I20260709 12:12:37.152110 26470 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:12:37.153553 26587 leader_election.cc:400] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21.
I20260709 12:12:37.154003 26587 leader_election.cc:403] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:12:37.154740 26546 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:37.138193   920 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:37.150337 26513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.004s	sys 0.009s
W20260709 12:12:37.156810 26513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.004s	sys 0.010s
W20260709 12:12:37.158066 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 686462us
I20260709 12:12:37.160637 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:37.163327 26514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.007s	sys 0.012s
W20260709 12:12:37.163708 26514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.007s	sys 0.012s
W20260709 12:12:37.163990 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 694174us
I20260709 12:12:37.166363 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.167215 26622 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 20: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:37.168932 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:37.165171 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:37.173542   913 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:37.173457   888 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:37.177623   965 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:12:37.179868   982 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:37.168531   997 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21.
I20260709 12:12:37.177390 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1050) took 1148 ms. Trace:
I20260709 12:12:37.176561   944 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:37.186182 26545 rpcz_store.cc:276] 0709 12:12:36.028987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.284352 (+255365us) service_pool.cc:224] Handling call
0709 12:12:36.284638 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:36.473478 (+188840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.177075 (+703597us) spinlock_profiling.cc:243] Waited 91.7 ms on lock 0x7b540018b5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:37.177320 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210887936}
I20260709 12:12:37.153138   976 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
W20260709 12:12:37.193717   962 consensus_meta.cc:287] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.727s	user 0.009s	sys 0.002s
I20260709 12:12:37.171481 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:37.198288 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:37.201736 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 486633us
I20260709 12:12:37.195739 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:37.204039 26513 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:37.197697 26620 pending_rounds.cc:85] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 11
I20260709 12:12:37.210748 26620 pending_rounds.cc:107] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 12:12:37.211127 26620 raft_consensus.cc:2889] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:37.212425 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3051) took 1074 ms. Trace:
I20260709 12:12:37.170465   984 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:37.212821 26621 rpcz_store.cc:276] 0709 12:12:36.138345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.138496 (+   151us) service_pool.cc:224] Handling call
0709 12:12:36.138857 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:36.151225 (+ 12368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:36.151262 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:36.676901 (+525639us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b2c000c78e8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:12:36.704561 (+ 27660us) log.cc:844] Serialized 26 byte log entry
0709 12:12:37.195242 (+490681us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:37.195283 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.195363 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:37.195411 (+    48us) raft_consensus.cc:1685] finished
0709 12:12:37.195421 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:37.212326 (+ 16905us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11903,"raft.queue_time_us":12023,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":134,"spinlock_wait_cycles":68088576,"thread_start_us":460553,"threads_started":1,"wal-append.queue_time_us":471578}
I20260709 12:12:37.216850 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:37.215534 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.219457 26464 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:37.219666 26622 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:37.167450   848 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 12:12:37.194222   962 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.217092 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:37.156128   800 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.231324   976 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:37.231880 26473 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:37.207088   888 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.223379 26545 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:12:37.232383   888 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.234309   800 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:37.212598   744 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:37.238858   744 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:37.239283   965 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:37.222069 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:37.214905   779 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:37.213188   668 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:12:37.214576  1004 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:37.220542   913 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 12:12:37.216655   997 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:37.239884   965 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:37.224514 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.226295  1007 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:37.267869 26616 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 18: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:37.218179 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:37.242645 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.248839 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.269393 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:37.269935 26622 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
W20260709 12:12:37.256978 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.231781   976 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:37.266963 26613 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:37.270758 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.271178 26613 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:37.268937  1007 consensus_queue.cc:1243] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:12:37.270025 26545 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:37.273375 26540 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:37.216291   982 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:12:37.274677 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:37.247030   888 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:37.274681 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 56588.1us
I20260709 12:12:37.274403   944 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:37.297829 27168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 863) took 1708 ms. Trace:
I20260709 12:12:37.298178 27168 rpcz_store.cc:276] 0709 12:12:35.589371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.589507 (+   136us) service_pool.cc:224] Handling call
0709 12:12:35.676935 (+ 87428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:36.513766 (+836831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.295662 (+781896us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b540014fad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:37.297762 (+  2100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817637760}
I20260709 12:12:37.283051   976 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.284013   962 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:37.284210   993 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:37.271970 26613 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.300413 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:37.286195   956 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:37.286737 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 65717us
I20260709 12:12:37.239861   744 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:37.275902 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 53862.4us
I20260709 12:12:37.275158   988 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.268461   984 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:37.262208   997 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:37.271868   992 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:37.290067   971 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:37.273769   704 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:37.327319   530 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:37.288067   779 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:12:37.303297 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 78757.4us
I20260709 12:12:37.303974 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:37.304780 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.305584 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:37.340931 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.308487 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:37.309600 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:37.305099 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:37.343328 26540 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
I20260709 12:12:37.311343 26613 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:37.313930 27166 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:37.315479 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:37.318967   965 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.343794 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:37.342592 26545 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:37.319499   984 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.321700 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:37.323973   991 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:37.297591   944 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:37.310792 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:37.355113 27162 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:12:37.327883   704 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.346366 27159 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:37.341836 26616 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:37.352406 26539 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 11.
I20260709 12:12:37.369951 26514 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:37.372458   848 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:37.373052   848 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.373492   848 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:37.380684 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.398437   993 raft_consensus.cc:697] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 15 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:37.400112   993 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.350816  1010 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:37.353873   668 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:37.417425 26547 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:37.351854  1009 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:37.314950   988 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.420584   884 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:37.315121   957 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 12:12:37.422531   779 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.405822   976 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:37.423554   997 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.426779 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2788) took 1474 ms. Trace:
I20260709 12:12:37.405880   801 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:37.433754 26547 rpcz_store.cc:276] 0709 12:12:35.952046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.416862 (+1464816us) service_pool.cc:224] Handling call
0709 12:12:37.417230 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:37.426499 (+  9269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.426715 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:37.417991  1010 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:37.369729   991 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
W20260709 12:12:37.441465 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 89922.8us
W20260709 12:12:37.446872 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 97680.6us
I20260709 12:12:37.449249   913 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:37.456693   913 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.459177   913 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:37.463881   988 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:37.446213   884 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:37.466755 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.463150  1010 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.451658   997 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:37.479142 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.480232 26616 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
W20260709 12:12:37.481313 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.434059   848 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.445165   801 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.448670   992 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:37.470309   971 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.451318   944 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.506419   944 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:37.507064 26616 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:12:37.509626 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.510299 26616 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:12:37.510576   971 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:37.500313 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 192977us
I20260709 12:12:37.493762  1010 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:37.516511 26616 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:37.517119 26616 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:37.529510  1019 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:37.532842   971 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:37.534173  1022 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:37.534739  1022 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:37.535760  1022 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.537405  1022 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:37.538801 26616 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.540290 26616 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:37.542901   992 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.504298   957 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:37.546823   957 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.552349 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.557181 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.557933 26621 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
W20260709 12:12:37.559190 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:37.559744 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:37.550918 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 79392.3us
I20260709 12:12:37.549314   957 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:37.567619 26616 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:37.554751   884 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:37.583513 27161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 921) took 1440 ms. Trace:
I20260709 12:12:37.565408  1015 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:12:37.595386 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 2816) took 1229 ms. Trace:
I20260709 12:12:37.595923 26464 rpcz_store.cc:276] 0709 12:12:36.366382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.478514 (+112132us) service_pool.cc:224] Handling call
0709 12:12:37.595177 (+1116663us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54001fead4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:37.595312 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1619480832}
I20260709 12:12:37.597872 26622 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:37.602619 26615 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:37.584035 27161 rpcz_store.cc:276] 0709 12:12:36.142801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.143029 (+   228us) service_pool.cc:224] Handling call
0709 12:12:37.583288 (+1440259us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54006054d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:37.583397 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":607033728}
I20260709 12:12:37.605648 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.608093 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.608822 26613 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:12:37.612582 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.612996 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.607472 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:37.615252 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:37.616451 27162 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 18: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:37.619697 26544 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:37.595463  1015 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:37.626865 27159 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:37.630081 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:37.631165 26614 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:37.631323 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:37.632319 27166 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 14.
I20260709 12:12:37.635080 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:37.634981   779 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.638151 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:37.638331   779 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.638815   958 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:37.628635 26613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:12:37.639634 26613 raft_consensus.cc:606] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:12:37.639398   958 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.640890   779 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:37.641636   958 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:37.621919   940 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:37.642745   940 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.642861 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:37.643404   940 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:37.621758   530 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:12:37.637916   884 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.651120   668 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.653836 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.651777   668 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:37.656673 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.658692  1028 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:12:37.664470   990 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:37.569847   744 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:12:37.665043   990 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:37.665779   744 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:37.666427   744 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.669260   744 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:37.669895   744 raft_consensus.cc:3055] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:37.633615   848 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:37.670274   744 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:37.678604 26618 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:37.629398  1015 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:37.683326  1015 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.684813  1015 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:37.688584   704 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:37.666128   990 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.691852 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:37.692075 26614 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:37.692628 26545 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:37.690029   990 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:37.695438 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 2815) took 1365 ms. Trace:
I20260709 12:12:37.695860 26470 rpcz_store.cc:276] 0709 12:12:36.329989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.355195 (+ 25206us) service_pool.cc:224] Handling call
0709 12:12:37.695267 (+1340072us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b54000690d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:37.695374 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1764686592}
W20260709 12:12:37.697209 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:37.698642 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 60597.8us
I20260709 12:12:37.699507 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:37.700348  1028 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:37.701014   774 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.701113  1028 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:37.701857 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:37.702440  1028 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:37.701719   774 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.702829  1028 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:37.704506  1028 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:37.706709 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.706498  1028 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:37.705826  1009 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:37.732287   774 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:37.733608 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:37.734995 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:37.736092 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 966) took 1458 ms. Trace:
I20260709 12:12:37.736881 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.735014  1009 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.738004 26616 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 21: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:37.740485 26616 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:12:37.740389 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.741031 26616 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:37.742095 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 969) took 1028 ms. Trace:
I20260709 12:12:37.742743 26465 rpcz_store.cc:276] 0709 12:12:36.713800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.713953 (+   153us) service_pool.cc:224] Handling call
0709 12:12:36.714417 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:36.714697 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:36.727342 (+ 12645us) log.cc:844] Serialized 14 byte log entry
0709 12:12:36.749230 (+ 21888us) log.cc:844] Serialized 14 byte log entry
0709 12:12:37.713466 (+964236us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b180047e120. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5072fefa40 00007f5072fea4e4 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287 00007f50760f5208
0709 12:12:37.741620 (+ 28154us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:37.741694 (+    74us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:37.741759 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.741848 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:37.742022 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45437,"prepare.queue_time_us":22603,"prepare.run_cpu_time_us":131,"prepare.run_wall_time_us":29215,"raft.queue_time_us":1992781,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":153,"spinlock_wait_cycles":3533184,"thread_start_us":19131,"threads_started":1}
I20260709 12:12:37.748425 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:37.749729   801 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:37.752068 26514 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:37.753196 26620 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:37.759223   961 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.736626 26466 rpcz_store.cc:276] 0709 12:12:36.277311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.486320 (+209009us) service_pool.cc:224] Handling call
0709 12:12:36.486744 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:36.674629 (+187885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:36.674677 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:36.723969 (+ 49292us) log.cc:844] Serialized 26 byte log entry
0709 12:12:36.975342 (+251373us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:12:36.997211 (+ 21869us) log.cc:844] Serialized 14 byte log entry
0709 12:12:37.735616 (+738405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.735720 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:37.735781 (+    61us) raft_consensus.cc:1685] finished
0709 12:12:37.735801 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:37.735989 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":738091,"prepare.queue_time_us":21970,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":96446,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":62747,"thread_start_us":416526,"threads_started":2,"wal-append.queue_time_us":325429}
I20260709 12:12:37.741894 26616 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.750211 27133 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:37.765394 26470 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
W20260709 12:12:37.767227 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.701225 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:37.777001 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:37.771615 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:37.781546 26465 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:37.762321   530 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.783212 26616 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:37.789353 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:37.786716   993 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:37.792837 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:37.779817   788 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.797784   884 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:37.786522   961 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.797837   788 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.799121   953 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:37.798056 26473 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:37.810335 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:37.821228 26621 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:37.802000 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:37.809841 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 606650us
I20260709 12:12:37.779119   873 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.778759   931 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.821308 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:37.825693 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 124558us
W20260709 12:12:37.828385 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 43901.8us
W20260709 12:12:37.807459  1020 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.231s	user 0.002s	sys 0.000s
I20260709 12:12:37.832752 27134 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:37.788641   801 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:37.825435   704 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.800800   957 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:37.845535 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:37.848296 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:37.800390   961 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:37.850164 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:37.800320   788 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:37.795141   993 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.809101  1001 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.806579   917 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.840901 26616 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:37.841538   990 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:37.852770 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:37.850715 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:37.855499 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:37.859556 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:37.862890 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:37.848625   827 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:37.830014   944 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:37.854836   422 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.844537   817 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.810484   530 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.803792   940 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:37.951324 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.916224 26473 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:37.860329   913 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:37.872953   987 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:37.917814   990 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:37.919658 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:37.877501 26621 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:37.916499 26470 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:37.860608   801 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:37.837819   953 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.032s
W20260709 12:12:37.928244 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.916115   944 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.927961 26471 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 20: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:37.937676 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:37.930526 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:37.865757   946 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.800s	user 0.018s	sys 0.024s
I20260709 12:12:37.853299   937 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:37.788466   744 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.947124 26541 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:37.992081 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:37.993739 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:37.805507   668 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.952734 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:37.863971   993 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:37.838593   931 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.838811   873 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.854270   963 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
W20260709 12:12:37.969308 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.969985 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2794) took 1405 ms. Trace:
I20260709 12:12:37.938315 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:38.009265 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 71078.8us
I20260709 12:12:37.869128   848 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:37.952108   974 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:12:38.008626 26546 rpcz_store.cc:276] 0709 12:12:36.564395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.564531 (+   136us) service_pool.cc:224] Handling call
0709 12:12:36.564845 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:37.155174 (+590329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.969706 (+814532us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b5400105ed4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:37.969918 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1356195584}
I20260709 12:12:38.011039 26473 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:37.975203 26539 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 20: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:37.928930   888 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.849623   774 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 12:12:37.881062   958 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:37.990206 26470 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:38.072400 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:38.073669 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:38.074318 26470 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:38.075150 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:38.075829 26470 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 18: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:38.076619 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:38.077286 26470 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 21: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:38.078044 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:37.969288   952 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:12:37.956233   913 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.967904   990 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:38.079342   913 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:37.912053   917 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.003845 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:38.083480 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:38.084175   917 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:37.973513   971 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.085143   971 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:37.978592   944 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:37.978868   946 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.918s	user 0.018s	sys 0.024s
I20260709 12:12:37.848644   704 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.091771 26548 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:38.092442 26470 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:38.093700 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2790) took 2141 ms. Trace:
I20260709 12:12:38.035463 26467 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
W20260709 12:12:38.037001 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:38.095090 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.911859  1001 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.096127 26467 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:38.096485   990 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:38.097373  1001 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:38.032371  1018 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:38.031131   884 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:38.011183  1040 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:38.098131  1018 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:38.098721  1040 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:38.100577  1018 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:38.101240 26469 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:38.101315  1040 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:38.008306  1014 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:38.102224  1014 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:38.102802  1014 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:38.103394 26469 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:12:38.041966 26472 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22. Ops: []
W20260709 12:12:38.012377 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 59749.6us
I20260709 12:12:37.981184   937 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.094095 26548 rpcz_store.cc:276] 0709 12:12:35.952658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.212009 (+259351us) service_pool.cc:224] Handling call
0709 12:12:36.237264 (+ 25255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:38.092321 (+1855057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:38.093438 (+  1117us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b5400140354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:38.093624 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4264544512}
I20260709 12:12:37.956676   422 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:37.947002   827 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:38.066908 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:37.967629   955 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:12:37.990989 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:38.091848 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:38.032040  1029 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:12:37.956597   817 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.105571 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:38.072218   936 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:37.972617   987 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.158427 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:38.186049 26471 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 19: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:38.123375 26473 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:38.169458 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 63953.6us
I20260709 12:12:38.065714 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:38.191490 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 125875us
I20260709 12:12:38.176504 26469 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:38.192745 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:38.114439   937 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:38.198134 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:38.199103 26613 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 22: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:38.042407   848 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.110839  1019 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 12:12:38.197059 26615 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:12:38.195895 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:38.202381 26465 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:38.177481   936 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.206192 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:38.105863   888 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.207716 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:38.208127 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:38.215754 26618 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:38.208494 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:38.216980 26621 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:38.111538   958 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.213302 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:38.199766  1009 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:38.228004 26471 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:38.232889 26465 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:38.202623   968 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.114473   801 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.242710 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:38.244616 26465 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:38.214258   936 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:38.209797  1001 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.239001 26439 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:38.248149 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:38.222185   724 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:38.252763 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:38.256953 26439 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:38.258319 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:38.258688 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:38.250605   788 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:38.256561 32721 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:38.308012 26541 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:38.306635 26473 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:38.246531   961 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:12:38.265802   985 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:38.375968   985 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.376466   985 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:38.312510 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:38.379627 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:38.380239 26617 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:12:38.309674 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:38.383383 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:38.384547 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:38.385026 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:38.385841 26621 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:38.389142   971 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:38.385087 26619 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:38.395676   704 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:38.267066   920 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:38.406672   920 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.407169   920 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:38.266268   932 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:38.410650   932 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:38.411201   932 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:38.416066   985 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.420334 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:38.421415   830 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.422082   830 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.424335   830 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:38.424430   912 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:38.427853   917 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.428412   917 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.430850   917 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:38.420259 26617 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:38.434994  1030 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:38.435665  1030 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:38.436828  1030 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:38.441107  1035 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.448s	user 0.000s	sys 0.001s
I20260709 12:12:38.440824   932 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:38.402257 26619 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:38.443804 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:38.444494 26619 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:38.447537   985 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:38.454118   920 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:38.455097  1032 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.275s	user 0.000s	sys 0.002s
I20260709 12:12:38.456718   920 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:38.457212 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:38.458107   917 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:38.458614   917 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.459008   917 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:38.462234 26368 catalog_manager.cc:5697] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:38.468811   931 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:38.270972  1019 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:38.470558 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:38.471601  1019 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:38.473227  1019 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.438289  1030 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:38.470507   932 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:38.466111 26368 catalog_manager.cc:5697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:12:38.482544   917 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:38.489902   917 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:38.295239  1009 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:38.299228   800 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:38.310132  1037 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:12:38.295787   940 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:38.263546  1043 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:38.295591   530 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:38.246757   968 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:38.509398 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.296139   724 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:12:38.361224  1034 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:12:38.499600 32721 raft_consensus.cc:697] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:38.298537   874 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.219s
W20260709 12:12:38.565164 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 94740.7us
I20260709 12:12:38.566519 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:38.569149 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:38.516687   963 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:38.257540  1001 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.553467   704 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.516913   955 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.518651 26621 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:12:38.363696   788 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:38.546118   985 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.521998  1009 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:38.521272  1043 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:38.582474 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:38.597215 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:38.558372   971 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.567905   422 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:38.519297   800 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.610325   956 raft_consensus.cc:3055] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:38.611306   956 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:38.612517   956 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:38.611372   800 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:38.614228   956 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:38.623782 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:38.625667 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:38.628263 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:38.631114   913 consensus_meta.cc:287] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.001s
I20260709 12:12:38.631635   913 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:38.633998   913 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:38.638304 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.630056 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:38.641675 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44555.8us
I20260709 12:12:38.642730 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:38.642869 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:38.573865   779 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:38.634934   888 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:38.650166 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:38.634716 32721 consensus_queue.cc:237] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.659770  1009 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.662811   817 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:38.664845   724 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:38.640429   985 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:38.667220  1049 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:12:38.669027   985 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:38.669718  1045 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:12:38.669888   873 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:38.671337 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 972) took 1937 ms. Trace:
I20260709 12:12:38.658334   774 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:38.596761   946 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:38.679224 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:38.672027 26468 rpcz_store.cc:276] 0709 12:12:36.737304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.017451 (+280147us) service_pool.cc:224] Handling call
0709 12:12:37.017851 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:37.738618 (+720767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:37.738650 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:37.739213 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:12:37.842102 (+102889us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:37.842147 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.842235 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:38.671026 (+828791us) raft_consensus.cc:1685] finished
0709 12:12:38.671053 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:38.671223 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":720353,"raft.queue_time_us":721798,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":55,"thread_start_us":102505,"threads_started":1,"wal-append.queue_time_us":225950}
I20260709 12:12:38.635953   932 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.583261   963 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.592912   955 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.635732   530 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:38.657328   917 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.583652   704 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.608065  1043 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:38.701033  1001 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:38.713927   913 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:38.704044   968 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:38.705583   944 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.001s
W20260709 12:12:38.725674 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 46577.1us
I20260709 12:12:38.753916 26513 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:38.726948 26512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.023s	sys 0.062s
W20260709 12:12:38.754987 26512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.024s	sys 0.062s
W20260709 12:12:38.696280 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 431199us
I20260709 12:12:38.747530 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:38.708520  1022 consensus_meta.cc:287] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.171s	user 0.017s	sys 0.003s
I20260709 12:12:38.699337   988 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:38.700907   788 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:38.700326   958 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:38.749847 27133 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.015s	sys 0.031s
I20260709 12:12:38.761312 26622 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:38.791185 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:38.791234 27133 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.016s	sys 0.031s
W20260709 12:12:38.794550 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 943851us
I20260709 12:12:38.796808 26513 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:38.748200   888 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:38.763123 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:38.712431   963 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:38.814040 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:38.821476 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 399650us
I20260709 12:12:38.710721   932 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:38.826618   932 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:38.748339 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:38.767738   530 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:38.831384   530 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:38.832688 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:38.833472 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.769716   988 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.724557   774 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:38.834646   988 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:38.835264   774 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:38.850045   988 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:38.851361 26616 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:38.854264  1069 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.856817 27133 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:38.823828 26547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.000s	sys 0.020s
I20260709 12:12:38.699270   971 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:38.860565 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 97584.5us
I20260709 12:12:38.873356 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:38.815693   984 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:38.862102  1030 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:38.807462   956 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:38.742933   917 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:38.866526 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52578.1us
W20260709 12:12:38.871268 26547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.000s	sys 0.021s
I20260709 12:12:38.873955 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:38.874964 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:38.818162   937 consensus_meta.cc:287] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.001s
I20260709 12:12:38.883538 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:38.861466 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:38.884232 26540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.008s	sys 0.023s
I20260709 12:12:38.898295 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:38.901244 26540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.008s	sys 0.024s
I20260709 12:12:38.901294 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:38.769323   944 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:38.891839 26468 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:38.900985 26613 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:12:38.904189 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:38.904708 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:38.886670   873 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.894763 26464 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:38.765543   913 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:38.901700 26618 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:12:38.905702 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:38.899559 26622 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:12:38.894243 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2958) took 1015 ms. Trace:
I20260709 12:12:38.916743 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:38.913758 26547 rpcz_store.cc:276] 0709 12:12:37.878891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.879498 (+   607us) service_pool.cc:224] Handling call
0709 12:12:37.879908 (+   410us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:37.920157 (+ 40249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:37.920189 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:37.946654 (+ 26465us) log.cc:844] Serialized 52 byte log entry
0709 12:12:38.893921 (+947267us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:38.893958 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:38.894022 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:38.894064 (+    42us) raft_consensus.cc:1685] finished
0709 12:12:38.894075 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:38.894185 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39943,"raft.queue_time_us":49811,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":12656,"thread_start_us":901702,"threads_started":1,"wal-append.queue_time_us":855059}
I20260709 12:12:38.908473 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:38.888931   991 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:38.898736 26616 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:38.910254 26546 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:38.896385   940 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:38.916848 26545 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:38.924412 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:38.966730 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:38.967553 26616 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:12:38.898576  1030 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:38.919250 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:38.927438 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:38.969909 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:38.950727 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:38.972520 26542 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:38.975257 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:38.976032 26464 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:12:38.977774 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:38.979031 26473 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:38.980219 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:38.980914 26469 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 14: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:38.981806 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:38.928278 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:38.891767  1057 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:38.906091  1022 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.966730 26613 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 12:12:38.908900   932 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:38.911947  1009 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:12:38.984346 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 60043.4us
W20260709 12:12:39.022965 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.986349 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:39.023430 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.024494 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:39.025076 26545 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:38.987267 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:39.026870 26542 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 22: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:38.989377 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:38.874877  1069 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:39.007860 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:38.917217  1048 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:12:39.005887 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.013067 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:38.927728   991 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.927162   992 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:39.008633 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:39.015815 26469 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:38.896227  1071 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.099s
I20260709 12:12:38.927165  1051 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:39.001340 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 95072.3us
I20260709 12:12:38.984771   874 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.986644  1057 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.022233 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:38.903138  1044 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:39.023202  1010 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:38.909631   937 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:39.066615  1030 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:39.069589   937 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:38.916029   873 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:39.010067   774 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:39.070531   774 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:39.071142   774 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:39.071915   873 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:39.072718 26543 raft_consensus.cc:2368] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15.
I20260709 12:12:38.991345  1065 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:12:39.074903  1065 consensus_queue.cc:1243] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:39.079946  1071 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:39.043252   912 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.081571   912 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:39.084733   912 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:39.085574  1010 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:39.087671   992 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:39.088272   992 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:39.032358   704 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:39.090626   992 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:39.035296 26541 raft_consensus.cc:2368] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19.
I20260709 12:12:38.946718   958 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 12:12:39.039155 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:39.093050 26473 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:39.040004 26467 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:12:39.042300 26464 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:39.014407   788 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:39.095062   788 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:39.097262   788 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:39.019115   962 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:39.097961   962 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:39.100136   962 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:38.989038  1022 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:39.052474 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:39.059155  1053 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:12:39.059762  1044 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:39.060992  1055 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 12:12:39.125156 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 978) took 1269 ms. Trace:
I20260709 12:12:39.125896 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:39.126286 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:39.052330  1057 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:39.061012  1015 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:39.063728 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:39.066495   874 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:39.045013   991 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:39.121613  1050 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
W20260709 12:12:39.051898   957 consensus_meta.cc:287] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.200s	user 0.012s	sys 0.001s
I20260709 12:12:39.053007   982 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 12:12:39.132067 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:39.125552 26470 rpcz_store.cc:276] 0709 12:12:37.856251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.106848 (+250597us) service_pool.cc:224] Handling call
0709 12:12:38.107183 (+   335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:38.204533 (+ 97350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:38.204572 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:38.208801 (+  4229us) log.cc:844] Serialized 52 byte log entry
0709 12:12:38.563031 (+354230us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:38.580489 (+ 17458us) log.cc:844] Serialized 14 byte log entry
0709 12:12:38.580875 (+   386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:38.580991 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:39.124909 (+543918us) raft_consensus.cc:1685] finished
0709 12:12:39.124933 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:39.125096 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107436,"prepare.queue_time_us":71869,"raft.queue_time_us":97886,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":31770,"spinlock_wait_cycles":28504320,"thread_start_us":308604,"threads_started":1,"wal-append.queue_time_us":530791}
W20260709 12:12:39.141448 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 77795.9us
I20260709 12:12:39.146917 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:39.115604  1010 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:39.149268   957 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:39.152125   992 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:39.263877 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 100267us
I20260709 12:12:39.265292  1015 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:39.266494   788 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.268344 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:39.271668  1022 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:39.201557   971 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:39.272907   982 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:39.200141  1009 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:12:39.280730 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 257540us
I20260709 12:12:39.293723 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:39.384595 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 90948.3us
I20260709 12:12:39.385900 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:39.301875 27134 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.441s	user 0.012s	sys 0.013s
W20260709 12:12:39.388713 27134 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.534s	user 0.013s	sys 0.014s
W20260709 12:12:39.389053 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 1.53479e+06us
I20260709 12:12:39.392289 27134 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:39.315279 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2956) took 1452 ms. Trace:
I20260709 12:12:39.323707 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:39.382930 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:39.318104 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3890) took 1474 ms. Trace:
I20260709 12:12:39.387744 26439 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:39.394410 26544 rpcz_store.cc:276] 0709 12:12:37.862460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.862601 (+   141us) service_pool.cc:224] Handling call
0709 12:12:37.920119 (+ 57518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:38.163776 (+243657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:38.163814 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:38.178271 (+ 14457us) log.cc:844] Serialized 26 byte log entry
0709 12:12:38.614896 (+436625us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b18003fbb60. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5075c824bc 00007f5072fd048b 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1
0709 12:12:38.615070 (+   174us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:38.615110 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:38.616682 (+  1572us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54003cf854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:38.616745 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:39.315003 (+698258us) raft_consensus.cc:1685] finished
0709 12:12:39.315033 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:39.315198 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73534,"raft.queue_time_us":401423,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":16472,"spinlock_wait_cycles":419158528,"thread_start_us":323818,"threads_started":1,"wal-append.queue_time_us":518766}
W20260709 12:12:39.427899 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:39.549234 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 166421us
I20260709 12:12:39.315338 26368 catalog_manager.cc:5697] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 6 to 15, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 15 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:12:39.583771 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:39.587118 26470 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:39.539206 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:39.588570 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:39.589299 26464 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
W20260709 12:12:39.589003 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 196794us
I20260709 12:12:39.548883 26466 rpcz_store.cc:276] 0709 12:12:37.844092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.844218 (+   126us) service_pool.cc:224] Handling call
0709 12:12:37.873895 (+ 29677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:38.210092 (+336197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:38.210144 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:38.399616 (+189472us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b2c000327f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:12:38.400240 (+   624us) log.cc:844] Serialized 26 byte log entry
0709 12:12:38.851950 (+451710us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:38.852387 (+   437us) log.cc:844] Serialized 14 byte log entry
0709 12:12:38.872119 (+ 19732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.317746 (+445627us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b540035edd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:39.317809 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:39.317860 (+    51us) raft_consensus.cc:1685] finished
0709 12:12:39.317872 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:39.318033 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45998,"prepare.queue_time_us":237,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":26294,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":14154,"spinlock_wait_cycles":753721984,"thread_start_us":451188,"threads_started":1,"wal-append.queue_time_us":427626}
I20260709 12:12:39.591956 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:39.350544 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.277009 26618 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:39.594098 26473 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:39.350441 26539 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:39.351310 26545 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:12:39.597445 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:39.598150 26473 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:12:39.342053  1019 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:39.328379   884 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:12:39.600653 27133 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.011s	sys 0.051s
W20260709 12:12:39.380152  1052 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.515s	user 0.002s	sys 0.000s
W20260709 12:12:39.306137   946 consensus_meta.cc:287] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.000s
W20260709 12:12:39.357013 26369 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57044 (request call id 314) took 49094 ms (client timeout 15000 ms). Trace:
I20260709 12:12:39.640079 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:39.276569  1044 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:39.313292   888 consensus_meta.cc:287] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.000s
W20260709 12:12:39.375056  1043 consensus_meta.cc:287] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.001s
I20260709 12:12:39.579905   779 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:39.665252 27133 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.012s	sys 0.060s
I20260709 12:12:39.652094 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:39.643757 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:39.602802 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 215126us
I20260709 12:12:39.326349  1010 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:39.575352   920 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:39.291887   827 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:39.669991 26468 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:39.534449   971 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:39.376189  1064 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.362s	user 0.005s	sys 0.009s
W20260709 12:12:39.358783  1042 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 1.115s	user 0.004s	sys 0.000s
I20260709 12:12:39.673965 26465 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:39.329118   848 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:39.283674  1066 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.642311 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:39.576397   962 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 12:12:39.674563 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 76401.9us
I20260709 12:12:39.325817  1058 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:39.337023   913 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:39.372359   995 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:39.365520  1014 consensus_meta.cc:287] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.262s	user 0.005s	sys 0.012s
I20260709 12:12:39.790882  1014 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:39.791633 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:39.792776 26541 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:39.794432  1014 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:39.343669   744 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:39.271718   993 consensus_meta.cc:287] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.263s	user 0.014s	sys 0.006s
I20260709 12:12:39.795655   993 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:39.797842   993 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:39.690764 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 640179us
I20260709 12:12:39.356353   982 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:39.800235   982 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:39.704698  1043 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:39.801770 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:39.322119   987 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:39.802883  1043 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:39.803128 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:39.804320 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2957) took 1926 ms. Trace:
W20260709 12:12:39.804384 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 50671.3us
I20260709 12:12:39.806773 27162 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 12:12:39.804744 26540 rpcz_store.cc:276] 0709 12:12:37.878523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.878679 (+   156us) service_pool.cc:224] Handling call
0709 12:12:37.879106 (+   427us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:37.881380 (+  2274us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:37.957172 (+ 75792us) log.cc:844] Serialized 14 byte log entry
0709 12:12:38.908077 (+950905us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:38.911264 (+  3187us) log.cc:844] Serialized 52 byte log entry
0709 12:12:38.911427 (+   163us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:38.911679 (+   252us) log.cc:844] Serialized 14 byte log entry
0709 12:12:38.911882 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:38.911968 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:39.280317 (+368349us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b180029f3e0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5079fae58f 00007f5072fed571 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd
0709 12:12:39.801287 (+520970us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b180029f3e0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:12:39.804058 (+  2771us) raft_consensus.cc:1685] finished
0709 12:12:39.804081 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:39.804246 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38956,"prepare.queue_time_us":83457,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":22120,"raft.queue_time_us":41129,"raft.run_cpu_time_us":520,"raft.run_wall_time_us":119143,"spinlock_wait_cycles":97354752,"thread_start_us":901525,"threads_started":1,"wal-append.queue_time_us":989168}
I20260709 12:12:39.807708 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:39.807960 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:39.808543 27167 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 19: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:39.696900 26546 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:39.809805 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:39.695932   873 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.810827   873 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:39.813217   873 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:39.366142   990 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:39.321307   917 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:39.704145 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:39.705315 26467 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:39.283267   984 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.392s
I20260709 12:12:39.337714   874 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:39.642278  1019 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:12:39.696530 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52850.5us
I20260709 12:12:39.336395  1069 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:39.357425   668 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:39.366001   988 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:39.643729   932 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:39.694150 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:39.716802 32721 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:39.836619 32721 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:39.381294   991 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:39.376345  1057 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:39.719894 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:39.843009 26545 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 13.
I20260709 12:12:39.678169   963 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:39.724702 26466 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:39.693296   946 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:39.693791   779 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.691732  1010 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:39.350096   788 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:39.750260 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:39.854965 26613 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 19: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:39.754830 26619 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 12:12:39.758261   936 consensus_meta.cc:287] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.500s	user 0.011s	sys 0.009s
W20260709 12:12:39.759861   956 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.861s	user 0.016s	sys 0.000s
I20260709 12:12:39.706287   530 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:39.706243  1022 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:39.766769 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:39.768249   830 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:39.768908 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3068) took 1989 ms. Trace:
I20260709 12:12:39.692427   912 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:39.770686   957 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:39.674677   884 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:39.718477   971 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:39.772454   848 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:39.771976 26368 catalog_manager.cc:5697] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 12 to 14, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 14 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:12:39.723268  1066 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:39.699692   920 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:12:39.773676  1087 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 12:12:39.774204 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:39.885639   530 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.777133 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:39.720578   962 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:39.778666 26438 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.511s (SENT) [suppressed 2 similar messages]
I20260709 12:12:39.782688  1088 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:12:39.788553   774 consensus_meta.cc:287] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.717s	user 0.011s	sys 0.001s
I20260709 12:12:39.790073 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3842) took 1418 ms. Trace:
I20260709 12:12:39.678635 26544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:12:39.937175 26544 raft_consensus.cc:606] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:39.937752 26544 raft_consensus.cc:614] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:39.704362   888 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:39.851105  1019 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:39.942507  1014 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:39.943195  1014 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:39.807173 27162 pending_rounds.cc:85] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 15
I20260709 12:12:39.946750 27162 pending_rounds.cc:107] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 12:12:39.947115 27162 raft_consensus.cc:2889] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:39.935822 26617 rpcz_store.cc:276] 0709 12:12:38.371217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.432135 (+ 60918us) service_pool.cc:224] Handling call
0709 12:12:38.432489 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:38.432853 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:38.432887 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:38.433399 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 12:12:38.813051 (+379652us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:38.813110 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:38.813206 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:39.375382 (+562176us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:39.789665 (+414283us) raft_consensus.cc:1685] finished
0709 12:12:39.789698 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:39.789986 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24831,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":86,"spinlock_wait_cycles":2668928,"thread_start_us":379180,"threads_started":1,"wal-append.queue_time_us":469131}
I20260709 12:12:39.948065 26548 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:39.853127   963 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:39.335479   944 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:39.564947   960 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.372885  1009 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:39.814927  1074 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.791s	user 0.008s	sys 0.008s
I20260709 12:12:39.815514 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:39.377496   955 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:39.692384 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:39.957259 26539 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 14.
I20260709 12:12:39.957620 27159 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: []
W20260709 12:12:39.677032 26369 rpcz_store.cc:269] 0709 12:11:50.262617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.262931 (+   314us) service_pool.cc:224] Handling call
0709 12:11:51.290172 (+1027241us) spinlock_profiling.cc:243] Waited 7.98 ms on lock 0x7b540007d354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076044090 00007f50760e2f3a 00007f507be98e9c 00007f507bf9704e 00007f507a4582a4 00007f507a458232 00007f507a458161 00007f507a4580dc 00007f507a457392 00007f507441548c 00007f50744148c6
0709 12:12:39.356905 (+48066733us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:33.221724 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:33.222548 (+   824us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:33.222603 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:12:33.222640 (+    37us) tablet.cc:662] Decoding operations
0709 12:12:33.367545 (+144905us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:33.378209 (+ 10664us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:33.379308 (+  1099us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:12:33.495117 (+115809us) tablet.cc:701] Row locks acquired
0709 12:12:33.519795 (+ 24678us) write_op.cc:260] PREPARE: finished
0709 12:12:33.556334 (+ 36539us) write_op.cc:270] Start()
0709 12:12:33.556522 (+   188us) write_op.cc:276] Timestamp: P: 1783599153556238 usec, L: 0
0709 12:12:33.556551 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:12:33.557501 (+   950us) log.cc:844] Serialized 6741 byte log entry
0709 12:12:34.063708 (+506207us) op_driver.cc:464] REPLICATION: finished
0709 12:12:34.145781 (+ 82073us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5072fd00ac 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5079b10ef0
0709 12:12:34.346477 (+200696us) write_op.cc:301] APPLY: starting
0709 12:12:34.346616 (+   139us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:34.606895 (+260279us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:34.606940 (+    45us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:34.706165 (+ 99225us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:34.753557 (+ 47392us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 12:12:34.761367 (+  7810us) write_op.cc:312] APPLY: finished
0709 12:12:34.813753 (+ 52386us) log.cc:844] Serialized 156 byte log entry
0709 12:12:34.846799 (+ 33046us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:34.860391 (+ 13592us) write_op.cc:454] Released schema lock
0709 12:12:34.882447 (+ 22056us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:34.883043 (+   596us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:34.883100 (+    57us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3949766,"reported_tablets":51,"spinlock_wait_cycles":18352512,"child_traces":[["op",{"apply.queue_time_us":259329,"apply.run_cpu_time_us":28448,"apply.run_wall_time_us":543341,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75119,"num_ops":17,"prepare.queue_time_us":64603,"prepare.run_cpu_time_us":38696,"prepare.run_wall_time_us":490401,"raft.queue_time_us":96804,"raft.run_cpu_time_us":26803,"raft.run_wall_time_us":237519,"replication_time_us":506961,"spinlock_wait_cycles":3213184,"thread_start_us":508692,"threads_started":4,"wal-append.queue_time_us":191986,"wal-append.run_cpu_time_us":41989,"wal-append.run_wall_time_us":2170302}]]}
I20260709 12:12:39.826480 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:39.959035 27167 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 15: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:39.905148  1022 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:39.794296 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:39.832387 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 128326us
I20260709 12:12:39.964345 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:39.838059 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 144018us
I20260709 12:12:39.942840 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:39.966952 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:39.966152 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:39.846112 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:39.822996   940 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.823630  1015 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.851699 26545 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 23. Ops: []
I20260709 12:12:39.876238 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:39.882632  1089 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:39.874784 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:39.840165   874 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:39.969588   874 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:39.842306   932 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:39.738344  1058 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:39.906564 26615 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:39.985257 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:39.823374   995 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:39.855232  1010 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:39.853567   779 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:39.920895 26616 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
W20260709 12:12:39.775895  1051 consensus_meta.cc:287] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.700s	user 0.011s	sys 0.000s
I20260709 12:12:39.895730   956 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:39.845100  1044 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:12:39.843168   990 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 12:12:39.926048 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:39.928936 26546 raft_consensus.cc:2410] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:12:39.929977 26368 catalog_manager.cc:5697] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 11 to 12, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 12 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:39.978963   976 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:39.939716 26547 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:39.807873 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:39.985342   873 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:12:39.921599   920 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:39.985069   940 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:39.893707   936 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:39.929540   530 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:39.949361   774 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:39.954798 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:39.828078 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:39.959797 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:39.953857 26543 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:40.020483 26543 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:40.021495 26622 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 23: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:40.004717 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:39.932813   962 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:12:39.845137 32721 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:39.945760  1014 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:40.018962 27164 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:39.970207 26545 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:40.030062 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2807) took 1013 ms. Trace:
I20260709 12:12:40.030433 26545 rpcz_store.cc:276] 0709 12:12:39.016867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.969418 (+952551us) service_pool.cc:224] Handling call
0709 12:12:39.969778 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:40.029796 (+ 60018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.030005 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:39.942854  1019 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:39.908957   912 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:39.917446   848 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:39.979662 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:39.983888 27165 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 22: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:39.979252  1015 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:39.985920 26544 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:39.949590   957 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.991321 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:40.044776 26613 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 12:12:40.045372 26613 pending_rounds.cc:85] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 11
I20260709 12:12:40.045684 26613 pending_rounds.cc:107] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 12:12:40.046022 26613 raft_consensus.cc:2889] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:40.047204 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2809) took 1027 ms. Trace:
I20260709 12:12:40.047755 26544 rpcz_store.cc:276] 0709 12:12:39.019478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.985367 (+965889us) service_pool.cc:224] Handling call
0709 12:12:39.985720 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:40.046834 (+ 61114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.047127 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:39.995151 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:40.002301 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:39.979301  1030 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:40.025962 26368 catalog_manager.cc:5697] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:40.012272 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.015631 26472 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:40.015873  1058 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:39.958211   960 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:40.032271 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:40.019300 26617 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:12:40.007251 26540 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:40.011248  1057 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:40.035864 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:39.986196  1065 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:12:39.894795 26614 rpcz_store.cc:276] 0709 12:12:37.779624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.780176 (+   552us) service_pool.cc:224] Handling call
0709 12:12:37.780703 (+   527us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:37.794017 (+ 13314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:37.794071 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:37.817374 (+ 23303us) log.cc:844] Serialized 52 byte log entry
0709 12:12:38.043897 (+226523us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:38.043940 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:38.044015 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:39.358076 (+1314061us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:39.768553 (+410477us) raft_consensus.cc:1685] finished
0709 12:12:39.768574 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:39.768822 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12756,"raft.queue_time_us":17662,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":93,"spinlock_wait_cycles":7782272,"thread_start_us":185095,"threads_started":1,"wal-append.queue_time_us":359502}
I20260709 12:12:40.003858   945 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.998677   992 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:12:40.015410   936 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:40.014135   940 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:40.012168   995 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:40.018240  1051 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:40.054919 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:40.006829   874 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:40.060554  1066 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:40.061193 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:40.017861   774 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:40.065188 26368 catalog_manager.cc:5697] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 9 to 16, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 16 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:40.030915   991 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:40.066620 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 71614.1us
I20260709 12:12:40.094602 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:40.065471 26514 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:40.070772   976 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:40.097848 26514 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:40.089102 27161 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 15: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:40.101328 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3904) took 2233 ms. Trace:
I20260709 12:12:40.054294   957 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:40.100135 32721 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:40.102087 32721 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.102587 32721 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:40.042837   917 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 12:12:40.086999   788 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:40.103842 26542 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:40.101776 26472 rpcz_store.cc:276] 0709 12:12:37.868736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.114042 (+245306us) service_pool.cc:224] Handling call
0709 12:12:38.115134 (+  1092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:40.063128 (+1947994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.101034 (+ 37906us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54003fc0d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:40.101260 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4370272640}
I20260709 12:12:40.089875 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:40.109593 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:40.072753   704 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 12:12:40.123713 26617 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:12:40.124089 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:40.127028 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:40.128556 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2806) took 1113 ms. Trace:
I20260709 12:12:40.129103 26548 rpcz_store.cc:276] 0709 12:12:39.014705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.971090 (+956385us) service_pool.cc:224] Handling call
0709 12:12:39.992605 (+ 21515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:40.067536 (+ 74931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:40.067589 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:40.067648 (+    59us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:40.067694 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.128232 (+ 60538us) spinlock_profiling.cc:243] Waited 74.6 ms on lock 0x7b54000b4354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:40.128308 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:40.128479 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171656576}
I20260709 12:12:40.083891   945 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:40.133605 27164 raft_consensus.cc:2410] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:12:40.128813 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:40.103183   990 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:40.105165   976 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:12:40.137612 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 358983us
I20260709 12:12:40.122949 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:40.112979  1089 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.122599  1066 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:40.107753   884 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:40.116807   774 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:40.109557   971 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:40.116580   995 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.141469 27163 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:12:40.072868   932 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:40.103048  1058 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
W20260709 12:12:40.140298 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 299492us
I20260709 12:12:40.107587  1095 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:12:40.161283 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:40.164611 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:40.138281  1044 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:40.147624 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:40.169175 32721 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:40.116966  1030 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:12:40.143379   976 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:40.139778   990 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.143735  1057 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:40.156443   992 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:12:40.204331 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:40.181730 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:40.150876  1089 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:40.182175 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:40.182551 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:40.209446 27160 raft_consensus.cc:2393] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 19: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:40.168800  1066 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:40.193990 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:40.205590 27165 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:40.213958 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:40.214205 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:40.215005 27164 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:12:40.199507 26543 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 12:12:40.200593 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:40.210173 26548 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
W20260709 12:12:40.206799 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 96577us
I20260709 12:12:40.205454 26438 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:40.216080 27166 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:40.195442 26544 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:40.216665 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:40.217442 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:40.218670 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:40.219165 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.219606 32721 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:40.219041 26466 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:40.223445 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:40.150625  1065 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 12:12:40.226940 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:40.227603 26464 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
W20260709 12:12:40.228682 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 222741us
I20260709 12:12:40.197077   884 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:40.230453 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.231182 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:40.195315   960 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:40.239104 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:40.240363 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:40.203833   990 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:40.240047 26465 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:12:40.247869 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:40.250010 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:40.251567 26544 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.250444 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:40.207888  1044 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:40.188413   995 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:40.248661 26468 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:40.259829 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:40.260406 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:40.264622 26467 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:40.213238   873 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:40.266350 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:40.268270 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:40.263427 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 48595.6us
I20260709 12:12:40.273036 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:40.273321 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:40.232677   788 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:40.277074 27164 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 19: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:40.274873 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:40.274415 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:40.278196 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:40.248238   884 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:40.280598   987 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:40.281847   884 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:40.239104  1057 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:40.283185  1057 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:40.262748   912 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:40.286966  1101 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:12:40.239758  1015 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:40.307207 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:40.271319 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:40.291025 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:40.310026 26615 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 15: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:40.283187 27160 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:40.311228 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:40.313843 26617 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:12:40.319520 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:40.320283 26619 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.258975   848 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:40.234354   936 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:12:40.323148 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:40.321959 27134 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:40.332056 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:40.332953 26546 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 15: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:40.338853 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:40.277215   788 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.352519 26546 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:40.348026 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:40.349303 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:40.350760 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:40.351492 32721 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.354741 26614 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:40.354794 32721 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:40.327878  1058 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.356992 27134 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:40.357262 26546 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:40.322217   987 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:40.358595 26614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:12:40.363197 26614 raft_consensus.cc:606] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:12:40.363830 26614 raft_consensus.cc:614] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:40.359860 26587 leader_election.cc:400] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19.
I20260709 12:12:40.364506 26587 leader_election.cc:403] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:40.367636 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:40.364398 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:40.329023   827 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:40.352046 26544 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
I20260709 12:12:40.312577   988 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:12:40.374552 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:40.374899 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:40.345655   912 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:40.385176 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:40.385501 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:40.386835 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:40.369760   744 consensus_meta.cc:287] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.574s	user 0.008s	sys 0.004s
I20260709 12:12:40.362414  1086 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:40.378559 26544 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:12:40.356999   788 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:40.353116  1030 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:40.387988 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:40.382120 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:40.366736  1100 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:40.365972   987 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.372200 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:40.411510 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:40.412798 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:40.398759 26619 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
I20260709 12:12:40.366961  1065 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19.
I20260709 12:12:40.340409   884 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:12:40.355104  1014 consensus_queue.cc:1059] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:12:40.403679 26620 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:40.406061 26548 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:40.406385 26587 leader_election.cc:400] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15.
I20260709 12:12:40.407037 27160 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:40.407626 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:40.383605   912 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.396600  1119 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:40.382783   944 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:12:40.380401   848 consensus_queue.cc:1059] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 12:12:40.482211 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.336565  1066 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:40.416726 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:40.532655 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:40.533118 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 116485us
I20260709 12:12:40.431959 26587 leader_election.cc:403] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:40.534018 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:40.534503 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 128270us
I20260709 12:12:40.535485  1119 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15.
I20260709 12:12:40.536515  1119 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:40.537871  1119 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:40.538061   992 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:40.538579   884 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:40.435457 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:40.397897 26544 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:40.539480   992 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:40.540177  1009 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:40.540588  1009 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:40.536406 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:40.541446  1009 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:40.361680  1058 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:40.543123 26619 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 12:12:40.417400 27134 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:40.465090 26546 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:40.544149  1009 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:40.405150   827 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:40.545389  1100 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:40.545151   827 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:40.545985  1100 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 19 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:40.547031  1100 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:40.547811   827 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:40.548509   827 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:40.548892   827 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.549257   827 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.383430   952 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:12:40.545444   944 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:40.551088   944 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:40.414368   987 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:40.552035   944 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:40.553400   944 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:40.437322   991 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:40.376147   913 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
W20260709 12:12:40.554939 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 137625us
I20260709 12:12:40.555249   913 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:40.555619   913 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:40.556474   913 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:40.557693   913 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:40.559103 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 123738us
I20260709 12:12:40.560505 27133 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:40.561924   952 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:40.563453   952 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:40.501685  1110 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:40.417222   945 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:40.572552  1110 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:40.572871   945 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:40.573120  1110 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:40.573441   945 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:40.573969   945 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:40.436192   912 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:40.434465  1107 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.579137  1107 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:40.416656  1071 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:40.409897  1030 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:40.400034  1086 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:40.581101  1086 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:40.582456  1030 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:40.585119 26544 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:40.586714   874 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:40.598743  1030 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:40.600024  1030 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:40.600589  1030 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:40.601822  1030 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:40.603354  1030 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.397212  1044 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:40.609529  1069 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:40.610123  1069 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:40.434834   920 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:40.611200  1069 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:40.418438  1122 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:40.477303  1088 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:40.617034 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:40.619495 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:40.633410 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:40.621894 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:40.634325 26618 raft_consensus.cc:2410] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 26 because replica has last-logged OpId of term: 24 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 11.
I20260709 12:12:40.634325 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:40.623627 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:40.524935  1104 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 12:12:40.476572  1089 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:40.640080 26614 raft_consensus.cc:2393] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 19: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:40.636936 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:40.644757 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:40.659586 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:40.605048   987 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:40.602054   912 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:40.676746 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 130510us
I20260709 12:12:40.681051 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:40.681965 26471 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:40.632151  1122 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.635277   848 consensus_queue.cc:1243] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:40.632622  1015 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:40.661571   920 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:40.659695   874 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:40.659287  1051 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:40.605751  1086 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:40.643152  1069 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:40.709173 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:40.687090  1131 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:40.690284  1122 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:40.701361   995 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:40.754962 27160 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:40.757828   987 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:40.723060  1009 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:40.736290 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:40.706862   874 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:40.711231 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 150800us
I20260709 12:12:40.698477  1015 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:40.736932  1114 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.362s	user 0.001s	sys 0.000s
W20260709 12:12:40.765974 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.735903  1120 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.748174   963 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:40.714159  1051 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:40.785658 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 148828us
W20260709 12:12:40.785477  1124 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:12:40.796123 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:40.789232  1115 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
W20260709 12:12:40.808527 26439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.002s	sys 0.006s
W20260709 12:12:40.809054 26439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.002s	sys 0.006s
W20260709 12:12:40.770493 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.772313  1135 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:40.751242   945 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:40.803066 26467 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.004s
I20260709 12:12:40.818770 26467 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:12:40.772493  1097 consensus_queue.cc:1059] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:12:40.820129  1097 raft_consensus.cc:3055] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:40.864646  1097 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:40.794728  1009 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 12:12:40.865661  1097 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:40.866220  1107 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:40.867583  1097 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.867895  1086 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:40.785934  1120 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:40.871356  1108 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.722s	user 0.000s	sys 0.003s
I20260709 12:12:40.872830 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 2982) took 1199 ms. Trace:
W20260709 12:12:40.874217   530 consensus_meta.cc:287] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.858s	user 0.009s	sys 0.003s
I20260709 12:12:40.874701   530 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:40.876160 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 3835) took 3028 ms. Trace:
I20260709 12:12:40.876606 26620 rpcz_store.cc:276] 0709 12:12:37.847847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.849874 (+  2027us) service_pool.cc:224] Handling call
0709 12:12:40.875921 (+3026047us) spinlock_profiling.cc:243] Waited 2.55 s on lock 0x7b5400194e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:40.876062 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5870825344}
I20260709 12:12:40.876997   530 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:40.878073 26539 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: []
W20260709 12:12:40.878839 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.879074 26621 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:12:40.880231  1129 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:12:40.880616 26514 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:40.882054  1135 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:40.882488  1135 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:40.873221 26547 rpcz_store.cc:276] 0709 12:12:39.673242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.011611 (+338369us) service_pool.cc:224] Handling call
0709 12:12:40.011997 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:40.012423 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:40.012452 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:40.012963 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:12:40.149803 (+136840us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:40.149845 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.149925 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:40.870722 (+720797us) spinlock_profiling.cc:243] Waited 4.76 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:40.872525 (+  1803us) raft_consensus.cc:1685] finished
0709 12:12:40.872547 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:40.872760 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1125,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":88,"spinlock_wait_cycles":10952960,"thread_start_us":136458,"threads_started":1,"wal-append.queue_time_us":136458}
I20260709 12:12:40.882854  1135 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:40.883302  1058 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:40.890540  1118 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 12:12:40.890784   955 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:40.891686   955 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:40.894949   955 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:40.897055   945 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:40.899386 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2805) took 1885 ms. Trace:
I20260709 12:12:40.899907 26539 rpcz_store.cc:276] 0709 12:12:39.014348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.970887 (+956539us) service_pool.cc:224] Handling call
0709 12:12:39.992507 (+ 21620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:40.878513 (+886006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.899128 (+ 20615us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b540037f0d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:40.899309 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2036183808}
I20260709 12:12:40.830978 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2804) took 1824 ms. Trace:
W20260709 12:12:40.839568  1121 log.cc:927] Time spent T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:12:40.946933 26542 rpcz_store.cc:276] 0709 12:12:39.006606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.873060 (+866454us) service_pool.cc:224] Handling call
0709 12:12:39.873666 (+   606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:40.119681 (+246015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.830593 (+710912us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b5400398ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:40.830860 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":526149376}
W20260709 12:12:40.843163  1126 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:12:40.824695  1019 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.784s	user 0.012s	sys 0.000s
I20260709 12:12:40.795048  1089 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:12:40.802368  1010 consensus_meta.cc:287] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.797s	user 0.012s	sys 0.000s
I20260709 12:12:40.949095  1089 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:40.949245  1010 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:40.951365  1010 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:40.846624   830 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:40.782232  1105 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:40.952924   830 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:40.953140  1105 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:40.953938   830 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:40.955410   830 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:40.848385 32721 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:40.851037  1065 raft_consensus.cc:3055] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:40.957387 26514 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:40.963728  1065 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:40.851989   912 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:40.854339  1117 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.635s	user 0.002s	sys 0.000s
I20260709 12:12:40.859157  1103 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:40.859827  1051 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:40.863855  1015 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:40.870523  1022 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:40.987684 26613 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:40.850261   946 raft_consensus.cc:3055] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:40.904953 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:40.999233 26615 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:40.905989  1116 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.688s	user 0.003s	sys 0.000s
I20260709 12:12:40.821298   957 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:40.913326   956 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:40.914291  1143 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:40.872857  1120 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:40.917135  1110 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:40.924741 26465 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:41.004814 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:41.005676 26473 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
I20260709 12:12:40.926718 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:40.927840 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:40.930456 26469 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 12:12:40.945955   990 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.677s	user 0.009s	sys 0.001s
I20260709 12:12:40.837617   827 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:40.842144   779 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.837s	user 0.007s	sys 0.003s
I20260709 12:12:40.955592  1105 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:40.740628  1131 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:40.848219   962 consensus_meta.cc:287] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.812s	user 0.011s	sys 0.003s
I20260709 12:12:40.961207 27166 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:40.961361 26470 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:12:40.976238 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:40.977977 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 181975us
I20260709 12:12:40.989413 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:40.901677 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3081) took 2284 ms. Trace:
I20260709 12:12:41.019073 26621 rpcz_store.cc:276] 0709 12:12:38.617537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.646500 (+ 28963us) service_pool.cc:224] Handling call
0709 12:12:40.878717 (+2232217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:40.879425 (+   708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.901431 (+ 22006us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b5400194e50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:40.901580 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5132759424}
W20260709 12:12:40.976840   976 consensus_meta.cc:287] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.757s	user 0.010s	sys 0.001s
I20260709 12:12:40.997087 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:40.998509 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:40.995391 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 315265us
I20260709 12:12:41.002727 26548 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:41.028429 27167 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:40.985863   704 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:41.012482 26471 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 18: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:40.967958   874 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:40.938100  1135 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:40.998869   946 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:41.018565 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:41.023284 26615 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:41.025913 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3849) took 1205 ms. Trace:
I20260709 12:12:41.030486 26464 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
W20260709 12:12:41.016018   788 consensus_meta.cc:287] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.001s
I20260709 12:12:41.009720   956 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:41.035029 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:41.047909 26616 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 12:12:41.034286 26620 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 12:12:41.109072 26616 pending_rounds.cc:85] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 11
I20260709 12:12:41.109387 26616 pending_rounds.cc:107] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 12:12:41.109628 26616 raft_consensus.cc:2889] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:41.110353 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:41.108191 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:41.048555 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:41.015645   992 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.118733   992 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:41.121392  1120 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:41.121887  1120 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:41.122294  1120 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:41.125121  1122 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:41.126431 26472 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:12:41.126725  1135 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:41.050734 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:41.051944 26618 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:41.127972 26465 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:41.053505 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:41.108317 26439 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:41.030258   744 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:41.025151   962 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:41.055881 26622 rpcz_store.cc:276] 0709 12:12:39.821038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.036730 (+215692us) service_pool.cc:224] Handling call
0709 12:12:40.053740 (+ 17010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:40.053976 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:40.195419 (+141443us) log.cc:844] Serialized 14 byte log entry
0709 12:12:40.906120 (+710701us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b1800420940. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:12:40.912659 (+  6539us) spinlock_profiling.cc:243] Waited 76.6 ms on lock 0x7b1800420940. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5079fae58f 00007f5072fed571 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd
0709 12:12:41.025455 (+112796us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:41.025519 (+    64us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:41.025574 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:41.025724 (+   150us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:41.025852 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11583,"prepare.queue_time_us":186146,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":77916,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":11028,"spinlock_wait_cycles":200966912,"thread_start_us":941869,"threads_started":3,"wal-append.queue_time_us":600080}
I20260709 12:12:41.029449   704 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:41.094242 27134 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:41.066190 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.105576 26619 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:41.113336 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:41.114830  1131 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:41.115814  1140 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:41.133584 26621 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:12:41.055491 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:41.020035   779 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:41.164924  1135 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:41.165567  1135 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:41.165961  1135 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:41.014894   990 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:41.127758 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 77135.2us
I20260709 12:12:41.167510 26543 raft_consensus.cc:2368] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 22. Current term is 23.
W20260709 12:12:41.114130 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 95650.4us
W20260709 12:12:41.154966 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 96661.7us
I20260709 12:12:41.168429 26587 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:41.156312 26471 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 20.
I20260709 12:12:41.170622   990 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:41.171238   779 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:41.174151 26541 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:41.175473 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2808) took 2156 ms. Trace:
I20260709 12:12:41.175841 26541 rpcz_store.cc:276] 0709 12:12:39.019162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.971303 (+952141us) service_pool.cc:224] Handling call
0709 12:12:39.971622 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.174690 (+1203068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:41.175228 (+   538us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54001063d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:41.175405 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2765180160}
I20260709 12:12:41.107365  1089 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:41.055557   971 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.190452 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:41.195425 26468 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 26. Current term is 27. Ops: [26.17-26.17]
W20260709 12:12:41.158058 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 49832.6us
I20260709 12:12:41.189191 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:41.182629 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:41.192052 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:41.197089 26439 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:41.039150   976 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:41.193527 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:41.198539 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:41.120997   992 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:41.160543   936 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:41.201152 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:41.154837  1146 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:41.159114  1014 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:41.203673 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:41.107889  1051 consensus_queue.cc:1059] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.086s
I20260709 12:12:41.212016 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:41.194485 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 141044us
I20260709 12:12:41.205216 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:41.213599 26543 raft_consensus.cc:2368] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 22. Current term is 23.
I20260709 12:12:41.213630 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:41.154446   704 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:41.207044 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:41.117843  1065 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:41.219058  1110 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:41.219187  1065 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:41.221261   992 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:41.221889   992 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:41.222867   992 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:41.227618   956 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:41.228084 26617 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:41.106565   788 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:41.253013 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:41.281267 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.160622  1140 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:41.203099   920 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:41.210235  1146 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:41.202847   971 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:41.314098 26618 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:41.207333  1089 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:41.317044 26473 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:12:41.201298 26439 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:41.232673 27133 leader_election.cc:400] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 22. Current term is 23.
I20260709 12:12:41.318770 27133 leader_election.cc:403] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:12:41.281905 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.244930   976 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:41.284646 26471 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 23: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:41.285938 26470 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 12:12:41.327589 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 112283us
I20260709 12:12:41.328269 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:41.298589 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 69760.3us
I20260709 12:12:41.306254 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:41.307255 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:41.329710 26613 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:41.308269 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:41.309732 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:41.331912 26544 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:41.331983 26543 raft_consensus.cc:2376] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23. Re-sending same reply.
W20260709 12:12:41.290762  1153 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 0.162s	user 0.004s	sys 0.000s
W20260709 12:12:41.335290 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:41.335755 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.312793 26465 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:12:41.315228 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:41.313848  1146 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:41.192785  1131 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:41.338575  1131 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:41.339028  1131 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:41.328963 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:41.339548   936 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:41.340322   957 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:12:41.282829   920 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:41.282836  1140 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:41.289798  1014 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 18 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:12:41.319371  1152 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.088s	user 0.003s	sys 0.000s
I20260709 12:12:41.380254 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:41.321128  1089 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:41.315999  1113 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.395489 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:41.399492 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:41.400231 26613 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:41.401288 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:41.401958 26545 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:41.403702 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:41.400228 26542 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:12:41.406270 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:41.407749 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:41.408452 26546 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:12:41.409379 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:41.335230  1103 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:41.415126 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:41.396240 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:41.397106 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 195929us
I20260709 12:12:41.397228 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1079) took 1038 ms. Trace:
I20260709 12:12:41.427085 26620 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:12:41.433075 26548 rpcz_store.cc:276] 0709 12:12:40.359211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.481951 (+122740us) service_pool.cc:224] Handling call
0709 12:12:40.482283 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.028546 (+546263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:41.130505 (+101959us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b540028d320. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f5076051dc0 00007f50760dda02 00007f50760d9dd6 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:12:41.396976 (+266471us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b5400397bd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:41.397163 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1201993984}
I20260709 12:12:41.396358 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:41.434805 26469 raft_consensus.cc:2410] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 26 because replica has last-logged OpId of term: 24 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 11.
I20260709 12:12:41.412812 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:41.414484 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:41.442021 26465 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:12:41.411214   971 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:41.398144  1089 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:41.376453   920 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:41.464512  1030 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.465231  1030 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:41.470660 26464 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22. Ops: [17.10-21.12]
I20260709 12:12:41.470983  1122 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:41.426506  1113 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:41.474224   830 consensus_meta.cc:287] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.518s	user 0.003s	sys 0.007s
I20260709 12:12:41.431754 26542 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:12:41.449103 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:41.451746 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:41.450656  1124 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:12:41.454562 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:41.477530 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1115) took 1087 ms. Trace:
I20260709 12:12:41.477984 26548 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 22: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:41.454766   962 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:41.443646   936 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:12:41.459535  1014 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:41.463304  1065 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:41.443164  1103 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:41.486963  1065 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:41.478139 26617 rpcz_store.cc:276] 0709 12:12:40.389829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.390031 (+   202us) service_pool.cc:224] Handling call
0709 12:12:40.390324 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.228541 (+838217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:41.477187 (+248646us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b54003d7a54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:41.477432 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1926191360}
I20260709 12:12:41.398658   827 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:41.462183 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.453987 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:41.491681 26471 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:41.459622   788 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:41.502316 26617 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:41.503315 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:41.507989 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:41.509943 26545 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 18: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:41.510455 26471 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 12:12:41.508896  1086 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 21.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.004s
I20260709 12:12:41.513366   991 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:41.515374 26469 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:41.516853 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:41.517050 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:41.522492 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:41.523509 26545 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:41.523620 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:41.524430 27166 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:41.524986 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:41.525700 26542 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:41.525504 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:41.526170 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:41.497452  1120 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:41.527040 26618 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 12:12:41.672178   779 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.400s
W20260709 12:12:42.072135 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:41.872303 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:41.846138 26466 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.011s	sys 0.038s
W20260709 12:12:42.074113 26466 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.013s	sys 0.047s
I20260709 12:12:41.659915 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:41.663134 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:12:41.759419 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.527209 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:42.077343 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:42.077574 27133 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.011s	sys 0.027s
W20260709 12:12:42.081075 27133 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.011s	sys 0.027s
I20260709 12:12:41.605211 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:41.683174 26621 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:41.543161 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:41.542418 26543 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 23: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:41.684520 26615 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:42.091660 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:41.513952   991 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:42.133605 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 3873) took 1052 ms. Trace:
I20260709 12:12:41.545096 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:42.166492 27164 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:12:41.652896 32721 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:42.138686 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 621886us
W20260709 12:12:42.076382 26439 connection.cc:256] RPC call timeout handler was delayed by -1.1750840880001761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 12:12:42.171648 26439 connection.cc:256] RPC call timeout handler was delayed by -1.0943426710000494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
W20260709 12:12:41.871415   957 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.003s
I20260709 12:12:42.166043 26615 rpcz_store.cc:276] 0709 12:12:41.049750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.055126 (+  5376us) service_pool.cc:224] Handling call
0709 12:12:41.684255 (+629129us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b540020a9a8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507beb75f4 00007f507b0a0227 00007f507b09fab8 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6
0709 12:12:42.101639 (+417384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70713600}
W20260709 12:12:42.200080 26539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.023s	sys 0.030s
W20260709 12:12:42.201659 26539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.023s	sys 0.031s
W20260709 12:12:42.207962 26540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.015s	sys 0.021s
W20260709 12:12:42.127081  1143 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.009s	sys 0.038s
W20260709 12:12:42.210270 26540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.016s	sys 0.021s
I20260709 12:12:42.173545 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:41.841039  1103 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:42.144709  1058 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.009s	sys 0.034s
I20260709 12:12:42.223939 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:42.270931 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:41.753126  1030 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:41.542271   971 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:42.244105 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:42.244115 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 70654.9us
W20260709 12:12:42.234437  1143 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.009s	sys 0.041s
I20260709 12:12:42.222302  1120 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:42.227104 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:41.605808  1113 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:42.307533 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:42.323226  1164 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:12:41.544359  1022 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.718s
I20260709 12:12:42.335734   991 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:42.206226   957 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 22. Current term is 23.
I20260709 12:12:42.338238   957 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.338964   957 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:42.341777   957 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:42.346855   971 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:42.350790   976 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.351667   976 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:41.785632   956 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.685904   704 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:42.165128   992 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.263319 26471 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 12:12:42.397804 26471 pending_rounds.cc:85] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 11
I20260709 12:12:42.398136 26471 pending_rounds.cc:107] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 12:12:42.398468 26471 raft_consensus.cc:2889] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:41.510025  1107 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.696s
I20260709 12:12:42.245517 32721 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:41.671900  1066 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.558s
I20260709 12:12:42.300817 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:42.414276 26470 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:42.302775 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 3876) took 1223 ms. Trace:
I20260709 12:12:42.415441 26620 rpcz_store.cc:276] 0709 12:12:41.053035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.110082 (+ 57047us) service_pool.cc:224] Handling call
0709 12:12:42.275896 (+1165814us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b540020a654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:42.276054 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":726368512}
I20260709 12:12:41.628180  1065 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:42.367249 26546 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.006s	sys 0.027s
W20260709 12:12:42.422972 26546 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.006s	sys 0.027s
W20260709 12:12:42.269543  1058 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.009s	sys 0.037s
I20260709 12:12:42.379019 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:42.388451 26622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.019s	sys 0.018s
W20260709 12:12:42.397351 26541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.024s	sys 0.030s
W20260709 12:12:42.435858 26541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.024s	sys 0.032s
I20260709 12:12:42.436241 26472 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:12:42.436468 26622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.020s	sys 0.018s
I20260709 12:12:41.510491  1097 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.750s
I20260709 12:12:42.437994 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:42.430640 26514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.009s	sys 0.026s
I20260709 12:12:41.741672   920 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:42.260361 26467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.000s	sys 0.019s
W20260709 12:12:42.438752 26514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.010s	sys 0.026s
W20260709 12:12:42.411366 26548 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.013s	sys 0.027s
I20260709 12:12:42.438910 26473 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 23: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:42.443306 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:42.445945 26548 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.013s	sys 0.027s
W20260709 12:12:42.445288 26467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.105s	user 0.000s	sys 0.020s
W20260709 12:12:42.445436 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 816377us
I20260709 12:12:42.447661 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:42.448401 26465 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:42.443552 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3001) took 1005 ms. Trace:
I20260709 12:12:42.457743 26617 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:12:42.458910 26470 raft_consensus.cc:2410] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
W20260709 12:12:42.443607  1135 consensus_meta.cc:287] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.277s	user 0.012s	sys 0.003s
I20260709 12:12:42.428563   976 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:42.451021  1140 consensus_meta.cc:287] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.039s	user 0.013s	sys 0.000s
I20260709 12:12:42.587522  1140 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:42.379719  1030 consensus_queue.cc:1059] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 12:12:42.479250 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:42.591228  1140 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:42.469048  1153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.950s	user 0.005s	sys 0.037s
W20260709 12:12:42.592300  1153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.078s	user 0.005s	sys 0.037s
I20260709 12:12:42.424868   992 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:42.508013 26464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.010s	user 0.016s	sys 0.037s
W20260709 12:12:42.593107 26464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.016s	sys 0.037s
I20260709 12:12:42.477901   971 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:42.410174   956 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:42.493494  1066 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:12:42.518978 26471 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:12:42.594807   992 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:42.551491   788 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.550951 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2828) took 1219 ms. Trace:
I20260709 12:12:42.613550 26540 rpcz_store.cc:276] 0709 12:12:41.331496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.331617 (+   121us) service_pool.cc:224] Handling call
0709 12:12:41.332472 (+   855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:41.332863 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:41.332906 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:41.369277 (+ 36371us) log.cc:844] Serialized 26 byte log entry
0709 12:12:42.234881 (+865604us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:42.234944 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.235049 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:42.550577 (+315528us) raft_consensus.cc:1685] finished
0709 12:12:42.550608 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.550835 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40958,"raft.queue_time_us":112,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":4652,"spinlock_wait_cycles":1275136,"thread_start_us":794955,"threads_started":1,"wal-append.queue_time_us":1149441}
I20260709 12:12:42.518429 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 984) took 1594 ms. Trace:
I20260709 12:12:42.579618 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 3116) took 1055 ms. Trace:
I20260709 12:12:42.618625 26617 rpcz_store.cc:276] 0709 12:12:41.524291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.526924 (+  2633us) service_pool.cc:224] Handling call
0709 12:12:42.579537 (+1052613us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:42.514359  1131 consensus_meta.cc:287] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.175s	user 0.016s	sys 0.000s
I20260709 12:12:42.591216  1051 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:42.591539 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:42.595438  1135 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:42.492596 26465 raft_consensus.cc:2410] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
W20260709 12:12:42.601883 26619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.911s	user 0.024s	sys 0.027s
I20260709 12:12:42.602999 27167 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:12:42.594287 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3122) took 1058 ms. Trace:
I20260709 12:12:42.560536   744 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:42.547140   988 raft_consensus.cc:3055] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:42.455379 26541 rpcz_store.cc:276] 0709 12:12:41.437782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.446091 (+  8309us) service_pool.cc:224] Handling call
0709 12:12:41.446488 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.446732 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:41.468087 (+ 21355us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.443172 (+975085us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:42.443227 (+    55us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:42.443278 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.443358 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.443491 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11549,"prepare.queue_time_us":51885,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":2661,"raft.queue_time_us":18368,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":9642,"thread_start_us":967942,"threads_started":1}
I20260709 12:12:42.495631   957 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.520500 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:42.691650 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:42.695453 26472 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 23: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:12:42.692977 26616 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.012s	sys 0.011s
W20260709 12:12:42.696717 26616 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.013s	sys 0.011s
W20260709 12:12:42.675995 27131 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.008s	sys 0.022s
W20260709 12:12:42.697422 27131 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.009s	sys 0.022s
I20260709 12:12:42.535645  1107 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:42.617376  1146 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.279s	user 0.010s	sys 0.005s
W20260709 12:12:42.698010 26439 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.006s	sys 0.018s
W20260709 12:12:42.699126 26619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.026s	sys 0.028s
W20260709 12:12:42.711454 26439 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.007s	sys 0.018s
W20260709 12:12:42.711831 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 539127us
I20260709 12:12:42.701198 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:42.695294 26618 rpcz_store.cc:276] 0709 12:12:41.535384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.072464 (+537080us) service_pool.cc:224] Handling call
0709 12:12:42.087528 (+ 15064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.087779 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:42.087818 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:42.087878 (+    60us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:42.087923 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.087998 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.594082 (+506084us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b540020ab50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:42.594215 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33696640}
I20260709 12:12:42.736891 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:42.753830 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:42.721302 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:42.673022  1014 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.019s	sys 0.028s
W20260709 12:12:42.715896 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.695254  1051 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:12:42.698609   873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.008s	user 0.006s	sys 0.048s
I20260709 12:12:42.759111 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:42.709216  1175 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:12:42.616274   788 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:42.618122 26468 rpcz_store.cc:276] 0709 12:12:40.923866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.923994 (+   128us) service_pool.cc:224] Handling call
0709 12:12:40.924363 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:41.195837 (+271474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.518122 (+1322285us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54001c2354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:42.518344 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622734080}
I20260709 12:12:42.695003   988 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:42.762671 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:42.682471  1140 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:42.763597 26473 raft_consensus.cc:2368] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23.
W20260709 12:12:42.763979 26437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.005s	sys 0.026s
W20260709 12:12:42.784587 26437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.005s	sys 0.027s
W20260709 12:12:42.785343 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.637630   920 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:42.706185  1174 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 12:12:42.760732  1014 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.021s	sys 0.031s
W20260709 12:12:42.779121 26466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.013s	sys 0.003s
W20260709 12:12:42.794914 26466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.014s	sys 0.003s
W20260709 12:12:42.697942  1151 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.001s	user 0.006s	sys 0.007s
I20260709 12:12:42.783097 26472 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:12:42.622354   704 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:42.787458 27167 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 901) took 1458 ms (client timeout 1777 ms). Trace:
I20260709 12:12:42.787490 26473 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:42.798632 26468 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:42.799000 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:42.765269 26469 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:12:42.702761   957 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:42.792310 26465 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:42.754165  1146 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:42.751813  1107 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:42.806713 26585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.009s	sys 0.009s
I20260709 12:12:42.621332   874 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:42.799800 26472 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:42.699536   744 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:42.784507   873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.011s	sys 0.048s
I20260709 12:12:42.696586   946 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:42.793260   988 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:42.823366 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2826) took 1492 ms. Trace:
W20260709 12:12:42.797581  1151 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.136s	user 0.006s	sys 0.010s
W20260709 12:12:42.809931 27132 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.009s	sys 0.018s
W20260709 12:12:42.798056 27167 rpcz_store.cc:269] 0709 12:12:41.328602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.328730 (+   128us) service_pool.cc:224] Handling call
0709 12:12:42.787253 (+1458523us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540060de54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:42.787389 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2306257152}
W20260709 12:12:42.825424 27132 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.009s	sys 0.018s
I20260709 12:12:42.791982  1140 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:42.701463  1131 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:42.798517  1119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.006s	sys 0.019s
W20260709 12:12:42.811625 26585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.009s	sys 0.009s
I20260709 12:12:42.824003 26539 rpcz_store.cc:276] 0709 12:12:41.330632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.330751 (+   119us) service_pool.cc:224] Handling call
0709 12:12:41.340065 (+  9314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:41.393882 (+ 53817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:41.393915 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:41.411848 (+ 17933us) log.cc:844] Serialized 26 byte log entry
0709 12:12:42.203356 (+791508us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:42.203421 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.203526 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:42.823057 (+619531us) raft_consensus.cc:1685] finished
0709 12:12:42.823088 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.823281 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57559,"raft.queue_time_us":57728,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":17787,"thread_start_us":744212,"threads_started":1,"wal-append.queue_time_us":1144278}
I20260709 12:12:42.843374   988 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:42.829602   946 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:42.828305  1014 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.854384 26614 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:42.838891  1119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.007s	sys 0.020s
W20260709 12:12:42.847798  1168 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:12:42.832902 26472 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
W20260709 12:12:42.850090 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.893949  1146 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:42.895045  1135 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:42.868669   992 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.896507   992 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:42.897965   788 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:42.900645  1172 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.208s	user 0.003s	sys 0.000s
I20260709 12:12:42.901821 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1123) took 1438 ms. Trace:
I20260709 12:12:42.902199 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 3877) took 1598 ms. Trace:
I20260709 12:12:42.902276 26614 rpcz_store.cc:276] 0709 12:12:41.463036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.466606 (+  3570us) service_pool.cc:224] Handling call
0709 12:12:41.467004 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.856337 (+1389333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.901549 (+ 45212us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54001f63d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:42.901745 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3190261504}
I20260709 12:12:42.905542 26622 rpcz_store.cc:276] 0709 12:12:41.303603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.307831 (+  4228us) service_pool.cc:224] Handling call
0709 12:12:41.346107 (+ 38276us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:41.378272 (+ 32165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:41.378351 (+    79us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:41.379519 (+  1168us) log.cc:844] Serialized 52 byte log entry
0709 12:12:42.437031 (+1057512us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:42.437072 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.437147 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:42.900023 (+462876us) spinlock_profiling.cc:243] Waited 7.33 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:42.901777 (+  1754us) raft_consensus.cc:1685] finished
0709 12:12:42.901823 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.902109 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1899,"raft.queue_time_us":33532,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":17601,"spinlock_wait_cycles":16857856,"thread_start_us":983685,"threads_started":1,"wal-append.queue_time_us":1206048}
I20260709 12:12:42.910300  1107 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:42.864858  1014 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:42.914742 27133 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.012s	sys 0.030s
I20260709 12:12:42.915076 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2827) took 1584 ms. Trace:
W20260709 12:12:42.915509 27133 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.012s	sys 0.030s
W20260709 12:12:42.916344 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 833270us
I20260709 12:12:42.915656 26547 rpcz_store.cc:276] 0709 12:12:41.331075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.331216 (+   141us) service_pool.cc:224] Handling call
0709 12:12:41.331554 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:41.331936 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:41.331969 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:41.339880 (+  7911us) log.cc:844] Serialized 26 byte log entry
0709 12:12:42.071256 (+731376us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:42.071300 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.071378 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:42.914756 (+843378us) raft_consensus.cc:1685] finished
0709 12:12:42.914788 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.914992 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53321,"raft.queue_time_us":506,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5722,"thread_start_us":350611,"threads_started":1,"wal-append.queue_time_us":1275141}
I20260709 12:12:42.847048   956 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:42.808990  1051 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:42.920192 26587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.018s	sys 0.033s
W20260709 12:12:42.922497 26587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.018s	sys 0.033s
I20260709 12:12:42.866074  1151 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:12:42.923758 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 628358us
I20260709 12:12:42.926915 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3004) took 1426 ms. Trace:
W20260709 12:12:42.928391  1143 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.030s	sys 0.046s
I20260709 12:12:42.927462 26548 rpcz_store.cc:276] 0709 12:12:41.500760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.506480 (+  5720us) service_pool.cc:224] Handling call
0709 12:12:41.543384 (+ 36904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.543659 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:12:41.543958 (+   299us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.926436 (+1382478us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:42.926502 (+    66us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:42.926574 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.926659 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.926825 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6968,"prepare.queue_time_us":143087,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":8458,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":9643,"thread_start_us":1381962,"threads_started":2,"wal-append.queue_time_us":1090446}
W20260709 12:12:42.932715 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 484926us
I20260709 12:12:42.932411 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:42.854905   874 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:42.936126   956 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:12:42.924010 27134 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.009s	sys 0.013s
I20260709 12:12:42.935786  1066 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:42.938761 27134 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.009s	sys 0.013s
I20260709 12:12:42.942020 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3941) took 1542 ms. Trace:
I20260709 12:12:42.942819 26464 rpcz_store.cc:276] 0709 12:12:41.400066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.471892 (+ 71826us) service_pool.cc:224] Handling call
0709 12:12:41.472323 (+   431us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:41.472789 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:41.472816 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:41.496592 (+ 23776us) log.cc:844] Serialized 52 byte log entry
0709 12:12:42.593554 (+1096962us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:42.593902 (+   348us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.941647 (+347745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.941736 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:42.941784 (+    48us) raft_consensus.cc:1685] finished
0709 12:12:42.941798 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.941952 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":967,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":239717,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":16675,"thread_start_us":1443047,"threads_started":2,"wal-append.queue_time_us":1085182}
W20260709 12:12:42.944692 26513 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.013s	sys 0.020s
W20260709 12:12:42.945181 26513 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.013s	sys 0.020s
W20260709 12:12:42.945569 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 670368us
I20260709 12:12:42.946640 26588 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:42.948632  1198 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:42.938966 26514 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:42.939693  1187 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:42.949438  1198 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:42.950162  1195 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:42.950403  1187 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:42.950888  1187 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:42.950852  1195 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:42.941071 27133 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:42.952247  1086 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.952821  1086 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:42.954239 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3931) took 1724 ms. Trace:
I20260709 12:12:42.954504  1086 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:42.955157  1200 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:42.955303 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:42.955924  1200 raft_consensus.cc:697] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:42.956553 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:42.956766  1146 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:42.957301  1146 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:42.957502  1103 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:42.958432   530 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:42.959162   530 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:42.959633   530 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:42.958282  1103 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:42.960446  1103 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:42.961220  1146 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:42.923127 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3003) took 1472 ms. Trace:
W20260709 12:12:42.962492 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.963544 26548 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:42.966091   990 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:12:42.954586 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:42.967847 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.961825 26546 rpcz_store.cc:276] 0709 12:12:41.450222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.498554 (+ 48332us) service_pool.cc:224] Handling call
0709 12:12:41.499267 (+   713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.499727 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:12:42.423505 (+923778us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.922495 (+498990us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.922700 (+   205us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:42.922749 (+    49us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:42.922810 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.922885 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.923037 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19370,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":598,"spinlock_wait_cycles":2582400,"thread_start_us":1403588,"threads_started":2}
I20260709 12:12:42.968676 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:42.969636 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:42.971702 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:42.973336 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:42.974362 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:42.972394 26467 rpcz_store.cc:276] 0709 12:12:41.229458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.229668 (+   210us) service_pool.cc:224] Handling call
0709 12:12:41.276243 (+ 46575us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:41.276545 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:41.276583 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:41.277216 (+   633us) log.cc:844] Serialized 26 byte log entry
0709 12:12:42.446743 (+1169527us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:42.499440 (+ 52697us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.953855 (+454415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.953954 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:42.954005 (+    51us) raft_consensus.cc:1685] finished
0709 12:12:42.954021 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.954167 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":54382,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":298061,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":3733,"thread_start_us":1559429,"threads_started":2,"wal-append.queue_time_us":1230414}
I20260709 12:12:42.975239 26614 raft_consensus.cc:2410] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 23 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 12:12:42.977962 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:42.914237  1014 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:42.998008 26513 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:42.998353 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 57404.8us
I20260709 12:12:42.977514  1051 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:42.966915   990 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:43.003243  1097 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:43.007200  1193 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:42.997339  1143 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:12:43.002558 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:43.012255 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:43.012349 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:43.012585 26620 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:43.013228 27166 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:43.014536 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:43.015383 26615 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 20: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:43.002559  1186 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:43.006646 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 60126.1us
I20260709 12:12:42.924431  1151 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:12:43.008916 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.010031 26614 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:43.023237 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:43.007225  1184 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 12:12:43.009023 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 287857us
I20260709 12:12:43.011492 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:43.016137 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:42.998735  1044 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:43.010247 26622 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 12:12:43.008533  1135 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:43.029616 27164 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:43.032572 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:43.061167 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:43.038846 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.957463  1200 consensus_queue.cc:237] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:43.017062  1066 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:43.050303 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:43.029179 27167 raft_consensus.cc:2410] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:12:43.064138 26439 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:42.995219  1086 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 12:12:43.009673  1193 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:43.079125 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:43.079667  1204 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:43.053094  1217 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:43.082962  1217 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:43.082094  1181 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:12:43.083369  1217 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:43.084585 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3120) took 1551 ms. Trace:
I20260709 12:12:43.084937 26619 rpcz_store.cc:276] 0709 12:12:41.533195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.688829 (+155634us) service_pool.cc:224] Handling call
0709 12:12:41.689268 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:41.689660 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:41.689690 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:41.690185 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:12:42.713445 (+1023260us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:42.713506 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.713603 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:43.084344 (+370741us) raft_consensus.cc:1685] finished
0709 12:12:43.084368 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.084520 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6547,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":6276,"thread_start_us":1022801,"threads_started":1,"wal-append.queue_time_us":1166160}
I20260709 12:12:43.086238  1193 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:43.070860  1208 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:43.051723  1146 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:43.088063  1146 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:43.089286  1151 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:43.095475  1146 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:43.096782  1217 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:43.098281 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 3927) took 1894 ms. Trace:
I20260709 12:12:43.099052  1146 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:43.099643  1146 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:43.099834 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:43.100139  1146 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:43.100673 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 131162us
I20260709 12:12:43.101004 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3125) took 1012 ms. Trace:
I20260709 12:12:43.101452 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:43.049523  1185 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 12:12:43.103348  1192 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:43.103583  1185 raft_consensus.cc:3055] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:43.103916  1192 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:43.104084  1185 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:43.104475  1192 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:43.105111  1185 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:43.098712 26466 rpcz_store.cc:276] 0709 12:12:41.203970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.204106 (+   136us) service_pool.cc:224] Handling call
0709 12:12:41.204452 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:41.278533 (+ 74081us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:42.107784 (+829251us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.946725 (+838941us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:42.947335 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 12:12:42.947571 (+   236us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:42.947873 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 12:12:43.051917 (+104044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:43.097875 (+ 45958us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b54001c1e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:43.097921 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:43.098050 (+   129us) raft_consensus.cc:1685] finished
0709 12:12:43.098068 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.098206 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103782,"prepare.queue_time_us":234865,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"raft.queue_time_us":208258,"raft.run_cpu_time_us":375,"raft.run_wall_time_us":30870,"spinlock_wait_cycles":93619456,"thread_start_us":1478034,"threads_started":3,"wal-append.queue_time_us":798408}
I20260709 12:12:43.106642  1058 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:12:43.107117  1058 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:43.107527  1058 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:12:43.108265  1217 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:43.013530  1014 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:12:43.111682  1014 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:43.111874   990 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:43.112128  1014 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:43.113183  1014 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:43.114746  1014 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:43.116155 26588 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:43.116465   991 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:43.117182  1107 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:43.117360  1140 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:43.132419 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:43.101421 26616 rpcz_store.cc:276] 0709 12:12:42.092365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.093094 (+   729us) service_pool.cc:224] Handling call
0709 12:12:42.093396 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.093685 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:42.697413 (+603728us) log.cc:844] Serialized 14 byte log entry
0709 12:12:43.007721 (+310308us) log.cc:844] Serialized 14 byte log entry
0709 12:12:43.100420 (+ 92699us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b180006d240. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5072fefa40 00007f5072fea4e4 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287 00007f50760f5208
0709 12:12:43.100594 (+   174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:43.100648 (+    54us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:43.100739 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:43.100816 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.100944 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":155912,"prepare.queue_time_us":371316,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":76,"raft.queue_time_us":154254,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":211,"spinlock_wait_cycles":13524224,"thread_start_us":820851,"threads_started":2,"wal-append.queue_time_us":258049}
W20260709 12:12:43.133492 26438 leader_election.cc:336] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.511s (SENT)
I20260709 12:12:43.118583  1131 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:43.121040   976 raft_consensus.cc:3055] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:43.052205  1209 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.121994   957 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:43.074658  1135 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:12:43.124409  1089 consensus_meta.cc:287] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.614s	user 0.012s	sys 0.002s
I20260709 12:12:43.124426  1208 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:43.021703   774 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:12:43.009675  1097 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:43.130051 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:43.167690 27164 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:12:43.130112 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:43.131274 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 113652us
I20260709 12:12:43.172104 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:43.134513 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:43.173835 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:43.174678 26616 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:12:43.152338  1151 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:43.140663 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:43.121577  1088 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:43.026667   956 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.099s
W20260709 12:12:43.148519 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.048794  1069 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:43.151651 26588 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:43.069273   744 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:43.198973  1131 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:43.199595  1131 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:43.200167  1131 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:43.159633 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:43.055613  1198 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:43.072806  1186 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.203545  1186 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:43.136610  1204 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 12:12:43.094197   992 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:43.208853   530 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:43.219352   530 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:43.219967  1186 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:43.226691  1103 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:43.234519  1179 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.235913  1069 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:43.072345  1210 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:43.056465  1195 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:43.117579 26621 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:43.141963  1206 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:43.140349 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:43.238026 26622 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:43.142069   976 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:43.239602   976 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:43.240686   976 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:43.157289  1140 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:43.242600  1140 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.243024  1140 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:43.243737  1097 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:43.143514  1185 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:43.167079   873 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:43.190943 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:43.164860  1089 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:43.180186  1088 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:43.252445  1088 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:43.253405  1089 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:43.179955   920 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:43.185556   774 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:12:43.254431   920 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:43.256520 26613 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 21: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:43.162642  1208 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:43.143776  1107 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:43.257334   920 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:43.175252  1202 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.258522  1202 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:43.259445  1107 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:43.257359  1208 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:43.261471  1202 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:43.163175  1135 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:43.264110  1135 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:43.162853  1209 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:43.266453  1209 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:43.195693 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:43.155055  1146 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:43.267771 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 72170.5us
I20260709 12:12:43.268697  1146 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:43.269800 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:43.185307   788 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:43.278746   788 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:43.279366   788 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:43.185014   779 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:43.197947   971 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:43.282665   779 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:43.235432  1179 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:43.250433   873 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:43.197118   990 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:43.283937   779 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:43.270764   774 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:43.271365  1135 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:43.285611   873 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:43.285694   779 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:43.288769 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:43.290082   956 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:43.298247 26613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 3115) took 1776 ms (client timeout 1978 ms). Trace:
W20260709 12:12:43.298733 26613 rpcz_store.cc:269] 0709 12:12:41.521508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.521661 (+   153us) service_pool.cc:224] Handling call
0709 12:12:43.298018 (+1776357us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540003be54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:43.298178 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2701311232}
I20260709 12:12:43.300531 26618 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:12:43.301739  1179 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:43.302347  1179 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:12:43.304813 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.306565  1088 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:43.312736 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:12:43.323673 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.333973 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:43.339346 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:43.340445  1135 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:43.344724  1140 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:43.348594 26618 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:43.238013  1193 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:43.413794 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 312410us
I20260709 12:12:43.353101  1058 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:43.180719  1192 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:43.361004  1187 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:43.383673 27134 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:43.385907  1215 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:43.387400 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:43.458621 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:43.392418 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 369236us
I20260709 12:12:43.394018 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:43.394721 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:43.460788 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:43.400473 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.498363 26547 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:43.402014 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:43.414834 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:43.499472 26541 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:43.403162 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:43.497346 27167 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:12:43.500468 26466 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:43.143602 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:43.406558 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:43.414449   744 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:43.407232 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.409096 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:43.502161 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:43.502545 26542 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:43.503100 26467 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:43.410578 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:43.503818 26469 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:43.505007 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:43.505478 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:43.411880 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:43.454473 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:43.456139 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:43.422837 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:43.465068 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:43.444041 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:43.405794 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:43.411185 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:43.503613 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:43.556483 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:43.536572 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.559628 26471 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:43.507234 26473 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 15: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:43.560427 26544 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:43.561038 26465 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 16: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:12:43.561090 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 177580us
I20260709 12:12:43.562270 26464 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 16: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:43.591930 26541 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:12:43.569883 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:43.593873 26588 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:43.594975 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:43.614041 26540 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:12:43.615742 26547 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15.
I20260709 12:12:43.616775 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:43.617651 26547 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 20: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:43.456853 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:43.414620 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:43.599960 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:43.618884 26469 raft_consensus.cc:2410] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 12:12:43.619210 26468 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 23: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:12:43.602655 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.603328 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:43.414011   774 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.234541  1103 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:43.454051  1208 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:43.607326 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 70493.9us
W20260709 12:12:43.629047 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 485559us
I20260709 12:12:43.629930 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:43.607429 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:43.513082 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:43.634171 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:43.635684 26542 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:43.610154 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:43.610932 26471 raft_consensus.cc:2410] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:12:43.612641 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:43.636931 26472 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:43.556931   971 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.455114  1211 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.570932 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:43.637068  1200 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.016s	sys 0.007s
I20260709 12:12:43.624742 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:43.626940 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:43.627188 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:43.645206 26465 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:43.613008 26544 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:43.627594 27167 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:43.588959  1185 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:43.491688  1223 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.106s	user 0.002s	sys 0.000s
I20260709 12:12:43.644590 26547 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:12:43.594646  1170 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.643908 26473 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:43.593011   744 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:43.457665   788 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:43.652521 27167 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:43.621757  1069 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.655493 26548 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:43.656424 27164 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:43.662648 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:43.665336 27166 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:43.648499  1185 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.669821 27164 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:43.652382  1146 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:43.596077  1216 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.098s
I20260709 12:12:43.639595   774 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:43.678294 26621 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 12.
I20260709 12:12:43.678368 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:43.680913  1208 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:43.668557  1069 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:43.684815  1131 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:43.685946  1069 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:43.688014 27164 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 19: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:43.645834   971 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:43.700218   991 consensus_meta.cc:287] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.000s
I20260709 12:12:43.673575  1185 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:43.705685  1131 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:43.706920   971 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:43.707719   991 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.694857  1193 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:43.714145   788 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:43.715821   744 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:43.716071 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:43.716956 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:43.717885 27166 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:43.703689   956 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:43.714169   991 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:43.728020   991 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:43.728405   774 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:43.730461  1058 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:43.725864  1140 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:43.731838  1187 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:43.722465  1192 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:43.780292 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 150228us
I20260709 12:12:43.782608 26439 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:43.785926 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:43.823323 26543 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:43.831089 26545 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:43.832405  1202 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:43.834126 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:43.835577 27163 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:43.839008  1185 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:43.830950   874 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:43.855886 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:43.857121 27163 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:43.815465 26439 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:43.557318  1215 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:43.844769  1185 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:43.659200  1170 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:43.649842  1211 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:43.877615  1170 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:43.880389 27160 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 12: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:43.882117  1215 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:43.890762 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:43.891325 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.892133 26464 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:43.897305 26466 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:43.901433 26543 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:43.904489  1211 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:43.908360   788 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:43.909292 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:43.910128 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:43.914642 26471 raft_consensus.cc:3055] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:43.915655 26471 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:43.917615 26471 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:43.919041 26471 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:43.922523 27161 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:43.922832 26465 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:43.929764  1146 raft_consensus.cc:2764] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
W20260709 12:12:43.938877 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:43.954638 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47438.6us
I20260709 12:12:43.955444  1185 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:43.956043  1185 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.956455  1185 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:43.956322 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:43.958657  1170 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.959127 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:43.959357  1170 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:43.960489  1187 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:43.961643  1187 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:43.963943 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 175304us
I20260709 12:12:43.968443 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:43.968887 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:43.969713 26618 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:43.971138 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 514244us
W20260709 12:12:43.976001 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 382095us
I20260709 12:12:43.976630   744 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:43.977234   744 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.977623   744 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:43.979036   976 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:43.979550   976 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:43.980014   976 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:43.993854 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.997963 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:43.998836 27163 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:12:44.005774 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:44.001829  1170 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:44.006908 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:44.010138 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:44.000866 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:43.961980 27133 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:43.998328 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:44.016983  1221 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:44.017545  1221 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.017949  1221 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:44.018268 26365 catalog_manager.cc:5697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 12 to 19. New cstate: current_term: 19 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:44.025897 27164 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:44.023483 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:44.024863 26621 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
W20260709 12:12:44.032605 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 70844.4us
I20260709 12:12:44.033391 26618 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:12:44.038801 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:44.039580 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 526462us
W20260709 12:12:44.040453 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.040941 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:44.042096 26613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:12:44.043150 26613 raft_consensus.cc:606] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:12:44.043618 26613 raft_consensus.cc:614] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:44.044175 26622 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 12.
I20260709 12:12:44.045058 27167 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:44.046762 26622 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:12:44.048947 26471 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:44.052928   530 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:12:44.053187 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:44.054378 26616 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:44.054549 27164 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:12:44.022267  1185 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:44.086052 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:44.080621  1170 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:44.096175 27167 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:44.095921  1170 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.100601 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:44.105180 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:44.105655  1192 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:44.106164  1192 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.106802  1192 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:44.108361 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 200709us
I20260709 12:12:44.109989 26513 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:44.106225 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:44.110755   990 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:44.111657   990 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:44.111763 26588 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:44.106154 26620 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
I20260709 12:12:44.112360 26513 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:44.113423  1140 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:44.114115  1140 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:12:44.115209 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 74510us
I20260709 12:12:44.115437  1140 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:44.116271  1179 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:44.116497 26514 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:44.118866  1058 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:44.119488  1058 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:44.120604  1058 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:44.113466 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.122952 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:44.123816 26613 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 20: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:44.125360 26546 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:44.114205 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:44.081343 26365 catalog_manager.cc:5697] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 8 to 11, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 11 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:44.132275   971 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:44.134881   774 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:44.134922  1179 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:44.136459 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:44.136914 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44754.2us
I20260709 12:12:44.143285  1192 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:44.151784  1185 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:44.152029 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.153148   956 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:44.154039   956 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:44.155587  1192 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:44.155496 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:44.156620   956 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:44.162879 26514 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:44.164871 26514 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:44.166047  1088 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:44.166352 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:44.166538 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:44.167157  1088 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:12:44.167362 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:44.167574  1088 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:44.168653 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:44.170006 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.170775 27134 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:44.172325  1014 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:44.172437 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:44.172807  1014 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.173244  1014 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:44.174154 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:44.175403 27134 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:44.176448 27134 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:44.178491 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:44.179443 26470 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:44.180377 26365 catalog_manager.cc:5697] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:44.178656 26471 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:12:44.104442  1170 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:44.185030 26467 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:44.185917 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:44.186997 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:44.187835 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:44.188074 26469 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:44.189702 26543 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:12:44.169324  1088 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:44.190418 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:44.191238 26469 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:44.191354 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:44.192458 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:44.193282 26467 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:12:44.195155 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:44.194059 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:44.196082 26620 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:12:44.196363 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:44.197237 26543 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:44.198328 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:44.196306 26542 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:44.198810 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:44.194598  1185 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:44.183606  1216 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:44.198537 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:44.195633 26548 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:12:44.198194 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:44.201848 26365 catalog_manager.cc:5697] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 10 to 17. New cstate: current_term: 17 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:44.205104 26365 catalog_manager.cc:5697] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:44.200182  1216 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.199792  1185 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.206552   990 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:44.208112  1135 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:44.208513 26470 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
W20260709 12:12:44.209075 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44338.7us
I20260709 12:12:44.211061   971 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:44.210822   976 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:44.212149   744 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:44.213133  1221 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:44.195046 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:44.212193 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 98104.5us
I20260709 12:12:44.246793 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:44.247097 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:44.247593 26467 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:44.191256  1088 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:12:44.249378 26365 catalog_manager.cc:5697] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:12:44.217255 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.252442   956 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:44.253557 26469 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
W20260709 12:12:44.254863 26439 connection.cc:256] RPC call timeout handler was delayed by -1.1797080389999337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
I20260709 12:12:44.254490 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:44.257067 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:44.236667  1216 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:44.255556 26439 connection.cc:256] RPC call timeout handler was delayed by -1.113108038999826s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
I20260709 12:12:44.226713 26616 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
I20260709 12:12:44.242272 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:44.244227 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:44.264228 26439 connection.cc:256] RPC call timeout handler was delayed by -1.073508038999762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
I20260709 12:12:44.267285 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:44.267016   971 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:44.262094 26467 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:44.251520 26365 catalog_manager.cc:5697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 22 to 25. New cstate: current_term: 25 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:44.274017 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:44.274068 26618 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:44.237640  1185 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:44.241077   990 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:44.289914 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:44.290959 26467 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:12:44.282514   990 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:44.284754   976 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:44.300763 26513 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:44.302081 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:44.313999 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.314601 26542 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:12:44.327057   971 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
W20260709 12:12:44.343492 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 166223us
W20260709 12:12:44.346104 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 61989.5us
I20260709 12:12:44.347776 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:44.333920   956 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:44.355403 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:44.359992 26542 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:12:44.362722 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:44.363024 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:44.363729 27164 raft_consensus.cc:2368] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24.
I20260709 12:12:44.366371 27161 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 12:12:44.362751 26588 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:44.372442 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:44.376840 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:44.377028 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:44.377200 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:44.361240   956 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.383976 26471 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 20: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:44.385721 27164 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 20: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:44.390066 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:44.395092 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:44.399125 26467 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:12:44.382606   956 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:44.400774 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:44.402779 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:44.404179 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:44.398955  1135 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:44.409404   990 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:44.394919  1140 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:44.414338 26365 catalog_manager.cc:5697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 13 to 21, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 21 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:44.415503  1140 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:44.416678  1140 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:44.396646   744 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:44.416543 26365 catalog_manager.cc:5697] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:12:44.422816 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 49132.7us
W20260709 12:12:44.423630 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 198485us
I20260709 12:12:44.424738 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:44.430721  1200 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:44.431443  1200 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:44.411044  1221 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:44.432593  1200 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:44.435105 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:44.440330 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:44.441807 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:44.444958 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:44.445729  1215 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:44.446353  1215 raft_consensus.cc:697] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:44.446630  1216 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:44.447376  1215 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:44.448963  1216 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:44.442322   990 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:44.411515 27134 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:44.442651 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:44.451053 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 49414.9us
I20260709 12:12:44.451282 26546 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 12.
I20260709 12:12:44.452071 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:44.453194  1170 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:44.456915  1170 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:44.464875 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:44.465577 26621 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:44.469972 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:44.470654 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:44.471074 26546 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 19: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:44.443436  1051 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:44.472265  1051 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:44.472379 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:44.472889 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:44.473289 26469 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
I20260709 12:12:44.473371  1051 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:44.474858 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:44.475461 26468 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:44.470959 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:44.478564 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:44.478849 26465 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
I20260709 12:12:44.479523 26467 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:44.480417 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:44.481119 26472 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:44.482060  1179 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:44.483739  1179 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:44.484108  1179 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:44.485055  1179 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:44.487344   744 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:44.488098   744 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:44.490978 26587 connection.cc:256] RPC call timeout handler was delayed by -1.3504542060002223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
W20260709 12:12:44.491075 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 49408.1us
W20260709 12:12:44.491451 26587 connection.cc:256] RPC call timeout handler was delayed by -1.2820542060001117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
I20260709 12:12:44.491297 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:44.492091 26587 connection.cc:256] RPC call timeout handler was delayed by -1.0840542060002463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260709 12:12:44.492519 26587 connection.cc:256] RPC call timeout handler was delayed by -1.0453542060001837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
I20260709 12:12:44.458205 26365 catalog_manager.cc:5697] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 14 to 18, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 18 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:44.443018 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:44.482278 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:44.534667 26618 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:44.512908 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:44.495373 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:44.494329 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:44.503751 26368 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57048 (request call id 304) took 56430 ms (client timeout 15000 ms). Trace:
I20260709 12:12:44.539525 26468 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:12:44.501474 27167 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:44.542516 26548 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:12:44.542727 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.542347 26621 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:12:44.517683 26472 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:12:44.549469 26470 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:44.451624  1088 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:44.510524  1179 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:44.494880   744 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:44.550285  1221 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:44.541904   788 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:44.558334  1221 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:44.559547 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 77383.3us
I20260709 12:12:44.583642  1221 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:44.584708 26514 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:44.561556 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.458145  1014 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:44.541903   971 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:44.528506  1185 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:44.571480 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.571568 26618 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 20.
I20260709 12:12:44.519383 26365 catalog_manager.cc:5697] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 16 to 21, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 21 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:12:44.606801 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 112591us
I20260709 12:12:44.595932 27134 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:44.612119 27161 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 13: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:44.587967  1179 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:44.580729  1135 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:44.618525 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:44.558616  1088 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 19 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:12:44.539896 26368 rpcz_store.cc:269] 0709 12:11:48.107957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.108483 (+   526us) service_pool.cc:224] Handling call
0709 12:12:44.503406 (+56394923us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:40.717458 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:40.718090 (+   632us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:40.718132 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:12:40.718150 (+    18us) tablet.cc:662] Decoding operations
0709 12:12:40.719059 (+   909us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:40.719134 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:40.719163 (+    29us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:12:40.719808 (+   645us) tablet.cc:701] Row locks acquired
0709 12:12:40.719825 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:12:40.739733 (+ 19908us) write_op.cc:270] Start()
0709 12:12:40.750980 (+ 11247us) write_op.cc:276] Timestamp: P: 1783599160737612 usec, L: 0
0709 12:12:40.758969 (+  7989us) op_driver.cc:348] REPLICATION: starting
0709 12:12:40.881397 (+122428us) log.cc:844] Serialized 2865 byte log entry
0709 12:12:42.706816 (+1825419us) op_driver.cc:464] REPLICATION: finished
0709 12:12:42.931871 (+225055us) write_op.cc:301] APPLY: starting
0709 12:12:42.931977 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:43.270947 (+338970us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:43.271056 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:43.287288 (+ 16232us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:43.287607 (+   319us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 12:12:43.287713 (+   106us) write_op.cc:312] APPLY: finished
0709 12:12:43.288072 (+   359us) log.cc:844] Serialized 73 byte log entry
0709 12:12:43.456743 (+168671us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:43.491518 (+ 34775us) write_op.cc:454] Released schema lock
0709 12:12:43.555598 (+ 64080us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:43.641890 (+ 86292us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:43.645102 (+  3212us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4136678,"reported_tablets":51,"spinlock_wait_cycles":8064,"child_traces":[["op",{"apply.queue_time_us":224780,"apply.run_cpu_time_us":13503,"apply.run_wall_time_us":689472,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33359,"num_ops":7,"prepare.queue_time_us":343410,"prepare.run_cpu_time_us":11845,"prepare.run_wall_time_us":344058,"raft.queue_time_us":1200916,"raft.run_cpu_time_us":1154,"raft.run_wall_time_us":234328,"replication_time_us":1944804,"thread_start_us":1721080,"threads_started":4,"wal-append.queue_time_us":225710,"wal-append.run_cpu_time_us":49730,"wal-append.run_wall_time_us":3168185}]]}
I20260709 12:12:44.626744  1058 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:44.628364  1088 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:44.632483 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.639535 27164 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:44.639621  1051 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:44.640583  1051 raft_consensus.cc:697] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:44.641682  1051 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:44.647053  1151 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:44.647686  1151 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:44.649919  1151 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:44.613178  1170 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:44.652977 27167 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 12:12:44.642830 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 170112us
I20260709 12:12:44.660065 26439 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:44.662103  1211 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:44.663010  1211 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:44.664531  1151 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:44.669561   744 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:44.670008   744 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:44.671021   744 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:44.666698  1014 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:44.672127   744 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:44.674510 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:44.676460   788 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:12:44.677078   788 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:44.678121   788 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:44.687603 26548 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:12:44.689070 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:44.696491 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:44.696779 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:44.698005 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:44.698541 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:44.699422 26545 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:44.699712 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:44.701344 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:44.704053 26544 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:44.606895 26365 catalog_manager.cc:5697] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 15 to 17, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 17 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:44.643270   976 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:12:44.705375 26365 catalog_manager.cc:5697] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 12 to 18, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 18 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:12:44.707242 26365 catalog_manager.cc:5697] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:44.718127 26616 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:44.718766 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:44.720495 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:44.717911 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:44.726569 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:44.727214  1151 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:44.727964  1193 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:44.729281 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:44.729954  1151 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:44.731011  1192 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:44.731415   956 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:44.732553 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:44.732771 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:44.733717   956 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:44.734174 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:44.690604  1058 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:44.735286 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 60938.3us
I20260709 12:12:44.737206  1058 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:44.690317  1170 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 20 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:44.737221 26439 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:44.734973  1151 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:44.741110 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:44.743722 26618 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:44.752789 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:44.754143 26614 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 13: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:44.706434   976 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:44.758972 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:44.761727 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:44.762952 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:44.770915 26616 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:12:44.720511  1185 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:44.774509 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.779744 27161 raft_consensus.cc:2376] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23. Re-sending same reply.
I20260709 12:12:44.780722 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:44.780089 26365 catalog_manager.cc:5697] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:44.783128 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 46003.7us
I20260709 12:12:44.784320 26439 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:44.787308   920 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:44.787824   920 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:44.788837   920 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:44.792953  1193 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:44.776660 26618 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:12:44.797374 26544 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:12:44.799944 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:44.802762 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 68672.1us
I20260709 12:12:44.803367 27133 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:44.756374  1170 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:44.758680   976 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:44.808977 27160 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:44.801308 27134 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:44.804113 26438 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.109s (SENT) [suppressed 16 similar messages]
I20260709 12:12:44.757297  1221 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:44.818135 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:44.818150  1069 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:44.819272  1185 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:44.838749  1051 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.839226  1185 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:44.839455  1051 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:44.840303  1185 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:44.822530   873 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:44.810575  1216 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:44.825168  1260 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.826671   779 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:44.829880 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:44.815589 26621 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:44.830504  1135 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.008s
I20260709 12:12:44.838038  1200 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:44.837961 27166 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:12:44.843508 26545 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:12:44.847190 26588 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:44.847683   976 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:44.848367  1260 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:44.849149   976 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:44.850670 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:44.850929  1260 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:44.851614  1260 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:44.852421  1260 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:44.852798  1260 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:44.853541 26587 leader_election.cc:400] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23.
I20260709 12:12:44.854080 26587 leader_election.cc:403] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:12:44.863571 26514 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:44.866654  1151 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.847687 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:44.853241  1260 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:44.841904  1051 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:44.872062 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:44.880596 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 53557.4us
I20260709 12:12:44.853662  1216 raft_consensus.cc:697] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:44.877410  1140 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23.
I20260709 12:12:44.878443  1088 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:12:44.912175 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 94825.4us
W20260709 12:12:44.942137 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 60112us
W20260709 12:12:44.970599 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 98632.6us
I20260709 12:12:44.892638  1151 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:44.947508  1088 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 24 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:44.949681  1146 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:44.985035 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:45.006487 26439 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:45.012780  1258 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 12:12:45.023207 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 159721us
I20260709 12:12:45.133164  1103 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:45.007476   788 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:45.114110   744 consensus_queue.cc:1059] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:45.115125  1221 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:45.024610  1216 consensus_queue.cc:237] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:45.115787   971 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.134681   744 raft_consensus.cc:3055] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:45.135103   744 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:45.134920   971 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.135993   744 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.137213   971 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:45.137290   744 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:44.987368  1088 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:45.138465  1255 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:45.138928  1255 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:45.139780  1255 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:45.140821  1255 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:45.118923  1200 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:45.028664  1193 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:45.022586   779 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:12:45.123240 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:45.147033 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.018621  1192 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:45.014539   956 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:45.126767  1260 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:45.127409  1058 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:45.121595 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:45.131624  1151 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:45.058770  1265 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:12:45.142580 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:45.148098 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 163037us
I20260709 12:12:45.144337  1200 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:45.160647 26542 raft_consensus.cc:2368] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24.
I20260709 12:12:45.162758 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:45.163354 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:45.164215 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:45.164531  1266 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:45.164924 26545 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:12:45.165382  1266 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:45.165903  1266 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:45.167014  1266 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.156855  1146 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:45.171742 26621 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:45.154820  1140 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:12:45.173647 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 58566.1us
I20260709 12:12:45.174083 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:45.178452 26542 raft_consensus.cc:2410] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 12:12:45.179459  1192 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:45.179984  1192 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:45.179728 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:45.186898  1058 raft_consensus.cc:2764] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election decision vote started in defunct term 22: won
I20260709 12:12:45.197947  1260 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:45.202775 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:45.204336 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:45.205642 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:45.208808  1200 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:45.215497 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.206287 26548 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:45.221643 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 46811.9us
I20260709 12:12:45.210199  1200 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.169817   779 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:45.171617  1146 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.175408  1140 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:45.161211   956 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.240715 26547 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27. Ops: []
I20260709 12:12:45.241355 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:45.260740 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.239140  1146 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:45.229194  1014 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:12:45.295248 26544 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:45.298558 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 135338us
I20260709 12:12:45.299734 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:45.306535 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.311298 26545 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:45.312878 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:45.313671 26547 raft_consensus.cc:2376] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 15. Re-sending same reply.
I20260709 12:12:45.314890 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:45.315680 26542 raft_consensus.cc:2376] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23. Re-sending same reply.
I20260709 12:12:45.319547 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:45.320477 26621 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:45.321832  1140 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.323596  1140 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:45.327302   873 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:45.327986   956 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:45.335983 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:45.342374 26615 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:45.350708 26548 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:12:45.353865  1255 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:12:45.354863 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 90428.1us
W20260709 12:12:45.356541 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 175058us
I20260709 12:12:45.354964   956 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:12:45.364571 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 125742us
I20260709 12:12:45.355568 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:45.362746 26618 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:45.369618 26615 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
W20260709 12:12:45.368772 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 224702us
I20260709 12:12:45.372041 26618 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:45.373852 26544 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:12:45.379136 26618 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:12:45.363276   956 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:45.381620 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:45.384779 26618 raft_consensus.cc:2410] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
W20260709 12:12:45.386065 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 86446.9us
I20260709 12:12:45.361654   920 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:45.357970   873 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 12:12:45.387379 26616 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:45.383741  1069 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.390558  1069 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:45.392925  1069 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:45.393563  1069 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:45.394951 26619 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: []
I20260709 12:12:45.400352 26621 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:45.403040 26620 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:45.403892 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:45.405587 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 50144.5us
I20260709 12:12:45.406666 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:45.376250  1255 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:45.376725   779 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:45.415558 27167 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 19 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:45.430045 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.434314  1260 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.435015  1260 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.437533  1260 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:45.375044  1192 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:45.444830   788 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:12:45.445338 27160 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:12:45.446485   920 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:45.446666 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:45.447412 27166 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:45.447564   920 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:45.449008 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 69586.8us
I20260709 12:12:45.449826 26439 leader_election.cc:400] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24.
I20260709 12:12:45.450116 26439 leader_election.cc:403] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:45.432888  1255 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:45.452195   956 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.453488   956 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:45.456182  1192 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:45.462888 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 56302us
I20260709 12:12:45.469980 27161 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 20 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:45.469008 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:45.471753 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:45.475371 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:12:45.483105 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 107446us
I20260709 12:12:45.485487 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:45.473237   788 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24.
I20260709 12:12:45.501231 27163 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:12:45.501271 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:45.501909 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:45.481910  1135 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:45.466424  1200 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 12:12:45.482007   990 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:12:45.523355 27166 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:45.470219  1260 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 12:12:45.527071 27159 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 12. Current term is 13. Ops: []
W20260709 12:12:45.530022 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 45941.8us
I20260709 12:12:45.531913 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:45.513899  1282 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:45.532910 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:45.533763  1151 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:12:45.534710 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 49309.5us
I20260709 12:12:45.535359  1151 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:45.535883  1151 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:45.536285  1151 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:45.535310  1221 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:45.538661  1221 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.539021  1221 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:45.539310 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 70366.1us
I20260709 12:12:45.540858 26438 leader_election.cc:400] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24.
I20260709 12:12:45.541559  1283 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:45.541766 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:45.542029  1283 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:45.542646   873 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:45.534579  1275 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:45.543458  1200 consensus_queue.cc:1243] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:12:45.543038  1283 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.543732  1275 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:45.544130  1200 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:45.544299  1051 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:45.544750   976 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:45.544920  1051 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:45.545218   976 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:45.545960  1051 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:45.506969  1266 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 12:12:45.547233  1266 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:45.547366  1051 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.547638  1266 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:45.548636  1266 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:45.549796  1266 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:45.550868 26613 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:12:45.534298 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:45.503281  1103 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:12:45.544682  1200 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:45.519240  1135 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:45.569554 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 86230.6us
I20260709 12:12:45.544216  1275 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:45.576372 26439 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:45.577924 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:45.582623 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:45.586237 27168 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:45.588275 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:45.568882  1283 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:45.546070   976 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.572630  1135 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:45.596400 26438 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:45.583887  1140 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:45.586577   873 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:45.617206   920 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:45.618736  1286 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:45.619866  1200 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:45.622828 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 50584.1us
I20260709 12:12:45.624644 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:45.625116 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:45.625528 26470 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:45.625818 26468 raft_consensus.cc:2376] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24. Re-sending same reply.
I20260709 12:12:45.626945 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:45.627744 26471 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:45.627905 26613 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:12:45.628814 26467 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:45.629173 26467 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:45.629920 26467 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:45.631237 26467 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:45.610939   788 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:45.632458  1140 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:45.633396  1140 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.642675  1275 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.643694 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:45.644366  1275 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:45.645191 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:45.645841 26470 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:12:45.646904  1170 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:45.648658  1284 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:45.607161  1280 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:45.595384  1192 raft_consensus.cc:2764] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:45.661149   976 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.664283  1146 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.670182  1200 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:45.624725 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:45.678215 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 51875.6us
W20260709 12:12:45.680792 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 43790.7us
I20260709 12:12:45.681770 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:45.682691 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 117411us
W20260709 12:12:45.684547 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:45.685308 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 90293.6us
W20260709 12:12:45.686340 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.689343 26472 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
W20260709 12:12:45.702436 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 222924us
W20260709 12:12:45.724028 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:45.751971 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.743516 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:45.661433  1221 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.680516   788 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:12:45.755380 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:45.750465 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 68763.6us
I20260709 12:12:45.701406  1146 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:45.771484 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:45.772451 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.772516 26613 raft_consensus.cc:2410] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:12:45.772579 26467 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:45.689551  1170 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.064s
I20260709 12:12:45.704074   873 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 12:12:45.747825   779 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:12:45.780507  1211 consensus_queue.cc:1059] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:12:45.749732   971 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:12:45.798990  1051 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.777194  1088 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:45.806445 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 97603.2us
W20260709 12:12:45.807180 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 98431.3us
W20260709 12:12:45.816519 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.784729  1284 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:45.803920 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:45.825986 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 48395.8us
I20260709 12:12:45.793377  1298 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:12:45.831444 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 150018us
I20260709 12:12:45.832823 26514 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:45.822386  1266 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:12:45.845001 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:45.845248  1266 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:45.845798 26616 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:45.845978  1282 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:45.846276  1266 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.847723  1266 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:45.832466   956 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:12:45.837831   971 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:45.851577  1255 raft_consensus.cc:3055] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:45.852077  1255 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:45.852980  1255 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:45.854001  1255 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:45.855640 26616 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:45.825683  1051 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.859761  1014 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:45.830260  1088 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:45.844828 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.850687   956 consensus_queue.cc:1243] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:12:45.856942  1200 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.840298   990 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:12:45.859153  1295 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:12:45.834651  1260 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:45.882692  1260 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:45.882965 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:45.883865 26468 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:12:45.883699  1260 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.825192  1284 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:45.862587 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.885371 26465 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:45.885597 26439 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:45.885883 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.867983 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:45.875416 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:45.883191 26614 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:45.875602 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:45.889120 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 86826.4us
I20260709 12:12:45.889472 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:45.890094 26613 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27. Ops: []
I20260709 12:12:45.891682 26616 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:45.891644 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:45.893918 26544 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:45.883802  1211 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.016s
I20260709 12:12:45.900137  1211 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:12:45.900568  1305 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:45.866230  1298 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.901326  1305 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:45.901538  1135 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.906488 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:45.913079  1306 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:45.914359  1306 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:45.914937  1051 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:45.896201   788 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:45.915714  1308 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.915791  1281 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:45.916406  1281 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:45.916347  1308 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.918227 26467 raft_consensus.cc:2410] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:12:45.918910  1221 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:45.889590  1200 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.890429  1260 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:45.926826 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.890257   990 raft_consensus.cc:697] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:45.929719   990 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:45.895694  1170 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:45.933008  1170 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:45.935204  1308 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:45.936626   920 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.937342   920 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:45.885373  1284 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.940712  1088 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:45.941221 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:45.941951 26614 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
I20260709 12:12:45.943408 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:45.943789  1298 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:45.944237  1304 raft_consensus.cc:3055] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:45.944430 26618 raft_consensus.cc:2393] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 16: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:45.944656  1304 raft_consensus.cc:740] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:45.945744   920 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:45.946750  1135 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:45.945708  1304 consensus_queue.cc:260] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:45.948261  1304 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:45.950021  1200 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:45.943325  1151 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:45.953264  1151 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:45.956677 26614 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:45.957705  1200 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.957918 26544 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:12:45.900615  1211 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:45.958362  1200 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.959383  1211 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:45.960922  1211 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:12:45.963455 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:45.963955 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 88497.6us
I20260709 12:12:45.963135 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:45.967595 26467 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:12:45.967595 26471 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:45.971266 26472 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 24 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 12:12:45.979460 26614 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:45.980124  1311 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.981046 26543 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:45.980728  1311 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:45.982790 26618 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:45.983295  1311 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:45.984186 26548 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:45.984819  1289 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:12:45.985287  1289 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.985656  1289 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:12:45.986050 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:45.989014 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:45.989990 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:45.990758 26468 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:45.991012 26467 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:45.991730 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:45.992504 27160 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:45.993947 26466 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:45.968657   920 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:45.994979 26465 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:45.995337  1185 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:45.995571  1187 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:45.996601  1185 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:45.997042  1185 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:45.998553  1303 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:12:45.977336  1200 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:45.993386  1146 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 12:12:46.000672  1146 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:46.001149  1146 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:45.917743  1281 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:46.003240  1281 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:46.003177  1279 consensus_queue.cc:1175] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac3ac2181aa941229a758ccf6b5607cd" responder_term: 19 status { last_received { term: 18 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:45.976847 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:46.007722 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:45.935266  1170 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:46.013911 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:46.020056 26465 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:12:46.019215 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:46.024022 26548 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:12:46.027014 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:46.028885 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 139767us
W20260709 12:12:46.030649 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 54834.4us
I20260709 12:12:46.035430 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:46.035883 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:46.037300 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:46.038218 26614 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:46.056181 26514 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:46.056612 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:46.057538 26614 raft_consensus.cc:2410] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:12:46.058576 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:46.059547 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:46.058746 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:46.018384  1221 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:46.063458 26613 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:12:46.064380 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:46.066602 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 55673us
I20260709 12:12:46.028146  1282 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:46.066157 26547 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:46.060256 26618 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
W20260709 12:12:46.069300 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 92544us
I20260709 12:12:46.071414 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:45.998088  1185 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:46.073103 26514 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:46.028621  1279 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.076889   779 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:46.083933 26545 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 12:12:46.015463  1187 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:12:46.012441  1088 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:12:45.958663  1305 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:46.085731 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:46.085377 26545 pending_rounds.cc:85] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 11
I20260709 12:12:46.059894   920 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:46.058740  1069 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:46.077651  1216 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.086975 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:46.089253 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:46.068729  1308 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:46.090078  1279 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:46.093698  1284 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:46.094960   920 raft_consensus.cc:697] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:46.107843 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:46.060714  1298 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 12:12:46.108522 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:46.098981 26548 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
W20260709 12:12:46.100100 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 86263.2us
I20260709 12:12:46.091063 26545 pending_rounds.cc:107] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 12:12:46.110689 26545 raft_consensus.cc:2889] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:46.110756 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:46.114969 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:46.085274   779 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:46.115661 26544 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:46.128763  1146 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:46.131691  1146 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:46.137440 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 51307.5us
I20260709 12:12:46.144107 26467 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:12:46.144559 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:46.145675 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.106940   788 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:12:46.152416 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.096351  1216 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:46.153258 27164 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
W20260709 12:12:46.143682 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 43646.5us
I20260709 12:12:46.154961 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:46.160022 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:46.149766 26547 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:12:46.106781  1051 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:46.124925  1185 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:46.114658  1308 raft_consensus.cc:697] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:46.164598 26465 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 27.
I20260709 12:12:46.166628 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:46.167675  1051 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.167742   920 consensus_queue.cc:237] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:46.086627  1282 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:46.170629  1014 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:46.178026  1069 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:46.178846  1088 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:46.179016   779 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:46.181509  1284 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:46.182655 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:46.183810  1279 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:46.143965  1313 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:12:46.184878 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 77133.2us
W20260709 12:12:46.203259 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:46.206211 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 75477us
I20260709 12:12:46.145210  1221 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:46.225656 27168 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
W20260709 12:12:46.233479 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 113754us
I20260709 12:12:46.223532  1051 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:46.256633  1282 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:46.257385 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:46.261531 26619 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:46.309450 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:46.263657 26613 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:46.277200 26617 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 21: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:46.185556   788 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 21 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:46.219475  1014 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.302716 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:46.303532 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:46.295390  1313 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.304332  1308 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:46.310585 26467 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 19: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:46.215865  1298 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:46.272591  1088 consensus_queue.cc:1243] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 18.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:12:46.294672  1279 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.339792 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:46.340926 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 51920.9us
I20260709 12:12:46.342842  1317 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:12:46.343052   990 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.336130  1298 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:46.343551  1325 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.021s
I20260709 12:12:46.299940   779 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:46.359920 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.367370  1282 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:46.325333  1014 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:46.321118  1151 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:46.333455  1313 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:46.387995 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 201946us
W20260709 12:12:46.391358 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:46.392196 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 177908us
I20260709 12:12:46.395011 26613 raft_consensus.cc:1217] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Deduplicated request from leader. Original: 18.12->[19.13-19.13]   Dedup: 19.13->[]
W20260709 12:12:46.395149 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.378268  1298 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:46.395678 26613 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: [19.13-19.13]
W20260709 12:12:46.395960 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:46.397887 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 49871.7us
I20260709 12:12:46.401060 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:46.406419 27160 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
W20260709 12:12:46.397338  1255 consensus_meta.cc:287] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.543s	user 0.013s	sys 0.000s
I20260709 12:12:46.414456 26622 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:46.375104  1279 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:46.426438 26543 raft_consensus.cc:2410] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:12:46.418767 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:46.407091  1323 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:46.420976  1331 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:12:46.422303 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:46.431833 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:46.428213 26465 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:46.428890 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:46.405869  1200 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:46.364490   990 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:46.386463  1151 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:46.411383  1298 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:46.440910 26546 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
W20260709 12:12:46.466617  1266 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.618s	user 0.014s	sys 0.000s
I20260709 12:12:46.471069 26470 raft_consensus.cc:2410] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 26 because replica has last-logged OpId of term: 25 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 12.
I20260709 12:12:46.472168  1051 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:46.473378 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:46.497495 26469 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:46.479897  1216 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:46.481223 26471 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260709 12:12:46.482873 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 65125.3us
W20260709 12:12:46.493873 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.509142 27160 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 12:12:46.530109 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.454226   976 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:46.549747 26471 pending_rounds.cc:85] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 12
I20260709 12:12:46.550107 26471 pending_rounds.cc:107] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 12:12:46.550352 26471 raft_consensus.cc:2889] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:46.500512  1193 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.436316  1323 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:46.538273   971 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.548368   920 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.529868  1200 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:46.548164  1283 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.432089   788 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:46.569780  1289 consensus_meta.cc:287] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.005s
W20260709 12:12:46.606779 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 107252us
I20260709 12:12:46.515228  1221 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.075s
I20260709 12:12:46.585996  1275 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.621726 26465 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
W20260709 12:12:46.672945 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 132598us
I20260709 12:12:46.591985  1103 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.599821  1324 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:46.609171  1304 consensus_meta.cc:287] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.003s
I20260709 12:12:46.702831 26472 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:12:46.704365 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:46.610803  1266 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.709812 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:46.583632  1193 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:46.609959   971 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:46.601679  1334 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.126s
I20260709 12:12:46.676004  1283 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:46.676415  1289 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:46.695814  1275 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:46.718309  1321 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:46.699018  1103 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:46.731622  1135 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.620760   920 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:46.703873  1324 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:46.774494 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:46.797437 26465 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:46.801151 26465 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:46.769752  1306 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.727985  1266 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:46.809439  1332 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:12:46.758279  1200 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:46.803977  1279 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:46.817474  1337 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:12:46.812825  1151 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:46.836985 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:46.799048  1321 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:46.847790 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:46.855525 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 145816us
I20260709 12:12:46.858258 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:46.857547 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.859411 26465 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 16: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:46.798756  1135 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:46.813671  1306 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:46.872920 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:46.846279  1151 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:46.881759   971 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:46.888515  1342 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:12:46.890190  1283 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:46.896682  1321 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:46.903676  1275 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:46.863281  1211 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.898s	user 0.011s	sys 0.004s
W20260709 12:12:46.911036 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.900676  1351 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:46.902827  1354 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:46.882128  1338 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:12:46.947935  1321 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.950588  1255 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.930361  1280 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.951153  1321 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:46.951395  1280 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:46.951813  1354 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:46.953953  1321 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:46.861084  1311 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:46.935114 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:46.963851 26465 raft_consensus.cc:2410] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
W20260709 12:12:46.941332 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 71770.7us
I20260709 12:12:46.951238  1255 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:46.955235  1349 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:12:46.963747 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:46.969362 26468 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:46.970724  1289 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:46.972214  1255 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:46.960158  1346 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:12:46.966913  1311 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:46.981736  1311 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:46.954161  1354 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:46.964970 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:46.965018  1103 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:46.940845   971 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:46.973855 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.975421  1324 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:46.976765  1266 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:46.978633 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:47.003345 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:47.004784 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:47.005791 26465 raft_consensus.cc:2410] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:12:46.983855 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:46.987398 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:46.988348 26468 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:47.001914 26464 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
W20260709 12:12:47.010205 26615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.001s	sys 0.006s
I20260709 12:12:46.927294 26469 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 20.
W20260709 12:12:47.013090 26615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.001s	sys 0.006s
I20260709 12:12:46.988006 27164 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 925) took 1010 ms. Trace:
I20260709 12:12:47.013931 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:47.015810 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:47.017493 26467 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:46.958913  1351 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:46.953987  1280 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:47.017519 27164 rpcz_store.cc:276] 0709 12:12:45.978038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.978266 (+   228us) service_pool.cc:224] Handling call
0709 12:12:45.985112 (+  6846us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:46.153949 (+168837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:46.987764 (+833815us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b540077c754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:46.987947 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362555648}
W20260709 12:12:47.001569  1185 consensus_meta.cc:287] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.785s	user 0.010s	sys 0.000s
W20260709 12:12:46.994908  1014 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.004s
I20260709 12:12:46.984138  1354 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:47.023901 26467 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:12:46.982349  1284 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:47.004125   920 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:47.026512 26469 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
W20260709 12:12:47.014454  1328 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.605s	user 0.000s	sys 0.002s
I20260709 12:12:47.003959  1193 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:47.029240 27159 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
W20260709 12:12:47.030572 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 46816.2us
I20260709 12:12:47.052745 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:47.032423 26468 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:46.992524   971 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:47.030998  1275 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:47.039288 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:47.040730 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:47.042670 26465 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:47.057741 26473 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 19: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:47.029773  1014 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:47.051908  1284 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:47.054334 26469 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 12:12:47.031737   779 consensus_meta.cc:287] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.666s	user 0.012s	sys 0.001s
I20260709 12:12:47.062922 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:47.067955 26468 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:47.064829 26467 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:47.069862 26548 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 12:12:47.070421 26548 pending_rounds.cc:85] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 12
I20260709 12:12:47.070667 26548 pending_rounds.cc:107] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 12:12:47.071019 26548 raft_consensus.cc:2889] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:47.065531 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:47.075946 27167 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:47.077559 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:47.079058   956 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:47.078234   779 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:47.054795  1306 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:47.084954 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:47.087469  1051 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:47.087592  1354 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:47.088536  1354 raft_consensus.cc:3055] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:47.088912  1351 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:47.088915  1354 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:12:47.093405  1333 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.496s	user 0.001s	sys 0.000s
I20260709 12:12:47.093673  1354 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:47.094976  1354 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:47.095654   971 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:47.080751  1304 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:47.096840 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.096674  1304 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:47.092526  1284 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:47.098886  1304 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:47.074772  1283 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.100361  1283 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:47.103341   990 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:47.103636  1014 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:47.107123 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.109098  1324 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:47.109928 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 2868) took 1002 ms. Trace:
I20260709 12:12:47.110339 26546 rpcz_store.cc:276] 0709 12:12:46.107138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:46.108274 (+  1136us) service_pool.cc:224] Handling call
0709 12:12:47.109742 (+1001468us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54003386d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:47.109865 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":523978112}
I20260709 12:12:47.112141 27164 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:47.070796  1211 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.113673  1211 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:47.120822 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:47.127135 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:47.127717 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:47.071486  1193 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:12:47.130264 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:47.128325 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:47.139110 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:47.149384 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:47.149889 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:47.150705 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:47.150130 26468 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:12:47.151415 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:47.152750 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:47.153630 26471 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:47.138607   971 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:47.129514   990 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:47.152814 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:47.158980 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:47.117132  1351 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:47.159125 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:47.158980 26513 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:47.140229  1304 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.140651   976 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:47.159279  1355 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:47.171418   990 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:47.172254  1353 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:12:47.172734   956 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:47.173372  1151 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:47.157235  1354 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:12:47.168834  1221 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:47.166884  1211 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:47.182947  1135 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:47.149207  1280 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:47.157981  1289 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:47.167501  1185 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:47.151286  1051 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:47.165380  1193 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:47.191043 26468 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 28.
I20260709 12:12:47.201406 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:47.192684   976 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:47.205102 26471 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:12:47.167156  1283 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:47.199693  1353 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:47.237845 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:47.187218  1304 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:47.204963   956 consensus_queue.cc:1059] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:12:47.246044   956 raft_consensus.cc:3055] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:47.246567   956 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:47.247589   956 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:47.249066   956 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:47.258805 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:47.259621 26619 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:47.207960  1280 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.260895  1280 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:47.262522 27160 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:47.260251 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1112) took 1146 ms. Trace:
I20260709 12:12:47.265748 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:47.267722 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:12:47.272105 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.273126 26514 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:47.278748 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:47.265828 26548 rpcz_store.cc:276] 0709 12:12:46.113899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:46.117132 (+  3233us) service_pool.cc:224] Handling call
0709 12:12:46.117432 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:47.071616 (+954184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:47.259881 (+188265us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b54000b4354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:47.260127 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2189301504}
W20260709 12:12:47.282032 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44277.6us
I20260709 12:12:47.282979 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:47.283784 27167 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
W20260709 12:12:47.236573  1298 consensus_meta.cc:287] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.760s	user 0.013s	sys 0.001s
I20260709 12:12:47.241460   971 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:47.285341 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:47.231781  1135 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.282310 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:47.288600 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:47.286289 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:47.236807  1289 raft_consensus.cc:697] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 20 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:47.293624 27167 raft_consensus.cc:2410] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:12:47.292176 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:47.287774   976 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:47.306552  1304 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:47.308314  1323 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:47.309690 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:47.299728 27160 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:47.313014 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:47.313684 26621 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 28
I20260709 12:12:47.278318  1311 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:12:47.324908 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:47.328694 26469 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:12:47.323051 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:47.327284 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:47.330919 26465 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:47.281929  1324 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:12:47.317054 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:47.317806 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:47.332487 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:47.334656 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 61663.3us
I20260709 12:12:47.341982 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:47.342806 26468 raft_consensus.cc:2376] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19. Re-sending same reply.
I20260709 12:12:47.285562  1284 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:47.331058 26615 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:47.233022  1185 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:47.346429 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:47.348884 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 196113us
I20260709 12:12:47.349411 26542 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
I20260709 12:12:47.350687 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:47.351608 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:47.296883  1103 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:47.353701 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:47.354027 26615 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 22: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:47.360241 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:47.354563 26619 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 13.
I20260709 12:12:47.369701 26473 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:47.371776 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:47.347548  1323 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:47.344012  1298 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:12:47.354933  1313 consensus_meta.cc:287] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.950s	user 0.016s	sys 0.004s
I20260709 12:12:47.375761 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:47.376315 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:47.315164   990 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:12:47.375667 27159 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:47.353772  1200 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.385995 26469 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:47.377799 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:47.393724 26616 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:47.354498  1324 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 28 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:47.310618  1135 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:47.362890  1284 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 24 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:47.399780 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:47.403980 26547 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:47.404117 26471 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:12:47.400302 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:47.403700 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:47.405632 26544 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:47.407577 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:47.397408 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:47.408519 26544 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 15.
I20260709 12:12:47.386420  1323 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.382658  1216 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 12:12:47.385035  1298 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:47.416333 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.421203  1367 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.421355  1284 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:47.422045  1367 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:47.424583  1367 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:47.393811   990 consensus_queue.cc:1243] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:47.432163 26545 raft_consensus.cc:2410] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:12:47.429786 26615 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 12:12:47.437243 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 65760.2us
I20260709 12:12:47.439990 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:47.440757 26547 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:12:47.440024 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:47.441500 26619 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:47.440449 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:47.442910 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:47.443521 26618 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:47.417044  1323 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:47.428785  1298 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:47.447584 26621 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 28.
W20260709 12:12:47.449388 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 73739.3us
I20260709 12:12:47.402349  1200 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:47.459050 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:47.478287 26471 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:47.460376 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:47.463846 26469 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:12:47.480587 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:47.388861  1313 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:47.456800 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:47.482981 26615 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
W20260709 12:12:47.450271 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 75198.8us
I20260709 12:12:47.468357 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:47.468508 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:47.466463 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:47.472158 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:47.497548 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:47.463910  1151 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:47.499506  1336 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.500188  1369 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:47.504514 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:47.509709 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:47.465974  1325 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:47.510458 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:47.606040 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 134017us
W20260709 12:12:47.510725  1362 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
W20260709 12:12:47.511104 26470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 2889) took 1642 ms (client timeout 2090 ms). Trace:
I20260709 12:12:47.512180  1323 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:47.515384  1354 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:47.516131  1135 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:47.516426 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:47.517256 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.428412  1289 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:47.518828  1200 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:47.412379  1353 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 24.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:47.528285 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:47.530095 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:47.443881  1355 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:47.388141  1193 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:47.434343  1321 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:12:47.561378 26622 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:12:47.644433 26622 pending_rounds.cc:85] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 9
W20260709 12:12:47.557608 26472 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 1019) took 1419 ms (client timeout 1618 ms). Trace:
I20260709 12:12:47.644763 26622 pending_rounds.cc:107] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:12:47.645154 26622 raft_consensus.cc:2889] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:47.540228 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:47.584205 26467 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:47.606952 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:47.645021 26472 rpcz_store.cc:269] 0709 12:12:46.137750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:46.137875 (+   125us) service_pool.cc:224] Handling call
0709 12:12:46.431639 (+293764us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b5800011198. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:12:47.557348 (+1125709us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b540035f7d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:47.557524 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":631783168}
I20260709 12:12:47.607154 26618 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:47.611068 26620 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 21: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:47.620019 26439 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:47.618213 26470 rpcz_store.cc:269] 0709 12:12:45.868237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.875066 (+  6829us) service_pool.cc:224] Handling call
0709 12:12:47.510841 (+1635775us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b54002db254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:47.511021 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1340387072}
I20260709 12:12:47.605357  1336 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:47.631464 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:47.650345 26466 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:47.635334 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 3987) took 1330 ms. Trace:
I20260709 12:12:47.630915 26540 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:47.554363  1313 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:47.638187 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:47.605829  1325 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:47.637856  1304 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:12:47.583622 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 231590us
W20260709 12:12:47.651571 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.646682  1151 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:47.657212 26471 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:47.636428  1187 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.663060  1375 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:47.664695   920 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:47.665493  1336 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:47.495911  1324 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:47.652452 26464 rpcz_store.cc:276] 0709 12:12:46.305180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:46.320319 (+ 15139us) service_pool.cc:224] Handling call
0709 12:12:47.635099 (+1314780us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54001a8954. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:47.635271 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746433408}
I20260709 12:12:47.641819 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:47.636422  1281 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:12:47.670368  1185 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:47.671937 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:47.674532  1367 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:47.676997 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:47.642565  1355 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:47.718688  1355 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:12:47.721606  1351 consensus_meta.cc:287] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.538s	user 0.013s	sys 0.000s
I20260709 12:12:47.693008   920 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.722810   920 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:47.686697   976 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:47.726626 26613 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:47.685420  1321 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.003s
I20260709 12:12:47.691998 26472 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:47.696161 26469 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:47.674006  1325 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:47.731740  1323 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:47.745488  1051 consensus_meta.cc:287] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.004s
I20260709 12:12:47.745992  1051 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:47.688735   779 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:12:47.681725   971 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:47.693473  1187 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:47.692546  1304 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:47.749533  1187 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:47.692047  1279 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:47.750178  1304 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:47.750257 26547 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:47.750530  1279 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:47.751713  1321 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:47.752136  1321 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:47.753053  1321 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:47.755313  1279 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:47.756583 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 79659.8us
I20260709 12:12:47.701081  1298 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:47.683493 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:47.621855  1369 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:47.735543 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 87156.8us
W20260709 12:12:47.766896 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 83549.1us
I20260709 12:12:47.767683 26514 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:47.759011 27159 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:47.758287 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:47.759443 26543 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:12:47.769068 26469 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:12:47.768616 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:47.773912 27134 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:47.775854 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:47.754285  1321 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:47.695376  1280 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:47.781629 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:47.788118 26620 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:47.786547 26548 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 23: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:47.788620 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:47.760111  1334 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:47.779475   956 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:47.777323  1281 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:47.791276 26540 raft_consensus.cc:2376] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22. Re-sending same reply.
I20260709 12:12:47.801816 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:47.778577  1255 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:47.779093   779 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:47.788353  1286 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:47.770717  1304 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:12:47.836798 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:47.787112  1382 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:47.805774  1151 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:47.806423   956 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.809150 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:47.816113  1255 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.789260  1367 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 12:12:47.843400 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:47.806942  1281 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:47.818104  1275 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:47.819824   779 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.845835 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:47.799412  1280 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:47.846664 26540 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:47.910516 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:47.912056 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:47.912957 26539 raft_consensus.cc:2410] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:12:47.913816 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:47.917719 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:47.918733  1379 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:12:47.919003  1375 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:47.919463  1375 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.919838  1375 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:47.920182  1369 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:47.921073 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:47.921775 26541 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:47.922544   788 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:47.923100   788 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:47.924016  1383 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:47.924116  1275 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:47.924690  1383 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:47.925385   788 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:47.925437  1275 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:47.927552  1383 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:47.932240 26513 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:47.853510   956 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:47.933331 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:47.935683 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:47.850572  1382 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.932909   990 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:47.959751 26546 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: []
W20260709 12:12:47.898216 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 89146.6us
I20260709 12:12:47.945468 26539 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:12:47.962661 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:47.850065  1151 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.964875 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:47.966058 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:47.851142  1334 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:47.968294 26547 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:47.854180  1255 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:47.962486   971 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:48.025839 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:48.026289 26546 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:12:48.026700 26547 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:12:47.967940 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:48.021775 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:47.858433  1281 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:47.956470   779 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:48.027894 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 61984.1us
I20260709 12:12:47.936571  1347 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:48.028510 26541 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:47.955161  1260 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.855746  1266 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.164s
I20260709 12:12:48.044432 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:48.046692 26469 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:48.038160 26513 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:48.045475 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:48.052380 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:47.957937  1382 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:48.024708  1151 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:48.038947  1280 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:48.019963   920 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:48.031354  1051 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.967986   990 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:48.165946 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.168435  1282 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.168514   990 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:48.169204  1282 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:48.171886   956 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:48.062779 26539 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:48.178105 26539 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:48.029443   971 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.180004   971 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:48.180267   920 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:48.062959 26622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:12:48.181401 26622 raft_consensus.cc:606] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:12:48.181859 26622 raft_consensus.cc:614] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:48.114362 26469 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:48.097271 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:48.111384 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:48.098654 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 46355.3us
I20260709 12:12:48.067270 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:48.107007 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 68948.9us
I20260709 12:12:48.105432 26540 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:48.061932 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:48.029394  1279 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:48.097617 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:48.194060 26543 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 20: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:12:48.072906  1357 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:12:48.088238  1325 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:48.198705 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:48.205732 26540 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:48.098294  1275 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:12:48.173405  1385 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.317s	user 0.004s	sys 0.000s
I20260709 12:12:47.968640  1103 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:12:48.176095  1282 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:48.239145 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:48.188776 26472 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 20: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:12:48.087733  1392 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:12:48.260382  1387 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.416s	user 0.000s	sys 0.001s
I20260709 12:12:48.215922  1103 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.263026  1103 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:12:48.093103 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:48.268560  1325 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:48.269335 26542 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:48.211513  1279 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:48.089921  1383 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.120s
I20260709 12:12:48.074281  1322 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:48.148365  1260 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:48.187597 26513 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:48.068821  1389 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:12:48.155149  1323 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:48.160286  1051 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:48.163784  1255 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:48.095249  1298 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:48.206249 26614 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:48.062037  1211 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:48.061906  1353 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:48.215638 26541 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:48.042229  1334 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:48.066887 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:48.082522  1371 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.186s
I20260709 12:12:48.241937  1185 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.292754   990 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:48.255707   956 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:48.196858 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:48.309299 26613 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:48.280321 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:48.313086 26543 raft_consensus.cc:2368] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 21. Current term is 22.
I20260709 12:12:48.061604  1347 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:48.193460 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 499407us
I20260709 12:12:48.289085 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:48.289157 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 101646us
I20260709 12:12:48.156610  1355 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:48.290954  1280 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 12:12:48.299999 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:48.301056 26539 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 12:12:48.290772  1354 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:48.303524 26468 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 21: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:48.227332  1275 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:48.293017  1323 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.321893 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:48.338967 26467 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:48.301644  1353 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:48.352325 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:48.341156 26539 pending_rounds.cc:85] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 14
I20260709 12:12:48.359724 26539 pending_rounds.cc:107] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 12:12:48.360164 26539 raft_consensus.cc:2889] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:48.362174 26473 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 12:12:48.352660 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:48.344086 27133 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:48.356042 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:48.356043 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:48.369815 26467 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 16: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:48.374903 26613 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:12:48.382339 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:48.341703   990 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:48.339881  1283 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:48.355334  1323 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:48.353372  1266 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:48.300984  1211 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:48.373513  1396 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:48.398012  1371 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.399773 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:48.404014 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:48.369366  1353 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:48.424201  1354 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:48.465389  1371 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:48.467978  1371 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:48.436021 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 1118) took 1118 ms. Trace:
I20260709 12:12:48.469266 26548 rpcz_store.cc:276] 0709 12:12:47.317363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:47.317548 (+   185us) service_pool.cc:224] Handling call
0709 12:12:48.435728 (+1118180us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b540018b5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:48.435913 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1022954240}
I20260709 12:12:48.470216  1255 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:48.471632  1275 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:48.471374   990 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:48.455917  1396 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:48.472553  1396 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:48.480581  1375 consensus_meta.cc:287] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.003s
I20260709 12:12:48.481107  1375 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:48.469348 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:48.489017 26472 raft_consensus.cc:2376] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22. Re-sending same reply.
I20260709 12:12:48.490069 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:48.490700 26472 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:48.491613  1347 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:48.321199  1185 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:48.495929  1051 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:48.496264  1185 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:48.436779 26547 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:48.496575  1051 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.497066  1051 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:48.499049  1260 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:48.378463  1279 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:48.404983  1321 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.616s	user 0.013s	sys 0.000s
I20260709 12:12:48.385629  1187 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:48.454160 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:48.508978 27159 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 21: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
W20260709 12:12:48.456354 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 81888.1us
I20260709 12:12:48.393410  1069 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:48.464468 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:48.515071 27164 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:48.465842  1354 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:48.445427  1266 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.380378 26439 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:48.506592 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 321588us
I20260709 12:12:48.513813 26542 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:48.407636  1283 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:48.523397  1069 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:48.533123  1069 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:48.525389  1266 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:48.506673   779 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:48.536970   779 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:48.538686 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 158412us
I20260709 12:12:48.538853  1322 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.539402  1322 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:48.539656  1323 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:48.518906 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:48.550580 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:48.550872 26468 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:12:48.547325 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2878) took 1081 ms. Trace:
I20260709 12:12:48.551702 26544 rpcz_store.cc:276] 0709 12:12:47.465750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:47.477713 (+ 11963us) service_pool.cc:224] Handling call
0709 12:12:47.478081 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:47.478528 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:47.478568 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:47.498826 (+ 20258us) log.cc:844] Serialized 26 byte log entry
0709 12:12:47.937177 (+438351us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b18003744a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:12:48.292745 (+355568us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:48.292795 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:48.292872 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:48.540660 (+247788us) raft_consensus.cc:1685] finished
0709 12:12:48.540678 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:48.547247 (+  6569us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":541,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":13010,"spinlock_wait_cycles":72369920,"thread_start_us":355195,"threads_started":1,"wal-append.queue_time_us":1035016}
I20260709 12:12:48.557545 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:48.538861  1334 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:48.516007 26472 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:48.565619 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:48.575812 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.579262 26545 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 21: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:48.580106  1323 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:48.547987  1305 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:48.583508 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:48.587080 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:48.588672 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:48.591096 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:48.519814  1187 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:48.592499 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:48.520807  1151 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:48.593299 26467 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:48.562274 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:48.566931 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:48.608546 26472 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:12:48.607638 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:48.587798 26620 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
I20260709 12:12:48.553910  1355 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:48.614709 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:48.615427 26470 raft_consensus.cc:2376] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20. Re-sending same reply.
I20260709 12:12:48.581838  1396 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:48.624835 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:48.627925 26470 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 12:12:48.633931 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 344308us
I20260709 12:12:48.611896  1327 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:48.611675  1305 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 21 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:48.642496 26542 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:48.645053 26467 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:48.616920  1374 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:48.649945 26470 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 14. (term mismatch)
I20260709 12:12:48.652168 26470 pending_rounds.cc:85] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 13
I20260709 12:12:48.652302 26542 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:12:48.652530 26470 pending_rounds.cc:107] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 12:12:48.652877 26470 raft_consensus.cc:2889] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:48.650602 26544 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:12:48.636231  1327 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.655067 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:48.656739 26470 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:48.640302 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:48.657869   779 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:48.647399 26472 pending_rounds.cc:85] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 9
I20260709 12:12:48.661849 26472 pending_rounds.cc:107] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:12:48.662130 26472 raft_consensus.cc:2889] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:48.665115 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:48.668682 26514 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:48.623293  1051 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:48.609618  1281 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:48.637579  1355 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:48.654614  1327 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:48.678714 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:48.676470 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:48.676532 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:48.677403 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:48.684223 26469 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:48.687016 26544 raft_consensus.cc:2368] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 21. Current term is 22.
I20260709 12:12:48.652088  1374 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:48.661535  1375 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:48.678473 26470 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:12:48.694468 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:48.698531 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:48.697724 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 43902.2us
I20260709 12:12:48.702728 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:48.706516 26546 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 17. (term mismatch)
I20260709 12:12:48.706964 26546 pending_rounds.cc:85] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 16
I20260709 12:12:48.707187 26546 pending_rounds.cc:107] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 12:12:48.707423 26546 raft_consensus.cc:2889] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:48.702683 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:48.718947 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:48.722460 26544 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 12:12:48.723019 26544 pending_rounds.cc:85] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 12
I20260709 12:12:48.723309 26544 pending_rounds.cc:107] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 12:12:48.723628 26544 raft_consensus.cc:2889] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:48.679746  1260 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:48.674867   920 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:48.696094  1374 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:48.686700  1403 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.727083 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:48.671317  1103 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:48.744537 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:48.745326 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:48.714221  1275 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:48.686414   971 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:48.747628  1283 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:48.726903  1260 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:48.724413  1373 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:48.726613  1069 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 12:12:48.776705 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:48.777428 27166 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:48.777757 26469 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:48.752689  1369 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:48.785102 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:48.785773 27168 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:48.738736  1323 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:12:48.791376 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:48.789166 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:48.796415 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:48.742023   920 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:48.798704 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:48.764597  1260 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:48.799089 26513 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:48.870199 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:48.767032  1373 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:48.802371 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:48.855576 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:48.889863 26467 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:12:48.870478 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:48.870678 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:48.871826 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 72819.8us
I20260709 12:12:48.801548 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:48.891086 27168 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:48.879769 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:48.885831 26546 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
I20260709 12:12:48.855849 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:48.892045 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:48.890055 26617 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 13.
I20260709 12:12:48.894939 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:48.782680  1185 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:48.895764 26464 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:12:48.901324 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:48.844044 27166 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
W20260709 12:12:48.791812  1382 consensus_meta.cc:287] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.601s	user 0.012s	sys 0.000s
I20260709 12:12:48.910184 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:48.911478 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:48.756347  1403 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:48.917452 26514 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:48.941781 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:48.943353 26620 raft_consensus.cc:2393] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 16: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:48.942034 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:48.803575  1283 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:48.806381  1396 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:48.944751 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 250428us
I20260709 12:12:48.767201  1266 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:48.803589  1051 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:48.950920 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:48.888304  1375 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:48.896862  1373 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:48.968330 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:48.973184 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:48.988273 27162 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:12:48.988940 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:48.989809 26617 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 21: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:48.973570 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:48.965250 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:48.991482 26620 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:48.991997 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:48.976716 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:48.887481  1355 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:48.995754 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:48.995999  1355 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:48.996923 27162 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:49.001809 26615 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:48.942289  1407 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:48.872371  1411 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:48.978886 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:48.894989  1255 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:48.751102  1305 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:48.982250 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:48.980978  1146 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:12:48.983366  1405 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 12:12:48.983492  1281 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:48.895062  1321 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:48.944808 26467 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:49.013571 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:49.014907 26616 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:49.014978 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 144872us
I20260709 12:12:49.013887 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:49.037777 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:49.017963   976 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:49.020473 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 128470us
I20260709 12:12:49.022265 26468 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 23: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:48.904224  1151 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:49.028530  1322 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:49.030576   971 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:49.005095   779 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:49.044571 27133 leader_election.cc:400] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 21. Current term is 22.
I20260709 12:12:49.035328 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:49.055351 27133 leader_election.cc:403] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:49.071579  1322 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:49.044615  1255 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:49.015830  1396 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.080309  1396 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:49.080783  1255 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:48.966316  1382 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:49.001240  1375 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:49.082551  1146 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:12:49.083454  1353 consensus_meta.cc:287] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.001s
I20260709 12:12:49.083673  1146 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:48.987525  1283 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:49.089520  1283 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:49.083946  1353 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:48.943010  1185 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:49.090761  1429 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:49.090963 26622 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:49.035310  1051 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:49.092303  1051 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:49.093127  1353 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:49.093272  1427 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 21. Current term is 22.
I20260709 12:12:49.094748  1426 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:12:49.095981 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 58278.5us
I20260709 12:12:49.084112  1375 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:49.009756  1187 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:49.096868 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:49.098654 27160 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 14: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:49.079586   920 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:49.105476 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:49.110533 26616 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:49.107451  1353 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:49.120182 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:49.122823 26620 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
W20260709 12:12:49.123112 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 54951.1us
I20260709 12:12:49.100404  1347 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:49.160060 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:49.162050  1407 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:49.167198 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:49.113072  1283 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:49.168772 26620 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
I20260709 12:12:49.054222   976 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:49.053452  1321 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:49.044718  1418 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.134s
I20260709 12:12:49.119120  1396 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:49.176297 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:49.174937 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 161459us
I20260709 12:12:49.104431  1324 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 12:12:49.158696  1103 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:49.093273  1051 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:49.169415  1423 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:49.178896  1281 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:49.229684  1151 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:12:49.231966  1281 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.229748  1283 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 12:12:49.235237  1281 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:49.235824  1283 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:49.236260  1283 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:49.237090  1283 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:49.241999 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 199021us
I20260709 12:12:49.238317  1283 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:49.253862  1211 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:49.279328 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 328493us
I20260709 12:12:49.282903 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:49.283788 26616 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:49.284039 26614 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: []
W20260709 12:12:49.287921  1354 consensus_meta.cc:287] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.760s	user 0.009s	sys 0.004s
I20260709 12:12:49.288002 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:49.288623  1185 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:49.288558  1354 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:49.289449 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:49.291299   976 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:49.293444 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3203) took 1014 ms. Trace:
I20260709 12:12:49.294237 26622 rpcz_store.cc:276] 0709 12:12:48.279424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.279602 (+   178us) service_pool.cc:224] Handling call
0709 12:12:48.283992 (+  4390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:49.091538 (+807546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:49.293167 (+201629us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b5400346a54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:49.293373 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1855346944}
I20260709 12:12:49.290196  1373 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:49.301630  1373 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:49.303717 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:49.304385  1369 consensus_meta.cc:287] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.000s
I20260709 12:12:49.304862  1369 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:49.305155  1327 consensus_meta.cc:287] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.607s	user 0.006s	sys 0.003s
I20260709 12:12:49.305719  1327 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:49.309092  1374 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.000s
I20260709 12:12:49.296515 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:49.311232  1211 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.311656  1354 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:49.312217  1403 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:49.312729 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:49.313392  1321 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:49.313882  1266 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:49.316087  1423 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:49.317107  1260 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:49.320515 26545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 2879) took 1276 ms (client timeout 1620 ms). Trace:
I20260709 12:12:49.321413 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:49.323431 27160 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:49.324920 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:49.389879 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.325922 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:49.328385 26618 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:12:49.228613  1347 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:49.332474 26615 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:49.334517 26616 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
W20260709 12:12:49.226018 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44971.2us
I20260709 12:12:49.570777 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:49.305392  1429 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:49.353796 27134 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:49.579456 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 225737us
I20260709 12:12:49.359045 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:49.581060 26613 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 22: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:49.359246 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:49.581753 26547 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:49.360067 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 63642us
I20260709 12:12:49.360185 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:49.368548 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:49.548290 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:49.545455  1327 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:49.361315   990 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:49.361195  1374 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:49.551931  1260 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:49.548287   956 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:49.347859  1411 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:49.547734 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4042) took 1212 ms. Trace:
I20260709 12:12:49.412842 26622 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 22: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:49.603792  1260 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:49.353140  1421 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 12:12:49.604473  1260 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:49.604940  1421 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:49.605154  1374 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:49.605394  1421 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:49.605859   990 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:49.599017  1324 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:49.606901  1324 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.607309  1324 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:49.606282  1421 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:49.608129   990 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:49.608413  1421 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:49.609011 26621 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:49.603370 26472 rpcz_store.cc:276] 0709 12:12:48.335768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.622215 (+286447us) service_pool.cc:224] Handling call
0709 12:12:48.647144 (+ 24929us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:48.786554 (+139410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:48.786588 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:49.308311 (+521723us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b2c000327f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:12:49.308932 (+   621us) log.cc:844] Serialized 52 byte log entry
0709 12:12:49.411378 (+102446us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:49.432889 (+ 21511us) log.cc:844] Serialized 14 byte log entry
0709 12:12:49.433098 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:49.433204 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:49.547354 (+114150us) raft_consensus.cc:1685] finished
0709 12:12:49.547470 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:49.547655 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2345,"prepare.queue_time_us":22629,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":2451,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":7945,"spinlock_wait_cycles":12195200,"thread_start_us":203149,"threads_started":2,"wal-append.queue_time_us":180053}
I20260709 12:12:49.611476 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:49.530449 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2881) took 1484 ms. Trace:
I20260709 12:12:49.431157  1146 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.424916  1266 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 12:12:49.434984  1438 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:12:49.367544  1211 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:49.472872 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:49.413882 27167 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:12:49.367095  1414 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:49.379598 26545 rpcz_store.cc:269] 0709 12:12:48.043624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.106431 (+ 62807us) service_pool.cc:224] Handling call
0709 12:12:49.320305 (+1213874us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b54001068d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:49.320446 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":906637184}
I20260709 12:12:49.422034   971 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.434922   873 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:49.252156  1407 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:49.371338  1284 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:49.589027 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:49.650063 26541 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:49.590934 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:49.650755 26544 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:49.650899 26620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:12:49.577814 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:49.651578 26620 raft_consensus.cc:606] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:12:49.651952 26620 raft_consensus.cc:614] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:49.652027 26615 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:49.600227 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 1198) took 1157 ms. Trace:
W20260709 12:12:49.600598 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 232140us
I20260709 12:12:49.619689   956 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:49.626941 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:49.624244  1266 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.625838  1146 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:49.631897  1412 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.630s	user 0.005s	sys 0.000s
I20260709 12:12:49.596539  1383 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:49.673295 27164 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
W20260709 12:12:49.666934 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45414.3us
I20260709 12:12:49.648177 26467 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:49.653486 26514 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:49.653009 26613 rpcz_store.cc:276] 0709 12:12:48.442344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.358690 (+916346us) service_pool.cc:224] Handling call
0709 12:12:49.600147 (+241457us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:49.675895 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:49.596029  1221 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.039s
I20260709 12:12:49.660892 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:49.666679 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:49.622866 26539 rpcz_store.cc:276] 0709 12:12:48.045562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.179211 (+133649us) service_pool.cc:224] Handling call
0709 12:12:48.179535 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:48.391314 (+211779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:49.530165 (+1138851us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b5400111cd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:49.530356 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276631936}
I20260709 12:12:49.597563  1281 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:49.671095  1403 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:12:49.672057 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:49.673530 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:49.667711 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:49.634655  1347 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.685392 26547 raft_consensus.cc:2410] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:12:49.689409 26467 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:12:49.770604 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:49.771561 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:49.739012 26544 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
W20260709 12:12:49.782262 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 128935us
I20260709 12:12:49.785300 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:49.785771 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:49.691112 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:49.783104 26546 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:49.787056 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:49.788776 26473 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
I20260709 12:12:49.783885 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:49.791059 26539 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:49.650161  1374 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:49.792420 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2913) took 1131 ms. Trace:
I20260709 12:12:49.794070 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:49.793262 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:49.786545 26471 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 20.
I20260709 12:12:49.688110 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:49.796144 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:49.796450 26514 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:49.797297 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:49.797663 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:49.795070 26613 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 20: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:49.649417  1437 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.645735  1279 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:49.603793  1411 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:49.655031   971 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:49.664381  1351 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.176s
I20260709 12:12:49.664224  1354 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.131s
I20260709 12:12:49.649466  1414 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:49.661674  1373 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:49.838248 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:50.085741 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 292557us
I20260709 12:12:49.794198 26465 rpcz_store.cc:276] 0709 12:12:48.648706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.650217 (+  1511us) service_pool.cc:224] Handling call
0709 12:12:48.650594 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:48.651009 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:48.651033 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:48.651524 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:12:48.748705 (+ 97181us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:12:48.999081 (+250376us) log.cc:844] Serialized 14 byte log entry
0709 12:12:49.006646 (+  7565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:49.006759 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:49.628971 (+622212us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:49.672612 (+ 43641us) raft_consensus.cc:1685] finished
0709 12:12:49.780054 (+107442us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:49.780231 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":297635,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":2956,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":17475,"spinlock_wait_cycles":87095680,"thread_start_us":346380,"threads_started":2,"wal-append.queue_time_us":244080}
I20260709 12:12:49.779606  1383 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:49.842072 26545 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: []
W20260709 12:12:49.900307 26438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.003s	sys 0.024s
I20260709 12:12:49.897318 26546 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:49.862772 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 1036) took 1322 ms. Trace:
I20260709 12:12:49.855237 26539 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:49.858999 26548 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
W20260709 12:12:50.086731 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 289137us
I20260709 12:12:50.156387 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:50.093252 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:50.093654 26541 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
W20260709 12:12:50.157382 26438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.016s	sys 0.024s
W20260709 12:12:50.158094 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 845456us
I20260709 12:12:49.660924  1266 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:12:50.154824 26468 rpcz_store.cc:276] 0709 12:12:48.540867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.551543 (+ 10676us) service_pool.cc:224] Handling call
0709 12:12:49.862494 (+1310951us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54000a4e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:49.862707 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1048040192}
I20260709 12:12:49.792294  1255 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:50.098912 26542 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:49.673367  1284 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 22 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:49.840133  1369 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:12:50.092290   956 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:49.799749  1441 raft_consensus.cc:2764] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:12:49.862528   976 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:49.803267   990 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:49.934592  1445 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:50.167178 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 74015.2us
W20260709 12:12:50.169484 26615 consensus_meta.cc:287] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.000s
I20260709 12:12:49.803637  1051 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:49.801256  1281 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:50.098418  1437 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:50.165380 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:50.048295  1382 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:50.167855 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:49.848896  1260 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:49.722950  1211 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:50.176162 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 485134us
I20260709 12:12:49.793078  1151 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.864338  1453 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:50.206629  1283 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:50.149488  1373 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.206707  1151 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:50.207600  1373 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:50.209177  1151 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:50.161115   873 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 12:12:49.780004  1280 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.396s
I20260709 12:12:50.090972  1347 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:49.678992  1327 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.492s
I20260709 12:12:49.834689  1374 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:50.170730  1323 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:50.192431 26615 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:12:50.176565  1426 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:12:50.102035  1429 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 12:12:50.100342  1279 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:49.801296  1146 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:50.203402 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:50.204636  1281 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:50.216467  1151 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.171218  1421 consensus_queue.cc:1059] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:12:50.182588   976 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:12:50.196517  1324 consensus_meta.cc:287] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.589s	user 0.006s	sys 0.005s
I20260709 12:12:50.221395  1051 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:50.214493  1450 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:50.224462 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:50.232301 26513 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.505s (SENT) [suppressed 10 similar messages]
I20260709 12:12:50.096083  1440 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:50.258178 26466 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
I20260709 12:12:50.202123 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:50.258178  1151 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:50.262696  1051 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:50.267148  1414 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:50.275372 26619 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:50.279085 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 122783us
W20260709 12:12:50.290184 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 88152.5us
I20260709 12:12:50.292558 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:50.318114 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 113926us
I20260709 12:12:50.323740 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:50.327265 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:50.258148  1146 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:50.314059 26472 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
I20260709 12:12:50.325249 26514 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:50.341892 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 49482.6us
I20260709 12:12:50.216080  1383 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:50.322472  1374 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:50.323403  1193 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:50.324307   779 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.364187 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:50.371343 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 139064us
I20260709 12:12:50.370918 26438 leader_election.cc:400] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 21. Current term is 22.
I20260709 12:12:50.341172  1146 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.360586  1280 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:50.376917 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:50.378419 26438 leader_election.cc:403] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:12:50.379856  1282 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.401s	user 0.017s	sys 0.004s
W20260709 12:12:50.380354  1282 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.435s	user 0.017s	sys 0.004s
W20260709 12:12:50.377012 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 51934.9us
I20260709 12:12:50.381589 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:50.380620  1461 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:50.270825  1373 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:50.279549  1324 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:50.293591  1440 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:50.389138 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:50.393385 26541 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 18: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:50.341486  1354 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 12:12:50.390465 27167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 937) took 1664 ms. Trace:
I20260709 12:12:50.386883 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:50.390764 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:50.294451  1281 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 12:12:50.400619  1465 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:50.382514  1371 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:50.401435  1465 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 21. Current term is 22.
I20260709 12:12:50.386312   873 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:50.383500   971 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:50.391680  1260 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:12:50.406410  1280 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:50.371243  1456 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:12:50.407459  1440 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:50.407764  1455 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:12:50.410003  1151 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:50.387904  1351 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:50.410948  1351 raft_consensus.cc:697] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:50.411057 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:50.412168 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1136) took 1055 ms. Trace:
I20260709 12:12:50.411929  1351 consensus_queue.cc:237] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:50.412541 26540 rpcz_store.cc:276] 0709 12:12:49.356542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.356729 (+   187us) service_pool.cc:224] Handling call
0709 12:12:49.411735 (+ 55006us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:49.444173 (+ 32438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:49.444221 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:49.547998 (+103777us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b180040ebe0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fbb2a6 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a
0709 12:12:49.548389 (+   391us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b2c0005b0f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:12:49.548866 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:12:49.936235 (+387369us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:49.936309 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:49.936864 (+   555us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:50.411930 (+475066us) raft_consensus.cc:1685] finished
0709 12:12:50.411954 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:50.412106 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31583,"raft.queue_time_us":31848,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":26755,"spinlock_wait_cycles":71959808,"thread_start_us":386791,"threads_started":1,"wal-append.queue_time_us":621000}
I20260709 12:12:50.414856  1347 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:50.415632 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:50.395498 27167 rpcz_store.cc:276] 0709 12:12:48.719165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.719398 (+   233us) service_pool.cc:224] Handling call
0709 12:12:48.719685 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:49.634619 (+914934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:50.383278 (+748659us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b540014fad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:50.383488 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1595825024}
I20260709 12:12:50.417021 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:50.384848  1323 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:50.417685 26473 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:12:50.366513   976 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:50.420501  1373 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:50.377717  1146 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:50.399960  1279 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:50.406669  1457 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 12:12:50.398011 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:50.425557  1279 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:50.407526  1280 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:50.429611 26467 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:50.399245 26545 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 12:12:50.414991 26468 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:12:50.433578 26619 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 14.
W20260709 12:12:50.384354 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 171798us
I20260709 12:12:50.291067  1450 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:50.438202 27159 raft_consensus.cc:2368] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23.
W20260709 12:12:50.438444 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 114795us
I20260709 12:12:50.438292 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:50.439167 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:50.438211 27160 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 23: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:50.439842 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:50.386842  1374 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:50.308476  1284 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:50.445042 26473 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:12:50.450631 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:50.450357 26467 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 12:12:50.453176 26465 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:50.454722 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:50.437747  1461 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.450527 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:50.457188 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:50.436511  1371 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:50.436479  1437 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:50.392103  1369 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.061s
I20260709 12:12:50.480723  1369 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:12:50.481194  1369 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:50.482247  1369 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:50.483722  1369 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:12:50.384626   779 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:50.475303 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:50.469964  1374 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:50.457257   873 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:50.488188 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 53058.5us
I20260709 12:12:50.492337 27134 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:50.445539  1151 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:12:50.496243 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:50.496429 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:50.451130  1465 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 12:12:50.473444  1421 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:50.498217 26467 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:50.501758 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:50.460678  1283 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:12:50.460906  1354 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:12:50.494745  1453 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:50.501003 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:50.497974  1347 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:50.554661 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:50.558847 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:50.559253 26620 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:50.559505 26615 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:50.562300 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:50.563575 26617 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 18: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:50.564682 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:50.497045  1266 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:50.567858 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:50.477627  1461 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:50.490877  1456 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:12:50.571362 26464 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: []
I20260709 12:12:50.572606 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:50.627274 26472 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:12:50.572964 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:50.628594 26466 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:50.573340 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:50.573685 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:50.630748 26470 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:50.618850 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:50.597273 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:50.599691 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:50.629954 26471 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:12:50.633196 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:50.604287 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:50.519481  1475 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:50.631999 26622 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:50.621853 26616 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:50.640748 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:50.503717  1407 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.113s
I20260709 12:12:50.556072  1440 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:50.646096 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:50.569087  1193 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:50.569706  1470 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:50.650889 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:50.673032 26613 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:50.653535  1450 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:50.653746  1351 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:50.681036  1193 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:50.681516  1351 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:50.682207  1351 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:50.681430  1470 raft_consensus.cc:697] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:12:50.683053  1467 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:12:50.683758  1193 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:50.683935  1470 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:50.673820  1221 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:12:50.686800 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1139) took 1089 ms. Trace:
I20260709 12:12:50.687228 26543 rpcz_store.cc:276] 0709 12:12:49.597106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.597347 (+   241us) service_pool.cc:224] Handling call
0709 12:12:49.597883 (+   536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:50.176957 (+579074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:50.177005 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:50.180023 (+  3018us) log.cc:844] Serialized 26 byte log entry
0709 12:12:50.363252 (+183229us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:50.363302 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:50.381798 (+ 18496us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b5400237dd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:50.381846 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:50.686461 (+304615us) raft_consensus.cc:1685] finished
0709 12:12:50.686487 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:50.686722 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8433,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":3205,"spinlock_wait_cycles":1319083264,"thread_start_us":182904,"threads_started":1,"wal-append.queue_time_us":317242}
I20260709 12:12:50.694510 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:50.625715  1421 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:50.695572 27167 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 16.
I20260709 12:12:50.714481 26588 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:50.716449 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:50.667455 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:50.732823 26548 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:50.733265 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:50.736742 26615 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:12:50.737815 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:50.615808  1441 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.105s
I20260709 12:12:50.742439 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:50.752566 27167 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:50.669471  1440 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:12:50.761116 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 93725.6us
I20260709 12:12:50.770186 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:50.762274  1383 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:50.763952 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:50.765607 26543 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:50.766481 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:50.775662  1441 raft_consensus.cc:3055] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:50.776224  1441 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:50.781741 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:50.783852 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:50.791415 27159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 969) took 1113 ms. Trace:
I20260709 12:12:50.784777 27165 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:50.748901  1151 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:50.793352 27159 rpcz_store.cc:276] 0709 12:12:49.666258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.666430 (+   172us) service_pool.cc:224] Handling call
0709 12:12:50.779629 (+1113199us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b540071c5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:50.779777 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1729281792}
W20260709 12:12:50.822939 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 45862.5us
W20260709 12:12:50.826870 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 43811.8us
I20260709 12:12:50.826177  1151 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.828316  1151 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:50.624645  1371 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:50.747371  1051 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:50.894969 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:50.638284  1374 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:50.791939  1282 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:50.825752  1426 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.785701  1324 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:50.779521  1383 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:12:51.015445 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 169173us
I20260709 12:12:51.027112 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:51.031430 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:50.845722  1281 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.041261 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:50.790105  1407 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.230s
I20260709 12:12:50.843880  1476 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:50.801254  1193 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.233s
I20260709 12:12:51.019224  1051 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:51.020408  1450 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.846407  1354 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.217s
I20260709 12:12:51.084704 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:51.091687 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:50.967576  1322 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.107s
I20260709 12:12:51.034683  1383 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:51.087860  1479 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.397s	user 0.000s	sys 0.001s
I20260709 12:12:51.106256 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:51.082612  1478 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:51.045995  1465 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
W20260709 12:12:51.126271  1482 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
W20260709 12:12:51.128119  1484 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
W20260709 12:12:51.133891  1477 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.281s	user 0.000s	sys 0.000s
W20260709 12:12:51.135211  1480 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 12:12:51.137511 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:51.139019 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:51.059090  1475 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:12:51.023762  1441 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.086944   779 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:51.038820  1282 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:51.166960 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 339282us
I20260709 12:12:51.070006  1281 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:51.048352  1426 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.198019  1211 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:51.099123  1450 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.099680  1051 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.210887 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:51.199345  1211 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:51.083747  1421 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.084399  1476 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:51.188210  1437 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:12:51.201468  1146 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.775s	user 0.010s	sys 0.002s
I20260709 12:12:51.112957 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:51.198273  1461 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:51.231823 27133 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.006s	sys 0.005s
W20260709 12:12:51.236860 27133 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.006s	sys 0.006s
W20260709 12:12:51.237301 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 729471us
I20260709 12:12:51.238181 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:51.231617  1470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.014s	sys 0.010s
I20260709 12:12:51.244957 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:51.250218 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:51.246912  1470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.014s	sys 0.010s
I20260709 12:12:51.207268  1440 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:51.260360 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:51.243511  1382 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:51.265172 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:51.266935  1491 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:12:51.267624  1266 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:51.268267  1266 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.268775  1266 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:51.269515  1490 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:12:51.249327  1461 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:51.270848  1382 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:51.271412  1382 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:51.275355  1426 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:51.275724 27160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 973) took 1507 ms. Trace:
I20260709 12:12:51.276108 27160 rpcz_store.cc:276] 0709 12:12:49.768356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.770234 (+  1878us) service_pool.cc:224] Handling call
0709 12:12:51.275516 (+1505282us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54005c30d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:51.275660 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1503536384}
W20260709 12:12:51.278038  1351 consensus_meta.cc:287] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.595s	user 0.006s	sys 0.004s
I20260709 12:12:51.279655  1221 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:12:51.279310  1211 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:51.282321  1468 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.635s	user 0.003s	sys 0.018s
I20260709 12:12:51.248240  1373 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 12:12:51.283746 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:51.302826 26466 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
W20260709 12:12:51.286706  1492 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:12:51.265113 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:51.287214 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:51.300341 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:51.253588  1185 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:51.253435  1499 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:51.315562 26466 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:51.237735  1146 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:51.321391 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 56362.1us
W20260709 12:12:51.322497 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.337405 27133 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:51.302481  1221 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:51.352406  1502 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.353333  1502 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:51.317958  1499 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:51.352807  1494 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:12:51.340832  1374 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:51.423784 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:51.425479 27167 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:12:51.314419   873 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:51.345034  1470 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:51.426297 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:51.435328 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.358932  1221 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:12:51.306908  1351 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:51.343972  1211 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:51.354853  1499 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:51.489065 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:51.491997 26473 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
W20260709 12:12:51.495868 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 70408.9us
W20260709 12:12:51.431521 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 166398us
I20260709 12:12:51.426463  1185 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:51.502868 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:51.505577 26466 raft_consensus.cc:3055] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:51.506188 26466 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:51.514297 26470 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:51.514760 26470 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:51.507197 26466 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:51.516669 26466 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:51.490667  1470 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:51.519285 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:51.519528 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:51.491520  1374 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:51.515480 26470 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:51.530278 26542 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:12:51.531890 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:51.533947  1466 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:51.534632 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:51.535709  1466 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:51.513435  1475 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.547590 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:51.548910 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:51.516604  1266 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:51.550240 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2920) took 1141 ms. Trace:
I20260709 12:12:51.562640 26464 rpcz_store.cc:276] 0709 12:12:50.409061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.438882 (+ 29821us) service_pool.cc:224] Handling call
0709 12:12:50.452899 (+ 14017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:50.626502 (+173603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:51.550012 (+923510us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54002db254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:51.550181 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271756032}
I20260709 12:12:51.488024   873 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.522900  1440 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.523181  1323 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.570683 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:51.526119  1470 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:51.538357  1374 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:51.525476  1051 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:51.579804  1146 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:51.586529  1489 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 12:12:51.588833 26540 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 12:12:51.590180 26540 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:51.590443  1485 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 12:12:51.591600  1435 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.591763 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2902) took 1196 ms. Trace:
I20260709 12:12:51.592170  1435 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.592204 26539 rpcz_store.cc:276] 0709 12:12:50.395169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.396307 (+  1138us) service_pool.cc:224] Handling call
0709 12:12:50.396690 (+   383us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:50.431852 (+ 35162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:50.431885 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:50.452247 (+ 20362us) log.cc:844] Serialized 52 byte log entry
0709 12:12:50.709623 (+257376us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:50.709685 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:50.709792 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:51.591497 (+881705us) raft_consensus.cc:1685] finished
0709 12:12:51.591523 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:51.591694 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34644,"raft.queue_time_us":35779,"spinlock_wait_cycles":17111808,"thread_start_us":218344,"threads_started":1,"wal-append.queue_time_us":548535}
W20260709 12:12:51.593967  1504 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:12:51.528475  1282 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:51.528200  1407 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:51.602059 26466 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:51.572623  1502 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:51.540366   779 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.062s
I20260709 12:12:51.622903 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1042) took 1985 ms. Trace:
I20260709 12:12:51.623469 26469 rpcz_store.cc:276] 0709 12:12:49.637555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.637692 (+   137us) service_pool.cc:224] Handling call
0709 12:12:49.638199 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:49.768461 (+130262us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:12:49.839061 (+ 70600us) log.cc:844] Serialized 14 byte log entry
0709 12:12:50.047087 (+208026us) log.cc:844] Serialized 14 byte log entry
0709 12:12:50.092788 (+ 45701us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:50.096772 (+  3984us) log.cc:844] Serialized 26 byte log entry
0709 12:12:50.096955 (+   183us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:50.097013 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:50.445283 (+348270us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b18003b38c0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fbb2a6 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419
0709 12:12:51.622536 (+1177253us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54001c0554. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:51.622599 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:51.622645 (+    46us) raft_consensus.cc:1685] finished
0709 12:12:51.622659 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:51.622831 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45229,"prepare.queue_time_us":71661,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":82,"raft.queue_time_us":49003,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":62972,"spinlock_wait_cycles":317679744,"thread_start_us":206991,"threads_started":1,"wal-append.queue_time_us":344156,"wal-append.run_cpu_time_us":2782,"wal-append.run_wall_time_us":1081941}
W20260709 12:12:51.627246  1486 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 12:12:51.628626 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1217) took 1098 ms. Trace:
I20260709 12:12:51.629024 26614 rpcz_store.cc:276] 0709 12:12:50.530538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.530975 (+   437us) service_pool.cc:224] Handling call
0709 12:12:50.531350 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:50.558047 (+ 26697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:50.558079 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:50.563267 (+  5188us) log.cc:844] Serialized 26 byte log entry
0709 12:12:50.831112 (+267845us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:12:50.831184 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:50.838316 (+  7132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:51.628398 (+790082us) raft_consensus.cc:1685] finished
0709 12:12:51.628420 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:51.628545 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26288,"raft.queue_time_us":42545,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":267403,"threads_started":1,"wal-append.queue_time_us":581111}
W20260709 12:12:51.637989 26439 connection.cc:256] RPC call timeout handler was delayed by -1.0879896579999695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
I20260709 12:12:51.651916 26615 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:51.653405 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:51.643042 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:51.568307  1475 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.655750 26613 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
W20260709 12:12:51.656200 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 108321us
I20260709 12:12:51.658111 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:51.658839 26615 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:51.596840  1323 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.668881 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:51.665756 26619 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:51.596206  1440 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.673421 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:51.677147 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:51.665362  1282 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.679531  1266 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.676586  1513 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:51.682013 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:51.678869  1185 raft_consensus.cc:697] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:51.682925  1323 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:51.683496  1507 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:12:51.683785 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:51.684244  1185 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.667976 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:51.691529 26439 leader_election.cc:400] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23.
I20260709 12:12:51.691849 26439 leader_election.cc:403] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:12:51.603773  1407 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.699093 26542 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:12:51.704596 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:51.681903  1282 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:51.687727  1014 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:51.693964  1513 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:51.755393 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:51.757058  1323 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:51.790220 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:51.758608  1506 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
W20260709 12:12:51.759958  1508 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:12:51.682003  1266 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:51.770618  1014 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.785121 27165 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:51.785507 27164 raft_consensus.cc:2410] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 12:12:51.697883  1515 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:51.760281  1221 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:51.806830 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 106521us
I20260709 12:12:51.806339  1524 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:51.814968  1524 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.817812  1524 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:51.818612  1524 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:51.753551  1351 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:51.784793  1513 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:51.824476  1151 consensus_meta.cc:287] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.995s	user 0.013s	sys 0.002s
W20260709 12:12:51.823523  1369 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.339s	user 0.013s	sys 0.003s
I20260709 12:12:51.837468 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:51.782166  1374 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:51.837282 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:51.828783  1513 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:51.846948  1520 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:51.847453  1374 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:51.809788  1502 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:12:51.801563  1323 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.852430  1520 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:51.830495  1505 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.861353  1463 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:51.861953  1463 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:51.851766   873 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:51.873245 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4055) took 1045 ms. Trace:
I20260709 12:12:51.851771  1369 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:51.872517  1282 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:51.854990  1511 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:51.876719 26471 rpcz_store.cc:276] 0709 12:12:50.828190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.284750 (+456560us) service_pool.cc:224] Handling call
0709 12:12:51.285103 (+   353us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:51.285510 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:51.285544 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:51.286195 (+   651us) log.cc:844] Serialized 52 byte log entry
0709 12:12:51.495715 (+209520us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:51.576854 (+ 81139us) log.cc:844] Serialized 14 byte log entry
0709 12:12:51.600308 (+ 23454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:51.600402 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:51.873010 (+272608us) raft_consensus.cc:1685] finished
0709 12:12:51.873031 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:51.873182 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155643,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":27572,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":16595,"thread_start_us":263264,"threads_started":2,"wal-append.queue_time_us":309328}
I20260709 12:12:51.835508  1499 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:51.843871  1151 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.895726 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3233) took 1319 ms. Trace:
I20260709 12:12:51.896319 26621 rpcz_store.cc:276] 0709 12:12:50.576103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.580967 (+  4864us) service_pool.cc:224] Handling call
0709 12:12:50.581433 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:50.687147 (+105714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:50.687248 (+   101us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:50.687301 (+    53us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:50.687336 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:51.895392 (+1208056us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540003c354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:51.895456 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:51.895641 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242537344}
I20260709 12:12:51.875598  1374 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:12:51.906049  1383 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.788s	user 0.009s	sys 0.004s
I20260709 12:12:51.911967  1323 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:51.912228  1383 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:51.913749  1266 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:51.906849  1518 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.867864  1505 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:51.914805  1518 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:51.906369  1478 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.723s	user 0.014s	sys 0.000s
I20260709 12:12:51.917033  1505 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:51.917605  1478 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:51.918754  1475 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:51.893339  1511 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.922019  1511 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:51.909503  1499 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:51.910852  1440 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:51.911311  1014 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:51.911485  1463 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:51.912178  1374 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.907447  1439 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.067s
I20260709 12:12:51.907841  1151 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:51.922569  1520 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.923820  1355 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:51.924166  1515 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23.
I20260709 12:12:51.925539 26468 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:51.891422  1369 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.926236  1383 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:51.927845   976 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:51.929869  1450 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:51.930713  1382 consensus_meta.cc:287] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.659s	user 0.006s	sys 0.006s
I20260709 12:12:51.932214 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4052) took 1142 ms. Trace:
I20260709 12:12:51.954667  1461 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:12:51.932837 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.933283 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:51.951618 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:51.951958 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:51.917029  1518 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:51.961308 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:51.957647  1282 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.964723 26472 rpcz_store.cc:276] 0709 12:12:50.789712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.789972 (+   260us) service_pool.cc:224] Handling call
0709 12:12:50.852220 (+ 62248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:51.214630 (+362410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:51.214678 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:51.214751 (+    73us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:51.214815 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:51.931928 (+717113us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b54002dda54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:51.931990 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:51.932143 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":832846208}
I20260709 12:12:51.960788  1407 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:51.957686  1463 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:51.959393  1499 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:51.962759  1151 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.968441  1369 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:51.968655  1513 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.973067 26543 raft_consensus.cc:2410] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:12:51.960400  1355 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:51.975134 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:51.917447  1470 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.960554   990 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:51.980751 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:52.039220 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:51.968885  1382 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.981842 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:52.040886 26615 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
I20260709 12:12:52.041625 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:52.043203 26543 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 23: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:51.987555 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:52.030104  1513 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:52.029253  1529 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.989493  1151 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:52.038193 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:52.039865 26539 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:12:52.053156 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:52.053229 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:52.054430 26543 raft_consensus.cc:2410] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 21 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:12:51.975733 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:52.044153 27161 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
W20260709 12:12:52.045535 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 52840.2us
I20260709 12:12:52.058071 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:52.046581 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.051437 27167 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:51.976208  1505 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:12:52.058310  1522 log.cc:927] Time spent T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:12:52.062469 27160 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:51.973443  1461 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:52.060796 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:52.037104  1407 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:51.984555  1282 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:51.985585  1463 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:51.987367  1499 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:52.068754  1325 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:52.070755 26621 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 23: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:52.044911   990 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:52.067986  1513 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:52.099334  1325 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.099726  1374 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:52.110816  1351 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:52.107002  1369 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:52.067467  1505 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:52.113361  1513 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.071236  1407 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:52.126609  1530 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:52.127220  1530 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:52.127626  1530 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:52.118798  1325 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:52.092995  1355 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:52.147505  1355 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:52.148387   990 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:52.151377  1499 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:52.151537  1282 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:52.061249  1529 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:52.128440  1513 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:52.121744  1351 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:52.174335 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:52.174759 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 203156us
I20260709 12:12:52.171260   990 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:52.190245 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:52.192466 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:52.198606 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:52.199096 26471 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:52.193138 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 135143us
I20260709 12:12:52.199321 26469 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:12:52.199911 26543 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:52.162762  1527 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:52.201375 26588 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:52.201825 26467 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:52.203275 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:52.202521 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:52.204674 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:52.128607  1369 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:52.206593 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:52.207007 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:52.207827 26465 raft_consensus.cc:2393] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 17: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:52.207847 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:52.208233 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:52.176316  1282 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:52.209332 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:52.184034  1374 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:52.211570 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:52.217173 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:52.217645 26540 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
W20260709 12:12:52.211915 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.212638 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:52.218910 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:52.214664 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:52.206112  1324 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.221556 26614 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 28. Current term is 29. Ops: []
I20260709 12:12:52.222829 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:52.223404 26467 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:52.216061 26469 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:12:52.226732 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:52.239069 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:52.245960   976 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:52.249133   976 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:52.246455 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:52.252444 26464 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:12:52.253736 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:52.256175 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:52.245855 26539 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:52.258847  1382 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:52.221693  1499 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:52.208027  1527 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:52.260422  1499 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.260872  1499 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:52.204069   990 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:52.220970  1324 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:52.259825  1540 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:12:52.259990  1435 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:52.245577 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:52.291518 26465 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:52.281553 26471 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:52.204424  1463 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:52.204722  1470 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:52.296474 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:52.292065  1542 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:12:52.220027  1543 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:52.263545   990 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:52.269711  1324 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:52.262357  1527 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:52.309859 26467 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
W20260709 12:12:52.299986  1371 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.010s	sys 0.011s
I20260709 12:12:52.298331  1407 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:52.270117  1530 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:52.230674  1374 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:52.311450  1383 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.298306  1529 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:52.221923  1282 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:52.298761  1461 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:52.330278 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 75645.2us
W20260709 12:12:52.319594  1371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.010s	sys 0.011s
I20260709 12:12:52.372996  1509 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.373644  1509 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:52.375839  1509 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:52.311311  1543 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:52.384927  1543 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:52.387073  1530 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:52.390048  1282 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:52.377084  1513 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:52.388760  1499 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:52.397558 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2930) took 1919 ms. Trace:
I20260709 12:12:52.329790  1383 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:52.372444  1505 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:52.402469 26473 rpcz_store.cc:276] 0709 12:12:50.478327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.487398 (+  9071us) service_pool.cc:224] Handling call
0709 12:12:50.487782 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:51.492749 (+1004967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.397258 (+904509us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54001c1e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:52.397486 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2308745984}
I20260709 12:12:52.408246  1383 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:52.413183  1414 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 12:12:52.415709  1103 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:52.416258  1103 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:52.417229  1103 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:52.419657  1103 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:52.436434  1325 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:52.437368  1437 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:52.438088  1437 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:52.403895  1518 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.439317  1325 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:52.450110 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:52.453894 26513 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:52.456375  1411 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:52.459847 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:52.453241  1518 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:52.462178 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:52.464054  1069 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.634s	user 0.007s	sys 0.015s
W20260709 12:12:52.472636  1069 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.643s	user 0.007s	sys 0.016s
I20260709 12:12:52.481657 26620 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:52.484153 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:52.486904 26614 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:52.493728 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:52.496333 26620 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:52.463486  1510 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.468921 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:52.498201 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:52.498143 26617 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:12:52.500435 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:52.500537 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:52.499770 26622 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:52.471580  1411 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:52.503670 26617 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:52.501709   956 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:52.502986 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:52.510895 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:52.478202  1383 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:52.498699  1532 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.519536 26617 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:52.532817  1532 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:52.506349  1476 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:52.507354  1550 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.534215  1550 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:52.535130  1532 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:52.535519  1151 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:52.537158  1550 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:52.509614  1441 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:52.538832  1518 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:52.526233  1499 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:52.541983 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:52.542809 27162 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 23: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:52.542758 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:52.544703  1351 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:52.546344 26541 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:52.547346 26439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.008s	sys 0.000s
W20260709 12:12:52.547709 26439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.008s	sys 0.000s
I20260709 12:12:52.547830 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:52.547967 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:52.548282 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 854582us
I20260709 12:12:52.548772 26541 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 28: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:52.549028 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:52.549577 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:52.549892 26539 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:52.549042 26439 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:52.551997 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:52.552748 26468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 4054) took 1725 ms (client timeout 1655 ms). Trace:
W20260709 12:12:52.553160 26468 rpcz_store.cc:269] 0709 12:12:50.827563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.084416 (+256853us) service_pool.cc:224] Handling call
0709 12:12:52.552534 (+1468118us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54003156d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:52.552673 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878748928}
I20260709 12:12:52.546909 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:52.554989 26542 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:12:52.526741  1383 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:52.506961  1260 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:12:52.528261 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.550194 26541 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:52.562273 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:52.565431 27167 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:12:52.567546 26622 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:52.567353 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:52.568387 27159 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
W20260709 12:12:52.528589 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.529361 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 2909) took 1006 ms. Trace:
I20260709 12:12:52.553953  1282 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:12:52.510035  1510 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:52.572506 26546 rpcz_store.cc:276] 0709 12:12:51.523194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.523344 (+   150us) service_pool.cc:224] Handling call
0709 12:12:51.540988 (+ 17644us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:51.542270 (+  1282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:51.542313 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:51.559982 (+ 17669us) log.cc:844] Serialized 52 byte log entry
0709 12:12:51.752213 (+192231us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:52.521913 (+769700us) log.cc:844] Serialized 14 byte log entry
0709 12:12:52.529019 (+  7106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.529097 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:52.529134 (+    37us) raft_consensus.cc:1685] finished
0709 12:12:52.529145 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:52.529302 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":771785,"prepare.queue_time_us":770013,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":9158,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":24542,"thread_start_us":142203,"threads_started":1,"wal-append.queue_time_us":200437}
I20260709 12:12:52.574115 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:52.515359  1496 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:52.574874 26439 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:52.574854 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.575405 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:52.576190 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 73339.8us
I20260709 12:12:52.575076 26588 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:52.583331 26588 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:52.585284 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:52.586568 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:52.594962 26620 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 23: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:52.598519 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:52.599228 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:52.623924 26541 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:52.550452   976 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:52.559675  1513 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:52.630221 26614 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:52.579519  1435 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.600416  1499 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:52.579917  1476 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:52.593991  1439 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:52.629920 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:52.602113  1211 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:52.600791  1530 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:52.595657  1496 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:52.602355  1505 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:12:52.645819 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:52.575407  1284 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 28.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.064s
I20260709 12:12:52.651149 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:52.580926  1351 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.066s
I20260709 12:12:52.671409  1351 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:52.671859  1351 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:52.672119  1407 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.672742  1351 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:52.672751  1407 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:52.675756  1538 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.502s	user 0.000s	sys 0.004s
I20260709 12:12:52.655049  1530 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.677978  1530 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:52.659848  1453 raft_consensus.cc:3055] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:52.678354 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:52.678982  1453 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:52.679169  1407 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:52.679603 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:52.680294 26622 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:52.682060  1383 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:52.665185  1510 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:52.682964  1510 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.683533  1510 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:52.684170 26470 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:52.648530  1499 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.685153  1499 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:12:52.687218 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.667089  1284 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:12:52.669030  1221 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:52.688108  1510 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:52.640834  1411 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:52.688428  1284 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:52.688874  1411 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:52.689356  1411 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:52.689543  1284 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:52.663007  1496 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:52.691046  1284 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:12:52.691124  1496 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:52.691671  1369 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:52.600144  1520 consensus_queue.cc:1059] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 12:12:52.702075 27160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 945) took 1280 ms. Trace:
I20260709 12:12:52.703889 26470 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:12:52.679215 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:52.710940 27160 rpcz_store.cc:276] 0709 12:12:51.422139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.422333 (+   194us) service_pool.cc:224] Handling call
0709 12:12:51.422741 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:52.065406 (+642665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.701805 (+636399us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b54006cfcd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:52.702002 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1463027456}
I20260709 12:12:52.632283  1260 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.712647 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 2943) took 1208 ms. Trace:
I20260709 12:12:52.713462 26470 rpcz_store.cc:276] 0709 12:12:51.504526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.513638 (+  9112us) service_pool.cc:224] Handling call
0709 12:12:51.514178 (+   540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:52.683971 (+1169793us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b58001df0d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760360aa 00007f50760b8447 00007f50760d0fe7 00007f50760d27de 00007f50760dcb49 00007f50760dd416 00007f50760d9d8f 00007f50760d983e 00007f507b09e419 00007f5074615bd4
0709 12:12:52.712249 (+ 28278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.712561 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2054093184}
I20260709 12:12:52.739848 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:52.654213  1211 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.648156  1435 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:52.739319  1347 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 23 current term: 23 is higher.
I20260709 12:12:52.734879  1351 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:52.756927 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 158546us
I20260709 12:12:52.745561  1211 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:52.754197  1426 raft_consensus.cc:3055] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:12:52.786510 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.786440 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3075) took 2146 ms. Trace:
I20260709 12:12:52.739082  1260 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:52.798336 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:52.789363 26547 rpcz_store.cc:276] 0709 12:12:50.635515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.635700 (+   185us) service_pool.cc:224] Handling call
0709 12:12:50.636021 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:50.636397 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:50.636431 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:50.647431 (+ 11000us) log.cc:844] Serialized 52 byte log entry
0709 12:12:50.745944 (+ 98513us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:51.167508 (+421564us) log.cc:844] Serialized 14 byte log entry
0709 12:12:52.513058 (+1345550us) log.cc:844] Serialized 14 byte log entry
0709 12:12:52.781087 (+268029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.781219 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:52.781270 (+    51us) raft_consensus.cc:1685] finished
0709 12:12:52.781289 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:52.781489 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1329336,"prepare.queue_time_us":3094853,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":25332,"raft.run_cpu_time_us":451,"raft.run_wall_time_us":22653,"spinlock_wait_cycles":29148800,"thread_start_us":745828,"threads_started":4,"wal-append.queue_time_us":543925,"wal-append.run_cpu_time_us":3683,"wal-append.run_wall_time_us":1186098}
I20260709 12:12:52.784440  1440 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:52.787858 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:52.788463 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 192174us
I20260709 12:12:52.784857   990 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:52.810765 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:52.783794   971 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:52.789179  1426 raft_consensus.cc:740] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:12:52.951362 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 139531us
W20260709 12:12:52.937999 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 150215us
I20260709 12:12:52.937374 26439 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:53.013430 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 202798us
I20260709 12:12:52.953145 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:52.952268 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:52.786242  1255 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.144s
W20260709 12:12:53.038625 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 101353us
I20260709 12:12:53.039853 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:52.955596 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3084) took 2216 ms. Trace:
W20260709 12:12:53.041642 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 340416us
I20260709 12:12:52.798287  1279 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.158s
W20260709 12:12:53.044515 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.907998  1510 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:53.043165  1567 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:53.041906 26545 rpcz_store.cc:276] 0709 12:12:50.738863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.796444 (+ 57581us) service_pool.cc:224] Handling call
0709 12:12:50.844404 (+ 47960us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:50.865513 (+ 21109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:50.865546 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:51.025156 (+159610us) log.cc:844] Serialized 52 byte log entry
0709 12:12:51.248756 (+223600us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:52.514848 (+1266092us) log.cc:844] Serialized 14 byte log entry
0709 12:12:52.636255 (+121407us) log.cc:844] Serialized 14 byte log entry
0709 12:12:52.955235 (+318980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.955321 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:52.955369 (+    48us) raft_consensus.cc:1685] finished
0709 12:12:52.955380 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:52.955528 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1311658,"prepare.queue_time_us":1271587,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":99,"raft.queue_time_us":72399,"raft.run_cpu_time_us":428,"raft.run_wall_time_us":59708,"spinlock_wait_cycles":4861696,"thread_start_us":567412,"threads_started":3,"wal-append.queue_time_us":434427,"wal-append.run_cpu_time_us":1837,"wal-append.run_wall_time_us":1013400}
W20260709 12:12:53.058296 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.044128 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1227) took 1072 ms. Trace:
W20260709 12:12:53.073134 26513 connection.cc:256] RPC call timeout handler was delayed by -2.2781075870000222s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
I20260709 12:12:52.936245  1513 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:52.908195  1441 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:53.079501 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 126484us
I20260709 12:12:53.082453  1456 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:12:53.083614  1260 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:53.084779 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:53.044128  1439 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:12:52.951830  1437 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:53.124809  1325 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.074752  1510 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:53.151191 26616 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:53.089699  1527 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:12:53.091284  1554 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
W20260709 12:12:53.091521 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:53.091946  1557 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
W20260709 12:12:53.093451 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.094959  1374 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:53.099050 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 146893us
I20260709 12:12:51.352490 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:53.100672  1567 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.188660 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:53.100857  1051 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:53.102463 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:53.107542  1435 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:53.107966 26365 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39184 (request call id 164) took 19616 ms (client timeout 15000 ms). Trace:
I20260709 12:12:53.108595  1281 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:52.929842  1476 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:53.231074 26465 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:52.959105  1322 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:53.136652 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:53.088454  1279 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:53.152477  1527 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:53.051855  1373 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:53.145897 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:53.147267 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:53.148962 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:53.149171  1325 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:53.258297 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:53.150594  1439 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:53.156896 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:53.191706 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:53.258297 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:53.197409  1051 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.197890  1456 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.197007  1371 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:53.200223 26617 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 12:12:53.220463 27133 leader_election.cc:336] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.777s (SENT)
W20260709 12:12:53.271646 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 51241.4us
I20260709 12:12:53.225565 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:53.225878 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:53.273280 26468 raft_consensus.cc:2376] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22. Re-sending same reply.
I20260709 12:12:53.273595 26470 raft_consensus.cc:2410] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 24 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
I20260709 12:12:53.227763 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:53.274616 26466 raft_consensus.cc:2410] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:12:53.227998 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:53.217226  1465 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:53.229182 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:53.232326 26540 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 20.
I20260709 12:12:53.233170 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:53.235926 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 196155us
I20260709 12:12:53.285226 26465 raft_consensus.cc:2410] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 24 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 12:12:52.959527   971 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:52.959590  1515 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:53.247432 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:53.290941 26469 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:53.257481 26539 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
W20260709 12:12:53.252846  1569 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:12:53.150372  1437 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:53.169648  1496 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:12:53.203337 26365 rpcz_store.cc:269] 0709 12:12:33.491724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.492789 (+  1065us) service_pool.cc:224] Handling call
0709 12:12:53.107851 (+19615062us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:45.018931 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:45.120827 (+101896us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:45.120878 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:12:45.120897 (+    19us) tablet.cc:662] Decoding operations
0709 12:12:45.187634 (+ 66737us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:45.187723 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:45.187767 (+    44us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:12:45.189058 (+  1291us) tablet.cc:701] Row locks acquired
0709 12:12:45.189109 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:12:45.189300 (+   191us) write_op.cc:270] Start()
0709 12:12:45.189471 (+   171us) write_op.cc:276] Timestamp: P: 1783599165189224 usec, L: 0
0709 12:12:45.189498 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:12:45.273038 (+ 83540us) log.cc:844] Serialized 5899 byte log entry
0709 12:12:45.767434 (+494396us) op_driver.cc:464] REPLICATION: finished
0709 12:12:45.834369 (+ 66935us) write_op.cc:301] APPLY: starting
0709 12:12:45.859933 (+ 25564us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:46.336521 (+476588us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:46.369252 (+ 32731us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:47.107102 (+737850us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:47.107527 (+   425us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 12:12:47.107583 (+    56us) write_op.cc:312] APPLY: finished
0709 12:12:47.108091 (+   508us) log.cc:844] Serialized 139 byte log entry
0709 12:12:47.166237 (+ 58146us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:47.186658 (+ 20421us) write_op.cc:454] Released schema lock
0709 12:12:47.199935 (+ 13277us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:47.291122 (+ 91187us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:47.297495 (+  6373us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":117656,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":22503,"apply.run_cpu_time_us":39972,"apply.run_wall_time_us":1441831,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66767,"num_ops":15,"prepare.queue_time_us":187904,"prepare.run_cpu_time_us":26835,"prepare.run_wall_time_us":446688,"raft.queue_time_us":211462,"raft.run_cpu_time_us":10542,"raft.run_wall_time_us":53116,"replication_time_us":563165,"spinlock_wait_cycles":2944,"thread_start_us":278147,"threads_started":5,"wal-append.queue_time_us":265352,"wal-append.run_cpu_time_us":11018,"wal-append.run_wall_time_us":2087549}]]}
I20260709 12:12:53.268481 26464 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 27: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:53.275662 26467 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:12:53.228034 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:53.271744  1557 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:12:53.284124 26471 raft_consensus.cc:2410] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 12:12:53.286350 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:53.255044  1527 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:53.215101  1260 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 12:12:53.262493  1439 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:53.214555  1513 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:53.311533 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:53.342335 26465 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:12:53.061579 26619 rpcz_store.cc:276] 0709 12:12:51.972038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.972167 (+   129us) service_pool.cc:224] Handling call
0709 12:12:51.974854 (+  2687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:52.112039 (+137185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:52.112089 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:52.112153 (+    64us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:52.112201 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.043835 (+931634us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b540009f1d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:53.043886 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:53.044054 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314944384}
I20260709 12:12:53.152204  1426 consensus_queue.cc:260] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:53.328329 26467 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:12:53.296479 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:53.296257 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:53.354838 26469 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:53.299437 27166 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
W20260709 12:12:53.331511 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 45269.6us
I20260709 12:12:53.294870 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:53.222954  1441 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 12:12:52.952221  1565 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.364s
I20260709 12:12:53.217904  1567 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:53.258450  1279 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:52.951927   990 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:53.250670  1476 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:53.270730  1051 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:53.314175  1411 consensus_meta.cc:287] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.002s
I20260709 12:12:53.323609  1515 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:53.362632 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 82503.4us
I20260709 12:12:53.362703 26472 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:53.342434  1564 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:53.368091 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 71673.7us
W20260709 12:12:53.385886 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.263260  1373 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:53.364043 26439 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:53.295094  1281 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 12:12:53.260823  1322 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:53.281106  1568 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.113s
I20260709 12:12:53.387818 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:53.283907  1456 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:53.373255  1426 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:53.392480 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1223) took 1430 ms. Trace:
I20260709 12:12:53.334406  1496 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:53.400076 26613 rpcz_store.cc:276] 0709 12:12:51.963972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.964133 (+   161us) service_pool.cc:224] Handling call
0709 12:12:51.972421 (+  8288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:52.108640 (+136219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:52.108677 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:52.108745 (+    68us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:52.108835 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.391115 (+1282280us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400267854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:53.391165 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:53.392393 (+  1228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312753920}
I20260709 12:12:53.398505 26472 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:53.382320 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:53.393146 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 177144us
I20260709 12:12:53.353250  1185 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 12:12:53.404505 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:53.376884  1469 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:53.383711  1515 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:53.390460  1211 consensus_meta.cc:287] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.004s
I20260709 12:12:53.300246  1465 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:53.376879  1563 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:53.410610 26472 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:53.390005  1283 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:53.416306  1576 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:53.419915   971 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:53.421669  1513 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:53.422624  1279 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:53.423677  1567 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:53.427790  1476 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:53.429461  1530 consensus_meta.cc:287] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.750s	user 0.011s	sys 0.000s
W20260709 12:12:53.434051  1351 consensus_meta.cc:287] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.654s	user 0.005s	sys 0.005s
W20260709 12:12:53.405704  1558 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 12:12:53.414949  1211 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:53.436784  1465 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:53.412863  1511 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:53.407748  1284 consensus_meta.cc:287] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.716s	user 0.013s	sys 0.000s
I20260709 12:12:53.412585  1407 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:12:53.441432 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 59221.8us
I20260709 12:12:53.446452 26472 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: [15.11-17.12]
I20260709 12:12:53.447429 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3083) took 2708 ms. Trace:
I20260709 12:12:53.439714  1568 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 12:12:53.391719  1564 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:53.440428  1530 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:53.450692  1567 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:53.451407  1566 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:53.387814  1411 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:53.387250  1439 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:53.423833  1373 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:53.461920 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 167290us
I20260709 12:12:53.464809 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:53.465150 26544 rpcz_store.cc:276] 0709 12:12:50.738569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.786994 (+ 48425us) service_pool.cc:224] Handling call
0709 12:12:50.787488 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:50.832054 (+ 44566us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:52.507104 (+1675050us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b18003ca900. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5072fefa40 00007f5072fea4e4 00007f5072fea455 00007f5079ad23c7 00007f50760e49a7 00007f50760f40bf 00007f50760f4038
0709 12:12:52.593630 (+ 86526us) log.cc:844] Serialized 14 byte log entry
0709 12:12:52.760304 (+166674us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:52.783701 (+ 23397us) log.cc:844] Serialized 26 byte log entry
0709 12:12:52.783885 (+   184us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:52.784190 (+   305us) log.cc:844] Serialized 14 byte log entry
0709 12:12:52.784450 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.784576 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:53.438385 (+653809us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b18003ca900. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:12:53.447153 (+  8768us) raft_consensus.cc:1685] finished
0709 12:12:53.447184 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:53.447349 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":211603,"prepare.queue_time_us":1684274,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":50411,"raft.run_cpu_time_us":429,"raft.run_wall_time_us":127624,"spinlock_wait_cycles":96898560,"thread_start_us":196265,"threads_started":2,"wal-append.queue_time_us":421519}
I20260709 12:12:53.472716 26473 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:53.453105  1441 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 12:12:53.486773 26513 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:53.476253  1499 consensus_meta.cc:287] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.791s	user 0.009s	sys 0.003s
I20260709 12:12:53.493021  1579 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:53.493949 26622 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 25: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:53.494580  1411 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:53.494994  1530 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:53.494580 26542 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:53.495810  1453 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:53.512367  1440 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:53.512874  1453 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:53.513790 26513 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:12:53.514228  1578 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:12:53.493254  1499 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:53.515018   971 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:53.515432   971 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:53.515803   971 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:53.516630  1499 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:53.524835 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:53.525604 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:53.526414 26471 raft_consensus.cc:2376] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20. Re-sending same reply.
I20260709 12:12:53.474694  1566 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:53.527753  1566 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:53.529390  1566 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:53.529573  1562 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.889s	user 0.008s	sys 0.006s
I20260709 12:12:53.530351 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:53.531307 26471 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:53.501207  1571 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:12:53.533905  1211 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:53.534518  1556 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.895s	user 0.004s	sys 0.009s
I20260709 12:12:53.534874  1322 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:53.468448  1407 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:53.522044  1510 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:53.536098  1407 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:53.537871  1407 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:53.541139 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:53.508498 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:53.546561  1570 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.263s	user 0.002s	sys 0.000s
I20260709 12:12:53.509884  1496 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:53.548888  1185 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:53.549530  1185 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.550043  1185 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:53.530685  1325 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:53.551668 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.560209  1564 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:53.512073  1579 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:53.507543  1456 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:53.566298 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.569375 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:53.573197 27162 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
W20260709 12:12:53.574213 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 81383.3us
W20260709 12:12:53.585987 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 176427us
I20260709 12:12:53.588403 26616 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 16. Current term is 17. Ops: [16.13-16.13]
W20260709 12:12:53.595436 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.597484 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:53.600013 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:53.601709 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:53.602384 27167 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:12:53.602303 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 59980.4us
I20260709 12:12:53.608973 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:53.611138 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:53.611523 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:53.612769 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.614903 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:53.617466 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:53.618537 26544 raft_consensus.cc:2410] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:12:53.622753 26473 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 28. Current term is 29. Ops: [26.17-28.18]
I20260709 12:12:53.624492 26471 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:53.624974 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:53.626088 26469 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:12:53.627342 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:53.634886 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:53.636952 26472 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:12:53.637651 26471 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:53.583606  1579 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:53.638267 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:53.631858  1530 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:53.619630  1574 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:12:53.645298 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.645169 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:53.659932 27163 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:53.649109 26472 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:53.650708  1351 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:53.651846  1499 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:53.652016  1496 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:12:53.607892  1280 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.641899 27167 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:12:53.665103 26471 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 20.
I20260709 12:12:53.690025 26588 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:53.692112 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:53.692847 26471 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
W20260709 12:12:53.695976 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.694798 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:53.639816  1512 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:12:53.702585  1527 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:53.706624 26613 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 12:12:53.708231 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 303911us
I20260709 12:12:53.708559 26471 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 12:12:53.679551  1574 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:53.703922  1499 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:12:53.709457 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:53.729130 26472 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:12:53.733894 26465 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:53.644474  1374 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:12:53.745962 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:53.753539 26514 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:53.679220  1530 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:53.758875 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:53.732973  1574 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:53.767429 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:53.732753  1587 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:53.704604  1280 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:53.753465   990 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:53.751766  1499 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:53.789794 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:53.757568  1255 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:53.792269 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:53.753914  1585 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:12:53.792269 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:53.764253  1580 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:53.734265  1014 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 12:12:53.795360 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:53.769698   779 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:53.799357 26620 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:53.799350 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:53.798144 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.769985  1512 consensus_queue.cc:1243] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 25.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:53.772771  1496 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:53.800572 26621 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:53.807345 26619 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
W20260709 12:12:53.809636 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 182324us
I20260709 12:12:53.810983 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:53.811779 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:53.815881 26514 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:53.817148 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:53.820355 27161 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:53.770599  1568 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:12:53.822732 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:53.823889 26466 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:12:53.825426 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:53.826781 26514 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:53.827286 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:53.796906  1580 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:53.830729 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:53.833364 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:53.779663  1505 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.033s
I20260709 12:12:53.832572 26543 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
W20260709 12:12:53.840220 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.748648  1579 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:53.835836 26466 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:12:53.837414 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:53.847163 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:53.849788 26473 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:53.848869 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:53.786945  1587 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:53.850260 26466 raft_consensus.cc:2376] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23. Re-sending same reply.
I20260709 12:12:53.837536  1440 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:53.853729  1440 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:53.837270  1595 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Stepping down as leader of term 26
W20260709 12:12:53.855028 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.853276 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:53.836392  1580 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:53.853921  1496 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.18, Last appended by leader: 18, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:53.852149 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:53.906442 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 54369.7us
I20260709 12:12:53.854233  1440 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:53.855293  1374 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:53.834822  1588 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:53.905213 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:53.975284 26466 raft_consensus.cc:2410] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:12:53.904414 26473 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 12:12:53.911214 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 62432.4us
I20260709 12:12:53.847869  1565 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:53.852337  1579 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:53.911926  1591 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:12:53.931572  1586 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:12:53.982715 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:53.906608  1527 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:53.993912 27163 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:12:53.904525  1595 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:53.913000  1456 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:53.851008  1499 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:53.909502  1596 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:54.015050 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.975363  1374 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:53.975914  1588 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:53.912827  1355 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:53.918200  1411 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
I20260709 12:12:54.008073  1597 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:54.019985  1600 log.cc:927] Time spent T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:12:54.011435  1530 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:54.017781  1280 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:54.014936  1596 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:54.022194  1374 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:12:54.034011  1515 consensus_meta.cc:287] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.610s	user 0.012s	sys 0.001s
I20260709 12:12:54.024529  1588 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:54.031688  1566 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:12:54.059834 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.009760  1456 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.020591  1543 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:12:54.068915  1530 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:54.077090 27162 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56886 (request call id 1156) took 1371 ms (client timeout 1591 ms). Trace:
W20260709 12:12:54.078178 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:54.079229  1592 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 12:12:54.080302  1601 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:12:54.080054 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:54.108428 27166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 961) took 1036 ms. Trace:
I20260709 12:12:54.032639  1355 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:54.094959  1530 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:54.105089 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:54.018280   971 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:54.092046 27162 rpcz_store.cc:269] 0709 12:12:52.706065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.706501 (+   436us) service_pool.cc:224] Handling call
0709 12:12:54.076756 (+1370255us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b540071b954. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:54.076983 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1680290048}
I20260709 12:12:54.116799 27166 rpcz_store.cc:276] 0709 12:12:53.072545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:53.084491 (+ 11946us) service_pool.cc:224] Handling call
0709 12:12:54.108243 (+1023752us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b540014fad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:54.108359 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399871744}
I20260709 12:12:54.107169  1260 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:54.150998  1260 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:54.152268  1260 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:54.092133  1543 consensus_queue.cc:1243] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 22.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:12:54.155999  1530 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:54.156397 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:54.158056   971 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:54.082155  1566 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:54.159842 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:54.090010  1599 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:12:54.098291  1587 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:54.161264  1440 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:54.086941  1515 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:54.164089  1515 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:54.150540  1185 consensus_meta.cc:287] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.567s	user 0.014s	sys 0.000s
I20260709 12:12:54.159729  1566 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:54.090706  1605 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:12:54.208206  1407 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.670s	user 0.011s	sys 0.003s
I20260709 12:12:54.210984  1574 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:54.129971  1051 consensus_meta.cc:287] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.715s	user 0.010s	sys 0.001s
I20260709 12:12:54.054714  1596 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:54.100013  1568 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:54.165211  1441 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.211784  1255 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:54.091355  1456 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:54.229233  1568 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:54.094493  1595 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:54.212656  1185 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:54.237057  1580 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:54.239514  1440 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:54.239260  1441 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:54.230960  1566 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:54.223044  1585 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:12:54.243260  1374 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:54.260051  1441 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:54.262215  1574 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:54.263372  1355 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:54.265292  1374 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:54.256606  1595 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:12:54.281366  1580 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:54.271688  1568 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:54.283830  1568 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:54.292748  1596 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:54.295296  1588 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:54.212275  1260 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:54.298480  1588 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:54.377213  1580 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:54.229561  1051 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:54.361967 26539 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 21: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:54.365411 26546 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: []
W20260709 12:12:54.358266 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:54.368095 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.361826 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:54.339648 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:54.373742  1279 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.014s	sys 0.014s
W20260709 12:12:54.359432 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.378340  1185 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:54.352440 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:54.363550 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:54.354580 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:54.353580 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:54.352859 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:54.352468 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:54.362874 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:54.403692  1279 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.015s	sys 0.014s
I20260709 12:12:54.300457  1596 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:54.420282  1515 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.421380  1515 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:54.423840 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:54.426062 26544 raft_consensus.cc:2410] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 23 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 12:12:54.424986 26473 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:12:54.427845 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:54.429144 26544 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:12:54.432215 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:54.433674 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:54.436149 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:54.437618 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:54.440883 26544 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:12:54.440977 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:54.430095 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:54.430019 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:54.455901 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:54.443312  1511 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.447139  1374 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.447525 26548 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:54.448787  1611 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:54.451038  1515 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:54.451795 26541 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:12:54.452430 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:54.452633 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:54.454162 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:54.456118 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:54.446245 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:54.453493 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:54.464191 26473 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:12:54.463927 26465 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:54.470918  1051 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:54.472280 26466 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:54.474720 26467 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:12:54.476097 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1159) took 1232 ms. Trace:
I20260709 12:12:54.476683 26542 rpcz_store.cc:276] 0709 12:12:53.243237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:53.260493 (+ 17256us) service_pool.cc:224] Handling call
0709 12:12:53.260814 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:53.512114 (+251300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.475440 (+963326us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b5400237dd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:54.475843 (+   403us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537112448}
I20260709 12:12:54.412361  1580 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:54.484371  1374 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:54.485327 26540 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:54.485575  1511 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:54.487322 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:54.480122  1185 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.489023  1185 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:54.489642 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.492086  1185 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:54.492372 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.459194  1597 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:54.496742  1596 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:54.496624 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:54.498548 26619 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 20: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:54.494582 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:54.503532 26540 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:12:54.504912 26545 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:12:54.505571 26468 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 12:12:54.505649 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:54.508245 26540 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:12:54.516871  1580 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:54.518106  1511 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:54.519165 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:54.518172  1374 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:54.521868 26473 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:54.524152 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:54.524408 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:54.525410 26614 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:12:54.525671 26613 raft_consensus.cc:2393] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 17: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:12:54.511816 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 96001.9us
W20260709 12:12:54.524255 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.528182 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:54.528779 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:54.529958 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:54.530220 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:54.531865 26547 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:54.535384 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:54.538623 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:54.539343 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:54.540105 26547 raft_consensus.cc:2368] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22.
I20260709 12:12:54.541352 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:12:54.542672 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:54.542989 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 97001.2us
I20260709 12:12:54.545001 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:54.552027 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:54.532409 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 393375us
I20260709 12:12:54.546128 26541 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:54.556232 26539 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 23: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:54.562043 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:54.562870 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:54.574038 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:54.580304  1597 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:54.581619  1355 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:54.582441  1355 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:54.585176  1355 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:54.588826 26540 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
W20260709 12:12:54.590384 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:54.625352  1616 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:12:54.632758 26541 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:54.636660 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:54.639006 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:54.640059  1612 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.200s	user 0.003s	sys 0.000s
I20260709 12:12:54.641652 26541 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:54.646145 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:54.646589  1355 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.647286 27167 raft_consensus.cc:2368] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25.
I20260709 12:12:54.647516  1355 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:54.649139 26617 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:54.653345 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:54.659672 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1160) took 1382 ms. Trace:
W20260709 12:12:54.661373 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 114239us
I20260709 12:12:54.661899 26547 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:12:54.650164  1355 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:54.660250 26548 rpcz_store.cc:276] 0709 12:12:53.277418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:53.277608 (+   190us) service_pool.cc:224] Handling call
0709 12:12:53.313613 (+ 36005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.468561 (+1154948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.659319 (+190758us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400397bd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:54.659591 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2502732544}
I20260709 12:12:54.670006 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:54.676607  1456 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:54.665390 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:54.682657 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:54.683375  1439 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:54.683238 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:54.684756 27162 raft_consensus.cc:2410] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:12:54.684808 26617 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:54.687126 27163 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:54.689358 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:54.691591 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:54.694356  1103 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:54.694988  1103 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.695451  1103 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:54.709877  1505 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.711242  1355 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:54.711159  1505 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:54.711792 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48829.6us
W20260709 12:12:54.714986 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.715094 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:54.716106 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:54.716223 26542 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:54.709666 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:54.721333 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:54.737363 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:54.743994 26542 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:54.745678 26548 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:54.752308 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:54.757120 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:54.757969 26619 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
I20260709 12:12:54.766774  1574 consensus_queue.cc:1059] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:54.768496  1574 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:54.768628  1371 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:54.768992 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:54.769635 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:54.769515  1371 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:54.774031 26540 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:54.775104 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:54.775633  1371 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:54.779549 27161 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 24: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
W20260709 12:12:54.780342 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.780930 26470 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 25
I20260709 12:12:54.779539 26539 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:54.761025 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:54.770042 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:54.786307  1499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.021s	sys 0.022s
I20260709 12:12:54.786870 27162 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 21: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:54.756268  1456 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:54.768397  1351 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:54.801707 26542 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:54.801944 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:54.783290  1574 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:12:54.796119  1499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.022s	sys 0.022s
I20260709 12:12:54.804412  1351 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:54.817196 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:54.817261 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:54.814452 26545 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 26 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 12:12:54.819900 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:12:54.820514 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.820760 27160 raft_consensus.cc:2376] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29. Re-sending same reply.
I20260709 12:12:54.822496 26543 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:54.822561  1505 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:54.824870 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:54.826691 27163 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:54.829200 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4094) took 1192 ms. Trace:
I20260709 12:12:54.829664 26471 rpcz_store.cc:276] 0709 12:12:53.636220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:53.701678 (+ 65458us) service_pool.cc:224] Handling call
0709 12:12:53.702037 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:53.713019 (+ 10982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.828652 (+1115633us) spinlock_profiling.cc:243] Waited 6.25 ms on lock 0x7b54001c0a54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:54.828987 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14375168}
I20260709 12:12:54.833000  1426 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 23.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:12:54.833832 26588 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:54.853897  1499 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:54.854584  1499 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:54.855792  1499 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:54.854576 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 141737us
I20260709 12:12:54.859853 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:54.861418 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:54.861816 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:54.861349 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:54.862627 26614 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:12:54.862368 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:54.862998 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:54.863534  1597 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:54.863834 26621 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:54.864085 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:54.864394  1597 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:54.864847 26616 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:54.865057  1597 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:54.865619  1597 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:54.866537 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:54.863044 26619 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:54.868531 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.836467  1103 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:54.839570  1574 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:54.840252 26470 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
W20260709 12:12:54.869428 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 58215us
I20260709 12:12:54.841723 26542 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:12:54.844728 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 1243) took 1617 ms. Trace:
W20260709 12:12:54.847637  1613 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.407s	user 0.003s	sys 0.000s
I20260709 12:12:54.858784 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:54.871183 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.818545  1351 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:54.876055 27162 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:54.870219 26622 rpcz_store.cc:276] 0709 12:12:53.227644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:53.227779 (+   135us) service_pool.cc:224] Handling call
0709 12:12:54.844146 (+1616367us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b540037a354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:54.844475 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382026624}
I20260709 12:12:54.877206 26548 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:54.877106 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:54.878306 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.882151 26541 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:54.883080  1456 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:54.884743  1456 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.885135  1456 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:54.885043 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:54.889364  1437 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:54.889792  1437 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:54.890179  1437 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:54.892544  1610 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.464s	user 0.001s	sys 0.001s
I20260709 12:12:54.893108 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:54.893296 26613 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:54.893788 26620 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:12:54.879058 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:54.899586 26546 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 23: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:54.901029 26618 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:54.901532 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:54.862231 26371 catalog_manager.cc:5697] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:54.911199 26621 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
W20260709 12:12:54.912184 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.912495 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:54.913400 26622 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 22: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:54.913316 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:54.913971  1103 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:54.915390  1374 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:54.912199 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:54.918943  1322 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:12:54.919135 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.919263 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:54.919683  1322 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:54.920302  1568 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:54.920946 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:54.921195 26371 catalog_manager.cc:5697] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 16 to 19, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 19 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:54.920989  1568 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:54.924855  1630 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:54.925269  1630 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:54.925450  1568 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:54.927069 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47679.6us
I20260709 12:12:54.905125 26615 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:12:54.930873  1580 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:12:54.932297 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.931833  1580 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:54.932776  1566 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.933331  1566 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:54.934818  1505 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:54.934633  1371 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:54.935324  1505 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.935545  1566 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:54.935797  1505 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:54.936228  1566 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:54.935128  1580 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:54.936661  1566 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:54.937081  1566 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:54.938611 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:54.922147  1322 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:54.945657 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:54.960793 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:54.961982 26620 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:54.962361 26616 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:54.963650 26613 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:54.955489 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:54.964438 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 67939.9us
I20260709 12:12:54.973543 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:54.965741 26514 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:54.974613 26620 raft_consensus.cc:2410] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 24 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:12:54.973315 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:54.976975  1371 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:54.980166  1371 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:54.980558  1371 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:54.981403  1632 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:54.982375 26544 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:54.986481  1511 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:54.987001  1511 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:54.987403  1511 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:54.967173  1574 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:54.982153 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 123246us
I20260709 12:12:54.971045  1322 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:54.995193 26514 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:54.996692 27134 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:54.997648 26615 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:54.991549 26371 catalog_manager.cc:5697] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 15 to 17, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 17 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.003873  1103 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:55.004474  1103 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:55.005478  1103 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:54.975198  1530 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:55.014794 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:55.016395 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:55.019032 26371 catalog_manager.cc:5697] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 10 to 15, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 15 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:55.024709 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 103938us
I20260709 12:12:54.926304  1630 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:55.002054  1322 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.027901  1437 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:55.034610  1437 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:55.030776 26620 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 23: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:55.036715 27164 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:12:55.038811 26371 catalog_manager.cc:5697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.040931 26371 catalog_manager.cc:5697] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 8 to 13, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 13 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.047981  1279 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:55.049347  1515 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:55.049755  1515 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:55.050884  1515 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.052337  1515 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:55.055125  1629 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 12:12:55.039366 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 100909us
I20260709 12:12:55.060596 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:55.018743  1632 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:55.063275 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:55.065305 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:55.067183 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:55.067641 26619 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:55.069209 26620 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:55.071734 26618 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:55.069126 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:55.073706  1279 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:55.074165  1279 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:55.074589  1279 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:55.075956 27162 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:12:55.077441 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:55.082837 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:55.083097 26371 catalog_manager.cc:5697] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 14 to 15, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 15 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:12:55.085812  1051 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:55.087041 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:55.087580  1588 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:55.093186 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:55.094974 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:55.094954 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:55.100143  1439 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:55.100785  1439 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:55.105563 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:55.109751 26617 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:55.111783  1630 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:55.101819  1439 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.057478  1322 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:55.118438 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:55.119206 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:55.120476 26371 catalog_manager.cc:5697] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 13 to 14, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 14 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:12:55.065025  1632 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.123308  1632 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:55.126132 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:55.127182  1437 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:12:55.127732  1437 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.127661  1371 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:55.129271 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 69311.1us
W20260709 12:12:55.130242 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44755.1us
I20260709 12:12:55.128443  1437 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:12:55.140991 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 245601us
I20260709 12:12:55.143677 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:55.147094  1355 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:55.190580  1355 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.191164  1355 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:55.138017  1530 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:12:55.191555  1426 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:55.192556  1426 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:55.192937  1426 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:55.160831  1369 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.047s
I20260709 12:12:55.189128 26371 catalog_manager.cc:5697] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 12 to 14, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 14 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.159377 26514 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:55.215909 26371 catalog_manager.cc:5697] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 8 to 13, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 13 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
W20260709 12:12:55.223578 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52898.9us
I20260709 12:12:55.211338  1597 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:55.228423 26371 catalog_manager.cc:5697] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 13 to 20. New cstate: current_term: 20 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.235157 26371 catalog_manager.cc:5697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:55.239975 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 92552.9us
I20260709 12:12:55.152467  1374 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.070s
I20260709 12:12:55.150094  1499 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.072s
I20260709 12:12:55.229740  1437 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.245114 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:55.249519 26613 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 20. Current term is 21. Ops: []
W20260709 12:12:55.250322 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 193501us
I20260709 12:12:55.241531  1439 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:55.251147 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:55.257079  1635 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.106s	user 0.002s	sys 0.000s
I20260709 12:12:55.259989 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:55.226017  1456 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:55.266878 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:55.267818  1439 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:55.268187  1051 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:55.260514  1530 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:55.269435  1530 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:55.264773  1103 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:55.271046  1103 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:55.273422  1103 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:55.268996  1439 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.275861  1437 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:55.276187  1640 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.082s	user 0.004s	sys 0.000s
I20260709 12:12:55.232314  1426 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:55.277515  1426 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:55.268955  1643 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.281590 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:55.263353  1499 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:12:55.277868  1638 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:12:55.303869 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:55.312510 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48778.1us
I20260709 12:12:55.316308  1437 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:55.316934  1437 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:55.317421  1437 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:55.329146  1437 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.336275  1437 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:55.339854  1511 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.296844  1499 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.343509  1456 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:55.346735 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:55.347267  1597 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:55.350605 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:55.351433 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 96829.4us
I20260709 12:12:55.353960  1505 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.354413 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:55.355708  1279 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.356525  1505 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:55.357227  1505 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:55.357951  1279 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:55.358079  1588 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:55.358785  1588 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:55.360186  1588 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.270469  1530 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:55.350492  1644 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:55.366436 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:55.354183 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:55.363482  1530 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:55.363432  1588 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:55.386672 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:55.313191  1371 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:55.342283  1511 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:55.343510  1499 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:55.401652 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:55.370730  1644 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:55.410779 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 44460.7us
I20260709 12:12:55.411834 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:55.412698  1437 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:55.413166  1437 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:55.413653  1437 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:55.414472  1568 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:55.415153  1568 raft_consensus.cc:697] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:55.416271  1568 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:55.418553  1633 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:12:55.422497  1597 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:55.422916  1437 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.425362  1437 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:55.384660  1103 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.398602  1185 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.339869  1355 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:55.408453  1644 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:55.415056  1382 raft_consensus.cc:2764] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
W20260709 12:12:55.434695 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 80656.3us
I20260709 12:12:55.436715 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:55.438341 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:55.313589  1643 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.413095 26587 leader_election.cc:400] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22.
W20260709 12:12:55.445930 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 194865us
I20260709 12:12:55.451180 26587 leader_election.cc:403] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:55.450942 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:55.450856 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 65239.6us
I20260709 12:12:55.448040 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:55.450115 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:55.453714 26620 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 22: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:55.458173 26613 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 26 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 12:12:55.459462 26619 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24. Ops: []
W20260709 12:12:55.442219  1566 consensus_meta.cc:287] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.003s
W20260709 12:12:55.468374 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55514.9us
I20260709 12:12:55.468904 26620 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 21. Current term is 22. Ops: []
W20260709 12:12:55.471385 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 81440.1us
I20260709 12:12:55.457183 26617 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:55.437978  1632 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:55.476477  1371 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:55.470523  1437 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22.
W20260709 12:12:55.493153 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:55.495563 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:55.451032  1103 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:55.502732 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:55.503629 27164 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 24: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:55.497327  1654 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:55.506253  1654 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:55.507362  1654 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:55.508566 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:55.511817 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:55.475158  1322 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.471323  1185 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:55.531720  1574 consensus_meta.cc:287] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.001s
I20260709 12:12:55.493726  1439 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:55.532482  1351 consensus_meta.cc:287] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.004s
I20260709 12:12:55.495785  1371 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.475452  1566 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:55.535526  1643 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:55.480628  1653 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 12:12:55.488885  1511 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.541849 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:55.544401 26617 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:12:55.544006 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:55.550244 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:55.550159 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:55.552663 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:55.555199 27167 raft_consensus.cc:2410] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 12:12:55.550750 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:55.557988 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:55.556082 27160 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:55.559540 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:55.563319  1103 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:55.538543  1279 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:55.564440  1279 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.567203  1355 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:55.568017  1371 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:55.551344  1511 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.539601  1654 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:55.542552  1515 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:55.529565  1456 consensus_queue.cc:1059] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 12:12:55.577725 27160 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
W20260709 12:12:55.581513 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 73145.5us
I20260709 12:12:55.584084  1650 consensus_queue.cc:1059] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:55.585543  1185 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:55.587139  1649 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:55.587821  1574 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:55.604745  1647 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.547631  1439 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:55.605491  1647 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:55.607685  1439 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:55.594707  1456 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:55.608721  1456 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:55.610044  1456 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.611858  1456 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:55.595832  1279 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:55.612540  1647 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:55.608978 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:55.596415  1633 raft_consensus.cc:3055] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:55.596892 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:55.598497  1382 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:55.604027  1632 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:55.547961  1351 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:55.616523 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:55.635933 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:55.584131  1566 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:55.598845 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 79559.3us
W20260709 12:12:55.635661 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 73400.1us
W20260709 12:12:55.633071 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 89609us
I20260709 12:12:55.553823  1643 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 12:12:55.636616 26615 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:55.595391  1322 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:55.666147 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:55.667724 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:55.668555  1665 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.669165  1665 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.671509  1665 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:55.635630  1511 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:55.639149  1437 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:55.673976  1437 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.627332  1633 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:55.675866 26617 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:12:55.676642  1643 raft_consensus.cc:3055] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:12:55.681094 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 45557.4us
I20260709 12:12:55.681945 26614 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:55.593492  1515 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:55.685864 26615 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:55.663267 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:55.680217 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:55.687580 26619 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:12:55.690332  1633 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:55.691648  1633 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:55.694483  1530 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:55.696434 27168 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:55.697491 26615 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:55.699577 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:55.702070  1322 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:55.702224  1511 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:55.637662  1355 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.702726  1322 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.703218  1355 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.703692  1351 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:55.705099  1511 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:55.705381  1322 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:55.706248  1511 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:55.710979  1355 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:55.711316  1499 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.713733  1499 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:55.714570 26620 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:55.715618 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:55.701057 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:55.681910  1437 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:55.728036 26439 leader_election.cc:400] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25.
I20260709 12:12:55.730119 26439 leader_election.cc:403] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:55.684432  1643 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:55.734071 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:55.739171 26542 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:55.740288  1051 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:55.741040  1665 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:55.741590 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:55.742719  1647 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25.
I20260709 12:12:55.743438 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:55.742041 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:55.786813 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 63946.6us
W20260709 12:12:55.795101 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 61151.9us
I20260709 12:12:55.687072  1568 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 12:12:55.798249 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:55.799301 26545 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:55.727511  1351 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:55.800282 27134 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:55.806494 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:55.813191  1658 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:55.813771  1658 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.814184  1658 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:55.810745  1566 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:55.815004  1566 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:55.816030  1566 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.818722 26615 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:55.821653  1322 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:55.822736 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:55.823638 26548 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 24: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:55.824401  1439 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:55.824826  1611 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:55.824510  1658 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:55.826118 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 91484.3us
I20260709 12:12:55.828402  1597 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:55.829418  1499 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:55.829788 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:55.830508 26617 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:55.830962 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:55.831658 26464 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:12:55.833509 26466 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: [21.13-23.14]
I20260709 12:12:55.837240 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:55.837956 26471 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:12:55.829795  1499 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:55.840605  1499 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.841159 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:55.841853 26466 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:55.833113 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:55.842759 26467 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:55.833797  1566 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:55.801328  1351 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:55.845883  1351 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:55.800405  1665 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:55.850900 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:55.851768 26548 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:12:55.851408  1665 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.795507  1662 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:55.855055  1662 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.858006 26466 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:12:55.855448  1662 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:55.858804  1611 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:55.842185  1499 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:55.876756 26545 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:12:55.882306 26544 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:55.881989 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:55.882956 27162 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:55.883931 26514 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:12:55.885859 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 143859us
I20260709 12:12:55.887553 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:55.898154 26467 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:12:55.901013 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:55.908259 26539 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 23: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:55.909374 26617 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:12:55.909890 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:55.910887 26547 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 24: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:55.914149 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:55.914330 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:55.914665 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:55.915058 27167 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:55.915217 26468 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:55.916265 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:55.917397  1649 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:55.917340 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:55.872575  1611 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.918505  1647 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:55.918980 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:55.919701 26539 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:55.924918 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:55.925112 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:55.925776 26470 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 29
I20260709 12:12:55.926131 26465 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:55.926566 26465 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:12:55.927711  1664 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:12:55.928702 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:55.930708 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:55.913125 26546 pending_rounds.cc:85] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 10
I20260709 12:12:55.931957 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:55.930912 26543 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:55.934686 26539 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:12:55.874615  1630 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:55.933087 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:55.938540 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:55.940971 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:55.941351 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45893.1us
I20260709 12:12:55.938421 26541 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:12:55.943399 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:55.943303 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:55.943725 26471 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:55.944171 26547 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:55.944276 26539 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:12:55.945158 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:55.946832 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 63053.1us
I20260709 12:12:55.947543 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:55.948297  1456 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.948926 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:55.948879  1456 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.949716 26543 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:12:55.939733  1437 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.951049 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:55.951790 26543 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:55.952323  1437 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:55.952996 26543 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:55.931649 26546 pending_rounds.cc:107] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:12:55.955473 26546 raft_consensus.cc:2889] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:55.956411 26470 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:12:55.957998 26539 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:12:55.959151 26539 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:12:55.959542 27162 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:12:55.963006 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:55.963738 26467 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:12:55.965283 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:55.965948 26472 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 25
I20260709 12:12:55.919044  1647 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:55.974012 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:55.970901 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 227553us
I20260709 12:12:55.972515 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:55.973694  1643 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:55.975598 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:55.978919 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:55.979554  1515 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:55.979951 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:55.981055 26548 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 12:12:56.000877 26541 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:55.945928  1322 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 12:12:56.003824 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:55.882855  1382 consensus_queue.cc:1059] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.082s
I20260709 12:12:55.995365 26468 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:12:56.001078 26548 pending_rounds.cc:85] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 11
I20260709 12:12:56.014343 26469 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:12:56.014511 26548 pending_rounds.cc:107] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 12:12:56.015031 26548 raft_consensus.cc:2889] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:56.015909 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:56.016644 26469 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:12:56.016845 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:56.017539 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:55.906338  1644 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:56.018138 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:56.023507 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 90185.9us
I20260709 12:12:56.018200 26469 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:56.026805 26468 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:12:56.000854  1647 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:55.972199  1355 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:55.966593  1630 raft_consensus.cc:697] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 18 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:56.039856 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:56.046293 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 73825.1us
I20260709 12:12:56.047600 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:56.050740 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:56.055008 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:56.056542 26473 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:56.059449  1660 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:56.058548  1515 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 12:12:56.041466  1568 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:56.067781 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:56.018579  1658 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:56.069147 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:56.055925 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:56.071347  1665 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:55.982311  1662 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:56.075325 26547 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:12:56.075624 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:56.078346 26464 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:56.082476 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:56.082427 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:56.086591  1585 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:56.087083 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:56.087963  1663 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:56.088563 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:56.088639  1663 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:56.057829  1588 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.090025 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:56.093883 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:56.097076 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:56.091228 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:56.097671 26470 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:56.097864 26468 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
W20260709 12:12:56.097718 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 45892.1us
I20260709 12:12:56.105556  1644 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:56.108069 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.112412  1663 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:56.115720 26469 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:56.115502 27164 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:56.117587 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:56.121860 26472 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:12:56.121642 26541 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:56.076360  1355 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:56.135710  1662 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:56.136546 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:56.137804  1667 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 0.238s	user 0.004s	sys 0.000s
I20260709 12:12:56.137722  1355 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:12:56.138906 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 93280.5us
I20260709 12:12:56.139794  1051 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.140061 26439 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:56.115272  1439 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:56.144249 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:12:56.147264 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 174475us
W20260709 12:12:56.151008 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 59911.5us
I20260709 12:12:56.152310  1103 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:56.152861  1103 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:56.153275  1103 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:56.154834 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:56.115497  1505 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:56.145306  1611 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.133394  1585 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:12:56.186594 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 69100.6us
I20260709 12:12:56.200357 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:56.202541 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 53497.3us
I20260709 12:12:56.185334  1371 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:56.121847  1588 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:56.175802  1322 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:56.174095  1439 raft_consensus.cc:697] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:56.191740  1644 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.192332  1585 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.192102  1511 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:56.157986  1051 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:56.218998 26513 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:56.229878 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:56.230917 26473 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:12:56.229192 26464 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:12:56.231727 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:56.234819 26470 raft_consensus.cc:2410] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 12:12:56.217042  1505 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.222689  1355 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:12:56.248124 26473 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:12:56.185441  1630 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:56.227008  1585 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:56.226984  1371 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:56.199997  1611 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:56.252188 26471 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:56.244414 26465 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:56.254536 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:56.255180 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 115274us
I20260709 12:12:56.250133  1651 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:56.266438 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:56.270936 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:56.226282  1662 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.029s
I20260709 12:12:56.227303  1644 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:56.281947 26513 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:56.285746 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:56.287880 26619 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 24: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:56.257826  1322 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:56.286341 26465 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:56.289096 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:56.298205 27164 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:12:56.293066 26439 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:56.294098  1665 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:56.294768  1611 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:56.251489  1505 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:56.296718 27165 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:56.303273 26469 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
W20260709 12:12:56.304592  1677 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:12:56.304989  1678 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:12:56.304253  1371 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:56.301596  1647 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:56.283638  1682 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:56.295964  1499 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:56.308701  1351 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:56.346982  1499 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:56.348166  1499 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:56.349454  1351 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:56.302358  1439 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:56.329548  1511 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:56.350956  1511 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:56.320333  1588 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:56.354820  1588 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:12:56.355631  1588 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:56.353356  1511 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:56.356240  1588 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:56.356734  1426 raft_consensus.cc:3055] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:56.357234  1426 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:56.323096  1644 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:12:56.330436 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 102333us
I20260709 12:12:56.269222  1382 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 12:12:56.360209  1382 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:56.360657  1382 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:56.360906 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:56.362839  1456 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:56.363507 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 70530.5us
I20260709 12:12:56.363709  1682 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:56.365688 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:56.336267  1649 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:56.336807  1663 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:56.367605 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:56.302827  1322 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.344709  1505 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:56.377353  1322 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:56.383164 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:56.384016 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:56.384392  1643 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:56.385666  1588 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:56.386234 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:56.389658 26468 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
I20260709 12:12:56.324618  1665 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:56.390697 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:56.391302 26468 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:56.392879  1665 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:56.396178  1649 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:56.396628  1051 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:56.358273  1426 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:56.398370  1426 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:56.398602 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:56.366026  1647 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:56.403223 26439 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:56.403604 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:56.404458 26473 raft_consensus.cc:2368] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 20. Current term is 21.
I20260709 12:12:56.404721 26439 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:56.405405 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:56.405471  1663 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:56.406114 26473 raft_consensus.cc:2376] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21. Re-sending same reply.
I20260709 12:12:56.361656  1382 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:56.413800 27133 leader_election.cc:336] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.537s (SENT)
I20260709 12:12:56.440495 26465 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 15. (term mismatch)
I20260709 12:12:56.444252 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:56.446795 26465 pending_rounds.cc:85] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 14
I20260709 12:12:56.447343 26465 pending_rounds.cc:107] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 23.15
I20260709 12:12:56.447672 26465 raft_consensus.cc:2889] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:56.449991 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:56.460662 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:56.461097 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 179285us
W20260709 12:12:56.461490 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.462240 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:56.466181 26469 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:56.430768  1649 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:56.468827 26468 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:12:56.431820  1650 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.442970  1351 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:56.439536  1355 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:56.463424  1515 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 24 current term: 24 is higher.
W20260709 12:12:56.472524 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 287253us
I20260709 12:12:56.473263 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:56.488534 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 83935us
I20260709 12:12:56.489351 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:56.471583  1665 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:56.460029  1662 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:56.473133  1588 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:56.483280  1382 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:56.474094  1351 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:56.503691 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:56.475425  1651 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:12:56.506801 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 93074.1us
I20260709 12:12:56.516464 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:56.498796  1647 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:56.519817  1355 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:56.520093 26439 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:56.520344  1355 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.520833  1355 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:12:56.507817 27133 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.620s (SENT) [suppressed 12 similar messages]
I20260709 12:12:56.474267  1650 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:56.555617 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 47844.7us
I20260709 12:12:56.557257 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:12:56.565917 27133 leader_election.cc:336] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.681s (SENT)
I20260709 12:12:56.506026  1351 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:56.537014  1649 raft_consensus.cc:2764] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election decision vote started in defunct term 27: won
I20260709 12:12:56.508219  1371 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:56.575349  1371 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.575847  1371 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:56.567404 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:56.567287 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:56.541067  1588 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:12:56.587316 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 47981us
I20260709 12:12:56.592231 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:56.593276 26547 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: []
W20260709 12:12:56.590018 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 49125.6us
I20260709 12:12:56.506516  1103 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:56.599738 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:56.599895 26545 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:56.602792 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:56.582501  1650 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:56.602792 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:56.619777 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:56.620415 26439 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:56.582108  1051 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
W20260709 12:12:56.624789 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 58899.1us
I20260709 12:12:56.632550 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:56.633795 26542 raft_consensus.cc:2410] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 28 because replica has last-logged OpId of term: 26 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 13.
I20260709 12:12:56.595127  1688 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:56.624249  1697 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
W20260709 12:12:56.642374 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 73374.7us
W20260709 12:12:56.669415 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.637777  1568 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.701254  1696 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:56.792826 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:56.686874 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:56.635747  1588 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:12:56.770144  1692 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:12:56.738013  1322 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:56.811435  1702 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.818806  1702 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:56.820292 26541 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:12:56.684679 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.685762  1630 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.635898  1585 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:56.739775  1103 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:56.634353  1651 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:56.701740 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 81427.6us
I20260709 12:12:56.836782 26439 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:56.683935  1515 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:56.785696 26540 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:56.791899  1371 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:56.751885 26466 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
W20260709 12:12:56.805727 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 238376us
W20260709 12:12:56.754745 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 189538us
I20260709 12:12:56.814113 26620 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:12:56.819500  1322 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:56.685138 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:56.789093  1351 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:56.840242 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:56.836386  1588 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 25 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:56.816437  1696 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.862567  1702 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:56.863070 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:56.863576  1351 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:56.864704 26544 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:56.842821 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:56.866097 26540 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:56.816840  1568 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:56.862596 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:56.853621  1279 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:56.868777 26467 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:56.844377 27134 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:56.869621  1585 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:56.853277 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:56.871472 27133 leader_election.cc:336] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.850s (SENT)
I20260709 12:12:56.871803  1688 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:56.872341  1688 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.872713  1688 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:56.872655  1588 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:56.857085 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:56.862613  1696 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:56.875423  1632 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:56.864707 26545 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:56.875916  1632 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:56.877009  1632 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:56.878803 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:56.879731 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:56.880143 26539 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:56.880317  1662 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.880999  1662 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:56.884182 26439 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:56.883805  1662 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:56.886606  1279 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:56.887409  1371 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:56.858441 26542 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 24: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:56.858349 26469 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:56.860363 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:56.837941  1630 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:56.903702 26464 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:56.861182 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:56.905160 26473 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:56.861922 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:56.906102 26471 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:56.868171  1568 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:56.843606  1660 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:56.893425 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:56.907552 26469 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:56.898018 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:56.871942 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:56.890847 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:56.878139  1632 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:56.889230 26439 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:56.836117  1697 consensus_queue.cc:1243] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 22.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:12:56.815728  1355 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:56.911550 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:56.871809  1694 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.230s	user 0.002s	sys 0.000s
I20260709 12:12:56.927943 26472 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:12:56.928267 26619 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:56.919166 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:56.930718  1351 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.899699  1702 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:12:56.937112 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 46393.9us
I20260709 12:12:56.937146 26469 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
W20260709 12:12:56.935807 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 46669.2us
I20260709 12:12:56.910339  1611 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:56.943228 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:56.910452  1382 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.952251 26541 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:56.951498 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:56.930884  1426 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:56.957384 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:56.933656  1665 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:56.965637 26473 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:56.945722  1568 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:56.974594 26513 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:56.988333 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 116905us
W20260709 12:12:56.989145 27133 leader_election.cc:336] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 2.030s (SENT)
I20260709 12:12:56.989589 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:56.987027 26439 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:56.945675  1703 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:12:56.991851 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:56.992913 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:56.961325  1707 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:12:56.993881  1653 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:56.952637  1351 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:57.008623 26541 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:56.985198  1568 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.956993  1647 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 12:12:57.017676  1611 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:56.959957  1382 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:57.018790 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:57.037880 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:56.991173  1689 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:57.026974 27165 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:57.035423 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:57.019381  1568 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:57.022981  1697 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 12:12:57.041378  1710 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:12:57.045717  1515 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:57.046566 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:57.030442  1643 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:12:57.014987  1702 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:12:57.048878 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 97469.8us
I20260709 12:12:57.077610 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:57.017170  1707 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:57.088876 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:57.036885 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:57.099422  1647 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:57.140961  1647 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:57.142045  1647 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:57.142640  1426 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:12:57.143219  1647 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:57.131789 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:57.099686  1723 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:57.149657  1723 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:57.150098  1723 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:56.994369  1505 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
W20260709 12:12:57.101181 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 114282us
I20260709 12:12:57.154618 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:57.154953 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:57.154522 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:57.155465  1716 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:12:57.156783  1437 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:57.157315  1437 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:57.160954 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:57.161666 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:57.162376 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:57.163443 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:57.165022 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:57.127368  1718 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 12:12:57.173130  1351 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:57.178258  1611 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:57.178717  1707 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:57.077512  1697 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.108117 26542 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:56.957906  1690 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:12:57.114923  1103 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:57.206979 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:57.208365 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:57.208874  1715 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:12:57.209182 26618 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:57.206717 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:57.194412  1437 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:57.212227 26613 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:57.212476  1437 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:57.129894 26615 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:57.137148 26617 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:57.216773  1630 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:57.217677 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:57.217852  1721 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:12:57.218761 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:57.046725  1686 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.238s
I20260709 12:12:57.048170  1689 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.140044  1717 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:12:57.140414 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 103627us
I20260709 12:12:57.151046  1723 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:57.184092 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:57.104499 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:57.189694 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:57.194681 26468 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:12:57.202086 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:57.194206  1660 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.202860 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:57.258535 26467 raft_consensus.cc:2376] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18. Re-sending same reply.
I20260709 12:12:57.206637  1351 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:12:57.210700 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:57.224499 27162 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 12:12:57.200393 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 68712.3us
I20260709 12:12:57.224794 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:57.255560 26469 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:12:57.256290 26616 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:57.262581 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:57.263597 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:57.264294 26542 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:12:57.267021 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:57.268018 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:57.268872 26469 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 19: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:57.269412 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:57.138722 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:57.230319 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:57.274377 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:57.275399 26543 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:57.279031 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:57.279898 26543 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:12:57.255002 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 150636us
I20260709 12:12:57.282775 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:57.222292  1355 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:57.236408 26613 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:57.236506 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:57.199841  1697 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:12:57.284740 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 61407.2us
I20260709 12:12:57.287281 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:57.299118 26614 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:57.291239  1647 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:57.259877 27165 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:12:57.300089 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:57.300704 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:57.290287 26542 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:12:57.291594 26546 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 19: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:57.301635 26545 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:12:57.291819 26620 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 21: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:57.292518 26472 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:12:57.303606 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:57.304335 26472 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:57.210107 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:57.305401 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:57.306746 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:57.238155  1689 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:57.307225 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.296933 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:57.307337 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:57.308717 26467 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:12:57.309504 26470 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:57.296228 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:57.307142 26616 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:57.308750 26540 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 23: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:57.308708 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:57.231297 26471 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:57.315095 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:57.267781  1643 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 12:12:57.325290 27133 leader_election.cc:336] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 2.073s (SENT)
I20260709 12:12:57.328622 26465 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:57.202135  1566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.011s	sys 0.025s
I20260709 12:12:57.284343  1597 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 12:12:57.340385 26466 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:12:57.345152 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.348624 26514 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:12:57.351323 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55171us
I20260709 12:12:57.352205 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:57.361424 26620 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:57.306830  1351 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:57.369647 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:57.363833 26472 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:12:57.357288 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:57.366076 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:57.367127  1722 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:57.284525  1660 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:57.380916 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:57.341012  1566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.012s	sys 0.025s
I20260709 12:12:57.298043  1279 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 12:12:57.382969 26466 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 20.
I20260709 12:12:57.386138 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:57.338166  1355 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:57.338457  1103 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:57.389168 26472 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:12:57.359890  1663 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:57.361230  1643 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:57.371930  1439 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:57.370308  1649 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:57.370569  1708 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:57.389446  1686 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.389663  1505 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:57.400741  1647 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:12:57.418211  1696 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.539s	user 0.012s	sys 0.000s
I20260709 12:12:57.431640 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:57.427628  1650 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:57.435276  1279 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:57.442888  1663 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:57.409207  1103 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:57.450249  1505 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:57.466287 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 91511.7us
I20260709 12:12:57.411953  1355 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:57.476749 26617 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:57.477126 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:57.403880  1702 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:57.470525  1426 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:12:57.455400  1696 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:57.486059 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 177407us
I20260709 12:12:57.491285 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:57.453293  1686 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:57.467644  1663 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:57.495201  1663 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:57.496896  1663 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:12:57.485013 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 115435us
I20260709 12:12:57.470858  1505 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:57.486758 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 120816us
I20260709 12:12:57.517225  1703 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:57.520668 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:57.472407  1382 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:57.527422 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:57.530365 27165 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:12:57.530927 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:57.533216 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:57.483777  1653 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:57.468457  1650 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:57.546885 26622 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 24: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:57.484467  1643 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:57.549626 26543 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:12:57.558192 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:57.559286 27165 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:57.541868  1703 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:57.541258  1699 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:57.544711  1653 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.483377  1662 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 12:12:57.568190  1696 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:57.476033  1351 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:57.570701  1729 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:12:57.573104 27162 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
W20260709 12:12:57.587715 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 53033.9us
I20260709 12:12:57.539623  1727 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.189s
I20260709 12:12:57.581116  1653 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:57.625607 27162 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:12:57.592501  1699 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:57.580924  1505 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:57.640942 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:12:57.644882 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:57.648029 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:57.649102 26543 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:12:57.615224  1690 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:57.617467  1660 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:57.646488 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:12:57.658322 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:57.605460  1499 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:12:57.679970 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:57.665838 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 62610us
I20260709 12:12:57.628182  1696 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:12:57.684650 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:57.656598  1103 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:57.660634  1660 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:57.704221  1717 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:57.704733  1717 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.705082  1717 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:57.706486  1725 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
W20260709 12:12:57.707652  1730 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
W20260709 12:12:57.709434  1739 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:12:57.627719  1643 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:57.710235 27165 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:57.686241  1662 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:57.698325 26618 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:12:57.716069 26618 pending_rounds.cc:85] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 12
I20260709 12:12:57.716414 26618 pending_rounds.cc:107] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:12:57.684646  1707 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:57.716749 26618 raft_consensus.cc:2889] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:57.656874  1611 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:57.689713  1703 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:57.656659  1690 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:57.724197  1703 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.733711  1703 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:57.721339  1103 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
W20260709 12:12:57.736867  1632 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.806s	user 0.012s	sys 0.002s
I20260709 12:12:57.737203  1745 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:12:57.739001  1733 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:12:57.741204 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:57.707664  1505 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:57.715921  1662 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.710106  1734 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 12:12:57.721096  1439 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:57.750178 27164 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:12:57.741200  1707 raft_consensus.cc:697] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:57.720762  1660 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:57.743430  1355 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:57.744824  1745 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:12:57.772260 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 87737.6us
I20260709 12:12:57.761561  1662 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:57.768487  1505 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:57.792513  1505 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:57.792846  1653 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:57.793727  1505 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:57.795593  1568 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.683s	user 0.005s	sys 0.007s
I20260709 12:12:57.796083  1568 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:57.797876  1745 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:57.798720 26539 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 21: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:57.799222  1745 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:57.800467  1643 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:57.801123  1643 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:57.802874  1688 consensus_meta.cc:287] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.930s	user 0.006s	sys 0.010s
I20260709 12:12:57.778586  1439 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.803658  1643 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:57.803593  1688 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:57.803761  1439 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:57.804843  1660 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:57.776818  1355 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:57.782999  1735 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
W20260709 12:12:57.783672  1726 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 12:12:57.775312 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:57.766326  1650 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:57.803004  1747 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 12:12:57.781106  1437 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.003s
I20260709 12:12:57.724541  1699 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:57.781781  1689 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:57.833360 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 92241.1us
W20260709 12:12:57.834275 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 59033.3us
I20260709 12:12:57.807948  1355 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:57.841634 26464 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:57.834527 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 188197us
I20260709 12:12:57.843135 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:57.825784  1568 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:57.847352 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:57.847985 26464 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 23: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:57.849514 27165 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:57.851702 26466 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 12:12:57.852075 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:57.849678 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:57.854739 26470 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 24: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:12:57.852854 26514 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:57.858857 26540 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:57.858425 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:57.860590 27162 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:57.845526  1688 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:57.847000  1439 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:57.838656  1707 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:57.886749 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:57.926331 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 73537.6us
I20260709 12:12:57.878557 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:57.913861 27162 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:12:57.907898 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:57.887534 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:57.928553 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 63943.4us
I20260709 12:12:57.927942 26618 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:57.941665 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:57.942912 26618 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:12:57.945423 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:57.946182 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:57.940207 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:57.872689  1731 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.394s	user 0.001s	sys 0.000s
I20260709 12:12:57.887617  1720 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:57.948592  1630 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.067s
I20260709 12:12:58.014726  1708 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:58.017052  1743 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:57.866802  1653 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:57.894644  1650 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:57.853853  1744 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.081s
I20260709 12:12:57.887058  1690 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:57.849951  1702 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.094s
W20260709 12:12:58.013031 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 105221us
I20260709 12:12:58.031667 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3150) took 1039 ms. Trace:
I20260709 12:12:58.032222 26539 rpcz_store.cc:276] 0709 12:12:56.992365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.992641 (+   276us) service_pool.cc:224] Handling call
0709 12:12:58.031358 (+1038717us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b54002f8ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:58.031561 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1843790080}
I20260709 12:12:57.934624  1103 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:58.033960  1103 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:58.035118  1103 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:58.015187  1720 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.017795  1743 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:57.951217 26514 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:12:58.059778 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 108689us
I20260709 12:12:58.060866 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:58.019488  1650 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.054342 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:58.065945 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:57.923338  1703 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.022663  1688 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:58.058885  1720 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:58.083009 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:12:57.890014  1355 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:58.143114 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 60209.2us
I20260709 12:12:58.066943  1439 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:12:58.162883 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:58.071997  1660 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:58.161298  1735 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.072965  1650 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:58.194068 26473 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 24 index: 20. (index mismatch)
I20260709 12:12:58.156033  1051 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:58.157358  1568 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.211411  1568 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.171914  1439 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.214697  1439 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:58.072194  1505 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.115s
I20260709 12:12:58.177419  1660 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:58.226356  1660 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:58.186908  1279 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:58.202574  1746 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.202843  1759 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:12:58.230594  1279 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:58.230652  1746 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.141469  1688 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:58.239073  1686 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:58.204495  1697 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.873s	user 0.014s	sys 0.000s
I20260709 12:12:58.207991  1703 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:58.210697  1051 raft_consensus.cc:697] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:58.165117  1611 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:58.245698 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:58.265645 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:58.188907  1351 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:12:58.269676 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:58.278306 26466 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:58.247900  1702 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:58.272708 26613 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:12:58.283982 26514 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:58.250484  1568 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:58.258901  1764 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:58.188488  1735 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.252281  1697 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.285607  1351 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:58.291038  1103 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:12:58.310225  1745 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.508s	user 0.013s	sys 0.000s
I20260709 12:12:58.326988 26621 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 28: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:58.288506  1702 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:58.316556  1632 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.320544  1103 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.328784  1688 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:58.327796  1705 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:58.330662  1746 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:58.356748 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3007) took 1089 ms. Trace:
I20260709 12:12:58.362140 26466 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:12:58.343111  1103 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:58.329103  1662 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:58.365922  1743 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:58.296403  1764 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:58.369946  1717 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.664s	user 0.013s	sys 0.001s
I20260709 12:12:58.357501 26467 rpcz_store.cc:276] 0709 12:12:57.267641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.309416 (+ 41775us) service_pool.cc:224] Handling call
0709 12:12:57.339732 (+ 30316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:57.339950 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:57.339972 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:57.361089 (+ 21117us) log.cc:844] Serialized 26 byte log entry
0709 12:12:57.545691 (+184602us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:12:57.560597 (+ 14906us) log.cc:844] Serialized 14 byte log entry
0709 12:12:57.892309 (+331712us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b180048f280. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:12:58.354866 (+462557us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b180048f280. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fbb2a6 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f5076055733 00007f50760dadbf 00007f50760d983e
0709 12:12:58.356021 (+  1155us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b5400287920. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f5076055733 00007f50760dadbf 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c
0709 12:12:58.356152 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:58.356299 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:58.356376 (+    77us) raft_consensus.cc:1685] finished
0709 12:12:58.356398 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:58.356642 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20616,"prepare.queue_time_us":14720,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":2347,"raft.queue_time_us":20820,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":7834,"spinlock_wait_cycles":55826816,"thread_start_us":118332,"threads_started":1,"wal-append.queue_time_us":165300}
W20260709 12:12:58.378018  1766 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:12:58.408057  1663 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.408746  1663 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:58.379964  1662 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:58.369330  1279 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:58.322275  1051 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:58.342279  1632 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:58.320349  1611 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.385519  1702 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:58.387926  1499 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.389720 26470 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:58.390564  1699 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.392696 26617 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:58.392972 26619 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:58.393455 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:58.438259 26620 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:12:58.395944 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:12:58.439929 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 928254us
I20260709 12:12:58.440825 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:58.398695  1735 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:58.401021  1597 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:58.375746  1351 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.387939 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:58.420596  1103 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.372462  1744 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:12:58.451695 26466 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
W20260709 12:12:58.467690 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 64776us
I20260709 12:12:58.431309  1647 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.438634  1751 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:58.411556  1717 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.468173  1735 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:58.430583  1705 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.045s
I20260709 12:12:58.471536  1279 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:12:58.485390 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52640.8us
I20260709 12:12:58.441665  1499 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.454483  1699 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.477298  1597 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:58.490334  1499 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:58.478677  1647 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.512413  1649 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:58.512874  1649 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:12:58.491940  1740 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 1.014s	user 0.003s	sys 0.000s
I20260709 12:12:58.492488  1515 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.493324  1720 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:58.494263  1777 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.495035  1723 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:58.498832 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:58.483583  1703 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 12:12:58.479769  1696 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.041s
I20260709 12:12:58.513862  1103 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:58.471174  1744 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.510682  1597 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:58.513595  1647 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:58.527556  1735 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:58.501531  1697 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:58.549276  1632 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:58.551381  1744 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:58.484722  1751 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.559262 26618 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:58.560796 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:58.513675  1649 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.562326 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:58.562603 26613 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:12:58.530853  1515 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.576596 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:12:58.576831 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 136092us
I20260709 12:12:58.577759 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:58.578001 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:58.579722 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:58.581308 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:58.582252 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:58.558221  1764 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:58.588461 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:58.594254 27160 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:58.538239  1777 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.596752 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:58.606721 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:58.572734  1663 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:58.565197  1279 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 19 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:58.640336  1699 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:58.558874  1735 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.640959  1751 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:58.641841 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45235.2us
I20260709 12:12:58.642534  1735 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:58.643136  1735 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:58.643784  1735 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:58.643904  1515 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:58.644320  1735 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 19 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:58.645439  1735 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.646754 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:58.647938  1777 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:58.648072 26513 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:58.648788  1777 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:58.649299  1777 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:58.646107  1515 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:58.587038  1597 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.651569  1597 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:58.653183 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:12:58.654795  1772 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:12:58.657349  1660 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.658656  1649 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:58.658816 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:58.660887 27160 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:58.612493 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:58.660887 27159 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:58.666714 26472 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:58.668299 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:58.670136 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:58.670218 26542 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:58.671383 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:58.671937 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:58.672142 26541 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:12:58.672415 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:58.673044 26543 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:12:58.682686 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1286) took 1409 ms. Trace:
I20260709 12:12:58.693701 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:58.696928 26470 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:58.694315 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:58.694067 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:58.697225 26540 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:12:58.698553 26466 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
I20260709 12:12:58.682839 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:12:58.673627 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 201716us
I20260709 12:12:58.704200 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:58.696758 26615 rpcz_store.cc:276] 0709 12:12:57.259456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.288849 (+ 29393us) service_pool.cc:224] Handling call
0709 12:12:57.289183 (+   334us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:57.327814 (+ 38631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:57.327847 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:57.350612 (+ 22765us) log.cc:844] Serialized 52 byte log entry
0709 12:12:57.476784 (+126172us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:57.476823 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.476891 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:58.491327 (+1014436us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:58.612556 (+121229us) raft_consensus.cc:1685] finished
0709 12:12:58.612584 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:58.669118 (+ 56534us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14682,"raft.queue_time_us":36134,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":3333,"spinlock_wait_cycles":23192320,"thread_start_us":61543,"threads_started":1,"wal-append.queue_time_us":79682}
I20260709 12:12:58.705986 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:58.707679 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:58.708420 26472 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:12:58.709316 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:58.674084  1658 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:12:58.696285  1783 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:12:58.714881 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:58.714692 26513 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:58.674211  1103 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:58.672690  1751 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:58.718700 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:58.720706  1758 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 12:12:58.693377  1051 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:58.729926 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:58.722075  1770 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:58.722342 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:58.719805 26513 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:58.729007 26467 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
W20260709 12:12:58.712293  1650 consensus_meta.cc:287] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.510s	user 0.013s	sys 0.000s
I20260709 12:12:58.650262  1439 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.683817  1688 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 12:12:58.738687 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:58.706039  1690 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.719487 26546 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:12:58.737358 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:58.730707 26544 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
W20260709 12:12:58.734290 26468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 4127) took 1868 ms (client timeout 1578 ms). Trace:
W20260709 12:12:58.740262 26468 rpcz_store.cc:269] 0709 12:12:56.854752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.856821 (+  2069us) service_pool.cc:224] Handling call
0709 12:12:58.723005 (+1866184us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b54001c1454. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:58.723141 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":735666560}
I20260709 12:12:58.683730  1764 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.047s
I20260709 12:12:58.746325  1764 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:58.746788  1764 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:58.747658  1764 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.20, Last appended by leader: 20, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:58.748404  1439 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:58.694973  1760 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 12:12:58.750799  1760 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:58.750612  1690 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.751273  1760 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:58.752293  1760 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:58.753131  1690 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:58.753618  1760 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:58.754583  1660 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:58.760480 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:58.748929  1764 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:58.762960 26470 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
I20260709 12:12:58.759929 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:12:58.776211 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:58.777889 26470 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:58.734520  1658 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:58.781687 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:58.819895 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:58.819653  1658 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.820600 26467 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:12:58.819599  1723 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:12:58.821635 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:58.757820  1279 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.756464  1751 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:58.783535  1789 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:12:58.783875 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:58.831696 26472 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:58.737474  1103 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:58.784188  1705 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:58.775156  1611 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 12:12:58.788064  1651 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:58.787969  1788 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:58.789847 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:58.765549  1439 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:58.736270  1051 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.718647  1351 consensus_queue.cc:1059] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 12:12:58.793229 26473 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 12:12:58.875094 27164 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 992) took 1715 ms (client timeout 2216 ms). Trace:
W20260709 12:12:58.798659 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:58.803040  1689 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:58.888692  1707 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:58.803248 26439 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:58.804593 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3003) took 1538 ms. Trace:
W20260709 12:12:58.808655 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:58.809906  1748 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 1.076s	user 0.003s	sys 0.000s
I20260709 12:12:58.812611  1371 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:58.890887  1371 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:58.891481  1723 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:58.893472  1371 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:58.813171  1660 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.894237  1660 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:58.894801 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:58.896535  1660 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:58.813613  1746 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:58.897133 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:58.813853 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:58.814304 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:58.899329 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:58.899959 26544 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:58.814647 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:58.815006  1749 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:58.758216  1690 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:58.736436  1780 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:58.729800  1499 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:12:58.819527 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:58.826171 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:58.834300  1647 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 12:12:58.758203  1682 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:12:58.870668 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 80919.5us
I20260709 12:12:58.828565  1720 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:58.738307  1650 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:58.880828 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:58.881857  1770 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.881956 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:58.885630  1051 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:58.889194  1707 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:58.889688 26465 rpcz_store.cc:276] 0709 12:12:57.266507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.293214 (+ 26707us) service_pool.cc:224] Handling call
0709 12:12:57.322890 (+ 29676us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:57.329242 (+  6352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:58.804344 (+1475102us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b540025a3d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:58.804525 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12627712}
W20260709 12:12:58.890159 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 87072us
I20260709 12:12:58.897523  1746 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:59.043346 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:58.871313  1759 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:59.046188 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:58.902773 26548 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:12:58.904206 26547 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
W20260709 12:12:58.875823 27164 rpcz_store.cc:269] 0709 12:12:57.154098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.154270 (+   172us) service_pool.cc:224] Handling call
0709 12:12:58.868927 (+1714657us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b540060de54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:58.869099 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1367671552}
I20260709 12:12:58.905516 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:58.905381 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:58.834076  1705 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:58.870992  1756 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:58.907473 26546 raft_consensus.cc:2368] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24.
I20260709 12:12:58.910866 26472 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:12:59.003345  1723 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.863390  1651 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:12:59.003993 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 177889us
I20260709 12:12:59.080590 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:59.080888 26544 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:12:58.797966  1515 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:59.082134 26544 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:59.003544 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:59.003127 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:59.005056 26471 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:58.890196  1611 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:58.901932 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:59.049006 26614 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:12:59.084728 26470 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:59.087210  1103 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:59.048144  1785 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.874279  1788 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:59.041471 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:59.017127 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:59.016978  1790 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:58.911495 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 121992us
I20260709 12:12:59.075628 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:59.076318 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:59.073675  1705 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:59.069434 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:59.049247 26619 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:12:59.092381 26613 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:59.073190 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:59.115456 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:59.130719 26472 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:12:59.017194  1779 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:59.110010 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:59.139358 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:12:59.139842 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 70502.1us
I20260709 12:12:59.105683 26614 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:12:59.097573 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:59.071146  1662 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:59.089701  1651 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:59.096769  1665 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:59.077185  1663 raft_consensus.cc:2764] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 12:12:59.115448  1688 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:59.115746 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:59.117977  1788 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:59.161845 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:59.120303 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:59.124200 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:59.124787  1777 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:58.922694  1749 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:59.017755  1682 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.115180  1611 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:59.147928 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:59.255932 26539 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:12:59.150504 26546 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:12:59.143627 26470 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:59.097013 26540 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:12:59.257984 26616 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
W20260709 12:12:59.154814 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 72961us
W20260709 12:12:59.259400 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 106450us
I20260709 12:12:59.124706  1707 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:59.127280  1751 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:59.264102 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:59.261674 26472 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:12:59.091532  1723 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:59.135072  1779 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.270658 26614 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 21: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:59.271914 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:59.159883 26471 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:12:59.266188  1682 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:59.152238  1795 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:59.146723  1515 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:59.276894 27164 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:12:59.278376 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:59.150820  1665 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:59.287703 26619 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:12:59.079442  1759 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:59.306625 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:59.184677  1662 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:59.039654  1780 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:59.285488 26615 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:12:59.310628 26470 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:12:59.273401 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:59.311204 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:59.310081 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:59.049818  1770 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:59.278754  1597 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.003s
I20260709 12:12:59.317469 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:59.328835 27160 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:12:59.286221  1651 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:59.309167 26540 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:12:59.266157  1735 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.061s
I20260709 12:12:59.346020 26472 raft_consensus.cc:2410] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 19 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:12:59.292466  1779 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:59.356942 26539 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:59.126447  1785 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:59.135749  1790 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:59.269598  1688 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:59.361188 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:59.362377 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:12:59.285858  1751 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.071s
I20260709 12:12:59.330747  1665 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:59.368682 26620 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:59.330956 26614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:12:59.392618 26614 raft_consensus.cc:606] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:12:59.393144 26614 raft_consensus.cc:614] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:59.393424  1793 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 12:12:59.395769  1796 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:12:59.397279  1723 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:59.397517 26464 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 12:12:59.400704  1798 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:12:59.404672  1611 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:59.407510  1785 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:59.409286  1746 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:59.411072  1649 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.752s	user 0.012s	sys 0.001s
I20260709 12:12:59.411844 26469 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:59.415844 26467 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:59.416656 26464 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: [24.20-24.20]
W20260709 12:12:59.419346 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 150083us
I20260709 12:12:59.421908 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:59.420584 26466 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:12:59.360616  1777 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:59.367126  1795 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.434569 26622 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 12:12:59.453446 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 193856us
I20260709 12:12:59.457690 26438 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:59.395851  1759 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:59.472581  1723 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:59.478214 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:59.479269 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:59.480715  1649 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:59.481141  1649 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.481482  1649 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:59.446455  1795 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:59.487315  1805 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:12:59.440460  1777 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:59.489542 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:59.492455 26513 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:59.493430 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:12:59.493716  1770 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:59.494606  1371 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:59.495235  1371 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:12:59.496860  1790 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:59.496486  1371 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:59.498471  1658 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:59.499151  1658 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:59.499234  1780 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:59.499802  1658 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:59.506610  1777 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:59.509446  1688 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:12:59.515314  1801 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:12:59.521394 26613 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:12:59.469568  1650 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:59.526273  1632 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.526576 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:59.627190  1632 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:12:59.627817 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 101356us
I20260709 12:12:59.628738 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:59.629733  1632 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:59.526873 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:59.527493  1662 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:59.630895  1632 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:12:59.631310  1662 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:59.631716  1662 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:59.531442  1515 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:59.537317 26439 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:59.540086 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3024) took 1196 ms. Trace:
I20260709 12:12:59.467227  1663 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:59.554816  1749 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:12:59.555130  1791 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.834s	user 0.000s	sys 0.005s
I20260709 12:12:59.555550  1707 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:59.552206 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:59.559487 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:59.559506 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:59.559711  1723 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:12:59.560479 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:12:59.642735 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:59.561839  1790 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.562489  1803 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:59.562438 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:59.494602  1770 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:12:59.564855 26621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 3285) took 2404 ms (client timeout 1500 ms). Trace:
W20260709 12:12:59.581431 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:59.594437  1665 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:12:59.598099 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 82437.8us
I20260709 12:12:59.628834  1717 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:59.632138  1662 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:59.552161  1705 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:59.670353 27168 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 12:12:59.670670 27160 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
W20260709 12:12:59.636898 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 99699.9us
I20260709 12:12:59.636122  1663 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:59.489380  1795 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:12:59.630110 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:59.640153 26622 raft_consensus.cc:2410] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 12:12:59.681072 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:59.661796 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:12:59.682777 26620 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:12:59.658051 26621 rpcz_store.cc:269] 0709 12:12:57.160478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.160631 (+   153us) service_pool.cc:224] Handling call
0709 12:12:59.564514 (+2403883us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54001f5ed4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:59.564714 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2673880960}
I20260709 12:12:59.632544  1515 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:12:59.685559 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:59.666706 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:59.673081 26439 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:59.687584 26470 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:59.688205 26616 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 28: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:12:59.632958 26473 rpcz_store.cc:276] 0709 12:12:58.344036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:58.344249 (+   213us) service_pool.cc:224] Handling call
0709 12:12:58.366622 (+ 22373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:58.875651 (+509029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:59.539754 (+664103us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b540035f2d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:59.539998 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":980134656}
W20260709 12:12:59.653935  1103 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.017s	sys 0.047s
I20260709 12:12:59.640607  1708 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.679574 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:59.688483 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:12:59.691058 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 61029.8us
I20260709 12:12:59.696799 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:12:59.691207 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:59.680354  1770 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:12:59.694454  1103 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.017s	sys 0.048s
I20260709 12:12:59.694974 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:59.697477 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:59.701431 26473 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:12:59.703524 26439 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:59.667977  1803 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:59.711380 26545 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:12:59.711612  1632 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:12:59.712555  1632 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:59.713935  1705 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:12:59.662880  1790 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:59.715726  1279 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:59.716403  1279 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:59.715838  1515 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:59.716625  1790 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:59.716830  1279 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:59.717413  1515 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:59.718430  1770 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:59.701416  1760 consensus_queue.cc:1059] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 12:12:59.722886  1760 raft_consensus.cc:3055] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:59.723311  1760 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:12:59.724205  1760 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:59.680691  1663 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:59.695313  1795 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:12:59.711357  1735 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:59.711396 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:59.697510 27168 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:12:59.734218 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:12:59.725642  1760 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:59.735643 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:12:59.737007 27166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1181) took 1157 ms. Trace:
I20260709 12:12:59.714007  1632 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:59.657444  1723 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:59.747273 26622 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 12:12:59.754019 26620 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:12:59.676889  1690 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 12:12:59.763139 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:12:59.698715  1810 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:59.758268 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:59.761113 26617 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:59.765148 26467 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:12:59.739809 27166 rpcz_store.cc:276] 0709 12:12:58.579830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:58.580006 (+   176us) service_pool.cc:224] Handling call
0709 12:12:58.593904 (+ 13898us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:58.594349 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:58.594385 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:58.595024 (+   639us) log.cc:844] Serialized 26 byte log entry
0709 12:12:58.693072 (+ 98048us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:58.694367 (+  1295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:58.694500 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:59.554271 (+859771us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:59.734623 (+180352us) raft_consensus.cc:1685] finished
0709 12:12:59.734648 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:59.736910 (+  2262us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4912,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":37851,"spinlock_wait_cycles":5816448,"thread_start_us":97563,"threads_started":1,"wal-append.queue_time_us":125662}
I20260709 12:12:59.771855 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:59.732862  1735 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:59.744426  1653 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:12:59.755326  1785 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:12:59.746344  1688 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:59.755208  1743 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:59.788444  1797 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:12:59.791924 26616 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 12:12:59.792040 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4143) took 1124 ms. Trace:
I20260709 12:12:59.834105 26470 rpcz_store.cc:276] 0709 12:12:58.667246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.370387 (+703141us) service_pool.cc:224] Handling call
0709 12:12:59.390245 (+ 19858us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:59.688180 (+297935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:59.791644 (+103464us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b54003156d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:12:59.791940 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":683213056}
I20260709 12:12:59.800873  1779 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:12:59.808799 26472 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:12:59.812389  1686 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.814042  1355 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:59.814867 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 70659.5us
I20260709 12:12:59.705375  1708 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:59.769953  1647 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.768111  1810 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:59.782622  1735 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:59.835474 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 139760us
I20260709 12:12:59.814790  1795 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:59.836151  1688 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:12:59.930121 26472 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:12:59.970669 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:12:59.908700 26465 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:12:59.972965 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:12:59.955204 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:12:59.979787 26546 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:59.936818 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:59.915342 27164 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:59.936162 26541 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:12:59.944324 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:59.853114  1777 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:59.860448  1810 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:00.005368 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:59.966112 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:00.007414 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:00.008175 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:00.029206 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:12:59.898597  1770 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.005718 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:00.034260 26545 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:00.030223 26539 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
W20260709 12:13:00.086870 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 120856us
I20260709 12:13:00.043560 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:00.093037 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:00.094857 26468 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26. Ops: [25.13-25.13]
I20260709 12:12:59.857362  1686 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:12:59.967315  1751 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:00.112974  1810 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:00.018304  1371 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:12:59.890977  1795 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:00.052631 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:00.143507 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4096) took 1058 ms. Trace:
I20260709 12:13:00.144170 26615 rpcz_store.cc:276] 0709 12:12:59.085426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.360153 (+274727us) service_pool.cc:224] Handling call
0709 12:12:59.552883 (+192730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:59.553131 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:59.553163 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:59.553217 (+    54us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:59.553254 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:59.553321 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:00.143231 (+589910us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540003c850. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:00.143416 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370943232}
I20260709 12:12:59.895520 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:00.057197  1437 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.051239 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 4152) took 1275 ms. Trace:
I20260709 12:13:00.066458  1734 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.066470  1785 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:00.067566 27162 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:13:00.027024  1705 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.027899  1780 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.964416  1653 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.006104  1505 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.165015  1505 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:00.164917  1734 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:00.148862  1785 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:00.167673  1505 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:12:59.914383  1749 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:00.168478 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:00.076618  1665 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:00.072844 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 4154) took 1295 ms. Trace:
I20260709 12:13:00.169152 26465 rpcz_store.cc:276] 0709 12:12:58.776670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.075316 (+298646us) service_pool.cc:224] Handling call
0709 12:13:00.070272 (+994956us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b54002de1d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:00.072065 (+  1793us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1836287872}
W20260709 12:13:00.078111  1822 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:12:59.888603  1647 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:00.027623  1690 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:00.072674 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3032) took 1292 ms. Trace:
I20260709 12:13:00.146282 26466 rpcz_store.cc:276] 0709 12:12:58.776124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.093437 (+317313us) service_pool.cc:224] Handling call
0709 12:13:00.050899 (+957462us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54001c0f54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:00.051129 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644839680}
I20260709 12:13:00.113339  1588 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:00.180722 26469 rpcz_store.cc:276] 0709 12:12:58.779940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.412966 (+633026us) service_pool.cc:224] Handling call
0709 12:12:59.413419 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:59.413960 (+   541us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:12:59.414009 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:59.418449 (+  4440us) log.cc:844] Serialized 26 byte log entry
0709 12:12:59.748638 (+330189us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:59.748702 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:59.748818 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:00.072394 (+323576us) raft_consensus.cc:1685] finished
0709 12:13:00.072422 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:00.072596 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":481,"raft.queue_time_us":8074,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":12446,"thread_start_us":288550,"threads_started":1,"wal-append.queue_time_us":588552}
I20260709 12:13:00.151670  1705 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:00.183928 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:00.185078  1690 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:00.185885 26616 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 20: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:00.099498  1660 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:00.186765  1660 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:00.185127 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:00.187552  1690 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:00.188112  1807 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.188755 26469 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:00.188649  1807 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:00.190644 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:00.191360 26545 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:00.194999  1808 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 12:13:00.152756 26468 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
W20260709 12:13:00.151968 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 256585us
I20260709 12:13:00.001024  1658 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:00.083436  1279 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:00.179333 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:00.179929 26614 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 13. (term mismatch)
I20260709 12:13:00.210227 26614 pending_rounds.cc:85] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 12
I20260709 12:13:00.210532 26614 pending_rounds.cc:107] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 12:13:00.210894 26614 raft_consensus.cc:2889] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:00.168718  1653 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:00.183259 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:00.183694 27167 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:13:00.113412  1103 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 12:13:00.151841  1437 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:00.184202  1588 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.189036  1660 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:00.194897  1515 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:12:59.900612 26621 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:13:00.251962 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:00.249714 26473 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 12:13:00.154188 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:00.255328 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:00.255388 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:00.267432 27160 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:13:00.168516  1749 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:00.174667 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:00.206611 26468 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:13:00.163655 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:00.249696  1588 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:00.132433  1723 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:00.181774  1750 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.078s	sys 0.171s
I20260709 12:13:00.248898  1696 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.218191 26545 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:13:00.219519 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:00.108827  1770 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:00.204668  1682 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.874s	user 0.012s	sys 0.003s
I20260709 12:13:00.175855  1781 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:00.135957  1751 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:00.186326  1705 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:00.249128 26470 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:00.256070 26622 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:00.239866  1690 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:00.170946  1780 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:00.270341 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:00.276701 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:00.208635 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:00.153522  1371 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:00.279716  1750 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.078s	sys 0.171s
I20260709 12:13:00.263186  1515 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:00.305518 26622 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:00.305891  1653 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:00.307590  1770 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:00.309952  1780 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:00.303864  1690 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:00.338975  1690 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:00.339685  1690 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:00.339795  1707 consensus_meta.cc:287] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.002s
I20260709 12:13:00.288280  1682 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:00.311844 26615 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 21: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:00.315841  1751 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:00.341622  1816 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:13:00.342664  1682 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:00.317520 26613 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:13:00.319021  1686 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:00.344775  1764 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.345323  1764 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:00.302695  1807 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:00.347157  1814 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:13:00.347585  1658 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:00.348615 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3309) took 1297 ms. Trace:
W20260709 12:13:00.348896  1818 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:13:00.348767  1735 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:00.349051 26619 rpcz_store.cc:276] 0709 12:12:59.051720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.359092 (+307372us) service_pool.cc:224] Handling call
0709 12:12:59.366218 (+  7126us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:59.366740 (+   522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:59.366776 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:59.367320 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 12:12:59.743413 (+376093us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:59.743455 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:59.743528 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:00.348305 (+604777us) raft_consensus.cc:1685] finished
0709 12:13:00.348344 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:00.348542 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1218,"raft.run_cpu_time_us":7800,"raft.run_wall_time_us":51513,"thread_start_us":337211,"threads_started":1,"wal-append.queue_time_us":727747}
I20260709 12:13:00.350699 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3041) took 1298 ms. Trace:
I20260709 12:13:00.351029  1795 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:00.333389 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:00.287303  1781 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:00.319028  1437 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:00.336513  1779 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:00.340240  1690 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:00.350315  1785 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:00.285593  1708 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:00.312608  1371 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:00.204687 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:00.351130 26464 rpcz_store.cc:276] 0709 12:12:59.052219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.447997 (+395778us) service_pool.cc:224] Handling call
0709 12:12:59.448461 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:59.468099 (+ 19638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:59.468147 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:59.513561 (+ 45414us) log.cc:844] Serialized 26 byte log entry
0709 12:12:59.847735 (+334174us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:59.847801 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:59.847914 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:00.350470 (+502556us) raft_consensus.cc:1685] finished
0709 12:13:00.350489 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:00.350640 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11326,"raft.queue_time_us":22510,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":333611,"threads_started":1,"wal-append.queue_time_us":727530}
I20260709 12:13:00.286876  1696 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:00.326174 26473 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:13:00.263926  1688 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:00.381247  1735 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:00.381578  1515 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:00.381786  1751 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:13:00.380517 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 175901us
I20260709 12:13:00.360759  1781 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:00.360201  1279 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:00.384264  1662 consensus_meta.cc:287] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.705s	user 0.011s	sys 0.002s
I20260709 12:13:00.410939 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:00.403939  1649 consensus_meta.cc:287] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.920s	user 0.013s	sys 0.000s
I20260709 12:13:00.397321  1734 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:00.426297 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:00.873530 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:00.524164 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:00.879864 26622 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:00.744455 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:00.872932 26617 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 12:13:00.684679 26512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.000s	sys 0.031s
W20260709 12:13:00.882442 26512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.002s	sys 0.034s
W20260709 12:13:00.883579 26514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.005s	sys 0.008s
I20260709 12:13:00.601094 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4162) took 1120 ms. Trace:
W20260709 12:13:00.496780 26546 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.001s
I20260709 12:13:00.898212  1686 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:00.909866 26546 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:13:00.896709 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 1306) took 1212 ms. Trace:
I20260709 12:13:00.489184 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:00.903898 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:00.887799  1759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.005s	sys 0.015s
W20260709 12:13:00.912678  1759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.005s	sys 0.016s
I20260709 12:13:00.912863 26468 raft_consensus.cc:2410] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 12:13:00.913975 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:00.898725 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 154351us
W20260709 12:13:00.884275 26514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.006s	sys 0.008s
I20260709 12:13:00.418327  1735 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:00.916929 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:00.910842 26621 rpcz_store.cc:276] 0709 12:12:59.684663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.690849 (+  6186us) service_pool.cc:224] Handling call
0709 12:13:00.872350 (+1181501us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400267854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:00.896638 (+ 24288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465038720}
W20260709 12:13:00.902208 26472 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.000s	sys 0.016s
W20260709 12:13:00.923552 26472 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.001s	sys 0.016s
I20260709 12:13:00.919996 26546 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
W20260709 12:13:00.831459  1825 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 12:13:00.911315 27165 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.007s	sys 0.027s
I20260709 12:13:00.925015 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:00.984723 27165 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.007s	sys 0.028s
I20260709 12:13:00.970945  1831 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.498948  1696 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:00.983237 27166 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.011s	sys 0.023s
W20260709 12:13:00.991559 27166 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.012s	sys 0.023s
I20260709 12:13:00.908972 26467 rpcz_store.cc:276] 0709 12:12:59.480731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.783421 (+302690us) service_pool.cc:224] Handling call
0709 12:12:59.830747 (+ 47326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:59.831072 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:13:00.227966 (+396894us) log.cc:844] Serialized 14 byte log entry
0709 12:13:00.600342 (+372376us) log.cc:844] Serialized 14 byte log entry
0709 12:13:00.600591 (+   249us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:00.600647 (+    56us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:00.600732 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:00.600840 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:00.601012 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18998,"prepare.queue_time_us":201181,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":148,"raft.queue_time_us":6340,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":7490,"spinlock_wait_cycles":205958016,"thread_start_us":740633,"threads_started":2}
I20260709 12:13:00.926967 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:00.615576  1663 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.872s	user 0.013s	sys 0.002s
W20260709 12:13:00.858309  1760 consensus_meta.cc:287] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.112s	user 0.010s	sys 0.003s
I20260709 12:13:00.785074  1790 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.416262  1515 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.506s
I20260709 12:13:00.412937  1662 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:00.432186  1649 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:00.887416  1785 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:00.554581  1749 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:00.526075  1810 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:00.922736  1632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.003s	sys 0.007s
I20260709 12:13:00.742796  1371 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.214s
W20260709 12:13:00.960601 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:00.907064  1751 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:00.523757  1690 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:00.926236  1735 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:00.950706  1653 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:00.951107  1803 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:00.952512  1827 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:00.960075  1665 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:00.981815 26587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.020s	sys 0.033s
I20260709 12:13:00.965126  1759 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:00.969106  1723 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.744347  1505 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.218s
W20260709 12:13:00.483716  1798 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:13:01.022465  1723 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:00.497648  1734 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.029685  1734 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:01.032404  1734 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:00.993009 27166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 994) took 1137 ms. Trace:
W20260709 12:13:00.997202 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 70322.5us
I20260709 12:13:01.033874 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:01.035333  1653 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:00.981501  1834 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:01.035987  1723 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:01.036252  1834 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:01.038035  1841 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:13:01.038587  1834 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:00.515470  1781 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:01.010223 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:01.021935  1665 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.039929 26467 raft_consensus.cc:2393] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 17: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:01.040940 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:01.041200  1665 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:01.010143 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:01.015050  1810 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:01.007766  1632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.003s	sys 0.011s
I20260709 12:13:00.998059  1696 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:01.016486  1751 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:01.042238  1810 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:01.042739  1696 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.044359  1751 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:01.044966  1696 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:01.005151  1807 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:01.045187  1810 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:01.045879  1807 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 24 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:01.046248 26470 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:01.046710  1647 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:01.046960  1807 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:01.047731 26468 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:01.008104  1785 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.049204  1785 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.051380  1662 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:01.051963  1764 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:01.052361 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.053478 26464 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:01.055253 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:01.056370 26465 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
W20260709 12:13:01.019824 26587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.021s	sys 0.033s
I20260709 12:13:01.001183  1790 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:00.995299  1663 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:01.014345  1735 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:00.996158  1831 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:00.700522  1708 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.027143  1649 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:01.028788 26647 heartbeater.cc:646] Failed to heartbeat to 127.24.179.126:41797 (5 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.24.179.126:41797 timed out after 15.000s (SENT)
I20260709 12:13:01.003398 27164 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
W20260709 12:13:00.997627  1588 consensus_meta.cc:287] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.712s	user 0.009s	sys 0.005s
I20260709 12:13:01.094883 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:01.102614 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:01.111405 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:01.111797 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.112721 26546 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 26: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:01.112762 26614 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:13:01.113581 26468 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:13:01.104609 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:01.116693 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:01.117399 27162 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:13:01.120167 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:01.122639 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.123521 26619 raft_consensus.cc:2410] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 12:13:01.095898 27166 rpcz_store.cc:276] 0709 12:12:59.856161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.856335 (+   174us) service_pool.cc:224] Handling call
0709 12:12:59.891472 (+ 35137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:59.891722 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:13:00.390608 (+498886us) log.cc:844] Serialized 14 byte log entry
0709 12:13:00.992234 (+601626us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:00.992300 (+    66us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:00.992357 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:00.992534 (+   177us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:00.992940 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":685808,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":1727,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":5529,"spinlock_wait_cycles":7424,"thread_start_us":994351,"threads_started":2,"wal-append.queue_time_us":632695}
I20260709 12:13:01.127103 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:01.020699  1827 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.119540 27159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 995) took 1263 ms. Trace:
I20260709 12:13:01.132782 26467 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:01.051386  1785 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:01.096336  1632 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.023106  1759 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.159512 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:01.128763 27159 rpcz_store.cc:276] 0709 12:12:59.856558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.856726 (+   168us) service_pool.cc:224] Handling call
0709 12:12:59.891384 (+ 34658us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:59.891792 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:59.891822 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:00.019843 (+128021us) log.cc:844] Serialized 52 byte log entry
0709 12:13:00.398726 (+378883us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:00.398792 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:00.398895 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:01.119325 (+720430us) raft_consensus.cc:1685] finished
0709 12:13:01.119347 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:01.119479 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44959,"raft.queue_time_us":740,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":109684,"spinlock_wait_cycles":1072000,"thread_start_us":323181,"threads_started":1,"wal-append.queue_time_us":524513}
I20260709 12:13:01.156383 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:01.137826 27160 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:01.174721 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:01.131733  1734 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:01.126356  1746 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.126232  1696 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:01.188513 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:01.195479 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:01.203316 26543 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:13:01.198164 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:01.199774 26547 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:01.200414 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:01.205377 26542 raft_consensus.cc:2410] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 12:13:01.162456  1834 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.121250  1588 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.156160  1686 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:01.121382  1708 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:01.216732 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:01.215931 26467 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:13:01.221815 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:01.186686  1734 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.229197 26543 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 12:13:01.222621 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:01.232035 26542 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:13:01.234364 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:01.102950  1764 consensus_queue.cc:1059] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.086s
W20260709 12:13:01.238628 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 120582us
I20260709 12:13:01.241082 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:13:01.241204 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.236680 26542 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:13:01.157184  1835 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.090s
W20260709 12:13:01.222460  1838 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.260s	user 0.000s	sys 0.002s
I20260709 12:13:01.205765  1746 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.167914  1632 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:01.246457  1840 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:13:01.247064  1827 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:01.268393 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1194) took 1178 ms. Trace:
I20260709 12:13:01.323985 26539 rpcz_store.cc:276] 0709 12:13:00.089727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.091325 (+  1598us) service_pool.cc:224] Handling call
0709 12:13:00.129236 (+ 37911us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:00.198092 (+ 68856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:00.198124 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:00.198164 (+    40us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:00.198203 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:01.268175 (+1069972us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x7b54002387d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:01.268217 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:01.268329 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157816704}
I20260709 12:13:01.279378 27164 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 1002) took 1107 ms. Trace:
I20260709 12:13:01.325284 27164 rpcz_store.cc:276] 0709 12:13:00.171739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.171912 (+   173us) service_pool.cc:224] Handling call
0709 12:13:00.172358 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:01.102930 (+930572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:01.278987 (+176057us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b5400547ed4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:01.279292 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1910698752}
W20260709 12:13:01.280349  1837 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 12:13:01.317664  1649 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:01.327142  1649 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:01.327715 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4170) took 1397 ms. Trace:
I20260709 12:13:01.328154 26472 rpcz_store.cc:276] 0709 12:12:59.930508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.005493 (+ 74985us) service_pool.cc:224] Handling call
0709 12:13:00.005823 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:00.252083 (+246260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:00.252130 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:00.252742 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 12:13:00.925635 (+672893us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:00.925687 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:00.925754 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:01.327478 (+401724us) raft_consensus.cc:1685] finished
0709 12:13:01.327499 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:01.327647 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50078,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"thread_start_us":858497,"threads_started":2,"wal-append.queue_time_us":706747}
I20260709 12:13:01.329432  1649 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:01.183395  1653 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.058s
I20260709 12:13:01.332321  1746 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:01.283185  1588 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:01.290378  1759 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:01.289232  1790 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:01.284797  1831 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:01.297286  1781 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:01.291316  1663 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:01.342650  1632 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:01.343840  1632 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:01.344349  1632 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:01.294795 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:01.364526 26548 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:13:01.320369 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:01.323307  1843 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:01.366715  1843 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:01.221738  1834 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.220794  1696 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:01.390861 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.391346  1696 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.393628  1812 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:01.394294  1812 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:01.395311  1515 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.395874  1515 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.396802  1812 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:01.399153  1515 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:01.399735 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4101) took 1303 ms. Trace:
I20260709 12:13:01.399942  1515 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:01.400188 26617 rpcz_store.cc:276] 0709 12:13:00.096498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.096724 (+   226us) service_pool.cc:224] Handling call
0709 12:13:00.872540 (+775816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:00.881803 (+  9263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:01.399498 (+517695us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b5400267850. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:01.399670 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1783310592}
I20260709 12:13:01.403251  1735 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:01.243448  1734 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:01.405840  1735 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:01.400490  1515 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.408589  1515 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:01.298192  1760 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.410539  1760 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:01.240386  1686 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:01.288148  1708 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:01.417001  1708 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:01.417547  1708 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:01.361454 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:01.418597 26546 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:01.421527  1588 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.362696 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:01.422115  1588 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.422883 26473 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 26: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:01.424399  1588 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:01.424062  1708 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.425509  1708 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:01.376241  1843 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:01.377308 26544 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:01.378823  1834 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:01.384003 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 64441.7us
I20260709 12:13:01.291926 26540 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:01.394687  1785 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.428246  1785 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.384531  1682 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:01.430409  1831 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:01.450973  1785 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:01.453032  1834 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:01.453536  1834 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:01.454470  1662 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:01.454416  1834 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.466143  1662 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:01.468906  1735 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.469902  1735 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:01.465258 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 54391.4us
I20260709 12:13:01.471144 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:01.472671 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:01.473488 26473 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:01.474259  1686 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:01.479178 26439 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:01.480579 26439 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:01.476234  1843 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:01.484092  1790 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:01.484591  1790 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:01.485019  1790 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:01.476624  1760 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:01.483455  1843 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:01.487452  1843 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:01.487213  1632 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:01.372851 26514 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:01.495559 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 122811us
I20260709 12:13:01.496528 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:01.497723  1588 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:01.498638  1588 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:01.503113  1785 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:01.511358  1790 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.511817 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:01.512128 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:01.512877 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:01.513067 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:01.513856 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:01.556033 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 75496.4us
I20260709 12:13:01.556666 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:01.557475 26540 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:01.467249  1820 consensus_queue.cc:1059] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:13:01.467527  1834 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:01.467020  1831 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:01.498260 26514 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:01.538132 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.552660 26546 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:01.559206 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:01.562914 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:01.577020 26540 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:01.578625  1785 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:01.579159  1785 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:01.580091  1785 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.581388  1785 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:01.520413  1735 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:01.611063 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:01.611974 26548 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:13:01.619181 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:01.573433  1663 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:13:01.623572 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 125397us
W20260709 12:13:01.630198 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 466357us
I20260709 12:13:01.628618 26539 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 24: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:13:01.631007 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 388062us
W20260709 12:13:01.625641 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:01.632231 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.631572 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:01.635571 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:01.637814 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.641101 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:01.569314  1831 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:01.526208 26543 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:13:01.647255 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.654588 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.649521 26540 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:13:01.648725 27134 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:01.660236 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:01.651672 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.661329 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:01.650800 26514 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:01.653937  1505 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:01.667075  1505 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:01.668105  1505 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.639899  1663 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.671149  1663 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:01.672499  1760 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:01.675616  1790 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:01.652451  1850 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:01.677452  1850 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:01.677871  1588 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:01.679646  1812 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:01.680164  1812 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.680544  1812 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:01.628484  1820 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:01.654137  1746 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 12:13:01.687492  1831 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:01.689047  1831 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:01.674160  1760 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:01.690653  1760 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:01.691063  1760 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:01.691627  1734 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.693840  1734 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:01.697371  1843 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:01.616693  1662 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:01.700425  1850 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:01.706876 26620 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 26: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:01.710186  1790 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:01.714515  1632 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:01.719208 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:01.729606 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 78924.9us
I20260709 12:13:01.733470 26514 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:01.731969 26614 raft_consensus.cc:2410] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 23 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 12:13:01.735287 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.736622  1682 raft_consensus.cc:3055] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:01.737733  1844 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:01.742822 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.743567 26544 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:01.745988 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:01.751747  1850 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:01.752803 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.778869 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.743639  1835 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.782976 26614 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 24: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:01.772722 26514 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:01.785336 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.794852 26620 raft_consensus.cc:2410] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 25 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 12:13:01.795487 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:01.715265  1790 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.798931 26514 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:01.755790  1682 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:01.779552  1588 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:01.806761 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:01.811035 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.790175 26542 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:01.814468  1836 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:13:01.812605 26438 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.015s
W20260709 12:13:01.812775 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:01.817744 26438 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.000s	sys 0.015s
W20260709 12:13:01.818017 26439 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.68:35069 timed out after 1.607s (SENT) [suppressed 4 similar messages]
I20260709 12:13:01.821370 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.822856 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.823745 26614 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 22: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:01.825666 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.826653 26613 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:13:01.827740 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.828032 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.828411 26622 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:01.793565  1851 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:13:01.827759 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.829917 26616 raft_consensus.cc:2410] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 12:13:01.793495  1844 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:01.814199  1750 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:01.832765 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.835209 26614 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 14.
I20260709 12:13:01.836946 26621 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
W20260709 12:13:01.837193 26371 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57052 (request call id 307) took 63856 ms (client timeout 15000 ms). Trace:
W20260709 12:13:01.818107 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 511357us
I20260709 12:13:01.807727  1834 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:01.839449 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:01.810806  1820 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:01.842279 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:01.841035 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.798170  1835 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.860045 26472 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:01.851336 26613 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 12:13:01.851516 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:01.861246 26613 pending_rounds.cc:85] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 15
I20260709 12:13:01.861531 26613 pending_rounds.cc:107] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 12:13:01.861929 26613 raft_consensus.cc:2889] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:01.855036 26467 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:01.861454 26618 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:01.858901 26616 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:13:01.864542 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:01.866915 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.793721 26364 catalog_manager.cc:5697] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 13 to 14, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 14 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:01.869624 26364 catalog_manager.cc:5697] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 14 to 21. New cstate: current_term: 21 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:01.871564 26364 catalog_manager.cc:5697] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 9 to 14, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 14 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:01.873502 26364 catalog_manager.cc:5697] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:01.874571  1850 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:01.875834 26618 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:01.876528  1850 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:01.877663  1844 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:01.833037  1836 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 12:13:01.880327  1855 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:01.881193  1855 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:01.881430  1682 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:01.859395  1781 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:01.882956  1781 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:01.881697  1855 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:01.885250 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.886492 26622 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:13:01.888006  1843 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:01.900604 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:01.907264 26545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.006s	sys 0.012s
W20260709 12:13:01.907770 26545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.006s	sys 0.012s
I20260709 12:13:01.920913 26620 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:01.882900  1682 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:01.932037 27165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.031s	sys 0.038s
I20260709 12:13:01.911108 26513 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:01.925463 27133 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.000s	sys 0.019s
W20260709 12:13:01.934798 27133 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.000s	sys 0.019s
I20260709 12:13:01.928200 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:01.857424  1588 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:01.938845 26618 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:01.939561 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:01.941030 26472 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:01.941354 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:01.927379 26439 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:01.936105 27165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.031s	sys 0.038s
W20260709 12:13:01.935199 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 567385us
W20260709 12:13:01.901978  1764 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.017s	sys 0.041s
I20260709 12:13:01.946808 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:01.947626 26469 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:01.947077 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:01.946979 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.950923 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.953146 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:01.945514 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:01.953954 26614 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:13:01.955644 26439 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:01.959929 26468 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 12:13:01.964473 26547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.008s	sys 0.017s
I20260709 12:13:01.964613 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:01.965030 26547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.008s	sys 0.017s
I20260709 12:13:01.965341 26617 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:01.967574 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:01.968518 26472 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:13:01.965402 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:01.979996 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:01.980370 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:01.983671 27165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 999) took 2013 ms. Trace:
I20260709 12:13:01.980688 26472 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:13:01.932999  1843 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:13:01.956146  1764 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.018s	sys 0.041s
W20260709 12:13:01.838081 26371 rpcz_store.cc:269] 0709 12:11:57.986218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.995472 (+  9254us) service_pool.cc:224] Handling call
0709 12:13:01.834204 (+63838732us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:55.588354 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:55.589070 (+   716us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:55.589122 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:12:55.589156 (+    34us) tablet.cc:662] Decoding operations
0709 12:12:55.716668 (+127512us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:55.716789 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:55.716833 (+    44us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:12:55.743082 (+ 26249us) tablet.cc:701] Row locks acquired
0709 12:12:55.743133 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:12:55.743318 (+   185us) write_op.cc:270] Start()
0709 12:12:55.743476 (+   158us) write_op.cc:276] Timestamp: P: 1783599175743248 usec, L: 0
0709 12:12:55.743493 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:12:55.763897 (+ 20404us) log.cc:844] Serialized 4806 byte log entry
0709 12:12:56.089700 (+325803us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:12:56.304386 (+214686us) op_driver.cc:464] REPLICATION: finished
0709 12:12:56.568453 (+264067us) write_op.cc:301] APPLY: starting
0709 12:12:56.568570 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:56.605140 (+ 36570us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:56.605187 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:56.883778 (+278591us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b540007d354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d732a 00007f507605cf14 00007f507605cec3 00007f507605ce38 00007f507605cdf3 00007f507605c0dc 00007f5076085e16 00007f507606dcbb 00007f507605839d 00007f507605bd75
0709 12:12:56.991145 (+107367us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:57.127660 (+136515us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0709 12:12:57.167470 (+ 39810us) write_op.cc:312] APPLY: finished
0709 12:12:57.168098 (+   628us) log.cc:844] Serialized 113 byte log entry
0709 12:12:57.168340 (+   242us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:57.168490 (+   150us) write_op.cc:454] Released schema lock
0709 12:12:57.168571 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:57.169111 (+   540us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:57.169144 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":53093,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":260020,"apply.run_cpu_time_us":25142,"apply.run_wall_time_us":600627,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54239,"num_ops":12,"prepare.queue_time_us":123789,"prepare.run_cpu_time_us":43403,"prepare.run_wall_time_us":354458,"raft.queue_time_us":143892,"raft.run_cpu_time_us":29501,"raft.run_wall_time_us":595303,"replication_time_us":560678,"spinlock_wait_cycles":35388416,"thread_start_us":387617,"threads_started":4,"wal-append.queue_time_us":80517,"wal-append.run_cpu_time_us":51651,"wal-append.run_wall_time_us":2275294}]]}
I20260709 12:13:01.963012  1686 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:01.956604  1649 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:01.966277  1836 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election won for term 26
W20260709 12:13:02.018522 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.987629  1653 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:01.966800  1588 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:02.002589  1515 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:01.962816  1849 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:13:02.014438  1807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.017s	sys 0.066s
I20260709 12:13:01.984380 27165 rpcz_store.cc:276] 0709 12:12:59.970160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.971959 (+  1799us) service_pool.cc:224] Handling call
0709 12:13:00.037193 (+ 65234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:00.203745 (+166552us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:13:00.985256 (+781511us) log.cc:844] Serialized 14 byte log entry
0709 12:13:01.164169 (+178913us) log.cc:844] Serialized 14 byte log entry
0709 12:13:01.255355 (+ 91186us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b18001d0fe0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287 00007f50760f5208
0709 12:13:01.256782 (+  1427us) spinlock_profiling.cc:243] Waited 9.04 ms on lock 0x7b18001d0fe0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:13:01.365600 (+108818us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x7b18001d0fe0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:13:01.367397 (+  1797us) spinlock_profiling.cc:243] Waited 51.8 ms on lock 0x7b18001d0fe0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed557 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:13:01.945341 (+577944us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:01.945425 (+    84us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:01.945491 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:01.983294 (+ 37803us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b540056bb54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:01.983370 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:01.983577 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":375660,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":59615,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":27661,"spinlock_wait_cycles":618784512,"thread_start_us":1583644,"threads_started":3,"wal-append.queue_time_us":257123}
I20260709 12:13:02.036983 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:02.044178 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 384046us
I20260709 12:13:02.045567 26469 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:13:02.053267 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:02.054071 26469 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 30: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:02.059926  1662 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:02.043006  1849 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.061110  1849 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:02.061823  1853 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 12:13:02.065001 27134 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:02.027832  1653 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:02.054700  1807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.018s	sys 0.066s
I20260709 12:13:02.093487  1856 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:02.093745  1781 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:02.087929  1653 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:02.104117 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:02.105599 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:02.106446 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:02.011437  1843 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:02.041924  1836 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:02.130250 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:02.131251 26617 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
I20260709 12:13:02.133468 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:02.109001 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:02.134423 27168 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:02.134900 27165 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:13:02.057210  1688 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:02.111953 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.108651 26620 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 12:13:02.139640 26620 pending_rounds.cc:85] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 14
I20260709 12:13:02.140030 26620 pending_rounds.cc:107] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 12:13:02.140380 26620 raft_consensus.cc:2889] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:02.148705 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:02.150306  1686 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:02.151450  1686 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:02.129055  1790 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:02.155289  1835 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:02.156548  1855 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:02.156980 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:13:02.159406  1785 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.578s	user 0.014s	sys 0.000s
I20260709 12:13:02.160455  1759 raft_consensus.cc:3055] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:02.161020  1759 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:02.162133  1759 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:02.162890  1836 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:02.168493  1759 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:02.170024 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:02.170781 27164 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:02.178700 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 384674us
I20260709 12:13:02.180274 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:02.205998  1686 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:02.143141  1820 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.215190 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:02.296567 27168 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
W20260709 12:13:02.235327 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:02.239938 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 284375us
W20260709 12:13:02.246236 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:02.301214 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.247120 26587 leader_election.cc:400] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24.
I20260709 12:13:02.247538  1764 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:02.082170 26364 catalog_manager.cc:5697] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 13 to 17, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 17 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:02.252610 26619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.000s	sys 0.015s
I20260709 12:13:02.255864 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:02.303013 27160 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:02.261902 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:13:02.277552 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 289752us
I20260709 12:13:02.302376 26587 leader_election.cc:403] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:13:02.307557 26619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.000s	sys 0.015s
I20260709 12:13:02.308526 27159 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:02.148051  1588 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:02.308552 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:02.343958 27162 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:02.211388  1760 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:02.303999 26439 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:02.311736  1860 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:13:02.312597  1863 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
W20260709 12:13:02.313563  1857 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:13:02.315290 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 68330.1us
I20260709 12:13:02.371507 27164 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:02.313702 26364 catalog_manager.cc:5697] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 14 to 21. New cstate: current_term: 21 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:02.320677 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:02.321967 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:02.323225 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:02.288849  1515 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:02.290843  1708 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:02.324692 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:02.328253 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:02.329941 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:02.339562  1843 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:02.343372 26620 pending_rounds.cc:85] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 19
W20260709 12:13:02.373594  1831 consensus_meta.cc:287] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.003s
I20260709 12:13:02.356637  1760 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:02.371979 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:02.315940  1867 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24.
I20260709 12:13:02.357249  1785 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:13:02.423933 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 52052.4us
W20260709 12:13:02.357666 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 304333us
I20260709 12:13:02.373682 27159 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:13:02.323983  1653 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:02.373231  1663 consensus_meta.cc:287] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.700s	user 0.009s	sys 0.003s
I20260709 12:13:02.429257 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:02.351017 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 47159.1us
W20260709 12:13:02.391880 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 62025.5us
I20260709 12:13:02.395876 26620 pending_rounds.cc:107] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 24.20
I20260709 12:13:02.435524 26620 raft_consensus.cc:2889] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:02.413343 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 356279us
I20260709 12:13:02.437490 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:02.417354 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:02.376746  1505 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.012s	sys 0.004s
I20260709 12:13:02.419731 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:02.420046 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:02.455792 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:02.362236 27162 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
W20260709 12:13:02.395437  1812 consensus_meta.cc:287] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.714s	user 0.014s	sys 0.000s
W20260709 12:13:02.427515 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.461287 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:02.415371 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:02.441087 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:02.430184 27161 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:13:02.438437 27163 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:02.457738 27168 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:02.346796  1820 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:02.388206  1708 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:02.467082 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:02.465284 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:02.473459 26543 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:02.480595 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:02.439785  1844 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.014s	sys 0.008s
I20260709 12:13:02.481195 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:02.459884  1505 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.013s	sys 0.004s
I20260709 12:13:02.423158  1785 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.497021 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:02.387840  1849 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:02.488234 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:02.504868  1505 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.505607  1653 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:02.505517  1505 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:02.492746 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:02.483579  1844 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.015s	sys 0.008s
I20260709 12:13:02.459484  1843 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:02.474838  1807 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:02.478150  1855 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:02.501929 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:02.501979 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.481611 26617 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
W20260709 12:13:02.508126 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 80572.6us
I20260709 12:13:02.502133 27167 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 25: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:02.515341 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:02.520531 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:02.521538 26473 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
I20260709 12:13:02.520838 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:02.453685  1663 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:02.473632  1827 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:13:02.528813 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:02.565132 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:02.500697  1785 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:02.525008 26469 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:13:02.566982 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:02.534310 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:02.534327 26439 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:02.567687 26468 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:13:02.567843 26464 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:02.472050  1812 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:02.575268 26472 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:02.542112  1850 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:02.554694  1835 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:02.556023 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:02.579520 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:02.560958 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3169) took 1370 ms. Trace:
I20260709 12:13:02.538196  1760 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:02.516832  1843 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.585724  1734 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:02.586769 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:02.564539  1790 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:02.601610 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:02.593977 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 124676us
W20260709 12:13:02.576435  1649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.008s	sys 0.005s
I20260709 12:13:02.564425  1851 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 12:13:02.595108 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.607030 27159 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 22: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:02.582783 26545 rpcz_store.cc:276] 0709 12:13:01.191032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:01.192668 (+  1636us) service_pool.cc:224] Handling call
0709 12:13:01.193184 (+   516us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:13:01.222787 (+ 29603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:01.222818 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:13:01.239694 (+ 16876us) log.cc:844] Serialized 78 byte log entry
0709 12:13:01.298498 (+ 58804us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b1800451cc0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:13:01.908242 (+609744us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:02.195023 (+286781us) log.cc:844] Serialized 14 byte log entry
0709 12:13:02.196827 (+  1804us) log.cc:844] Serialized 14 byte log entry
0709 12:13:02.560308 (+363481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:02.560424 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:02.560628 (+   204us) raft_consensus.cc:1685] finished
0709 12:13:02.560660 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:02.560868 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24376,"prepare.queue_time_us":606431,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":66,"raft.queue_time_us":629785,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":1086,"spinlock_wait_cycles":4684160,"thread_start_us":1224555,"threads_started":3,"wal-append.queue_time_us":858969}
I20260709 12:13:02.502867  1515 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:02.589337  1855 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:02.526403  1807 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:02.592916  1843 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:13:02.610791  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.009s	sys 0.005s
I20260709 12:13:02.646637 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3175) took 1446 ms. Trace:
W20260709 12:13:02.693614 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 159387us
I20260709 12:13:02.694523 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:02.695746 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:02.696973 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:02.572249  1844 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 12:13:02.685346 26547 rpcz_store.cc:276] 0709 12:13:01.199771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:01.205016 (+  5245us) service_pool.cc:224] Handling call
0709 12:13:01.224102 (+ 19086us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:01.299738 (+ 75636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:01.299768 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:01.300452 (+   684us) log.cc:844] Serialized 52 byte log entry
0709 12:13:01.965563 (+665111us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:02.393818 (+428255us) log.cc:844] Serialized 14 byte log entry
0709 12:13:02.645784 (+251966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:02.645963 (+   179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:02.646095 (+   132us) raft_consensus.cc:1685] finished
0709 12:13:02.646118 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:02.646496 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75101,"prepare.queue_time_us":390013,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":185987,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":225,"thread_start_us":1291738,"threads_started":3,"wal-append.queue_time_us":838150}
I20260709 12:13:02.640869  1760 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:02.643283  1790 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:02.569921  1708 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:02.592621  1696 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.106s
W20260709 12:13:02.718048 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 131352us
I20260709 12:13:02.692513  1781 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:13:02.717161 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 152108us
I20260709 12:13:02.691388  1649 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:02.702009  1836 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:02.719627  1686 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:02.634440  1588 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.085s
I20260709 12:13:02.726238 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:02.713747  1505 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:02.716229  1760 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:02.727218  1908 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:02.730926 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 85966.9us
I20260709 12:13:02.723832  1886 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:13:02.757364 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:02.732784  1900 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:02.728771 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:02.748256 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:02.732465  1895 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:02.721995  1881 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:02.722224  1868 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:13:02.734838  1852 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.008s	sys 0.027s
I20260709 12:13:02.758185 26468 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:13:02.751058  1760 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:02.756139  1688 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.613s	user 0.012s	sys 0.000s
W20260709 12:13:02.777422 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 85088.1us
I20260709 12:13:02.733830  1874 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:02.760702 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:02.779783 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:02.761409  1812 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:02.761155  1649 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:02.733994  1871 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:02.734969  1880 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:02.734426  1875 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:02.813069 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:02.776408  1682 consensus_meta.cc:287] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.833s	user 0.014s	sys 0.000s
I20260709 12:13:02.770478 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:02.825982 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:02.722174  1890 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:02.768342 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:02.768935 26470 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:02.766451 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:02.642776 26364 catalog_manager.cc:5697] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 15 to 19, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 19 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:02.781678 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:02.782743  1895 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:13:02.783084  1870 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:13:02.762282  1708 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:02.762449  1908 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:02.795387 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:02.849573 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:02.850296 26540 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:13:02.796454 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:02.799501 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:02.801112 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:02.734071  1865 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.312s
I20260709 12:13:02.857287 26541 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 26: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:02.744597  1790 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:02.748075  1850 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:13:02.817651  1869 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:13:02.817469 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:02.862473 26545 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:13:02.766196  1909 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:02.818176 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:02.766088  1881 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:02.868183  1881 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:02.821261  1785 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:02.821893  1883 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 12:13:02.822412 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:02.801777  1688 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:02.823014 26613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "541724f47bb04d5185dd369750546cbf"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "3262bf0553e543eea76794fc529a9acc"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:13:02.823177  1901 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.782775  1874 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.828285 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:02.830358 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 52019us
W20260709 12:13:02.815245 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 61297.8us
I20260709 12:13:02.834877 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:02.841583 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 77602us
I20260709 12:13:02.845358 26469 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:02.883174 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:02.888309 26613 raft_consensus.cc:606] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Received request to transfer leadership to TS 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:02.882352 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:02.815485  1759 consensus_meta.cc:287] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.636s	user 0.010s	sys 0.002s
I20260709 12:13:02.841997  1844 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.029s
I20260709 12:13:02.824263  1913 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:02.854008 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:02.855032 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 157017us
I20260709 12:13:02.902978 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:02.763195  1903 raft_consensus.cc:3055] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:02.857517 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:02.861057 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:02.863660  1790 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:02.916816  1790 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:02.918573  1865 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.919189  1865 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:02.920513 26464 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:13:02.921865  1865 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:02.863952  1909 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:02.922423 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:02.923461  1895 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:02.924396 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:02.840888  1871 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:02.867641 26547 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: [27.17-29.18]
I20260709 12:13:02.872419  1850 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:02.925881  1871 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:02.869361  1760 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:02.927069  1759 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:02.844503  1849 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:02.930203  1849 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:02.930824  1849 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:02.927114  1850 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:02.931236  1849 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:02.881366 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:02.889631 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:02.881582 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:02.934870 27159 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:02.888350 26548 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:13:02.884280 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:02.891625  1901 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:02.845206  1890 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:02.887593 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:02.870575  1902 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:13:02.893699 27166 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:02.782757  1820 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:02.897131 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:13:02.961097 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 64046.7us
I20260709 12:13:02.899127 26469 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 12:13:02.894769 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:02.893394  1898 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 12:13:02.857980  1915 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:02.906536 26539 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: [24.13-24.13]
W20260709 12:13:02.906787 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 52917us
I20260709 12:13:02.912374  1887 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 12:13:02.907450  1903 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:02.883803  1785 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:02.922880  1909 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:02.867254  1899 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:13:02.924372 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:02.929349  1760 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:02.891714 27165 raft_consensus.cc:2368] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26.
I20260709 12:13:02.937403 26464 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:13:02.837080  1880 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:02.946961 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.906543  1781 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:02.899168  1874 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:02.962723 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:02.926726  1807 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:03.095047  1746 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:03.095681  1746 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:03.096257  1746 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:02.944387  1913 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 21 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:03.098248  1913 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:03.099880  1903 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:03.017584  1886 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:02.966380  1922 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:03.102680  1922 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:03.103809  1922 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:03.106158 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:03.106909 26545 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:03.107154  1890 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:03.107344  1746 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:03.109753  1909 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:03.110139  1746 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:02.953306  1883 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.171s
I20260709 12:13:03.115964  1850 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.116549  1850 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:03.119097  1850 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:03.118495  1881 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:03.121213  1881 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:03.121131 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:02.978139 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 83445.1us
I20260709 12:13:03.123171 26468 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
W20260709 12:13:03.123517 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 234047us
I20260709 12:13:03.123678 26513 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:03.073676 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:03.124504 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:03.124785 26465 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:03.125697 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 163046us
I20260709 12:13:03.126556 26514 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:03.101259  1903 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:03.129654 26545 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:13:03.123327 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:03.134347 26438 connection.cc:256] RPC call timeout handler was delayed by -1.0212048089999826s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
I20260709 12:13:03.134989  1881 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:03.135716  1881 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:03.130056  1750 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:03.137454  1750 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:03.138028  1881 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:03.138729 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:03.139890  1750 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:03.130544 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 206297us
I20260709 12:13:03.141697 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:03.142760 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:03.143537 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:03.147104  1746 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:03.147451 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:03.139930  1881 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:03.147679  1746 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.150520  1909 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:03.151895 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:03.152612 26466 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
W20260709 12:13:03.154676  1906 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:13:03.155395 26613 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 12:13:03.155694  1901 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:03.157944 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4193) took 1216 ms. Trace:
I20260709 12:13:03.159376  1880 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:03.158495 26471 rpcz_store.cc:276] 0709 12:13:01.943062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:01.943633 (+   571us) service_pool.cc:224] Handling call
0709 12:13:01.943976 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:01.958572 (+ 14596us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:13:02.249090 (+290518us) log.cc:844] Serialized 14 byte log entry
0709 12:13:02.759724 (+510634us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:02.765768 (+  6044us) log.cc:844] Serialized 52 byte log entry
0709 12:13:02.776177 (+ 10409us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:02.779240 (+  3063us) log.cc:844] Serialized 14 byte log entry
0709 12:13:02.779655 (+   415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:02.779741 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:03.157703 (+377962us) raft_consensus.cc:1685] finished
0709 12:13:03.157724 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:03.157876 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":142735,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":88,"raft.queue_time_us":129791,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":26132,"spinlock_wait_cycles":17073024,"thread_start_us":666160,"threads_started":3,"wal-append.queue_time_us":429684}
I20260709 12:13:03.161255 26471 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 12:13:03.162492  1505 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.162642  1890 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:03.163383  1890 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:03.163225  1505 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:03.164527  1890 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 29.19, Last appended by leader: 19, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:03.146492  1900 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:03.165964  1900 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:03.166953 26471 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:03.168360  1900 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:03.168658 26471 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:13:03.146724  1877 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:03.170991 26364 catalog_manager.cc:5697] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:03.155825 26613 pending_rounds.cc:85] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 11
I20260709 12:13:03.175416 26613 pending_rounds.cc:107] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 12:13:03.175693 26613 raft_consensus.cc:2889] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:03.176272 26464 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:03.179510 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:03.179806 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:03.180423  1917 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.236s	user 0.000s	sys 0.000s
I20260709 12:13:03.180804 26614 raft_consensus.cc:2410] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:13:03.181221 26621 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 12:13:03.074700  1897 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:13:03.182421 26467 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:03.184924 26465 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:03.179862  1653 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.008s
I20260709 12:13:03.181895  1760 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:03.190626  1871 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 29.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:03.191759  1867 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:03.192238  1867 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:03.175614  1785 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:03.193789 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 4197) took 1157 ms. Trace:
I20260709 12:13:03.193651 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:03.001955  1820 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:03.196321 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:03.194298 26472 rpcz_store.cc:276] 0709 12:13:02.036316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.036548 (+   232us) service_pool.cc:224] Handling call
0709 12:13:03.193571 (+1157023us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b5400314cd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:03.193723 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1198759296}
I20260709 12:13:03.193293  1867 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 29.19, Last appended by leader: 19, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:03.214969 26472 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:03.215229  1867 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:03.193346  1785 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:03.218760  1785 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:03.146950  1886 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:03.260205 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:03.269264 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:13:03.275996 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.173626  1746 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:03.173465  1850 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:03.289609 27167 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 12:13:03.222903  1871 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.093s
I20260709 12:13:03.292874 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:13:03.330940 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 183565us
I20260709 12:13:03.404403  1505 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:03.408640 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:03.408910 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:03.408386 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:03.414486 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:03.295037 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:03.415306 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:03.423606 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:03.424352 26542 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:13:03.425226 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:03.357784 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:03.427992 26614 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 22: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:03.432542 26621 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 18. Current term is 19. Ops: []
W20260709 12:13:03.355787 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 170018us
I20260709 12:13:03.293524 26618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:13:03.434463 26618 raft_consensus.cc:606] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:13:03.434839 26618 raft_consensus.cc:614] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:03.435429 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:03.224911  1916 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:03.431388 26588 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:03.437793 26514 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:03.438361 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:03.444325 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:03.444880 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:03.251646  1915 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:03.405699  1850 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.443745 26588 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:03.447926 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:03.448007 26472 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:13:03.450435 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:03.432114  1708 consensus_meta.cc:287] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.567s	user 0.011s	sys 0.001s
I20260709 12:13:03.388986  1886 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 25 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:03.455453 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:03.461382 26546 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:13:03.417011  1908 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:03.457859 26588 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:03.458279 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:03.436710  1836 raft_consensus.cc:3055] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:03.463234 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:03.465385 26588 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:03.419148  1881 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:03.226254  1820 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:03.436920  1505 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:03.471464 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:03.474895 26473 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:03.448318  1901 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:03.477684 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:03.448259  1649 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:03.451642  1850 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:03.412103  1790 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:03.464699  1916 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:03.477224  1682 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:03.490846 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:03.472476  1835 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:03.498564  1835 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.498998 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:03.500380 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:03.500623  1790 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:03.501041 26544 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:03.501391 26468 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:03.184448 26364 catalog_manager.cc:5697] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 13 to 17, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 17 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:03.503921 26364 catalog_manager.cc:5697] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 15 to 19, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 19 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:03.476620  1708 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:03.506739  1708 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.506771  1868 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:03.507261  1708 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:03.507388  1868 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:03.469183  1836 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:03.508483  1836 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:03.474048  1820 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:03.510401  1759 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:03.464465  1871 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:03.482023  1901 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.502030 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:03.553122 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:03.554040 26544 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:03.499001  1835 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:03.560437 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 121170us
I20260709 12:13:03.517638  1759 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:03.588943 26548 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
W20260709 12:13:03.589262 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 110029us
I20260709 12:13:03.590632 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:03.600629 27134 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:03.516325  1649 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:03.596208 26548 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:03.549836  1901 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:03.538189  1746 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:03.549723  1935 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:13:03.614173 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.498154  1874 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:03.593562  1785 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:03.598016  1886 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:03.579873  1915 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 29.18, Last appended by leader: 18, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:03.624872 27168 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:13:03.625499 26545 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
W20260709 12:13:03.625924  1849 consensus_meta.cc:287] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.694s	user 0.013s	sys 0.001s
I20260709 12:13:03.628144  1649 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:03.596231  1844 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.042s
W20260709 12:13:03.631026  1929 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:13:03.631259  1820 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:03.631903  1930 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:13:03.633708 26548 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:03.634881 26544 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:03.579360  1760 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:03.636035 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:03.637348 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 199672us
I20260709 12:13:03.603547  1807 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:03.688020 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:03.667923 26470 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 12:13:03.639961  1851 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:03.593859  1505 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:13:03.506053 26364 catalog_manager.cc:5697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 11 to 18. New cstate: current_term: 18 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:03.678607 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 90119.9us
I20260709 12:13:03.688344 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:03.685869 26514 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:03.653470  1875 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.702596 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:03.650162  1812 consensus_queue.cc:1059] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 12:13:03.662438  1903 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.037s
I20260709 12:13:03.606966  1881 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:03.699657  1875 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:03.721884 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:03.697922  1505 consensus_queue.cc:1243] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 22.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 12:13:03.718559 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 118390us
I20260709 12:13:03.722759 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:03.693797  1686 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:03.667279  1849 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:03.740104 26548 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:03.709491  1909 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:03.825378 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:03.827414 26471 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:03.806493  1812 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:03.810153 26466 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
W20260709 12:13:03.792505 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 106718us
I20260709 12:13:03.611363  1916 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:03.667951  1759 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:03.699187  1851 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:03.684751  1939 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.087s
I20260709 12:13:03.791374 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:03.826774 26464 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:03.648574  1935 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:03.830847 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:03.826488  1932 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.845994 26464 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:03.845793  1785 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:03.849370 26468 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:03.850636 26514 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:03.852114 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:03.836212  1903 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:03.861172 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:03.856578  1871 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.872355 26548 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
W20260709 12:13:03.923920  1941 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:13:03.925351  1949 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:13:03.928805  1948 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:13:03.910692  1874 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:03.816279 26364 catalog_manager.cc:5697] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 12 to 19, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 19 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:03.855026  1932 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:03.857141  1759 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:03.836872  1812 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:03.879760  1938 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
W20260709 12:13:04.025383 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 177117us
W20260709 12:13:04.035880 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 185323us
I20260709 12:13:04.039914 26514 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:03.941521 26364 catalog_manager.cc:5697] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:04.035097  1843 consensus_meta.cc:287] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.328s	user 0.014s	sys 0.005s
I20260709 12:13:04.057173  1877 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.057646  1820 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:04.026798  1874 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:13:04.059935 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 423990us
W20260709 12:13:04.049319  1868 consensus_meta.cc:287] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.534s	user 0.018s	sys 0.000s
I20260709 12:13:04.039279  1844 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:04.063975 26514 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:04.048714  1958 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:13:04.039014  1505 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 12:13:04.033708  1871 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:04.067912  1903 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:13:04.117504 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 91247.1us
I20260709 12:13:04.073182  1877 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:04.053251  1940 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.076s
W20260709 12:13:04.124841 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 64091.1us
I20260709 12:13:04.125901 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:04.064239  1843 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:04.109849  1958 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:13:04.141687 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 68943.3us
I20260709 12:13:04.081401  1874 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:04.107097  1939 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:13:04.081409  1868 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:04.150950 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4206) took 1013 ms. Trace:
I20260709 12:13:04.130800  1883 raft_consensus.cc:2764] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 12:13:04.125499  1663 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:04.130411  1849 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:04.143756  1958 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:04.151751 26465 rpcz_store.cc:276] 0709 12:13:03.137697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.185730 (+ 48033us) service_pool.cc:224] Handling call
0709 12:13:03.186135 (+   405us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:03.449000 (+262865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:03.449032 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:03.484596 (+ 35564us) log.cc:844] Serialized 52 byte log entry
0709 12:13:03.640996 (+156400us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:03.686521 (+ 45525us) log.cc:844] Serialized 14 byte log entry
0709 12:13:03.686842 (+   321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:03.687049 (+   207us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:04.150669 (+463620us) raft_consensus.cc:1685] finished
0709 12:13:04.150693 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:04.150879 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43478,"prepare.queue_time_us":45131,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":5492,"raft.queue_time_us":200875,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":22008,"spinlock_wait_cycles":9725056,"thread_start_us":319076,"threads_started":2,"wal-append.queue_time_us":174392}
I20260709 12:13:04.150947  1820 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:04.168504 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:04.181454 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.181416 26514 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:04.150821  1851 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:04.169878  1688 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:04.197933  1946 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:13:04.199412  1957 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:13:04.175545  1965 consensus_queue.cc:1059] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
W20260709 12:13:04.202951  1947 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:13:04.204370  1874 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:04.206501  1868 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:04.207876  1950 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:13:04.208156  1850 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.688s	user 0.018s	sys 0.002s
I20260709 12:13:04.208375  1950 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:04.208601  1850 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:04.209299  1950 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:04.210711  1883 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:04.211194  1835 consensus_meta.cc:287] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.624s	user 0.013s	sys 0.006s
W20260709 12:13:04.211757  1960 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:13:04.211691  1835 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:04.212182  1812 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:04.183621  1505 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.214462  1505 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:04.215282  1965 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:04.215761  1965 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:04.213168 26364 catalog_manager.cc:5697] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 14 to 16, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 16 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:04.234469 26469 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:04.236744 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:04.237917 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.258299 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:04.259251 26543 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:13:04.261103 26543 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:04.262632  1932 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:04.263707 26543 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:04.265080  1877 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:04.267110 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 85810.5us
W20260709 12:13:04.235708  1708 consensus_meta.cc:287] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.728s	user 0.007s	sys 0.016s
I20260709 12:13:04.233322  1950 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:04.230160  1835 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:04.270658 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 104078us
I20260709 12:13:04.268007 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:04.274507 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:04.218441  1820 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 12:13:04.281796 26617 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:04.284148 26621 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:04.284709 26621 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:04.283248 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:04.288820 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:04.294580  1964 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.295866 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3072) took 1337 ms. Trace:
I20260709 12:13:04.281347  1632 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:04.295581  1964 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:04.296595  1632 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:04.297087  1632 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:04.297351 26539 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:04.298060 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3019) took 1198 ms. Trace:
I20260709 12:13:04.298383 26539 rpcz_store.cc:276] 0709 12:13:03.100128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.144163 (+ 44035us) service_pool.cc:224] Handling call
0709 12:13:03.149021 (+  4858us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:04.297173 (+1148152us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b540028dd20. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f5076051dc0 00007f50760dc1c0 00007f50760dd231 00007f50760d9d8f 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c
0709 12:13:04.297764 (+   591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.297981 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30647680}
I20260709 12:13:04.298877  1974 consensus_queue.cc:1059] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:04.301263 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3061) took 1465 ms. Trace:
I20260709 12:13:04.301749 26470 rpcz_store.cc:276] 0709 12:13:02.835870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.845053 (+  9183us) service_pool.cc:224] Handling call
0709 12:13:02.845453 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:03.691052 (+845599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.300944 (+609892us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b540035f2d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:04.301192 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1890872576}
I20260709 12:13:04.216657  1965 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:04.224867  1688 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:04.296334 26466 rpcz_store.cc:276] 0709 12:13:02.960619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.153409 (+192790us) service_pool.cc:224] Handling call
0709 12:13:03.153721 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:03.831552 (+677831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.295600 (+464048us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b54000dc0d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:04.295795 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1509078784}
I20260709 12:13:04.305320 26619 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:13:04.285658 26621 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:04.311787 26621 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:04.282696  1850 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:04.314201 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:04.307531  1505 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:04.238600  1875 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:04.330071 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:04.335680 27167 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:04.274791  1708 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:04.343899 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:04.349800 26619 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 12:13:04.351003 26613 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:04.321285  1871 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:04.353470 26621 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:13:04.353773 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:04.354171 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.325003  1843 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:04.343710  1965 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:04.362774  1909 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:04.355827  1588 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
W20260709 12:13:04.346578  1890 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.022s	sys 0.017s
I20260709 12:13:04.371491 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:04.372195 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:04.372874  1708 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:04.399812 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:04.399881 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:04.401654 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:04.393281  1967 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:04.397403 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:04.401832 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:04.403491 26617 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:13:04.406191  1916 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:04.408946  1916 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:04.406834 26514 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:04.402304 26539 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:04.368603  1852 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.415865 26514 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:04.365787  1894 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:04.369150  1909 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:04.387794  1903 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:13:04.424479  1954 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.578s	user 0.002s	sys 0.000s
I20260709 12:13:04.423746 26364 catalog_manager.cc:5697] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 6 to 20, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 20 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:04.425809 26364 catalog_manager.cc:5697] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:04.427482 26364 catalog_manager.cc:5697] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 13 to 17, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 17 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:04.428807  1967 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:04.430824 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 1218) took 1136 ms. Trace:
W20260709 12:13:04.430824 27165 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 1011) took 2285 ms (client timeout 2168 ms). Trace:
I20260709 12:13:04.431703  1688 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:04.431288 27159 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:04.431269 26545 rpcz_store.cc:276] 0709 12:13:03.294630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.294774 (+   144us) service_pool.cc:224] Handling call
0709 12:13:04.430631 (+1135857us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540018bfd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:04.430714 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479503104}
I20260709 12:13:04.436226  1875 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:04.435973  1852 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:04.440361  1632 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:04.420220  1588 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:04.413231  1901 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.783s	user 0.015s	sys 0.000s
W20260709 12:13:04.413642  1890 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.022s	sys 0.017s
W20260709 12:13:04.431808 27165 rpcz_store.cc:269] 0709 12:13:02.146216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.156639 (+ 10423us) service_pool.cc:224] Handling call
0709 12:13:04.430543 (+2273904us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b540060de54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:04.430700 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1687556480}
I20260709 12:13:04.433616 27159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 1012) took 1248 ms. Trace:
I20260709 12:13:04.455336 27159 rpcz_store.cc:276] 0709 12:13:03.185648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.186320 (+   672us) service_pool.cc:224] Handling call
0709 12:13:04.430928 (+1244608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:04.432579 (+  1651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.433395 (+   816us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540060de50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:04.433555 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2626716032}
I20260709 12:13:04.417297 26514 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:04.429765 26364 catalog_manager.cc:5697] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:04.456862  1903 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:04.457469  1903 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:04.457005 26364 catalog_manager.cc:5697] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 14 to 18, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 18 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:04.457934  1903 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:04.459939  1632 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:04.459064 26364 catalog_manager.cc:5697] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
W20260709 12:13:04.463269 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 46068.6us
I20260709 12:13:04.450317  1852 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:04.472209 26539 raft_consensus.cc:2410] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 12:13:04.452227  1894 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:04.476224 26539 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 12:13:04.461675 26364 catalog_manager.cc:5697] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:04.474339 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:04.455991  1916 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:04.480486 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:04.451098  1958 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:04.454497  1901 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:04.492820  1913 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:04.500411 26364 catalog_manager.cc:5697] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 15 to 18, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 18 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:04.505226 26364 catalog_manager.cc:5697] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 12 to 16, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 16 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:04.506731  1916 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:04.507702 26543 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 14. Current term is 15. Ops: []
I20260709 12:13:04.509224  1958 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:04.547080 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:04.548062 26467 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:04.549057 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:04.549805 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:04.550631 26545 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:04.513496 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:04.553429 26466 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 19: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:04.554322 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:04.554674  1964 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:04.556950 26466 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 12:13:04.557329 26466 pending_rounds.cc:85] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 10
I20260709 12:13:04.514109 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:04.514187 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:04.514981 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:04.559446 26465 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:04.559612  1901 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:04.516737 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:04.560310 26468 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 20.
I20260709 12:13:04.561113 26466 pending_rounds.cc:107] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 12:13:04.562048 26466 raft_consensus.cc:2889] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:04.526790 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 61530.8us
I20260709 12:13:04.587615 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:04.589072 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:13:04.537374 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.547101  1939 consensus_queue.cc:1059] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.004s
I20260709 12:13:04.550110 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:04.551338 26539 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:04.563562 26544 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:04.518683 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:04.566797  1935 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:04.567302  1894 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:04.567930  1588 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:04.571831 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:04.613700 26614 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:04.572687 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:04.615790 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:04.617151 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:04.530668  1916 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:04.576642 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3069) took 1639 ms. Trace:
I20260709 12:13:04.578145 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:04.578773 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:04.511153 26546 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:04.583130 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:04.572705  1708 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:04.587723 26514 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:04.606346  1919 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.620785 27166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 1014) took 1394 ms. Trace:
I20260709 12:13:04.624564 26544 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:04.618352 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:04.688588 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 100937us
W20260709 12:13:04.658334 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.685168 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:04.685350 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:04.628918 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:04.687616 27166 rpcz_store.cc:276] 0709 12:13:03.226909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.227090 (+   181us) service_pool.cc:224] Handling call
0709 12:13:03.405041 (+177951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:03.405275 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:13:03.540817 (+135542us) log.cc:844] Serialized 14 byte log entry
0709 12:13:04.303396 (+762579us) spinlock_profiling.cc:243] Waited 8.97 ms on lock 0x7b18001bb9e0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5075c824bc 00007f5072fd048b 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a23a
0709 12:13:04.303791 (+   395us) log.cc:844] Serialized 14 byte log entry
0709 12:13:04.304143 (+   352us) log.cc:844] Serialized 14 byte log entry
0709 12:13:04.438510 (+134367us) spinlock_profiling.cc:243] Waited 7.23 ms on lock 0x7b18001bb9e0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:13:04.620212 (+181702us) spinlock_profiling.cc:243] Waited 5.8 ms on lock 0x7b18001bb9e0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5072fefa40 00007f5072fea4e4 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287 00007f50760f5208
0709 12:13:04.620393 (+   181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:04.620453 (+    60us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:04.620507 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.620583 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:04.620715 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17367,"prepare.queue_time_us":340521,"prepare.run_cpu_time_us":153,"prepare.run_wall_time_us":10610,"raft.queue_time_us":2942,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":11662,"spinlock_wait_cycles":50609536,"thread_start_us":252385,"threads_started":2,"wal-append.queue_time_us":241373}
I20260709 12:13:04.590875  1735 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.691622 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:04.694024 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:04.711082 26618 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:13:04.628882 26547 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:13:04.712277 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3195) took 1353 ms. Trace:
I20260709 12:13:04.712303 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:04.713207 26547 rpcz_store.cc:276] 0709 12:13:03.359115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.361365 (+  2250us) service_pool.cc:224] Handling call
0709 12:13:04.578626 (+1217261us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:13:04.712182 (+133556us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10199424}
I20260709 12:13:04.705528 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:04.618933  1916 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:04.706724 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:04.623658  1963 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.429s	user 0.002s	sys 0.000s
I20260709 12:13:04.681728  1965 raft_consensus.cc:3055] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:04.682735  1760 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.695839 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:04.700765 26614 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:04.687248  1852 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.686733  1871 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.593703  1901 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.109s
I20260709 12:13:04.684021  1958 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:04.722939 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:04.695986  1939 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:04.694541  1708 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:04.626382  1903 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:04.724378  1965 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:04.707417  1735 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:04.734911  1939 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.709074  1850 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:04.745987  1987 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.174s	user 0.000s	sys 0.011s
I20260709 12:13:04.749289  1708 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:04.731200  1760 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:04.733228  1852 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:04.737565  1958 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:04.752779  1939 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:04.735249  1871 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:04.700248 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.628265 26469 rpcz_store.cc:276] 0709 12:13:02.937388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.981433 (+ 44045us) service_pool.cc:224] Handling call
0709 12:13:03.019915 (+ 38482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:04.235226 (+1215311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.576339 (+341113us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540006a4d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:04.576563 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2792515840}
I20260709 12:13:04.701511 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:13:04.703611 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 74754.4us
I20260709 12:13:04.872501 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3209) took 1507 ms. Trace:
I20260709 12:13:04.730248 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:04.725555 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:04.873157 26544 rpcz_store.cc:276] 0709 12:13:03.364402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.856333 (+491931us) service_pool.cc:224] Handling call
0709 12:13:04.871858 (+1015525us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b54002369d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:04.872177 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1595008896}
I20260709 12:13:04.765978  1965 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:04.864979 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:04.886201 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.887030  1965 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:04.887496 26543 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:13:04.843410 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1331) took 1203 ms. Trace:
I20260709 12:13:04.848263 26622 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:04.851451 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1219) took 1536 ms. Trace:
W20260709 12:13:04.852682 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.863056  1909 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:04.874935 26617 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:04.727057 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:04.695652  1919 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:04.875785 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:04.872835 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:04.906510 26614 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:04.921118 26542 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 22: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:04.942207  1760 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:04.952907 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:04.961519  1807 raft_consensus.cc:3055] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:04.954903  1931 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:04.955814  1935 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:04.963167  1935 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:04.958688  1746 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:04.891252 26616 rpcz_store.cc:276] 0709 12:13:03.639455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.641919 (+  2464us) service_pool.cc:224] Handling call
0709 12:13:03.642432 (+   513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:03.854186 (+211754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:03.854222 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:03.854808 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 12:13:04.060483 (+205675us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:04.060626 (+   143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.460881 (+400255us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b5400195354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:04.460936 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:04.622948 (+162012us) spinlock_profiling.cc:243] Waited 6.29 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:04.842626 (+219678us) raft_consensus.cc:1685] finished
0709 12:13:04.842686 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:04.843114 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":500708992,"thread_start_us":205248,"threads_started":1,"wal-append.queue_time_us":303928}
I20260709 12:13:04.967953  1909 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:04.968545 26616 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 29 index: 19. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
I20260709 12:13:04.962153  1807 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:04.970563 26619 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:04.963121  1931 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:04.973905  1931 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:04.975821 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3023) took 1560 ms. Trace:
I20260709 12:13:04.976347 26546 rpcz_store.cc:276] 0709 12:13:03.415405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.201451 (+786046us) service_pool.cc:224] Handling call
0709 12:13:04.201793 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:04.629223 (+427430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.975199 (+345976us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b54003971d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:04.975606 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710818688}
I20260709 12:13:04.976917  1852 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:04.979590  1682 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.980443  1682 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:04.891527 26541 rpcz_store.cc:276] 0709 12:13:03.314491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.314632 (+   141us) service_pool.cc:224] Handling call
0709 12:13:03.752757 (+438125us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:13:03.753083 (+   326us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:04.100953 (+347870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:04.100990 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:04.111644 (+ 10654us) log.cc:844] Serialized 52 byte log entry
0709 12:13:04.219352 (+107708us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:04.266586 (+ 47234us) log.cc:844] Serialized 14 byte log entry
0709 12:13:04.266860 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.266941 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:04.764803 (+497862us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b18001c3f60. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:13:04.850672 (+ 85869us) raft_consensus.cc:1685] finished
0709 12:13:04.850751 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:04.851186 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":176354,"prepare.queue_time_us":36492,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":3821,"raft.queue_time_us":99918,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":28534,"spinlock_wait_cycles":78035072,"thread_start_us":368499,"threads_started":2,"wal-append.queue_time_us":158541}
I20260709 12:13:04.957330  1871 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:04.991830 26618 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:04.988770 26613 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 24: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:04.983691 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:04.988890 26621 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:05.038559 26615 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 13. (term mismatch)
W20260709 12:13:05.039129  1844 consensus_queue.cc:1175] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aaadfdd9ca9f424c91505f9b43876233" responder_term: 23 status { last_received { term: 22 index: 14 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:13:05.047024 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:05.048468 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:05.051095 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:05.052708  1735 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:05.053025  1958 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:05.055896  1682 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:05.054201 26617 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:05.062522  1935 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:05.065763 26615 pending_rounds.cc:85] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 12
W20260709 12:13:04.986932 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 63716.3us
I20260709 12:13:04.989171  1708 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 12:13:04.990068 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 114683us
I20260709 12:13:05.062898  1760 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.077922 26615 pending_rounds.cc:107] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 25.13
I20260709 12:13:05.086733 26615 raft_consensus.cc:2889] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:05.092269 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.090190 27162 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:05.095155  1922 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:05.095438 26439 leader_election.cc:336] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Timed out: RequestConsensusVote RPC to 127.24.179.68:35069 timed out after 1.656s (SENT)
I20260709 12:13:05.096401 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:05.092240  1895 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.099917  1895 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:05.102622 27167 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:05.098384 26545 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:13:05.086529  1871 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:05.105573  1922 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:13:05.106756  1995 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 12:13:05.112113  1895 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:05.107916  1871 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:05.117035 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 133831us
I20260709 12:13:05.119287 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:05.121052  1895 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:13:05.124565 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.123554 26438 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:05.130688 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:05.134806  1760 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:05.139356 27166 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 23: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:05.138299  1919 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:05.140761  1760 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:05.143764 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:13:05.147338 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.142198 26614 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:13:05.125744  1895 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:05.155153  1922 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:05.155931 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:05.156144  1632 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.151851  1760 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:05.157437  1895 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:05.175199 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 52171.1us
W20260709 12:13:05.176574 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.176997 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:05.169816  1919 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:05.179591 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:05.175392  1688 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.180109  1903 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:05.180677  1688 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:05.181303  1993 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.180681 27166 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 20: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:05.182227  1993 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:05.182992 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:05.184439 27165 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:05.184590  1632 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:05.185616  1993 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:05.186285 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:05.187170  1632 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:05.187621 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:05.188874 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:05.189211 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:05.192803  1922 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:05.194072 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:05.198508 26621 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:05.201545  1922 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:05.202534  1922 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:05.202863 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1330) took 1561 ms. Trace:
I20260709 12:13:05.202585  1807 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:05.204064  1922 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:05.166765  1760 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:05.216923 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:05.215484  1760 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:05.221395 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 48528.4us
I20260709 12:13:05.221100 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:05.223426 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:05.233945  1836 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:05.234472  1505 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:05.235076  1505 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:05.236505  1505 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:05.237417 27168 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 29 index: 19. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
I20260709 12:13:05.237895  1505 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:05.243036 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4215) took 1400 ms. Trace:
I20260709 12:13:05.243602 26471 rpcz_store.cc:276] 0709 12:13:03.842363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.842525 (+   162us) service_pool.cc:224] Handling call
0709 12:13:03.842872 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:03.869532 (+ 26660us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:13:03.938644 (+ 69112us) log.cc:844] Serialized 14 byte log entry
0709 12:13:04.441081 (+502437us) spinlock_profiling.cc:243] Waited 7.07 ms on lock 0x7b18000fa8a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a23a 00007f50760e4a2a
0709 12:13:04.524696 (+ 83615us) log.cc:844] Serialized 14 byte log entry
0709 12:13:04.525023 (+   327us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:04.525078 (+    55us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:04.525129 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:05.242516 (+717387us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b54003205d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:05.242598 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:05.242821 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20894,"prepare.queue_time_us":69674,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":4480,"raft.queue_time_us":4345,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":35812,"spinlock_wait_cycles":58785536,"thread_start_us":71701,"threads_started":1,"wal-append.queue_time_us":487937}
I20260709 12:13:05.246609 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:05.247486 26616 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:05.248629 26619 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:05.249326  1887 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.243026  1807 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:05.250083  1887 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:05.252969  1887 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:05.238796 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 83067.1us
W20260709 12:13:05.262364  1916 consensus_meta.cc:287] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.008s
I20260709 12:13:05.262851  1919 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.263010  1916 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:05.263710  1919 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:05.265507  1916 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:05.259320 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:05.203470 26620 rpcz_store.cc:276] 0709 12:13:03.637835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.638027 (+   192us) service_pool.cc:224] Handling call
0709 12:13:03.638495 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:03.638792 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 20
0709 12:13:03.799806 (+161014us) log.cc:844] Serialized 14 byte log entry
0709 12:13:04.992186 (+1192380us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b180045d300. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287 00007f50760f5208
0709 12:13:05.135923 (+143737us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:05.157310 (+ 21387us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:13:05.164671 (+  7361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:05.171667 (+  6996us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:05.199172 (+ 27505us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":202244,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":16015,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":6692,"spinlock_wait_cycles":12348160,"thread_start_us":193756,"threads_started":2}
I20260709 12:13:05.268584 27167 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:05.268646 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:05.272277 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 78398.4us
I20260709 12:13:05.268378  1887 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.273141 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:05.270982  1812 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.274714 26614 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:05.274847  1887 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:05.274714  1812 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:05.276821 27168 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:05.277412  1887 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:05.266142  1919 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:05.295320 27167 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:13:05.284374 26619 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:05.296085 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:05.280275 26439 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:05.294220 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:05.298452 26615 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:05.298712  2006 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.299423 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:13:05.303712 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.304654 27165 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:05.306512 27166 raft_consensus.cc:2368] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26.
I20260709 12:13:05.307528  2006 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:05.311419 27168 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:05.313127  2006 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:05.315567 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:05.325541 26539 raft_consensus.cc:2410] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 21 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 12:13:05.329145 27168 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:05.309396  1688 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:05.336272 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 104977us
I20260709 12:13:05.316731  1871 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:05.348426 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:05.349422 27168 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
W20260709 12:13:05.350911  2005 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 0.118s	user 0.002s	sys 0.004s
I20260709 12:13:05.353657 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:05.355072  1812 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:05.355273  2004 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:13:05.358716  1939 consensus_meta.cc:287] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.589s	user 0.013s	sys 0.006s
I20260709 12:13:05.359338  1939 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:05.359879  1760 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:05.364480 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 78423.3us
I20260709 12:13:05.365909 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:05.366600  1916 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:05.366976 26613 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 22: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:05.367236  1916 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:05.368435  1916 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:05.371068  1915 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:05.371592  1915 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:05.371977  1915 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:05.374771 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 119470us
I20260709 12:13:05.374974 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:05.366174 26438 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:05.395603 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:05.396397 26539 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 20.
I20260709 12:13:05.395821 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:05.395821 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:05.362255  1760 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:05.407869 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:05.408692 27165 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:13:05.409046 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:05.394019  1919 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:05.343801  1895 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:05.413362 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47367.7us
I20260709 12:13:05.414825 26439 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:05.421960 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:05.423218 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.428539 26613 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:05.428319 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:05.433948 26619 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 30.
W20260709 12:13:05.437085  2001 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.245s	user 0.000s	sys 0.003s
I20260709 12:13:05.437868 26545 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:13:05.430907 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:05.429289 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:05.419642  1935 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:05.424518 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:05.416985  1939 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:05.449400 26615 raft_consensus.cc:2410] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 27 because replica has last-logged OpId of term: 24 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 12:13:05.453130 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:05.458321 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.458915 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:05.461942 26539 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:05.453919 26616 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:13:05.466338 26545 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:13:05.460978 26588 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:05.472397  1935 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:05.490108 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 78585us
I20260709 12:13:05.491127 26439 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:05.493059 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:05.471208  1871 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:05.500748 26545 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:05.502288 26544 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
I20260709 12:13:05.518738 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:05.518877  1895 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:05.499881  1935 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:05.527113 26544 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24. Ops: []
W20260709 12:13:05.527200 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 101964us
I20260709 12:13:05.528813 26588 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:05.531294 26548 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:05.539956 26588 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:05.542626 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 140961us
I20260709 12:13:05.554178 26546 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:05.554332 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:05.555919  1735 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:05.556514 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:05.558485 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:05.543310  1871 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:05.563702  1505 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:05.539563  1935 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:05.546904  1760 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:05.568802 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:05.569257  1760 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:05.561997  1850 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.734s	user 0.018s	sys 0.001s
I20260709 12:13:05.557868  2002 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:13:05.572887 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.575294 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:05.572415 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:05.532994  1922 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:13:05.571822  1812 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:05.581909  1653 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:05.582263  1812 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.582576  1922 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:05.582608  1653 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.582957  1812 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:05.583261  1922 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:05.583390  1653 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:05.584514  1922 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:05.585963  1922 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:05.587167 26540 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:05.589452 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3221) took 1195 ms. Trace:
I20260709 12:13:05.592000 26539 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 27: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:05.571046  1760 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:13:05.593207 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47369.6us
I20260709 12:13:05.593540 26543 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:05.589828 26540 rpcz_store.cc:276] 0709 12:13:04.394408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.419413 (+ 25005us) service_pool.cc:224] Handling call
0709 12:13:05.586549 (+1167136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:05.587593 (+  1044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:05.589226 (+  1633us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54003cf350. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:05.589394 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2642470784}
I20260709 12:13:05.595039 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3225) took 1196 ms. Trace:
I20260709 12:13:05.595470 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:05.595479 26548 rpcz_store.cc:276] 0709 12:13:04.395716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.401420 (+  5704us) service_pool.cc:224] Handling call
0709 12:13:05.575415 (+1173995us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b54003cf354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:05.592289 (+ 16874us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2127556992}
I20260709 12:13:05.575104  1871 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:05.599823  1871 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:05.602555  1852 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:05.606276 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:05.606848 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:05.607613 26546 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:05.607973 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:05.608723 26543 raft_consensus.cc:2376] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24. Re-sending same reply.
I20260709 12:13:05.576848  2002 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.615926 26621 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:13:05.617020 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:05.617245 26617 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:05.619633  1505 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:05.622041  1505 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:05.616520  2002 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:05.622931  1935 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:05.624126 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:05.623816  1653 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:05.593688  1915 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:05.631812  1812 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:05.596004  1850 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:05.638338 26514 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:05.662911 26545 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:13:05.663622  1505 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:05.663868 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:05.639843  1916 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.025s
W20260709 12:13:05.638938 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 70798.3us
I20260709 12:13:05.650337  1653 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:05.640324  1735 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 12:13:05.693390 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:05.640074 26439 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:05.673508 27134 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:05.648113 26539 raft_consensus.cc:2376] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23. Re-sending same reply.
I20260709 12:13:05.652582 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:05.640355  2009 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:13:05.646126  1919 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:05.701844 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.653096  1812 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:05.651038  1915 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:05.706799 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.696635  1505 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:05.722985 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 57183.2us
I20260709 12:13:05.706758  1965 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:05.736596  1831 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.737560  1831 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:05.737922  1505 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:05.741160  1831 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:05.730091  1688 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:05.728885  1836 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:05.766577  1935 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:05.699024  1708 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.054s
I20260709 12:13:05.772289 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:05.773646 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:05.782673 26622 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
W20260709 12:13:05.788081 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 124343us
I20260709 12:13:05.767455  1965 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:05.813087  1965 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:05.814982  1820 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:05.815663  1965 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:05.816057  1820 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:05.816572  1820 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:05.818778  1688 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:05.826588  1688 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:05.826802 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 144043us
I20260709 12:13:05.823642  1935 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:05.789590  1850 raft_consensus.cc:2764] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:13:05.831527  2019 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:05.831377  1935 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:05.817687  1820 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:05.838779 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:05.839744 26621 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:13:05.844655 26617 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:05.834780  1820 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:05.854615  1812 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:05.855527  1812 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:05.865348  1852 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:05.866024  1852 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:05.838984  1836 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:05.882331 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:05.883248 26621 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:13:05.861528  2002 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:05.879222 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:05.889107 26619 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 13. (term mismatch)
I20260709 12:13:05.889691 26619 pending_rounds.cc:85] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 12
I20260709 12:13:05.893754 26619 pending_rounds.cc:107] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 24.13
I20260709 12:13:05.894112 26619 raft_consensus.cc:2889] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:05.881785  1807 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.876124  1812 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:05.909493  1807 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:05.910504 26618 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 25: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:13:05.912845 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 272916us
W20260709 12:13:05.915311 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:05.934664 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 198917us
I20260709 12:13:05.918933  1812 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:05.975018 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:05.976487 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 45258.7us
I20260709 12:13:05.976737 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:05.980335 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 327835us
I20260709 12:13:05.979668 26615 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:13:05.974932  1812 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.990904  1812 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:06.000532  1831 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.004190  1900 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.004334  2020 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:13:06.004720  1831 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:06.004830  1900 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:06.009604 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:06.012584  1967 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.013803  1900 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:06.013486  1967 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:06.014544  1900 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.015125  1900 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:06.010819 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:06.032466 26621 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:13:05.996793  1760 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:06.007129  1895 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:05.988593  1852 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:06.030995  1967 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:06.046109 26614 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 31: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:06.035207  1836 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:06.047104 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.039484  1895 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:13:06.050191 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 159583us
W20260709 12:13:06.048687 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 355388us
I20260709 12:13:06.044340  1922 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:06.074723 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:06.055326  1807 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:06.056881  1939 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:06.099457  1831 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:06.084730 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:06.086865  1900 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:06.099781  1939 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:06.100936 27168 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 25: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:06.103258  2024 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:06.107115  1915 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:06.107663  1915 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:06.108736  1915 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:06.090548 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:06.072566  2002 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:06.091611  2021 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:13:06.092415  1895 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:06.093302  2026 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:06.097419  1760 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:06.110188  1915 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:06.128942 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:06.130496 27168 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 31: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:06.084029  1852 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:13:06.132882 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 135849us
W20260709 12:13:06.133606 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 58927.4us
I20260709 12:13:06.134829  1820 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.136595 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:06.123273  1922 raft_consensus.cc:697] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:06.153044  1831 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:06.154906 26439 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:06.155233  1831 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:06.158622  1735 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:06.159152  1735 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.159530  1735 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:06.160415 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:06.162562 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.163014 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:06.164795 26619 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:06.165297 26619 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:06.136694  1820 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:06.169023  1935 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:06.170249  1935 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:06.162568 26615 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31. Ops: [30.20-30.20]
I20260709 12:13:06.171276  2025 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:06.171792  2025 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:06.172278 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:06.172907  2025 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:06.166199 26619 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:06.174758 26619 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:06.175060  2025 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:06.184587 26619 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:13:06.185802  1812 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:06.186313 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:06.212340  1935 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:06.212921  1935 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.213382  1935 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:06.219537  1939 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:06.220331  1820 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:06.222087  1831 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:06.229635  2020 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:13:06.231411 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.188426  1812 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:06.200655  1895 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:06.237162 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:06.201355 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 62939.4us
I20260709 12:13:06.238222  2022 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:06.239223 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:06.239514  2022 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:06.239923  2022 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:06.239223  2024 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:06.240890  2022 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:06.242609  2022 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:06.202087  2035 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:06.247517  2035 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:06.248085  2035 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.248510  2035 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:06.248833  1653 raft_consensus.cc:3055] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:13:06.249279  1653 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:06.203364  1922 consensus_queue.cc:237] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:06.205024 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:06.207966  2037 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:06.154152  2026 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:06.210757  1967 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:06.211468 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.250160  1653 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:06.254408 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 101760us
I20260709 12:13:06.304467 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:06.254724  2037 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:06.309491  2037 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:06.280462 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 154334us
I20260709 12:13:06.313848 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:06.254912  2026 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:06.314534 26619 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:06.314591  2026 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:06.255497  2029 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:13:06.318655 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.318853  2029 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:06.319850  2029 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:06.255159  1967 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:06.323225  1967 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:06.324009 26619 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
I20260709 12:13:06.281081  1653 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:06.240890 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:06.271227 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.326597  1807 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:06.327030  1807 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.327380  1807 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:06.328389 27165 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
W20260709 12:13:06.330503 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 89709.6us
I20260709 12:13:06.264765 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:06.333976  2002 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:06.380796 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:06.381405 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:06.381980 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.289659  2024 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:06.280685  1812 consensus_queue.cc:1175] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aaadfdd9ca9f424c91505f9b43876233" responder_term: 14 status { last_received { term: 14 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 14 index: 11 } }
I20260709 12:13:06.386952  1900 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.387681  1900 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:06.392679  2040 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.393533  1831 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:13:06.394584 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 90220.2us
I20260709 12:13:06.392557 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:06.395957 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:06.397883  2039 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:06.398443  2039 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.398819  2039 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:06.408143 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:06.409648  2035 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:06.408182 26362 catalog_manager.cc:5697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:06.410737  1831 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:06.412772 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:06.414289 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:06.432040 26614 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:13:06.393477  2040 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:06.420125  1900 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:06.420266  1850 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:06.421705 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:06.422474  2002 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:06.422798 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 158217us
I20260709 12:13:06.423614  1735 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:06.424841 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.424692 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:06.427317 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:06.428184 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:06.429023  1852 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:13:06.254381  1935 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:06.440327 26621 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:06.415429  2022 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:06.462157 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 198271us
W20260709 12:13:06.463222 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.465552 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:06.473054 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:06.476524 26614 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:13:06.477959 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:06.482589 26620 raft_consensus.cc:2410] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 23 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:13:06.485270  2038 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.486106  2038 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:06.486840  1939 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:06.487038  2022 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.487424  1939 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.487962  1939 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:06.487805  2022 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:06.446249  1820 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:06.482695 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.441185  2037 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:06.438329  1807 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:06.489203  2038 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:06.490701  1505 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 12:13:06.528298 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:06.453068  1831 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:06.506690  1820 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:06.543589  2026 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:06.546525  2037 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:06.524621  1922 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.023s
I20260709 12:13:06.557583 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:06.558347  2024 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:06.558614  1895 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:06.558949  1900 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:06.558910  2025 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.002s
I20260709 12:13:06.549100  2035 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:06.572052 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 110995us
I20260709 12:13:06.560102  2040 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:06.586244 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:06.587682  1831 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:06.588521  1915 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:06.589287 26439 leader_election.cc:400] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26.
I20260709 12:13:06.552846  2022 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:06.589874 26439 leader_election.cc:403] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
W20260709 12:13:06.592768 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 262671us
I20260709 12:13:06.579857  1900 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:06.593318 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 261706us
I20260709 12:13:06.598809 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:06.604652 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:13:06.623874 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.596359  1915 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:06.602245  1935 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:06.652634 26439 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:06.605628  2035 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:06.601339  2022 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:06.663484  1760 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:13:06.665125 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.676471 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:06.665712  1900 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:06.673180 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 189446us
I20260709 12:13:06.590243  2039 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:06.654134  2009 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:13:06.650089  2024 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election won for term 26
W20260709 12:13:06.679797 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 194019us
I20260709 12:13:06.648866  1922 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26.
I20260709 12:13:06.677325  2025 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:06.689922 26514 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:06.678947  2035 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:06.691299  1900 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:06.701730 26514 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:06.690114  1735 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:06.691794  1895 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:06.711983 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:06.698050  2025 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.719384 26514 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:06.701118  2038 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:06.699110  2024 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:13:06.747087 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 93444.1us
I20260709 12:13:06.747579 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:06.753206 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 167056us
I20260709 12:13:06.753299 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:06.694195  2040 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:13:06.757958 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:06.743393  2025 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:06.721156  1965 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:06.759255 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:06.760339 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:06.746754  2038 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.748911  1922 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:06.760926  1820 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:06.779835  1831 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:06.781078 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:06.782546 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 70858.9us
I20260709 12:13:06.782125  2059 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:06.782253  2026 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:06.783291  1735 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.799443  2029 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:06.815160  2029 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:06.814901  1735 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:06.816286 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:06.816098  2029 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:06.817369  1735 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:06.782933  1935 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:13:06.803256  2063 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.027s
W20260709 12:13:06.786455 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.752003  1967 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:06.819367  1967 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:06.819804  1967 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:06.807341 26362 catalog_manager.cc:5697] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 11 to 14, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 14 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:06.781817  2039 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:06.792050 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47862.7us
I20260709 12:13:06.757800  1807 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:06.762995  1836 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:06.789950  1831 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.792217  2059 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:06.803027 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:06.805289  1850 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:06.801017 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:06.800539 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:06.805562 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:06.801594 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:06.805680 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:06.813324  2022 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:06.807276  2020 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:06.850572  2020 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:06.851747  2020 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:06.852952  2020 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:06.845412  2059 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:06.854877  2057 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:13:06.817436  2029 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:06.785516  2038 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:06.834316 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:06.839033 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 123225us
I20260709 12:13:06.842724 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:06.864276 27162 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24. Ops: [23.18-23.18]
W20260709 12:13:06.848836 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 67823.6us
I20260709 12:13:06.834008  1915 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:06.830878  1836 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.843437  1831 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:06.821684 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44940us
I20260709 12:13:06.793179  2052 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:06.855474 26466 raft_consensus.cc:2410] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 27 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 12:13:06.859634 26469 raft_consensus.cc:2410] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 27 because replica has last-logged OpId of term: 26 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260709 12:13:06.865163 26616 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:06.867383 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:06.881222 26621 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:06.871129  2024 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:06.882113 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47889.3us
I20260709 12:13:06.881349 27159 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31. Ops: [30.20-30.20]
I20260709 12:13:06.854939  2063 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:06.823161  2035 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:06.887203 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:06.883112 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:06.890508  2052 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:06.891654  2052 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:06.884634  2063 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:06.895680  2063 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 28.14, Last appended by leader: 14, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:06.896977  2063 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:06.898116  2025 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:06.847899  1922 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 29.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.032s
I20260709 12:13:06.909220 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:06.878832  1836 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:06.910051 26618 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:06.910593 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45298us
I20260709 12:13:06.912654 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:06.914599 27163 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:06.855237  1735 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:13:06.878931  1850 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:06.878760  1760 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:13:06.928045 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 51129.7us
I20260709 12:13:06.908412 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:06.933681 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.939218 26621 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 12:13:06.942584 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.953537 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:06.958446 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:06.959510 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:06.958568 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:06.961953 26622 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
W20260709 12:13:06.959637 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 76633.3us
I20260709 12:13:06.974768  1922 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:06.946949  2051 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 12:13:06.936934  1965 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:06.976547  1965 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:06.978825 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:06.979813 26620 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:06.982931 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:06.983958 26465 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 21: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:06.975172 26467 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:06.974668 26464 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 12:13:06.990654 26618 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
W20260709 12:13:06.993112 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 84808.4us
I20260709 12:13:06.947175  2064 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:06.995038 26472 pending_rounds.cc:85] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 12
I20260709 12:13:07.001040 26472 pending_rounds.cc:107] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 22.13
W20260709 12:13:07.004050 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.007019 26439 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:07.001313 26472 raft_consensus.cc:2889] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:07.016316 26439 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:07.022953 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:07.023655 27167 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:07.014637 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:06.999537  2064 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:07.006971  2025 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:07.033989 26468 raft_consensus.cc:2410] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 14.
I20260709 12:13:07.031819 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:07.071951  2064 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:07.074608 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.075194  1836 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:07.018699  1935 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:07.076107 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:07.077275  1939 consensus_meta.cc:287] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.589s	user 0.013s	sys 0.000s
I20260709 12:13:07.000483  1900 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 12:13:07.031860  1850 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:07.081614 27167 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:13:07.029892  1735 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:07.098600 26466 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:13:07.018512  2038 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:07.096072  2059 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:07.018857  1922 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:13:07.149438  1922 raft_consensus.cc:3055] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:13:07.107563 26514 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.68:35069 timed out after 2.004s (SENT) [suppressed 26 similar messages]
I20260709 12:13:07.118280 26467 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:07.130363 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 54339.1us
I20260709 12:13:07.131006  2029 raft_consensus.cc:2764] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election decision vote started in defunct term 24: won
I20260709 12:13:07.156813  2038 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:07.122946  1935 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.136013 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.135820  1831 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:07.149531 26469 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:07.158968 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:07.119302 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 102309us
I20260709 12:13:07.135110  1836 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:07.162200 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:07.165512  1935 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:07.176277 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:07.177028 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.178663 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:07.180936 26621 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31. Ops: [30.20-30.20]
I20260709 12:13:07.182017  2059 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:07.183212 26464 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:07.184446  1967 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:07.185822  1831 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:07.188391  2025 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 29.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:07.190199 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:07.191918  2026 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:07.192420  2026 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:07.193297  2026 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 30.20, Last appended by leader: 20, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:07.193689  1807 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:07.161432  1735 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:07.195232  2029 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 12:13:07.196857 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:07.223104 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.225674 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.150142  1922 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:07.141351  1939 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:07.229679  1831 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:13:07.232797 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 54257.9us
I20260709 12:13:07.233855  1967 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:07.238620  2029 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Stepping down as leader of term 25
W20260709 12:13:07.239396 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 63293.4us
I20260709 12:13:07.248253 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:07.254166 26467 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:13:07.249658  1939 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:07.250159  1831 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:07.252117  2054 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:07.265988 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.266234  2054 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:07.266748  2054 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:07.266826 26467 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:13:07.267938 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:07.267802  2054 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:07.268504  1831 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:07.268816 26467 raft_consensus.cc:2410] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 14.
I20260709 12:13:07.269170  2054 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:07.269703 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.252849  1760 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:07.270771 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.271170  1760 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:07.271780  1760 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:07.272056 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.272811 26464 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:13:07.272684  1760 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:07.273738 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.253507  1922 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:07.275372  1922 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:07.275511 26362 catalog_manager.cc:5697] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:07.252892 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:07.248369 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:07.281309 26473 raft_consensus.cc:2376] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27. Re-sending same reply.
I20260709 12:13:07.282642 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.283306 26473 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:13:07.284286 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:07.285442 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.286914  2055 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:07.288743 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:07.221645  1871 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:07.289844  1871 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:13:07.291882 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.262315 26465 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:07.297538 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.299532 26467 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:07.290326  1871 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:07.306290 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.293932 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:07.301069 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:07.307286 26464 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:13:07.304879 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.305441 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:07.302878 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.308424 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:07.316411 26614 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:07.309226 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.316712 26465 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:13:07.317332 26466 raft_consensus.cc:2410] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 14.
I20260709 12:13:07.274197  1760 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:07.309860 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:07.321579 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.327337 26466 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:07.304160 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.298776  2026 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:07.336537 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:07.336894 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.338208 26439 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:07.340739 26464 raft_consensus.cc:2410] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 14.
I20260709 12:13:07.343334 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.277740 26362 catalog_manager.cc:5697] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:07.343742 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:07.344206 26466 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 21: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:07.344359 26617 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:07.344722 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.345610 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.333290 26473 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:07.263412  2029 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:07.310606  2023 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:07.358007 26465 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:13:07.324867  2022 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:07.302840  2025 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.038s
I20260709 12:13:07.368968 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:07.356793 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 68149.8us
I20260709 12:13:07.333884  2038 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:07.370985 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.336490  1850 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:07.373421 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:07.342499  1831 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.342346  2059 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:07.377864 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:07.375550 26620 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:07.373152  2038 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:07.388765 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.401008 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:07.401796 26465 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
W20260709 12:13:07.404239 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 105520us
I20260709 12:13:07.373608  2052 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:07.437146 26466 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
W20260709 12:13:07.436831 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 129610us
I20260709 12:13:07.456328 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.457139 26467 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:13:07.400650  2038 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:07.402277  2020 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:07.466298 26468 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:07.466621 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:07.480957 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.408505  2059 raft_consensus.cc:697] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:07.497855 26617 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
W20260709 12:13:07.481196  2063 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.584s	user 0.016s	sys 0.000s
I20260709 12:13:07.402822  1831 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:07.381830  1850 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:07.509068 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:07.373456  1735 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:07.482313  2020 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:13:07.525475  2075 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 12:13:07.526504  2076 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:13:07.529047 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:07.546938 26619 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:13:07.482003  2002 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
W20260709 12:13:07.549165 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.535120  1915 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.480916  2029 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:07.560070  1812 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:07.564731  2063 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:07.568930  2081 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.351s	user 0.006s	sys 0.000s
I20260709 12:13:07.529367  1935 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:07.591673  2062 consensus_queue.cc:1175] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3262bf0553e543eea76794fc529a9acc" responder_term: 25 status { last_received { term: 25 index: 18 } last_committed_idx: 18 last_received_current_leader { term: 25 index: 18 } }
W20260709 12:13:07.596658  2080 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:13:07.566897  2088 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.598547  2088 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:07.601387  2078 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:13:07.562285  2040 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.022s
I20260709 12:13:07.603046  2063 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:07.604763  2040 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:07.605458  2063 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:07.579276  2020 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:07.564985  2064 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:07.609450 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:07.610203 26545 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:07.610309 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:07.610786 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:07.611081 26540 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:13:07.611541 26548 raft_consensus.cc:2393] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 18: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:07.610364 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:07.612624 26539 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 22: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:07.612521 26618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:13:07.613348 26618 raft_consensus.cc:606] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:13:07.616953  1935 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:07.619266  2085 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:13:07.574731  1915 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:07.629727 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 141253us
I20260709 12:13:07.605428  2040 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:07.630771 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.640527 26545 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:07.642455 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:07.646818 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:07.648522 26620 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:13:07.663935 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:07.666043 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:07.666427 26543 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:07.666786 26540 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:07.668183 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:07.669152 26548 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:13:07.672762 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.673046 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.674702 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:07.675572 26619 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:07.677809 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.572181  1965 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 12:13:07.684713 26621 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:07.686260 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.684682 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:07.647666  2063 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:13:07.709172 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 55417.4us
I20260709 12:13:07.647759  1820 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 12:13:07.712235 26473 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:07.576865  2059 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:07.737607 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.703550 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:07.670964  2064 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:07.714699 26548 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:07.693105  2088 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:07.829864 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:07.850857 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 203483us
I20260709 12:13:07.854379 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:07.851750 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.864363 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:07.868582 26619 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:07.880685 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.888731 26619 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:13:07.707285  2063 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:07.878846  1967 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:07.899869 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:07.904255  2091 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.904953  2091 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:07.905503  2079 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.689s	user 0.005s	sys 0.008s
I20260709 12:13:07.895923  1820 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:07.906899  1820 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:07.907317  2091 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:07.907868  1820 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:07.909265  1820 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:07.911044  1915 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:07.912303 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:07.915472 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:07.888168  2064 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:07.924537  2064 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:13:07.967593 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 114152us
I20260709 12:13:07.969444 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:07.971072 26439 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:07.972416 26469 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:07.711802  2040 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:07.982441  2060 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:07.982506 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:07.983147  2060 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:07.983366 26543 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:13:07.983563 27168 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: []
W20260709 12:13:07.998653 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:07.992499 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 128193us
I20260709 12:13:07.915839  1850 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:08.002027 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:07.921823  2091 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:07.917920  1831 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:07.974186  2064 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:07.922739  1915 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:08.001441 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:08.020514 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:08.028892 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:08.030305 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 60957.5us
I20260709 12:13:07.915022  2052 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.089s
I20260709 12:13:07.920938 26540 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:13:08.036324 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:13:08.031279 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 329095us
I20260709 12:13:07.979468  1967 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:07.983609  2060 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:08.043635 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:07.922325  2038 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:07.992566  2097 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:08.057770 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:08.056921 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:08.067201  2101 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:08.068048  2101 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:08.069083  2101 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.069235  1967 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 26.13, Last appended by leader: 13, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.048292  2096 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:08.074559  2099 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.075245  2099 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.078053  1831 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:08.078233 26548 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:08.078727 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:08.078886  1831 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:08.079319  2083 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.623s	user 0.000s	sys 0.007s
I20260709 12:13:08.080488  2040 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:08.080168  1831 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.084336  2038 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:08.084558  1836 raft_consensus.cc:3055] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:08.085014  1836 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:08.087303  2102 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:08.088007  2102 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:08.088465  2102 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:08.090129  2082 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.555s	user 0.000s	sys 0.001s
I20260709 12:13:08.090454 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:08.107971 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:08.091814 26362 catalog_manager.cc:5697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:08.108790 26543 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:13:08.107364 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:08.091876  2094 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:13:08.048277  2095 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.115026 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:13:08.114300 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:08.056386  2097 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:08.126418 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:08.128422 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 71042.9us
I20260709 12:13:08.129673 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:08.135340 26542 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:08.056560  2103 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:08.112571 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 114739us
I20260709 12:13:08.141779 26540 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:13:08.113116  2092 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:13:08.147074 26546 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:08.142443 26472 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 16. (term mismatch)
I20260709 12:13:08.147822 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:08.142987 26541 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:08.140800 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:08.160041 26544 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:08.159436 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:08.150681 26470 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:08.148149 26472 pending_rounds.cc:85] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 15
I20260709 12:13:08.166927 26472 pending_rounds.cc:107] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 25.16
I20260709 12:13:08.167374 26472 raft_consensus.cc:2889] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:08.171433 27168 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 12:13:08.170037 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:08.175570 26541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:13:08.140460  2096 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:08.178454 27162 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 26. Ops: []
I20260709 12:13:08.125777  2097 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:08.182181 27168 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 12:13:08.187085 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:08.194898 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:08.196653 27166 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:08.180581  1735 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:08.198329  1735 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:08.211592  2026 consensus_meta.cc:287] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.871s	user 0.007s	sys 0.009s
I20260709 12:13:08.215531 27168 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15.
I20260709 12:13:08.231666 27165 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 25. Current term is 26. Ops: []
W20260709 12:13:08.233027  1760 consensus_meta.cc:287] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.908s	user 0.011s	sys 0.001s
W20260709 12:13:08.238535 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 206275us
I20260709 12:13:08.239508 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:08.239806  2099 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:08.240401  2099 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.240926  2099 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:08.241915 26513 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:08.243014  2105 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:08.202813  2100 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.153s
I20260709 12:13:08.203755  2106 consensus_queue.cc:1059] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.097s
W20260709 12:13:08.247515  2073 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 1.017s	user 0.013s	sys 0.022s
I20260709 12:13:08.247967  1836 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.249207  2063 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:08.286716 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:08.218878 26469 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:13:08.215376 26467 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:08.161592  2035 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:08.274487 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:08.271395 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:13:08.221259  1922 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.945s	user 0.012s	sys 0.000s
I20260709 12:13:08.286729 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:08.201061  1735 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:08.270201  2054 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.001s	user 0.008s	sys 0.011s
I20260709 12:13:08.290650 26468 raft_consensus.cc:2410] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 31 because replica has last-logged OpId of term: 30 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 29 index: 19.
W20260709 12:13:08.275621  2089 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.706s	user 0.007s	sys 0.000s
I20260709 12:13:08.299095  1836 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:08.299220 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:08.300078 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:08.300858 26465 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:13:08.305002  2029 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:08.350828 27165 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 21: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:08.310596 26362 catalog_manager.cc:5697] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 15 to 18, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 18 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:08.269923  2105 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.354028  2105 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:08.319156 26541 raft_consensus.cc:606] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:08.355350 26541 raft_consensus.cc:614] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:13:08.325268 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 50945.5us
I20260709 12:13:08.342854 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:08.348184 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:08.344202 26539 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:08.345695 26543 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:08.289531  2038 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:08.320837  1871 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.992s	user 0.015s	sys 0.000s
I20260709 12:13:08.353334  1939 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:08.356076 26540 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:08.318893  1850 raft_consensus.cc:3055] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:08.356237 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:08.371691 27168 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:13:08.325695  2063 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:08.126825  2095 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:08.418562 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 62421.2us
I20260709 12:13:08.420892 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:08.424311 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:08.425218 27168 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:08.424311 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:08.421145  2063 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:08.433090  2063 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.428859  2038 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:08.434882  2038 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:08.435364  2038 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:08.440129  2095 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:08.442066  2063 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:08.446530  2099 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:08.455097 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1361) took 1159 ms. Trace:
I20260709 12:13:08.456133 26540 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 12:13:08.457650  1812 consensus_meta.cc:287] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.873s	user 0.013s	sys 0.000s
I20260709 12:13:08.455682 26615 rpcz_store.cc:276] 0709 12:13:07.295348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.295773 (+   425us) service_pool.cc:224] Handling call
0709 12:13:07.296234 (+   461us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:07.303305 (+  7071us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:07.303355 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:07.318711 (+ 15356us) log.cc:844] Serialized 52 byte log entry
0709 12:13:07.480435 (+161724us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:07.480495 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:07.480586 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:08.072084 (+591498us) spinlock_profiling.cc:243] Waited 9.17 ms on lock 0x7b48000cded8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507b003aa1 00007f507affab37 00007f507affa9ca 00007f507b0f226f 00007f507b0f1f37 00007f507b10655c 00007f507b106508 00007f507b106488 00007f507b106443 00007f507b1056ec 00007f507a02fa96
0709 12:13:08.241578 (+169494us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:08.454804 (+213226us) raft_consensus.cc:1685] finished
0709 12:13:08.454833 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:08.455024 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26670,"raft.queue_time_us":4605,"raft.run_cpu_time_us":37848,"raft.run_wall_time_us":766620,"spinlock_wait_cycles":38002816,"thread_start_us":94508,"threads_started":1,"wal-append.queue_time_us":163789}
I20260709 12:13:08.458122  1812 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:08.459867 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:08.463582  1939 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:08.464076  1939 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.464427  1939 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:08.467360 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4222) took 1554 ms. Trace:
I20260709 12:13:08.469640 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:08.468915 26471 rpcz_store.cc:276] 0709 12:13:06.912921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:06.926106 (+ 13185us) service_pool.cc:224] Handling call
0709 12:13:06.952121 (+ 26015us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:06.982868 (+ 30747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:06.982901 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:06.983694 (+   793us) log.cc:844] Serialized 52 byte log entry
0709 12:13:07.008006 (+ 24312us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:07.008048 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:07.008121 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:08.246566 (+1238445us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:08.467046 (+220480us) raft_consensus.cc:1685] finished
0709 12:13:08.467070 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:08.467285 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":152,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":29222272,"thread_start_us":23826,"threads_started":1,"wal-append.queue_time_us":140305}
I20260709 12:13:08.421969  1967 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:08.473104 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:08.474467  2099 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:08.478866 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:08.479552 26543 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:08.385811  1871 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.484481  1871 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:08.485487 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 356727us
I20260709 12:13:08.492209  2060 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.494962 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:08.501559 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:08.502012 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:08.502982 27163 raft_consensus.cc:2376] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 15. Re-sending same reply.
I20260709 12:13:08.504112 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:08.504789 27162 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:13:08.502533 27160 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:08.505599 26546 raft_consensus.cc:2410] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 24 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 12:13:08.505824 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:08.506489 27166 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:13:08.507529 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:08.508356 27167 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:08.509816 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:08.510563 27159 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:13:08.532539 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:08.486313 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:08.534839 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48637.2us
I20260709 12:13:08.537348 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:08.538054 26548 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:08.536044 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:08.548414 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:08.554129 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:08.561371 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:08.561978 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:08.417673  1850 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:08.562666 27168 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:08.555673 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:08.556592 26539 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:13:08.556737 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:08.557436 26618 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
I20260709 12:13:08.558164 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:08.566088 26616 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:08.558568 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:08.559569 26617 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:13:08.570220 26545 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 15: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:08.570384 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:08.571382  2002 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:08.571978 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:08.572678 26545 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:13:08.575819 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:08.564116 26615 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:13:08.577287 26620 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:08.581878 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:08.491729  2102 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:08.586772 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:08.583817 26471 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 19: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:08.583930 26613 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: [24.17-24.17]
I20260709 12:13:08.584756 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:08.578033 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:08.585474 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:08.543103  1871 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:08.595737 26472 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:13:08.596956 26614 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:08.584278 26439 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:08.605676 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:08.605036 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:08.553010  2060 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:08.611282 26548 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:08.616472 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:08.472540  2038 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:08.606984  2110 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:08.623013 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:08.624037 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:08.626559 27159 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:13:08.591271  1871 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.628084 26548 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 12:13:08.628690 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 159093us
I20260709 12:13:08.629920 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:08.587209  1922 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:08.607486  2091 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.607182  2002 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:08.636423 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:08.637151 27168 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:13:08.614928  2025 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:08.640704 26543 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:13:08.641829 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:08.602022  2097 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.625381  2029 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:08.590835  2024 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.045s
W20260709 12:13:08.674958 27134 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.008s	sys 0.012s
I20260709 12:13:08.633221  2060 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:13:08.621377  2100 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:08.589181  2059 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.047s
I20260709 12:13:08.634301  1871 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:08.721913 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:08.724831 26547 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 12:13:08.725136 26472 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:08.726473  2115 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:08.727149  2115 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:08.728144  2115 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.728881  2020 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:08.644930  1852 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 12:13:08.731802  1852 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:08.732178  1852 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:08.733067  1852 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.636772  2095 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:08.644411  2023 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.097s
I20260709 12:13:08.638517  2054 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.079s
I20260709 12:13:08.676877 26543 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24. Ops: []
W20260709 12:13:08.735101 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:08.691797 27134 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.009s	sys 0.012s
I20260709 12:13:08.743434  2102 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:08.735997 26465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 4269) took 1322 ms (client timeout 1532 ms). Trace:
I20260709 12:13:08.744652  2038 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:08.674671  2063 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.751441  2063 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.716359  2108 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.134s
W20260709 12:13:08.754192 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:08.754298 26546 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:13:08.712390  2106 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:13:08.755280  2054 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.755882  2054 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:08.711742  1922 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:08.749996 26465 rpcz_store.cc:269] 0709 12:13:07.437317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.439531 (+  2214us) service_pool.cc:224] Handling call
0709 12:13:08.735763 (+1296232us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54001a8454. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:08.735905 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1877783936}
I20260709 12:13:08.758324  2054 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:08.750222  1935 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:08.760192  1935 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:08.760701  1967 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:08.678793  2101 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:08.763738 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 3090) took 1046 ms. Trace:
I20260709 12:13:08.763969 26545 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:08.764209 26468 rpcz_store.cc:276] 0709 12:13:07.717810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.819522 (+101712us) service_pool.cc:224] Handling call
0709 12:13:08.763505 (+943983us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b54001c2354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:08.763648 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":940163968}
W20260709 12:13:08.688259 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 58462.2us
I20260709 12:13:08.642271  2025 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.717114 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4237) took 1577 ms. Trace:
I20260709 12:13:08.740893  2095 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:08.766700  2095 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:08.766255  2025 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:08.763768  2101 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.734359  1852 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:08.766543 26473 rpcz_store.cc:276] 0709 12:13:07.139439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.370190 (+230751us) service_pool.cc:224] Handling call
0709 12:13:07.370539 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:07.718032 (+347493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:08.716849 (+998817us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54003d0c54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:08.717061 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":785200384}
I20260709 12:13:08.771093  2101 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:08.771615 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:08.775390 26542 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:13:08.776310 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:08.778062 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:08.778448 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:08.778707 27168 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:08.779819 26618 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:08.781170 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:08.781812 26618 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:08.712117  1735 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:08.782820 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:08.782938  1735 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:08.778810 26616 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:13:08.785290  1735 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:08.785373  2025 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.744843  2097 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:08.786604 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:08.789674  2108 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.790645  1895 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:08.790351  2108 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:08.791263  1895 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.793109  2108 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:08.793423  1895 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:08.794507 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:08.795149  2060 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:08.786753 26540 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:08.795812  2060 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.786906 26547 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:08.799520 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:08.799831 27168 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:08.763921  2063 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:08.675925  2064 consensus_meta.cc:287] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.002s
I20260709 12:13:08.802783 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:08.805166 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:08.821269 27159 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:08.686666  2040 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:08.797413 26547 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 25 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:08.800637 26618 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:08.796772 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:08.810921 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:08.807515 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:08.841462 26540 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:08.742072  2023 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:08.824841 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:08.825021  2060 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:08.825369 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:08.825621 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:08.825788 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:08.826520 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:08.827579 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:08.850821 26465 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:13:08.850102 26468 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:08.828855  1935 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:08.830761 26364 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57044 (request call id 316) took 34898 ms (client timeout 15000 ms). Trace:
I20260709 12:13:08.831210 27165 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:13:08.747233  2100 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:08.795316 26362 catalog_manager.cc:5697] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 13 to 16, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 16 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:08.835282  2025 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:08.836404  2105 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.819056 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:08.679400  2088 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:08.824033 27167 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24. Ops: [23.18-23.18]
W20260709 12:13:08.844127 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:08.889391 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:08.844444 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44998.3us
I20260709 12:13:08.890168 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:08.841462 26616 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:13:08.847591 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:08.818452  2097 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:08.758431  1922 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:08.848392  2023 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:08.852834  1820 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:08.862704 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:13:08.881780 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 63841.2us
I20260709 12:13:08.865116  2100 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:08.846220 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:08.863003 26547 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:08.898317 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:08.839286  2064 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.901643 26615 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:08.834657  2099 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:08.855499  2066 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:08.674860  1850 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:08.916509 26541 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 23: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:08.918226 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:08.643213  2091 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:08.920377 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:08.899127  2029 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.909590 26545 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:08.923362 27168 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 15: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:08.922204 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:08.900748  2097 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.925508 26547 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:08.926054 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:08.920061  1935 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:08.926422 26540 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
W20260709 12:13:08.928599 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 323634us
I20260709 12:13:08.934135 26465 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:08.858199  2002 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.676894  2110 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.935521  2066 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.937767  2091 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:08.858870 26364 rpcz_store.cc:269] 0709 12:12:33.931853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.934603 (+  2750us) service_pool.cc:224] Handling call
0709 12:13:08.830501 (+34895898us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:04.975878 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:04.976671 (+   793us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:04.976729 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:13:04.976768 (+    39us) tablet.cc:662] Decoding operations
0709 12:13:05.039186 (+ 62418us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:05.039312 (+   126us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:05.039348 (+    36us) tablet.cc:685] Acquiring locks for 23 operations
0709 12:13:05.041878 (+  2530us) tablet.cc:701] Row locks acquired
0709 12:13:05.041938 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:13:05.042168 (+   230us) write_op.cc:270] Start()
0709 12:13:05.063166 (+ 20998us) write_op.cc:276] Timestamp: P: 1783599185042078 usec, L: 0
0709 12:13:05.073306 (+ 10140us) op_driver.cc:348] REPLICATION: starting
0709 12:13:05.145708 (+ 72402us) log.cc:844] Serialized 9069 byte log entry
0709 12:13:05.299859 (+154151us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:05.501617 (+201758us) op_driver.cc:464] REPLICATION: finished
0709 12:13:05.566599 (+ 64982us) write_op.cc:301] APPLY: starting
0709 12:13:05.566714 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:05.768297 (+201583us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:05.768356 (+    59us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:05.982619 (+214263us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:06.019078 (+ 36459us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=0,mrs_lookups=0
0709 12:13:06.019174 (+    96us) write_op.cc:312] APPLY: finished
0709 12:13:06.135289 (+116115us) log.cc:844] Serialized 204 byte log entry
0709 12:13:06.170922 (+ 35633us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:06.171175 (+   253us) write_op.cc:454] Released schema lock
0709 12:13:06.171279 (+   104us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:06.171861 (+   582us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:06.171907 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":320941,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":64569,"apply.run_cpu_time_us":43243,"apply.run_wall_time_us":605220,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100175,"num_ops":23,"prepare.queue_time_us":109294,"prepare.run_cpu_time_us":45699,"prepare.run_wall_time_us":276072,"raft.queue_time_us":111554,"raft.run_cpu_time_us":22225,"raft.run_wall_time_us":37308,"replication_time_us":428114,"spinlock_wait_cycles":51040384,"thread_start_us":199025,"threads_started":4,"wal-append.queue_time_us":86787,"wal-append.run_cpu_time_us":55862,"wal-append.run_wall_time_us":2045729}]]}
I20260709 12:13:08.939981 26542 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:08.939527  1939 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:08.940400  2063 consensus_queue.cc:1059] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 12:13:08.909804  2059 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:08.977317  2066 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:08.909621  2054 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.898564  2105 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:08.941833 26546 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:08.899434  2106 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:08.995146 26613 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:08.918535  2060 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:08.952601 26619 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:08.932454  1922 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:13:08.954098 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:08.856874  1871 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.963124  2002 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.970984  2110 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:09.019568 26622 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:13:08.948817  2097 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:08.931070  1836 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:13:08.948293  1852 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:08.975908 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:08.984768 26615 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:09.023332 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:08.977838  2059 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:08.949702  2029 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:08.989828 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:08.955565  2098 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.011s	sys 0.011s
I20260709 12:13:08.963438  2025 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:09.008200 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:09.008744 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 54733.8us
I20260709 12:13:09.019078 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:08.987165 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:09.038185 27160 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:13:08.960171  2087 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 12:13:09.033211 27168 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:09.041015 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:09.041963 26614 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:08.982548  2024 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 12:13:09.022249  2106 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:09.018875  2102 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:09.042516 26616 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:09.043430 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:09.048560 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3403) took 1048 ms. Trace:
W20260709 12:13:09.035969  2098 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.012s	sys 0.011s
I20260709 12:13:09.053617 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:09.049769 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:09.054687 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:09.062960 26613 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:09.028182  1852 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:09.086884 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:09.061949 26615 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:13:09.059852 26619 rpcz_store.cc:276] 0709 12:13:07.999947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:08.000154 (+   207us) service_pool.cc:224] Handling call
0709 12:13:08.032063 (+ 31909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:09.007382 (+975319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:09.048270 (+ 40888us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b5400194454. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:09.048469 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2116544384}
I20260709 12:13:09.004558  2054 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:09.090687 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 103638us
W20260709 12:13:09.049377  2122 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:13:09.064999 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:09.093847 26613 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:09.097261 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:09.044765  2022 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.041545  2060 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:09.046496  2024 consensus_queue.cc:1243] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 23.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:13:09.087872  1852 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:09.042465 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 152380us
I20260709 12:13:09.052016  2029 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:09.102192 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:09.102372 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:09.102735 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:09.048743  2106 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:09.107306 26614 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
W20260709 12:13:09.115675 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:09.092631  2063 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:09.121920 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:09.125782 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:09.126521 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:09.097591  2066 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:09.086146  2055 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 12:13:09.139599 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:09.052106  1735 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.055s
I20260709 12:13:09.087890  2026 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:13:09.096312  2129 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:09.140058 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53244us
W20260709 12:13:09.132669 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 156737us
I20260709 12:13:09.101735  2115 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:09.136759 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:09.152974 26615 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:09.137534 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:09.138226 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:09.154439 26468 raft_consensus.cc:2410] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 31 because replica has last-logged OpId of term: 30 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 29 index: 19.
I20260709 12:13:09.134773 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:09.106716  1922 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:09.133880 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:09.141441 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:09.140825 26621 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:09.124174  2025 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:09.104002  2022 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:09.148000 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 256247us
I20260709 12:13:09.156424 26469 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:09.157182 26472 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 26: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:09.157449 27159 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:09.142251  1895 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:09.140895  2063 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:09.158560 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:09.172324 26470 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:09.106225  2110 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 12:13:09.146270 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:09.168406 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:09.135430  1915 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:09.162034  2108 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:09.170797  2106 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 12:13:09.187409 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:09.197167 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:09.197721 26468 raft_consensus.cc:2410] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 24 because replica has last-logged OpId of term: 23 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 17.
I20260709 12:13:09.198747  2063 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:09.201802  2040 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:09.204010  2105 raft_consensus.cc:2764] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:13:09.206466  2143 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.207080  2143 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:09.209272  2143 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:09.209560 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:09.209718  2002 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:09.193797  2138 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:13:09.194525  2135 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:13:09.210078  1939 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:09.211043  2054 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:09.212230 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:09.212447  2132 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:13:09.092957 26362 catalog_manager.cc:5697] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 20 to 25. New cstate: current_term: 25 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:09.213337 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:09.214504 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:09.214715  1871 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:09.215600 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:09.219420 26541 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 17. (term mismatch)
I20260709 12:13:09.273813 26541 pending_rounds.cc:85] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 16
I20260709 12:13:09.273880 26540 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:09.219461  2055 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:09.273907 26547 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:13:09.274223 26541 pending_rounds.cc:107] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 22.17
I20260709 12:13:09.275084 26541 raft_consensus.cc:2889] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:09.275969 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:09.276428 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:09.277065 26547 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 24: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:09.277273 26541 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 21: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:13:09.219802  2141 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:13:09.221536 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:09.279234 26539 raft_consensus.cc:2368] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 19. Current term is 20.
I20260709 12:13:09.223184 26466 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:09.224462 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:09.225884  2115 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:09.189049 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:13:09.227177  2130 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:13:09.228143 27166 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:13:09.228806 26546 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:09.160584  2064 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:09.142258  2066 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:09.233151 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:09.241453 26615 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:09.242440 26548 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:09.248025 26470 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:13:09.251251 27159 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
W20260709 12:13:09.251412 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 66213.5us
I20260709 12:13:09.254168 26471 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:09.262537 26465 raft_consensus.cc:2410] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 25 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 16.
I20260709 12:13:09.264102 26542 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 23: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:09.220137  2059 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:09.282617 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 131660us
I20260709 12:13:09.284394 26540 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
W20260709 12:13:09.284825 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 60507.9us
I20260709 12:13:09.288662 26541 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 17. (term mismatch)
I20260709 12:13:09.243356  2108 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:09.283417  2091 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 26.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 12:13:09.298270 26541 pending_rounds.cc:85] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 16
I20260709 12:13:09.307529 26541 pending_rounds.cc:107] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 22.17
I20260709 12:13:09.307883 26541 raft_consensus.cc:2889] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:09.308110 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:09.283995  2115 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.299901 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:09.314132 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:09.301350 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 112436us
I20260709 12:13:09.299500 26539 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:13:09.292017  2061 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:13:09.315783 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:09.322508 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:09.323312 26470 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:13:09.324458 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:09.325199 26466 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:09.327164 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:09.328344 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:09.343384 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:09.311086  1871 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:09.345615 26471 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:09.317059  1820 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:09.318181  2064 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.296409  1935 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:13:09.348819 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:09.318948  2115 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:09.348992 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:09.352583 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:09.354854 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:09.326728  2152 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:09.332336  1900 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:09.326329  2145 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:09.359313 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 60465.6us
W20260709 12:13:09.361567  2136 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:13:09.362432 26362 catalog_manager.cc:5697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 25 to 29. New cstate: current_term: 29 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:09.350822  2143 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:09.371770  1850 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:09.373435  2066 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:09.358098  2108 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:09.380019 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 87584.2us
I20260709 12:13:09.380698  1922 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:09.418633  2091 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.419450  2091 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:09.422430  2143 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:09.423000 26362 catalog_manager.cc:5697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 21 to 24, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 24 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:09.424854  2143 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:09.413277  2061 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.013s
I20260709 12:13:09.425086 26362 catalog_manager.cc:5697] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 16 to 22, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 22 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:09.404361  1735 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:09.426700  1735 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:09.382687 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 87368.8us
I20260709 12:13:09.428448 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:09.428056  2097 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:09.429764 26544 raft_consensus.cc:2368] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 22. Current term is 23.
I20260709 12:13:09.358248  2138 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:13:09.383832 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:09.384258 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:09.385213  2150 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:09.384987  2100 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:09.381737  1852 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:09.406728 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 51969.3us
W20260709 12:13:09.407337 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 58438.8us
I20260709 12:13:09.352286  1871 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.406278  1820 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:09.410722 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:09.444198 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:09.414168 26439 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:09.409235  2063 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:13:09.408051  2140 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.116s	user 0.004s	sys 0.013s
I20260709 12:13:09.434857 26471 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:13:09.435436 26468 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:13:09.441202  2060 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:09.441411  1852 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:09.464214 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 53562.5us
I20260709 12:13:09.387881  2064 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:09.443222 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:09.434221  2138 raft_consensus.cc:697] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:09.473860 26617 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 25. Current term is 26. Ops: []
W20260709 12:13:09.465575  2147 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:13:09.466670  1900 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:09.437832  2150 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:09.500861  2144 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:09.501731  2100 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:09.463800  1871 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:09.502385  2102 raft_consensus.cc:3055] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:09.505687  1735 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:09.506300  2023 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:09.507447  2097 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:09.459839  2110 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:13:09.511886  1935 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:09.616640  1935 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:09.617146  1935 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:09.501242 26362 catalog_manager.cc:5697] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 17 to 18, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 18 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:09.459583  1895 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.146s
I20260709 12:13:09.620339  1895 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:09.620786  1895 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:09.620839  2150 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:09.533294  2054 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 12:13:09.534643 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 91690.3us
I20260709 12:13:09.622423  2150 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:09.622574  2054 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:09.623623  2054 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:09.624469 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:09.624873  2054 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:09.534803  2060 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:09.477749 27133 leader_election.cc:400] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 19. Current term is 20.
I20260709 12:13:09.625662  2060 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:09.466913  2063 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:09.475162 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:09.626228  2060 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:09.561515 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:09.628783 26539 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:09.422278  2091 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:09.585350 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:09.590839 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:09.591665 26465 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:13:09.592410 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:09.463491  2059 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.135s
I20260709 12:13:09.446820  2022 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:09.598125 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:09.602156 26469 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:09.581146 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:09.602360 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:09.638065 26466 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 21: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:09.602873 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:09.638619 26541 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:09.638875 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 57857.6us
I20260709 12:13:09.606971 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:09.639693 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:09.640386 26468 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:09.608803 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:09.641089 26544 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:09.609695 26620 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:09.610765 26472 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 29 index: 14. (index mismatch)
I20260709 12:13:09.611227  2102 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:09.531838  2020 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:09.625761 27133 leader_election.cc:403] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:13:09.543367  2138 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:09.603652  2095 consensus_meta.cc:287] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.836s	user 0.003s	sys 0.012s
W20260709 12:13:09.626824 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 151762us
I20260709 12:13:09.560433 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:09.621698  1895 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:09.601922  2024 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:13:09.652570 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 181009us
I20260709 12:13:09.626355  2063 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:09.632498 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 218385us
I20260709 12:13:09.608153 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:09.619971 26362 catalog_manager.cc:5697] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 16 to 19, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 19 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:09.643895 26465 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:09.659260 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:09.650233 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:09.634573  1900 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:09.661312 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:09.635485  2098 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.654742 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:09.668876  1820 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:09.669354  2145 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:09.669423  2040 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:09.634361  1852 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 12:13:09.649296  2020 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:09.642552  2143 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:09.659452  1812 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:09.656313  2144 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 19. Current term is 20.
I20260709 12:13:09.679503 26439 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:09.651739  2100 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:09.655694  2095 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:09.758322  2020 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:09.764117  2020 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:09.765429  2095 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:09.690687  2158 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:09.688657  2098 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:09.766619  2158 raft_consensus.cc:3055] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:09.675694  2024 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:09.767575 26464 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:09.692708  2038 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:09.768814  2026 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:09.769182  2024 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:09.769290  2026 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:09.769876  2026 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:09.770504  1935 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:09.772862  1935 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:09.757005  2102 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:09.719985 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55153.8us
I20260709 12:13:09.683555 26467 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:13:09.775579  2102 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:09.756669 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 60401.5us
W20260709 12:13:09.756616 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:09.776715 27133 leader_election.cc:400] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 22. Current term is 23.
I20260709 12:13:09.694640  2101 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:09.777323  2101 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.777734  2101 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:09.763166  2100 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.782796  2100 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:09.767073  2158 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:13:09.761516 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 82089.6us
I20260709 12:13:09.716711 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:09.784045 27133 leader_election.cc:403] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:09.655467  1836 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 12:13:09.714726  1895 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:09.718427  2051 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:09.789634 26465 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:09.804210 26514 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:09.790171 26471 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25. Ops: []
W20260709 12:13:09.790774 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 109697us
I20260709 12:13:09.719254  2143 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.792385 26439 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:09.723964  1820 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:09.832038 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:09.688274  2105 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.096s
W20260709 12:13:09.837631 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 45323.6us
I20260709 12:13:09.843629 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:09.774042  2144 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.055s
I20260709 12:13:09.842679 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:09.852703  2173 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:09.788918  2091 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:09.864123 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:09.866534 26465 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:09.833463  1922 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:09.870496 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:09.873915 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:09.874725 26620 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:13:09.870314 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:09.803622  2038 consensus_queue.cc:1243] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 23.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:13:09.836409  2061 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 23
W20260709 12:13:09.868894 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 180413us
I20260709 12:13:09.848670  1967 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:09.939203 26622 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 21. Current term is 22. Ops: []
W20260709 12:13:09.933108 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 307701us
I20260709 12:13:09.936018 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:09.840548  2143 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:09.854315  2173 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.846006  2105 consensus_queue.cc:1243] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 25.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:13:09.845284  2108 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:09.845715  1852 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.940376 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:09.951843 26618 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:09.942313 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:09.944145 26614 pending_rounds.cc:85] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 15
I20260709 12:13:09.945063 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:09.954697 26614 pending_rounds.cc:107] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260709 12:13:09.955176 26614 raft_consensus.cc:2889] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:09.947679 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:09.956924 26467 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 19: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:09.954159 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:09.839075  1935 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.101s
I20260709 12:13:09.938297  2097 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:09.868598  2159 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:09.933525  1900 raft_consensus.cc:697] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:09.971418 26467 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:13:09.976754 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:09.944676  2040 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:09.990545  2040 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:09.968171 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:09.873170  2059 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.093s
I20260709 12:13:09.872447  2022 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
I20260709 12:13:09.954317  2138 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:09.999697 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:09.874415  2091 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:10.011198 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 167632us
I20260709 12:13:09.942574  2051 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 12:13:09.969775  2064 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:10.020494 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 180203us
I20260709 12:13:09.967422  2173 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.023850 26514 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:10.049322 26618 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:10.028416  2099 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:10.022799  1967 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:09.984464  2159 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.044409 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:09.964607  1852 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:10.065073 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.006685  2138 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:10.003345  2169 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:13:10.088768 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:09.968923  1820 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.039620  2164 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:09.940034  2158 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.059149  1831 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:10.064332  2051 consensus_queue.cc:1243] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 12:13:10.130647 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.084257  2159 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:10.090616  2095 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:10.099583 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 99992.9us
I20260709 12:13:10.059126  2099 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:10.062196  2097 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 12:13:10.087153  2138 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:13:10.145485 26541 consensus_meta.cc:287] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.004s
W20260709 12:13:10.148612 26468 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
I20260709 12:13:10.157277 26541 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:13:10.157430 26468 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:10.171466  2101 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:10.134166  2166 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:13:10.134428  2144 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:13:10.167348  2150 consensus_meta.cc:287] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.004s
I20260709 12:13:10.204124 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:10.205513 27168 raft_consensus.cc:2410] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 23 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 12:13:10.208974 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:10.176705  2176 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.181290  2055 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:10.209762 27167 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:10.186782  2158 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:10.184626  1850 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:10.120051  2164 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.112221  1900 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.220538 26541 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:10.158608  2095 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.196952  2108 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:10.193320  1831 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:10.224171 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:10.228634 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:10.232133  2101 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:10.235036  1967 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:10.236792  2169 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 25 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:10.238670 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:10.246306  2168 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:13:10.201968  2150 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.217727  2186 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:10.248147 26541 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:13:10.198505  2144 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.269418 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:10.254158 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:10.259254 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:10.260124 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:10.222201  1939 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:10.227020  2165 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.247761 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:10.272495 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:10.249174  2097 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Stepping down as leader of term 24
W20260709 12:13:10.307260 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 215510us
I20260709 12:13:10.243530  2029 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:13:10.310372 26514 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:10.316757 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:10.217806  2099 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.325723 26514 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:10.222893  2176 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.298764  1939 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.308172  2054 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:10.299263  2097 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:10.332902 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:10.333683 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 94291us
I20260709 12:13:10.336040 26539 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:13:10.282670  2150 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.345077  2150 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:10.341450 26468 raft_consensus.cc:1217] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Deduplicated request from leader. Original: 21.10->[23.11-29.14]   Dedup: 24.12->[26.13-29.14]
I20260709 12:13:10.346103 26468 pending_rounds.cc:85] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 12
I20260709 12:13:10.346468 26468 pending_rounds.cc:107] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 25.13
I20260709 12:13:10.346822 26468 raft_consensus.cc:2889] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:10.350888 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:10.372414  2196 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:10.373277 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:10.374343  2190 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:10.376240  2202 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:10.375842  2175 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:13:10.359771  2026 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.567s	user 0.016s	sys 0.000s
I20260709 12:13:10.336658  2173 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:10.274730  2186 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.377557  2099 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:10.369987  1820 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:13:10.333590  1836 consensus_queue.cc:1175] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aaadfdd9ca9f424c91505f9b43876233" responder_term: 24 status { last_received { term: 22 index: 14 } last_committed_idx: 14 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:13:10.377967  1852 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:10.405081 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 70809.6us
I20260709 12:13:10.307742  2165 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.409500 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:10.381605  2196 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.413228 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:10.417465  2196 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:10.420557 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 69927.4us
I20260709 12:13:10.360607  2054 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.393503  2150 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:10.426230 27133 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:10.395596  2202 raft_consensus.cc:697] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:10.433173 27168 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:10.402209  2145 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:10.435393  2178 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:10.438588  2177 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:13:10.359615  1967 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.439325  2055 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:10.439643  2177 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:10.440229  2177 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 25 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:10.440595  1850 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:10.441144  1850 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:10.420006  2173 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:10.442659  2162 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.271s	user 0.002s	sys 0.000s
I20260709 12:13:10.442811  2173 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:10.444569  2167 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 12:13:10.445218  1939 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:10.445468  2173 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:10.446794 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3119) took 1116 ms. Trace:
I20260709 12:13:10.447703  2165 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:10.448230  2176 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:10.448371  2202 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:10.449481  2179 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
W20260709 12:13:10.450562  2174 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 12:13:10.451001  2095 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:10.359695  1831 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.446141  2173 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 12:13:10.450994  2152 consensus_meta.cc:287] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.039s	user 0.014s	sys 0.000s
I20260709 12:13:10.392778  2026 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.447218 26470 rpcz_store.cc:276] 0709 12:13:09.330881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:09.410146 (+ 79265us) service_pool.cc:224] Handling call
0709 12:13:09.411588 (+  1442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:09.413720 (+  2132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:09.413757 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:09.557150 (+143393us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b2c000327f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:13:09.557785 (+   635us) log.cc:844] Serialized 26 byte log entry
0709 12:13:09.792564 (+234779us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:09.792601 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:09.792678 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:10.446469 (+653791us) raft_consensus.cc:1685] finished
0709 12:13:10.446491 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:10.446723 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5658,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":38395264,"thread_start_us":234233,"threads_started":1,"wal-append.queue_time_us":414171}
I20260709 12:13:10.476364 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:10.327036  2108 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.439939  2055 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:10.441184  2177 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.485555 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:13:10.442292  2100 consensus_meta.cc:287] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.659s	user 0.009s	sys 0.000s
I20260709 12:13:10.486528 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:10.369560  2169 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:10.493572 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.461835  2165 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:10.477545  2115 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.070s	user 0.014s	sys 0.000s
W20260709 12:13:10.520236 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.481989  2152 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:10.528776 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:10.521442  2173 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:10.533291  2180 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 12:13:10.534159  2182 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:13:10.437285  2150 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:10.537781 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.478190  1915 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.049s
I20260709 12:13:10.430384  2097 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:10.535132  2197 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:13:10.523742  2029 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.476768  2145 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:10.561542 26439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.021s	sys 0.010s
W20260709 12:13:10.535135  2198 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:13:10.483772  2024 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.055s
W20260709 12:13:10.567191 26439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.021s	sys 0.011s
W20260709 12:13:10.573625 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 82576.3us
I20260709 12:13:10.569834  1852 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:10.570343  2029 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:10.571245  2204 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:13:10.508671  2100 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.572332  2195 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:10.571641  2184 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.051s
W20260709 12:13:10.566133  2022 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.001s	sys 0.028s
I20260709 12:13:10.583395 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:10.607342 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:10.584721 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:10.588224 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:10.589577 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:10.608469 27163 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:10.595238 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:10.603010 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.592267 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:10.594991 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:10.610684 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:10.613320 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:10.610430 27166 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:10.527724  2115 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.527961  2165 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.619788 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:10.594945  2191 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 25.20, Next index: 21, Last known committed idx: 19, Time since last communication: 0.164s
I20260709 12:13:10.602950 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:10.621050 26621 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:10.603937  2098 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:10.604874  2145 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:10.605509  2063 consensus_meta.cc:287] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.922s	user 0.005s	sys 0.010s
I20260709 12:13:10.584349 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:10.626221 26467 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
W20260709 12:13:10.611459  2022 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.001s	sys 0.029s
I20260709 12:13:10.616726 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:10.590449  2097 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:10.553030  2173 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.600907  2100 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:10.598598 27160 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:10.633298 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:10.638057 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:10.596413  2026 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:10.642831 26546 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:13:10.627349 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:10.637262 26439 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:10.640689 26618 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 23: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:10.617233  2208 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:10.641175 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:10.649439 26470 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
I20260709 12:13:10.617646  2024 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:10.645463 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:10.642216 27160 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:10.587764  1852 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:10.647326  1871 consensus_meta.cc:287] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.033s	user 0.011s	sys 0.003s
I20260709 12:13:10.615902  2178 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:10.649997 26544 raft_consensus.cc:2410] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 25 because replica has last-logged OpId of term: 24 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 12:13:10.657289 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:10.648980 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:10.661633 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:10.668931 26547 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:10.668794 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:10.656798 27160 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.645814  2022 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:10.673638 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:10.680261 27160 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:10.652490  2024 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:10.681516 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.682698 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:10.666518  1871 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.684604 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:10.693006  2206 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:10.693535  2206 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.693899  2206 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:10.695159 26547 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 12:13:10.697259  2143 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.728s	user 0.000s	sys 0.012s
I20260709 12:13:10.635895  2063 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.699623 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:10.707115 26621 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:13:10.714040 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:10.710666 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:10.715009 27160 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:13:10.715191 26617 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:10.671311  2191 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:10.715826 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:10.729036 26546 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:10.730695  2098 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:13:10.731374  2098 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 32 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:10.732091  2178 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.732517  2098 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 30.20, Last appended by leader: 20, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.683781  2024 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:10.732725  2178 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.735802 26615 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:10.741056 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:10.716957  2173 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:10.729039  2102 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.953s	user 0.015s	sys 0.000s
I20260709 12:13:10.742192  1915 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:10.752539  2211 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:10.784868  2211 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:10.754835 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:10.785986  2211 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.786509 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:10.787125 26617 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:10.757616 27163 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:13:10.758548  2219 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.709697  2143 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.725317  2191 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:10.763809  2138 consensus_meta.cc:287] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.564s	user 0.006s	sys 0.005s
I20260709 12:13:10.717140  2054 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:10.773298 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:10.783033  1915 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.784053  2059 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:10.784759  1850 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:10.810410 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.786006  2115 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:10.655248  2208 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:10.791802 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.797896 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:10.790453  2060 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.147s	user 0.013s	sys 0.001s
W20260709 12:13:10.789502  2159 consensus_meta.cc:287] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.000s
W20260709 12:13:10.790129  1895 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.953s	user 0.012s	sys 0.000s
I20260709 12:13:10.758011  2206 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.795476  2191 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:10.810077  1915 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:10.829449 26617 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:10.809612  2150 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:10.825497 26472 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:10.811643  2101 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:10.826349  2221 log.cc:927] Time spent T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:13:10.823568  2060 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.847931 26620 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:10.834137  2206 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:10.837038 26613 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 12:13:10.836835  2024 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.838943  2178 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:10.841311  2165 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:10.789891  2219 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:10.843974  2061 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.904s	user 0.011s	sys 0.003s
I20260709 12:13:10.839700  2029 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:10.819802  2138 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.842327  2063 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:10.847293  2060 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:10.823225  2059 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.844354  2196 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.871753  1850 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:10.868371  2225 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:13:10.872869  2186 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:10.893288  2024 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:10.895473  2055 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.827754  2159 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.867316  2061 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 22. Current term is 23.
I20260709 12:13:10.928848 26545 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:10.849874  2101 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.937429 26539 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:10.937299 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:10.926185  2158 consensus_meta.cc:287] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.686s	user 0.013s	sys 0.000s
I20260709 12:13:10.942183 26542 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: [20.11-22.12]
I20260709 12:13:10.943912  2110 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:10.947306 26467 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 23: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:10.944461  2110 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:10.953459  2110 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.954710  2110 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:10.955590  2224 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:13:10.937744  2115 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.963217  2138 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:10.964951  2196 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:10.966923  2101 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:10.968214  2208 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:10.969957  2159 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:10.937515  2063 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.936688  2102 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.979677 26541 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:10.976068  2158 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.974056  2184 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.972900  2145 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:10.980420  2165 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.982316  2063 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.990478  1915 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:10.993418  2158 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:10.978106  2115 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:11.004878 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.990034  2143 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:11.006296 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1143) took 1785 ms. Trace:
I20260709 12:13:11.000356  2165 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:11.007622  2219 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:10.985451  2102 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:11.007330 26464 rpcz_store.cc:276] 0709 12:13:09.221158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:09.223581 (+  2423us) service_pool.cc:224] Handling call
0709 12:13:09.223892 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:09.768047 (+544155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:11.006019 (+1237972us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b540035f7d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:11.006232 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1249855872}
I20260709 12:13:11.009338  2165 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:11.010000  2102 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:11.010069  2063 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:10.999099  2145 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:11.013762  2145 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:11.014035 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4285) took 1413 ms. Trace:
I20260709 12:13:11.014649 26466 rpcz_store.cc:276] 0709 12:13:09.601884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:09.647781 (+ 45897us) service_pool.cc:224] Handling call
0709 12:13:09.648104 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:09.782864 (+134760us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:13:09.783304 (+   440us) log.cc:844] Serialized 14 byte log entry
0709 12:13:10.226493 (+443189us) log.cc:844] Serialized 14 byte log entry
0709 12:13:10.260402 (+ 33909us) log.cc:844] Serialized 14 byte log entry
0709 12:13:10.263139 (+  2737us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:10.263363 (+   224us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:10.263632 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:11.013653 (+750021us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54000690d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:11.013710 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:11.013966 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7193,"prepare.queue_time_us":1310,"prepare.run_cpu_time_us":158,"prepare.run_wall_time_us":9798,"raft.queue_time_us":151098,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":26435,"spinlock_wait_cycles":369364992,"thread_start_us":442364,"threads_started":2,"wal-append.queue_time_us":309228}
I20260709 12:13:11.018432  2115 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:11.020213  2059 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:11.020738  2161 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 1.181s	user 0.003s	sys 0.000s
I20260709 12:13:10.997365  2184 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:11.022066  1915 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:11.022985  2123 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 12:13:11.023092  2184 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:11.027333  2055 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:11.028756  2158 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:11.026280  2023 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:11.032620  2192 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:11.033094  2192 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:11.033355  2191 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:11.035743  2191 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:11.045403 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4281) took 1450 ms. Trace:
I20260709 12:13:11.046120 26471 rpcz_store.cc:276] 0709 12:13:09.594968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:09.642697 (+ 47729us) service_pool.cc:224] Handling call
0709 12:13:09.642973 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:09.837157 (+194184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:11.045002 (+1207845us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54001c0a54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:11.045299 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326992128}
I20260709 12:13:11.057317 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:11.059593 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:11.071885 27162 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:11.061064 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:11.069810 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.034049  2192 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:11.082070 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:11.180050 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:11.088032 26539 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:11.092445 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:11.182116 26613 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:11.182904 26543 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:13:11.129433 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.116916 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:11.133828 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:11.163443 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:11.061389 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:11.267812 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:11.128829 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:11.310798 26618 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:11.307921 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:11.134280 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:11.313025 26617 raft_consensus.cc:2410] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 12:13:11.313565 26471 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:11.134811 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:11.161676 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:11.371989 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:11.529227 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 211541us
W20260709 12:13:11.511021 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.530810 26618 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 16.
I20260709 12:13:11.456578 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4215) took 1038 ms. Trace:
I20260709 12:13:11.533304 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:11.351567 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:11.535452 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.529629 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:11.525816  2145 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.535491 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:13:11.554695 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:11.535579 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.175858 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:11.540611 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:11.352994 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:11.320638 26464 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 25: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:11.575608 26545 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:13:11.128388 26467 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:11.124539 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:11.082011 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:11.169950 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:11.088917 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:11.533015 26615 rpcz_store.cc:276] 0709 12:13:10.417886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:10.418104 (+   218us) service_pool.cc:224] Handling call
0709 12:13:10.418514 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:10.738682 (+320168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:11.456151 (+717469us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54003a4b54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:11.456471 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":729228032}
I20260709 12:13:11.175536  1900 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:11.122087  2170 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.966s	user 0.000s	sys 0.002s
I20260709 12:13:11.581243 26539 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 24: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:13:11.409660  2207 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.855s	user 0.003s	sys 0.000s
W20260709 12:13:11.607343  2243 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:13:11.607263 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:11.607601 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4289) took 1927 ms. Trace:
I20260709 12:13:11.613270 26470 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:13:11.148558  2175 consensus_queue.cc:1059] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.442s
I20260709 12:13:11.161922  2192 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:11.151299  2201 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.517819  2184 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:11.117034  1871 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:11.612345 26619 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:11.412896  2144 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:11.314786  2115 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:13:11.167369  2157 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 1.375s	user 0.000s	sys 0.006s
I20260709 12:13:11.616329 26472 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
W20260709 12:13:11.618268 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 536293us
I20260709 12:13:11.615442 26620 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 23: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:11.613307 26473 rpcz_store.cc:276] 0709 12:13:09.680633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:09.680797 (+   164us) service_pool.cc:224] Handling call
0709 12:13:09.715329 (+ 34532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:09.715717 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:09.715749 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:09.755826 (+ 40077us) log.cc:844] Serialized 26 byte log entry
0709 12:13:09.957572 (+201746us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:09.957616 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:09.957689 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:11.121203 (+1163514us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:11.607278 (+486075us) raft_consensus.cc:1685] finished
0709 12:13:11.607306 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:11.607539 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2588,"raft.queue_time_us":5261,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":13042,"spinlock_wait_cycles":34603264,"thread_start_us":193931,"threads_started":1,"wal-append.queue_time_us":320621}
I20260709 12:13:11.623562 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:11.659169 26539 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:11.627990 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:11.632112 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:11.609999 26613 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:11.634321 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:11.457803  2091 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:11.127318  2181 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.679111 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4292) took 1712 ms. Trace:
I20260709 12:13:11.679824 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3278) took 1111 ms. Trace:
I20260709 12:13:11.661398 26469 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:11.643000 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:11.679607 26465 rpcz_store.cc:276] 0709 12:13:09.967280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:09.969681 (+  2401us) service_pool.cc:224] Handling call
0709 12:13:09.970023 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:10.372787 (+402764us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:13:10.373194 (+   407us) log.cc:844] Serialized 14 byte log entry
0709 12:13:10.431490 (+ 58296us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:10.432113 (+   623us) log.cc:844] Serialized 26 byte log entry
0709 12:13:10.432318 (+   205us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:10.432370 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:10.432456 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:11.177485 (+745029us) spinlock_profiling.cc:243] Waited 9.85 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:11.678741 (+501256us) raft_consensus.cc:1685] finished
0709 12:13:11.678860 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:11.679035 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21769,"prepare.queue_time_us":224,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":145013,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":28668,"spinlock_wait_cycles":22648704,"thread_start_us":432543,"threads_started":2,"wal-append.queue_time_us":88386}
I20260709 12:13:11.680346 26544 rpcz_store.cc:276] 0709 12:13:10.580503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:10.581305 (+   802us) service_pool.cc:224] Handling call
0709 12:13:11.667995 (+1086690us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b5400140354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:11.679754 (+ 11759us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88188160}
I20260709 12:13:11.682262 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:11.408020  2152 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:11.102245  2055 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.693559 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:11.694301 26473 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:11.646806 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:11.696636 26464 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:11.536886  2158 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:11.608223  2193 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.706276  2193 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:11.708763  2193 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:11.346279  2064 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:11.710089  2064 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.710623  2064 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:11.644541  2195 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:11.713660  2195 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:11.714772  2195 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:11.653215  2201 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:11.677700  2244 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:13:11.718523  2201 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:11.675740 26539 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:11.658617  2115 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:11.687551 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:11.690582 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3293) took 1101 ms. Trace:
I20260709 12:13:11.611244  1900 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:11.723152 27162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 1048) took 1260 ms. Trace:
I20260709 12:13:11.723533 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3432) took 1854 ms. Trace:
I20260709 12:13:11.665263  1871 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.723599 27162 rpcz_store.cc:276] 0709 12:13:10.462752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:10.463178 (+   426us) service_pool.cc:224] Handling call
0709 12:13:11.722946 (+1259768us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b540071af54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:11.723051 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1074077056}
I20260709 12:13:11.650297 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:11.663218  2184 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:11.702803 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:11.609035  2145 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:11.724398  1900 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:11.746294 26548 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
I20260709 12:13:11.678305  2181 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:11.758338 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:11.759737 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:11.760691 26465 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 23: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:13:11.690949  2023 consensus_meta.cc:287] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.659s	user 0.011s	sys 0.003s
W20260709 12:13:11.758558 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.761970 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:11.736730 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:13:11.747535 27168 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 1057) took 1535 ms (client timeout 1909 ms). Trace:
I20260709 12:13:11.761001 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:11.706143  2158 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:11.767325 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:11.778220 27168 rpcz_store.cc:269] 0709 12:13:10.211987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:10.238234 (+ 26247us) service_pool.cc:224] Handling call
0709 12:13:11.747310 (+1509076us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54003b5e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:11.747451 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":395921280}
I20260709 12:13:11.779384  2144 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.712924  2064 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:11.724342  1871 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:11.724028 26614 rpcz_store.cc:276] 0709 12:13:09.868773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:09.869934 (+  1161us) service_pool.cc:224] Handling call
0709 12:13:09.937640 (+ 67706us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:09.963016 (+ 25376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:09.963049 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:09.963640 (+   591us) log.cc:844] Serialized 52 byte log entry
0709 12:13:10.166274 (+202634us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:10.166320 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:10.166428 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:11.720769 (+1554341us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b24002bf178. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072e739c4 00007f5072e71acb 00007f507302cdc9 00007f507302ca55 00007f507302bfb0 00007f5075ca2488 00007f5075ca2be8 00007f5075c7a398 00007f5075c7576a 00007f5075c74bb6
0709 12:13:11.723222 (+  2453us) raft_consensus.cc:1685] finished
0709 12:13:11.723254 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:11.723474 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":450,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":28677,"spinlock_wait_cycles":9307392,"thread_start_us":179044,"threads_started":1,"wal-append.queue_time_us":344954}
I20260709 12:13:11.786971 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:11.787916 26465 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:11.780941  2184 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:11.781639 26471 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:11.782171 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:11.792363 26470 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:13:11.722138 26546 rpcz_store.cc:276] 0709 12:13:10.589179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:10.927983 (+338804us) service_pool.cc:224] Handling call
0709 12:13:10.941322 (+ 13339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:10.943477 (+  2155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:10.943516 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:10.944200 (+   684us) log.cc:844] Serialized 52 byte log entry
0709 12:13:10.991401 (+ 47201us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:10.991445 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:10.991521 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:11.690328 (+698807us) raft_consensus.cc:1685] finished
0709 12:13:11.690351 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:11.690511 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1309,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":11006,"thread_start_us":46748,"threads_started":1,"wal-append.queue_time_us":233412}
I20260709 12:13:11.786561  1850 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.794615 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:11.795439 26467 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:13:11.789749  2144 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:11.687227  2108 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.746138  2191 raft_consensus.cc:3055] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:11.723152  2115 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:11.803071 26467 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 16. Current term is 17. Ops: []
W20260709 12:13:11.808827  2110 consensus_meta.cc:287] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.854s	user 0.014s	sys 0.000s
I20260709 12:13:11.759846  2181 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:11.811489  2144 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:11.692968  2152 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:11.794512  1922 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:11.814929  1922 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:11.799216  1850 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:11.806180  2108 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:11.807173  2191 raft_consensus.cc:740] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:11.832365 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3291) took 1243 ms. Trace:
I20260709 12:13:11.832998 26541 rpcz_store.cc:276] 0709 12:13:10.588672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:10.616526 (+ 27854us) service_pool.cc:224] Handling call
0709 12:13:11.832084 (+1215558us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b540037e1d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:11.832268 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825975552}
I20260709 12:13:11.799985  2023 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:11.800215  2064 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.839830 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:11.846345 27168 raft_consensus.cc:2410] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 27 because replica has last-logged OpId of term: 26 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 15.
I20260709 12:13:11.775807  2055 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:11.840821 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:11.847203 27162 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:13:11.841928 26472 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 25. Current term is 26. Ops: []
W20260709 12:13:11.829608  2123 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.136s	sys 0.238s
W20260709 12:13:11.850229 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.864876 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:11.865669 26621 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 15.
I20260709 12:13:11.827991  1900 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.878001 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:11.878824 26614 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
W20260709 12:13:11.886336 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 307622us
I20260709 12:13:11.887135 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:11.888074 26622 raft_consensus.cc:2410] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
W20260709 12:13:11.890202 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:11.864141  2123 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.136s	sys 0.238s
I20260709 12:13:11.893576 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:11.878634  2023 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:11.882893  2164 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:11.896347  2110 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.897639  2145 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:11.855228  2064 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:11.932119  2108 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:11.889322  1900 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:11.932346  2181 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:11.933010  2175 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.933858 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:11.934588  2020 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.940899  1922 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:11.948024 26473 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 27.
I20260709 12:13:11.963328 26467 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:11.882510  2115 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 12:13:11.875025  2152 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 25.20, Last appended by leader: 20, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:11.961761  2108 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:11.961609 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:11.969589 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:11.973664 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.946329  2023 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:12.011126 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 475679us
I20260709 12:13:11.982698 26613 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:11.961995  2175 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:11.976050  2108 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:12.000847  2152 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:11.997001  2158 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:12.015503 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:12.005505  2184 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:11.968595  2020 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:12.074122 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 58747.2us
I20260709 12:13:12.014058  1871 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:11.968287  2181 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:12.034296  2095 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 12:13:12.041137  1922 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:12.084758  2115 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:13:12.085899  2025 consensus_queue.cc:1059] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:12.049816 26464 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
I20260709 12:13:12.033198  1852 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:12.074828  2250 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:12.076186 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:11.956516  2110 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:12.092962 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:12.064929  2108 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:12.061908  2169 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.013s	sys 0.032s
I20260709 12:13:12.098589 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:12.094298  1852 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:12.102583 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:12.108321  2110 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:12.108690  2175 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:12.115052 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:12.115945 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:12.116659 26622 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:13:12.116719 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:12.117375 26619 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:13:12.118295 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:12.119153 26621 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:12.122581 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:12.095811  2020 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:12.128707 26614 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 12:13:12.096910  2169 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.014s	sys 0.032s
I20260709 12:13:12.111843  2145 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:12.138144 26620 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 29 index: 19. Preceding OpId from leader: term: 32 index: 21. (index mismatch)
I20260709 12:13:12.122797  2222 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:12.131451  2250 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:12.146495  1871 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:12.147011  1900 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:12.147619  2064 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:12.125660  2175 consensus_queue.cc:1059] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:13:12.142270 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:12.148758 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.149644 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3437) took 1549 ms. Trace:
I20260709 12:13:12.154896 26613 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:12.176384 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:12.149196 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 491809us
I20260709 12:13:12.147694 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 1250) took 1068 ms. Trace:
I20260709 12:13:12.158353 26621 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:12.179384 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:12.183465 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:12.179493 26619 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:12.184584 26464 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 25: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:12.180584 26548 rpcz_store.cc:276] 0709 12:13:11.080850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.087562 (+  6712us) service_pool.cc:224] Handling call
0709 12:13:12.147415 (+1059853us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b5400110dd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:12.147606 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486437760}
I20260709 12:13:12.185290 26473 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 18. Current term is 19. Ops: []
W20260709 12:13:12.147675 26586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.021s	sys 0.038s
W20260709 12:13:12.186264 26586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.021s	sys 0.038s
I20260709 12:13:12.188566 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:12.154685 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:12.189335 26614 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:12.178912 26616 rpcz_store.cc:276] 0709 12:13:10.600526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:10.600683 (+   157us) service_pool.cc:224] Handling call
0709 12:13:10.601033 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:10.673522 (+ 72489us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:13:10.819613 (+146091us) log.cc:844] Serialized 14 byte log entry
0709 12:13:10.924076 (+104463us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:10.924134 (+    58us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:10.924180 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:12.149322 (+1225142us) spinlock_profiling.cc:243] Waited 72.2 ms on lock 0x7b54001b0654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:12.149395 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:12.149571 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1447,"prepare.queue_time_us":135063,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":2129,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":4383,"spinlock_wait_cycles":166122752,"thread_start_us":213734,"threads_started":2,"wal-append.queue_time_us":127588,"wal-append.run_cpu_time_us":1674,"wal-append.run_wall_time_us":1049306}
W20260709 12:13:12.201682 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 47116.1us
I20260709 12:13:12.199134 26439 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:12.220155 26466 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:13:12.222203 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:12.223186 26615 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
W20260709 12:13:12.224511 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 82330.2us
I20260709 12:13:12.201992 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:12.226231 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:12.227209 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:12.227901 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:12.228170 26621 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:13:12.232700 26621 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:12.235146 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:12.236289 26621 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:12.235430 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:12.168648  2250 raft_consensus.cc:697] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:12.232457 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:12.242409 26473 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 23: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:12.247313 26615 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:13:12.265960 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 383801us
I20260709 12:13:12.251089 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:12.275249 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:12.250161 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:12.277194 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:12.274852  2020 consensus_queue.cc:1059] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 12:13:12.281638 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:12.239557  2201 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:12.203720  2110 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:12.283272 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:12.244442  2222 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:12.286638 26617 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 27: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:12.282178 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:12.203137  1900 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.071s
I20260709 12:13:12.237990  2195 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:12.238215  1852 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:12.293452 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:12.239352  2252 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.298667 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:12.265161  2145 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:12.305617 26541 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:13:12.298667 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:12.299448 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:12.301040 26615 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:12.275491  2175 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:12.302083 26439 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:12.310010 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:12.316777  2253 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:12.317302  2253 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:12.317668  2253 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:12.319481 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:12.320525 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:12.244220  2064 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 12:13:12.286970  2184 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:12.287045  2201 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:12.303494  2020 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:12.319617  1922 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:12.303030  1852 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.302711  2195 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:12.295567  2110 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:12.319813  2181 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:12.322382  2095 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:12.338454 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:12.330724  2020 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:12.325489  2184 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.341800 26542 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:13:12.328287  2201 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:12.325822  2175 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:12.334087  1852 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:12.335219  1922 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.312115  2252 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:12.372044 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 317295us
I20260709 12:13:12.365556  2095 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.402892  2095 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:12.334244  2195 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:12.404363 26620 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:12.406975  2201 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:12.378911 26621 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
W20260709 12:13:12.393988 26438 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.864s (SENT) [suppressed 9 similar messages]
I20260709 12:13:12.371085  2184 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:12.410797 26618 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:13:12.410130  2175 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:12.389483  1922 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:12.419296  2257 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:13:12.420847  1850 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:12.394138  2020 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:12.395784  2177 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:12.399255  2193 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:12.400709 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4293) took 2060 ms. Trace:
I20260709 12:13:12.408130  2099 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.393524  2181 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:12.422703 26620 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:12.383533  1900 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.434962  2020 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:12.438280  2252 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:12.439440  2201 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:12.441215  1922 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:12.447978  2191 consensus_queue.cc:260] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:12.309615  2250 consensus_queue.cc:237] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:12.430235 26468 rpcz_store.cc:276] 0709 12:13:10.340186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:10.340576 (+   390us) service_pool.cc:224] Handling call
0709 12:13:10.341120 (+   544us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:13:10.384128 (+ 43008us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:13:10.398870 (+ 14742us) log.cc:844] Serialized 14 byte log entry
0709 12:13:10.787287 (+388417us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b18002db8c0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:13:11.846218 (+1058931us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b18002db8c0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a23a 00007f50760e4a2a
0709 12:13:12.191839 (+345621us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:12.192684 (+   845us) log.cc:844] Serialized 52 byte log entry
0709 12:13:12.192890 (+   206us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:12.192940 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:12.193043 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:12.400421 (+207378us) raft_consensus.cc:1685] finished
0709 12:13:12.400445 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:12.400623 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45639,"prepare.queue_time_us":14673,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":43254,"raft.run_cpu_time_us":475,"raft.run_wall_time_us":30605,"spinlock_wait_cycles":54668800,"thread_start_us":323951,"threads_started":1,"wal-append.queue_time_us":1916516}
I20260709 12:13:12.401721  2108 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:12.471545 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 268835us
I20260709 12:13:12.500859 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:12.422295  2256 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:12.463099  2192 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:12.490756 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 208158us
W20260709 12:13:12.504331 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.492771 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1245) took 2557 ms. Trace:
W20260709 12:13:12.479429 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 229319us
I20260709 12:13:12.515398 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:12.508213 26540 rpcz_store.cc:276] 0709 12:13:09.935412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:09.935632 (+   220us) service_pool.cc:224] Handling call
0709 12:13:09.935968 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:10.076548 (+140580us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:13:10.199773 (+123225us) log.cc:844] Serialized 14 byte log entry
0709 12:13:10.557643 (+357870us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:11.775168 (+1217525us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b2c0005b0f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:13:11.775611 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 12:13:12.159147 (+383536us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:12.477327 (+318180us) log.cc:844] Serialized 14 byte log entry
0709 12:13:12.492019 (+ 14692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:12.492224 (+   205us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:12.492413 (+   189us) raft_consensus.cc:1685] finished
0709 12:13:12.492435 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:12.492649 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39398,"prepare.queue_time_us":208680,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":2911,"raft.queue_time_us":73381,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":10979,"spinlock_wait_cycles":6502144,"thread_start_us":1248276,"threads_started":5,"wal-append.queue_time_us":975211,"wal-append.run_cpu_time_us":1437,"wal-append.run_wall_time_us":1056436}
I20260709 12:13:12.512668 27134 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:12.463376  2193 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:12.491312  2222 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:12.534637 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:12.532049 27134 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:12.501796  2201 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:12.499038  2172 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:12.540918  1922 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:12.481736  1900 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:12.542680  2169 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:12.477200  2099 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:12.543906  2061 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:12.531303  2123 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.512112  2263 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:12.549598 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:12.551723 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:12.551983 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:12.556010 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:12.564366 27162 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:12.548178  2201 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.551307  2191 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:12.562490 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:12.550601  2265 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.576604 27159 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:13:12.535899 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:12.567849 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:12.511826  2192 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:12.546654  2023 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:12.512403  2256 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:12.580011 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:12.595010 27163 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:12.580345 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:12.595855 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 275392us
I20260709 12:13:12.558805  2061 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.596928 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:12.597851 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:12.556663  2169 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:12.588209 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52379.7us
I20260709 12:13:12.588851 27162 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:13:12.580720  2038 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.572865  2201 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:12.596616 27166 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:13:12.598637 26439 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:12.604050 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:12.572310  2152 consensus_queue.cc:1059] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:13:12.615175 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:12.637770 27162 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:12.595175  2252 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:12.571697  2123 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:12.639920 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:12.601389  2061 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:12.643314 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:12.654556 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:12.658596 27163 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:12.680379 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:12.581228  2265 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:12.654297  2023 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:12.694276 27160 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:12.685412 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:12.726241 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:12.684688  2252 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:12.611552  2038 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:12.781858 26468 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:12.685806  1850 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:12.799423 26469 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:13:12.683072  1922 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.651907  2184 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:12.784406 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:12.615779  2222 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:12.775919 27166 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 23: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:12.725438  2091 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.802316 27168 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:12.802734 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:12.824086 27162 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:12.643118  2195 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:12.772428  2023 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.833994 26468 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:12.717120  2268 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:12.771564  2152 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:12.786496 27132 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.003s	sys 0.007s
I20260709 12:13:12.782143  2108 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:12.838531 27132 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.004s	sys 0.007s
W20260709 12:13:12.839962 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.797067 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:12.805142  2273 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.821677  2091 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:12.853636 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 285914us
W20260709 12:13:12.843950 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 47016us
W20260709 12:13:12.823346  2264 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 12:13:12.830919  2266 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:12.803459  2193 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:12.811945  2262 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:12.855741 27166 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 29 index: 19. Preceding OpId from leader: term: 32 index: 21. (index mismatch)
I20260709 12:13:12.859854 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:12.812415  1922 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:12.842235  2023 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:12.850598 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 238546us
I20260709 12:13:12.856329 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:12.833112  2099 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:12.866227 27163 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:12.842944  2268 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.724743  2169 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:12.899848 26439 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:12.900308 27160 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:12.879478 26469 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:12.901922 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:12.851298  2175 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:12.853446  2276 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:12.881413 26468 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:13:12.852775  2252 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:12.903090  2276 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.903677  2276 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:12.875558 27162 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:12.901310 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:12.884701 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:12.906940 26438 leader_election.cc:336] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.513s (SENT)
I20260709 12:13:12.907470 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:12.860829  2263 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:12.853009  2022 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 12:13:12.865509  2266 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:12.870817  2108 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:12.879522  1900 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:12.894640  2181 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:12.890125  1850 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:12.895316  2208 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:12.935966 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:12.926883 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:12.855804  2273 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:12.895627  2268 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:12.922233  2192 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:12.978143 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 51352.4us
I20260709 12:13:12.980316 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:12.966966  2274 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:12.985847 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:12.993649 26469 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
W20260709 12:13:12.995381 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 93536us
I20260709 12:13:12.996603 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:12.996977 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:12.934207  1871 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:12.935024  2279 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.936021  2256 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:12.887472  2262 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:13.038894 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:13.002111 26464 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:12.937187  2169 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:13.044266 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:12.998471  2289 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:13:13.035241  2279 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:12.986294  2158 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.937076  2266 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:13.073874 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:13.073364 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:13.077401 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:12.982944 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:13.046144 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:13.103402 26545 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:13:12.965756  2108 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.077386 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:13.057281 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:13.115365 26464 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:13:13.104566 26541 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:13:13.105073 26468 raft_consensus.cc:2368] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27.
W20260709 12:13:13.101071 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 169267us
I20260709 12:13:13.105886 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:12.994477  2123 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.057725 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:13.115957 26546 raft_consensus.cc:2410] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 26 because replica has last-logged OpId of term: 24 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 14.
I20260709 12:13:13.118902 26542 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:13.120652 26540 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:13:13.138564  2265 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.112058  2158 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:12.998194  2280 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.139348  2265 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:13.139958  2265 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.139652  2280 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.140848  2158 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:13.141723  2285 raft_consensus.cc:2764] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260709 12:13:13.141834  2275 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:13.142639  2280 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.142689  2285 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:13.143813  2262 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:13.144796  2275 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.145332  2275 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:13.146983  2270 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 12:13:13.147003  2311 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:13:13.148654  2295 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:13:13.149354  2275 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:13.150065  2282 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 12:13:12.999115  2252 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:13.154773  2252 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.155375  2252 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:13.157883  2279 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.160887  2110 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.162102 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3142) took 1818 ms. Trace:
I20260709 12:13:13.162536 26467 rpcz_store.cc:276] 0709 12:13:11.344044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.810195 (+466151us) service_pool.cc:224] Handling call
0709 12:13:11.963145 (+152950us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:11.963846 (+   701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:13.161889 (+1198043us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54000a4e50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:13.162033 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336515328}
I20260709 12:13:13.163592  2273 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:13.164273  2184 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:12.998456  2192 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.992761  1850 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:13.049109  2099 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.118896 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:13.058671  2022 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.150s
W20260709 12:13:13.214037 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 95222.8us
I20260709 12:13:12.991744  2208 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.226652 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:13.046643  1871 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:13.222352  2253 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.904s	user 0.008s	sys 0.007s
I20260709 12:13:13.167707  2175 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:13.122056  2271 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:13.166297  2285 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:13.228042 26438 leader_election.cc:336] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.939s (SENT)
I20260709 12:13:13.219926  2195 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.248139 26514 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:13.142279  2265 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.224442  2145 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:13.266969 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:13.207358  1850 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.146202  2276 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.260500 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:13.261734 26464 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:13:13.125077  2304 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.144s
I20260709 12:13:13.209365  2038 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.229427  2273 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:13:13.249198  2191 consensus_meta.cc:287] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.670s	user 0.013s	sys 0.000s
I20260709 12:13:13.275257 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:13.171164  2181 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:13.265066  2091 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.222178  2099 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.287734 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:13.267776  1852 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.874s	user 0.019s	sys 0.000s
I20260709 12:13:13.214319  2192 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.281700  1850 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:13.255703  2253 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.291610 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:13.125483  2263 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:13.350777  2020 consensus_meta.cc:287] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.863s	user 0.012s	sys 0.002s
W20260709 12:13:13.295184 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.292752 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:13.300061 26473 raft_consensus.cc:2410] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 25 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
W20260709 12:13:13.294795  2095 consensus_meta.cc:287] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.891s	user 0.013s	sys 0.000s
W20260709 12:13:13.309141  2309 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:13:13.317482  2099 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.309222  2281 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:13:13.308959  2298 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 12:13:13.305557  2302 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:13:13.325049 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:13.329252  2188 raft_consensus.cc:3055] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:13:13.333259 26613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 3457) took 1218 ms (client timeout 1621 ms). Trace:
I20260709 12:13:13.291082  2273 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.337831  2208 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.313652  1922 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.279817  2145 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:13.308944  2291 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:13.344393  2253 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:13.346267  2192 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.347841  2252 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:13.352938 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 60273.4us
I20260709 12:13:13.263937  2271 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:13.306079  2269 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 12:13:13.375977  2193 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:13:13.377039 26613 rpcz_store.cc:269] 0709 12:13:12.114518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:12.114682 (+   164us) service_pool.cc:224] Handling call
0709 12:13:13.332942 (+1218260us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b5400346054. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:13.333114 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89465088}
I20260709 12:13:13.307600  2055 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:13.314951  2300 raft_consensus.cc:2764] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
W20260709 12:13:13.428164 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 431598us
I20260709 12:13:13.376952  2188 raft_consensus.cc:740] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:13.424749  2222 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:13.301662  2293 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.375806  2029 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:13.309425  1852 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.290537  2250 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:13.477290 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:13.300925  1871 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:13.478626 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:13:13.471329  2298 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:13:13.499786  2145 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:13.501258  2192 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:13.501886  2192 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.502368  2192 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:13.493964  2250 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.496194  2266 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.487600  2291 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 12:13:13.494125  2271 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:13.497370  2276 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.549333 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:13.549871 26469 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:13:13.550199 27165 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:13:13.374961  2095 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.476001  2055 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:13:13.477487  2023 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.556s	user 0.017s	sys 0.001s
I20260709 12:13:13.565012  2250 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:13.565450  2055 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.568679  2303 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:13.569232  2303 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:13.569759 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:13.570436 27160 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:13.522694 26615 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:13.572883 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:13.573510 26615 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:13:13.532011 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:13.574678 26616 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:13.484874  2029 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.575860  2029 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:13.506352 26514 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:13.490670  2293 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:13.535089 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:13.565032  2266 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.579003 26614 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 26: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:13:13.579253  2314 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:13:13.580044 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:13.580240 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:13.580681  2293 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.377780  2281 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:13.581524 27168 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:13:13.533125 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:13.582207 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 46028.6us
W20260709 12:13:13.508093  2268 consensus_meta.cc:287] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.000s
I20260709 12:13:13.565572  2023 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.513492 26613 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
W20260709 12:13:13.537863  2269 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:13:13.580717 26614 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:13.557138 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:13.584227 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 77996.4us
I20260709 12:13:13.613514 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:13.612242 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 385631us
I20260709 12:13:13.590860 26622 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 28: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:13.570154  2303 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.625100  2303 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:13.628513  2201 consensus_meta.cc:287] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.012s	user 0.012s	sys 0.000s
I20260709 12:13:13.611403  2265 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:13:13.629053  2201 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.630043  2265 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:13.630502  2265 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:13.591670  1852 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:13.592490 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:13.596161  2281 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:13.526734  2108 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.605156 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:13.647150 26613 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 30: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:13.578090 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:13.648383 26619 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 27
I20260709 12:13:13.649159 27160 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:13.526201  2304 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:13.652185  2304 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:13.612607  2195 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:13:13.616034 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:13.612903  2268 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:13.656934 26614 raft_consensus.cc:2410] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 24 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 12:13:13.659070  2268 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.616365 26473 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:13.616729  1900 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:13.617164 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:13.662791 26622 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:13:13.617662  2288 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:13.617569  2099 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:13.664160  2288 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:13.618100  2321 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:13:13.618603  2296 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:13.619072 26514 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:13.619014  2297 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:13.620111  2283 raft_consensus.cc:3055] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:13.610883  2266 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:13.621562  2177 consensus_meta.cc:287] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.181s	user 0.012s	sys 0.002s
I20260709 12:13:13.668152  2283 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:13.623616  2273 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:13.623713  2095 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.503156  2188 consensus_queue.cc:260] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:13.669764  2188 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:13.669323  2283 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.671217  2283 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:13.620154 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:13.674954  2288 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:13.612794  2038 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:13.632066 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:13.653607  2304 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:13.584769  2061 consensus_meta.cc:287] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.900s	user 0.010s	sys 0.004s
I20260709 12:13:13.676833  2061 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:13.600831 26616 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:13:13.489202  2222 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:13.489015  1922 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.128s
I20260709 12:13:13.681124 27159 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 16: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:13.668438  2266 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:13.675246 26470 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 27: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:13.645045 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:13.690155 26466 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
W20260709 12:13:13.690275 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 46142.3us
I20260709 12:13:13.692090 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:13.694085  2061 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.694571  2222 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:13.696576  2266 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:13.698743 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:13.700423  2253 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:13.700922  2253 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.701309  2253 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:13.707413  2201 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:13.711055 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:13:13.717207 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 98234.1us
W20260709 12:13:13.733178 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.682179  2256 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:13.779888 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 147883us
W20260709 12:13:13.780225 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 54760us
I20260709 12:13:13.765625 26439 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:13.781100 26619 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:13.782045 26587 leader_election.cc:400] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27.
I20260709 12:13:13.782478 26587 leader_election.cc:403] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:13.785355 27159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56886 (request call id 1242) took 1207 ms. Trace:
I20260709 12:13:13.789218 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:13.785983 27159 rpcz_store.cc:276] 0709 12:13:12.578429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:12.579209 (+   780us) service_pool.cc:224] Handling call
0709 12:13:13.785045 (+1205836us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400438854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:13.785269 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2488534272}
I20260709 12:13:13.789012 26439 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:13.716585  2296 consensus_queue.cc:1243] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 28.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 12:13:13.834204 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:13.842089 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 119205us
I20260709 12:13:13.718490  2222 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:13:13.849231 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 67323.4us
I20260709 12:13:13.644470  2279 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 27.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.136s
W20260709 12:13:13.848032 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 66907.4us
I20260709 12:13:13.854589 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:13.855505 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:13.855899 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:13.856225 26465 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:13.855535 26468 raft_consensus.cc:2393] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 19: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:13.857635 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:13.858786 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:13.860044 26540 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 24: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:13.860880 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:13.861835 26545 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:13.864786 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:13.865721 26546 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:13.867336 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:13.867575 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 78651.8us
I20260709 12:13:13.778908  1900 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:13.868899 26439 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:13.882061 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:13.876344 26466 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 12:13:13.884577 26466 pending_rounds.cc:85] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 11
I20260709 12:13:13.884347 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:13.884868 26466 pending_rounds.cc:107] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 12:13:13.885181 26466 raft_consensus.cc:2889] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:13.812134  2038 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:13.880131 26464 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:13.880507 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:13.887454 26546 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:13:13.888581 26472 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 28: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:13.888957 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:13.888842 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:13.914503 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 45673us
I20260709 12:13:13.919162 26439 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:13.890664 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:13.921551 26547 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:13:13.890321 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:13.923260 26545 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:13.870573  2222 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.847033  2271 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.842968  2315 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:13.945429 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:13.920913 26542 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:13:13.931170 26465 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:13:13.711712  2265 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.789885  2256 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.881009  2266 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:13.962684 26439 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:13.875922  2313 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:13.846310  2250 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.106s
I20260709 12:13:13.915378  2177 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:13.919991  2038 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.038733  2038 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:14.040580  2029 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.042091 26621 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 12:13:13.980568 26545 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:13:14.044536  2055 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:14.048924  2023 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:14.049887  2023 raft_consensus.cc:3055] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:14.054739  2023 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:14.055764  2023 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.057221  2023 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:14.060376  2291 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:14.060963  2291 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:14.061643  2177 raft_consensus.cc:697] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:13.932142  2025 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:14.081822 26588 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:13.954375  2315 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:14.025645  2253 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:13.957229  1967 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
I20260709 12:13:13.954324  2186 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.953385  2095 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:13.974660  1852 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27.
I20260709 12:13:13.964870  2252 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:13.966131  2266 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.890058  2208 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.123s
I20260709 12:13:13.950284  2222 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:14.015064 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 52488.4us
I20260709 12:13:14.082792  2025 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.015959 26470 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:14.089749 26588 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:14.092981 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.956568  2326 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:14.062974  2177 consensus_queue.cc:237] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:13.962329  1922 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.129s
W20260709 12:13:14.114868 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.098249  2324 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:14.079941  2191 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.124398 26439 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:13.965332  2288 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:13.974622  2276 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.135s
W20260709 12:13:14.134260 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 44621.7us
I20260709 12:13:14.098551  2095 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:14.174690  2095 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:14.090634  2274 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:14.175314  2274 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:14.090960  2315 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:14.012471  2313 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:14.176611  2313 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:13.958308  2271 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.179104  2271 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:14.013458  2297 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.103s
I20260709 12:13:14.061944  2291 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 29.14, Last appended by leader: 14, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.180323  2291 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:14.114799  2266 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:14.181631  2193 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:14.182065  2253 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:14.138466  2025 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:14.186914  2181 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:14.187486  2181 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:14.187885  2181 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:14.147233  2288 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.150089  2317 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:13:14.171494  2330 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:13:14.084832  2273 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:14.182156  2193 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:14.150363  2191 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:14.190377 26438 leader_election.cc:336] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.214s (SENT)
I20260709 12:13:14.220243 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:14.192756  2288 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:14.214303  2192 consensus_meta.cc:287] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.711s	user 0.012s	sys 0.000s
I20260709 12:13:14.212570 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:14.229672 26620 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:14.210824 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:13:14.193369  2188 consensus_meta.cc:287] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.523s	user 0.012s	sys 0.000s
I20260709 12:13:14.110352  2186 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.215576 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:14.213249  2307 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:14.217592 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:14.217353 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:14.240262 27159 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:14.145153  2326 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:14.209487  2263 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.002s
W20260709 12:13:14.223348 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:14.208993  2304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.011s	sys 0.020s
I20260709 12:13:14.210701  2252 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:13:14.225203 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 341452us
I20260709 12:13:14.253428 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:14.259414 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.235023 26588 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:14.214454  2303 consensus_meta.cc:287] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.004s
I20260709 12:13:14.228431  2311 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:14.226115  2306 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.246745 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:14.227020  2029 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:14.240347  1850 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.889s	user 0.009s	sys 0.005s
W20260709 12:13:14.246495  2304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.011s	sys 0.021s
I20260709 12:13:14.220814  2273 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.289851  2273 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:14.274989 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.290766 26542 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:14.296562  2326 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:14.301120  2186 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:14.300984  2025 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:14.304030  2327 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.412s	user 0.002s	sys 0.000s
I20260709 12:13:14.240612  2332 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:14.307508  2332 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:14.242254  2307 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:14.283497 26620 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:14.287151  1850 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.238919  2038 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.252300  2252 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.281823 26545 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 12:13:14.233844  2192 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.326577 26617 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
W20260709 12:13:14.331959 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 97008.5us
I20260709 12:13:14.301478  2256 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:14.335862 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:14.341641 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:14.342453 26540 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:14.346920 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.347853 26541 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:14.350317 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 3150) took 1354 ms. Trace:
I20260709 12:13:14.340260 26588 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:14.351517 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 480247us
I20260709 12:13:14.352173 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.353128 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:14.353911 26618 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 23: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:14.367136 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.367882 26539 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:14.350858 26469 rpcz_store.cc:276] 0709 12:13:12.996394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:12.996619 (+   225us) service_pool.cc:224] Handling call
0709 12:13:14.350123 (+1353504us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54002599d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:14.350243 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1263354112}
W20260709 12:13:14.356415 26438 leader_election.cc:336] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.676s (SENT)
I20260709 12:13:14.366250 26545 raft_consensus.cc:2410] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 25 because replica has last-logged OpId of term: 24 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 12:13:14.358086 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:14.332814  2252 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:14.361985 26547 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:14.402029 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.364773 26540 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:14.374480 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:14.381984 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.399082 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.404753 26544 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 22: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:14.353066  2326 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:14.400902 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:14.401443 26617 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:14.339811  2333 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:14.400216 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:14.414431  2331 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:13:14.415432 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:14.416119 26617 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:14.416383  2038 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:14.418144  1850 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:14.425784 27134 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:14.426739 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.427485  2263 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:14.364235  1871 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:13:14.430703  1871 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:14.431252  1871 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:14.437589 26617 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:13:14.284250  2306 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:14.406445 26587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.010s	sys 0.015s
I20260709 12:13:14.407727 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.308602  2332 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:14.408537 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.441329 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:14.446244 26469 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:13:14.337749  2335 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.068s
I20260709 12:13:14.443817 26539 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:13:14.445178 26544 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:14.609660 26471 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:14.610347 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:14.440579 27134 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:14.444337 26587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.010s	sys 0.015s
I20260709 12:13:14.413156  2333 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.611567  2335 consensus_queue.cc:1243] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 27.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
W20260709 12:13:14.652503  2023 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.595s	user 0.015s	sys 0.000s
I20260709 12:13:14.624377  2029 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.612144 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:14.647759 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 3487) took 1034 ms. Trace:
I20260709 12:13:14.639175 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:14.563006 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.657312 26471 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:13:14.657960 26545 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:14.625988 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:14.659848 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:14.405025  2025 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:14.412781  2283 consensus_meta.cc:287] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.741s	user 0.014s	sys 0.001s
I20260709 12:13:14.506076 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:14.576499 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.661079 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:14.577097 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:14.577764 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:14.625557 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3484) took 1053 ms. Trace:
I20260709 12:13:14.662528 26473 raft_consensus.cc:2368] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 27. Current term is 28.
I20260709 12:13:14.575047 26547 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
W20260709 12:13:14.653191 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 212688us
I20260709 12:13:14.664482 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:14.655951 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:14.662578 26615 rpcz_store.cc:276] 0709 12:13:13.572257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:13.720003 (+147746us) service_pool.cc:224] Handling call
0709 12:13:13.720368 (+   365us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:13.723252 (+  2884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:13.723290 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:13.723878 (+   588us) log.cc:844] Serialized 52 byte log entry
0709 12:13:14.247538 (+523660us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:13:14.247576 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:14.247644 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:14.625235 (+377591us) raft_consensus.cc:1685] finished
0709 12:13:14.625256 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:14.625465 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2414,"raft.queue_time_us":2678,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":12407,"thread_start_us":362828,"threads_started":1,"wal-append.queue_time_us":556722}
I20260709 12:13:14.665526 26467 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:14.476095 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:14.528421 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.667412 26473 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 12:13:14.669210 26469 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 21: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:14.672230 27134 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:14.654039  2029 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:14.639618  2322 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.921s	user 0.002s	sys 0.000s
I20260709 12:13:14.687824 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.686064 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:14.690032 26545 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:14.627166  2338 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:14.655961 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 43932.7us
I20260709 12:13:14.694868 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.708037 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:14.710009 26539 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 23: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:14.655692 26618 rpcz_store.cc:276] 0709 12:13:13.613077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:13.613193 (+   116us) service_pool.cc:224] Handling call
0709 12:13:14.647420 (+1034227us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b540009f6d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:14.647657 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1700414208}
W20260709 12:13:14.697453 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.709380 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:14.711508 26467 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:13:14.609836  2273 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:14.721644 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.721302  2193 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:14.721809  2273 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.723690  2193 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:14.723996  2273 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:14.678925  2256 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.696971  2263 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:14.725714  2263 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:14.728076  2263 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:14.728619  2263 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:14.702829  2255 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:14.572499  2038 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:14.697328 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:14.677930 26543 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 20: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:13:14.703985  2095 consensus_meta.cc:287] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.529s	user 0.012s	sys 0.000s
I20260709 12:13:14.651708  2317 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.707403 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:14.669521  2333 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:14.697199  2025 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:14.675330  2023 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:14.714440 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:14.651921  2181 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.623134  2313 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.669862  2177 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.654363  2265 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:14.736986 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:14.696059  2055 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.037s	sys 0.072s
I20260709 12:13:14.688547  2191 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:14.743468  2317 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:14.741194 27159 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:13:14.644382  2253 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.832444  2253 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.743083 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:14.835712 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.836608 26545 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:14.624185  2266 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.680528  2310 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:14.746610 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:14.839725 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 93220.1us
I20260709 12:13:14.840656 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:14.841806 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:14.708555  2311 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.734163  2338 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.733942  2324 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.730883  2192 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:14.730731  2255 raft_consensus.cc:697] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:14.753800  2326 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:14.754581  2023 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:14.759177 26614 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:14.857815 26614 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:14.729130  2263 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:14.739305 26619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.027s	sys 0.038s
W20260709 12:13:14.860319 26619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.027s	sys 0.038s
W20260709 12:13:14.756631  2055 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.037s	sys 0.072s
I20260709 12:13:14.786866 26473 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:14.788017  2313 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:14.749284  2025 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.789582  2108 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:14.788774  2252 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:14.794843 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:14.889447 26467 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 23: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:14.795692  2029 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:14.804515 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.893324 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:14.733101  2335 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.023s
I20260709 12:13:14.805735 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.939985 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.941635 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:14.761212  2177 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.944798  2177 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:14.808382  2291 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.628s	user 0.012s	sys 0.000s
I20260709 12:13:14.724934  2256 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.808633 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.810302  2181 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:14.810881 26465 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:14.739167  2038 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:14.814682  2288 consensus_meta.cc:287] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.579s	user 0.007s	sys 0.013s
I20260709 12:13:14.816884 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:14.743161  2095 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.823829  2306 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:14.831276  2315 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.655s	user 0.012s	sys 0.000s
I20260709 12:13:14.743911  2273 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 12:13:14.846082 26464 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:14.855278 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.991051 26545 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:14.991770 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:14.992357 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.993453 26545 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 22: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:14.857964 26471 raft_consensus.cc:2368] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25.
W20260709 12:13:14.765339 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.867280 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:14.867894 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:14.813112  2333 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:14.857347 26511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.020s	sys 0.067s
W20260709 12:13:14.886607 26548 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.028s	sys 0.027s
I20260709 12:13:14.849381  1850 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:14.994381 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.998317  2333 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:14.998697 26545 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 20: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:14.996069 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:14.999136  2333 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.999632 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:14.999701  2333 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:15.000269 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:15.000599 26545 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 23: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:14.996403 26466 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:13:15.001561 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:15.002043  2333 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:14.867308  2250 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:15.004853  2250 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.942381 26540 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:15.006932  2344 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.057s	user 0.002s	sys 0.000s
I20260709 12:13:14.996721 26472 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:13:15.008229 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:15.008888 26472 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:13:15.009856 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:14.949676 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:15.010954 26543 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:15.011583 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:15.012424 26468 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 25: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:15.012174 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.996731 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:15.014870 26471 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:15.015858 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:14.996917 26511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.107s	user 0.020s	sys 0.068s
W20260709 12:13:14.997054 26548 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.029s	sys 0.027s
I20260709 12:13:14.956693 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.959690 26618 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
W20260709 12:13:14.937093  1871 consensus_meta.cc:287] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.002s
I20260709 12:13:14.961966  2188 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:13:14.984440 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:15.033344 26467 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 23: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:15.034339 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:14.857463  2324 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:14.987670 26620 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 16.
W20260709 12:13:15.039059  2349 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:13:14.988298 26541 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:15.002493 26545 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:14.992794 26464 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 23: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:15.041163 26467 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
W20260709 12:13:14.937917 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:15.003849  2095 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:14.954278  2335 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.022544 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:14.955507 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 138709us
I20260709 12:13:14.947252  2055 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:15.053776  2055 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.054371  2055 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:15.026378 26472 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 23: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:15.029222 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:15.059482 26616 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 23: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:14.967530  2291 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:15.060822  2291 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.061384  2291 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:14.852080  2311 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:15.009058  2307 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:15.067090  2307 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:14.960417  2029 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:15.068607  2029 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:15.070773  2335 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:15.071610  2029 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:15.072381 26613 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:15.026067 26540 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:15.038849 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:14.852662  2346 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:15.042050 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:15.042258 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.894832  2108 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:15.047487 26466 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:15.049743 26439 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:14.985972  2253 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:15.052937 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:14.968541  2288 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:14.987071  2315 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:15.011145  2255 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:15.074708 26471 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:15.236617 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:15.076560 26513 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:15.227195 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:15.429386 26616 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:15.429713 26467 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25. Ops: []
W20260709 12:13:15.222481 27167 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.023s	sys 0.037s
I20260709 12:13:15.184727 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:15.411417 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 361742us
W20260709 12:13:15.431277 27167 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.027s	sys 0.049s
I20260709 12:13:15.411496 26539 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
W20260709 12:13:15.271494  2145 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.339s	user 0.015s	sys 0.016s
I20260709 12:13:15.325969 26541 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:13:15.131337 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:15.379112 27133 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.017s	sys 0.014s
I20260709 12:13:15.414219 26473 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:13:15.275476  2266 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:15.414003 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:15.452692 27133 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.018s	sys 0.015s
W20260709 12:13:15.453631 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 377175us
I20260709 12:13:15.453910 26540 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:15.222977  2181 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:13:15.331218 26544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.026s	sys 0.023s
W20260709 12:13:15.466117 26544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.029s	sys 0.025s
I20260709 12:13:15.466266 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:15.466950 26541 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:15.420747  2335 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:15.419840 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3299) took 1157 ms. Trace:
I20260709 12:13:15.419960 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:15.422160 27134 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.012s	sys 0.023s
W20260709 12:13:15.455071  2145 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.526s	user 0.016s	sys 0.022s
I20260709 12:13:15.031766  2177 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.214929 26614 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:14.997562  1850 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:15.409202 26547 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.010s	sys 0.043s
W20260709 12:13:15.478976 26547 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.010s	sys 0.044s
I20260709 12:13:15.436426  2256 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:15.406733  2055 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:15.408102 26545 raft_consensus.cc:2393] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 19: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:15.144284  2342 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.368s
W20260709 12:13:15.276182  2222 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.132s	user 0.014s	sys 0.000s
W20260709 12:13:15.182893  2279 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.235s	user 0.026s	sys 0.022s
I20260709 12:13:15.451107 26615 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:15.452548 26613 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:15.455298 27132 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.026s	sys 0.033s
I20260709 12:13:15.473721  2250 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:15.066219  2311 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:15.379905  2263 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:15.391258  2025 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:15.297539  2324 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:15.425720  2306 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:15.013981  2313 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:15.425443  2252 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:15.228163  2274 consensus_meta.cc:287] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.052s	user 0.011s	sys 0.003s
I20260709 12:13:14.994508  2338 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:15.464921  2345 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.451s	user 0.001s	sys 0.000s
I20260709 12:13:15.045030  1871 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:15.453941  2038 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:15.452755  2346 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:15.464900  2192 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:13:15.480051  2023 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.011s	sys 0.006s
I20260709 12:13:15.484050  2335 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:15.487706  2332 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.027s	sys 0.046s
W20260709 12:13:15.496050  2279 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.564s	user 0.032s	sys 0.032s
I20260709 12:13:15.487205  2177 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:15.508666  2256 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:15.502512  2222 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:15.543810  2346 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:15.544262  2195 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:13:15.529177  2023 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.012s	sys 0.006s
W20260709 12:13:15.536005  2332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.027s	sys 0.047s
I20260709 12:13:15.526749  2192 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:15.529090  2354 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:13:15.551013  2315 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:15.553604  1871 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:15.559274  2288 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:15.542696  2256 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 25 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:15.519706  2274 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:15.521550  2306 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:15.521090  2313 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:15.560618  2192 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:15.543169  2335 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:15.581121  2335 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:15.581816  2307 consensus_meta.cc:287] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.514s	user 0.012s	sys 0.001s
I20260709 12:13:15.575361  2222 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:15.585475  2306 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:15.566556  2256 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:15.587947  2265 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.828s	user 0.007s	sys 0.006s
W20260709 12:13:15.418797 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:15.416934 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:15.675483 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 239348us
I20260709 12:13:15.678176 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4332) took 1007 ms. Trace:
W20260709 12:13:15.309355 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:15.814796 26469 rpcz_store.cc:276] 0709 12:13:14.671100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:14.671291 (+   191us) service_pool.cc:224] Handling call
0709 12:13:14.671674 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:14.672032 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:14.672062 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:14.678564 (+  6502us) log.cc:844] Serialized 26 byte log entry
0709 12:13:15.216292 (+537728us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:15.216336 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:15.216412 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:15.677320 (+460908us) raft_consensus.cc:1685] finished
0709 12:13:15.677394 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:15.677901 (+   507us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":483,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":13213,"thread_start_us":494780,"threads_started":1,"wal-append.queue_time_us":821690}
I20260709 12:13:15.455853 26513 leader_election.cc:400] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 27. Current term is 28.
I20260709 12:13:15.817999 26513 leader_election.cc:403] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Cancelling election due to peer responding with higher term
W20260709 12:13:15.678939 26470 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.980s	user 0.007s	sys 0.010s
W20260709 12:13:15.818766 26470 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.120s	user 0.007s	sys 0.010s
W20260709 12:13:15.819103 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 363443us
I20260709 12:13:15.819453  1900 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:15.437078 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:15.819986  1900 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:15.820978 26539 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 28: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:15.821717 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3326) took 1005 ms. Trace:
I20260709 12:13:15.455192 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:15.444033 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:15.485566 26541 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:13:15.684489 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3302) took 1343 ms. Trace:
I20260709 12:13:15.686198 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:15.473548 26548 rpcz_store.cc:276] 0709 12:13:14.262039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:14.267086 (+  5047us) service_pool.cc:224] Handling call
0709 12:13:14.275059 (+  7973us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:14.275459 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:14.275496 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:14.286242 (+ 10746us) log.cc:844] Serialized 26 byte log entry
0709 12:13:15.019007 (+732765us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:15.019070 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:15.019173 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:15.419622 (+400449us) raft_consensus.cc:1685] finished
0709 12:13:15.419643 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:15.419784 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4115,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":20034,"spinlock_wait_cycles":41856,"thread_start_us":666081,"threads_started":1,"wal-append.queue_time_us":965126}
W20260709 12:13:15.484460 26587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.011s	sys 0.026s
W20260709 12:13:15.709395 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:15.431488 26617 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:15.734895 26618 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:15.475654 26616 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:15.736630 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3486) took 2146 ms. Trace:
W20260709 12:13:15.737612 26622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.005s	sys 0.024s
W20260709 12:13:15.497987 27132 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.026s	sys 0.033s
W20260709 12:13:15.474835 27134 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.012s	sys 0.023s
W20260709 12:13:15.135486 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:15.453992 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 688731us
I20260709 12:13:15.737798 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:15.739639 27161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 1076) took 1530 ms. Trace:
I20260709 12:13:15.566107  2055 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:15.579092  2177 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:15.741349  2108 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:15.743661  2192 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:15.529748  1850 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:15.597157  2361 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:13:15.595463  2326 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:13:15.794812 26464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.014s	sys 0.004s
I20260709 12:13:15.790619 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:15.808856  2181 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:15.802372 26613 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
W20260709 12:13:15.841816 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:15.822118 26539 rpcz_store.cc:276] 0709 12:13:14.815930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.436723 (+620793us) service_pool.cc:224] Handling call
0709 12:13:15.821527 (+384804us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:15.822296 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:15.884529 26464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.016s	sys 0.005s
I20260709 12:13:15.888758 26621 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 23: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:15.827903  2256 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:15.891083 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 68959.4us
I20260709 12:13:15.892010  2038 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:15.892601  2038 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.893016  2038 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:15.893612 26513 leader_election.cc:400] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25.
I20260709 12:13:15.893930 26620 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:15.894380 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3348) took 1072 ms. Trace:
I20260709 12:13:15.871008 27161 rpcz_store.cc:276] 0709 12:13:14.209184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:14.209774 (+   590us) service_pool.cc:224] Handling call
0709 12:13:14.219774 (+ 10000us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:14.577711 (+357937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:14.577751 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:14.611195 (+ 33444us) log.cc:844] Serialized 52 byte log entry
0709 12:13:14.956975 (+345780us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:13:14.957036 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:14.957286 (+   250us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:15.738851 (+781565us) raft_consensus.cc:1685] finished
0709 12:13:15.738903 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:15.739290 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":810,"raft.queue_time_us":18539,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":2649,"thread_start_us":668206,"threads_started":2,"wal-append.queue_time_us":760206}
I20260709 12:13:15.895020 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1264) took 1234 ms. Trace:
I20260709 12:13:15.895509 26544 rpcz_store.cc:276] 0709 12:13:14.660245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:14.660395 (+   150us) service_pool.cc:224] Handling call
0709 12:13:14.678457 (+ 18062us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:14.678903 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:14.678936 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:14.704981 (+ 26045us) log.cc:844] Serialized 26 byte log entry
0709 12:13:15.466611 (+761630us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:15.466656 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:15.466726 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:15.894561 (+427835us) raft_consensus.cc:1685] finished
0709 12:13:15.894596 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:15.894843 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":24395,"thread_start_us":735777,"threads_started":1,"wal-append.queue_time_us":777433}
W20260709 12:13:15.896932  2291 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.835s	user 0.011s	sys 0.007s
I20260709 12:13:15.897590  2291 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:15.883816  2181 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:15.898767 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 1.19671e+06us
I20260709 12:13:15.898950  2338 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:15.899907  2326 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:15.901301 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3320) took 1148 ms. Trace:
I20260709 12:13:15.828596  2313 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.20, Last appended by leader: 20, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:15.918629  2195 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:15.920105  2195 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:15.904369 27167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1249) took 1209 ms. Trace:
W20260709 12:13:15.888800 26622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.007s	sys 0.029s
I20260709 12:13:15.823108  2279 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election lost for term 27. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 27. Current term is 28.
I20260709 12:13:15.894882 26545 rpcz_store.cc:276] 0709 12:13:14.821957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.685271 (+863314us) service_pool.cc:224] Handling call
0709 12:13:15.894304 (+209033us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:15.835304  2274 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:15.836983 26614 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:15.871414 26619 rpcz_store.cc:276] 0709 12:13:13.589741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:13.782940 (+193199us) service_pool.cc:224] Handling call
0709 12:13:13.784118 (+  1178us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:14.085159 (+301041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:14.085193 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:14.085823 (+   630us) log.cc:844] Serialized 26 byte log entry
0709 12:13:14.861022 (+775199us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:14.861091 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:14.861214 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:15.736041 (+874827us) raft_consensus.cc:1685] finished
0709 12:13:15.736090 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:15.736400 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":177734,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":98810,"thread_start_us":1049664,"threads_started":2,"wal-append.queue_time_us":801899}
W20260709 12:13:15.911427 26587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.012s	sys 0.027s
I20260709 12:13:15.911931  2338 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:15.917261 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3327) took 1100 ms. Trace:
I20260709 12:13:15.918994 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:15.902805 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:15.893978 26513 leader_election.cc:403] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:15.925905 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:15.934594 26543 raft_consensus.cc:2368] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26.
I20260709 12:13:15.934926 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3346) took 1113 ms. Trace:
I20260709 12:13:15.935331 26540 rpcz_store.cc:276] 0709 12:13:14.821497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.454881 (+633384us) service_pool.cc:224] Handling call
0709 12:13:15.934704 (+479823us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:15.936568 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:15.936934  2192 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:15.937390 26540 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:15.938328 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:15.927618 26541 rpcz_store.cc:276] 0709 12:13:14.816225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.465958 (+649733us) service_pool.cc:224] Handling call
0709 12:13:15.917026 (+451068us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:15.821862  1900 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:15.939831 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:15.939098 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:15.920559  2195 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:15.951037  2195 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:15.952823  2195 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:15.954911 26548 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 20: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:15.955022 26613 raft_consensus.cc:2410] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 21 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 9.
I20260709 12:13:15.955626 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3338) took 1136 ms. Trace:
I20260709 12:13:15.956315 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:15.920727 27167 rpcz_store.cc:276] 0709 12:13:14.694939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:14.695072 (+   133us) service_pool.cc:224] Handling call
0709 12:13:14.713376 (+ 18304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:14.713614 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:13:15.454554 (+740940us) log.cc:844] Serialized 14 byte log entry
0709 12:13:15.903451 (+448897us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:15.903565 (+   114us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:15.903677 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:15.903867 (+   190us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:15.904124 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":800990,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":20005,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":331,"thread_start_us":1025653,"threads_started":2,"wal-append.queue_time_us":393521}
I20260709 12:13:15.957787 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:15.956442 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 119998us
W20260709 12:13:15.959080 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:15.956027 26548 rpcz_store.cc:276] 0709 12:13:14.819477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.902213 (+1082736us) service_pool.cc:224] Handling call
0709 12:13:15.955533 (+ 53320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:15.960227 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:15.960640 26613 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:15.961290 26619 raft_consensus.cc:2410] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 12:13:15.962771 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:15.965047 26613 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 23: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:15.927059  2338 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:15.966383 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:15.968207 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:15.967677  2338 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:15.980060  2055 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.980772  2338 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:15.980923  2055 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:15.871958 26542 rpcz_store.cc:276] 0709 12:13:14.340854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:14.340991 (+   137us) service_pool.cc:224] Handling call
0709 12:13:14.401929 (+ 60938us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:14.409186 (+  7257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:14.409220 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:14.441817 (+ 32597us) log.cc:844] Serialized 26 byte log entry
0709 12:13:14.967349 (+525532us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:14.982565 (+ 15216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:14.986412 (+  3847us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:15.683854 (+697442us) raft_consensus.cc:1685] finished
0709 12:13:15.683898 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:15.684247 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":10363,"thread_start_us":333852,"threads_started":1,"wal-append.queue_time_us":1036457}
I20260709 12:13:15.982066  2326 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:15.983323 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:15.983770 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:15.984026  2029 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.985046 26615 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:15.984951  2029 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:15.971238 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 78043.2us
I20260709 12:13:15.972226  2192 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 25
I20260709 12:13:15.990427  2279 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:15.992820 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:15.970120  2255 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.994025  2255 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:15.973204  2274 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.978629  2191 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.962322 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:15.980638 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:15.986377 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:15.974856 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:16.011582 26544 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 28: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:16.014151 26545 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:16.014016  2274 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:16.014880 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3331) took 1197 ms. Trace:
I20260709 12:13:16.015136 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3344) took 1194 ms. Trace:
I20260709 12:13:16.012718 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3337) took 1189 ms. Trace:
I20260709 12:13:16.016000 26539 rpcz_store.cc:276] 0709 12:13:14.819205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.938728 (+1119523us) service_pool.cc:224] Handling call
0709 12:13:16.008531 (+ 69803us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.017293 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:16.018430 26616 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:16.018286  2274 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:16.019284 26540 raft_consensus.cc:2376] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25. Re-sending same reply.
I20260709 12:13:16.019747 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:16.020717 26616 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:13:16.021020 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:16.021827 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:16.015237 26545 rpcz_store.cc:276] 0709 12:13:14.817354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.929929 (+1112575us) service_pool.cc:224] Handling call
0709 12:13:16.014809 (+ 84880us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.023330 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:16.024116 26545 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:16.024683 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3340) took 1204 ms. Trace:
I20260709 12:13:16.024992 26545 rpcz_store.cc:276] 0709 12:13:14.819971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.022962 (+1202991us) service_pool.cc:224] Handling call
0709 12:13:16.024603 (+  1641us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.026005 26615 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:13:16.026742 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.027746  2191 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:16.030624 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:16.030937  2373 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:16.028112  2311 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:16.032434  2373 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:16.032836  2291 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:15.910257 26547 rpcz_store.cc:276] 0709 12:13:14.753124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:14.755865 (+  2741us) service_pool.cc:224] Handling call
0709 12:13:14.762690 (+  6825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:14.762966 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:13:15.479429 (+716463us) log.cc:844] Serialized 14 byte log entry
0709 12:13:15.900162 (+420733us) log.cc:844] Serialized 14 byte log entry
0709 12:13:15.900498 (+   336us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:15.900575 (+    77us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:15.900702 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:15.900851 (+   149us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:15.901111 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":748055,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":86,"raft.queue_time_us":2305,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":358,"thread_start_us":1072030,"threads_started":2}
I20260709 12:13:16.032852  2311 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:16.034123 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:16.035097 26547 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 23: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:16.031323  2108 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.036029 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:16.035787  2108 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:16.036302  2311 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:16.015674 26543 rpcz_store.cc:276] 0709 12:13:14.820997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.443547 (+622550us) service_pool.cc:224] Handling call
0709 12:13:16.014881 (+571334us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b540037e1d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:16.015057 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34482944}
I20260709 12:13:16.038803 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:16.033911  2373 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:16.041016 26588 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:16.022032 26618 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 21: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:16.042232  2333 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:16.043804 26618 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
W20260709 12:13:16.031638 26438 leader_election.cc:336] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.756s (SENT)
I20260709 12:13:16.019943 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3350) took 1197 ms. Trace:
I20260709 12:13:16.045226 26540 rpcz_store.cc:276] 0709 12:13:14.837709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.974502 (+1136793us) service_pool.cc:224] Handling call
0709 12:13:16.019871 (+ 45369us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.026093 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:16.052192 26618 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:16.066426 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 3125) took 1103 ms. Trace:
I20260709 12:13:16.067022 26547 rpcz_store.cc:276] 0709 12:13:14.952417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.035725 (+1083308us) service_pool.cc:224] Handling call
0709 12:13:16.056107 (+ 20382us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.012989  2326 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:16.078374 26613 raft_consensus.cc:2368] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 27. Current term is 28.
I20260709 12:13:16.071671 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 3126) took 1117 ms. Trace:
I20260709 12:13:16.084038 26545 rpcz_store.cc:276] 0709 12:13:14.954509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.025729 (+1071220us) service_pool.cc:224] Handling call
0709 12:13:16.071600 (+ 45871us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:16.088593 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 47806.5us
I20260709 12:13:16.098845 26618 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:13:16.100140  2274 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.100909  2274 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:16.102963  2360 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.103880  2274 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:16.103710  2360 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:16.109218  2307 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:16.109862 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3349) took 1287 ms. Trace:
I20260709 12:13:16.111076  2306 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:16.077714  2263 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.112653  2263 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:16.119400 26616 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:16.110324 26544 rpcz_store.cc:276] 0709 12:13:14.822183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.898085 (+1075902us) service_pool.cc:224] Handling call
0709 12:13:16.109567 (+211482us) spinlock_profiling.cc:243] Waited 74.3 ms on lock 0x7b540018bad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:16.109753 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170881280}
W20260709 12:13:16.127005 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.136405 27161 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:16.137827 27159 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:13:16.138357 27167 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:16.139577 27160 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:16.139813 27165 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:16.140842 27168 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:16.143976  2279 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.144654  2279 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:16.146570  2291 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.147215  2291 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:16.149441  2291 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:16.152769 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 121225us
I20260709 12:13:16.155777 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:16.157500 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3341) took 1337 ms. Trace:
I20260709 12:13:16.159837  2311 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:16.160795  2311 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:16.163460 26619 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: [29.14-29.14]
I20260709 12:13:16.065681  2191 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:16.159159 26544 rpcz_store.cc:276] 0709 12:13:14.820211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.155109 (+1334898us) service_pool.cc:224] Handling call
0709 12:13:16.157425 (+  2316us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.189023 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:16.190358 26613 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 12:13:16.197746 26614 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
W20260709 12:13:16.203522 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.159305 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:16.204623 26615 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:16.203313 26540 raft_consensus.cc:2376] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20. Re-sending same reply.
I20260709 12:13:16.208566 26539 raft_consensus.cc:2410] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:13:16.133399  2360 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:16.229904 27162 raft_consensus.cc:2410] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 21 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 12:13:16.237654 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:16.234601 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:16.237469 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:16.243291 27168 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:16.232198 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1401) took 1827 ms. Trace:
I20260709 12:13:16.208647  2291 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.245855 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:16.243798 26614 rpcz_store.cc:276] 0709 12:13:14.404404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:14.404724 (+   320us) service_pool.cc:224] Handling call
0709 12:13:14.414761 (+ 10037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:14.759042 (+344281us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b540030b4a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f5076051dc0 00007f50760dc1c0 00007f50760dd231 00007f50760d9d8f 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c
0709 12:13:15.214547 (+455505us) spinlock_profiling.cc:243] Waited 91.3 ms on lock 0x7b540030b4a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f507605806f 00007f50760d0f60 00007f50760d27de 00007f50760dcb49 00007f50760dd416 00007f50760d9d8f 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62
0709 12:13:15.714528 (+499981us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b5800652ad0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760360aa 00007f50760b8447 00007f50760d0fe7 00007f50760d27de 00007f50760dcb49 00007f50760dd416 00007f50760d9d8f 00007f50760d983e 00007f507b09e419 00007f5074615bd4
0709 12:13:15.835353 (+120825us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x7b5800805dd0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760360aa 00007f50760b8447 00007f50760d0fe7 00007f50760d27de 00007f50760dcb49 00007f50760dd416 00007f50760d9d8f 00007f50760d983e 00007f507b09e419 00007f5074615bd4
0709 12:13:16.198248 (+362895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:16.232118 (+ 33870us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504701824}
I20260709 12:13:16.245633 26617 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:16.248338 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:13:16.252879 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 272513us
I20260709 12:13:16.242043 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:16.267819 27167 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:16.268298 27165 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:16.249148 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3351) took 1409 ms. Trace:
I20260709 12:13:16.273125 26547 rpcz_store.cc:276] 0709 12:13:14.839550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.179456 (+1339906us) service_pool.cc:224] Handling call
0709 12:13:16.249078 (+ 69622us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.235069  2255 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:16.260627 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:13:16.280071  2186 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 27 current term: 27 is higher.
W20260709 12:13:16.303680 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 64885.2us
I20260709 12:13:16.281276  2346 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:16.282104 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 3498) took 1177 ms. Trace:
I20260709 12:13:16.228609  2055 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:16.282604  2291 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:16.284010 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:16.289233 27167 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:13:16.290385  2279 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:16.293018 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1168) took 1281 ms. Trace:
I20260709 12:13:16.200951  2311 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:16.298584  2191 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.308126 26588 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:16.320817 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:16.304479 26617 rpcz_store.cc:276] 0709 12:13:15.104894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.105080 (+   186us) service_pool.cc:224] Handling call
0709 12:13:16.281981 (+1176901us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.298812  2029 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:16.326004 26540 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 28: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:16.325472 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:16.319972 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:16.333866 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.267539  2360 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:16.312868 26464 rpcz_store.cc:276] 0709 12:13:15.011324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.046715 (+ 35391us) service_pool.cc:224] Handling call
0709 12:13:15.122170 (+ 75455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:15.145653 (+ 23483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:15.145702 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:15.146351 (+   649us) log.cc:844] Serialized 26 byte log entry
0709 12:13:15.965199 (+818848us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:15.965271 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:15.965376 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:16.292724 (+327348us) raft_consensus.cc:1685] finished
0709 12:13:16.292748 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:16.292909 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22897,"raft.queue_time_us":24224,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":53046,"thread_start_us":760254,"threads_started":1,"wal-append.queue_time_us":950769}
I20260709 12:13:16.330590 26541 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:13:16.344004 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3332) took 1526 ms. Trace:
I20260709 12:13:16.344483 26541 rpcz_store.cc:276] 0709 12:13:14.817619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.217178 (+1399559us) service_pool.cc:224] Handling call
0709 12:13:16.343904 (+126726us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:16.345081 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.349685 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:16.350663  2279 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:16.351599 26540 raft_consensus.cc:2410] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 12:13:16.353297 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:16.355047 27168 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:16.356233 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:16.357380  2274 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:16.363173 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.365604 27167 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:16.367102 26543 raft_consensus.cc:2410] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 27 because replica has last-logged OpId of term: 25 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260709 12:13:16.309386  2346 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:16.384112 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:16.392884 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3333) took 1575 ms. Trace:
I20260709 12:13:16.369985  2346 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:16.394289  2360 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:16.395395  2029 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:16.395862  2029 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:16.396260  2029 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:16.393965 26544 rpcz_store.cc:276] 0709 12:13:14.818076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.325506 (+1507430us) service_pool.cc:224] Handling call
0709 12:13:16.392783 (+ 67277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.398448 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:16.399291  2317 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.567s	user 0.008s	sys 0.015s
I20260709 12:13:16.399628 26464 raft_consensus.cc:2410] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 27 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 12:13:16.399847  2317 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:16.401432 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:16.411615 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:16.402490  2353 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:16.418076 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.418133 26544 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 26: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:16.418665 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:16.420823 26614 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 23: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:16.367735  2195 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
W20260709 12:13:16.421186 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 213987us
I20260709 12:13:16.423343 26546 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:16.423425 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:16.426061 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 3117) took 1572 ms. Trace:
I20260709 12:13:16.426518 26544 rpcz_store.cc:276] 0709 12:13:14.853802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.399697 (+1545895us) service_pool.cc:224] Handling call
0709 12:13:16.425987 (+ 26290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.397001  2360 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:16.434657 26615 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:16.434875 27167 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 12:13:16.402228  2317 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:16.443022 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:16.435086 26541 raft_consensus.cc:2376] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21. Re-sending same reply.
I20260709 12:13:16.387138  2191 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:16.448102 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 170057us
I20260709 12:13:16.449733 26464 raft_consensus.cc:2410] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 24 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 12:13:16.445426 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4330) took 1778 ms. Trace:
I20260709 12:13:16.450506 26613 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 23: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:16.450047 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:16.458695 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:16.459252  2347 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.459578 26544 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:16.459932  2347 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:16.460762 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:16.461879 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:16.462824 26465 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:16.472007  2191 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:16.454696 27134 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:16.474954  2265 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:16.475466  2265 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:16.476498  2265 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:16.477576  2265 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:16.447494  2263 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:16.480335 26468 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:16.480217 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:16.481472 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:16.482882 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 247583us
I20260709 12:13:16.483443 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:16.450225 26470 rpcz_store.cc:276] 0709 12:13:14.663175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:14.663695 (+   520us) service_pool.cc:224] Handling call
0709 12:13:14.698040 (+ 34345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:14.698273 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:13:15.819440 (+1121167us) log.cc:844] Serialized 14 byte log entry
0709 12:13:16.199535 (+380095us) log.cc:844] Serialized 14 byte log entry
0709 12:13:16.278019 (+ 78484us) log.cc:844] Serialized 14 byte log entry
0709 12:13:16.418081 (+140062us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:16.418169 (+    88us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:16.418262 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:16.423025 (+  4763us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:16.441875 (+ 18850us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1002573,"prepare.run_cpu_time_us":173,"prepare.run_wall_time_us":1284,"raft.queue_time_us":284512,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":550,"thread_start_us":1421505,"threads_started":4,"wal-append.queue_time_us":275843}
I20260709 12:13:16.482893 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:16.485421  2291 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:16.485318 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:16.446123  2353 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:16.445804  2108 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:16.488653 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:13:16.489035  2181 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.000s
I20260709 12:13:16.511065 26464 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:16.495553 27165 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:16.497851 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:16.499087 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:16.499765 26473 raft_consensus.cc:2410] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:13:16.500105 26466 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:13:16.499940  2387 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:16.500878 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:16.501211  2380 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:13:16.502089 26613 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:13:16.502892 26469 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:16.503624 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:16.505617 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:16.484309  2381 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.122s	user 0.002s	sys 0.000s
I20260709 12:13:16.508962 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 1273) took 1716 ms. Trace:
I20260709 12:13:16.524092 26545 rpcz_store.cc:276] 0709 12:13:14.792943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.484980 (+1692037us) service_pool.cc:224] Handling call
0709 12:13:16.508891 (+ 23911us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.489984  2029 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:16.512241 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53921.9us
I20260709 12:13:16.494856 26547 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
W20260709 12:13:16.508054  2192 consensus_meta.cc:287] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.516s	user 0.002s	sys 0.015s
I20260709 12:13:16.533655 26544 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:16.535909 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 148356us
I20260709 12:13:16.531096 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3360) took 1213 ms. Trace:
I20260709 12:13:16.539042 26543 rpcz_store.cc:276] 0709 12:13:15.318160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.505285 (+1187125us) service_pool.cc:224] Handling call
0709 12:13:16.531024 (+ 25739us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.539011 26548 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
W20260709 12:13:16.543900 26548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3334) took 1725 ms (client timeout 2188 ms). Trace:
W20260709 12:13:16.544288 26548 rpcz_store.cc:269] 0709 12:13:14.818418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.503226 (+1684808us) service_pool.cc:224] Handling call
0709 12:13:16.543836 (+ 40610us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.548151 26465 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:16.548255  2382 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:13:16.511111  2181 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:16.535060  2192 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25.
I20260709 12:13:16.550454 26541 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:16.558964  2382 raft_consensus.cc:697] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:16.559484 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:16.560128  2382 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:16.560876 26543 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 23: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:16.561551 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 3121) took 1642 ms. Trace:
I20260709 12:13:16.561987 26543 rpcz_store.cc:276] 0709 12:13:14.918775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.545170 (+1626395us) service_pool.cc:224] Handling call
0709 12:13:16.561470 (+ 16300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.549116  2385 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:16.572188 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.568430 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:16.574824 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:16.563537  2055 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:16.581766 26545 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 23: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:16.572947 26439 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:16.587098 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:13:16.591344 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 102818us
W20260709 12:13:16.592825 26546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3295) took 2340 ms (client timeout 1894 ms). Trace:
W20260709 12:13:16.593348 26546 rpcz_store.cc:269] 0709 12:13:14.252883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:14.253065 (+   182us) service_pool.cc:224] Handling call
0709 12:13:16.592529 (+2339464us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54002f85d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:16.592700 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3797312768}
I20260709 12:13:16.593760 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3362) took 1111 ms. Trace:
I20260709 12:13:16.594240 26547 rpcz_store.cc:276] 0709 12:13:15.482414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.319582 (+837168us) service_pool.cc:224] Handling call
0709 12:13:16.593578 (+273996us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x7b54002f7bd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:16.593696 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79575936}
I20260709 12:13:16.596226 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3322) took 1842 ms. Trace:
I20260709 12:13:16.596604 26547 rpcz_store.cc:276] 0709 12:13:14.753930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.595104 (+1841174us) service_pool.cc:224] Handling call
0709 12:13:16.595533 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:16.595821 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:16.595848 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:16.595890 (+    42us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:13:16.595930 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:16.596001 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:16.596138 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.597146  1850 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:16.598788 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3343) took 1778 ms. Trace:
I20260709 12:13:16.599226 26545 rpcz_store.cc:276] 0709 12:13:14.820750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.540595 (+1719845us) service_pool.cc:224] Handling call
0709 12:13:16.598715 (+ 58120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.598309 26547 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 18. (term mismatch)
I20260709 12:13:16.585846  2055 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:16.602609 26548 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:16.604657 26464 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:13:16.600482 26547 pending_rounds.cc:85] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 17
I20260709 12:13:16.606132 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:16.606940 27165 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:13:16.608958  2311 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:16.609613  2311 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:16.610623  2317 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:16.611454  2317 consensus_queue.cc:1243] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 24.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:13:16.580411  2333 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:13:16.613907 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45991.3us
I20260709 12:13:16.597828  1850 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:16.602586  2055 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:16.627242 26439 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:16.605712 26547 pending_rounds.cc:107] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 25.18
I20260709 12:13:16.634478 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:16.639853 26547 raft_consensus.cc:2889] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:16.581245  2274 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.033s
I20260709 12:13:16.574160  2108 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 12:13:16.575443  2387 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.055s
I20260709 12:13:16.654647 26541 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:13:16.636412  2029 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:16.657364 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:16.661206  2029 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:16.664618  2389 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:13:16.668321 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3330) took 1851 ms. Trace:
I20260709 12:13:16.669031 26543 rpcz_store.cc:276] 0709 12:13:14.817074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.666797 (+1849723us) service_pool.cc:224] Handling call
0709 12:13:16.667409 (+   612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:16.667792 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:16.667833 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:16.667902 (+    69us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:16.667950 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:16.668036 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:16.668228 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.673569  2346 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:16.645605  2385 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:16.697599  2326 consensus_meta.cc:287] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.001s
I20260709 12:13:16.699147  2385 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:16.674772 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 70357us
I20260709 12:13:16.675770  2313 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:16.662052  2029 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:16.695657 26543 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:16.695966  2181 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:16.714352 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.729295 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:16.709981 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3329) took 1842 ms. Trace:
W20260709 12:13:16.755965 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.756148 26617 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:13:16.742213 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:16.757874 26614 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:13:16.756347 26541 rpcz_store.cc:276] 0709 12:13:14.816792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.603895 (+1787103us) service_pool.cc:224] Handling call
0709 12:13:16.652899 (+ 49004us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:16.658373 (+  5474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:16.659038 (+   665us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:16.762602 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.739880 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:16.739880 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:16.778774 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1271) took 1964 ms. Trace:
I20260709 12:13:16.779425 26547 rpcz_store.cc:276] 0709 12:13:14.792103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.597532 (+1805429us) service_pool.cc:224] Handling call
0709 12:13:16.597900 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:16.658774 (+ 60874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:16.756291 (+ 97517us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.702160 26439 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:16.780623 26540 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:16.781910 26544 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:13:16.785331 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3115) took 1926 ms. Trace:
I20260709 12:13:16.785574 26548 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:16.785844 26543 rpcz_store.cc:276] 0709 12:13:14.846433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.694454 (+1848021us) service_pool.cc:224] Handling call
0709 12:13:16.695293 (+   839us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:16.772428 (+ 77135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:16.772690 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.786329 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3339) took 1966 ms. Trace:
W20260709 12:13:16.787820 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 195495us
I20260709 12:13:16.787995 26548 rpcz_store.cc:276] 0709 12:13:14.819718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.554646 (+1734928us) service_pool.cc:224] Handling call
0709 12:13:16.786257 (+231611us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:16.702232  2038 consensus_meta.cc:287] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.809s	user 0.011s	sys 0.001s
W20260709 12:13:16.796069 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 94071.5us
W20260709 12:13:16.796440 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.800127 26543 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 12:13:16.801019 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3364) took 1119 ms. Trace:
I20260709 12:13:16.801373 26543 rpcz_store.cc:276] 0709 12:13:15.681424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.787071 (+1105647us) service_pool.cc:224] Handling call
0709 12:13:16.799215 (+ 12144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:16.800625 (+  1410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:16.800909 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.803164  2385 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:16.803872  2385 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:16.805024  2385 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:16.806949 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3321) took 2053 ms. Trace:
I20260709 12:13:16.807403 26546 rpcz_store.cc:276] 0709 12:13:14.753604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.594309 (+1840705us) service_pool.cc:224] Handling call
0709 12:13:16.594787 (+   478us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:16.595293 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:16.595322 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:16.595956 (+   634us) log.cc:844] Serialized 52 byte log entry
0709 12:13:16.642942 (+ 46986us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:16.642988 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:16.643075 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:16.806690 (+163615us) raft_consensus.cc:1685] finished
0709 12:13:16.806711 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:16.806876 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2014,"raft.queue_time_us":3923,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":33053,"spinlock_wait_cycles":1668608,"thread_start_us":45834,"threads_started":1,"wal-append.queue_time_us":206477}
I20260709 12:13:16.809504 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:16.810169 27167 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:13:16.810191 27165 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:16.798781  2313 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:16.827950 26541 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:13:16.832124 26622 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:16.832896 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3118) took 1970 ms. Trace:
I20260709 12:13:16.839660 26541 rpcz_store.cc:276] 0709 12:13:14.862107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.783083 (+1920976us) service_pool.cc:224] Handling call
0709 12:13:16.824776 (+ 41693us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:16.828369 (+  3593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:16.832838 (+  4469us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:16.841390 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:16.842130 26613 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
I20260709 12:13:16.844043  2313 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:16.850598 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:16.855808  2029 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:16.857229  1850 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:16.859069  2346 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:16.861040 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:16.863149 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:16.865098 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:16.823936  2353 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:16.709719  2311 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:16.868317  2382 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:16.869351  2382 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:16.718489  2333 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:16.865103 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3342) took 2044 ms. Trace:
I20260709 12:13:16.870937 26544 rpcz_store.cc:276] 0709 12:13:14.820496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.460414 (+1639918us) service_pool.cc:224] Handling call
0709 12:13:16.864878 (+404464us) spinlock_profiling.cc:243] Waited 72.2 ms on lock 0x7b5400236ed4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:16.865022 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166047104}
I20260709 12:13:16.872371  2333 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:16.872620 26363 catalog_manager.cc:5697] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 15 to 20, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 20 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:16.875818 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:16.876547 26544 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
W20260709 12:13:16.879855 26438 leader_election.cc:336] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.864s (SENT)
I20260709 12:13:16.880048  2256 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:16.880427 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:16.880816 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:16.881883 26544 raft_consensus.cc:2393] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 21: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:16.882659  2181 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:16.883116 26544 raft_consensus.cc:3055] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:16.883376  2347 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:16.883508 26544 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:16.886052 26547 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
W20260709 12:13:16.886503 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.887687 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:16.877621  2274 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:16.878448 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3368) took 1195 ms. Trace:
I20260709 12:13:16.892472 26540 rpcz_store.cc:276] 0709 12:13:15.683336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.352863 (+669527us) service_pool.cc:224] Handling call
0709 12:13:16.878238 (+525375us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54003cf354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:16.878360 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498481920}
I20260709 12:13:16.877337  2306 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:16.888763  2382 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:16.891772  2386 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Stepping down as leader of term 22
W20260709 12:13:16.838693 26539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3357) took 1871 ms (client timeout 2068 ms). Trace:
W20260709 12:13:16.898728 26539 rpcz_store.cc:269] 0709 12:13:14.967031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.016905 (+1049874us) service_pool.cc:224] Handling call
0709 12:13:16.831265 (+814360us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54001068d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:16.838574 (+  7309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":427680512}
I20260709 12:13:16.880628  2256 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:16.799572  2038 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:16.900207 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3127) took 1938 ms. Trace:
I20260709 12:13:16.898203  2382 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.902105 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:16.904562 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:16.906179 26547 rpcz_store.cc:276] 0709 12:13:14.962197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.787435 (+1825238us) service_pool.cc:224] Handling call
0709 12:13:16.885844 (+ 98409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:16.886760 (+   916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:16.899956 (+ 13196us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x7b5400236ed0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:16.900143 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164675328}
I20260709 12:13:16.916181 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:16.916891 27165 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:13:16.919735 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:16.920272 26621 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:16.919809 26613 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 27. Current term is 28. Ops: [27.16-27.16]
I20260709 12:13:16.922554 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:16.930192 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.931697 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:16.939181 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.938550 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:16.938665 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:16.938247 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:16.938975 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:16.943859 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:16.898734  2306 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:16.939751 27167 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:16.898254  2386 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:16.961199 26619 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 24: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:16.946139 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:16.943912 26473 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:13:16.945223 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:16.919349  2382 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:16.963601 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:16.906598  2360 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.034s
I20260709 12:13:16.935765  2029 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:16.967924 26621 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:16.968089 26469 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 20: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:16.968616  2306 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:16.969941 26363 catalog_manager.cc:5697] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 12 to 20, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 20 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:16.970882  2386 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:16.935990  2195 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:17.426219  2195 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.426332  2386 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:17.426790  2195 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:16.933192  2307 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:17.430765  2307 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:17.432158 26363 catalog_manager.cc:5697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 16 to 21, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 21 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.433545  2307 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:16.992261  2401 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.070s	user 0.000s	sys 0.006s
I20260709 12:13:16.993098  2317 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.435603  2317 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:16.972996 26362 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39184 (request call id 165) took 18960 ms (client timeout 15000 ms). Trace:
W20260709 12:13:16.983186 26438 leader_election.cc:336] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.539s (SENT)
I20260709 12:13:17.662856 26438 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:17.664109 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 697852us
W20260709 12:13:17.664881 26438 leader_election.cc:336] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.621s (SENT)
I20260709 12:13:16.979971 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:17.668490 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 688611us
W20260709 12:13:17.025348 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 197834us
I20260709 12:13:17.017107 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:17.676482 26615 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:17.678632  2425 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:17.006881 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:17.681156 26617 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:17.007874 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:17.687276 26620 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:13:17.688539 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:17.689188 26620 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:17.001551 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:17.023592 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:17.692078 26619 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 24: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:17.692919  2386 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:17.693177 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:17.693986 26619 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:13:17.166293 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3328) took 2349 ms. Trace:
I20260709 12:13:17.670131  2177 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:17.695147 26545 rpcz_store.cc:276] 0709 12:13:14.816523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.600124 (+1783601us) service_pool.cc:224] Handling call
0709 12:13:16.648398 (+ 48274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:16.706688 (+ 58290us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:13:16.813177 (+106489us) log.cc:844] Serialized 14 byte log entry
0709 12:13:17.032661 (+219484us) log.cc:844] Serialized 14 byte log entry
0709 12:13:17.165871 (+133210us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:17.165934 (+    63us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:17.165987 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:17.166055 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:17.166184 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":226760,"prepare.queue_time_us":160518,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":73,"raft.queue_time_us":154014,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":12224,"thread_start_us":292725,"threads_started":2,"wal-append.queue_time_us":268677}
I20260709 12:13:17.174329 26588 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:17.697721 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 523507us
I20260709 12:13:17.698628 26588 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:17.194156  2414 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:13:17.337775 26544 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:17.364241 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:17.690063 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:17.365988 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:17.366425 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:17.376396 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:17.377707 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:17.391157 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:17.405639 26472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3288c98248464af5b8f3227349002ec7"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:57944
I20260709 12:13:17.703733 26472 raft_consensus.cc:606] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:17.704227 26472 raft_consensus.cc:614] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:17.412634 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:17.414367 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:17.440526 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.456070 26363 catalog_manager.cc:5697] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
W20260709 12:13:17.459839 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:17.472882 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.387509 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:17.001883 27161 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 25 index: 20. Preceding OpId from leader: term: 27 index: 21. (index mismatch)
I20260709 12:13:17.451776 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:16.983934  2029 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:17.050733  2256 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:17.756134 26615 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:17.086926  2055 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:17.759873 26618 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:17.761653  2055 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:17.762535 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:17.001551 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:17.767876 27165 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:17.073000 27167 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:13:17.771746 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:17.001912 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:17.774075  2191 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.296285  1900 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:17.775843  2191 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:17.099982  2038 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:17.358565  2108 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:17.791270  2108 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:17.791833  2108 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:17.132891  2263 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:13:17.077652  2265 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.581s	user 0.014s	sys 0.000s
I20260709 12:13:17.090662  2306 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:17.361095  2313 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:17.441031  2195 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:17.438354  2317 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:16.986714  2347 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:17.826061  2347 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.826745  2347 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:17.003409  2353 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:17.829262  2353 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:17.795285  2263 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:17.243424  2382 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:17.360183  2385 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:13:17.154537  2405 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.053s	user 0.002s	sys 0.000s
W20260709 12:13:17.516983 26621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.009s	sys 0.009s
W20260709 12:13:17.839561 26621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.010s	sys 0.010s
I20260709 12:13:17.841485 26621 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
W20260709 12:13:17.529470 26540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.015s	sys 0.025s
W20260709 12:13:17.842607 26540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.016s	sys 0.026s
I20260709 12:13:17.836457  2263 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:17.562381 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:17.845497 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.845786  2427 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:17.846307 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:17.565812 26464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.000s	sys 0.011s
W20260709 12:13:17.847601 26464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.000s	sys 0.012s
I20260709 12:13:17.566237  2394 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.577925 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:17.850466  2265 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:17.629098 26362 rpcz_store.cc:269] 0709 12:12:58.011912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:58.012233 (+   321us) service_pool.cc:224] Handling call
0709 12:13:16.972532 (+18960299us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:10.026259 (+     0us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5072fd00ac 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f5079b0f16c
0709 12:13:10.331527 (+305268us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:10.428986 (+ 97459us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:10.429028 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:13:10.429049 (+    21us) tablet.cc:662] Decoding operations
0709 12:13:10.567094 (+138045us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:10.580745 (+ 13651us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:10.585556 (+  4811us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:13:10.834849 (+249293us) tablet.cc:701] Row locks acquired
0709 12:13:10.834888 (+    39us) write_op.cc:260] PREPARE: finished
0709 12:13:10.835096 (+   208us) write_op.cc:270] Start()
0709 12:13:10.835551 (+   455us) write_op.cc:276] Timestamp: P: 1783599190835039 usec, L: 0
0709 12:13:10.835584 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:13:10.836390 (+   806us) log.cc:844] Serialized 5196 byte log entry
0709 12:13:11.804501 (+968111us) op_driver.cc:464] REPLICATION: finished
0709 12:13:12.387965 (+583464us) write_op.cc:301] APPLY: starting
0709 12:13:12.422767 (+ 34802us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:14.047763 (+1624996us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:14.047808 (+    45us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:14.960547 (+912739us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:15.105920 (+145373us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 12:13:15.144093 (+ 38173us) write_op.cc:312] APPLY: finished
0709 12:13:15.297216 (+153123us) log.cc:844] Serialized 121 byte log entry
0709 12:13:15.565738 (+268522us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:15.565939 (+   201us) write_op.cc:454] Released schema lock
0709 12:13:15.565995 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:15.566480 (+   485us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:15.566509 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":279,"mutex_wait_us":2588909,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":536550,"apply.run_cpu_time_us":117143,"apply.run_wall_time_us":3181570,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58415,"num_ops":13,"prepare.queue_time_us":528363,"prepare.run_cpu_time_us":27767,"prepare.run_wall_time_us":636238,"raft.queue_time_us":787581,"raft.run_cpu_time_us":33633,"raft.run_wall_time_us":415315,"replication_time_us":968709,"spinlock_wait_cycles":84735872,"thread_start_us":1342966,"threads_started":5,"wal-append.queue_time_us":431191,"wal-append.run_cpu_time_us":130783,"wal-append.run_wall_time_us":2397390}]]}
I20260709 12:13:17.851094  2265 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:17.666093 26358 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 953d8c981a6c459f8b7f3dbbb66fda45 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3262bf0553e543eea76794fc529a9acc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:13:17.853025 26358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 187253us
I20260709 12:13:17.691270 26622 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 27.
I20260709 12:13:17.853571  2265 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:17.854233  2394 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:17.854749 26622 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:17.855023  2353 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:17.846427  2427 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:17.705080 26471 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 27.
W20260709 12:13:17.713521 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.712862 26620 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
W20260709 12:13:17.856410 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.700858 26466 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
W20260709 12:13:17.856794 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:17.719880 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55029us
I20260709 12:13:17.714286 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:17.720820 27163 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:17.722736 26544 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:17.722995 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:17.710687  2425 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:17.724846 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:17.721051 26617 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:13:17.741328 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:17.858644 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 144496us
I20260709 12:13:17.744853  2177 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:17.746868  2386 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:17.747496 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 49013us
I20260709 12:13:17.742475 26363 catalog_manager.cc:5697] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 17 to 18, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 18 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.751827  2029 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:17.757936 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:17.776181 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:17.785146  2191 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:17.812186 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.812597  2108 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:17.822489  2291 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.824421 27165 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:17.824921  2195 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:17.834765 27159 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:17.836347  2382 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:17.837101  2256 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:17.865720  2291 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:17.866665 26621 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33. Ops: []
I20260709 12:13:17.868136 26621 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:17.868443  2291 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:17.859306 26439 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:17.869863 26439 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:17.850157 27133 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.952s (SENT) [suppressed 24 similar messages]
I20260709 12:13:17.870272  2427 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:17.872273 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:17.864920 26588 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:17.862242 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.866037 26613 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 25 index: 20. Preceding OpId from leader: term: 27 index: 21. (index mismatch)
I20260709 12:13:17.865208  2394 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:17.887733 26619 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:17.907974 26617 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
W20260709 12:13:17.916309 26438 leader_election.cc:336] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.638s (SENT)
I20260709 12:13:17.860404  2055 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:17.861227  2385 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:17.926613 26540 raft_consensus.cc:3055] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:13:17.927112 26540 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:17.930436 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:17.920059  2425 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:17.931137 26548 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:17.887095  2313 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:17.922338  2291 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.950115 26544 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 17. (term mismatch)
I20260709 12:13:17.951066 26544 pending_rounds.cc:85] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 16
I20260709 12:13:17.951408 26544 pending_rounds.cc:107] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 22.17
I20260709 12:13:17.951728 26544 raft_consensus.cc:2889] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:17.929327  2394 raft_consensus.cc:2764] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 12:13:17.927695  2373 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:17.928095  2386 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:17.923532  2385 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:17.966490 26548 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
W20260709 12:13:17.968745 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 243994us
W20260709 12:13:17.972049 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 121929us
I20260709 12:13:17.917706  2307 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 12:13:17.939682  2313 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.922073  2317 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 12:13:17.973441 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1282) took 1097 ms. Trace:
I20260709 12:13:17.979701 26544 rpcz_store.cc:276] 0709 12:13:16.875832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.882533 (+  6701us) service_pool.cc:224] Handling call
0709 12:13:16.882941 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:17.337180 (+454239us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b4c001f34c0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50743a6a20 00007f50743b7a29 00007f507437d644 00007f50743a4f2d 00007f50743a4b93 00007f50760d518b 00007f50760d5cb5 00007f50760d0f30 00007f50760d27de 00007f50760dcb49 00007f50760dd416
0709 12:13:17.973142 (+635962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:17.973373 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44836224}
W20260709 12:13:17.981806 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 117022us
W20260709 12:13:17.984347 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 121139us
I20260709 12:13:17.986011 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:17.968297  2386 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.967466  2108 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:17.989775 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:17.991222 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:18.014604 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:17.939414  2195 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 12:13:17.982076  2313 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:18.017531 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:17.973963  2385 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:18.019176 27159 raft_consensus.cc:2368] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20.
I20260709 12:13:17.981446  2435 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:17.956209  1900 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:13:18.031502  2425 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:17.985167  2373 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:18.035498  2373 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:17.954806  2291 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:18.038781 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:18.039713 26613 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 20.
I20260709 12:13:18.040992  2291 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:18.029326 26438 leader_election.cc:336] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.655s (SENT)
I20260709 12:13:18.031337  2435 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:18.047716 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:18.016382  2386 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:18.050519 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 66281.6us
I20260709 12:13:18.050716 26618 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 33: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:18.054301 26619 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:13:18.059625 26363 catalog_manager.cc:5697] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 13 to 20, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 20 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:18.060741 26542 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:13:18.060892  2347 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:18.058017 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:18.099172  2360 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:18.099777  2360 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:18.099961  2255 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:18.100813  2360 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:18.105464  2347 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:18.065377 26540 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:18.108695 26540 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:13:18.070768 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 56257us
I20260709 12:13:18.111195 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:18.071460  2428 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:18.073303  2437 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election won for term 28
W20260709 12:13:18.077983  2431 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:13:18.016691  2382 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.067s
I20260709 12:13:17.978760  2177 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:18.017899  2265 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:18.086050 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 98912us
W20260709 12:13:18.064427  2432 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:13:18.042870  2394 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.990989  2427 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.061s
W20260709 12:13:18.092528 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 220316us
I20260709 12:13:18.017323  2353 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.071s
W20260709 12:13:18.081899 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.124233 26588 leader_election.cc:400] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20.
I20260709 12:13:18.128607 26588 leader_election.cc:403] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 12:13:18.134781 26542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3325) took 3319 ms (client timeout 2164 ms). Trace:
W20260709 12:13:18.135303 26542 rpcz_store.cc:269] 0709 12:13:14.815629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.982890 (+1167261us) service_pool.cc:224] Handling call
0709 12:13:18.134569 (+2151679us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b54002f80d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:18.134701 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4344909184}
I20260709 12:13:18.138716 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:18.134905 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:18.121505  2055 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:18.156498 26540 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:13:18.154450 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 1412) took 1143 ms. Trace:
W20260709 12:13:18.156724 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45652us
I20260709 12:13:18.159672 26615 rpcz_store.cc:276] 0709 12:13:17.011549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:17.757597 (+746048us) service_pool.cc:224] Handling call
0709 12:13:18.154184 (+396587us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b5400269154. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:18.154349 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635183872}
I20260709 12:13:18.159433 26540 pending_rounds.cc:85] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 11
I20260709 12:13:18.195112 26540 pending_rounds.cc:107] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:13:18.196535 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:18.197484 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 182837us
I20260709 12:13:18.198149 26540 raft_consensus.cc:2889] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:18.192478 27134 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:18.199543 27160 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:18.125697  2265 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:18.197239  2432 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:13:18.128192  2394 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:18.163733  2055 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:18.164289  2425 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:18.152318  2443 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.134498  2291 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:13:18.196695  2195 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:13:18.215029 26438 leader_election.cc:336] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.656s (SENT)
I20260709 12:13:18.230093 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:18.219079  2441 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20.
I20260709 12:13:18.218816  2440 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 32.21, Next index: 22, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:18.212092  2411 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:13:18.203756  2307 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:13:18.227659 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.206334  2382 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:18.233134 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:18.231033 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:18.239920 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.264158  2265 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:18.258971 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 136487us
I20260709 12:13:18.210271  2435 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:18.217432 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3515) took 1022 ms. Trace:
I20260709 12:13:18.212767  2317 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:18.273414 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:18.284832  2444 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:13:18.289284  2029 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:18.233307  2443 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:18.259457  2195 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:18.294450 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 92372.9us
I20260709 12:13:18.267843 26363 catalog_manager.cc:5697] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 11 to 20, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 20 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:18.312136 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:18.306299 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.328459 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3514) took 1137 ms. Trace:
W20260709 12:13:18.345654 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:18.307978 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 99510us
I20260709 12:13:18.295909  2437 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:18.335480  2441 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:18.349427  2195 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:18.276499  2394 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:18.345552 26622 rpcz_store.cc:276] 0709 12:13:17.191519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:17.855527 (+664008us) service_pool.cc:224] Handling call
0709 12:13:17.855870 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:17.863108 (+  7238us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:13:18.143249 (+280141us) log.cc:844] Serialized 14 byte log entry
0709 12:13:18.328027 (+184778us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:18.328092 (+    65us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:18.328145 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:18.328234 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:18.328389 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":299464,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":2325,"thread_start_us":318093,"threads_started":2}
I20260709 12:13:18.354943 27134 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:18.357290 26616 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:18.328058  2265 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.295660  2311 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:18.323307  2373 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:18.322716  2177 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:18.298338  2191 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:18.323596 26620 rpcz_store.cc:276] 0709 12:13:17.191878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:17.856833 (+664955us) service_pool.cc:224] Handling call
0709 12:13:17.862979 (+  6146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:17.923303 (+ 60324us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:13:18.093508 (+170205us) log.cc:844] Serialized 14 byte log entry
0709 12:13:18.206158 (+112650us) log.cc:844] Serialized 14 byte log entry
0709 12:13:18.213441 (+  7283us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:18.213566 (+   125us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:18.213684 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:18.213782 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:18.213951 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1007,"prepare.queue_time_us":332912,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":101,"raft.queue_time_us":78469,"raft.run_wall_time_us":9385,"spinlock_wait_cycles":56062720,"thread_start_us":220740,"threads_started":2,"wal-append.queue_time_us":150261}
I20260709 12:13:18.375883  2029 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:18.294625  2313 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:18.380548 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:18.404733 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.439641  2385 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:18.402278 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 191934us
I20260709 12:13:18.306237  2317 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:18.357980  2441 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:18.426340 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 211785us
W20260709 12:13:18.422271 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 59976.7us
I20260709 12:13:18.375990  2386 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:18.358717  2360 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.076s
I20260709 12:13:18.360741  2307 raft_consensus.cc:697] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:13:18.459360 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 104533us
I20260709 12:13:18.391960  2311 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:18.428750  2191 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:18.451737  2441 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:18.418236  2265 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:18.434160  2437 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:18.469579  2411 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:18.480242  2411 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.498885 26514 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:18.504334 26643 debug-util.cc:398] Leaking SignalData structure 0x7b080030f720 after lost signal to thread 25293
I20260709 12:13:18.503338 26363 catalog_manager.cc:5697] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 17 to 18, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 18 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:18.504832 26643 debug-util.cc:398] Leaking SignalData structure 0x7b080035a3e0 after lost signal to thread 25296
W20260709 12:13:18.505980 26643 debug-util.cc:398] Leaking SignalData structure 0x7b0800313660 after lost signal to thread 26405
W20260709 12:13:18.507510 26643 debug-util.cc:398] Leaking SignalData structure 0x7b0800313700 after lost signal to thread 26497
W20260709 12:13:18.508805 26643 debug-util.cc:398] Leaking SignalData structure 0x7b080030e860 after lost signal to thread 26572
W20260709 12:13:18.522756 26643 debug-util.cc:398] Leaking SignalData structure 0x7b0800298620 after lost signal to thread 26646
W20260709 12:13:18.526942 26643 debug-util.cc:398] Leaking SignalData structure 0x7b080037f840 after lost signal to thread 26647
W20260709 12:13:18.538138 26643 debug-util.cc:398] Leaking SignalData structure 0x7b080039dd20 after lost signal to thread 27192
W20260709 12:13:18.540853 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.507707  2317 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:18.549609 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 50829.7us
I20260709 12:13:18.555428 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:18.556962 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3505) took 1552 ms. Trace:
I20260709 12:13:18.517138  2411 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:18.547091 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 86837us
I20260709 12:13:18.557412 26616 rpcz_store.cc:276] 0709 12:13:17.004672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:17.004818 (+   146us) service_pool.cc:224] Handling call
0709 12:13:17.005203 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:18.374424 (+1369221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:18.556692 (+182268us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540020ab54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:18.556895 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3102252800}
I20260709 12:13:18.549088  2428 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:18.483922  2311 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:18.569929 27134 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:18.573643  2385 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:18.575361  2195 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:18.580125  2447 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 12:13:18.581527  2429 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:18.582823  2429 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:13:18.582984  2457 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:13:18.583253  2429 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:18.508212  2191 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:18.584255  2429 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:18.585246  2311 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:18.585562  2429 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:18.570681  2443 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:18.601369 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:18.604157 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 145312us
W20260709 12:13:18.577997  2449 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:13:18.608742 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:18.568547  2360 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:13:18.609503 26616 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 27.
I20260709 12:13:18.610546  2255 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:18.611176  2255 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:18.594585  2460 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:18.613718  2255 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:18.601871  2452 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
W20260709 12:13:18.626004 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 51883.7us
I20260709 12:13:18.635320  2265 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:18.629158  2313 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:18.564421  2307 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:18.649896 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:18.651641 26438 leader_election.cc:336] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.894s (SENT)
W20260709 12:13:18.656864 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 465846us
I20260709 12:13:18.654772  2428 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:18.625465  2386 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:18.659904 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:18.654842  2108 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:13:18.663789  2313 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.017s
I20260709 12:13:18.694705 27134 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:18.699158 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:18.701393 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 74616.3us
I20260709 12:13:18.661648  2055 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:18.709815 26616 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:18.710968 26514 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:18.666836  2191 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:18.722020 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.719520  2195 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:18.726698 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:18.728289 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:18.719463  2425 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 12:13:18.726111 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:18.730825  2437 raft_consensus.cc:3055] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:18.731369  2437 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:18.732671  2437 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:18.734318  2437 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:18.717577  2443 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:18.732666 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:18.737531 26469 raft_consensus.cc:2410] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 31 because replica has last-logged OpId of term: 29 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 14.
I20260709 12:13:18.735018 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:18.738775 26466 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:18.739148 26472 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 26: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:13:18.739984 26587 connection.cc:256] RPC call timeout handler was delayed by -2.3985788299999058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
I20260709 12:13:18.740267 27163 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 12:13:18.740638 26587 connection.cc:256] RPC call timeout handler was delayed by -2.3805788300001041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260709 12:13:18.740967 26587 connection.cc:256] RPC call timeout handler was delayed by -2.3670788300000822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
W20260709 12:13:18.741268 26587 connection.cc:256] RPC call timeout handler was delayed by -2.321178830000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
W20260709 12:13:18.741611 26587 connection.cc:256] RPC call timeout handler was delayed by -2.2635788299999149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
I20260709 12:13:18.721553  2385 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 12:13:18.743054  2385 raft_consensus.cc:3055] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:18.743467  2385 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:18.744072 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:18.744464  2385 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:18.742002 26587 connection.cc:256] RPC call timeout handler was delayed by -1.8927788299999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 12:13:18.746044 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:18.745141 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:18.747131 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:18.747084 26587 connection.cc:256] RPC call timeout handler was delayed by -1.7667788300000211s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23290000000000002s for a response
I20260709 12:13:18.743389 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:18.747757 26587 connection.cc:256] RPC call timeout handler was delayed by -1.4292788299999302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27040000000000003s for a response
I20260709 12:13:18.702371  2108 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 32 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:13:18.748374 26587 connection.cc:256] RPC call timeout handler was delayed by -1.2672788299998956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2884s for a response
I20260709 12:13:18.748524 26473 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 26: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:13:18.759591 26587 connection.cc:256] RPC call timeout handler was delayed by -1.0485788299999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3127s for a response
I20260709 12:13:18.707814  2382 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:18.771749 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:18.773355 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:18.777262 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:18.778026 26472 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:13:18.780738 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:18.781452 26540 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:18.774359 27133 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:18.782460 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:18.783780 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 80948.6us
I20260709 12:13:18.784612 26514 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:18.785691 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:18.711030  2386 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 12:13:18.791663 26466 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:18.793846 27159 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:13:18.703646  2451 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 12:13:18.789800  2460 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:18.786561  2435 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 12:13:18.798556 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:18.792702 26465 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:13:18.799222 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:18.794486 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:18.773464  2382 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.800074 27165 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: [23.18-25.19]
I20260709 12:13:18.801637 26619 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:13:18.804262 26542 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:18.804913 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:18.793051  2385 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:18.812541 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 184287us
I20260709 12:13:18.813370 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:18.823498 26472 raft_consensus.cc:2410] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:13:18.823699 26617 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:18.814177 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:18.824056 26545 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 25: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:18.814754 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:18.815928 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:18.825156 26540 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 31: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:18.819536 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:18.821075 26469 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
W20260709 12:13:18.822377 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:18.816437 26358 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 953d8c981a6c459f8b7f3dbbb66fda45 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3262bf0553e543eea76794fc529a9acc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:18.826206 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:18.824399 26543 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:18.827654 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:13:18.828298 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 55035.8us
I20260709 12:13:18.829320 26614 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
W20260709 12:13:18.835491 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.837289 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:18.838194 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:18.841741 26546 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:18.834632 26539 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:18.837289 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:18.845184 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:18.845916 26542 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:18.846293 26469 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:18.802964  2353 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:18.847962 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:18.848937 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:18.849676 26548 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:13:18.852720 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:18.853369 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:18.854043 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:18.854979 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:18.778728  2443 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260709 12:13:18.861068 26544 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:13:18.861894 26542 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:13:18.862241 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:18.862804 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:18.864127 26438 leader_election.cc:336] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.960s (SENT)
I20260709 12:13:18.864627 26438 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:18.826761  2382 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:18.862879 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:18.822965  2434 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:18.831055  2465 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:18.873492 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:18.884895 26616 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:13:18.873816 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:18.885160 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:18.885747 26617 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:18.874485 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:18.887645 26548 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:13:18.877182 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 92651.6us
I20260709 12:13:18.878159 26469 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 12:13:18.879319  2472 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:13:18.845248  2466 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:13:18.898602 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:18.899483 26545 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:13:18.901255 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:18.894550 26620 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:13:18.893400 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:18.894336 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:18.903491 26546 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 29 because replica has last-logged OpId of term: 27 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 15.
I20260709 12:13:18.901971 26545 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:18.886636 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:18.905383 26470 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:18.905297 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:18.906301 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:18.922505 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:18.924279 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:18.926476 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:18.926882 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 56286.7us
I20260709 12:13:18.929157 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:18.905653 26539 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:18.906478 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:18.914734 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 95267us
I20260709 12:13:18.931062 27134 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:18.932425 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.902626 26621 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:18.942816 26539 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:18.883510  2465 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.915889  2435 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.952587 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:18.892859  2460 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:18.945302 26613 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:18.895671  2317 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:18.922014  2055 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:18.917951  2468 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:18.960078 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:18.963699 26617 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:18.965273  2448 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.030s
I20260709 12:13:18.967036  2461 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:18.967730  2461 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:18.968259  2461 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:18.970595 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:18.942523  2443 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.945012  2360 raft_consensus.cc:2764] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
W20260709 12:13:18.980212 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 106055us
I20260709 12:13:18.981285 26616 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
W20260709 12:13:18.984612 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 95981.4us
I20260709 12:13:18.874658  2108 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 32.21, Last appended by leader: 21, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:18.954258  2465 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:18.992738 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:18.995039 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:18.996081 26540 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:13:18.987350 26464 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:18.960877  2468 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:19.027558 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:19.027971 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.986132  2434 raft_consensus.cc:2764] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:13:19.040304 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:19.041038 26541 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:19.050031 26467 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:18.963312  2460 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:18.960804  2435 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:19.050525 26467 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:13:19.058660 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 44469.7us
I20260709 12:13:19.061216 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:19.029183  2439 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:19.064862 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:19.062757 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 105583us
I20260709 12:13:18.988132  2411 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:19.066655 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 67115.2us
I20260709 12:13:18.994020  2317 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:19.067584 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 203508us
I20260709 12:13:19.013341  2443 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:19.070262 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:13:19.071926 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52438.9us
I20260709 12:13:19.073731  2458 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:19.074185 26514 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:19.075171 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:19.075568  2468 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:19.076496  2428 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:19.076617  2459 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.077117  2468 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:19.077288  2459 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:19.079455  2479 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:13:19.075232 26469 raft_consensus.cc:2410] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:13:19.087006  2425 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:13:19.090214 26438 leader_election.cc:336] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.966s (SENT)
W20260709 12:13:19.091455 26438 leader_election.cc:336] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.003s (SENT)
W20260709 12:13:19.092479 26438 leader_election.cc:336] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.068s (SENT)
W20260709 12:13:19.093897 26438 leader_election.cc:336] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.085s (SENT)
I20260709 12:13:19.097177  2460 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:19.099762  2459 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:19.102615  2108 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
W20260709 12:13:19.103752 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.106205  2459 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:19.106843  2459 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:19.110286 26471 raft_consensus.cc:2410] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 12:13:19.070009  2195 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:19.116694 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:19.117195  2411 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:19.118871 26467 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.19, Last appended by leader: 19, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:19.120142 26467 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:19.029762  2386 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.040s
I20260709 12:13:19.123925 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:19.124670 26617 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:19.075881 26514 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:19.120929  2394 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:19.067034  2441 consensus_meta.cc:287] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.587s	user 0.008s	sys 0.004s
I20260709 12:13:19.151081  2441 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:19.141458  2435 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:19.153352  2441 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:19.142414  2317 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:19.142637 26613 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 12:13:19.076550  2478 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:13:19.068200  2373 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:19.072506  2440 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:19.187424  2440 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:19.187953  2440 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:19.189484 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:19.173108 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:19.190225 26618 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
W20260709 12:13:19.191354 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 74761.9us
I20260709 12:13:19.192590 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:19.200685  2443 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:19.201622  2311 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:19.202347  2459 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:19.121716  2451 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:19.206732  2451 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.207329  2451 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:19.210883  2437 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:19.212924  2437 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:19.184880 26617 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:13:19.169605  2195 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:19.186024  2458 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:19.200855 26439 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:19.220266 27134 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:19.175343 26466 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 27.
I20260709 12:13:19.194063 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:19.218947 26545 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
W20260709 12:13:19.228124 26438 leader_election.cc:336] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.126s (SENT)
W20260709 12:13:19.232113 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.237118 26547 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:13:19.223263 26439 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:19.248157 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.218791  2313 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 16, Time since last communication: 0.037s
I20260709 12:13:19.072589  2439 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:19.263859 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:19.265664  2385 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:19.266317  2385 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.266832  2385 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:19.263235  2435 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:19.201800  2443 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 12:13:19.240846  2317 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:13:19.265743 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 189979us
I20260709 12:13:19.253475  2453 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:19.273007 26439 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:19.277163 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 83231.8us
W20260709 12:13:19.283712 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 213398us
I20260709 12:13:19.292040 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:19.292831 26547 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 20.
W20260709 12:13:19.307261 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 88033.7us
W20260709 12:13:19.308081 26438 leader_election.cc:336] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.135s (SENT)
I20260709 12:13:19.308480 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:19.271317  2435 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:19.311339  2435 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:19.314430 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.314687  2195 consensus_queue.cc:1059] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:19.228708  2461 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:19.315532  2195 consensus_queue.cc:1243] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 19.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:13:19.316077  2195 raft_consensus.cc:3055] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:19.316429  2195 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:19.317111  2461 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:19.221956  2486 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.072s
I20260709 12:13:19.317375  2195 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:19.278914  2311 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:19.318790  2311 raft_consensus.cc:697] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:19.276381  2373 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:19.327243 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:19.323658 26541 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:19.287032  2317 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.292357  2386 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:19.338786  2353 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:19.336256  2317 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:19.360158  2439 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:19.326643  2373 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:19.320259  2453 raft_consensus.cc:697] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:19.361824  2373 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:19.363384  2373 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:19.363646  2453 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:19.319921  2382 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:19.370430  2382 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:19.372583  2311 consensus_queue.cc:237] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:19.374671  2428 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:19.375398 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.379091  2386 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:19.380483  2386 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:19.390496 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:19.335301  2195 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:19.331964  2307 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:19.403049 26467 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 18. (term mismatch)
I20260709 12:13:19.400772 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:19.409214 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 66068.5us
I20260709 12:13:19.411345 26467 pending_rounds.cc:85] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 17
I20260709 12:13:19.411839 26467 pending_rounds.cc:107] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 23.18
W20260709 12:13:19.413460 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 124288us
I20260709 12:13:19.404667  2439 consensus_queue.cc:1059] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 12:13:19.416093  2439 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:19.416493  2439 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:19.324932  2465 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:19.417421  2439 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:19.419734  2465 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:19.420512  2441 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:19.420719 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:19.421077  2441 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.421537  2441 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:19.423774  2489 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:19.420506 27168 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: [27.19-27.19]
I20260709 12:13:19.422034 27133 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:19.430660 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:19.430742 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:19.412895 26467 raft_consensus.cc:2889] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:19.431614 26467 pending_rounds.cc:107] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 25.19
I20260709 12:13:19.432070 26467 raft_consensus.cc:2889] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:19.434705  2486 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:19.435707 26514 leader_election.cc:400] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 27. Current term is 28.
I20260709 12:13:19.445132 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:19.451551 26472 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 33.
I20260709 12:13:19.393085  2440 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:19.460202 26514 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:19.446425  2435 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.016s
I20260709 12:13:19.462913 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:19.470643 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 197707us
I20260709 12:13:19.471025 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:19.469195 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:19.459646  2437 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 12:13:19.468044  2428 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:19.476799  2465 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:19.505692  2465 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:19.506150  2465 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:19.484608 26439 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:19.483537  2353 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 12:13:19.511567  2353 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:19.511960  2353 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:19.512763  2353 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:19.513470 26472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "3262bf0553e543eea76794fc529a9acc"
 from {username='slave'} at 127.0.0.1:57944
I20260709 12:13:19.494724  2439 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:19.514567 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:19.515239 27168 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:19.514146 26472 raft_consensus.cc:606] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Received request to transfer leadership to TS 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:19.519176 26472 raft_consensus.cc:614] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:19.514087  2353 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:19.521096 27165 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: [27.21-27.21]
I20260709 12:13:19.522477 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:19.522617 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:19.523313 27160 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 28: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:19.523825 26620 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:19.524883  2307 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:19.524986 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:19.525436  2307 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.525838  2307 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:19.527347  2448 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:19.528029  2448 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:19.486573  2459 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 12:13:19.496927  2440 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:19.481130  2434 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:19.502002  2451 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:19.505084 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:19.492378 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:19.491554 26514 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:19.543336 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:19.543375 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:19.545178 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.552001 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:19.552945 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:19.555233 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:19.562376 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:19.563118 26466 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:19.565398 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:19.567886 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:19.571357 26467 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 28: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:19.561679 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:13:19.572908 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 80610.8us
I20260709 12:13:19.529474  2448 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.19, Last appended by leader: 19, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:19.547024  2434 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:19.583206 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 91747.7us
I20260709 12:13:19.582120 26466 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
W20260709 12:13:19.607106 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 45525.8us
I20260709 12:13:19.587360 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:19.585146 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 80133.4us
I20260709 12:13:19.567884  2428 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:19.584369 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:19.572505  2490 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:19.582504  2435 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:13:19.583873  2496 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 0.176s	user 0.000s	sys 0.002s
I20260709 12:13:19.670195  2307 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:19.663686 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.585690  2440 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:19.643486  2434 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:19.683056  2490 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:19.572691  2453 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.102s
I20260709 12:13:19.609915  2386 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:19.618625  2382 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:13:19.696441 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:19.697402 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 113157us
W20260709 12:13:19.710148 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 82866.5us
I20260709 12:13:19.712375 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:19.682137  2435 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.702073  2055 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:19.727684 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:19.728324 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 197336us
I20260709 12:13:19.715359  2382 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:19.734766  2382 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:19.734781  2448 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:19.736677  2307 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:19.736999  2498 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:13:19.742599  2506 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:19.742868 26514 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:19.743702  2506 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:13:19.745584 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 76431.8us
I20260709 12:13:19.745873  2506 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:19.746691 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:19.747336 27168 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:19.746723  2394 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:19.748081 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:19.748034 26514 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:19.714872  2459 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:19.714598  2386 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:19.720404  2435 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:19.756268  2311 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:19.756795  2311 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:19.716563  2313 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.038s
I20260709 12:13:19.754547 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:19.707824  2385 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:19.755524 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:19.769737 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 59262.3us
I20260709 12:13:19.771015 26514 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:19.758580  2386 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:19.754266  2307 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:19.777457 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:19.779332  2497 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:13:19.779991  2385 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:19.762944  2506 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:19.762526  2311 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:19.749565  2317 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:19.788866  2317 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:19.786513  2195 raft_consensus.cc:2764] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:13:19.760831  2263 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:19.757328  2055 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:19.793270 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:19.800901 26514 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:19.766777  2440 consensus_queue.cc:1059] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 12:13:19.792685  2373 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:19.792896  2453 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:19.829066 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:19.822548  2317 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:19.799489  2307 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 21 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:13:19.833132 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 86807.9us
I20260709 12:13:19.811877  2451 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:19.840907 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47739.9us
W20260709 12:13:19.845849 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.834549 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:19.823153  2191 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:19.828176  2195 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:19.853717 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:19.858125 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:19.859129 26465 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:19.866204 26541 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:13:19.867082 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:19.867755 26618 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:19.868167 26514 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:19.873510 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:19.874182 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:19.874366 26544 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:13:19.874868 26617 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:19.875897 26541 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 12:13:19.846904  2506 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:19.879691 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:19.881971 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:19.882615 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:19.883431 26470 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:19.798799  2490 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:19.888310 26471 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: [27.19-27.19]
I20260709 12:13:19.892736 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:19.893875 26540 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 27: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:19.894069 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:19.888708 26464 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 12:13:19.891505 26545 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 15. (term mismatch)
I20260709 12:13:19.899441 26545 pending_rounds.cc:85] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 14
I20260709 12:13:19.899718 26545 pending_rounds.cc:107] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 23.15
I20260709 12:13:19.900044 26545 raft_consensus.cc:2889] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:19.891597 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:19.887976 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:19.894761 26539 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:19.903120 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:19.905037 26544 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:19.884083  2428 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:19.908164 26468 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:13:19.912624 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:19.884773  2500 raft_consensus.cc:3055] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:19.916570 26466 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:13:19.916560 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:19.918421 26546 raft_consensus.cc:2376] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28. Re-sending same reply.
I20260709 12:13:19.920085 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:19.926299 26617 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
W20260709 12:13:19.931945 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 66997us
I20260709 12:13:19.932948 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:19.896041  2459 consensus_queue.cc:1059] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 12:13:19.933784 26546 raft_consensus.cc:2368] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31.
I20260709 12:13:19.912501  2394 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:19.939337 26539 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 12:13:19.948158 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:19.948365 26544 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:19.915621  2500 raft_consensus.cc:740] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:19.955188 26466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:57944
I20260709 12:13:19.956082 26466 raft_consensus.cc:606] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:19.956559 26466 raft_consensus.cc:614] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:19.950445 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:19.949357 26540 pending_rounds.cc:85] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 14
I20260709 12:13:19.963997 26540 pending_rounds.cc:107] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 24.15
I20260709 12:13:19.964311 26540 raft_consensus.cc:2889] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:19.967617 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:19.896862  2055 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:19.986109  2317 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:19.986629  2317 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:19.987520  2317 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 27.21, Last appended by leader: 21, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:19.988305 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.989737 26472 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:19.990614  2435 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:19.936627  2441 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.515s	user 0.013s	sys 0.000s
I20260709 12:13:19.981338 26439 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:19.954319  2459 consensus_queue.cc:1243] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 12:13:20.027211 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 76904.4us
I20260709 12:13:20.028995  2440 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:20.029439 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:20.030382 26617 raft_consensus.cc:2410] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
W20260709 12:13:20.018996 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52526.6us
I20260709 12:13:20.031243 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:20.046705 26622 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:20.047067  2440 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:20.047276 26613 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:13:20.048183 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:20.048103  2440 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:20.048905 26614 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:20.048130 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:20.049970 26615 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 27: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:19.919840  2307 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:19.949472  2515 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.135s
I20260709 12:13:20.054978 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:20.053725 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:20.058424  2191 raft_consensus.cc:697] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 22 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:20.059419  2195 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.060210  2195 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:20.063055  2195 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:20.066525  2428 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.067060  2428 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:20.069080  2428 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:20.071233  2428 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:20.072224  2428 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:20.072739  2428 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:20.074165  2428 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:20.076035  2428 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:20.079747  2437 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:20.080214  2437 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:20.081125  2437 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:20.042409  2311 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:19.994293  2441 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:20.057044  2465 consensus_meta.cc:287] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.006s
I20260709 12:13:20.089435 26618 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:20.027783  2394 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:20.089941 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:20.100139 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:20.100459 26472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684"
dest_uuid: "01a57027214a411e80874ac7febd628b"
mode: GRACEFUL
new_leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
 from {username='slave'} at 127.0.0.1:57944
I20260709 12:13:20.103075 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:20.103389 26472 raft_consensus.cc:606] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Received request to transfer leadership to TS ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:20.091133 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:20.103753 26618 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:20.105593 26470 raft_consensus.cc:2410] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 24 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 12:13:20.082063 26465 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:20.098718 26620 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:20.092173 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:20.093636 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:20.111531 26614 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
W20260709 12:13:20.113467 26513 leader_election.cc:336] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.507s (SENT)
W20260709 12:13:20.201102 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 84840.2us
I20260709 12:13:20.059554  2191 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:20.206786 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:20.211675  2531 raft_consensus.cc:2764] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 12:13:20.215196 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:20.094482  2311 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:20.218815  2531 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:20.219667 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:20.232262  2531 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:20.232931  2531 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:20.233636 26621 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:20.235154  2435 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:20.236166 26621 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:20.236812  2263 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:20.237682 26621 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:20.098906  2441 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:20.115584  2521 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 12:13:20.205336 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 114331us
I20260709 12:13:20.201203  2518 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:20.226006 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:20.231063 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:20.221210  2373 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:20.257005 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:20.111018  2465 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:20.098944  2523 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.151s
W20260709 12:13:20.269357 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.274732  2441 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:20.249887  2435 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:20.285857  2526 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
W20260709 12:13:20.278291  2382 consensus_meta.cc:287] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.001s
I20260709 12:13:20.305171  2465 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:20.310952 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:20.290781  2191 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:20.318331  2434 consensus_meta.cc:287] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.001s
I20260709 12:13:20.334756  2434 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:20.336303 26622 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:20.337013  2500 consensus_queue.cc:260] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:20.309262  2382 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:20.326196 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:20.254151  2394 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:20.326671 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.319255  2435 raft_consensus.cc:2764] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260709 12:13:20.322129  2191 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:20.327822 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:20.332192  2518 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:20.343324 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.351670 27163 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: [21.14-23.15]
I20260709 12:13:20.349380 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:20.350169 27165 raft_consensus.cc:1217] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Deduplicated request from leader. Original: 18.15->[20.16-20.16]   Dedup: 20.16->[]
I20260709 12:13:20.352463 27165 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 12:13:20.353749 27159 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 12:13:20.356621 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:20.358006 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:20.358259 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:20.359313  2191 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:20.359409  2441 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:20.359570  2523 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:20.360471  2523 raft_consensus.cc:697] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:20.360422  2441 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:20.361085  2514 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:20.361312 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:20.361696  2514 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:20.361549  2523 consensus_queue.cc:237] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:20.362586  2440 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:20.362735  2514 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:20.364140 27163 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 22 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:20.359427 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:20.363430 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:20.347784  2500 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:20.366962 26622 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
I20260709 12:13:20.365567 26438 leader_election.cc:400] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31.
I20260709 12:13:20.380746 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:20.381929 26438 leader_election.cc:403] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:20.381662 27134 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:20.363474  2440 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:20.353230  2518 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:20.388329 27168 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:20.386324 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:20.388809  2513 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:20.382673  2435 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:20.398113 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:20.410892 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:20.418500  2386 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.644s	user 0.013s	sys 0.000s
I20260709 12:13:20.418645  2515 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:20.390336  2524 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:20.427515  2516 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:20.427927  2524 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.428396  2524 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:20.429381 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:20.388077  2307 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 31
I20260709 12:13:20.426867  2515 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:20.408331  2513 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:20.431278  2516 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:20.432370 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:20.435189  2515 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:20.440721  2513 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:20.441239  2513 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:20.441650  2513 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:20.441888 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:13:20.443228  2538 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:13:20.444208  2441 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:20.444854  2441 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:20.430123  2531 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:20.446889 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.438208  2437 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:20.448196 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:20.450639 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 85165.9us
I20260709 12:13:20.451902 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:20.456807 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:20.457091 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:20.457916 26617 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 33: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:20.453142  2451 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:20.458829  2451 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.459196  2451 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:20.460021 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:20.445812  2441 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:20.460678 26466 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:20.465844 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:20.467650  2519 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 12:13:20.470896 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:20.485167 26470 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:20.473727  2451 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:20.475170  2540 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:13:20.477694 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:20.478578 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:20.474529  2440 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:20.486907 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:20.527468 26546 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:20.528221 26544 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:13:20.490650 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.528425 26540 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:20.434438  2386 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:20.450950  2434 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:20.493937 26358 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 953d8c981a6c459f8b7f3dbbb66fda45 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3262bf0553e543eea76794fc529a9acc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:20.461150  2382 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:20.449589  2516 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.041s
I20260709 12:13:20.484577  2313 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:20.541263 26470 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:20.543700 26469 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 27: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:20.458215  2394 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.080s
W20260709 12:13:20.552496 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 95763us
I20260709 12:13:20.484874  2468 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.054s
I20260709 12:13:20.573024 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:20.574077 26542 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:20.577214 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:20.556957  2542 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:13:20.554800 26439 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:20.568642 26544 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:13:20.570571 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:20.586438 26539 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 19.
I20260709 12:13:20.578269 26542 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:20.581465 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:20.537990  2440 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:20.588068 26543 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:20.587875 26466 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:20.539547  2516 consensus_queue.cc:1243] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:13:20.590709 26540 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:13:20.594599 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:20.595263 26548 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:20.595091 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 114499us
I20260709 12:13:20.595503 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:20.596784 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:20.597607 26540 raft_consensus.cc:2368] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21.
I20260709 12:13:20.598989 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:20.600978 27168 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:20.602659 26546 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:20.606372 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:20.611177 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:20.611931 26546 raft_consensus.cc:2410] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:13:20.612850 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:20.589380  2428 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.616868 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:20.618019 26540 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:20.620093 26546 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:20.610499 26514 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:20.554456  2519 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 12:13:20.594038  2313 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:20.627905 26548 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:20.635742  2531 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:20.636550  2531 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:20.637079  2531 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:20.622668  2428 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:20.639588 26544 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:13:20.559414  2518 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:20.561355  2515 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:20.622821  2373 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.034s
W20260709 12:13:20.705260 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 98948.6us
W20260709 12:13:20.657549  2539 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 12:13:20.638029  2531 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:20.639348  2435 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 12:13:20.708134  2552 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:20.718690 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:20.720669 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:20.723825 26548 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:13:20.735812 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:20.736730 26464 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:20.746299 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 1199) took 1193 ms. Trace:
I20260709 12:13:20.747377 26469 rpcz_store.cc:276] 0709 12:13:19.552536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:19.564166 (+ 11630us) service_pool.cc:224] Handling call
0709 12:13:20.746012 (+1181846us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54001c0554. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:20.746187 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2074664704}
I20260709 12:13:20.747969  2518 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:20.749245  2544 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
W20260709 12:13:20.755717  2529 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.690s	user 0.005s	sys 0.000s
I20260709 12:13:20.758745  2551 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:20.759534  2551 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.760087  2551 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:20.764356  2317 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:20.768066 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:20.770793 26622 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 12:13:20.772894 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:20.774132  2411 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:20.775238 26540 pending_rounds.cc:85] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 15
I20260709 12:13:20.775701 26540 pending_rounds.cc:107] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 12:13:20.776021 26540 raft_consensus.cc:2889] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:20.778304  2545 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:13:20.782963  2515 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:20.727352  2451 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:20.826010 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 87888.2us
W20260709 12:13:20.830523 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.831050 27165 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:13:20.846460  2373 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.846866  2559 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:20.847256  2373 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:20.848341 26464 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:13:20.847869  2559 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:20.851454  2559 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:20.879128 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:20.810168  2555 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:20.733726  2524 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:20.850087  2373 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:20.660892  2440 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:20.887629 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 264649us
I20260709 12:13:20.892241 26543 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 20.
I20260709 12:13:20.897203 26470 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:20.733510  2552 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:20.898687 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.896235 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:20.908188 26514 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:20.909305 26470 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:20.909739 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:20.910902 26466 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 27: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:20.913503 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:20.914045 26464 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: []
W20260709 12:13:20.905463  2489 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.004s	sys 0.010s
W20260709 12:13:20.902093  2529 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:13:20.895789  2428 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:20.945766  2524 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:20.883325  2556 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.068s
I20260709 12:13:20.947391  2556 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:20.947795  2556 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:20.948776  2556 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:20.950065  2556 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:20.921764  2549 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
W20260709 12:13:20.931064  2547 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:13:20.938779  2563 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election won for term 31
W20260709 12:13:20.941032  2500 consensus_meta.cc:287] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.001s
I20260709 12:13:20.896776  2555 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:20.883071  2514 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:13:20.950804 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:20.951176  2386 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:20.952046 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:20.952606  2552 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:20.954747 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:20.901824  2559 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 12:13:21.019492 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.020985 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:20.916630  2513 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:21.024627  2513 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:20.960704 26614 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31. Ops: []
I20260709 12:13:21.025446 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:21.026674 26618 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:21.027805 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.028460  2563 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 31 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:21.028573 26466 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:20.963583  2459 raft_consensus.cc:3055] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:21.029752  2459 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:21.029569  2563 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 29.14, Last appended by leader: 14, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:21.030700  2459 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:21.032045  2459 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:21.032660  2385 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 30.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:13:21.033834  2385 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:20.964927 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:21.034660  2385 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:20.964944 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:21.034998  2385 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:21.035897  2385 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 30.19, Last appended by leader: 19, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:21.036770  2500 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:21.037334  2385 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:21.038801  2552 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:21.039417  2552 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:21.013700  2428 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:21.016582 27165 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:13:21.040362  2552 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:21.026749 26621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "3262bf0553e543eea76794fc529a9acc"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:13:21.041530 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.041853 26621 raft_consensus.cc:606] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Received request to transfer leadership to TS 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:21.045933  2555 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:20.976303 26619 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:20.977530  2551 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:20.978539  2394 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.979236 26617 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:20.980122 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:20.980499  2550 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:13:20.889403  2313 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:13:20.985793 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:20.986034 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:21.008200 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 100103us
W20260709 12:13:20.986613  2489 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.004s	sys 0.010s
I20260709 12:13:21.013337 26472 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
W20260709 12:13:21.005959  2307 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.000s
I20260709 12:13:21.055986 26588 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:21.028024  2514 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.078876 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:20.962754 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:21.079974 26622 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:21.047333 26470 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:20.972093  2411 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:21.029592 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.081373 26466 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 27: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:21.022224 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.085083 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:21.093181 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.093058 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:21.037362  2500 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:21.103773 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:21.072219 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:21.054209  2263 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.074009 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:21.018292  2568 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.062s	user 0.003s	sys 0.000s
W20260709 12:13:21.089527  2523 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.005s	sys 0.015s
I20260709 12:13:21.099522 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:21.099524 26513 leader_election.cc:336] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.779s (SENT)
I20260709 12:13:21.123422 26513 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:21.100253 27163 raft_consensus.cc:2368] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 25. Current term is 26.
I20260709 12:13:21.048305 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:21.102468 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:21.083173  2307 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 30. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31.
I20260709 12:13:21.083381  2441 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:21.131805 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.114914 26470 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:13:21.117815 26469 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:21.075112 26472 pending_rounds.cc:85] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 14
I20260709 12:13:21.134884 26472 pending_rounds.cc:107] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 12:13:21.135269 26472 raft_consensus.cc:2889] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:21.121754 26464 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 33.
W20260709 12:13:21.124756 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 76573.6us
I20260709 12:13:21.112743 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:21.105072  2437 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.146050 26467 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:21.148072 26473 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 12:13:21.152539 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:21.153271 26543 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:21.124233  2523 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.006s	sys 0.015s
I20260709 12:13:21.157703 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:21.158941 26541 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:21.160293 26539 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:21.164762 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:21.165786 26547 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:21.169474 26542 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:13:21.172896 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:21.173858 26542 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:13:21.079097  2394 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:21.128702  2516 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:21.089812  2386 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.049s
I20260709 12:13:21.090173  2514 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:21.129734  2441 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:21.204300 26543 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:13:21.113831  2555 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 12:13:21.206755 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:21.221710 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:21.222674 26470 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:21.224166 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:21.225382 26548 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:21.225456 26543 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:21.133474  2559 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.072s
I20260709 12:13:21.124269  2263 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:21.201432  2528 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:13:21.240471 26542 raft_consensus.cc:3055] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:21.241820 26542 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:21.249804 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 125629us
W20260709 12:13:21.250742 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:21.208709  2448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.020s	sys 0.023s
I20260709 12:13:21.149235  2515 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.074s
I20260709 12:13:21.226650  2441 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:21.261133 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.270833 26470 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:21.265744 26541 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:13:21.168941  2437 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:21.272331 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:21.224897  2551 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:21.267511 26543 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:13:21.246011 26542 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:21.256222  2448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.020s	sys 0.023s
I20260709 12:13:21.229176  2565 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:21.284205  2394 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:21.194124  2500 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:21.287482  2500 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:21.290758  2581 consensus_queue.cc:1059] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:21.291766  2581 consensus_queue.cc:1243] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:13:21.294584  2564 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:21.295221  2564 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:21.297464 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:13:21.298774  2561 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:13:21.300989  2525 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:21.301632  2525 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:21.303985  2525 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:21.305442 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.307723  2514 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:21.232870  2313 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:21.310232 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.311040 26464 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:21.312665 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.313030  2263 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:21.298230 26546 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:13:21.321353 26471 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:13:21.271979 26547 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:13:21.306232 26466 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:21.325861 26548 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:13:21.247785  2516 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:21.328012 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.328293 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:21.329828 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.331089 26622 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
I20260709 12:13:21.331530 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.332549 26472 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 27: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:21.333633 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:21.334867 26542 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:21.336822 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 196040us
I20260709 12:13:21.359355 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:21.360582 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:21.363291 26622 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:21.339224  2386 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Stepping down as leader of term 25
W20260709 12:13:21.341499  2579 log.cc:927] Time spent T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.066s	user 0.002s	sys 0.001s
W20260709 12:13:21.342314  2576 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.066s	user 0.003s	sys 0.000s
I20260709 12:13:21.342869 26472 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 27: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:21.382087 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.382967 26472 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 27: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:21.345552 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:21.297508  2564 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:21.365708 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:21.366595 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:21.369220  2512 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.370599  2551 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:21.371848  2437 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:21.375286  2569 log.cc:927] Time spent T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:13:21.378738 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.360121 27168 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:13:21.346745 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:21.412853 27159 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:13:21.379501  2386 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:21.392269 26546 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
I20260709 12:13:21.396379 27163 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:21.426317 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:21.327747  2394 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:21.410077 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:21.394491  2581 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:21.389725 26438 leader_election.cc:400] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21.
I20260709 12:13:21.400087  2317 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:21.429324 27160 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
W20260709 12:13:21.425284 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 174711us
I20260709 12:13:21.404170  2551 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:21.449136 26513 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:21.468104  2514 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.468968  2514 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:21.472977  2514 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:21.473754 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:21.474483 26548 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:21.483711 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:21.486637  2514 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:21.487527  2514 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:21.488754  2514 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:21.496708 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:21.498065  2451 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:21.424117  2263 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader election won for term 33
W20260709 12:13:21.499979 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 110370us
I20260709 12:13:21.503765 26464 raft_consensus.cc:2410] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:13:21.511143 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:21.511744 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:21.505559 26542 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:21.394451  2525 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.041s
I20260709 12:13:21.528123 26467 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:21.435354  2467 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.407686  2512 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:21.538614 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:21.539775  2555 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:21.540494  2555 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:21.529817 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:21.540897  2555 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:21.541342  2555 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:21.542680  2440 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:21.543447  2519 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:21.544824 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:21.548806  2448 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:21.549538  2520 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:21.550253  2520 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:21.550634  2551 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:21.551235  2520 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:21.446148  2581 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:21.551982  2551 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:21.430589  2307 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.102s
I20260709 12:13:21.574918  2531 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:13:21.578248  2574 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.305s	user 0.001s	sys 0.001s
I20260709 12:13:21.582441 26614 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:21.584546 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:21.585667  2531 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:13:21.586261  2531 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:21.586934  2583 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:21.587246  2531 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 30.19, Last appended by leader: 19, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:21.441033  2394 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:21.586982  2564 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:21.591143 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:21.591512  2434 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:21.593346  2519 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:21.593462  2434 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:21.593982  2519 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:21.595002  2519 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:21.596002  2512 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:21.597186 26622 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 12:13:21.597795 26622 pending_rounds.cc:85] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 12
I20260709 12:13:21.598021 26622 pending_rounds.cc:107] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 12:13:21.598281 26622 raft_consensus.cc:2889] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:21.603520 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47598us
I20260709 12:13:21.617043  2441 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:21.622476 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:21.623582 26471 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:21.628558 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.626240  2441 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:21.562103  2459 consensus_meta.cc:287] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.002s
I20260709 12:13:21.590107  2394 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:21.558830  2263 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 33 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:13:21.655318 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.445627  2565 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.156s
W20260709 12:13:21.598237  2573 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.324s	user 0.002s	sys 0.001s
I20260709 12:13:21.654767 26546 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:21.556916  2448 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:21.651628 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 242533us
I20260709 12:13:21.684473 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.645918  2552 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.533275  2524 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.121s
I20260709 12:13:21.675275 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.427258  2516 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:21.571825  2555 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:21.671793 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 232666us
I20260709 12:13:21.687531 27163 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:13:21.685441 26466 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:13:21.686514 26471 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:13:21.558089  2467 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:21.760171 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 51072.7us
I20260709 12:13:21.762862 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:21.705781 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:21.702358 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:21.709008 26514 leader_election.cc:400] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 25. Current term is 26.
I20260709 12:13:21.732892 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.766224 26472 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:13:21.696138  2552 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:21.767325 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:21.768347 26472 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:21.735132 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.768965 26465 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:21.738943 26467 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:13:21.710173  2459 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:13:21.740527  2581 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:21.561036  2386 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:21.713768 26468 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 12:13:21.791788 26468 pending_rounds.cc:85] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 13
I20260709 12:13:21.792099 26468 pending_rounds.cc:107] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 12:13:21.792410 26468 raft_consensus.cc:2889] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:21.760483  2556 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.754s	user 0.010s	sys 0.005s
I20260709 12:13:21.691045  2468 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.760133 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.765724 26514 leader_election.cc:403] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:13:21.797091 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 88272.2us
I20260709 12:13:21.768888 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:21.797960 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 380661us
W20260709 12:13:21.747503  2385 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.710s	user 0.007s	sys 0.008s
I20260709 12:13:21.700459  2559 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.698153  2373 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.848610  2373 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:21.851174  2594 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:21.851593  2373 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:21.786337 26472 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:21.853300 26472 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:21.788940 26465 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:21.704396  2465 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.854687  2448 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:21.855922  2465 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:21.856923  2467 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:21.857517  2263 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 32.21, Last appended by leader: 21, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:21.823559 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:21.698698  2525 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.081s
I20260709 12:13:21.827863 26544 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:21.828624 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:21.831717 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:21.791288  2489 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:21.707141  2440 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 12:13:21.835239 26464 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:13:21.836995 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3169) took 1111 ms. Trace:
I20260709 12:13:21.821376  2581 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 25. Current term is 26.
I20260709 12:13:21.878599 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:21.879439 26544 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:21.880087 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 431037us
I20260709 12:13:21.880836 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:21.881425 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:21.838987 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:21.882500 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 43613us
I20260709 12:13:21.872084 26540 rpcz_store.cc:276] 0709 12:13:20.726105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.726337 (+   232us) service_pool.cc:224] Handling call
0709 12:13:20.774922 (+ 48585us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:21.079609 (+304687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:21.079642 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:21.080269 (+   627us) log.cc:844] Serialized 52 byte log entry
0709 12:13:21.348963 (+268694us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:21.479379 (+130416us) log.cc:844] Serialized 14 byte log entry
0709 12:13:21.835897 (+356518us) log.cc:844] Serialized 14 byte log entry
0709 12:13:21.836611 (+   714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:21.836701 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:21.836739 (+    38us) raft_consensus.cc:1685] finished
0709 12:13:21.836750 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:21.836914 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46911,"prepare.queue_time_us":196527,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":67,"raft.queue_time_us":155597,"raft.run_cpu_time_us":399,"raft.run_wall_time_us":10050,"thread_start_us":896548,"threads_started":4,"wal-append.queue_time_us":317862}
I20260709 12:13:21.847532  2559 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:21.862818 26542 raft_consensus.cc:2410] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 27 because replica has last-logged OpId of term: 26 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 15.
I20260709 12:13:21.833097 26468 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:21.863473 26471 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:21.881669 26546 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:21.838091 27134 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:21.891707 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:21.858251  2465 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:21.911916 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:21.917126 26469 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:13:21.918078 26547 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:13:21.862960  2386 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:21.923729 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:21.924578 26542 raft_consensus.cc:2368] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25.
W20260709 12:13:21.927709 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 89749.5us
I20260709 12:13:21.928571 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:21.929447 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:21.929877 26547 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:21.823371  2468 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:21.871011  2486 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:21.937152 26542 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:13:21.954906  2563 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:21.955566  2563 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:21.956707  2563 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:21.947666 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:21.897647  2523 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.962984 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:21.972959 26544 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:21.894562  2489 raft_consensus.cc:697] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:21.926546  2434 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:13:21.930927  2565 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:21.950412  2524 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:21.982251 26546 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:21.984144 26540 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:21.990109 26470 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:13:21.990424 26547 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:13:21.921689  2601 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:21.979354 26542 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 12:13:21.996506 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 46527.8us
W20260709 12:13:22.001024 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.950109  2440 consensus_queue.cc:1243] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 22.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:13:21.755792 26362 catalog_manager.cc:5697] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.992887  2434 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:22.013257 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:22.027212 26546 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:22.027911 27163 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:13:22.030275 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:21.974805  2512 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 12:13:21.968593  2553 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:21.965749  2437 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:13:22.006140  2590 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 12:13:22.004487  2490 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:22.037469 26546 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:22.038678 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:22.050534 26540 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:22.021616  2524 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:21.980841 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:21.995393  2523 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:22.011713  2552 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:21.976270  2486 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:22.016306 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:22.013589 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 317570us
I20260709 12:13:22.047860 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:22.033356  2434 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:22.027201  2440 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.068889 27165 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:13:22.083057 27163 raft_consensus.cc:2393] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 28: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:22.049248  2553 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:22.099398 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 272517us
I20260709 12:13:22.102695 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:22.103579 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:22.053197  2555 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:22.106534 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 90354.9us
I20260709 12:13:22.107504 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:22.108564 26540 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:22.110986  2553 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:22.073757  2459 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.112407 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:22.061791  2556 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:22.123790 27160 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:13:22.086862  2373 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.092120  2519 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
W20260709 12:13:22.115280  2584 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 12:13:22.119553  2459 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:22.135676 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:22.145937 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:22.054694  2437 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:22.164848 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:22.171962  2600 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:13:22.172283  2512 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.172937  2512 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:22.110623  2307 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.038s
I20260709 12:13:22.175397  2512 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:22.175688  2468 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:22.149734  2581 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:22.137748  2373 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:22.134366  2519 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:22.182539  2459 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:22.182948  2519 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:22.183753  2373 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:22.185708 26616 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:22.163396  2524 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:22.187320  2523 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:22.188019  2559 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:22.110679  2440 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:22.188856 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:22.189563 26616 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
W20260709 12:13:22.190044  2591 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:13:22.190332  2440 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:22.194660 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:22.195395 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:22.196033 26617 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:22.197260 26467 raft_consensus.cc:3055] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:22.197703 26621 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 14. (term mismatch)
I20260709 12:13:22.198143 26621 pending_rounds.cc:85] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 13
I20260709 12:13:22.198382 26621 pending_rounds.cc:107] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 24.14
I20260709 12:13:22.198653 26621 raft_consensus.cc:2889] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:22.198800  2500 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:22.172212  2565 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:22.199270  2500 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:22.197679 26467 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:22.199738  2500 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:22.200315 26467 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:22.201581 26467 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:22.202702 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 239834us
I20260709 12:13:22.203143 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3174) took 1005 ms. Trace:
I20260709 12:13:22.199290 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:22.206275 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:22.204296 26539 rpcz_store.cc:276] 0709 12:13:21.197434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.197640 (+   206us) service_pool.cc:224] Handling call
0709 12:13:21.198051 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:21.514487 (+316436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:21.514561 (+    74us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:21.515504 (+   943us) log.cc:844] Serialized 26 byte log entry
0709 12:13:22.056428 (+540924us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:22.056486 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:22.057806 (+  1320us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:22.202939 (+145133us) raft_consensus.cc:1685] finished
0709 12:13:22.202958 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:22.203081 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77954,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":98,"thread_start_us":698989,"threads_started":2,"wal-append.queue_time_us":574887}
I20260709 12:13:22.210633 26621 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 28 index: 14. Preceding OpId from leader: term: 31 index: 15. (index mismatch)
W20260709 12:13:22.213407 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.213500 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:22.208942 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:22.203750 26513 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:22.153475  2612 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.206532  2565 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:22.216516  2385 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:22.214607  2578 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.214741  2559 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.217487  2588 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:22.218321 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:22.219679  2523 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:22.225565 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:22.239996 26617 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
W20260709 12:13:22.247239 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 43569.6us
I20260709 12:13:22.319885 26513 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:22.281375  2428 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:22.275890 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.093931  2489 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:22.288663 26588 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:22.286310 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52075.7us
I20260709 12:13:22.287339  2373 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.293057 27163 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 12:13:22.299369 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:22.227617  2601 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.233140  2581 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:22.325542 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 100122us
I20260709 12:13:22.327035 27133 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:22.325716 26620 raft_consensus.cc:2410] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 29 because replica has last-logged OpId of term: 27 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 20.
I20260709 12:13:22.292479  2435 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.285722  2512 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:13:22.227973  2612 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:22.277671  2578 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:22.284042  2559 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:22.348235  2263 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 12:13:22.323657  2565 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:22.282465  2553 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:22.333815  2602 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:22.358285  2428 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.412951 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:22.348731  2490 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:22.362224  2592 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 12:13:22.384187 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:22.410430 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 121830us
I20260709 12:13:22.429044 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:22.434809 26464 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 29 index: 14. Preceding OpId from leader: term: 31 index: 15. (index mismatch)
W20260709 12:13:22.440574 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 69569us
I20260709 12:13:22.441366 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:22.442111 26464 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:22.369407  2468 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.363149  2603 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:22.349938  2581 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:22.345428  2373 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:22.522131 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 80164.7us
I20260709 12:13:22.524433 26613 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:22.526288 26588 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:13:22.566534 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:22.448257  2551 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.879s	user 0.007s	sys 0.007s
W20260709 12:13:22.577615 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.348435  2435 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:22.374013  2441 consensus_queue.cc:1059] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.145s
I20260709 12:13:22.431885  2520 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:22.343847  2601 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:22.591064  2624 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.019s
I20260709 12:13:22.608132 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:22.596473  2612 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:22.598626 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3181) took 1113 ms. Trace:
I20260709 12:13:22.613705 26548 rpcz_store.cc:276] 0709 12:13:21.485023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.485230 (+   207us) service_pool.cc:224] Handling call
0709 12:13:21.485660 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:21.553521 (+ 67861us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:13:21.835236 (+281715us) log.cc:844] Serialized 14 byte log entry
0709 12:13:21.836652 (+  1416us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:21.836703 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:21.836755 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:22.598212 (+761457us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b54002369d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:22.598285 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:22.598528 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":340,"prepare.queue_time_us":138377,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":5640,"raft.queue_time_us":1407,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":7385,"spinlock_wait_cycles":155459840,"thread_start_us":281311,"threads_started":1}
W20260709 12:13:22.599386 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 215316us
I20260709 12:13:22.600229  2559 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:22.443624  2428 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:22.584415  2523 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.608414 26543 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
W20260709 12:13:22.594435  2610 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.264s	user 0.000s	sys 0.000s
I20260709 12:13:22.612411 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:22.625870 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 293538us
W20260709 12:13:22.652751 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 60213.2us
I20260709 12:13:22.523032  2514 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.091s
I20260709 12:13:22.653833 26513 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:22.668081 26438 leader_election.cc:400] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25.
I20260709 12:13:22.668622 26438 leader_election.cc:403] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 12:13:22.545526  2468 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:22.611855  2520 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:13:22.643319  2386 consensus_meta.cc:287] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.710s	user 0.013s	sys 0.000s
I20260709 12:13:22.684181 26548 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:13:22.691875 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:22.692531 26548 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:22.685762 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:22.686611 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:22.670353 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 144119us
I20260709 12:13:22.700806  2518 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:22.690145 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3179) took 1219 ms. Trace:
I20260709 12:13:22.702881  2518 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:22.702140 26541 rpcz_store.cc:276] 0709 12:13:21.470507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.471440 (+   933us) service_pool.cc:224] Handling call
0709 12:13:21.601845 (+130405us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:13:21.602056 (+   211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:21.602265 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:13:22.056895 (+454630us) log.cc:844] Serialized 14 byte log entry
0709 12:13:22.689476 (+632581us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:22.689573 (+    97us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:22.689684 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:22.689815 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:22.690053 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4533,"prepare.queue_time_us":140179,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":118813,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":23372,"spinlock_wait_cycles":4583168,"thread_start_us":1080653,"threads_started":3,"wal-append.queue_time_us":556520}
I20260709 12:13:22.709775 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:22.710762 26548 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:22.723526 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:22.728053 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.728683 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:22.732407 26438 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:22.690486  2520 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:22.740270 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3231) took 1038 ms. Trace:
I20260709 12:13:22.740454 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:22.712831 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:22.742309 26546 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:22.697284  2552 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:22.740757 26467 rpcz_store.cc:276] 0709 12:13:21.702172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.776513 (+ 74341us) service_pool.cc:224] Handling call
0709 12:13:21.820970 (+ 44457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:22.197153 (+376183us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54003e2720. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f5076051dc0 00007f50760dc1c0 00007f50760dd231 00007f50760d9d8f 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c
0709 12:13:22.340415 (+143262us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:13:22.431299 (+ 90884us) log.cc:844] Serialized 14 byte log entry
0709 12:13:22.739011 (+307712us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:22.739303 (+   292us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:13:22.739645 (+   342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:22.739852 (+   207us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:22.740187 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94288,"prepare.queue_time_us":99614,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":40378,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":7324,"spinlock_wait_cycles":451522944,"thread_start_us":262035,"threads_started":1}
I20260709 12:13:22.730283  2625 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:22.694732  2612 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:13:22.752276  2385 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:22.775373  2385 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:22.776409  2385 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:22.763935  2629 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:13:22.689833  2486 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:22.658052  2523 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:22.782590  2437 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:22.736759  2307 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:22.689906  2622 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.079s
I20260709 12:13:22.783602  2307 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:22.705890  2555 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.047s
I20260709 12:13:22.784586  2307 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:22.786966  2553 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:22.788990  2468 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:22.789361  2565 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:22.732353  2512 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:22.732482  2386 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 12:13:22.757470  2643 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:22.758155  2628 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 12:13:22.751735  2552 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:22.762317  2578 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:22.771641  2435 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:22.783017  2523 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:22.755882  2630 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:22.748126  2518 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:22.819995  2578 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:22.814360  2643 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:22.793932  2500 consensus_meta.cc:287] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.001s
I20260709 12:13:22.706364  2614 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25.
W20260709 12:13:22.845840 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 401148us
I20260709 12:13:22.794869  2625 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:22.792626  2512 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:22.837172  2518 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:13:22.883486 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 149963us
W20260709 12:13:22.882543 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 203337us
I20260709 12:13:22.790347  2565 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.080s
I20260709 12:13:22.847658  2583 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:22.895057 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:22.847110  2578 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:22.895730 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 209258us
I20260709 12:13:22.892580 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:22.890285  2518 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:22.903810  2448 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:22.846143  2500 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:22.888168  2435 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 12:13:22.913940  2559 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:22.891871  2646 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.891963  2614 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:22.902076  2565 consensus_queue.cc:1243] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 28.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:13:22.918228 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:22.950562 26620 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:13:22.950651 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:22.918826 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:22.908336 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 166092us
I20260709 12:13:22.951821 26468 raft_consensus.cc:2410] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 32 because replica has last-logged OpId of term: 29 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 14.
I20260709 12:13:22.905661  2581 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:22.905925  2373 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:22.922717 26464 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:22.956568  2614 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:22.919863  2651 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:22.963552  2651 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:22.965011  2614 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:22.965824  2651 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:22.957106 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:22.968771 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:22.970013 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:22.924575 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:22.926792  2552 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:22.928632  2601 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:22.930029  2435 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:22.905857  2553 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 12:13:22.931463 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3409) took 1038 ms. Trace:
I20260709 12:13:22.987715 26542 rpcz_store.cc:276] 0709 12:13:21.892988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.967265 (+ 74277us) service_pool.cc:224] Handling call
0709 12:13:21.978794 (+ 11529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:22.015196 (+ 36402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:22.931244 (+916048us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5400104fd0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:22.931399 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25261440}
I20260709 12:13:22.989236 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:22.986449 26438 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:22.989969 26542 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
W20260709 12:13:22.933629  2434 consensus_meta.cc:287] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.824s	user 0.011s	sys 0.001s
W20260709 12:13:22.916355  2519 consensus_meta.cc:287] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.733s	user 0.013s	sys 0.000s
I20260709 12:13:22.947454 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:22.917555  2640 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:13:22.994295 26547 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:13:22.952929 26467 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 12:13:22.956224 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:22.951143  2559 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:22.971109  2523 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:22.972007  2630 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 12:13:22.957942 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.913606 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:22.984269 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:23.002208 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:22.995296 26614 pending_rounds.cc:85] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 13
I20260709 12:13:22.989362  2658 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:23.004364  2658 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:23.004781  2658 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:23.004698 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:23.006034  2559 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:23.006165 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:22.985740  2435 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:23.007156  2565 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:23.007712  2650 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:13:23.007890  2638 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 12:13:23.008204  2650 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:23.008630  2650 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:23.008510  2559 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:13:22.994704  2581 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.007725  2435 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.010820  2581 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.011744  2435 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:23.013213  2581 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:22.996304  2654 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.014359  2654 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:23.015295 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:22.947132  2646 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.016661  2654 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:22.959326  2386 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:13:23.003427 26614 pending_rounds.cc:107] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 28.14
I20260709 12:13:22.999207  2523 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:23.017967 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:23.018350 26614 raft_consensus.cc:2889] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:23.018515  2523 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:23.017990  2646 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:22.995570 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:23.000732  2601 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:23.022071  2601 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:23.024395  2428 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:23.024578  2601 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:23.024981  2643 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:23.016588 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:23.013254 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:23.026616 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:23.027457 26464 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:13:23.027485 26539 raft_consensus.cc:2410] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 28 because replica has last-logged OpId of term: 26 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 15.
I20260709 12:13:23.028183 26514 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:23.028666 26613 raft_consensus.cc:2410] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 26 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 15.
I20260709 12:13:22.949028  2448 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:22.994967  2434 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:23.043440  2317 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 12:13:23.043258  2643 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:22.999384  2614 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.055967 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:23.058341 26617 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:13:23.056799 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:23.000525  2373 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:23.060515 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:23.065295  2614 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.061632  2643 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:23.073720  2643 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:23.065778 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:23.076462 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:23.069796 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:23.086977 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:23.087162 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:23.088490 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:23.093554 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:23.094895 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:23.095388 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:23.096487 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:23.098269 26514 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:23.054075  2594 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:22.999927  2519 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:23.101359 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:23.068295  2514 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:23.126627  2514 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:23.127030  2523 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.127600  2514 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.128983  2514 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:23.129326  2523 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:23.130250 26467 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:23.099274  2428 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:23.132541  2671 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:13:23.133486 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:23.134558 26548 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:23.135957 26548 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 12:13:23.137279 26548 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 12:13:23.103039  2646 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.138978  2646 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.140321 26620 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 33. Current term is 34. Ops: []
I20260709 12:13:23.141412  2646 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:23.142269 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 3234) took 1387 ms. Trace:
I20260709 12:13:23.142674 26471 rpcz_store.cc:276] 0709 12:13:21.755171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.768596 (+ 13425us) service_pool.cc:224] Handling call
0709 12:13:23.142112 (+1373516us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x7b54000dbbd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:23.142212 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99000064}
W20260709 12:13:23.147361  2632 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.473s	user 0.003s	sys 0.000s
I20260709 12:13:23.148938 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1224) took 1046 ms. Trace:
I20260709 12:13:23.149382 26465 rpcz_store.cc:276] 0709 12:13:22.102675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:22.104756 (+  2081us) service_pool.cc:224] Handling call
0709 12:13:22.118139 (+ 13383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:22.128177 (+ 10038us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:22.128226 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:22.128796 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 12:13:22.338053 (+209257us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:22.376974 (+ 38921us) log.cc:844] Serialized 14 byte log entry
0709 12:13:22.377350 (+   376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:22.377466 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:23.047129 (+669663us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b18003edb20. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:13:23.146679 (+ 99550us) spinlock_profiling.cc:243] Waited 8.59 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:23.148694 (+  2015us) raft_consensus.cc:1685] finished
0709 12:13:23.148724 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:23.148870 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6044,"prepare.queue_time_us":42569,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":15142,"raft.queue_time_us":52430,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":10914,"spinlock_wait_cycles":32902656,"thread_start_us":208921,"threads_started":1,"wal-append.queue_time_us":456141}
I20260709 12:13:23.151784 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:23.152223  2614 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:23.102281 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:23.154171 26468 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:13:22.987747  2578 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:23.156756 26358 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 953d8c981a6c459f8b7f3dbbb66fda45 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3262bf0553e543eea76794fc529a9acc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:23.065829  2601 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.104326 26547 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
W20260709 12:13:23.101349 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.106326  2654 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:23.106453 26514 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:23.067752  2556 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:23.108121  2652 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.174672 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:23.110006  2626 raft_consensus.cc:993] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: : Instructing follower 3262bf0553e543eea76794fc529a9acc to start an election
I20260709 12:13:23.112042 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3400) took 1284 ms. Trace:
I20260709 12:13:23.178582 26543 rpcz_store.cc:276] 0709 12:13:21.827959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.830753 (+  2794us) service_pool.cc:224] Handling call
0709 12:13:21.831222 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:22.640651 (+809429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:23.111713 (+471062us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b54000b4d54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:23.111963 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1786450176}
I20260709 12:13:22.955675  2625 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:23.115106  2500 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:23.119637  2434 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:23.236195  2658 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.237709 26473 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 28: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:23.121368  2448 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:23.064890  2630 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 12:13:23.122941  2594 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:23.124413  2263 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:23.125344  2519 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:23.025372  2520 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:23.248184 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:23.248853 27166 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:23.249473  2520 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:23.159884 26548 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 19. Preceding OpId from leader: term: 31 index: 20. (index mismatch)
I20260709 12:13:23.251364 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:23.252023 26548 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:13:23.159871 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:13:23.253466 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 93697.6us
I20260709 12:13:23.165321 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:23.255893 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 90723.1us
I20260709 12:13:23.168061 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:23.108573  2553 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:13:23.174845 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 68487.1us
I20260709 12:13:23.176836 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:23.113857  2518 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:23.182157 27160 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:23.183960 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:23.182876 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:23.188642 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:23.195031 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:23.196082  2516 raft_consensus.cc:1081] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Signalling peer 3262bf0553e543eea76794fc529a9acc to start an election
I20260709 12:13:23.166661  2486 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 22, Last known committed idx: 19, Time since last communication: 0.032s
I20260709 12:13:23.199507  2646 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.167166  2654 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:23.185037  2602 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:23.315222 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:23.184818  2652 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:23.166926  2441 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 12:13:23.205544  2531 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:23.207556  2643 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.174896  2556 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:23.246932  2263 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:23.252876 26622 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:23.258747 27166 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:13:23.255024 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:23.282110 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:23.252878 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:23.175468  2601 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.294492 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:23.315218 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:23.279174  2657 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:23.259238  2553 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:23.353600 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:23.354522 26466 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:23.356468 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:23.331154  2630 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:23.286007  2448 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 12:13:23.249497  2594 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:23.346280  2653 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:23.341964  2658 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:23.292428  2525 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.294525  2520 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.316151  2654 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:23.347671 26541 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:13:23.404299 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.280006  2519 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:23.364207 26467 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 32 index: 21. Preceding OpId from leader: term: 33 index: 22. (index mismatch)
W20260709 12:13:23.340646 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 85706.1us
W20260709 12:13:23.371335 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:23.394361 26469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 3220) took 2206 ms (client timeout 1770 ms). Trace:
W20260709 12:13:23.420202 26469 rpcz_store.cc:269] 0709 12:13:21.156211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.192882 (+ 36671us) service_pool.cc:224] Handling call
0709 12:13:23.361974 (+2169092us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b540006a4d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:23.362109 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1432525696}
I20260709 12:13:23.356015  2553 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:23.316663  2646 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.341957  2531 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.394757  2500 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:23.424078 26587 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.770s (SENT) [suppressed 21 similar messages]
I20260709 12:13:23.398518  2653 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:23.446858 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:23.447574 26467 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:23.359391  2650 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:23.472633 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 192705us
I20260709 12:13:23.480273 27133 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:23.475669 26588 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:23.417762  2658 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:23.487737  2524 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:23.476356 27166 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
 from {username='slave'} at 127.0.0.1:56886
I20260709 12:13:23.476706  2614 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.489249  2614 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.491662 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3581) took 1300 ms. Trace:
I20260709 12:13:23.491587  2614 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:23.492738  2651 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:23.493824  2651 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:23.494275  2512 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.494798  2651 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.19, Last appended by leader: 19, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:23.495385  2512 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:23.405611  2525 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:23.497932 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:23.498575  2525 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:23.492110 26616 rpcz_store.cc:276] 0709 12:13:22.191858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:22.192804 (+   946us) service_pool.cc:224] Handling call
0709 12:13:22.193173 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:22.193805 (+   632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:22.193835 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:23.047766 (+853931us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b2c000c78e8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:13:23.049687 (+  1921us) log.cc:844] Serialized 26 byte log entry
0709 12:13:23.362559 (+312872us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:23.362598 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:23.362678 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:23.491333 (+128655us) raft_consensus.cc:1685] finished
0709 12:13:23.491357 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:23.491596 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":26646272,"thread_start_us":287621,"threads_started":1,"wal-append.queue_time_us":351462}
I20260709 12:13:23.498620 26541 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:23.504490 26467 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:13:23.505044 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:23.505853 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:23.506534 26467 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:23.487918  2518 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:23.509298 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:23.522383 26472 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 27.
I20260709 12:13:23.396113  2630 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.472347  2653 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:23.445027  2523 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:23.407477  2520 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.536202 26547 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 24: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:13:23.535585  2677 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:13:23.541277 26472 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:23.546516 26472 pending_rounds.cc:85] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 10
I20260709 12:13:23.547114 26472 pending_rounds.cc:107] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 21.11
I20260709 12:13:23.547977 26472 raft_consensus.cc:2889] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:23.474871  2500 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.559801 26466 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:23.560876 26467 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:13:23.562463 26467 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 12:13:23.564373 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:23.514910  2658 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:23.565958 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 141917us
I20260709 12:13:23.565984 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:23.565203 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:23.567250 26466 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 19. Preceding OpId from leader: term: 31 index: 20. (index mismatch)
I20260709 12:13:23.568928 27160 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:23.543298  2523 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.572546 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:23.575743 27166 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:23.576257 27166 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:23.576990 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:23.582082 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:23.584707  2263 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:23.584789  2678 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:13:23.587642  2520 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:23.594535  2652 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:23.600399 26465 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:23.602547  2601 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:23.603485  2630 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:23.574725  2668 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 12:13:23.562119  2556 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.605748 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:23.610635 27167 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:23.582696  2670 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 12:13:23.614524 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:23.617698 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:23.577359  2625 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:23.579146  2643 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:23.651927  2556 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:23.652936  2531 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:23.653035  2448 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:23.615803  2441 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:23.615590  2630 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.617527 27166 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:23.582294  2622 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.629634  2373 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:23.632387 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:23.635747  2681 log.cc:927] Time spent T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:13:23.636878 26467 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: [27.16-27.16]
I20260709 12:13:23.583685  2518 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:23.619145  2652 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:23.667194 27167 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
W20260709 12:13:23.664270 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 46680.1us
I20260709 12:13:23.645386  2653 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:23.702481 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3419) took 1511 ms. Trace:
I20260709 12:13:23.648039  2625 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.703047 26545 rpcz_store.cc:276] 0709 12:13:22.191324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:22.216729 (+ 25405us) service_pool.cc:224] Handling call
0709 12:13:22.217066 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:22.730000 (+512934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:22.730052 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:22.736151 (+  6099us) log.cc:844] Serialized 26 byte log entry
0709 12:13:22.872353 (+136202us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:22.872392 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:23.671912 (+799520us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400105ed4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:23.671966 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:23.672014 (+    48us) raft_consensus.cc:1685] finished
0709 12:13:23.672031 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:23.702360 (+ 30329us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":196963,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":7988,"spinlock_wait_cycles":453668096,"thread_start_us":430012,"threads_started":2,"wal-append.queue_time_us":271135}
I20260709 12:13:23.670969  2518 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:23.665839  2373 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:23.711215 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:23.713856 26360 maintenance_manager.cc:419] P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033379
I20260709 12:13:23.664036  2622 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.722447  2622 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:23.702907  2614 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.724054  2614 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.724407  2646 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:23.702675  2612 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:23.727013  2612 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:23.727969 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:23.730340  2524 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:23.732873  2650 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:23.712255  2434 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.022s
I20260709 12:13:23.664175  2630 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.639694  2553 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.711390  2518 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:23.717998  2669 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.359s	user 0.001s	sys 0.000s
W20260709 12:13:23.716084  2663 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.650s	user 0.003s	sys 0.000s
W20260709 12:13:23.758770 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47647.6us
I20260709 12:13:23.763291 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:23.763204  2434 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:23.776427 26471 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:13:23.776326 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:23.747323  2652 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 12:13:23.780563 26470 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:23.775684  2467 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:23.766851  2684 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.018s
I20260709 12:13:23.791093 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:23.778855  2434 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:23.785020  2441 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:23.796846  2686 log.cc:927] Time spent T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 12:13:23.800302  2687 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:13:23.808665 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3416) took 1695 ms. Trace:
I20260709 12:13:23.801162  2317 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:23.799480  2531 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:13:23.808631 26470 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 33. Current term is 34. Ops: [33.22-33.22]
I20260709 12:13:23.817200 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:23.797991  2434 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:23.809434 26540 rpcz_store.cc:276] 0709 12:13:22.113133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:22.113320 (+   187us) service_pool.cc:224] Handling call
0709 12:13:22.113720 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:22.113996 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:13:22.134990 (+ 20994us) log.cc:844] Serialized 14 byte log entry
0709 12:13:22.366825 (+231835us) log.cc:844] Serialized 14 byte log entry
0709 12:13:22.788851 (+422026us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b18004ad880. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:13:23.155857 (+367006us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b4800270258. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507b003aa1 00007f507affab37 00007f507affa9ca 00007f507b0f226f 00007f507b0f1f37 00007f507b10655c 00007f507b106508 00007f507b106488 00007f507b106443 00007f507b1056ec 00007f507a02fa96
0709 12:13:23.784336 (+628479us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b18004ad880. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287 00007f50760f5208
0709 12:13:23.808276 (+ 23940us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:23.808347 (+    71us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:23.808403 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:23.808470 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:23.808599 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8760,"prepare.queue_time_us":34265,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":101,"raft.queue_time_us":392313,"raft.run_cpu_time_us":3504,"raft.run_wall_time_us":630766,"spinlock_wait_cycles":116120960,"thread_start_us":244046,"threads_started":2,"wal-append.queue_time_us":608119,"wal-append.run_cpu_time_us":1551,"wal-append.run_wall_time_us":1007713}
I20260709 12:13:23.819759  2520 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 12:13:23.828094  2519 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:23.826608 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:23.830039  2514 consensus_meta.cc:287] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.701s	user 0.010s	sys 0.002s
I20260709 12:13:23.831943  2531 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:23.833046  2531 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 32.21, Last appended by leader: 21, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:23.835028  2520 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:23.835546  2520 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:23.836421  2520 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:23.837092 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.837921  2520 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:23.816197  2317 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:23.839843 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:23.840972  2317 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:23.838608  2519 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:23.841867 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:23.842466  2519 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.843858  2581 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:23.844414  2581 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:23.841429 26622 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:23.847087  2604 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.847185 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:23.847785  2604 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:23.848467 26622 raft_consensus.cc:2410] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 26 because replica has last-logged OpId of term: 25 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 12.
I20260709 12:13:23.850082  2604 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:23.850849 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:23.865203 26619 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:23.851615 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:23.852347 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:23.820173  2690 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:13:23.853166  2603 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.854574  2578 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:23.855077  2564 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:23.856796  2428 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:23.858851  2565 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:23.860639  2583 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:23.821507 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:23.868538 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:23.870527 26620 raft_consensus.cc:2410] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 27 because replica has last-logged OpId of term: 26 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260709 12:13:23.797755  2467 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:23.878144 27166 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:23.877112  2490 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.019s
I20260709 12:13:23.919000 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:23.901671 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:23.911753 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 69982.2us
I20260709 12:13:23.827595  2563 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:23.928757 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:23.817086  2448 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:23.929628 26540 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:13:23.931186 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:23.917240  2467 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:23.950657 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:23.956951 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:23.928392  2556 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:23.959571 26614 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:23.962858 27159 raft_consensus.cc:2368] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29.
I20260709 12:13:23.877840  2435 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.068s
I20260709 12:13:23.898746  2441 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260709 12:13:23.934405  2625 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:23.897176  2564 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.942987  2653 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:23.896646  2578 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.882287  2603 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:23.981909  2691 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:13:23.940531  2448 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:23.911556  2565 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:24.018723 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:23.922993  2583 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:24.023810 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:24.025758 26616 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 33. Current term is 34. Ops: [33.22-33.22]
I20260709 12:13:23.964038  2428 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 12:13:24.012890  2553 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:24.050544 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 145241us
I20260709 12:13:24.080790 26513 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:24.030725  2595 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:24.082487 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:24.084877 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:24.085505 26468 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:24.087431 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:24.084344 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:24.089854 26473 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:13:23.987835  2647 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.087s
I20260709 12:13:24.095808 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:24.098630 26473 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:24.100286 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:24.094848 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:24.105553 26465 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:24.080677  2604 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.113821 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:24.114857 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:24.109369 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:24.089505  2656 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:24.112203  2654 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.687s	user 0.011s	sys 0.003s
I20260709 12:13:24.108567 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:24.118636 26471 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:24.076845  2525 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:24.088517  2595 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:24.120445 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:24.096014  2644 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:24.147924 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 47742.2us
I20260709 12:13:24.148931 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:24.133025  2692 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:13:24.129927  2595 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:24.131454  2650 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.122211  2604 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:24.162572  2644 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:24.131873  2654 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:24.147193  2428 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:24.234629 26548 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:24.223191  2551 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:24.224936  2701 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:24.234294  2428 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:24.232964  2698 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
W20260709 12:13:24.233783  2697 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:13:24.255195  2578 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:24.256049  2578 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.256645  2578 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:24.218930  2581 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:24.267041  2448 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:24.271114  2603 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:24.273545 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3430) took 1212 ms. Trace:
I20260709 12:13:24.308946 26543 rpcz_store.cc:276] 0709 12:13:23.061312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.854176 (+792864us) service_pool.cc:224] Handling call
0709 12:13:23.862616 (+  8440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:23.883184 (+ 20568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:23.883220 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:23.883720 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 12:13:23.983901 (+100181us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:23.983941 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:23.984021 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:24.273163 (+289142us) raft_consensus.cc:1685] finished
0709 12:13:24.273203 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.273446 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35234,"raft.queue_time_us":34077,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":12131,"thread_start_us":99836,"threads_started":1,"wal-append.queue_time_us":276958}
I20260709 12:13:24.311982 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:24.312842 26543 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:13:24.274472  2583 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:24.276909  2695 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 12:13:24.227100  2647 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:24.261519  2512 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.766s	user 0.009s	sys 0.005s
I20260709 12:13:24.314107 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:24.339627 26543 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:24.341058 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:24.342746 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:24.343854 26543 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 29: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:24.345014 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:24.225062  2518 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:24.211958  2650 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:24.225399  2644 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:24.225975  2307 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:24.345700 26543 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:24.230223 26473 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:13:24.333664  2603 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:24.380227 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3428) took 1319 ms. Trace:
I20260709 12:13:24.336249  2564 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:24.306054 26619 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:13:24.351073  2644 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:24.382774 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 460639us
I20260709 12:13:24.389139 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3426) took 1329 ms. Trace:
I20260709 12:13:24.387446 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3435) took 1293 ms. Trace:
I20260709 12:13:24.351649  2307 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:24.390555 26546 rpcz_store.cc:276] 0709 12:13:23.060689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.833088 (+772399us) service_pool.cc:224] Handling call
0709 12:13:23.833467 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:23.882446 (+ 48979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:23.882482 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:23.913436 (+ 30954us) log.cc:844] Serialized 26 byte log entry
0709 12:13:24.078178 (+164742us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:24.376503 (+298325us) log.cc:844] Serialized 14 byte log entry
0709 12:13:24.379871 (+  3368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.379960 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:24.380002 (+    42us) raft_consensus.cc:1685] finished
0709 12:13:24.380014 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.380159 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101102,"prepare.queue_time_us":184215,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":36744,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":27251,"thread_start_us":382974,"threads_started":2,"wal-append.queue_time_us":232172}
I20260709 12:13:24.412919 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:24.413861 26546 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:24.415052 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:24.402086 26542 rpcz_store.cc:276] 0709 12:13:23.094538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.931080 (+836542us) service_pool.cc:224] Handling call
0709 12:13:23.931423 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:23.961990 (+ 30567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:23.962025 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:23.962667 (+   642us) log.cc:844] Serialized 52 byte log entry
0709 12:13:24.145548 (+182881us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:24.383272 (+237724us) log.cc:844] Serialized 14 byte log entry
0709 12:13:24.386945 (+  3673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.387061 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:24.387122 (+    61us) raft_consensus.cc:1685] finished
0709 12:13:24.387142 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.387355 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24482,"prepare.queue_time_us":116616,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":33589,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":15622,"thread_start_us":282425,"threads_started":2,"wal-append.queue_time_us":295573}
I20260709 12:13:24.429332 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:24.447165 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.447546 26464 raft_consensus.cc:2376] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31. Re-sending same reply.
I20260709 12:13:24.431547 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:24.431985 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:24.427989 26543 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
I20260709 12:13:24.416628 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:24.456457 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:24.457114 26619 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
W20260709 12:13:24.434612 26585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.009s	sys 0.007s
I20260709 12:13:24.417066 26465 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
W20260709 12:13:24.463589 26585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.009s	sys 0.008s
W20260709 12:13:24.435030 26359 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.356s	user 0.003s	sys 0.009s
I20260709 12:13:24.414424  2307 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:24.400283 26541 rpcz_store.cc:276] 0709 12:13:23.060082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.537485 (+477403us) service_pool.cc:224] Handling call
0709 12:13:23.537984 (+   499us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:23.861283 (+323299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:23.861316 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:23.861880 (+   564us) log.cc:844] Serialized 52 byte log entry
0709 12:13:23.937298 (+ 75418us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:24.376287 (+438989us) log.cc:844] Serialized 14 byte log entry
0709 12:13:24.382616 (+  6329us) log.cc:844] Serialized 14 byte log entry
0709 12:13:24.388687 (+  6071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.388796 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:24.388855 (+    59us) raft_consensus.cc:1685] finished
0709 12:13:24.388873 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.389058 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":328178,"prepare.queue_time_us":285250,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":34117,"raft.queue_time_us":329240,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":6000384,"thread_start_us":492792,"threads_started":2,"wal-append.queue_time_us":98522}
I20260709 12:13:24.465974 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:24.466861 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:24.468106 26542 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:24.467434 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:24.456341 26546 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:24.469542 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:24.470657 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:24.471499 26546 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:13:24.472977 27165 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:13:24.473389 27165 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 33 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:24.473503 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:24.474283 26617 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:24.475325 26613 raft_consensus.cc:2410] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
W20260709 12:13:24.471341 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 350972us
I20260709 12:13:24.479462 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:24.481055 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:24.397333  2603 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:24.476732 27165 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 33.22, Last appended by leader: 22, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:24.475888 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:24.483529 27165 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:24.483999 26546 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:24.484982 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:24.485656 26622 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:13:24.484977 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:24.487818 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:24.494637 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3258) took 1072 ms. Trace:
I20260709 12:13:24.494982  2564 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:24.495115 26467 rpcz_store.cc:276] 0709 12:13:23.421857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.563524 (+141667us) service_pool.cc:224] Handling call
0709 12:13:23.636597 (+ 73073us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:23.662674 (+ 26077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.494439 (+831765us) spinlock_profiling.cc:243] Waited 72.7 ms on lock 0x7b54003151d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:24.494574 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167262976}
I20260709 12:13:24.495602  2564 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:24.496156  2563 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.556s	user 0.016s	sys 0.003s
I20260709 12:13:24.496475 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:24.497748  2564 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:24.497692 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:24.506816  2604 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:24.511371  2614 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:24.512548 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 3197) took 1321 ms. Trace:
I20260709 12:13:24.512737 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:24.513011 26547 rpcz_store.cc:276] 0709 12:13:23.191504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.341230 (+149726us) service_pool.cc:224] Handling call
0709 12:13:24.512294 (+1171064us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b540037f5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:24.512460 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373974912}
I20260709 12:13:24.498818 27164 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1294) took 1286 ms. Trace:
W20260709 12:13:24.499812  2710 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:13:24.514811 27164 rpcz_store.cc:276] 0709 12:13:23.212472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.212628 (+   156us) service_pool.cc:224] Handling call
0709 12:13:23.212947 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:23.248630 (+ 35683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:23.248662 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:23.248710 (+    48us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:23.248745 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.498458 (+1249713us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b5400221354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:24.498511 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.498642 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81597824}
W20260709 12:13:24.500592  2705 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 12:13:24.501441  2708 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:13:24.502075 27163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1290) took 1340 ms. Trace:
I20260709 12:13:24.503090  2563 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.540220  2563 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:24.539896 27163 rpcz_store.cc:276] 0709 12:13:23.161350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.161772 (+   422us) service_pool.cc:224] Handling call
0709 12:13:23.162031 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:23.359698 (+197667us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:13:23.360000 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 12:13:23.575508 (+215508us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:23.575565 (+    57us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:23.575620 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.501856 (+926236us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b540013b5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:24.501899 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.502015 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29608,"prepare.queue_time_us":1832,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":30340,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":7119,"spinlock_wait_cycles":454052096,"thread_start_us":184835,"threads_started":1,"wal-append.queue_time_us":246514}
I20260709 12:13:24.503515 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3425) took 1443 ms. Trace:
I20260709 12:13:24.539883 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1346) took 1396 ms. Trace:
I20260709 12:13:24.542622 26548 rpcz_store.cc:276] 0709 12:13:23.059821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.342930 (+283109us) service_pool.cc:224] Handling call
0709 12:13:23.343246 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.235146 (+891900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.503250 (+268104us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b54002373d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:24.503450 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2049488640}
I20260709 12:13:24.455668  2448 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:24.505213 26544 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:24.488200 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:24.516137 26467 raft_consensus.cc:2368] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29.
I20260709 12:13:24.558593 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:24.559294 26467 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:24.560416 26467 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:24.516466 26543 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:24.491420 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:24.518075 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:24.488047  2718 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:24.488327  2581 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:24.500450 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3262) took 1077 ms. Trace:
W20260709 12:13:24.566740 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 86499.1us
I20260709 12:13:24.522719 26468 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:13:24.572535 26468 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:24.535194  2518 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:24.536422  2650 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:24.581034 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:24.581768 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:24.491362 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:24.548154 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3432) took 1466 ms. Trace:
I20260709 12:13:24.583657 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:24.584523 27167 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:24.563141  2373 consensus_meta.cc:287] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.815s	user 0.005s	sys 0.009s
I20260709 12:13:24.553225 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:24.553428 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:24.589888 26547 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:24.549091 26542 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:13:24.506042  2556 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:24.543413 26540 rpcz_store.cc:276] 0709 12:13:23.142980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.943250 (+800270us) service_pool.cc:224] Handling call
0709 12:13:23.943546 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:23.961908 (+ 18362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:23.961953 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:23.965206 (+  3253us) log.cc:844] Serialized 26 byte log entry
0709 12:13:24.214538 (+249332us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:24.214591 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.214961 (+   370us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:24.539613 (+324652us) raft_consensus.cc:1685] finished
0709 12:13:24.539636 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.539809 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17925,"raft.queue_time_us":19754,"spinlock_wait_cycles":8603520,"thread_start_us":192173,"threads_started":1,"wal-append.queue_time_us":351359}
I20260709 12:13:24.563946  2578 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:24.566345 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:24.572615 27165 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 33 index: 22. Preceding OpId from leader: term: 34 index: 22. (term mismatch)
I20260709 12:13:24.622812 27165 pending_rounds.cc:85] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 21
I20260709 12:13:24.623131 27165 pending_rounds.cc:107] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 33.22
I20260709 12:13:24.575409 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:24.568181 26466 rpcz_store.cc:276] 0709 12:13:23.423245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.569690 (+146445us) service_pool.cc:224] Handling call
0709 12:13:23.569932 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:23.604918 (+ 34986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:23.604965 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:23.605016 (+    51us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:23.605063 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.500183 (+895120us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b54000dc0d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:24.500243 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.500389 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32164096}
I20260709 12:13:24.623405 27165 raft_consensus.cc:2889] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:24.586638 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:24.623785 26541 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:24.583108 26539 rpcz_store.cc:276] 0709 12:13:23.081551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.878769 (+797218us) service_pool.cc:224] Handling call
0709 12:13:23.879487 (+   718us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:23.912464 (+ 32977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:23.912513 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:23.913161 (+   648us) log.cc:844] Serialized 26 byte log entry
0709 12:13:24.131225 (+218064us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:24.438884 (+307659us) log.cc:844] Serialized 14 byte log entry
0709 12:13:24.439836 (+   952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.439931 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:24.547830 (+107899us) raft_consensus.cc:1685] finished
0709 12:13:24.547861 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.548061 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32373,"prepare.queue_time_us":131424,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":44360,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":7806,"thread_start_us":463171,"threads_started":2,"wal-append.queue_time_us":370340}
I20260709 12:13:24.622809 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:24.625095 26542 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:24.625275 26539 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:24.552287  2604 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.554306 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:24.628127 26548 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:24.628422 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3202) took 1209 ms. Trace:
I20260709 12:13:24.590173 26546 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:24.628937 26539 rpcz_store.cc:276] 0709 12:13:23.419426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.624844 (+1205418us) service_pool.cc:224] Handling call
0709 12:13:24.625096 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.628142 (+  3046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.628361 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:24.556295 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:24.563642  2602 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.626729 27167 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:24.630892 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3207) took 1147 ms. Trace:
I20260709 12:13:24.631608 26539 rpcz_store.cc:276] 0709 12:13:23.483998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.629840 (+1145842us) service_pool.cc:224] Handling call
0709 12:13:24.630109 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.630291 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:24.630314 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:24.630356 (+    42us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:24.630414 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.630476 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.630819 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:24.634881 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3208) took 1136 ms. Trace:
I20260709 12:13:24.635857 26539 rpcz_store.cc:276] 0709 12:13:23.498184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.633399 (+1135215us) service_pool.cc:224] Handling call
0709 12:13:24.633928 (+   529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.634177 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:24.634215 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:24.634471 (+   256us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:24.634525 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.634608 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.634793 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:24.638691 26542 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:24.639993 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3203) took 1220 ms. Trace:
I20260709 12:13:24.640630 26542 rpcz_store.cc:276] 0709 12:13:23.419624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.625743 (+1206119us) service_pool.cc:224] Handling call
0709 12:13:24.626028 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.639633 (+ 13605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.639916 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:24.675285 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3206) took 1203 ms. Trace:
I20260709 12:13:24.675961 26546 rpcz_store.cc:276] 0709 12:13:23.471952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.629618 (+1157666us) service_pool.cc:224] Handling call
0709 12:13:24.629905 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.674872 (+ 44967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:24.674906 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:24.674955 (+    49us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:24.674998 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.675067 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.675216 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44594}
I20260709 12:13:24.676820 26542 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:24.681049 26542 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:13:24.683580 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1347) took 1540 ms. Trace:
I20260709 12:13:24.684296 26547 rpcz_store.cc:276] 0709 12:13:23.143220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.593740 (+1450520us) service_pool.cc:224] Handling call
0709 12:13:24.682887 (+ 89147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.683153 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:24.683191 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:24.683251 (+    60us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:24.683300 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.683379 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.683521 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:24.563856  2486 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.054s
I20260709 12:13:24.570415  2524 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.059s
I20260709 12:13:24.594094  2490 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:24.591434  2518 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:24.594679  2563 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:24.579633  2317 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.064s
W20260709 12:13:24.673470  2411 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 34 current term: 34 is higher.
I20260709 12:13:24.703636 26514 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:24.576130  2448 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:24.578352  2718 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:24.728391 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 141842us
I20260709 12:13:24.580266  2581 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:24.682363  2578 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.719359 26547 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:24.592723  2373 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:24.726917 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:24.719947  2434 consensus_meta.cc:287] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.839s	user 0.011s	sys 0.004s
I20260709 12:13:24.743257 26619 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
W20260709 12:13:24.733951 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 54383.4us
I20260709 12:13:24.741539 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:24.742146 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 185938us
I20260709 12:13:24.712306  2518 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:24.628397  2556 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:24.673697  2604 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:24.677182  2595 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:24.719987  2524 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:24.732473  2601 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:13:24.762544  2723 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:13:24.762727  2601 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 25 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:24.763651  2601 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:24.764029  2618 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.053s
I20260709 12:13:24.765923  2725 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:24.766378  2725 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:24.766781  2725 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:24.768143 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:24.768631 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:24.769142 26613 raft_consensus.cc:2410] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 25 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 14.
I20260709 12:13:24.770710 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:24.754043  2307 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:24.774024  2604 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:24.756193 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:24.760030 26471 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: [27.14-27.14]
I20260709 12:13:24.761521 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:24.774719 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:24.726929  2683 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:24.734198  2490 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:24.777204 26621 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:24.777173 26622 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:13:24.745815  2518 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:24.780529 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:24.747622  2563 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:24.685967  2602 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:24.747107  2603 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:24.794734  2644 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:24.785145  2563 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:24.796314  2563 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:24.797114  2307 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:24.743117  2578 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:24.799458 26548 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:24.799671  2718 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:24.799916  2578 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:24.800541  2730 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 12:13:24.801268 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:24.802000 26622 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:13:24.748453  2434 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:24.804023  2434 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:24.806285 26514 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:24.779004  2683 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:24.807266  2578 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:24.838315  2563 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:24.841213  2563 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:24.842898 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:24.843816 26622 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:24.779065  2524 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:24.836385  2578 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:24.869211 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3201) took 1450 ms. Trace:
I20260709 12:13:24.870469  2578 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:24.871466  2716 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 12:13:24.872555  2724 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:13:24.872699  2524 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:24.876947 26465 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:13:24.879142  2448 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:24.880370 26469 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 32 index: 21. Preceding OpId from leader: term: 34 index: 22. (index mismatch)
W20260709 12:13:24.880887  2656 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.005s
I20260709 12:13:24.833024  2603 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 12:13:24.880754  2578 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:24.881618  2523 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:24.882915  2647 consensus_meta.cc:287] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.003s
I20260709 12:13:24.887809 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:24.887960  2647 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:24.888528 26616 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:13:24.891785 26622 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:13:24.896795 26359 maintenance_manager.cc:643] P 8f3fd02e9cbb4cbb90df37bb5fd109c3: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 1.177s	user 0.040s	sys 0.010s Metrics: {"bytes_written":4844,"delete_count":0,"lbm_write_time_us":1074,"lbm_writes_lt_1ms":5,"reinsert_count":0,"thread_start_us":285689,"threads_started":1,"update_count":186,"wal-append.queue_time_us":294960}
I20260709 12:13:24.898870  2578 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:24.900138 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:24.900857 26622 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:24.884572 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 140035us
I20260709 12:13:24.886953  2565 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:24.920542 26360 maintenance_manager.cc:419] P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.211713
I20260709 12:13:24.887140  2656 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:24.928015 26622 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:24.933619  2373 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:24.937729 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3209) took 1439 ms. Trace:
I20260709 12:13:24.938361 26539 rpcz_store.cc:276] 0709 12:13:23.498571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.637391 (+1138820us) service_pool.cc:224] Handling call
0709 12:13:24.638097 (+   706us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:24.674541 (+ 36444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:24.674575 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:24.687368 (+ 12793us) log.cc:844] Serialized 26 byte log entry
0709 12:13:24.778238 (+ 90870us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:13:24.778274 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.778353 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:24.937409 (+159056us) raft_consensus.cc:1685] finished
0709 12:13:24.937439 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.937637 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":43241,"threads_started":1,"wal-append.queue_time_us":155935}
W20260709 12:13:24.942090  2467 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.973s	user 0.008s	sys 0.004s
I20260709 12:13:24.943089  2581 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:24.945034 26362 catalog_manager.cc:5697] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 14 to 20, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 20 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:24.949043  2428 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:24.903048  2683 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:24.885488  2490 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:25.000312  2518 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:25.024128 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:25.034380 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:25.035133 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:25.004734  2725 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:24.957842  2467 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:25.011296  2500 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:25.012249  2630 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:25.026645 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:25.026682 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:25.044123 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:25.046274  2441 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.046808  2518 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:25.046907  2441 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:25.048223 26468 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 31. Current term is 32. Ops: [31.20-31.20]
I20260709 12:13:25.040959  2656 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:25.049576  2656 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.050110  2656 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:25.051174  2467 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:25.051833  2653 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:25.052399  2653 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:25.054616  2581 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:25.055327  2581 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:25.055903  2706 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:25.056463  2448 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:25.056740  2706 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:25.057026  2448 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:25.044153 27167 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:25.059149  2448 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:25.060448 26588 leader_election.cc:400] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29.
I20260709 12:13:25.060776 26588 leader_election.cc:403] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Cancelling election due to peer responding with higher term
I20260709 12:13:25.061074  2441 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:25.062263  2441 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:25.063331  2556 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:25.063459  2435 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
I20260709 12:13:25.055719 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:25.066532 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:25.067940  2434 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:25.068372  2434 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:25.068660  2595 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:25.070011 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.071483 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:25.068748  2434 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:25.028446 26614 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:13:25.077123 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:24.962553  2428 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.036820 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:25.055819  2581 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:25.068918  2718 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:25.028718 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:25.087320 26614 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: [25.14-25.14]
I20260709 12:13:25.093899 26614 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 26. Current term is 27. Ops: [26.18-26.18]
I20260709 12:13:25.029533 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3198) took 1837 ms. Trace:
I20260709 12:13:25.090996 26617 raft_consensus.cc:2410] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
W20260709 12:13:25.095759 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 59075.5us
I20260709 12:13:25.094645 26540 rpcz_store.cc:276] 0709 12:13:23.191805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.594892 (+1403087us) service_pool.cc:224] Handling call
0709 12:13:24.595300 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.772919 (+177619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:24.772952 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:24.772996 (+    44us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:24.773028 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.014063 (+241035us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400398ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:25.014157 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:25.029400 (+ 15243us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":381,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":407703936}
I20260709 12:13:25.096586 26514 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:25.097975 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1358) took 1133 ms. Trace:
I20260709 12:13:25.100229 26540 rpcz_store.cc:276] 0709 12:13:23.964784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.096823 (+1132039us) service_pool.cc:224] Handling call
0709 12:13:25.097259 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:25.097511 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:25.097553 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:25.097623 (+    70us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:25.097672 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.097754 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:25.097899 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:25.105485 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:25.106375 26615 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:25.106786 26615 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:25.107795 26615 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:25.109627 26615 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:25.083114  2651 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
W20260709 12:13:25.111035  2739 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 12:13:25.111195  2651 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:25.111881  2651 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:25.112385  2656 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:25.103600  2720 consensus_queue.cc:1059] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 12:13:25.116200  2720 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:25.116719  2720 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:25.119349 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:25.117945  2720 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:25.104177 26617 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:25.122822  2736 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:25.124514 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:25.078193 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:25.126504 26621 raft_consensus.cc:2393] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 22: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:25.129480 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:25.074141  2602 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:25.134912 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1360) took 1117 ms. Trace:
I20260709 12:13:25.145417 26540 rpcz_store.cc:276] 0709 12:13:24.017727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.132395 (+1114668us) service_pool.cc:224] Handling call
0709 12:13:25.132988 (+   593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:25.133784 (+   796us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:25.133828 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:25.134052 (+   224us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:25.134615 (+   563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.134707 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:25.134837 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:25.156097 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 77981.5us
I20260709 12:13:25.157302 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:25.127070  2694 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:25.174729 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:25.172206 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:25.126654  2583 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:25.196764 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:25.126859  2653 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:25.132531  2722 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:25.204219  2626 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 28.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:25.204702 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:25.131681  2618 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:25.141402  2565 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:25.132899  2729 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:25.086342  2428 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:25.171164  2718 raft_consensus.cc:2764] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election decision vote started in defunct term 26: won
I20260709 12:13:25.208320 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:25.240031 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:25.224097  2694 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:25.258157  2694 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:25.272431 26362 catalog_manager.cc:5697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 17 to 24, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 24 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:25.274646  2514 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:25.279259  2646 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:25.279767  2646 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:25.280122 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:25.280668  2646 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:25.281797  2646 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:25.228184  2583 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:25.283267  2583 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:25.284096  2602 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:25.287282  2706 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:25.287931 26617 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:13:25.202967  2720 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:25.201876  2500 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.228093 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:25.170652  2317 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:25.209148  2516 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:25.291275 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:25.229790 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:25.304354 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:25.305508 27162 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 28: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:25.301962  2728 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:25.234912  2729 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:25.235373  2722 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 29 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:25.321715 26615 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
W20260709 12:13:25.341028 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 611155us
I20260709 12:13:25.348426 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:25.304572  2516 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.231113  2618 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:25.357259 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:25.234099  2565 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:25.361858  2565 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:25.302354  2556 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:13:25.354637 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:25.315448  2524 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:25.340902  2729 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:25.376490 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:25.357923  2516 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:25.379105 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:25.307811  2317 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:25.354127  2630 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:25.304919  2500 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:25.392846 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.395854 26438 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:25.380306  2524 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:25.400454  2317 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:25.401336  2524 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:25.391317  2630 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.403596 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:25.404023  2630 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:25.406888  2750 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:25.377095  2565 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:25.408038  2565 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:25.407449  2750 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:25.412880  2654 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:25.375502  2602 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:25.381618  2614 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:25.380239  2701 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:25.403615  2500 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:25.427749 26615 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:25.411971  2618 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:25.421790  2647 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:25.430589  2317 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 12:13:25.445199  2746 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:25.434419  2750 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:25.435670  2658 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:25.313181  2728 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:25.393980  2722 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 27.21, Last appended by leader: 21, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:25.464505  2630 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:25.449976 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:25.440971  2701 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:25.442294  2614 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:25.479712  2317 consensus_queue.cc:1243] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 26.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
W20260709 12:13:25.497071  2735 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.655s	user 0.004s	sys 0.000s
W20260709 12:13:25.496490 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 259170us
I20260709 12:13:25.500204 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:25.441227  2602 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:25.456300  2654 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:13:25.504726 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.474713  2751 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:25.506592 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:25.516583 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:25.517414 26615 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:25.519570 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 134610us
I20260709 12:13:25.520709 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3450) took 1442 ms. Trace:
I20260709 12:13:25.521339 26543 rpcz_store.cc:276] 0709 12:13:24.078203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.468059 (+389856us) service_pool.cc:224] Handling call
0709 12:13:25.520417 (+1052358us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b54003377d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:25.520618 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105221376}
I20260709 12:13:25.521806 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:25.522914  2556 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:25.523468 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:25.523890 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:25.493142  2746 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:25.512591 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:25.495255  2701 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:25.452164  2581 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:25.498188  2614 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:25.526320 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:25.506944 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:25.533752 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:25.528789 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:25.457223  2647 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:25.531301 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 111121us
I20260709 12:13:25.542187 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:25.555027 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:25.574874 26543 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
I20260709 12:13:25.577433 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:25.578255 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44617.3us
W20260709 12:13:25.580765 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52053.3us
I20260709 12:13:25.580613 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:25.583976 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:25.586449 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:25.523372  2556 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:25.597893 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:25.598558 26438 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:25.508905  2612 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:25.509622  2317 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.514304  2500 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:25.497896  2729 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:25.604689 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:25.618528 26466 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:25.619545 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:25.605486 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:25.606151 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:25.587123  2448 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:25.514863  2751 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.527037  2428 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:25.650641  2751 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:25.650882  2428 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:25.613138 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.616261 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:25.653326 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:25.654778 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:25.654492  2516 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:25.579957  2583 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:25.625751 26464 raft_consensus.cc:2368] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:13:25.656809  2658 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:25.587967  2727 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:25.624760  2500 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:25.623958  2317 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:25.550801  2706 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
I20260709 12:13:25.523687  2654 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:25.634435  2448 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:13:25.658329  2743 log.cc:927] Time spent T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:13:25.602123  2556 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:25.638211 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:25.639207  2630 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:25.640926  2602 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:25.642047  2565 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:25.642763 26617 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:25.645162 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1356) took 1712 ms. Trace:
I20260709 12:13:25.646904  2746 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:25.650020 26615 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:25.656024 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:25.794066 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:25.589176  2748 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:25.553085  2646 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 12:13:25.662231 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:25.717139  2448 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:25.593863 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:25.803124 26543 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:25.678184 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:25.716780 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:25.717774 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:25.634896 27161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 1106) took 2089 ms. Trace:
W20260709 12:13:25.720082 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:25.718513 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 139468us
I20260709 12:13:25.813185 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:25.716893 26473 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 27: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:25.812582 27161 rpcz_store.cc:276] 0709 12:13:23.557434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.557570 (+   136us) service_pool.cc:224] Handling call
0709 12:13:23.564743 (+  7173us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:23.569041 (+  4298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:23.569086 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:24.771389 (+1202303us) spinlock_profiling.cc:243] Waited 986 us on lock 0x7b2c00135838. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:13:24.771938 (+   549us) log.cc:844] Serialized 52 byte log entry
0709 12:13:24.843118 (+ 71180us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:24.843161 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.843233 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:25.496437 (+653204us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:25.634502 (+138065us) raft_consensus.cc:1685] finished
0709 12:13:25.634535 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:25.634801 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8765,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":8184,"spinlock_wait_cycles":51902080,"thread_start_us":70766,"threads_started":1,"wal-append.queue_time_us":70118}
I20260709 12:13:25.781522 26469 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:25.717496  2612 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:25.690285  2658 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:25.787571 26547 rpcz_store.cc:276] 0709 12:13:23.932991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.767510 (+834519us) service_pool.cc:224] Handling call
0709 12:13:24.767839 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.780034 (+ 12195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:24.780066 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:24.780108 (+    42us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:24.780145 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.644801 (+864656us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b54000b5254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:25.644877 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:25.645075 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27564928}
I20260709 12:13:25.795279 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:25.799935 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:25.802285 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 203952us
I20260709 12:13:25.836534 26621 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 27: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:25.813582 26514 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:25.793864  2651 consensus_meta.cc:287] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.681s	user 0.013s	sys 0.003s
W20260709 12:13:25.783073  2752 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:13:25.840240 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:25.846103 26466 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:13:25.734375 26465 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:25.848799 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:25.849866 26615 raft_consensus.cc:2410] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 12:13:25.853382 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:25.856055 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:25.857100 26615 raft_consensus.cc:2393] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 21: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:25.857157 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:25.729079  2753 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:25.868388 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:25.869155 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:25.869781 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:25.872905 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:25.874135 26466 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:13:25.875638 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:25.878029 26466 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:13:25.860224 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:25.876986 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 293090us
I20260709 12:13:25.886551 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:25.888754 26513 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:25.802850  2630 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.780726  2718 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.071s
I20260709 12:13:25.841277  2612 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:25.889988 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:25.896986 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.897585 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:25.905495 26547 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:13:25.897761 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:25.849797  2565 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:25.902534  2694 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:25.892958 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:25.902065 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:25.902814  2630 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:25.917166 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:25.930503 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 117411us
I20260709 12:13:25.931738 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:25.900454 26543 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:25.901388  2583 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:25.900911  2762 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:25.954581 26587 leader_election.cc:400] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29.
I20260709 12:13:25.943440 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:25.945647 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4315) took 1487 ms. Trace:
I20260709 12:13:25.899521  2761 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.909152  2612 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:25.904482  2753 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:25.953819 26621 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 27: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:25.933674  2718 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:25.956368 26620 rpcz_store.cc:276] 0709 12:13:24.458457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.460260 (+  1803us) service_pool.cc:224] Handling call
0709 12:13:24.460739 (+   479us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:25.021299 (+560560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:25.021334 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:25.022143 (+   809us) log.cc:844] Serialized 52 byte log entry
0709 12:13:25.177172 (+155029us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:25.177233 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.177353 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:25.945315 (+767962us) raft_consensus.cc:1685] finished
0709 12:13:25.945347 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:25.945561 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":559990,"raft.queue_time_us":565783,"spinlock_wait_cycles":4967808,"thread_start_us":154452,"threads_started":1,"wal-append.queue_time_us":392452}
I20260709 12:13:25.927250  2706 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.820567  2748 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:25.936131  2565 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:25.858578  2651 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:25.948596  2441 consensus_meta.cc:287] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.886s	user 0.008s	sys 0.009s
I20260709 12:13:25.954952  2602 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:25.959270  2728 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:25.994252  2718 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:26.004773  2441 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election lost for term 28. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29.
I20260709 12:13:26.037305  2500 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:26.039258  2647 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:26.040498  2755 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 12:13:26.017591  2767 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:26.044198  2767 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:26.048290  2651 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:25.994410  2761 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:26.057452  2761 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:26.070683  2565 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:26.074481  2630 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:25.929656  2727 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:26.075145  2516 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:26.002115  2706 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:26.011044  2602 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:25.956343  2658 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.16, Last appended by leader: 16, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:26.095638  2602 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:26.105921  2727 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:26.106350  2720 consensus_meta.cc:287] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.802s	user 0.008s	sys 0.002s
I20260709 12:13:26.108893  2706 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:26.031596  2581 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:26.035243  2729 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:26.058892  2718 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:26.140686  2718 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:26.120066  2654 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:26.159956  2751 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.509s	user 0.015s	sys 0.000s
I20260709 12:13:26.160547  2751 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:26.162995  2751 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:26.167815  2767 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:26.187765  2614 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.001s
I20260709 12:13:26.188410  2614 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:26.190181  2556 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:26.182129  2750 consensus_meta.cc:287] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.689s	user 0.009s	sys 0.009s
W20260709 12:13:26.197731  2701 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.607s	user 0.009s	sys 0.000s
I20260709 12:13:26.220021  2701 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:26.223026  2701 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:26.400928  2647 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:26.202852  2750 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:26.402370  2647 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:26.403298  2653 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:26.403978  2653 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:26.405884  2750 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:26.291905 26467 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:26.293169 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:26.448300  2644 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:26.459491 26466 raft_consensus.cc:2410] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 26 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
W20260709 12:13:25.941440 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 48590.6us
W20260709 12:13:26.303694 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:26.467506  2763 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.601s	user 0.009s	sys 0.002s
I20260709 12:13:26.467959  2601 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:26.304144 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.469002  2601 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:26.469630  2428 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:26.305763 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3436) took 2235 ms. Trace:
I20260709 12:13:26.470599  2428 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:26.472175  2601 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:26.470646 26540 rpcz_store.cc:276] 0709 12:13:24.070600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.147575 (+1076975us) service_pool.cc:224] Handling call
0709 12:13:25.148058 (+   483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:25.148385 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:25.148426 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:25.149224 (+   798us) log.cc:844] Serialized 26 byte log entry
0709 12:13:25.505739 (+356515us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:25.505776 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.505846 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:26.304871 (+799025us) raft_consensus.cc:1685] finished
0709 12:13:26.304935 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:26.305462 (+   527us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":343482,"threads_started":1,"wal-append.queue_time_us":494568}
I20260709 12:13:26.473548  2428 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:26.314380 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:26.474828 26543 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:25.990696 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:26.478156  2766 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:26.480719 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 489951us
I20260709 12:13:26.481925 26467 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 12:13:26.000082 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:26.482964  2706 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:26.484867 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:26.473871 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:26.340575 26614 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:26.487751 26513 leader_election.cc:400] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:13:26.488289 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3599) took 1329 ms. Trace:
I20260709 12:13:26.488813 26614 rpcz_store.cc:276] 0709 12:13:25.159038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.159689 (+   651us) service_pool.cc:224] Handling call
0709 12:13:25.160100 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:26.487010 (+1326910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.487899 (+   889us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400346554. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:26.488199 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2712846720}
W20260709 12:13:26.341354 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.346410 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4333) took 1028 ms. Trace:
I20260709 12:13:26.494675 26617 rpcz_store.cc:276] 0709 12:13:25.317419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.317605 (+   186us) service_pool.cc:224] Handling call
0709 12:13:25.642514 (+324909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:25.794250 (+151736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.345804 (+551554us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b5400379e50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:26.346129 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746163456}
I20260709 12:13:26.355697 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:26.228869  2614 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:26.192955  2556 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:26.496769 26547 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:26.498131  2741 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:26.498713  2741 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:26.500209 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:26.383209  2581 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:26.202364  2602 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:26.216087  2612 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:26.391104 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:26.391640  2317 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:26.392921  2434 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.320s	user 0.013s	sys 0.009s
I20260709 12:13:26.405933  2653 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 28.14, Last appended by leader: 14, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:26.409173  2654 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:26.410893 26468 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:26.411368 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3267) took 2006 ms. Trace:
I20260709 12:13:26.428210  2656 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:26.434979  2647 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:26.283488 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:25.478711 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:26.438310  2683 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:26.522771 26470 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:26.438664 26362 catalog_manager.cc:5697] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 20 to 26, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 26 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:26.442998  2725 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:26.447971 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3205) took 3004 ms. Trace:
W20260709 12:13:26.458066 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.995751 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:26.488291 26513 leader_election.cc:403] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:26.513849 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:26.527113 26548 rpcz_store.cc:276] 0709 12:13:23.443557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.628788 (+1185231us) service_pool.cc:224] Handling call
0709 12:13:24.629098 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.800035 (+170937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.447307 (+1647272us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54003985d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:26.447721 (+   414us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391269760}
I20260709 12:13:26.519891 26471 rpcz_store.cc:276] 0709 12:13:24.404492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.404638 (+   146us) service_pool.cc:224] Handling call
0709 12:13:24.431661 (+ 27023us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:24.776974 (+345313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.410487 (+1633513us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54001a9354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:26.411078 (+   591us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754618240}
I20260709 12:13:26.479482  2766 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:26.529261  2448 consensus_meta.cc:287] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.667s	user 0.016s	sys 0.002s
I20260709 12:13:26.534015 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:26.523473 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3459) took 1090 ms. Trace:
I20260709 12:13:26.537150  2581 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:26.540820 26540 rpcz_store.cc:276] 0709 12:13:25.429577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.473291 (+1043714us) service_pool.cc:224] Handling call
0709 12:13:26.519690 (+ 46399us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:26.544690 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 57441.9us
I20260709 12:13:26.546280 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:26.546823  2581 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:26.547699  2581 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:26.547936 26472 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 27: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:26.532233  2434 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:26.548734 26613 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:13:26.550055 26618 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:26.555459  2612 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:26.556257  2602 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:26.556640 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1484) took 1470 ms. Trace:
I20260709 12:13:26.556491  2654 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:26.557832 26547 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:13:26.557133 26618 rpcz_store.cc:276] 0709 12:13:25.086374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.086561 (+   187us) service_pool.cc:224] Handling call
0709 12:13:25.086949 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:26.555550 (+1468601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.556317 (+   767us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540037b254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:26.556575 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3363828992}
W20260709 12:13:26.558629 26619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 4318) took 2093 ms (client timeout 1691 ms). Trace:
W20260709 12:13:26.559305 26619 rpcz_store.cc:269] 0709 12:13:24.465208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.465659 (+   451us) service_pool.cc:224] Handling call
0709 12:13:26.558146 (+2092487us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b540003c854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:26.558368 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585911168}
I20260709 12:13:26.560488 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 3227) took 1035 ms. Trace:
I20260709 12:13:26.561049 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:26.560997 26547 rpcz_store.cc:276] 0709 12:13:25.524762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.497919 (+973157us) service_pool.cc:224] Handling call
0709 12:13:26.560090 (+ 62171us) spinlock_profiling.cc:243] Waited 44.1 ms on lock 0x7b54001117d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:26.560409 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101399424}
I20260709 12:13:26.551884  2434 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:26.563489 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:26.565303 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:26.567183 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3595) took 1491 ms. Trace:
I20260709 12:13:26.567627 26616 rpcz_store.cc:276] 0709 12:13:25.075887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.077061 (+  1174us) service_pool.cc:224] Handling call
0709 12:13:26.565002 (+1487941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:26.565467 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.565499 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:26.565566 (+    67us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:26.565603 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.565681 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:26.566827 (+  1146us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b540003c850. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:26.566979 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3420980096}
I20260709 12:13:26.572046  2760 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:26.573689 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1350) took 2715 ms. Trace:
I20260709 12:13:26.574345 26546 rpcz_store.cc:276] 0709 12:13:23.858149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.677176 (+819027us) service_pool.cc:224] Handling call
0709 12:13:24.677476 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.752417 (+ 74941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:24.752449 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:24.752496 (+    47us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:24.752536 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.573054 (+1820518us) spinlock_profiling.cc:243] Waited 74.7 ms on lock 0x7b54003976d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:26.573172 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:26.573505 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171790592}
I20260709 12:13:26.576980  2766 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:26.577272  2516 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
I20260709 12:13:26.578025 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:26.577169 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:26.550598 26464 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 22: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:26.551254 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:26.551826  2647 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 27
I20260709 12:13:26.500387  2741 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:26.553349 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:26.553793 27161 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:26.544018  2448 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:26.552759  2490 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:26.593621  2490 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:26.595325 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:26.596307 26548 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:26.598640  2490 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:26.600095  2745 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.713s	user 0.007s	sys 0.016s
I20260709 12:13:26.581987 26619 raft_consensus.cc:2410] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 12:13:26.589998 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 3608) took 1107 ms. Trace:
I20260709 12:13:26.600855 26620 rpcz_store.cc:276] 0709 12:13:25.482826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.995404 (+512578us) service_pool.cc:224] Handling call
0709 12:13:26.589745 (+594341us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:26.601684 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 3293) took 1074 ms. Trace:
I20260709 12:13:26.604617  2741 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:26.605072 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:26.606868 26621 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:26.607086 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3593) took 1540 ms. Trace:
I20260709 12:13:26.607966 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:26.609663 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:26.610688 26467 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:26.589918 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:26.612823 26621 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 16.
I20260709 12:13:26.592304  2448 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:26.612100 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1495) took 1201 ms. Trace:
I20260709 12:13:26.602180 26465 rpcz_store.cc:276] 0709 12:13:25.527128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.527291 (+   163us) service_pool.cc:224] Handling call
0709 12:13:26.601248 (+1073957us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54000a4e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:26.601440 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347396864}
I20260709 12:13:26.617074 26543 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
I20260709 12:13:26.612879 27164 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:13:26.618745 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 1363) took 1336 ms. Trace:
I20260709 12:13:26.616705 26620 rpcz_store.cc:276] 0709 12:13:25.411094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.601998 (+1190904us) service_pool.cc:224] Handling call
0709 12:13:26.602560 (+   562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:26.602979 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.603013 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:26.603097 (+    84us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:26.603128 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.611838 (+  8710us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:26.611982 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:26.619554 26614 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:13:26.622733 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 4335) took 1260 ms. Trace:
I20260709 12:13:26.623239 26614 rpcz_store.cc:276] 0709 12:13:25.362720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.550804 (+1188084us) service_pool.cc:224] Handling call
0709 12:13:26.622656 (+ 71852us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:26.558373  2767 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 28.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.088s
I20260709 12:13:26.628602 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:26.623137  2766 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:26.620425 26543 rpcz_store.cc:276] 0709 12:13:25.285184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.313610 (+1028426us) service_pool.cc:224] Handling call
0709 12:13:26.618669 (+305059us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:26.650547 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:26.681583 26439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.006s	sys 0.021s
W20260709 12:13:26.693018 26439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.006s	sys 0.022s
I20260709 12:13:26.607568 26622 rpcz_store.cc:276] 0709 12:13:25.066147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.067642 (+  1495us) service_pool.cc:224] Handling call
0709 12:13:25.068045 (+   403us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:25.068455 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:25.068488 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:25.069142 (+   654us) log.cc:844] Serialized 52 byte log entry
0709 12:13:25.552222 (+483080us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:25.552267 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.552350 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:26.580954 (+1028604us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:26.606477 (+ 25523us) raft_consensus.cc:1685] finished
0709 12:13:26.606513 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:26.606891 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1966,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":122,"spinlock_wait_cycles":6892416,"thread_start_us":482651,"threads_started":1,"wal-append.queue_time_us":714646}
I20260709 12:13:26.694420 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:26.688949  2760 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:26.671325  2766 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:26.713248 26621 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 17.
W20260709 12:13:26.722431  2626 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.008s	sys 0.035s
W20260709 12:13:26.723044  2626 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.008s	sys 0.035s
I20260709 12:13:26.724546  2626 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:26.725483  2626 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:26.726608 26438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.000s	sys 0.046s
W20260709 12:13:26.727128 26438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.000s	sys 0.046s
I20260709 12:13:26.648084  2490 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.064s
I20260709 12:13:26.730585  2748 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:26.731635  2490 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:26.732295  2490 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:26.733537  2428 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.733788  2654 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:26.732367 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.734484  2428 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:26.733114  2760 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:26.738325 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:26.738876 26622 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 15. (term mismatch)
I20260709 12:13:26.739398 26622 pending_rounds.cc:85] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 14
I20260709 12:13:26.739727 26622 pending_rounds.cc:107] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 23.15
I20260709 12:13:26.740052 26622 raft_consensus.cc:2889] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:26.712643 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 818767us
I20260709 12:13:26.740994 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3609) took 1242 ms. Trace:
I20260709 12:13:26.741431 26622 rpcz_store.cc:276] 0709 12:13:25.498337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.707040 (+1208703us) service_pool.cc:224] Handling call
0709 12:13:26.734142 (+ 27102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:26.740652 (+  6510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.740903 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:26.739424 27164 raft_consensus.cc:2393] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 22: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:26.744653 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:26.745888  2612 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:26.747730 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1496) took 1336 ms. Trace:
I20260709 12:13:26.748415 26620 rpcz_store.cc:276] 0709 12:13:25.411367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.650456 (+1239089us) service_pool.cc:224] Handling call
0709 12:13:26.700008 (+ 49552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:26.747112 (+ 47104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.747155 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:26.747272 (+   117us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:26.747323 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.747405 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:26.747595 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:26.749996 26621 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:26.751106 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3616) took 1111 ms. Trace:
I20260709 12:13:26.751587 26621 rpcz_store.cc:276] 0709 12:13:25.639219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.749119 (+1109900us) service_pool.cc:224] Handling call
0709 12:13:26.749658 (+   539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:26.750655 (+   997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.750987 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:26.744727 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:26.706589  2448 consensus_queue.cc:1059] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.055s
I20260709 12:13:26.755981  2490 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:26.757718  2490 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:26.760666  2760 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:26.762921 26362 catalog_manager.cc:5697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:26.764055 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:26.827507 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3460) took 1397 ms. Trace:
I20260709 12:13:26.827733  2601 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.827981 26542 rpcz_store.cc:276] 0709 12:13:25.429896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.763441 (+1333545us) service_pool.cc:224] Handling call
0709 12:13:26.827397 (+ 63956us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:26.828974 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1498) took 1278 ms. Trace:
I20260709 12:13:26.828847  2601 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:26.829381 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:26.743952 26439 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:26.771039 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3286) took 1266 ms. Trace:
W20260709 12:13:26.771977 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 189920us
I20260709 12:13:24.871165 26541 rpcz_store.cc:276] 0709 12:13:23.419207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.624490 (+1205283us) service_pool.cc:224] Handling call
0709 12:13:24.624825 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.625042 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:13:24.684552 (+ 59510us) log.cc:844] Serialized 14 byte log entry
0709 12:13:24.868845 (+184293us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:24.868905 (+    60us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:24.868960 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.869031 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.869146 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131,"prepare.queue_time_us":61654,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":1045,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":12894,"thread_start_us":183878,"threads_started":1}
W20260709 12:13:26.776531 26613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 3604) took 1382 ms (client timeout 1716 ms). Trace:
W20260709 12:13:26.777222 26544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3411) took 4803 ms (client timeout 2220 ms). Trace:
I20260709 12:13:26.756446  2448 raft_consensus.cc:3055] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:26.780997 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1244) took 1047 ms. Trace:
I20260709 12:13:26.830360 26542 raft_consensus.cc:2376] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27. Re-sending same reply.
W20260709 12:13:26.831548 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 87879.8us
I20260709 12:13:26.831841 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4341) took 1017 ms. Trace:
I20260709 12:13:26.833918 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:26.784847 26548 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:13:26.789458 26470 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 28.
I20260709 12:13:26.791675 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1357) took 2850 ms. Trace:
I20260709 12:13:26.829460 26622 rpcz_store.cc:276] 0709 12:13:25.550520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.742331 (+1191811us) service_pool.cc:224] Handling call
0709 12:13:26.827824 (+ 85493us) spinlock_profiling.cc:243] Waited 41.7 ms on lock 0x7b5800049298. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:13:26.828071 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:26.828370 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.828408 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:26.828462 (+    54us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:26.828632 (+   170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.828728 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:26.828902 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95903104}
I20260709 12:13:26.845557 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 1246) took 1050 ms. Trace:
I20260709 12:13:26.793037 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:26.801463  2771 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.795753 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:26.797544 26618 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
W20260709 12:13:26.834089 26613 rpcz_store.cc:269] 0709 12:13:25.394556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.499912 (+105356us) service_pool.cc:224] Handling call
0709 12:13:26.776281 (+1276369us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b54003d7a54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:26.776461 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1966163840}
I20260709 12:13:26.810585  2524 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.837369 27163 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 18. (term mismatch)
I20260709 12:13:26.839612 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 4420) took 1251 ms. Trace:
I20260709 12:13:26.841990  2647 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:13:26.831707 26468 rpcz_store.cc:276] 0709 12:13:25.504923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.505112 (+   189us) service_pool.cc:224] Handling call
0709 12:13:25.531835 (+ 26723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:26.529459 (+997624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.770572 (+241113us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b540027abd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:26.770950 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2019724032}
I20260709 12:13:26.843259 26621 rpcz_store.cc:276] 0709 12:13:25.814594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.752665 (+938071us) service_pool.cc:224] Handling call
0709 12:13:26.830430 (+ 77765us) spinlock_profiling.cc:243] Waited 41.2 ms on lock 0x7b5800049298. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:13:26.830850 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:26.831429 (+   579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.831464 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:26.831515 (+    51us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:26.831560 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.831625 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:26.831770 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94813952}
I20260709 12:13:26.851704 27163 pending_rounds.cc:85] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 17
I20260709 12:13:26.846134 26470 rpcz_store.cc:276] 0709 12:13:25.795734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.390275 (+594541us) service_pool.cc:224] Handling call
0709 12:13:26.845481 (+455206us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:26.839217 26544 rpcz_store.cc:269] 0709 12:13:21.973904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.980451 (+  6547us) service_pool.cc:224] Handling call
0709 12:13:26.776795 (+4796344us) spinlock_profiling.cc:243] Waited 2.44 s on lock 0x7b54002364d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:26.776969 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5613880064}
I20260709 12:13:26.832880 26513 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:26.858347 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 3224) took 1328 ms. Trace:
I20260709 12:13:26.839617 26473 rpcz_store.cc:276] 0709 12:13:25.733383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.564258 (+830875us) service_pool.cc:224] Handling call
0709 12:13:26.603108 (+ 38850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:26.603415 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.603438 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:26.603478 (+    40us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:26.603532 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.603584 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:26.780531 (+176947us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b54000a4e50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:26.780746 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88115072}
I20260709 12:13:26.861894 26548 rpcz_store.cc:276] 0709 12:13:25.517553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.594670 (+1077117us) service_pool.cc:224] Handling call
0709 12:13:26.845374 (+250704us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:26.863015 27163 pending_rounds.cc:107] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 26.18
I20260709 12:13:26.845504 26539 rpcz_store.cc:276] 0709 12:13:23.941026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.940257 (+999231us) service_pool.cc:224] Handling call
0709 12:13:25.524676 (+584419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:25.524962 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:25.525003 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:25.525066 (+    63us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:25.525124 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.525204 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:26.791284 (+1266080us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54003377d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:26.791488 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342970624}
W20260709 12:13:26.861440 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 283540us
I20260709 12:13:26.852313 26472 rpcz_store.cc:276] 0709 12:13:25.587990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.655741 (+ 67751us) service_pool.cc:224] Handling call
0709 12:13:26.839197 (+1183456us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b54000db6d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:26.839493 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1704966528}
I20260709 12:13:26.863626 27163 raft_consensus.cc:2889] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:26.868986 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:26.870713 26541 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:26.871371 26546 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:26.839397  2448 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:26.832432  2626 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:26.832005  2525 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.903863 26621 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 26. Current term is 27. Ops: [26.18-26.18]
I20260709 12:13:26.831841  2768 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:26.838490  2683 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:26.908735 26542 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 24: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:26.911602 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4337) took 1469 ms. Trace:
I20260709 12:13:26.867568  2428 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:26.913234 26619 rpcz_store.cc:276] 0709 12:13:25.437284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.648565 (+1211281us) service_pool.cc:224] Handling call
0709 12:13:26.719135 (+ 70570us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:26.722280 (+  3145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.722325 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:26.722429 (+   104us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:26.722463 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.722538 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:26.906186 (+183648us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b540003cd50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:26.906410 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41188608}
I20260709 12:13:26.917249 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3464) took 1019 ms. Trace:
W20260709 12:13:26.910735 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 281671us
I20260709 12:13:26.918008 26542 rpcz_store.cc:276] 0709 12:13:25.895162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.840814 (+945652us) service_pool.cc:224] Handling call
0709 12:13:26.914108 (+ 73294us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:26.928638 26469 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:26.861353  2524 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:26.936070  2749 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.069s	user 0.033s	sys 0.030s
I20260709 12:13:26.928555  2525 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:26.942440 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4342) took 1086 ms. Trace:
I20260709 12:13:26.951354 26622 rpcz_store.cc:276] 0709 12:13:25.855982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.852948 (+996966us) service_pool.cc:224] Handling call
0709 12:13:26.911348 (+ 58400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:26.936789 (+ 25441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.936825 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:26.942047 (+  5222us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:26.942119 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.942194 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:26.942346 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8378}
I20260709 12:13:26.944103 26540 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:26.947075 26618 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:26.953647 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 3229) took 1427 ms. Trace:
I20260709 12:13:26.954192 26540 rpcz_store.cc:276] 0709 12:13:25.526436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.789952 (+1263516us) service_pool.cc:224] Handling call
0709 12:13:26.953557 (+163605us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:26.917481  2771 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:26.946363  2749 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.206s	user 0.033s	sys 0.030s
I20260709 12:13:26.973330  2525 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:26.974546 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:26.982834 26548 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: [22.15-24.16]
I20260709 12:13:26.982978  2612 consensus_queue.cc:1059] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:26.983951 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3441) took 2910 ms. Trace:
I20260709 12:13:26.984398 26548 rpcz_store.cc:276] 0709 12:13:24.073582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.870209 (+2796627us) service_pool.cc:224] Handling call
0709 12:13:26.957199 (+ 86990us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:26.983549 (+ 26350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.983851 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:26.985999 26548 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: []
W20260709 12:13:26.986564 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 153887us
W20260709 12:13:26.987013 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 121491us
I20260709 12:13:26.988075 26439 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:26.988261 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:26.989501  2428 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:26.990180  2428 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:26.991031 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3439) took 2918 ms. Trace:
I20260709 12:13:26.990193 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:26.991626 26544 rpcz_store.cc:276] 0709 12:13:24.072802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.873269 (+2800467us) service_pool.cc:224] Handling call
0709 12:13:26.956964 (+ 83695us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:26.990557 (+ 33593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.990609 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:26.990667 (+    58us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:26.990707 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.990789 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:26.990956 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35584}
I20260709 12:13:26.990877  2428 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:27.003587 26539 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:13:27.003464 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:27.008603 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3217) took 2559 ms. Trace:
I20260709 12:13:27.009178 26548 rpcz_store.cc:276] 0709 12:13:24.442499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.985297 (+2542798us) service_pool.cc:224] Handling call
0709 12:13:26.985763 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:27.001699 (+ 15936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.002201 (+   502us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:27.023593 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3451) took 2927 ms. Trace:
I20260709 12:13:27.032840 26539 rpcz_store.cc:276] 0709 12:13:24.078572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.874784 (+2796212us) service_pool.cc:224] Handling call
0709 12:13:26.949311 (+ 74527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:27.004241 (+ 54930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.006366 (+  2125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33152}
I20260709 12:13:27.040689 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:27.044571 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:27.045495  2771 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:27.048523  2658 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:26.959151  2683 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:27.045696 26547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3456) took 1617 ms (client timeout 2021 ms). Trace:
I20260709 12:13:27.051577 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4415) took 1464 ms. Trace:
W20260709 12:13:27.056470 26547 rpcz_store.cc:269] 0709 12:13:25.428719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.042162 (+1613443us) service_pool.cc:224] Handling call
0709 12:13:27.045589 (+  3427us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:27.036362  2654 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:27.031874  2768 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:13:27.074242 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52679.6us
I20260709 12:13:27.057354 26466 rpcz_store.cc:276] 0709 12:13:25.586728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.460475 (+873747us) service_pool.cc:224] Handling call
0709 12:13:26.461156 (+   681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:26.461695 (+   539us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:13:26.855882 (+394187us) log.cc:844] Serialized 14 byte log entry
0709 12:13:27.049488 (+193606us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:27.049931 (+   443us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:27.050227 (+   296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.051142 (+   915us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.051496 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":469953,"prepare.run_cpu_time_us":172,"prepare.run_wall_time_us":9991,"thread_start_us":541840,"threads_started":2}
W20260709 12:13:27.072441 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:27.072861  2565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.917s	user 0.021s	sys 0.028s
I20260709 12:13:27.074204 26548 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 26. Current term is 27. Ops: [26.18-26.18]
I20260709 12:13:27.075742 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:27.077327  2748 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:27.077880  2766 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:26.986176  2448 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:27.087396 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44867.6us
W20260709 12:13:27.088557 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.061458  2601 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:27.092154 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 136452us
I20260709 12:13:27.097777  2602 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:27.098335 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:27.099092 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:27.102487 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:27.103359 27168 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
W20260709 12:13:27.105818 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 74718.8us
I20260709 12:13:27.106468  2516 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 30.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:27.107105  2747 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:27.107726  2747 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:27.107894  2516 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:13:27.108500  2516 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:27.109397 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:27.109166  2747 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:27.112165  2683 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:27.114804  2578 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:27.115073 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:27.115739  2578 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:27.119205 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 68148.9us
W20260709 12:13:27.121054 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.121409  2373 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:13:27.122110 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.123103  2434 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:27.117710 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1497) took 1706 ms. Trace:
I20260709 12:13:27.124807  2775 raft_consensus.cc:3055] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:27.126194 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:27.069115  2644 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.119287 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:27.096556 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1362) took 1808 ms. Trace:
I20260709 12:13:27.142091 26548 rpcz_store.cc:276] 0709 12:13:25.282230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.040721 (+1758491us) service_pool.cc:224] Handling call
0709 12:13:27.073760 (+ 33039us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:27.082958 (+  9198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.090291 (+  7333us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:27.088361  2565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.021s	sys 0.029s
I20260709 12:13:27.125800  2524 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:27.131347 26614 rpcz_store.cc:276] 0709 12:13:25.411743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.669118 (+1257375us) service_pool.cc:224] Handling call
0709 12:13:26.697065 (+ 27947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:26.740355 (+ 43290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.740386 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:26.740451 (+    65us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:26.740488 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.117395 (+376907us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x7b540020a654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:27.117447 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.117608 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98932992}
I20260709 12:13:27.131029  2747 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:27.161962 26547 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 12:13:27.168190  2644 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:27.168692 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3215) took 2738 ms. Trace:
I20260709 12:13:27.122210  2373 raft_consensus.cc:697] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:27.170184 26362 catalog_manager.cc:5697] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 20 to 26, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 26 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.171968 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4338) took 1697 ms. Trace:
I20260709 12:13:27.172179  2490 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:27.173806  2720 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:27.176136 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:27.180819 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:27.181985 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 62822us
I20260709 12:13:27.182688 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:27.183187 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44941us
I20260709 12:13:27.183482  2525 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.109823  2516 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 31.20, Last appended by leader: 20, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:27.186656  2727 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:27.187250  2524 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.189397 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 3613) took 1635 ms. Trace:
W20260709 12:13:27.239635 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 82392.3us
I20260709 12:13:27.191120  2653 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:27.191624  2512 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.169287  2578 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:27.205359 27166 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:27.207859 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1365) took 1916 ms. Trace:
I20260709 12:13:27.250277 26547 rpcz_store.cc:276] 0709 12:13:25.285794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.069510 (+1783716us) service_pool.cc:224] Handling call
0709 12:13:27.147553 (+ 78043us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:27.201952 (+ 54399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.202293 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:27.252393 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:27.253393 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 77343.4us
I20260709 12:13:27.254369 26514 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:27.217566 26546 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:13:27.138562  2775 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:27.293529 26544 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: [27.14-27.14]
I20260709 12:13:27.295007 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:27.201248  2748 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:27.297809  2602 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.300774  2602 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:27.303177  2602 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:27.291620  2578 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:27.308210 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 53955.7us
I20260709 12:13:27.310083  2601 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:27.310405 26358 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 953d8c981a6c459f8b7f3dbbb66fda45 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3262bf0553e543eea76794fc529a9acc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:27.311187  2601 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:27.298343  2654 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:13:27.303978 26513 connection.cc:256] RPC call timeout handler was delayed by -1.3130808230000639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
I20260709 12:13:27.321148 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:27.322026 26547 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:27.323349 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3218) took 2852 ms. Trace:
I20260709 12:13:27.237054 26543 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:27.190828 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3427) took 4130 ms. Trace:
I20260709 12:13:27.328239 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:27.327908 26545 rpcz_store.cc:276] 0709 12:13:23.060353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.706875 (+646522us) service_pool.cc:224] Handling call
0709 12:13:23.707305 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:23.861823 (+154518us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:13:24.040348 (+178525us) log.cc:844] Serialized 14 byte log entry
0709 12:13:24.287559 (+247211us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:26.599071 (+2311512us) spinlock_profiling.cc:243] Waited 5.16 ms on lock 0x7b2c0005b0f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:13:26.599931 (+   860us) log.cc:844] Serialized 26 byte log entry
0709 12:13:26.878356 (+278425us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:27.056341 (+177985us) log.cc:844] Serialized 14 byte log entry
0709 12:13:27.093132 (+ 36791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.104986 (+ 11854us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:27.190334 (+ 85348us) raft_consensus.cc:1685] finished
0709 12:13:27.190356 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.190597 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":242828,"prepare.queue_time_us":340658,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":102,"raft.queue_time_us":215717,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":40745,"spinlock_wait_cycles":11859200,"thread_start_us":747688,"threads_started":4,"wal-append.queue_time_us":843045,"wal-append.run_cpu_time_us":2096,"wal-append.run_wall_time_us":1150818}
I20260709 12:13:27.239468 26615 rpcz_store.cc:276] 0709 12:13:25.554339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.871756 (+317417us) service_pool.cc:224] Handling call
0709 12:13:26.779430 (+907674us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b5800049298. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:13:27.125858 (+346428us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b5800049298. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5e9c 00007f5072fb5a5b 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:13:27.189302 (+ 63444us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73395712}
I20260709 12:13:27.246271 26618 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:13:27.246922 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:27.332204 26548 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:27.199368 26542 rpcz_store.cc:276] 0709 12:13:24.430598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.919918 (+2489320us) service_pool.cc:224] Handling call
0709 12:13:26.920664 (+   746us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:26.921577 (+   913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.921627 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:26.922798 (+  1171us) log.cc:844] Serialized 26 byte log entry
0709 12:13:27.029735 (+106937us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:13:27.029874 (+   139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.030469 (+   595us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:27.168442 (+137973us) raft_consensus.cc:1685] finished
0709 12:13:27.168465 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.168601 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2697,"raft.run_cpu_time_us":400,"raft.run_wall_time_us":556,"thread_start_us":105667,"threads_started":1,"wal-append.queue_time_us":242961}
I20260709 12:13:27.335285 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:27.336164 26542 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:27.251510 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1361) took 1969 ms. Trace:
I20260709 12:13:27.340273  2748 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:27.338653 26539 rpcz_store.cc:276] 0709 12:13:25.281921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.044384 (+1762463us) service_pool.cc:224] Handling call
0709 12:13:27.044985 (+   601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:27.045420 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:13:27.045839 (+   419us) log.cc:844] Serialized 14 byte log entry
0709 12:13:27.250659 (+204820us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:27.250791 (+   132us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:27.250909 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.251056 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.251319 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24927,"prepare.queue_time_us":20043,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":10276,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":5152,"thread_start_us":189068,"threads_started":1}
I20260709 12:13:27.341820 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:27.224344 26617 rpcz_store.cc:276] 0709 12:13:25.475063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.678819 (+1203756us) service_pool.cc:224] Handling call
0709 12:13:26.715491 (+ 36672us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:26.736487 (+ 20996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.736521 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:26.737305 (+   784us) log.cc:844] Serialized 52 byte log entry
0709 12:13:26.919353 (+182048us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:27.027817 (+108464us) log.cc:844] Serialized 14 byte log entry
0709 12:13:27.032244 (+  4427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.032570 (+   326us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:27.171739 (+139169us) raft_consensus.cc:1685] finished
0709 12:13:27.171762 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.171897 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9338,"prepare.queue_time_us":71377,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":96419,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":275,"thread_start_us":257877,"threads_started":2,"wal-append.queue_time_us":429146}
I20260709 12:13:27.303661  2775 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:27.350937  2654 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.351491 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:27.352391  2602 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:27.352831  2602 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:27.259651  2524 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:27.270377 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:27.270522  2512 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:27.231521  2720 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.353020  2565 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:27.350208  2775 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:27.274914 26541 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 28.
I20260709 12:13:27.275743  2644 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:27.363440 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 1367) took 2077 ms. Trace:
I20260709 12:13:27.363961 26541 rpcz_store.cc:276] 0709 12:13:25.286285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.833390 (+1547105us) service_pool.cc:224] Handling call
0709 12:13:27.363351 (+529961us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:27.365243 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:27.276463 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:27.277024 26587 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:27.278342  2516 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:13:27.278513  2792 log.cc:927] Time spent T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:13:27.279915  2373 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:27.372483 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:27.371413 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3617) took 1731 ms. Trace:
W20260709 12:13:27.289923 26546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3455) took 1861 ms (client timeout 2147 ms). Trace:
W20260709 12:13:27.373795 26546 rpcz_store.cc:269] 0709 12:13:25.428415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.792604 (+1364189us) service_pool.cc:224] Handling call
0709 12:13:27.289838 (+497234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:27.323942 26544 rpcz_store.cc:276] 0709 12:13:24.457412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.992984 (+2535572us) service_pool.cc:224] Handling call
0709 12:13:27.289146 (+296162us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:27.296717 (+  7571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.306813 (+ 10096us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54002378d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:27.309514 (+  2701us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679803264}
I20260709 12:13:27.351840  2654 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:27.262513  2706 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:27.272878  2525 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:27.353277  2448 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:27.273638 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1242) took 1540 ms. Trace:
I20260709 12:13:27.357695 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3603) took 1994 ms. Trace:
I20260709 12:13:27.353266  2602 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:27.367609  2647 raft_consensus.cc:2764] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election decision vote started in defunct term 27: won
I20260709 12:13:27.355993 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:27.354250  2601 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:27.284036 26439 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:27.284911  2727 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:27.375579 26539 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:27.357113  2720 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:27.381260 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:27.382686 26541 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:13:27.399897 26545 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:27.367990  2747 raft_consensus.cc:2764] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election decision vote started in defunct term 27: won
I20260709 12:13:27.362432  2565 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:27.362856 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3216) took 2928 ms. Trace:
I20260709 12:13:27.404234 26546 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 28.
I20260709 12:13:27.386441 26469 rpcz_store.cc:276] 0709 12:13:25.732806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.491572 (+758766us) service_pool.cc:224] Handling call
0709 12:13:26.852749 (+361177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:26.931296 (+ 78547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.273355 (+342059us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54000db6d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:27.273544 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806455680}
W20260709 12:13:27.403913 26543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3463) took 1509 ms (client timeout 1788 ms). Trace:
W20260709 12:13:27.404459 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 50490.5us
I20260709 12:13:27.373368 26620 rpcz_store.cc:276] 0709 12:13:25.639596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.749871 (+1110275us) service_pool.cc:224] Handling call
0709 12:13:26.791047 (+ 41176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:26.791545 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:13:27.002498 (+210953us) log.cc:844] Serialized 14 byte log entry
0709 12:13:27.370903 (+368405us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:27.370995 (+    92us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:27.371060 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.371154 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.371333 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4078,"prepare.queue_time_us":198812,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":17144,"thread_start_us":442571,"threads_started":2}
W20260709 12:13:27.406623 26543 rpcz_store.cc:269] 0709 12:13:25.894849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.672318 (+777469us) service_pool.cc:224] Handling call
0709 12:13:27.403765 (+731447us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54001054d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:27.403860 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410164480}
I20260709 12:13:27.404946 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:27.392786  2490 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:27.410611 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:27.386533 26616 rpcz_store.cc:276] 0709 12:13:25.363543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.580440 (+1216897us) service_pool.cc:224] Handling call
0709 12:13:26.580950 (+   510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:26.581479 (+   529us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 12:13:26.928178 (+346699us) log.cc:844] Serialized 14 byte log entry
0709 12:13:27.105382 (+177204us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b18002ad900. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5072fefa40 00007f5072fea4e4 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287 00007f50760f5208
0709 12:13:27.357308 (+251926us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:27.357366 (+    58us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:27.357416 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.357497 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.357637 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9733,"prepare.queue_time_us":371214,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":39511,"raft.queue_time_us":76826,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":116,"spinlock_wait_cycles":27036416,"thread_start_us":650766,"threads_started":3,"wal-append.queue_time_us":232424}
I20260709 12:13:27.405378 26540 rpcz_store.cc:276] 0709 12:13:24.434079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.006425 (+2572346us) service_pool.cc:224] Handling call
0709 12:13:27.071845 (+ 65420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:27.098362 (+ 26517us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:13:27.098824 (+   462us) log.cc:844] Serialized 14 byte log entry
0709 12:13:27.362458 (+263634us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:27.362518 (+    60us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:27.362568 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.362637 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.362793 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28169,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":5875,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":19657,"spinlock_wait_cycles":7646464,"thread_start_us":257254,"threads_started":1,"wal-append.queue_time_us":291557}
W20260709 12:13:27.419675 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 149450us
I20260709 12:13:27.420413 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:27.417557 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:27.409386  2565 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:27.424028  2556 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:27.425412  2524 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:27.426548 27165 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
I20260709 12:13:27.427071  2514 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 12:13:27.447211 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 170934us
I20260709 12:13:27.428159 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:27.431208 26362 catalog_manager.cc:5697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 29 to 32, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 32 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:27.449605  2556 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:27.446079 26546 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 27: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:27.449282  2514 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:13:27.454617 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 170748us
I20260709 12:13:27.453204  2514 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:27.456141 26539 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
W20260709 12:13:27.462740 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.439643  2490 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 22 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:13:27.467841 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 190934us
I20260709 12:13:27.473147  2728 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:27.473769 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:27.474810  2805 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:13:27.482627 26541 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:27.483460 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1366) took 2197 ms. Trace:
I20260709 12:13:27.483804 26541 rpcz_store.cc:276] 0709 12:13:25.286042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.438736 (+2152694us) service_pool.cc:224] Handling call
0709 12:13:27.482427 (+ 43691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:27.483170 (+   743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.483399 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:27.485287 26541 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:27.485905 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3452) took 2058 ms. Trace:
I20260709 12:13:27.456234 26362 catalog_manager.cc:5697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 24 to 26, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 26 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:27.490356 26362 catalog_manager.cc:5697] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 16 to 21, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 21 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.492748 26362 catalog_manager.cc:5697] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 18 to 23. New cstate: current_term: 23 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.495018  2766 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:27.495532  2766 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:27.496745  2766 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:27.504316 26548 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:27.486239 26541 rpcz_store.cc:276] 0709 12:13:25.427484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.484649 (+2057165us) service_pool.cc:224] Handling call
0709 12:13:27.485029 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:27.485646 (+   617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.485822 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:27.511307 26363 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57048 (request call id 306) took 52912 ms (client timeout 15000 ms). Trace:
I20260709 12:13:27.512069  2748 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:27.512595  2748 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:27.423446  2428 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:27.466478  2644 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:27.458143  2783 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:27.498348  2766 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:27.528070 26542 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:27.513747  2748 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:27.529700 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:27.536234 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:27.541287 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 152727us
I20260709 12:13:27.548373 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:27.521852  2644 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.545671 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1369) took 2236 ms. Trace:
I20260709 12:13:27.551395 26540 rpcz_store.cc:276] 0709 12:13:25.309155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.467396 (+2158241us) service_pool.cc:224] Handling call
0709 12:13:27.527094 (+ 59698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:27.534059 (+  6965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:27.534103 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:27.545258 (+ 11155us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:27.545324 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.545413 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.545587 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:27.554121 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.555444 26616 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:27.515998  2512 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:27.521610  2783 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:27.555024 26621 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:13:27.558805 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:27.530053  2601 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:27.560012 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:27.568145  2783 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 27.14, Last appended by leader: 14, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:27.569690  2783 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:27.569258  2490 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:27.558334 26617 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:13:27.553823  2644 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:27.575482 26620 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:13:27.576819 26513 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:27.574857 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:27.580233 26514 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:27.581465 27165 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:27.592986 26542 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:27.594138 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3222) took 2091 ms. Trace:
I20260709 12:13:27.594815 26542 rpcz_store.cc:276] 0709 12:13:25.502644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.532786 (+2030142us) service_pool.cc:224] Handling call
0709 12:13:27.573505 (+ 40719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:27.593678 (+ 20173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.594042 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:27.516117  2556 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:27.596355 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:27.597095 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:27.597522 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.600955  2725 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:27.611161  2815 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.008s
I20260709 12:13:27.612869  2748 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:27.614447  2578 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:27.614956 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:27.615134  2578 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:27.615940 26614 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:13:27.617668  2578 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:27.607199 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:27.610281  2654 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:27.622548 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 50139.1us
I20260709 12:13:27.623188 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:27.624204 26616 raft_consensus.cc:2410] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 12:13:27.624218 26513 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:27.606791 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:27.624536  2578 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:27.628937 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:27.574510  2653 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
W20260709 12:13:27.511922 26363 rpcz_store.cc:269] 0709 12:12:34.598989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.599301 (+   312us) service_pool.cc:224] Handling call
0709 12:12:34.657814 (+ 58513us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b540007d354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076044090 00007f50760e2f3a 00007f507be98e9c 00007f507bf9704e 00007f507a4582a4 00007f507a458232 00007f507a458161 00007f507a4580dc 00007f507a457392 00007f507441548c 00007f50744148c6
0709 12:13:27.511035 (+52853221us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:19.098779 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:19.099575 (+   796us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:19.099641 (+    66us) write_op.cc:435] Acquired schema lock
0709 12:13:19.099662 (+    21us) tablet.cc:662] Decoding operations
0709 12:13:19.100853 (+  1191us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:19.100958 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:19.100997 (+    39us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:13:19.101943 (+   946us) tablet.cc:701] Row locks acquired
0709 12:13:19.101999 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:13:19.102204 (+   205us) write_op.cc:270] Start()
0709 12:13:19.102370 (+   166us) write_op.cc:276] Timestamp: P: 1783599199102125 usec, L: 0
0709 12:13:19.133917 (+ 31547us) op_driver.cc:348] REPLICATION: starting
0709 12:13:19.272934 (+139017us) log.cc:844] Serialized 3243 byte log entry
0709 12:13:19.879210 (+606276us) op_driver.cc:464] REPLICATION: finished
0709 12:13:20.060263 (+181053us) write_op.cc:301] APPLY: starting
0709 12:13:20.060370 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:20.066271 (+  5901us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:20.066431 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:20.071112 (+  4681us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:20.071406 (+   294us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 12:13:20.071469 (+    63us) write_op.cc:312] APPLY: finished
0709 12:13:20.071839 (+   370us) log.cc:844] Serialized 81 byte log entry
0709 12:13:20.072689 (+   850us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:20.072824 (+   135us) write_op.cc:454] Released schema lock
0709 12:13:20.073000 (+   176us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:20.075870 (+  2870us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:20.075902 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":597462,"reported_tablets":51,"spinlock_wait_cycles":5806976,"child_traces":[["op",{"apply.queue_time_us":172270,"apply.run_cpu_time_us":12117,"apply.run_wall_time_us":15583,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37535,"num_ops":8,"prepare.queue_time_us":217653,"prepare.run_cpu_time_us":11471,"prepare.run_wall_time_us":345717,"raft.queue_time_us":156199,"raft.run_cpu_time_us":14112,"raft.run_wall_time_us":210346,"replication_time_us":741789,"thread_start_us":374871,"threads_started":4,"wal-append.queue_time_us":119315,"wal-append.run_cpu_time_us":39540,"wal-append.run_wall_time_us":1666918}]]}
W20260709 12:13:27.606546  2811 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:13:27.638897 26539 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: [26.14-26.14]
I20260709 12:13:27.641820 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:27.642480 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3231) took 2093 ms. Trace:
I20260709 12:13:27.632804 27160 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:13:27.643003 26539 rpcz_store.cc:276] 0709 12:13:25.548897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.625996 (+2077099us) service_pool.cc:224] Handling call
0709 12:13:27.633728 (+  7732us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:27.639393 (+  5665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.642378 (+  2985us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:27.590794  2525 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:27.644429 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.652093 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:27.654644 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:27.660772 26473 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 12:13:27.651209  2807 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:13:27.662796 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:27.675467 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:27.680544 26472 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
W20260709 12:13:27.676879 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 119089us
W20260709 12:13:27.685638 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.686717 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:27.687217 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 63129.9us
W20260709 12:13:27.697939 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.659585  2810 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:27.714200 26469 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:27.714711 26469 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:27.720652 26588 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:27.735399 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 155265us
I20260709 12:13:27.736913 26470 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:13:27.738500 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:27.739616 26617 raft_consensus.cc:2410] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 30 because replica has last-logged OpId of term: 27 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 20.
I20260709 12:13:27.565152 26362 catalog_manager.cc:5697] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 21 to 27, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 27 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:27.740738 26359 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.300s	user 0.002s	sys 0.019s
I20260709 12:13:27.710180  2428 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:27.746263 26514 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:27.747212 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:27.750749 26588 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:27.758563 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 46973.7us
I20260709 12:13:27.760622 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:27.764837 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:27.766714 26468 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: [26.14-26.14]
I20260709 12:13:27.749583  2728 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.767707 26466 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:27.770278 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3457) took 2341 ms. Trace:
I20260709 12:13:27.770246 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:27.764847 26473 raft_consensus.cc:2376] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29. Re-sending same reply.
I20260709 12:13:27.744058  2644 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:27.787220 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 70066.8us
I20260709 12:13:27.774178 26548 rpcz_store.cc:276] 0709 12:13:25.429009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.521286 (+2092277us) service_pool.cc:224] Handling call
0709 12:13:27.542825 (+ 21539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:27.563136 (+ 20311us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 12:13:27.587153 (+ 24017us) log.cc:844] Serialized 14 byte log entry
0709 12:13:27.769894 (+182741us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:27.769956 (+    62us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:27.770007 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.770086 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.770218 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17170,"prepare.queue_time_us":15877,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":4174,"raft.queue_time_us":25533,"thread_start_us":143419,"threads_started":1}
I20260709 12:13:27.772610 26469 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:27.787933 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3461) took 2189 ms. Trace:
I20260709 12:13:27.791460 26539 rpcz_store.cc:276] 0709 12:13:25.598149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.643864 (+2045715us) service_pool.cc:224] Handling call
0709 12:13:27.696154 (+ 52290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:27.696477 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:13:27.696827 (+   350us) log.cc:844] Serialized 14 byte log entry
0709 12:13:27.787430 (+ 90603us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:27.787511 (+    81us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:27.787576 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.787670 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.787848 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24618,"prepare.queue_time_us":667,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":32629,"thread_start_us":58782,"threads_started":1}
W20260709 12:13:27.793041 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.789206 26514 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:27.767112  2653 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:27.790647 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:27.779528  2556 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:27.806774 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:27.815999 26543 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:27.808079 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:27.808293 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:27.810463  2435 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:27.828454  2435 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.828948  2435 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:27.832345 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:27.811188 26472 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 27: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:13:27.835345 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 46263.7us
I20260709 12:13:27.813527 26545 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:27.820649  2812 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:27.836367  2812 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:27.836777 26514 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:27.837634  2810 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:27.837425  2812 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:27.838047  2810 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.822647 26469 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:27.838434  2810 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:27.838474  2822 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:27.839181  2822 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:27.822649  2816 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:27.840183  2816 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:27.814254  2653 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:27.825093 26467 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 27: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:27.844611 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:27.839589  2822 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:27.798184  2578 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:27.862859 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:27.782419  2512 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.062s
I20260709 12:13:27.865553 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:27.815361  2556 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.781298  2728 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:27.869932 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:27.870299 26615 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
W20260709 12:13:27.877043 26547 consensus_meta.cc:287] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.545s	user 0.007s	sys 0.002s
I20260709 12:13:27.879886 26547 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:27.880681 26540 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:27.883688 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:27.855136  2725 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:27.854707  2578 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.858726  2654 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:27.889906 26467 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:13:27.892179 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3454) took 2464 ms. Trace:
I20260709 12:13:27.874692  2556 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:27.900728 26546 rpcz_store.cc:276] 0709 12:13:25.428131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.509494 (+2081363us) service_pool.cc:224] Handling call
0709 12:13:27.549611 (+ 40117us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:27.681996 (+132385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:27.687937 (+  5941us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:27.711891 (+ 23954us) log.cc:844] Serialized 26 byte log entry
0709 12:13:27.881023 (+169132us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:27.881064 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.881130 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:27.888755 (+  7625us) raft_consensus.cc:1685] finished
0709 12:13:27.888788 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.892062 (+  3274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8784,"raft.queue_time_us":46270,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":224616,"threads_started":2,"wal-append.queue_time_us":154027}
I20260709 12:13:27.843271  2653 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:27.871184  2602 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:27.904114 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:27.905377 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:27.906195 26472 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 27: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:27.906991 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:27.907974 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:27.908231 26544 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 16. Current term is 17. Ops: []
W20260709 12:13:27.908936 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.854485  2428 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 12:13:27.871577  2728 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:27.914131 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:27.899621  2578 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:27.900499  2654 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.934849  2525 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:27.951962  2654 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:27.952139  2525 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.952589  2525 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:27.955052  2816 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:27.938113 26469 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 18. (term mismatch)
I20260709 12:13:27.956883 26469 pending_rounds.cc:85] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 17
I20260709 12:13:27.957247 26469 pending_rounds.cc:107] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 27.18
I20260709 12:13:27.957576 26469 raft_consensus.cc:2889] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:27.957973 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1368) took 2660 ms. Trace:
I20260709 12:13:27.942957 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:27.943351  2720 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.000s
I20260709 12:13:27.944078 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:27.944880 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:27.937878  2747 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 12:13:27.875777 26362 catalog_manager.cc:5697] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 18 to 23, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 23 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.934805  2815 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.019s
I20260709 12:13:27.895187  2683 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 12, Time since last communication: 0.087s
I20260709 12:13:27.947516  2514 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:27.950788 26542 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: [20.13-21.14]
I20260709 12:13:27.950963 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:27.959115 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:27.963374 26467 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 23: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:27.969210 26470 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:13:27.981281 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3226) took 2458 ms. Trace:
I20260709 12:13:27.989342 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:27.997396 26540 rpcz_store.cc:276] 0709 12:13:25.523149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.558195 (+2035046us) service_pool.cc:224] Handling call
0709 12:13:27.880481 (+322286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:27.885408 (+  4927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.981075 (+ 95667us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54002369d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:27.981221 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":699009280}
I20260709 12:13:27.980398 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:27.959512 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:27.999058 26543 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 27: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:27.958364 26544 rpcz_store.cc:276] 0709 12:13:25.297307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.421969 (+2124662us) service_pool.cc:224] Handling call
0709 12:13:27.426162 (+  4193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:27.908680 (+482518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.957678 (+ 48998us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54003980d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:27.957872 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1108112128}
W20260709 12:13:27.951413  2448 consensus_meta.cc:287] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.558s	user 0.012s	sys 0.000s
I20260709 12:13:28.002249 26466 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
W20260709 12:13:28.030556 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 63013.1us
W20260709 12:13:27.970009  2565 consensus_meta.cc:287] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.000s
W20260709 12:13:28.029167 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 119534us
I20260709 12:13:27.968070  2742 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:27.984681  2644 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:28.038014 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:28.047993 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:28.048677 26545 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 27: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:28.040127 26620 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:28.041531 26467 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:28.047933 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:28.049881 26543 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:28.047500 26464 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:13:27.983194  2683 raft_consensus.cc:3055] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:28.041265 26469 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 26 index: 16. (term mismatch)
I20260709 12:13:28.052561 26469 pending_rounds.cc:85] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 15
I20260709 12:13:28.052825 26469 pending_rounds.cc:107] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 27.16
I20260709 12:13:28.053071 26469 raft_consensus.cc:2889] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:27.976922  2741 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:13:28.055962 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:28.056535 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.054327 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:28.058809 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:28.058959 26547 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:28.071375 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:28.077032  2783 consensus_meta.cc:287] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.002s
I20260709 12:13:27.968400  2720 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:28.079653 26540 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:28.068737 26473 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:28.054112  2683 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:28.093178 26544 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:28.096925 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:28.098771 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3232) took 2490 ms. Trace:
I20260709 12:13:28.077768  2512 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:28.099494 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:28.117586 26469 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:28.117689 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:28.121950 26547 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:28.060798  2741 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:28.087970  2831 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:13:27.977067 26362 catalog_manager.cc:5697] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 18 to 21, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 21 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:28.131664 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:28.132949 26362 catalog_manager.cc:5697] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 19 to 21, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 21 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:28.137164  2602 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:28.138921  2809 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:28.139508  2809 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:28.139942  2809 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:28.142854 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48207.1us
I20260709 12:13:28.144456 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:28.149006 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3230) took 2621 ms. Trace:
I20260709 12:13:28.149487 26542 rpcz_store.cc:276] 0709 12:13:25.527308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.596095 (+2068787us) service_pool.cc:224] Handling call
0709 12:13:27.844119 (+248024us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:27.994563 (+150444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:28.086180 (+ 91617us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54001126d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:28.148800 (+ 62620us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54001126d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:28.148938 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":790281472}
I20260709 12:13:28.151803  2524 raft_consensus.cc:3055] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:28.152311  2524 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:28.152345  2809 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:28.152906  2435 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:28.153383  2524 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:28.033056  2565 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:28.155074 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:28.168004 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:28.157768 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 111047us
I20260709 12:13:28.127210 26544 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:28.100553 26548 rpcz_store.cc:276] 0709 12:13:25.608684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.796618 (+2187934us) service_pool.cc:224] Handling call
0709 12:13:27.861181 (+ 64563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:27.868921 (+  7740us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:13:27.898006 (+ 29085us) log.cc:844] Serialized 14 byte log entry
0709 12:13:28.094294 (+196288us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:28.098474 (+  4180us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:28.098519 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:28.098582 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:28.098700 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14893,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":4608,"raft.queue_time_us":297,"thread_start_us":153859,"threads_started":1}
I20260709 12:13:28.182791 26547 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:28.186129  2742 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 28 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:28.187418 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:28.202569 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:28.202761 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:28.204530 26542 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:28.206316 26541 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:28.207459 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:28.208158 26544 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 17: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:13:28.209344 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 64997.9us
I20260709 12:13:28.181867  2783 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:28.223253 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:28.223990 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:28.205941  2524 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:13:28.235375 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.231594 26546 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:28.239835 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:28.217487  2653 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.242772 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:28.245224 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:28.201452  2822 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:28.216490  2783 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:28.199272  2512 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:28.249605 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:28.248909 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:13:28.254201 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.255081 26469 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:28.189108  2683 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:28.239607  2809 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:28.256079 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:28.264282 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:28.265092 26472 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:13:28.227375  2810 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:28.251279  2783 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:28.253321  2514 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:28.313730 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:28.245635  2434 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
W20260709 12:13:28.335863 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 87056.5us
I20260709 12:13:28.254855  2653 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:28.293010  2815 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.343555  2720 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:28.336772  2448 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:28.375847 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:28.344551  2840 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:13:28.344672  2653 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:28.344957  2565 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:28.239921 26545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:13:28.383226 26545 raft_consensus.cc:606] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:13:28.383872 26545 raft_consensus.cc:614] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:28.350731  2512 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:28.337687  2742 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:28.351879  2812 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:28.336869  2841 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.036s
I20260709 12:13:28.355057 26540 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:13:28.343585 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:28.371836 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:28.295193  2435 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:28.388370 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:28.407442 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:28.392604 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.266144  2578 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:28.396610 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:28.404222 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.391408 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:28.409653 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.410241 26620 raft_consensus.cc:2410] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 12:13:28.407748 26542 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:28.411211 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:28.412876 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:28.413583 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3458) took 2984 ms. Trace:
I20260709 12:13:28.413986 26541 rpcz_store.cc:276] 0709 12:13:25.429287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.515815 (+2086528us) service_pool.cc:224] Handling call
0709 12:13:27.544178 (+ 28363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:28.206775 (+662597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:28.402193 (+195418us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b5400105ed4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:28.413520 (+ 11327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1522220416}
I20260709 12:13:28.413367 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:28.418318 26614 raft_consensus.cc:2368] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24.
I20260709 12:13:28.418586 26615 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 28: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:28.419832 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:28.421317 26613 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 28: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:28.375785  2448 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:28.376552  2844 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 12:13:28.428741 26472 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:28.432760 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 174544us
I20260709 12:13:28.445923 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:28.447535 26539 raft_consensus.cc:2368] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 22. Current term is 23.
I20260709 12:13:28.450804 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:28.422652  2434 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.469151 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:28.470639 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.389221  2815 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:28.387881  2654 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:28.398484  2525 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:28.477067 26614 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 27 index: 21. Preceding OpId from leader: term: 29 index: 22. (index mismatch)
I20260709 12:13:28.486624 26464 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:28.498656 26465 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:13:28.428985  2725 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:28.439347  2448 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:28.508574 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.510242 26543 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 26: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:13:28.516275 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 70491.5us
I20260709 12:13:28.517000  2654 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:28.517155 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:28.520499 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:28.521644 26614 raft_consensus.cc:2410] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 28 because replica has last-logged OpId of term: 27 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 15.
I20260709 12:13:28.510954  2725 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:28.522193 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:28.520428 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:28.527695 26619 raft_consensus.cc:2376] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29. Re-sending same reply.
I20260709 12:13:28.526626 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:28.500130  2822 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:28.536401 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:28.538029 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.512394  2435 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:28.530040  2813 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:28.531144 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:28.546703 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:28.498003  2434 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:28.556277 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:28.546170  2741 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:28.559165 26471 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 27.
I20260709 12:13:28.551746  2748 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.560211  2748 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:28.541196  2813 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:13:28.575197 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.568038 26622 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:28.566285  2766 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 12:13:28.566716  2435 raft_consensus.cc:697] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:28.579541  2435 consensus_queue.cc:237] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:28.580101 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:28.580829 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:28.581441 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:28.581938 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:28.583608  2490 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:28.586230 26472 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:13:28.586481  2720 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:28.576474 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:28.589564 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:28.590683  2813 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:28.596225 26464 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:28.601425  2815 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:28.602994  2578 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:28.603425  2725 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:28.605342 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:28.605896  2434 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:28.606647 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:28.607510 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:28.607833 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:28.608625 26619 raft_consensus.cc:2410] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 28 because replica has last-logged OpId of term: 27 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 15.
I20260709 12:13:28.608978 26620 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: [25.14-25.14]
I20260709 12:13:28.609594 26619 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:28.606765 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:28.610329 26620 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:28.594959  2810 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:28.634800 26617 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 27: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:28.640234 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:28.595534  2373 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:28.649369  2525 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:28.649863  2556 consensus_meta.cc:287] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.691s	user 0.004s	sys 0.008s
I20260709 12:13:28.663702  2809 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:28.664283  2809 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:28.665316  2809 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:28.642823 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:28.643608  2448 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:28.648342 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 67621.3us
I20260709 12:13:28.650323  2556 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:28.676012 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 128968us
I20260709 12:13:28.676223 26614 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:28.693003  2809 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:28.693609 26359 maintenance_manager.cc:643] P 8f3fd02e9cbb4cbb90df37bb5fd109c3: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 3.766s	user 0.145s	sys 0.087s Metrics: {"cfile_cache_miss":6,"cfile_cache_miss_bytes":25166,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":421542,"dirs.run_cpu_time_us":701,"dirs.run_wall_time_us":7416,"lbm_read_time_us":34354,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":20,"lbm_write_time_us":6159,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":8,"peak_mem_usage":265268,"reinsert_count":0,"thread_start_us":448813,"threads_started":3,"update_count":186,"wal-append.queue_time_us":194085}
W20260709 12:13:28.699409 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 133417us
I20260709 12:13:28.702075 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:28.707975  2760 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:28.708616  2760 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.709072  2760 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:28.716050  2653 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:28.717634  2512 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:28.718165  2512 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:28.719754  2839 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.406s	user 0.003s	sys 0.000s
I20260709 12:13:28.719619  2512 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:28.755532 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:13:28.757388  2848 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.286s	user 0.003s	sys 0.000s
I20260709 12:13:28.758769 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:28.755450  2831 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:28.759452 27166 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:28.754138 27168 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:13:28.763886 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:28.777691 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:28.778854 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:28.790905 27133 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:28.793718 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:28.795534 27133 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:28.798237 26619 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:28.799432 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:28.799360 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:28.801906 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:28.779443  2512 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:28.802434  2810 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:28.799371  2525 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:28.849438 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:28.850383 26613 raft_consensus.cc:2410] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 12:13:28.851328 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:28.852500 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:28.812414 26622 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:28.855206 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:28.856352 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:28.813396 26438 connection.cc:256] RPC call timeout handler was delayed by -1.0618083580000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
I20260709 12:13:28.857128 26620 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:28.846127 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:28.842422 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:13:28.856329 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.858409 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:28.846728 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:28.777117  2860 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:28.855715  2863 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:28.799554  2857 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.080s
I20260709 12:13:28.859421 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:28.859905 26466 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:28.880779  2860 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:28.860090 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:28.882731 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:28.884372 27163 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 25 index: 20. Preceding OpId from leader: term: 29 index: 22. (index mismatch)
I20260709 12:13:28.860428 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:28.886191 26469 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:28.886260  2822 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:28.889055 27168 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:28.890304 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:28.860684 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:28.847718  2775 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.890113 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:28.892704  2775 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:28.862830 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:28.894048 26465 raft_consensus.cc:2410] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 27 because replica has last-logged OpId of term: 25 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 13.
W20260709 12:13:28.867717 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.895206  2775 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:28.896488 26540 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:13:28.897493  2602 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:28.867954 27166 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:28.870971 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:28.898561  2654 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:28.898857 26545 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:13:28.898990  2654 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:28.899221 27163 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:28.899893  2654 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:28.871248 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:28.871868 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:28.901234 26467 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:28.901966  2766 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:28.903504 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:28.873296 26542 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:13:28.874025 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:28.874933 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:28.806283  2514 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.905815  2514 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:28.908059  2514 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:28.893087  2578 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:28.908190 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:28.910085 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:28.910760 26619 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:28.912014 26467 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:28.882704 26615 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:28.861377  2810 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:28.811769  2653 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.917621  2556 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:28.917742 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:28.918079  2857 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:28.918576  2857 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:28.914570  2843 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:28.848558  2856 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:28.919653  2856 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:28.920146  2856 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:28.921211 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 75151.9us
I20260709 12:13:28.923247 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:28.923950  2748 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:28.924461 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:28.919565  2857 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:28.925930  2857 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:28.929755  2837 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.486s	user 0.002s	sys 0.000s
I20260709 12:13:28.931281  2831 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:13:28.931716  2846 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.498s	user 0.001s	sys 0.001s
I20260709 12:13:28.932155  2831 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:28.937319 26615 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
W20260709 12:13:28.869376 26438 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.021s (SENT) [suppressed 19 similar messages]
I20260709 12:13:28.938666 26469 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:28.939352 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:28.939004 26514 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:28.943188 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.914026  2525 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:28.936378  2783 consensus_meta.cc:287] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.595s	user 0.007s	sys 0.005s
I20260709 12:13:28.868685  2435 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.079s
I20260709 12:13:28.949157  2836 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.007s
I20260709 12:13:28.951248  2819 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:28.956705  2819 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:28.949627  2524 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.006s
I20260709 12:13:28.938720  2653 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:28.930135  2856 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:28.943321  2448 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:28.963387  2783 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:28.968186 26622 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:28.977336  2783 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:28.977852  2524 consensus_queue.cc:1059] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:28.979667 26617 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
I20260709 12:13:28.980825  2653 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:28.983639  2862 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:13:28.984508 26439 leader_election.cc:400] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24.
I20260709 12:13:28.985265  2490 raft_consensus.cc:3055] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:28.986374  2741 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:28.986292 26439 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:28.987177  2748 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260709 12:13:28.988406  2760 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:28.957713  2819 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.16, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:28.995904 26513 leader_election.cc:336] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.528s (SENT)
I20260709 12:13:29.045897 26513 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:28.958984  2525 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:28.998744  2841 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Stepping down as leader of term 26
W20260709 12:13:29.001327  2845 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.652s	user 0.004s	sys 0.000s
I20260709 12:13:29.053268  2525 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:29.005478 26619 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
W20260709 12:13:29.055096 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 196775us
I20260709 12:13:29.005927 26620 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
W20260709 12:13:29.041760  2838 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.703s	user 0.003s	sys 0.000s
I20260709 12:13:29.035874  2490 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:29.037190  2741 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:13:29.043195  2842 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.532s	user 0.003s	sys 0.000s
I20260709 12:13:29.042960  2813 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:29.044989 26613 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: [24.15-24.15]
W20260709 12:13:29.048862 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.051219  2578 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:29.053790  2683 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:29.051956  2841 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:13:29.049880 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 102019us
W20260709 12:13:29.057183 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:29.088368 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.056836 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:29.053623  2775 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:29.056090 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:29.090288 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:29.058815 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 189453us
W20260709 12:13:29.051586 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 55754.1us
W20260709 12:13:29.092147 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.071909 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:29.073063 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:29.069566 26588 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:29.088625 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 102402us
I20260709 12:13:29.058483  2373 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.107133 27133 leader_election.cc:400] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 22. Current term is 23.
I20260709 12:13:29.107717 27133 leader_election.cc:403] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:29.108899 26619 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:13:29.101611  2602 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:29.117583  2514 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:29.115553 26622 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:29.122576 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:29.127628 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:29.129281 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:29.115674  2844 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.009s	sys 0.040s
I20260709 12:13:29.072031  2858 consensus_queue.cc:1059] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.057s
I20260709 12:13:29.101325  2822 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:29.118563  2512 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:13:29.138680  2844 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.009s	sys 0.041s
I20260709 12:13:29.132102  2831 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:13:29.126209  2514 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:13:29.170907 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 114142us
I20260709 12:13:29.110663  2373 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:29.173033 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:29.175843 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 68913.3us
I20260709 12:13:29.139114  2602 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:29.114363  2843 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.043s
I20260709 12:13:29.165279  2760 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:29.165596  2775 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:29.191476 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:13:29.198693 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 100617us
I20260709 12:13:29.204123 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:29.205343 27162 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 29: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:29.178063  2514 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:29.206502 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:29.209126 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:29.127168  2741 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.209570 27163 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
W20260709 12:13:29.211859 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 93205.7us
I20260709 12:13:29.180522  2512 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:29.215126 26614 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 29: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:29.219811 26439 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:29.237278  2856 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:29.238747  2813 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:29.238974  2877 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:29.239651  2877 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:29.224438  2812 consensus_meta.cc:287] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.818s	user 0.012s	sys 0.002s
I20260709 12:13:29.223369  2775 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:29.241410  2775 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.242046  2877 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:29.198290  2871 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.052s
I20260709 12:13:29.243377  2864 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:29.243736  2775 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:29.244405  2775 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:29.244993  2775 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:29.227619 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:29.249365 26618 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:29.246166  2775 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:29.252704 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:29.264004 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:29.271970 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 63129us
I20260709 12:13:29.278561 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:29.281668 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:29.255833  2741 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:29.193059  2490 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:29.285435 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44078.5us
I20260709 12:13:29.297849 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:29.306083 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:29.308422 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.193746  2841 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.274960  2434 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Stepping down as leader of term 26
W20260709 12:13:29.318964 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 55752.7us
I20260709 12:13:29.287937  2877 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:29.285049  2748 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:29.307945  2654 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:29.306944  2602 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.344789 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:29.325996  2512 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.352671  2725 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:29.353186  2725 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.353567  2725 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:29.317996  2434 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:29.357362  2434 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:29.358587  2578 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.358826  2434 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:29.359205  2578 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:29.361464  2578 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:29.362838  2490 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:29.364840  2879 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:29.365533  2879 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:29.373190  2556 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.373834  2556 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.376216  2556 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:29.377010  2810 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:29.418255 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 197904us
I20260709 12:13:29.314747  2822 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:29.421875 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:29.420910 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 93270.9us
I20260709 12:13:29.423391 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:29.424664 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 80023.3us
I20260709 12:13:29.425418 26513 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:29.428699  2893 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:29.429244  2893 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:29.429423  2886 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:29.430351 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:29.430500  2886 raft_consensus.cc:697] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:29.429664  2893 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:29.432003  2886 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.420794  2877 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:29.434862  2877 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:29.435464  2877 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:29.443157  2890 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:29.445348 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:29.444049  2888 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:29.411051  2810 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:29.449507 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 131409us
I20260709 12:13:29.461813 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:29.463164 26615 raft_consensus.cc:2410] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 12:13:29.447434  2844 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:29.464533 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:29.471127 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 45789.7us
W20260709 12:13:29.457083  2854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.012s	sys 0.013s
W20260709 12:13:29.481841 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.458966  2863 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:29.459473  2815 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:29.485235 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:29.486254 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.458752  2556 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:29.497181  2879 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:29.496932  2556 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:29.498232  2373 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:29.498909  2373 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:29.497932  2879 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:13:29.507091  2822 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:29.454844  2810 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:29.513085  2810 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:29.493965  2514 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.468497  2844 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:29.491470 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:29.492174  2854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.013s	sys 0.013s
W20260709 12:13:29.521121 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 54652.4us
I20260709 12:13:29.529146  2876 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:29.539191 26539 raft_consensus.cc:2410] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 28 because replica has last-logged OpId of term: 27 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 16.
I20260709 12:13:29.542109  2844 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.543301  2844 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:29.548584  2831 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 22. Current term is 23.
I20260709 12:13:29.549837  2748 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:29.535457  2876 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:29.553730  2876 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 28.14, Last appended by leader: 14, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:29.554874  2896 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 0.075s	user 0.001s	sys 0.002s
W20260709 12:13:29.556218 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 77842us
I20260709 12:13:29.533898  2890 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Stepping down as leader of term 23
W20260709 12:13:29.550544  2887 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:13:29.551721  2514 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:29.559932 26513 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:29.517652  2815 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.558910  2890 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:29.524811  2893 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:29.589560 27168 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
W20260709 12:13:29.591805 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 148136us
I20260709 12:13:29.592958 26438 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:29.558879  2822 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:29.596886 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 140787us
W20260709 12:13:29.597862 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.596810  2748 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:29.600376  2900 raft_consensus.cc:2764] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:13:29.601624 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:29.601756  2850 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:29.602373  2850 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:29.603634  2850 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.605120  2850 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:29.598603  2822 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.609118  2822 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:29.589607  2775 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:29.610572 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.614938 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:29.615581 27166 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:13:29.617340  2890 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:29.619145  2890 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:29.622648 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 65588.8us
I20260709 12:13:29.624711 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:29.627636 26513 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:29.630628 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:29.631830  2882 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:29.639304  2882 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:29.639644 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:29.613930  2775 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:29.641033  2900 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 12:13:29.641227 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:29.642581 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.642136  2775 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:29.626961  2725 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.639787  2882 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:29.645285  2725 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:29.644618  2882 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:29.647830  2893 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:29.648360  2654 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:29.650506 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:29.651093 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:29.652472 27166 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:29.651862  2822 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:29.653573  2822 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.653942  2822 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:29.651443  2654 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 12:13:29.656154 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 54615.1us
I20260709 12:13:29.657169  2879 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:29.659025 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47504.8us
I20260709 12:13:29.659444  2864 raft_consensus.cc:2764] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260709 12:13:29.660059 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:29.660754 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 382271us
I20260709 12:13:29.661170  2879 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:29.661713  2879 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:29.662426 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:29.662664  2879 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:29.664628  2813 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:29.665194  2813 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:29.666782  2760 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:29.668864 27166 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:29.666895  2888 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:29.670169 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:29.670584  2888 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:29.671505  2809 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:29.671906 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 140736us
I20260709 12:13:29.671651  2888 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:29.672120  2809 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.672716  2883 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:29.673059  2888 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:29.673360  2883 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:29.666038  2813 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:29.675674 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:13:29.673563 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.681371 26618 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:29.652669  2905 consensus_queue.cc:1059] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.067s
I20260709 12:13:29.683447  2883 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.684404  2905 consensus_queue.cc:1243] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 22.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:13:29.685086  2905 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:29.685545  2905 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:29.685587  2760 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:29.686153  2841 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:29.675751 27160 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:29.658226 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:29.658931 26439 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:29.695660  2870 raft_consensus.cc:3055] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:29.696185  2870 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:29.697207  2870 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.697531 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:29.698302  2815 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:29.700903  2870 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:29.702930  2720 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 27.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:29.701941  2809 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:29.686141  2760 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:29.706141 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:29.706935 27168 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:13:29.708323 26588 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:29.710911 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:29.723075 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 63092.7us
I20260709 12:13:29.736433 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:29.739483 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.758883 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:29.740356 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.759603 26620 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:13:29.761274 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:29.762738 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:29.763434 26615 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:29.735641  2654 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:29.764004  2654 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:29.764493  2654 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:29.766515  2653 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:29.767184  2653 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:29.768360  2653 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:29.769405  2822 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.704212  2720 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:29.770601  2900 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:29.736603  2809 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:29.759076 26587 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:29.756589 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:29.776604 26613 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
I20260709 12:13:29.784765 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:29.785463 26539 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:29.683589  2877 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:29.788154 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:29.788812 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.736353  2525 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.796200 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:29.789724 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:29.796902 26467 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:29.802309 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:29.802579 27161 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:13:29.810701 26513 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:29.814988 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:29.815795 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:29.816361 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:29.816989 26545 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:29.819375 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:29.821554 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 65056.4us
I20260709 12:13:29.820137 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:29.819039 26467 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:13:29.788393  2809 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.782627  2720 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:29.827849 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 168991us
I20260709 12:13:29.839596  2809 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:29.841320 26439 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:29.828064 26464 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:29.782346  2775 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:29.843159  2775 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:29.828653 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:29.830006 26546 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: [26.14-26.14]
I20260709 12:13:29.830782 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:29.844120  2906 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:29.844123 26542 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
W20260709 12:13:29.835326 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.837882 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:29.846247 26544 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:29.794636  2783 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:29.844506 26543 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:29.847744  2775 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:29.848166  2775 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:29.848212 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:29.849228  2775 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:29.827921 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:29.850761 26466 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:13:29.850883  2822 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:29.853681 26471 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:13:29.777180  2725 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 12:13:29.845548  2906 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:29.859525 26545 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:29.859848 26539 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:29.801559  2448 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:29.866441 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:29.867919 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:29.869679 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:29.818434  2556 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:29.818169  2810 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:29.846371  2899 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:29.873435  2514 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:29.873997 26615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d235a62666644668508e208ad8d21d3"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:13:29.874536  2775 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:29.925747 26543 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:29.877164  2783 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:29.879837  2434 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:29.881279 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:29.928157 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47005.4us
I20260709 12:13:29.929239 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:13:29.885308 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.911832  2720 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.916317  2760 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:29.832722  2373 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:29.808063  2525 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.814447  2654 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:29.919020 26540 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
W20260709 12:13:29.949306 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.922549 26542 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 12:13:29.923328 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 97438us
I20260709 12:13:29.873509  2906 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:29.832033  2876 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:29.757704  2905 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.972084 26615 raft_consensus.cc:606] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:13:29.926680  2899 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:29.897612  2809 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:29.935001  2812 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:29.997968 26615 raft_consensus.cc:614] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:30.003090 26547 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:29.919950  2448 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:29.932561  2882 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:30.007524 26438 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:29.994935  2434 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:30.012425  2435 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.027958 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:30.033608 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:30.022545  2812 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.021849  2720 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:30.023216  2434 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:30.000770  2876 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:30.027496  2373 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election won for term 27
W20260709 12:13:30.052284 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 211063us
I20260709 12:13:30.054750 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:30.043640  2748 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:30.056569 26613 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 12:13:30.058857 26619 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 29. Current term is 30. Ops: [29.22-29.22]
I20260709 12:13:30.059935 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:30.060588 27161 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:30.048544  2434 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:30.061477 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:30.062146 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.063199 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:30.070367 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:30.065342 26514 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:30.074949 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:30.075937 26543 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 29: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:30.065697 27166 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:30.032910  2435 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:30.077744 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:30.046836  2906 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:30.055047  2373 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:30.048125  2812 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:30.061054  2879 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:30.099859 26621 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:13:30.084388 26540 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 23. Current term is 24. Ops: []
W20260709 12:13:30.084789 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.085242 26546 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 12:13:30.076265 26514 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:30.028839  2783 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:30.064263  2900 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:30.091027  2760 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:30.062680  2877 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:30.105962  2888 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.139168  2888 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:30.142002  2888 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:30.103736 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:30.146102 26616 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:13:30.064518  2886 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:30.147428  2886 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:30.108083 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:30.109201 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:30.154873 26613 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:30.112421  2815 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:30.094204 26548 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:13:30.156147  2815 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:30.112965 27166 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:13:30.156805  2815 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:30.159742  2877 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:13:30.160501  2877 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:30.160897  2819 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:30.163286  2877 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 31.20, Last appended by leader: 20, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:30.166944  2886 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:30.168213  2886 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:30.170920  2654 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:30.174100 26544 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:30.174433  2809 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:30.175768  2888 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.176877  2888 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:30.177157  2876 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:30.188068 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:30.085455  2556 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:30.200608 27168 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:30.054243  2899 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:30.202227 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:30.203480 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.203872 27161 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:30.211354 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:30.211926 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:30.212285 27167 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:13:30.133757  2909 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 12:13:30.154186  2910 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:13:30.222929 26615 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 28 index: 14. Preceding OpId from leader: term: 29 index: 15. (index mismatch)
I20260709 12:13:30.226481 27166 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:30.177817  2900 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:30.241755 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 312605us
I20260709 12:13:30.204015  2556 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:30.230001  2760 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 12:13:30.243975 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:30.215898  2435 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:30.256359  2760 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:30.259111 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:30.261008 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.117105  2578 consensus_queue.cc:1059] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.124s
I20260709 12:13:30.234632  2525 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:30.091511  2373 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:30.239046  2882 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:30.248065  2556 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:30.265839 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 112022us
I20260709 12:13:30.238711  2448 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:30.284454 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:30.264412  2890 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.279292 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:30.292011 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:30.280629 26472 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 23. Current term is 24. Ops: []
W20260709 12:13:30.268422 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 199644us
I20260709 12:13:30.288640 26471 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:30.288903 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:30.298720 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.300153 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:30.267364  2435 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.026s
I20260709 12:13:30.303376  2812 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:30.303807  2888 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:30.294942 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:30.295212  2890 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:30.287406  2822 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.308280 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:30.308007  2915 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:30.294060  2919 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:30.306692  2882 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 12:13:30.314610  2890 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:30.314865  2912 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 12:13:30.310737  2741 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:30.347422  2915 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:30.319262 26468 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:13:30.348526  2915 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:30.351526  2900 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:30.356099 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:30.356827 26544 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
I20260709 12:13:30.356927  2815 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:30.307147  2578 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 12:13:30.327391  2879 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:30.328037  2556 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:30.329360  2819 raft_consensus.cc:3055] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:30.336730 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:30.304481  2888 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:30.338932 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 50106us
I20260709 12:13:30.344116  2890 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:30.370379  2920 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.002s
I20260709 12:13:30.370433  2819 raft_consensus.cc:740] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:30.371552  2920 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:30.370800  2890 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:30.372536  2870 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:30.362141  2919 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:30.377254  2888 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:30.377825  2919 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:30.371948  2920 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:30.330832  2822 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:30.379558  2888 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:30.379334  2920 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:30.381716  2890 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:30.382364 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:30.382948  2514 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:30.386960 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:30.387781  2888 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:13:30.388931  2888 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:13:30.390431  2919 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:30.391176  2882 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:30.391816  2882 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:30.397322 27167 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:13:30.400182 26588 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:30.374542  2879 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:30.412525  2556 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:30.413758  2921 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:30.414485  2921 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:30.422366 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.435487 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:30.371908  2819 consensus_queue.cc:260] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:30.415447  2921 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 27.21, Last appended by leader: 21, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:30.391187  2888 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.050s
I20260709 12:13:30.453840  2882 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:30.413776  2879 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:30.462782 27167 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 29. Current term is 30. Ops: [27.21-29.22]
I20260709 12:13:30.491060  2434 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:30.495178 26621 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:30.494213 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:30.496279 26619 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
W20260709 12:13:30.500999 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.494906 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:30.507606 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:30.492960  2775 consensus_meta.cc:287] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.558s	user 0.013s	sys 0.001s
I20260709 12:13:30.507395 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:30.507658 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:30.489408  2748 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:30.556710 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:30.558926 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:30.561419 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:30.582449 26619 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:13:30.582542 26618 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:13:30.505851  2819 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:30.587401 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:30.507344  2888 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:30.588431 26613 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:13:30.589716 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:30.591169 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:30.592744 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 333772us
W20260709 12:13:30.594648 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 344180us
I20260709 12:13:30.595508 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:30.588374  2742 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.610411 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:30.590451  2888 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:30.579475  2926 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 27.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.041s
I20260709 12:13:30.628386 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:30.620244 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:30.631800 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 259778us
I20260709 12:13:30.632184 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:30.632452 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:30.635406  2926 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:30.635885  2926 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:30.636940  2905 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:30.640723  2879 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:30.641350  2879 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:30.642547  2879 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:30.619064  2720 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:30.607728  2434 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:30.645622  2899 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:30.625885  2514 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:13:30.656730 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:30.648876  2653 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:30.670178 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:30.620152  2742 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:30.655911  2514 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:30.658660  2927 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.664951  2822 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:30.663365  2929 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:30.695768 26613 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:30.699452  2448 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:30.675516  2720 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:13:30.707804  2870 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:30.694880  2653 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:30.719511 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 209768us
W20260709 12:13:30.713474 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.723951 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:30.721215 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:30.724121 26439 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:30.633766  2748 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:30.693220  2514 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:30.690135  2741 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:30.755409  2741 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:30.755928 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:30.757027 26542 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:13:30.728883  2373 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:13:30.757970  2741 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:30.730852  2932 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 12:13:30.758888  2906 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:30.759914  2932 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:30.760344  2932 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:30.760692  2932 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:30.760825  2906 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:30.736260  2939 consensus_queue.cc:1059] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:30.762822 26540 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:30.729597  2919 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:30.765358  2915 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.735234 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:30.731976 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:30.737905  2760 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.738154 26613 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:30.728766  2813 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 12:13:30.738510  2448 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:30.738584  2929 raft_consensus.cc:697] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:30.729075  2864 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 12:13:30.739704  2822 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:30.741597  2810 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:30.742637  2882 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:30.745716  2435 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:30.686564  2888 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:30.748245 26547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:13:30.805536 26547 raft_consensus.cc:606] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:13:30.806015 26547 raft_consensus.cc:614] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:30.750912 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:30.751825  2812 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:13:30.752961  2512 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.735209  2653 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:30.767890 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:30.784086 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:30.636854  2926 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 29.22, Last appended by leader: 22, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:30.790015  2760 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:30.818689  2926 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:30.818863  2448 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:30.819996  2760 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:30.820688  2775 consensus_queue.cc:1175] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3262bf0553e543eea76794fc529a9acc" responder_term: 30 status { last_received { term: 25 index: 20 } last_committed_idx: 20 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 29. Current term is 30. Ops: [27.21-29.22]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:13:30.791365 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:30.799069 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:30.779808  2720 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:30.823523  2720 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:30.825914  2720 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:30.713105  2927 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:30.816250 26542 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:13:30.839222 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:30.840174 27161 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:30.836153 26540 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
W20260709 12:13:30.836755 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 199283us
I20260709 12:13:30.843449 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:30.846282 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:30.858144 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.847693 26588 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:30.795928  2556 consensus_queue.cc:1059] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 28.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.042s
I20260709 12:13:30.785087  2915 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:30.830556  2929 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:30.884552  2920 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:30.845788  2760 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:30.890457 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:30.893453 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 45872.8us
I20260709 12:13:30.873606 26546 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:13:30.832894  2512 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:30.956887  2890 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.004s
W20260709 12:13:30.966845 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 242826us
W20260709 12:13:30.987078 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 263250us
I20260709 12:13:30.986441 26439 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:30.991693 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:30.995749 26472 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:13:30.996220 26439 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:30.998015 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:30.998306  2775 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:30.998636  2926 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:30.993521 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:30.999375  2556 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:30.999415  2926 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:31.001415  2926 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:31.003556  2922 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.330s	user 0.003s	sys 0.000s
I20260709 12:13:31.003695 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:31.005383  2815 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:31.010011 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:31.010643 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:31.011550 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:30.998759  2775 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:31.012840  2775 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:31.013563 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:31.014240 26616 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:31.021311 26547 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:30.993402 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:31.023348 26469 raft_consensus.cc:2410] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 30 because replica has last-logged OpId of term: 29 index: 22, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 21.
I20260709 12:13:31.000725  2928 raft_consensus.cc:3055] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:31.024765  2928 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:31.025976  2928 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:31.027642  2928 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:31.028769 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:31.029369  2870 raft_consensus.cc:3055] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:31.029969  2870 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:31.031279 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:31.031473 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:31.034957 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:31.037050 26543 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:31.034837 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:31.037315  2870 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:31.029443 26548 raft_consensus.cc:2376] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28. Re-sending same reply.
I20260709 12:13:31.039142 26541 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: [24.15-24.15]
I20260709 12:13:31.042034  2870 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:31.042303 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:31.043062 26541 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:13:31.044727 26541 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:31.045935  2926 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:31.051605 26546 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 12:13:31.060194 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.904664  2760 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:31.061174  2775 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:31.062139 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:31.062588 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:31.063597 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:31.064473 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:31.093500 26541 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:13:31.095140 26541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:13:31.096211 26541 raft_consensus.cc:606] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:31.065670 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:31.066901 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.067752  2926 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:30.962960  2921 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:30.987920  2924 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.071939  2525 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.082253 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:31.107100 26465 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:31.091398 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:31.097379 26546 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:13:30.987910  2741 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:31.099012 26547 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 22: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:30.986136  2942 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.079407 26616 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:31.103313  2921 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:31.104367  2512 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:31.126169 26467 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:31.073364  2373 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:31.246608  2373 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:31.248987  2373 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:31.180601  2921 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:31.096832  2742 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:30.988472  2890 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:31.123953  2741 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:31.155730 26514 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:31.295159 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 139556us
W20260709 12:13:31.251355  2905 consensus_meta.cc:287] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.614s	user 0.013s	sys 0.000s
I20260709 12:13:31.160315  2525 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:31.305372  2899 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.337498 26464 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:31.339357 26473 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:31.203361  2924 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:31.284739  2949 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.250838  2435 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:31.347463 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1265) took 1063 ms. Trace:
I20260709 12:13:31.348223 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:31.301132  2741 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:31.350649 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 507267us
I20260709 12:13:31.356153 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:31.177343  2942 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:31.312455  2876 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:31.348112 26467 rpcz_store.cc:276] 0709 12:13:30.284466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.286633 (+  2167us) service_pool.cc:224] Handling call
0709 12:13:30.291808 (+  5175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:31.249636 (+957828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:31.347074 (+ 97438us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b540027a6d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:31.347368 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1918402432}
I20260709 12:13:31.324019  2915 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:31.364888 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:31.325014  2512 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:31.372619 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.332713  2812 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:31.356721 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.372606 26616 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:31.343181  2955 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.351297  2905 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.369117  2927 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:31.366766  2945 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:31.456929 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:31.453492 27133 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:31.459630  2893 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:31.344704  2899 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:31.392552  2876 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:31.473834 27167 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 20. Preceding OpId from leader: term: 30 index: 22. (index mismatch)
I20260709 12:13:31.461943 26541 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
W20260709 12:13:31.456609  2935 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.521s	user 0.000s	sys 0.002s
I20260709 12:13:31.397769  2870 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.407814  2742 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.378667  2448 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.087s
W20260709 12:13:31.471266  2514 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.707s	user 0.009s	sys 0.004s
I20260709 12:13:31.360740  2949 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:31.391700  2512 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:31.396853  2812 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:31.465843  2893 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:31.508410 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3333) took 1679 ms. Trace:
W20260709 12:13:31.515872 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.452047  2905 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:31.511657 26464 rpcz_store.cc:276] 0709 12:13:29.829247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:29.843352 (+ 14105us) service_pool.cc:224] Handling call
0709 12:13:29.843694 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:31.338170 (+1494476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:31.508112 (+169942us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400165654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:31.508338 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3427614592}
I20260709 12:13:31.484473  2775 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:31.486255  2653 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:31.538887 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:31.534276 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:31.507169  2943 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.408s	user 0.001s	sys 0.000s
I20260709 12:13:31.406983  2955 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:31.518805  2809 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:31.537791  2653 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:13:31.570089  2953 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 12:13:31.496989  2760 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:31.517899  2822 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.495157  2514 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:31.493501  2742 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:31.489279  2870 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:31.478644  2945 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:31.603575  2948 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
W20260709 12:13:31.638947  2964 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 12:13:31.639909  2958 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:13:31.550541  2434 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.567343 26622 raft_consensus.cc:2410] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:13:31.778187 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:31.616036  2876 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:31.495927  2435 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:31.784021 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:31.799906  2944 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.329s	user 0.006s	sys 0.006s
I20260709 12:13:31.788836  2815 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:31.799937 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:31.799552 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:31.880714 26471 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 32: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:31.852509 26615 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33. Ops: []
I20260709 12:13:31.799041  2809 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:31.884065 27161 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:31.835059  2653 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:31.800729 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:31.885279 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:31.886049 26466 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
W20260709 12:13:31.852802  2819 consensus_meta.cc:287] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.198s	user 0.014s	sys 0.006s
I20260709 12:13:31.867079 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:31.790194 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:31.883662 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4413) took 1291 ms. Trace:
I20260709 12:13:31.894085 27167 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 28: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:31.857836 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:31.868628 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 415177us
W20260709 12:13:31.878880 26465 consensus_meta.cc:287] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.771s	user 0.015s	sys 0.003s
I20260709 12:13:31.895656 26465 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:13:31.896437 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:31.882270 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 496783us
I20260709 12:13:31.883484 27168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1336) took 1618 ms. Trace:
I20260709 12:13:31.865761 26467 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:31.894143 26618 rpcz_store.cc:276] 0709 12:13:30.592498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.592646 (+   148us) service_pool.cc:224] Handling call
0709 12:13:30.601655 (+  9009us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:30.606690 (+  5035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:30.606742 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:30.624793 (+ 18051us) log.cc:844] Serialized 26 byte log entry
0709 12:13:30.811417 (+186624us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:30.811476 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:30.811573 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:31.883405 (+1071832us) raft_consensus.cc:1685] finished
0709 12:13:31.883436 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:31.883601 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4727,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":13918,"thread_start_us":173621,"threads_started":1,"wal-append.queue_time_us":320978}
I20260709 12:13:31.897485 27168 rpcz_store.cc:276] 0709 12:13:30.258614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.258836 (+   222us) service_pool.cc:224] Handling call
0709 12:13:30.268682 (+  9846us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:30.284248 (+ 15566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:30.284282 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:30.285025 (+   743us) log.cc:844] Serialized 52 byte log entry
0709 12:13:30.661408 (+376383us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:30.661468 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:30.661571 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:31.876337 (+1214766us) raft_consensus.cc:1685] finished
0709 12:13:31.876360 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:31.876536 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9547,"raft.queue_time_us":10289,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":4590,"thread_start_us":346264,"threads_started":1,"wal-append.queue_time_us":519321}
I20260709 12:13:31.895823 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:31.885298 26470 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:31.893307 26622 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:13:31.891631 26541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:13:31.777616  2810 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:31.865048  2946 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 0.391s	user 0.006s	sys 0.003s
I20260709 12:13:31.903316 26541 raft_consensus.cc:606] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:13:31.910620 26541 raft_consensus.cc:614] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:13:31.910989 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.895174 26472 raft_consensus.cc:2410] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 12:13:31.852895  2919 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.908623 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:31.915185 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:31.916637 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:31.782554  2654 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.919184 26469 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 29: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:31.924885 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:31.927812 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:31.929093 26547 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 26: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:31.934684 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:31.929721  2959 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:31.892287  2809 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:31.883863  2925 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.930359 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:31.941407 26464 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 32: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:31.943068 26467 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:13:31.950073 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:31.951951 26542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.009s	sys 0.023s
W20260709 12:13:31.952695 26542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.009s	sys 0.023s
I20260709 12:13:31.906683  2890 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:31.864703  2822 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:31.965058 26542 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 28 index: 17. (term mismatch)
I20260709 12:13:31.967057 26542 pending_rounds.cc:85] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 16
W20260709 12:13:31.967290 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.967523 26542 pending_rounds.cc:107] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 27.17
I20260709 12:13:31.969013 26542 raft_consensus.cc:2889] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:31.878209  2434 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:31.974174 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4417) took 1313 ms. Trace:
I20260709 12:13:31.918887  2927 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:31.974033 26466 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: [28.18-28.18]
I20260709 12:13:31.892508  2815 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:31.989348 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:31.994174 26543 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:31.983664 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:31.940311  2924 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:31.999316 26545 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:13:31.996207 26464 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:32.006868 26470 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:13:31.981686  2525 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:31.908706  2893 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:31.930260  2919 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.007997 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:31.981359 26621 rpcz_store.cc:276] 0709 12:13:30.660823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.661041 (+   218us) service_pool.cc:224] Handling call
0709 12:13:30.671496 (+ 10455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:30.685369 (+ 13873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:30.685403 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:30.685892 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:13:30.957430 (+271538us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:30.957511 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:30.957618 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:31.973882 (+1016264us) raft_consensus.cc:1685] finished
0709 12:13:31.973910 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:31.974098 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17534,"raft.queue_time_us":14167,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":6283,"spinlock_wait_cycles":1469824,"thread_start_us":225977,"threads_started":1,"wal-append.queue_time_us":626581}
I20260709 12:13:31.939761  2654 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:31.984221  2960 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:31.921288  2810 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.015221 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:32.017354 26467 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 12:13:31.953980  2959 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.010017  2905 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:32.016202  2976 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:32.019855  2906 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:31.997136  2927 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:32.025203  2942 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:32.143065 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.962180  2925 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:32.139294 26471 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:13:32.183346 26541 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:32.065157  2525 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.064662  2949 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:32.136382 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:32.137820 26622 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: []
W20260709 12:13:32.097999 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.016021  2980 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:32.047801  2921 consensus_meta.cc:287] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.750s	user 0.017s	sys 0.001s
W20260709 12:13:32.046383  2928 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.018s	user 0.013s	sys 0.004s
I20260709 12:13:32.195531 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:32.083916  2969 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:32.063266  2992 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:32.135937 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:32.205055 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:32.205976 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 309617us
W20260709 12:13:32.138978  2957 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
W20260709 12:13:32.132207  2978 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
W20260709 12:13:32.130864  2972 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:13:32.137055  2968 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
W20260709 12:13:32.131500  2966 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 12:13:32.065457  2512 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:32.132925  2979 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:13:32.240155 26466 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:32.091727  2939 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:32.082031  2893 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:32.183859  2976 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.247670 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:32.111357  2905 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:32.135244  2899 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:32.239136  2932 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.478s	user 0.019s	sys 0.004s
W20260709 12:13:32.238847  2920 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.339s	user 0.018s	sys 0.002s
I20260709 12:13:32.279721 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:32.279819  2870 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:32.284384 26548 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:32.191533  2942 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.184376  2915 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.242238  2980 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:32.355942 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 155513us
I20260709 12:13:32.287321 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:32.289170 26542 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:13:32.287076  2961 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.293238 27168 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:13:32.300137 27167 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:32.323755 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:13:32.293895  2986 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.412s	user 0.000s	sys 0.002s
I20260709 12:13:32.314045  2905 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.190809  2819 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.328830 27163 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:13:32.322460  2976 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.355651 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:32.357229 26614 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 18. (term mismatch)
I20260709 12:13:32.373531 26614 pending_rounds.cc:85] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 17
I20260709 12:13:32.373824 26614 pending_rounds.cc:107] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 27.18
I20260709 12:13:32.374074 26614 raft_consensus.cc:2889] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:32.244117  2921 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.241024  2906 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.384492 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:32.385350 26469 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 32: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:32.361663 26466 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:13:32.255682  2970 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 20, Time since last communication: 0.083s
I20260709 12:13:32.364013 26539 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 22: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:32.230710  2525 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.293124 26543 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:32.365600 26622 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:32.071338  2960 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.365506 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:32.246742  2969 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:32.294703  2742 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:32.370124 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:32.379038 26464 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:32.379415 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4427) took 1367 ms. Trace:
I20260709 12:13:32.397338 26542 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:32.397560 26620 rpcz_store.cc:276] 0709 12:13:31.012289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.012628 (+   339us) service_pool.cc:224] Handling call
0709 12:13:31.013023 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:31.013375 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:31.013402 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:31.013976 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 12:13:31.366756 (+352780us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:31.366831 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:31.366930 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:32.379151 (+1012221us) raft_consensus.cc:1685] finished
0709 12:13:32.379175 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:32.379346 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13985,"raft.queue_time_us":222660,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":33484,"spinlock_wait_cycles":43392,"thread_start_us":352373,"threads_started":1,"wal-append.queue_time_us":516821}
I20260709 12:13:32.379480 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.323940  2945 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:32.382500 26548 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 23: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:32.382768  2980 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:32.334301  2939 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.038s
W20260709 12:13:32.387787 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:32.419873  2967 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 12:13:32.421877 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4428) took 1409 ms. Trace:
I20260709 12:13:32.388466 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:32.423067 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3671) took 1415 ms. Trace:
I20260709 12:13:32.392045 27162 raft_consensus.cc:2410] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 27 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 15.
W20260709 12:13:32.423738  2984 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:13:32.429939  2965 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.430377 26439 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:32.431079  2965 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:32.432219 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.434978  2965 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:32.435214  2741 consensus_meta.cc:287] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.061s	user 0.014s	sys 0.000s
I20260709 12:13:32.435720  2741 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.378818  2961 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:32.378667  2819 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.393112 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:32.394596 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.363569  2942 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.383955  2976 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:32.365382  2915 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:32.332408  2932 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:32.377589  2870 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.403822 26616 raft_consensus.cc:2410] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 27 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 15.
I20260709 12:13:32.411346 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.260264  2992 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.413604 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:32.414127  2987 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.305s	user 0.001s	sys 0.001s
I20260709 12:13:32.414680 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:32.415653  2960 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:32.419322 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:32.422344 26619 rpcz_store.cc:276] 0709 12:13:31.012607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.015316 (+  2709us) service_pool.cc:224] Handling call
0709 12:13:31.015646 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:31.334779 (+319133us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:13:31.334830 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:31.343659 (+  8829us) log.cc:844] Serialized 26 byte log entry
0709 12:13:31.540018 (+196359us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:31.540082 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:31.540185 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:32.421615 (+881430us) raft_consensus.cc:1685] finished
0709 12:13:32.421644 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:32.421807 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26859,"raft.queue_time_us":266983,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":3979,"thread_start_us":396382,"threads_started":2,"wal-append.queue_time_us":411150}
W20260709 12:13:32.449638 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.444782 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:32.423519 26613 rpcz_store.cc:276] 0709 12:13:31.007504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.007745 (+   241us) service_pool.cc:224] Handling call
0709 12:13:31.008217 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:31.008701 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:31.008744 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:31.009439 (+   695us) log.cc:844] Serialized 26 byte log entry
0709 12:13:31.375255 (+365816us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:31.375300 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:31.375373 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:32.422725 (+1047352us) raft_consensus.cc:1685] finished
0709 12:13:32.422838 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:32.423004 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3280,"raft.queue_time_us":203385,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":7885,"thread_start_us":365369,"threads_started":1,"wal-append.queue_time_us":1006169}
I20260709 12:13:32.440429 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:32.438125  2741 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:32.526835 26548 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 22: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:32.505463 26539 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
W20260709 12:13:32.430106  2653 consensus_meta.cc:287] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.000s
I20260709 12:13:32.389371  2822 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:32.535686 26548 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:32.535722  2995 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 12:13:32.527729 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 129114us
I20260709 12:13:32.537631 26548 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:32.526892 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:32.538511 26466 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:32.538914 26472 raft_consensus.cc:2368] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:13:32.539873 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:32.541198 26466 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:32.531459 26542 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:32.541566  2882 raft_consensus.cc:993] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:13:32.397243  2434 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:32.543406 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:32.545384 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3334) took 1588 ms. Trace:
I20260709 12:13:32.533253 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.529194 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.540268  2932 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:32.540403 26588 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:32.452399 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:32.543994 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4426) took 1532 ms. Trace:
I20260709 12:13:32.549422 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:32.550132 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 97851.2us
I20260709 12:13:32.550464 26469 raft_consensus.cc:2376] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29. Re-sending same reply.
I20260709 12:13:32.550066 26615 rpcz_store.cc:276] 0709 12:13:31.011976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.012124 (+   148us) service_pool.cc:224] Handling call
0709 12:13:31.012453 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:31.881546 (+869093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:32.543744 (+662198us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b5400196254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:32.543930 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1898531584}
I20260709 12:13:32.440086  2815 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:32.438702 27165 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:32.545872 26473 rpcz_store.cc:276] 0709 12:13:30.956590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.962741 (+  6151us) service_pool.cc:224] Handling call
0709 12:13:30.963193 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:31.345249 (+382056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:32.545122 (+1199873us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b54001a8454. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:32.545321 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":864492928}
I20260709 12:13:32.447500  2905 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:32.547902 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:32.548806 27161 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:13:32.452654  2899 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.533360 26546 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:32.439965  2525 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:32.441123  2906 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:32.449189  2969 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:32.553952 26619 raft_consensus.cc:2393] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 23: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:32.552697 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:32.555840 26543 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:32.446466  2927 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:32.440847  2654 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:32.445863  2921 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:32.452510  2949 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:32.435006  2981 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.560302 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:32.442490  2959 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:32.410852  2928 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:32.497550  2945 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:32.542230  2882 raft_consensus.cc:1081] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Signalling peer aaadfdd9ca9f424c91505f9b43876233 to start an election
I20260709 12:13:32.561980 26466 raft_consensus.cc:2376] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22. Re-sending same reply.
I20260709 12:13:32.579568 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:32.451259  2810 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:32.572686 26473 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:13:32.586611  2973 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:32.586827 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:32.587327  2973 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:32.587764 26473 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:13:32.588449  3000 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.044s
I20260709 12:13:32.589120 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:32.590504  2949 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:32.591755  2949 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:32.575268 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.589941 26473 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 34.
I20260709 12:13:32.595630 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:32.596431 26473 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
I20260709 12:13:32.597544 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:32.587841  2973 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:32.599037 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:32.602624 26473 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 28.
I20260709 12:13:32.604102 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:32.581318  2899 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.607932 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:32.611569  2899 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:32.614464 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:32.614856  2919 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:32.616084 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:32.618821 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:32.548173  2653 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:32.619215 26466 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:32.620667 26466 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 30 index: 19. Preceding OpId from leader: term: 32 index: 21. (index mismatch)
I20260709 12:13:32.620978  2653 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:32.577566  2925 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:32.621903  2945 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:32.446310  2809 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:32.624352  2945 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:32.624768  2809 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:32.624845  2888 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:32.628226  2942 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:32.629141 26469 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:32.630535 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1392) took 1269 ms. Trace:
I20260709 12:13:32.630957 26544 rpcz_store.cc:276] 0709 12:13:31.361437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.361608 (+   171us) service_pool.cc:224] Handling call
0709 12:13:31.362166 (+   558us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:31.363656 (+  1490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:31.363685 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:31.374151 (+ 10466us) log.cc:844] Serialized 26 byte log entry
0709 12:13:31.596678 (+222527us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:31.596743 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:31.596850 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:32.630269 (+1033419us) raft_consensus.cc:1685] finished
0709 12:13:32.630292 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:32.630470 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4021,"raft.queue_time_us":1139,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":13377,"thread_start_us":125930,"threads_started":1,"wal-append.queue_time_us":459946}
I20260709 12:13:32.632630  2915 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:32.582182  2981 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:32.530738  2870 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.614286  2928 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.634130  2942 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.635114  2870 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:32.634850  2942 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.637627  2992 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:32.577915  2970 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:32.638377  2928 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:32.638568  2970 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.638972  2970 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:32.640151  2981 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:32.641367 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:32.642901  2996 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.643729  2983 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.643525  2996 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:32.644308  2983 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:32.642239  2919 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:32.648078 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 4432) took 1115 ms. Trace:
I20260709 12:13:32.648680 26615 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:32.647348  2919 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.650048  2961 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:32.650887 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.621876 26466 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:32.651813  2919 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:32.652091 26466 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:32.646106  2996 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:32.653053  2819 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:32.653016 26466 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.19, Last appended by leader: 19, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.659065 26466 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:32.660342 26469 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 29 index: 22. Preceding OpId from leader: term: 30 index: 22. (term mismatch)
I20260709 12:13:32.660804 26469 pending_rounds.cc:85] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 21
I20260709 12:13:32.661054 26469 pending_rounds.cc:107] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 29.22
I20260709 12:13:32.661131 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:32.662288 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:32.662673 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:32.662999  2992 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:32.663465  2992 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.663905  2992 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:32.648548 26616 rpcz_store.cc:276] 0709 12:13:31.532725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.533753 (+  1028us) service_pool.cc:224] Handling call
0709 12:13:32.647838 (+1114085us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b5400267854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:32.648004 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1986749184}
I20260709 12:13:32.667524 26613 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:13:32.657853  2941 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:32.668411 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.668619  2514 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:32.668812  2941 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:32.650224  2812 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:32.611132  2999 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.169s	user 0.001s	sys 0.002s
I20260709 12:13:32.669831  2941 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:32.671030  2941 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:32.671315 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.672207 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:32.667447 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.673048 26620 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:32.673625  2870 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:13:32.674072  2870 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:32.674458  2870 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:13:32.674314 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:32.675034  2742 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:32.675151 26622 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:32.675496  2742 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.676039  2742 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:32.677839 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:32.678704  2525 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:32.679112  2525 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.679443  2525 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:32.657042 26467 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 12:13:32.680209 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4416) took 2033 ms. Trace:
I20260709 12:13:32.680648 26614 rpcz_store.cc:276] 0709 12:13:30.647233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.647452 (+   219us) service_pool.cc:224] Handling call
0709 12:13:30.656221 (+  8769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:32.374586 (+1718365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:32.679940 (+305354us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b540037b254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:32.680147 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3907464576}
I20260709 12:13:32.661330 26469 raft_consensus.cc:2889] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:32.685511 26469 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:13:32.686048 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.686833 26615 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 18.
I20260709 12:13:32.686916 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:32.669886 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.680290 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.691262 27165 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:32.697337 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.698189 26616 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:32.694123 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:32.700551 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:32.705554 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 29 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.706779 26622 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
W20260709 12:13:32.708132 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 307595us
I20260709 12:13:32.709173 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.716665 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.716857 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:32.736826 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.741349 26618 raft_consensus.cc:2410] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 28 because replica has last-logged OpId of term: 26 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 13.
I20260709 12:13:32.743562 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.744261 26619 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 18.
I20260709 12:13:32.747655 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:32.749115 26466 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 28 index: 19. (term mismatch)
I20260709 12:13:32.749609 26466 pending_rounds.cc:85] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 18
I20260709 12:13:32.749890 26466 pending_rounds.cc:107] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 27.19
I20260709 12:13:32.750332 26466 raft_consensus.cc:2889] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:32.753830 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:32.754700 26621 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:32.755864 26614 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:32.757936 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:32.743611 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.760283 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.761456 26615 raft_consensus.cc:2410] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 26 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 12:13:32.792841 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:32.793720 27167 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 17.
I20260709 12:13:32.776497 26438 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:32.700695  2899 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:13:32.714433  2942 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:32.738027  2813 raft_consensus.cc:3055] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:32.737694  2983 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:32.646126  2973 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.717298  2741 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.755062  2819 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.815403 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:32.793002  2919 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:32.820863 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 44489.8us
I20260709 12:13:32.842461 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:32.845881 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:13:32.848278 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.773672 26613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:54660
I20260709 12:13:32.850004 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:32.850273 26613 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:32.850872 26613 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:32.806454  2822 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.806285  2952 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election won for term 28
W20260709 12:13:32.855470 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 467073us
I20260709 12:13:32.806705  2813 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:32.819890  2925 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:13:32.804483  3003 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:32.862812 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:32.867213 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 189265us
I20260709 12:13:32.867846 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:32.870244 27167 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
W20260709 12:13:32.869333 26513 connection.cc:256] RPC call timeout handler was delayed by -1.0571214700000837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2916s for a response
W20260709 12:13:32.871268 26513 connection.cc:256] RPC call timeout handler was delayed by -1.00791431499988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2061s for a response
I20260709 12:13:32.844666  2983 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.854458  2760 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:32.818014  2373 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.045s
I20260709 12:13:32.884491 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:32.853492  2932 raft_consensus.cc:2764] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:13:32.885329 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:32.888959 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:32.859390  2812 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:32.820742  2741 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.892875 26464 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 28.
I20260709 12:13:32.899122 26614 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 18: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:32.896575 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:32.873716  2949 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:32.912091 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:32.873529  2952 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:32.911568 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:32.903657  2929 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:32.891170  2920 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:32.859942  2822 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:32.925240 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:32.926021 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:32.916682 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:32.931921 26545 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:13:32.933079 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:32.934106 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 128347us
W20260709 12:13:32.914330 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.871634  2919 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.031s
I20260709 12:13:32.928712 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:32.928814 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:32.930665 27162 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:32.863214  2819 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:32.926636 26547 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:13:32.936043 26544 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:13:32.929391  2760 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:32.932821 26613 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.937290 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:32.874591  2514 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.051s
W20260709 12:13:32.938829 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 84347.1us
I20260709 12:13:32.930964  2929 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.940827 26468 raft_consensus.cc:2410] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 29 because replica has last-logged OpId of term: 28 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 17.
I20260709 12:13:32.941355 27161 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 17.
I20260709 12:13:32.894557  2928 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.043s
I20260709 12:13:32.941936 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 29 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:32.876709  3003 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:32.946413 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.889822  2983 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.913405  2905 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:32.964309 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:32.965291 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:32.965945 26545 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:32.968953 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:32.929702  2920 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.943286  2760 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.907095  2970 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:32.952666 27168 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:13:32.954435 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:32.955286 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:32.983520 26544 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 28: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:32.955979 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:32.962038  2899 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:32.959966 26547 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:13:32.961242 26613 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:32.963084 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:32.965024 26546 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:13:32.903735  2812 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:32.990312 26542 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 26: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:32.966058  2961 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:32.991466 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:32.974884 26545 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 26: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:32.993129 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:32.948333  2929 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:32.976516  2920 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:32.913574  2949 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:32.964607  3004 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:13:32.963920 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:32.958911 26543 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:32.962654  2906 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.010877 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:32.987933 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:33.012008 27168 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:32.978940 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:33.010823 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 75318.2us
I20260709 12:13:32.997083 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:32.996973 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:32.986236  3007 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:13:32.979246  2760 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:32.947814  2992 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:32.989384  3009 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:13:32.965054  2876 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.029s
I20260709 12:13:33.011941 26542 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:13:32.984539 26618 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 28.
I20260709 12:13:33.013659 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:32.936946  2813 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:32.987041  2899 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:33.023711 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:32.998667  2373 consensus_queue.cc:1243] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 27.19 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 18
I20260709 12:13:33.047297 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:33.048568 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:33.049335 26542 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
I20260709 12:13:33.025444 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:33.051352 26541 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:32.995834  2812 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:33.036458 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:32.996152  2961 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:33.038141 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:33.055375 26619 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
I20260709 12:13:32.999580  2926 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:32.983865  2971 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 12:13:33.058210 27163 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:33.020453  2888 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:33.026875  2448 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:33.002074  2919 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:33.024062 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:33.081655 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:33.039709 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:32.984109  3016 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 12:13:33.058709 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:33.084441 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:33.085654 26545 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:13:33.085049 26542 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:33.041985  2973 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:33.082494 26543 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:13:33.082494 26547 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:13:33.043650  3015 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 12:13:33.058094  2926 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:33.022111  2906 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:33.062106  2961 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:33.092757 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:33.073710  2971 consensus_queue.cc:1243] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 23.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:13:33.071427  2373 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:33.001940  2952 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:33.049671  2514 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:13:33.098412 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:33.110481 26541 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:13:33.105468 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:33.094767  2926 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:33.075990  2928 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.025s
I20260709 12:13:33.085685  3022 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:33.092098  2448 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:33.095566  2888 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.034s
I20260709 12:13:33.130203 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:33.160684 27166 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
I20260709 12:13:33.143328 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:33.114286  2653 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:33.086510  2434 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.032s
I20260709 12:13:33.101171  2373 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.137339  2435 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:33.080015  2864 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.025s
W20260709 12:13:33.152486 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 69036.5us
I20260709 12:13:33.173146 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:33.173972 26588 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:33.103530  2973 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
W20260709 12:13:33.171111  3012 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 12:13:33.114653  2810 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.062s
I20260709 12:13:33.182948 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:33.103161  2899 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:33.185115 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:33.182621  2819 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:33.192873  3019 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:13:33.195116 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:33.196691 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:33.199218  3020 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 12:13:33.200487  3017 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:13:33.186838  2876 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:33.202530 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:33.203025  2876 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:33.203544  2876 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:33.161916  2925 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.023s
I20260709 12:13:33.206679  2864 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:33.207228  2864 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.207620  2864 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:33.176926  2373 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:33.210691  2448 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:33.213160  2941 consensus_meta.cc:287] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.003s
I20260709 12:13:33.177629  2888 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:33.215415  3016 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:33.215947  3016 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.216315  3016 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:33.218676  2925 consensus_queue.cc:1243] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 21.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 12:13:33.219314  2925 raft_consensus.cc:3055] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:33.219659  2925 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:33.220520  2925 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:33.221843  2925 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:33.175221  2741 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:33.222975  3028 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.223593  3028 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:33.225986  3028 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:33.217753  2926 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:33.175354  2653 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:33.189095 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:33.146505  2809 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.038s
I20260709 12:13:33.186688  3021 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:33.175643  2435 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.230582 26466 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 18: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:33.218050  2983 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:33.198254 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:33.232268 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 51904.9us
I20260709 12:13:33.232527 26467 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:33.233146 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:33.187702 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:33.217656  2870 consensus_meta.cc:287] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.543s	user 0.003s	sys 0.007s
W20260709 12:13:33.229218  2742 consensus_meta.cc:287] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.000s
I20260709 12:13:33.226462  2961 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:33.240432 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:33.243153  3027 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:33.228536  3003 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:33.244324  2992 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:33.244906  2949 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:33.179272 27168 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:33.232805  2941 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:33.245990  2899 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:33.232365  3021 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.233043  2435 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:33.291622 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:33.292672  3026 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:33.293264  2760 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:33.293882  2876 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:33.296975  2760 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:33.297513  2876 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:33.269305 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:33.280025 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:33.282811  2980 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:33.299042  2980 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:33.299429  2980 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.299711 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:33.301224  2925 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:33.302053  2925 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:13:33.302464  2888 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:33.302994  2973 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:33.303391  2973 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:33.304303  2973 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.19, Last appended by leader: 19, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:33.305838  2973 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:33.267795 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 139722us
I20260709 12:13:33.282884 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:33.326884 26467 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:33.255376  2742 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:33.284847 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 4479) took 1150 ms. Trace:
I20260709 12:13:33.284987  2926 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:33.278849  3027 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:33.283618  2525 consensus_meta.cc:287] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.604s	user 0.009s	sys 0.004s
I20260709 12:13:33.298193 26547 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:33.666620 26547 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:33.338140 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 164226us
W20260709 12:13:33.281810 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 183577us
I20260709 12:13:33.668691 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:33.669406 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:33.372059 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:33.568771 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 232553us
I20260709 12:13:33.290809  3021 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:33.299772  2980 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:33.545974 26472 rpcz_store.cc:276] 0709 12:13:32.134724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:32.136135 (+  1411us) service_pool.cc:224] Handling call
0709 12:13:33.284601 (+1148466us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54000f41d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:33.284779 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":767818624}
I20260709 12:13:33.672420 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:33.673362 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:33.673996 26472 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:33.637414 26619 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:33.669441 26467 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:33.637131 26616 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
W20260709 12:13:33.675459 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:33.676134 26439 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:33.251076  2870 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:33.289794  2941 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:33.644254 27164 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 23: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:33.326961 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:33.685459 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 358576us
I20260709 12:13:33.686249 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:33.677421 26513 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:13:33.679077  2963 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 1.530s	user 0.001s	sys 0.006s
I20260709 12:13:33.679172  2888 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:33.680042  2876 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:33.680066  2949 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:33.680534  2742 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:33.697269 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:33.682874 26547 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:33.710119 26547 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:33.710286 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:33.710528 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:33.711608 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:33.706647 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:33.712819 26616 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:33.708482 26588 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:33.700734 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:33.681912  2925 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:33.727967 27159 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 35: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:33.667830  3027 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:33.730439 26439 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:33.696834  2941 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:33.742902 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:33.745682 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:33.747303 26616 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:13:33.748446 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:33.704936  2949 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.696035  2926 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 12:13:33.749147 26467 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:13:33.748446 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:33.669797  2373 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:33.712175  2653 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:33.712138  2983 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:33.736827  2434 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:33.705145  2809 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:33.748029  2925 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:33.744216  2928 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:33.819559  2928 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.820147  2928 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:33.723467 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:33.823230 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 99879.8us
W20260709 12:13:33.823741  2920 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.814s	user 0.010s	sys 0.002s
I20260709 12:13:33.824110 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:33.824458  2893 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:33.825095  2876 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:33.825652  2876 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:33.672381  2525 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:33.773337  2983 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:33.826936  3024 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.738s	user 0.003s	sys 0.000s
I20260709 12:13:33.826663  2876 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:33.828372  2525 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:33.828619  2983 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:33.790428  3016 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.005s
I20260709 12:13:33.829257  3016 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:33.824244  2920 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:33.831434  3016 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:33.749787  2888 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:33.751583  2949 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:33.779654  2809 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.771272 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:33.790369  2962 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:33.793202  3008 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:33.793761  3018 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.087s
W20260709 12:13:33.802932 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:33.856503 26472 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
W20260709 12:13:33.839306  3039 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:13:33.791947 27167 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:33.791657 27165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 1132) took 1469 ms. Trace:
W20260709 12:13:33.791131  2991 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.352s	user 0.002s	sys 0.001s
I20260709 12:13:33.834540 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:33.772034  2448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.028s	sys 0.060s
I20260709 12:13:33.876813 27165 rpcz_store.cc:276] 0709 12:13:32.322685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:32.323498 (+   813us) service_pool.cc:224] Handling call
0709 12:13:33.787802 (+1464304us) spinlock_profiling.cc:243] Waited 72.2 ms on lock 0x7b54003b5e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:33.791548 (+  3746us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165984000}
W20260709 12:13:33.852983  2864 consensus_meta.cc:287] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.645s	user 0.012s	sys 0.001s
I20260709 12:13:33.835966  2920 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:33.824124  2925 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:33.837877  2980 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:33.839221  2955 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:33.841387 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:33.894683  3033 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election won for term 29
W20260709 12:13:33.841936  2812 consensus_meta.cc:287] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.758s	user 0.010s	sys 0.002s
I20260709 12:13:33.794031  2870 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:33.851121 26547 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
W20260709 12:13:33.886318  2899 consensus_meta.cc:287] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.003s
I20260709 12:13:33.855808 26467 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 30: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:33.771728  2434 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.911381  2434 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:33.776369  2653 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:33.914788  2653 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:33.838385  2929 consensus_meta.cc:287] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.839s	user 0.007s	sys 0.005s
I20260709 12:13:33.865374  2962 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:33.851114  2809 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:33.848058  2888 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.875219 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:33.833724  2919 raft_consensus.cc:3055] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:33.826152 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:33.965070 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 138999us
I20260709 12:13:33.895421  3033 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:33.770150  3034 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:33.898974  2812 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:33.896536  2864 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:33.909614  2994 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 1.470s	user 0.012s	sys 0.000s
I20260709 12:13:33.941265  2961 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:33.941435  2929 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:33.941205  2949 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:33.896713  2435 consensus_meta.cc:287] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.589s	user 0.017s	sys 0.004s
I20260709 12:13:33.964325  2888 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:33.963346 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:33.964927 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:33.965899 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:33.887470 26620 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:33.982307 26467 raft_consensus.cc:2410] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 29 because replica has last-logged OpId of term: 27 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 16.
W20260709 12:13:33.966001 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 257627us
W20260709 12:13:33.878832  2448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.031s	sys 0.060s
I20260709 12:13:33.914084  3021 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:33.969127  2991 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:13:33.994266 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:33.995275 26472 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:33.971184  3033 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:33.989358 26620 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:33.964354  2919 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:33.991489 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:34.005223 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:33.991963 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 3366) took 1001 ms. Trace:
I20260709 12:13:34.006350 26467 rpcz_store.cc:276] 0709 12:13:32.994943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.911130 (+916187us) service_pool.cc:224] Handling call
0709 12:13:33.991874 (+ 80744us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:33.970082  3008 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:33.970467  3034 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:34.009159 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:33.909806  2941 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:33.991474 26613 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:33.994879  3018 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:34.015328 26513 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:33.988577  3027 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:34.027712 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 316145us
I20260709 12:13:34.009832  2373 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:34.025646 26472 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
I20260709 12:13:34.023844 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4475) took 1939 ms. Trace:
I20260709 12:13:34.007123  2893 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:33.991581  2435 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:34.000452  2899 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:13:34.015661  2819 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:34.041791 26470 rpcz_store.cc:276] 0709 12:13:32.084034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:32.112646 (+ 28612us) service_pool.cc:224] Handling call
0709 12:13:32.205960 (+ 93314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:32.206179 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:13:32.325219 (+119040us) log.cc:844] Serialized 14 byte log entry
0709 12:13:32.592823 (+267604us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b180004b0a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:13:33.781589 (+1188766us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b180004b0a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5072fefa40 00007f5072fea4e4 00007f5072fea455 00007f5079ad23c7 00007f50760e49a7 00007f50760f40bf 00007f50760f4038
0709 12:13:33.793197 (+ 11608us) log.cc:844] Serialized 14 byte log entry
0709 12:13:34.023447 (+230250us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:34.023515 (+    68us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:34.023570 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:34.023653 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:34.023781 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1218832,"prepare.queue_time_us":1598187,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":97,"raft.queue_time_us":2663,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":14154,"spinlock_wait_cycles":68811392,"thread_start_us":373598,"threads_started":3,"wal-append.queue_time_us":213033,"wal-append.run_cpu_time_us":12346,"wal-append.run_wall_time_us":1102940}
I20260709 12:13:34.011850  3034 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:34.049748 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3500) took 2986 ms. Trace:
I20260709 12:13:34.050843 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:34.050194 26540 rpcz_store.cc:276] 0709 12:13:31.063211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.063334 (+   123us) service_pool.cc:224] Handling call
0709 12:13:31.063749 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:31.064186 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:13:31.467361 (+403175us) log.cc:844] Serialized 14 byte log entry
0709 12:13:31.945434 (+478073us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:31.972703 (+ 27269us) log.cc:844] Serialized 26 byte log entry
0709 12:13:31.972915 (+   212us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:31.972965 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:31.973058 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:33.783395 (+1810337us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:34.043677 (+260282us) raft_consensus.cc:1685] finished
0709 12:13:34.049544 (+  5867us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:34.049688 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1974,"prepare.queue_time_us":292292,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":1444,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":10893,"spinlock_wait_cycles":26548992,"thread_start_us":843803,"threads_started":2,"wal-append.queue_time_us":888118}
I20260709 12:13:34.030050 26513 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:34.026361 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:34.020808  3030 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:34.030925  3008 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 12:13:33.976462  2653 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:34.043874 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:34.058665 26472 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:34.038380 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:34.024495  2945 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:34.054406 26467 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 24: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:34.031387  3018 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:34.065285 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:34.146199 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.148509 26547 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:13:34.148528 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:34.149361 26540 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:34.068415 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:13:34.154320 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 86025.5us
I20260709 12:13:34.031644  2876 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.033s
I20260709 12:13:34.164217 26472 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 29.
I20260709 12:13:34.164194 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:34.038133  3028 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 12:13:34.156276 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:34.011593  2962 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:34.055848  3030 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:34.193037 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:34.146656  3040 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 12:13:34.171370 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:34.167759 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3350) took 1658 ms. Trace:
I20260709 12:13:34.174612 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4483) took 2038 ms. Trace:
I20260709 12:13:34.228974 26540 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:34.065886  2373 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.237296 27163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 1136) took 1520 ms. Trace:
I20260709 12:13:34.075445  2448 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:34.075666  2969 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:34.238631 27163 rpcz_store.cc:276] 0709 12:13:32.716401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:32.716574 (+   173us) service_pool.cc:224] Handling call
0709 12:13:34.237035 (+1520461us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54006cfcd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:34.237193 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":718980352}
I20260709 12:13:34.245527 27163 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: [28.18-28.18]
I20260709 12:13:34.160647  3008 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:34.246286 27163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1353) took 1197 ms. Trace:
W20260709 12:13:34.247146 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.043834  2919 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:34.246713 27163 rpcz_store.cc:276] 0709 12:13:33.048682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.244884 (+1196202us) service_pool.cc:224] Handling call
0709 12:13:34.245273 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:34.245989 (+   716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:34.246211 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:34.232234  3012 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:13:34.159287  2920 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:34.165783  2980 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:34.173950  2951 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:34.387672  2932 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:34.388186  2932 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:34.226490 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4429) took 3160 ms. Trace:
I20260709 12:13:34.389091  2932 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:34.211795 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:34.254266 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:34.393164 26472 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 23: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:34.235447  3030 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:34.336804  3040 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:13:34.216948  2899 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:34.282147 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:34.295373  2929 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:34.389780 26617 rpcz_store.cc:276] 0709 12:13:31.012903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.013763 (+   860us) service_pool.cc:224] Handling call
0709 12:13:31.014143 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:31.362569 (+348426us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:13:31.542937 (+180368us) log.cc:844] Serialized 14 byte log entry
0709 12:13:31.963648 (+420711us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:31.964315 (+   667us) log.cc:844] Serialized 26 byte log entry
0709 12:13:31.964507 (+   192us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:31.964555 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:31.964660 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:33.908942 (+1944282us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:34.152012 (+243070us) raft_consensus.cc:1685] finished
0709 12:13:34.173364 (+ 21352us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:34.173524 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46762,"prepare.queue_time_us":699975,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":237580,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":29595,"spinlock_wait_cycles":33162624,"thread_start_us":575867,"threads_started":3,"wal-append.queue_time_us":790138}
I20260709 12:13:34.373512  2435 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:34.249886  3008 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:34.374159 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 217962us
I20260709 12:13:34.332208  2949 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:34.375370 26545 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:13:34.246925  2373 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:34.233533 26469 rpcz_store.cc:276] 0709 12:13:32.509679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:32.696650 (+186971us) service_pool.cc:224] Handling call
0709 12:13:32.697122 (+   472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:32.697393 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:13:34.044373 (+1346980us) log.cc:844] Serialized 14 byte log entry
0709 12:13:34.167372 (+122999us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:34.167432 (+    60us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:34.167480 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:34.167555 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:34.167694 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1195897,"prepare.queue_time_us":1188065,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":19963,"raft.queue_time_us":95946,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":51603,"thread_start_us":229288,"threads_started":2}
I20260709 12:13:34.376798 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:34.440230 26544 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:34.440642 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:34.441607 26469 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:13:34.443495 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:34.377583  3027 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:34.379478 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:34.246692  2969 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:34.248857  2988 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:34.453897  2969 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:34.422684  2434 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:34.455687  2988 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:34.452263  2920 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.005s
I20260709 12:13:34.456751  2988 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:34.458130  2988 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:34.449378 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:34.371872 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 341896us
I20260709 12:13:34.235574 26473 rpcz_store.cc:276] 0709 12:13:32.135976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:32.619803 (+483827us) service_pool.cc:224] Handling call
0709 12:13:32.620183 (+   380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:32.625425 (+  5242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:32.625463 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:32.626197 (+   734us) log.cc:844] Serialized 52 byte log entry
0709 12:13:32.861587 (+235390us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:34.048822 (+1187235us) log.cc:844] Serialized 14 byte log entry
0709 12:13:34.144806 (+ 95984us) log.cc:844] Serialized 14 byte log entry
0709 12:13:34.174140 (+ 29334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:34.174289 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:34.174363 (+    74us) raft_consensus.cc:1685] finished
0709 12:13:34.174380 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:34.174549 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1015537,"prepare.queue_time_us":1116072,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":106,"raft.queue_time_us":77397,"raft.run_cpu_time_us":403,"raft.run_wall_time_us":105032,"thread_start_us":426005,"threads_started":2,"wal-append.queue_time_us":279753}
I20260709 12:13:34.462616  2435 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:34.463402 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:34.464331 26473 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:34.465034  2434 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:34.465512 26473 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:34.371541  3021 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:34.382638 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.466220 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3353) took 1514 ms. Trace:
I20260709 12:13:34.467433 26473 rpcz_store.cc:276] 0709 12:13:32.951575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.464976 (+1513401us) service_pool.cc:224] Handling call
0709 12:13:34.465304 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:34.465973 (+   669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:34.466163 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:34.371677  2919 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:34.394227  2720 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election won for term 28
W20260709 12:13:34.377759  2928 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.004s
I20260709 12:13:34.407681 26540 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 26: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:34.294337  2819 raft_consensus.cc:697] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:34.250778  2448 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:34.426162  3008 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:34.418816 26468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 4461) took 2622 ms (client timeout 2052 ms). Trace:
W20260709 12:13:34.403702  3052 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.161s	user 0.003s	sys 0.000s
W20260709 12:13:34.403033  3045 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.237s	user 0.001s	sys 0.001s
W20260709 12:13:34.408874  3054 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.110s	user 0.003s	sys 0.000s
I20260709 12:13:34.445125 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:34.447528 26546 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:34.376065 27163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 1138) took 1321 ms. Trace:
W20260709 12:13:34.449851 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.463443  2435 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:34.449702  3062 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:34.468318 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:34.462127 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:34.525298 26545 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:34.525807 26464 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:34.468998 26548 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:13:34.494827 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:34.526932 26467 raft_consensus.cc:2410] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 29 because replica has last-logged OpId of term: 28 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 17.
I20260709 12:13:34.500835 26513 leader_election.cc:400] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:13:34.527390 26513 leader_election.cc:403] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260709 12:13:34.505195  3027 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:34.508051 26468 rpcz_store.cc:269] 0709 12:13:31.780189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.780307 (+   118us) service_pool.cc:224] Handling call
0709 12:13:34.391838 (+2611531us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003d0c54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:34.402534 (+ 10696us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2434284928}
I20260709 12:13:34.509876 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3355) took 1548 ms. Trace:
I20260709 12:13:34.422196  2899 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:34.529973  3027 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:34.512466 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.448999  2879 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:34.521414  2888 consensus_meta.cc:287] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.005s
I20260709 12:13:34.535388 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:34.535670  2888 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:34.536760 26469 raft_consensus.cc:2368] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25.
I20260709 12:13:34.537159  2876 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:34.519112 27163 rpcz_store.cc:276] 0709 12:13:33.055021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.375027 (+1320006us) service_pool.cc:224] Handling call
0709 12:13:34.375382 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:34.375657 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:34.375689 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:34.375736 (+    47us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:34.375781 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:34.375851 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:34.375993 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:34.521512 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 3367) took 1526 ms. Trace:
I20260709 12:13:34.543646 26472 rpcz_store.cc:276] 0709 12:13:32.995399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.409637 (+1414238us) service_pool.cc:224] Handling call
0709 12:13:34.521443 (+111806us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:34.507269  2434 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:34.546265  2434 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:34.547115  2876 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:13:34.548916  2434 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:34.371153  2864 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:34.528357 26473 rpcz_store.cc:276] 0709 12:13:32.961108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.468396 (+1507288us) service_pool.cc:224] Handling call
0709 12:13:34.509124 (+ 40728us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:34.509377 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:34.509419 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:34.509483 (+    64us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:34.509532 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:34.509608 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:34.509779 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:34.550971 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3358) took 1582 ms. Trace:
I20260709 12:13:34.551371 26473 rpcz_store.cc:276] 0709 12:13:32.968127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.550022 (+1581895us) service_pool.cc:224] Handling call
0709 12:13:34.550346 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:34.550596 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:34.550623 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:34.550681 (+    58us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:13:34.550713 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:34.550798 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:34.550910 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:34.552848 26473 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:34.553457 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3364) took 1575 ms. Trace:
I20260709 12:13:34.553768 26473 rpcz_store.cc:276] 0709 12:13:32.978100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.552343 (+1574243us) service_pool.cc:224] Handling call
0709 12:13:34.552674 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:34.553217 (+   543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:34.553391 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:34.435384  2932 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:34.555404  2905 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:34.556138  2905 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:34.495602  2941 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:34.536645 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:34.561251  3036 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.725s	user 0.001s	sys 0.000s
I20260709 12:13:34.533783  3034 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:34.562584 26613 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:34.562686  3063 raft_consensus.cc:2764] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election decision vote started in defunct term 27: won
I20260709 12:13:34.563601  2812 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:34.566275  3034 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:34.518522 26544 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
W20260709 12:13:34.568089 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.568466  2813 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:34.569519 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:34.571149  3062 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:34.571902 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:13:34.513675  3010 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 1.549s	user 0.000s	sys 0.004s
I20260709 12:13:34.573016 26544 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:34.579101 26545 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:13:34.581372 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:34.575594 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:34.582086 26545 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 25
I20260709 12:13:34.582501 26548 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:34.583856 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:34.587369 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3295) took 1351 ms. Trace:
I20260709 12:13:34.587966 26541 rpcz_store.cc:276] 0709 12:13:33.236235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.236365 (+   130us) service_pool.cc:224] Handling call
0709 12:13:33.236715 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:33.237339 (+   624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:33.237401 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:33.242211 (+  4810us) log.cc:844] Serialized 26 byte log entry
0709 12:13:33.312344 (+ 70133us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:33.312391 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:33.312462 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:34.560431 (+1247969us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:34.577689 (+ 17258us) raft_consensus.cc:1685] finished
0709 12:13:34.577722 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:34.587276 (+  9554us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":328,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":4895,"spinlock_wait_cycles":35406080,"thread_start_us":66668,"threads_started":1,"wal-append.queue_time_us":491750}
I20260709 12:13:34.586660  2882 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:34.592633  2882 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:34.587158 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:34.595870 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:34.596758  2864 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:34.597016  3048 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:34.597396  2864 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:34.598310  2864 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:34.599261  3048 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:34.599817  3048 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:34.600673  3048 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 27.14, Last appended by leader: 14, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:34.594075  2448 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:34.602924  2819 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:34.598681 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:34.584685 26548 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
I20260709 12:13:34.501359  3015 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.079s
W20260709 12:13:34.609846 26439 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.68:35069 timed out after 2.038s (SENT) [suppressed 8 similar messages]
I20260709 12:13:34.610374 26473 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:13:34.612749 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:34.523324  2720 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:34.614373 26540 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:34.616477 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3368) took 1487 ms. Trace:
I20260709 12:13:34.619094 26473 rpcz_store.cc:276] 0709 12:13:33.129118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.583339 (+1454221us) service_pool.cc:224] Handling call
0709 12:13:34.583719 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:34.614787 (+ 31068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:34.616405 (+  1618us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:34.621677 26545 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:34.513742  2920 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.101s
I20260709 12:13:34.507586  2928 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:34.629746 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:34.633078 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:34.633729 26473 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 28 index: 17. (term mismatch)
I20260709 12:13:34.660724 26473 pending_rounds.cc:85] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 16
I20260709 12:13:34.661002 26473 pending_rounds.cc:107] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 27.17
I20260709 12:13:34.661244 26473 raft_consensus.cc:2889] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:34.661302 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:34.662031 26548 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:34.663704 26540 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:13:34.667227  2928 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:34.670372 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4466) took 2812 ms. Trace:
I20260709 12:13:34.670886 26548 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:34.672281 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:34.670941 26465 rpcz_store.cc:276] 0709 12:13:31.858129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.909558 (+ 51429us) service_pool.cc:224] Handling call
0709 12:13:31.909956 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:31.931980 (+ 22024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:31.932012 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:31.959957 (+ 27945us) log.cc:844] Serialized 26 byte log entry
0709 12:13:34.245478 (+2285521us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b18002be460. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:13:34.395675 (+150197us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:34.446658 (+ 50983us) log.cc:844] Serialized 14 byte log entry
0709 12:13:34.446938 (+   280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:34.447040 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:34.669998 (+222958us) raft_consensus.cc:1685] finished
0709 12:13:34.670119 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:34.670280 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69177,"prepare.queue_time_us":52562,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":64471,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":23067,"spinlock_wait_cycles":40410624,"thread_start_us":149495,"threads_started":1,"wal-append.queue_time_us":2629904}
I20260709 12:13:34.674044 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:34.677348 26545 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:34.641985 26544 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
W20260709 12:13:34.628108  2760 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.045s	sys 0.073s
I20260709 12:13:34.643036 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:34.692628 26541 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:34.643603  3011 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 1.628s	user 0.016s	sys 0.024s
I20260709 12:13:34.644508 26546 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
W20260709 12:13:34.653294 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.614327  2812 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:13:34.694801 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.705392  2927 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:34.705905  2927 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:34.702802  2812 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:13:34.692198  2760 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.045s	sys 0.073s
I20260709 12:13:34.706971  2927 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 29.15, Last appended by leader: 15, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:34.708130  2927 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:13:34.711090  3060 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:13:34.713212 26545 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:34.714192 26544 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 23. Current term is 24. Ops: []
W20260709 12:13:34.725126 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 115302us
I20260709 12:13:34.660446  2882 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:34.703783  3033 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.695s	user 0.004s	sys 0.010s
I20260709 12:13:34.694176  2915 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:34.755208 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:34.764498 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:34.768951 26513 leader_election.cc:336] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 2.052s (SENT)
I20260709 12:13:34.769641 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:13:34.775315 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:34.801299 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.706964  2812 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:34.879791  2882 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:34.724189  2720 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:34.692021  2435 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.14, Last appended by leader: 14, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:34.928678 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 159784us
I20260709 12:13:34.932296 26541 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
I20260709 12:13:34.816157  3033 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:34.935619  2962 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.025s	sys 0.026s
W20260709 12:13:34.950459  2809 consensus_meta.cc:287] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.979s	user 0.009s	sys 0.006s
I20260709 12:13:34.948668  2988 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:34.963018  3030 consensus_meta.cc:287] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.544s	user 0.012s	sys 0.000s
I20260709 12:13:34.999226  2970 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:35.013887  2815 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Stepping down as leader of term 32
W20260709 12:13:35.018966 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 108901us
I20260709 12:13:34.970783  2809 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:35.020164 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 110336us
I20260709 12:13:34.977983  2988 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:35.030512 26543 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:13:34.980453  3030 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:34.979826  2905 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:35.018602  2815 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:35.041602 26621 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:35.029407  3062 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:35.046792 26547 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:35.048633  2815 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 32.21, Last appended by leader: 21, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:35.050192  2815 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:35.056915  3027 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:35.060307  2906 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:35.067775 26466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 1279) took 2220 ms (client timeout 1937 ms). Trace:
W20260709 12:13:35.068248 26466 rpcz_store.cc:269] 0709 12:13:32.847099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.202215 (+355116us) service_pool.cc:224] Handling call
0709 12:13:35.067548 (+1865333us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b54002dc154. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:35.067696 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62043904}
I20260709 12:13:35.072886 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3694) took 1396 ms. Trace:
I20260709 12:13:35.073443 26620 rpcz_store.cc:276] 0709 12:13:33.676604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.983275 (+306671us) service_pool.cc:224] Handling call
0709 12:13:33.983609 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:34.005114 (+ 21505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.072578 (+1067464us) spinlock_profiling.cc:243] Waited 5.53 ms on lock 0x7b5400194e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:35.072810 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12728576}
I20260709 12:13:35.072767 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:35.079670  3033 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:35.091150  2812 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:35.093735  2812 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:35.095834 26617 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 27. Current term is 28. Ops: []
W20260709 12:13:35.098227  3073 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 12:13:35.100230 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.105283 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:35.105940 26546 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:35.112267  3008 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.001s
I20260709 12:13:35.112730  3008 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:35.113715 26540 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:35.114883  3008 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:35.115440 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.116870  2809 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:35.119594  2888 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:35.120008  2905 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:35.121469 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:35.121760  3030 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:35.125516  2919 consensus_meta.cc:287] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.000s
I20260709 12:13:35.127444  2899 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:35.103327  2373 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:35.129338 27165 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 34. Current term is 35. Ops: []
I20260709 12:13:35.122318 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 3293) took 2034 ms. Trace:
I20260709 12:13:35.130359 26542 rpcz_store.cc:276] 0709 12:13:33.088208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.121149 (+2032941us) service_pool.cc:224] Handling call
0709 12:13:35.122254 (+  1105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:35.141618 26546 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:35.141929 27159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 1141) took 2198 ms. Trace:
I20260709 12:13:35.143198 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:35.142361 27159 rpcz_store.cc:276] 0709 12:13:32.930419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:32.950497 (+ 20078us) service_pool.cc:224] Handling call
0709 12:13:35.128886 (+2178389us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b540071b954. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:35.129055 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633494784}
I20260709 12:13:35.103067  2932 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.144063 26546 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:35.146121 27168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1347) took 2169 ms. Trace:
W20260709 12:13:35.148661 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.152593 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:35.153399 26466 raft_consensus.cc:2368] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33.
I20260709 12:13:35.154469 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:35.155105 26546 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:35.153427 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:35.144253  2888 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.156018 26473 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:35.157315 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:35.157974 26465 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:13:35.158030 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1545) took 1460 ms. Trace:
W20260709 12:13:35.159133 27164 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 1138) took 2268 ms (client timeout 2407 ms). Trace:
I20260709 12:13:35.158665 26613 rpcz_store.cc:276] 0709 12:13:33.697202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.159701 (+462499us) service_pool.cc:224] Handling call
0709 12:13:34.160090 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:34.563022 (+402932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.157671 (+594649us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b540037a854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:35.157943 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925089664}
I20260709 12:13:35.138607  2945 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 12:13:35.162289  2945 raft_consensus.cc:3055] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:13:35.159747 27164 rpcz_store.cc:269] 0709 12:13:32.890771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:32.890932 (+   161us) service_pool.cc:224] Handling call
0709 12:13:35.158940 (+2268008us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400547ed4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:35.159071 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1567964544}
I20260709 12:13:35.142282  2906 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.143548  2969 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:35.165642 26465 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: [29.15-29.15]
I20260709 12:13:35.167328 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:35.162724  2945 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:35.151113  2941 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.179361  2906 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:35.166139  2888 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:35.150759  2932 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:35.199239  2932 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:35.193733 26468 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33. Ops: [31.20-32.21]
W20260709 12:13:35.205610  3071 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 12:13:35.179967  2969 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:35.208225 27167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 1137) took 2325 ms. Trace:
I20260709 12:13:35.208771  2969 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:35.215703 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.208784 27167 rpcz_store.cc:276] 0709 12:13:32.882870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:32.883057 (+   187us) service_pool.cc:224] Handling call
0709 12:13:33.791743 (+908686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:33.878828 (+ 87085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.207915 (+1329087us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54003b5e50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:35.208109 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2088777600}
I20260709 12:13:35.189189  2941 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:35.236341 26618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 1540) took 2369 ms (client timeout 2354 ms). Trace:
W20260709 12:13:35.236805 26618 rpcz_store.cc:269] 0709 12:13:32.862411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:32.862567 (+   156us) service_pool.cc:224] Handling call
0709 12:13:35.231356 (+2368789us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b540037b254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:35.231500 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271970688}
I20260709 12:13:35.243352 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:35.245328 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3356) took 2283 ms. Trace:
I20260709 12:13:35.245808 26472 rpcz_store.cc:276] 0709 12:13:32.961489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.544453 (+1582964us) service_pool.cc:224] Handling call
0709 12:13:34.544824 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:34.545063 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:34.545088 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:34.545616 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 12:13:34.933923 (+388307us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:34.933976 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:34.934084 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:35.205055 (+270971us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:35.236100 (+ 31045us) raft_consensus.cc:1685] finished
0709 12:13:35.236124 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:35.245247 (+  9123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6360960,"thread_start_us":387937,"threads_started":1,"wal-append.queue_time_us":466448}
I20260709 12:13:35.252833  2941 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:35.263686  3038 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 1.427s	user 0.000s	sys 0.007s
I20260709 12:13:35.263859  2941 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.264933  2879 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.264672  2941 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:35.265484  2879 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:35.267761  2879 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:35.269567 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 4500) took 1210 ms. Trace:
I20260709 12:13:35.269964 26469 rpcz_store.cc:276] 0709 12:13:34.058878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.443125 (+384247us) service_pool.cc:224] Handling call
0709 12:13:35.269347 (+826222us) spinlock_profiling.cc:243] Waited 92.4 ms on lock 0x7b54001a8954. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:35.269504 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212410624}
I20260709 12:13:35.271085 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:35.272213 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:35.275869 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.276738 26469 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 19: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:13:35.278656 27162 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 1135) took 2563 ms (client timeout 1579 ms). Trace:
I20260709 12:13:35.279083  2888 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:35.279088 27162 rpcz_store.cc:269] 0709 12:13:32.715720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:32.715911 (+   191us) service_pool.cc:224] Handling call
0709 12:13:35.278465 (+2562554us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b5400221354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:35.278579 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404685568}
I20260709 12:13:35.287532 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:35.286600  2941 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:35.297008 27161 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 1143) took 2351 ms (client timeout 2038 ms). Trace:
I20260709 12:13:35.282305  3070 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 12:13:35.340664  3070 consensus_queue.cc:1243] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 24.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:13:35.341240  3070 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:35.341588  3070 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:35.341985 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:35.351882 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 59521us
I20260709 12:13:35.352151 26465 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:35.308358 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:35.309913 27165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1348) took 2324 ms. Trace:
I20260709 12:13:35.305140 26473 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:35.313246 26618 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:35.314528 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:35.355150 26613 raft_consensus.cc:2368] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 28. Current term is 29.
I20260709 12:13:35.315902 26614 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:35.322722 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 4453) took 1658 ms. Trace:
I20260709 12:13:35.355893 26621 rpcz_store.cc:276] 0709 12:13:33.665471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.841040 (+175569us) service_pool.cc:224] Handling call
0709 12:13:35.322493 (+1481453us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400345b54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:35.322653 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2631103872}
I20260709 12:13:35.325490 26619 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 12:13:35.326265  3028 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:35.327576 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:35.328353 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:35.335355 26513 leader_election.cc:400] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33.
I20260709 12:13:35.337445  2988 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:35.335951 27161 rpcz_store.cc:269] 0709 12:13:32.945803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.296756 (+2350953us) service_pool.cc:211] Skipping call since client already timed out
0709 12:13:35.296914 (+   158us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:13:35.373579 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:35.342785  3070 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:35.353582 27165 rpcz_store.cc:276] 0709 12:13:32.985507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.897645 (+912138us) service_pool.cc:224] Handling call
0709 12:13:35.129065 (+1231420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:35.129835 (+   770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.309625 (+179790us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540071b950. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:35.309831 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2831054720}
I20260709 12:13:35.312960 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:35.386655 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:35.387302 26541 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:35.387779 26621 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:35.355576 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:35.357307 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.359262 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:35.360700 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:35.362599 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:35.393370 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:35.393702 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:35.394151 26465 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:35.394644 26620 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 26: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:35.394801 26540 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:35.393735 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:35.396375 26542 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 29: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:35.364440 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:35.366292 26543 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 12:13:35.384219 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:35.347561  2962 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:35.394026 26548 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:35.374305 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:35.407616 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:35.411430 26539 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:35.407732 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:35.414180 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:35.408932 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:35.410351 26513 leader_election.cc:400] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25.
I20260709 12:13:35.415856 26513 leader_election.cc:403] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:35.417557 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:35.418681 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:35.418788 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:35.420079 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:35.424085 26469 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:35.426159 26539 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:35.412768 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:35.427711 26543 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 29: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:35.427551 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:35.421793 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:35.430338 26548 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: [20.13-22.15]
I20260709 12:13:35.430485 26471 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 29: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:35.431528 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:35.432073 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:35.433578 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:35.433797 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:35.434238 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:35.434504 26465 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:35.435004 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:35.432726 26469 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:35.426944  3062 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25.
I20260709 12:13:35.436928 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:35.437463 26618 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:35.437587 26466 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:35.438163  2960 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:35.438736  2960 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:35.440904  2742 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.441484  2742 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:35.373761  3000 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.061s
I20260709 12:13:35.443027 26621 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:35.443540 26542 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 12:13:35.446161 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:35.438686 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:35.393070  2893 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:35.417455  3008 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:35.461583 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:35.462615 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:35.405965 26546 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:35.455206 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:35.146765 27168 rpcz_store.cc:276] 0709 12:13:32.976839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.292824 (+315985us) service_pool.cc:224] Handling call
0709 12:13:33.293134 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:33.293350 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:13:33.293668 (+   318us) log.cc:844] Serialized 14 byte log entry
0709 12:13:33.713953 (+420285us) log.cc:844] Serialized 14 byte log entry
0709 12:13:33.906023 (+192070us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b18003644e0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:13:35.145483 (+1239460us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b18003644e0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5072fefa40 00007f5072fea4e4 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287 00007f50760f5208
0709 12:13:35.145650 (+   167us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:35.145729 (+    79us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:35.145801 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.145901 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:35.146058 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1403454,"prepare.queue_time_us":4340,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":80,"raft.queue_time_us":1434240,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":16318,"spinlock_wait_cycles":63032320,"thread_start_us":419128,"threads_started":1,"wal-append.queue_time_us":523969}
I20260709 12:13:35.450682 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:35.443563 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:35.429505  2514 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:13:35.460764 27134 connection.cc:256] RPC call timeout handler was delayed by -1.0305659569999079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
I20260709 12:13:35.488508 27134 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:35.488920 26469 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:35.489583 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:35.443704  3070 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:35.465930 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:35.467590 26618 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 12:13:35.465847 27163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1354) took 2394 ms. Trace:
I20260709 12:13:35.468230 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:35.468698 26466 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 26: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:35.493381 26471 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:35.460911 26621 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:13:35.489701 27134 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:35.453394  2995 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:35.494215 27163 rpcz_store.cc:276] 0709 12:13:33.071742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.542858 (+1471116us) service_pool.cc:224] Handling call
0709 12:13:34.543205 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:35.465482 (+922277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:35.465511 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:35.465560 (+    49us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:35.465605 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.465682 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:35.465793 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":916883,"raft.queue_time_us":942222}
I20260709 12:13:35.461277  3034 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:35.492148 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:35.454116 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:35.499346 26465 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:35.495715 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:35.501012 26542 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 26: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:35.490511  2741 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.458184  2893 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:35.509451 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.517931  2920 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:35.507048  2741 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:35.485728  2941 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:13:35.523501  2960 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:35.524442 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:35.583662 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:35.584388 26470 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
W20260709 12:13:35.584650 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 92578.6us
I20260709 12:13:35.585371 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:35.465219  2720 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.060s
I20260709 12:13:35.525610 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:35.527140 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3301) took 1377 ms. Trace:
I20260709 12:13:35.485800  2812 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 34.22, Next index: 23, Last known committed idx: 22, Time since last communication: 0.039s
I20260709 12:13:35.528760 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:35.529179 26471 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
W20260709 12:13:35.590257 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 61574.7us
I20260709 12:13:35.590674 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:35.591323 26471 raft_consensus.cc:2376] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33. Re-sending same reply.
I20260709 12:13:35.529495  2942 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 12:13:35.531085 26358 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 953d8c981a6c459f8b7f3dbbb66fda45 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3262bf0553e543eea76794fc529a9acc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:13:35.535804 27133 connection.cc:256] RPC call timeout handler was delayed by -1.3160345080000297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
I20260709 12:13:35.497494  2962 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:35.543802  2945 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:35.563453 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.569238 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:35.569443 26469 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:13:35.576078  2893 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:35.615451 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:35.616140 26540 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:13:35.620745 26621 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:35.620855 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:35.621927 26620 raft_consensus.cc:2410] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 31 because replica has last-logged OpId of term: 29 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 14.
I20260709 12:13:35.622123 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:35.622560 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:35.622820 26621 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:35.622855 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:35.623286 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:35.623680 26620 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:13:35.624856 26439 leader_election.cc:400] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 28. Current term is 29.
I20260709 12:13:35.625185 26439 leader_election.cc:403] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Cancelling election due to peer responding with higher term
I20260709 12:13:35.626178  2940 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:35.626669 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:35.627015  2940 consensus_queue.cc:1243] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 23.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:13:35.628050 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:35.628871 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:35.629001 27162 raft_consensus.cc:2410] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 25 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 16.
I20260709 12:13:35.633365 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:35.527794  2985 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:35.497594  2525 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:35.581882  2920 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:35.588208 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:35.658946 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:35.588809  2435 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:35.592756 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:35.462776  2870 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:13:35.602113 27133 connection.cc:256] RPC call timeout handler was delayed by -1.3156007929999305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
I20260709 12:13:35.602471 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:35.605454 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: true dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:35.606856 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:35.607153 26542 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:35.671808 27167 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 19
W20260709 12:13:35.602115 26358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 71207.6us
I20260709 12:13:35.608059 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:35.507920  2514 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:35.573194 26546 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:35.613447 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:35.623956 26617 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:35.624239  2988 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:13:35.629881  3095 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:13:35.630594  2876 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:35.630806  2942 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:35.629714  2996 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:35.629838 26618 raft_consensus.cc:2410] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 30 because replica has last-logged OpId of term: 29 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 15.
I20260709 12:13:35.629554 26472 raft_consensus.cc:2376] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23. Re-sending same reply.
I20260709 12:13:35.693127 26472 pending_rounds.cc:85] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 15
I20260709 12:13:35.693521 26472 pending_rounds.cc:107] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260709 12:13:35.693845 26472 raft_consensus.cc:2889] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:35.630621 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:35.695122 26467 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 30: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:13:35.695567 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.634647 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:35.697350 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 62795.4us
I20260709 12:13:35.586182 26547 rpcz_store.cc:276] 0709 12:13:34.150034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.150168 (+   134us) service_pool.cc:224] Handling call
0709 12:13:34.150559 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:35.047639 (+897080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.526841 (+479202us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b540037f5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:35.527066 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2060528384}
I20260709 12:13:35.641158  2822 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:35.641887  2741 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:35.642714  2945 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:35.576763  2995 raft_consensus.cc:697] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:35.579831  3034 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:35.658497 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:35.585371 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:35.573652 26465 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:13:35.724651 26465 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: [29.18-29.18]
I20260709 12:13:35.682715  2373 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:35.610879  3087 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:35.737843  3087 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.738380  3087 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:35.673874  2932 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:35.739625 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:35.740343 26546 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:35.740768  2940 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election lost for term 28. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 28. Current term is 29.
I20260709 12:13:35.676483  2888 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:35.686957  2942 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:35.678829 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:35.680279 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.668310 26439 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:35.681033 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:35.684580 27160 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 28: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:35.683781 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:35.654585  2985 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:35.702112 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.704099 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:13:35.785162 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.785305 27163 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 23: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
W20260709 12:13:35.786176 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 117948us
I20260709 12:13:35.786465 26540 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:35.714057 26467 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 30. Current term is 31. Ops: [30.22-30.22]
I20260709 12:13:35.787606 26544 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:13:35.789659 26466 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:35.718878 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:35.665163  2742 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:35.683355  2525 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:35.726243 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 140964us
I20260709 12:13:35.727988 26465 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: [28.18-28.18]
W20260709 12:13:35.742213  3046 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.348s	user 0.041s	sys 0.098s
I20260709 12:13:35.675549  2925 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:35.658347 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:35.742067 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:35.804056 26469 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 25: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:35.745644 27167 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
W20260709 12:13:35.670727 27133 connection.cc:256] RPC call timeout handler was delayed by -1.3150578429999769s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
W20260709 12:13:35.804615 27133 connection.cc:256] RPC call timeout handler was delayed by -1.2578403689999504s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
W20260709 12:13:35.805081 27133 connection.cc:256] RPC call timeout handler was delayed by -1.0850403689998984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260709 12:13:35.805374 27133 connection.cc:256] RPC call timeout handler was delayed by -1.0844694949998939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260709 12:13:35.805658 27133 connection.cc:256] RPC call timeout handler was delayed by -1.0786749789999703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
I20260709 12:13:35.688582  2435 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:35.688997  2870 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:35.752517  2888 consensus_queue.cc:1243] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 29.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:13:35.727236  2373 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:35.754691 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:13:35.797974  3046 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.408s	user 0.042s	sys 0.098s
I20260709 12:13:35.794848  2985 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:35.786932 26439 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:35.737943  2822 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.798472 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:35.797513 26464 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:13:35.800275 26467 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:13:35.869342 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:35.800776 26542 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:35.797492  2525 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:35.870361 26540 raft_consensus.cc:2410] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 31 because replica has last-logged OpId of term: 29 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 14.
I20260709 12:13:35.755584 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:35.799573 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:35.750833  2819 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:35.727466  2941 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:13:35.874781 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:35.875301 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:35.742656  2927 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:35.815796 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:35.876332 27167 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:35.874569 27163 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:13:35.699479  2876 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:35.820899 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:35.852614  2971 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:35.784279  3030 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.890234 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:35.891245 27167 raft_consensus.cc:2393] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 23: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:35.691083  2996 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:35.861660 27164 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 19: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:35.797025  2988 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:35.893440 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:35.898685 26541 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 29: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:13:35.899210  3094 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
I20260709 12:13:35.898797  2996 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:35.871353 27160 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:13:35.900185  2996 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:35.872392 27168 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:35.817946 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:35.882874  2927 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:35.869994  2514 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:35.806643 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:35.876027 27162 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:35.877473 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:35.880074 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:35.908565  2915 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:35.892071  2941 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.910224  2941 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:35.878638  3090 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:13:35.888170 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:35.876222  2822 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:35.895681  2971 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:35.887212  3034 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:35.893065  2920 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:35.896991  3000 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:35.897740  2988 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:35.916887 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 110466us
I20260709 12:13:35.875455 26540 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:35.918587 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:35.917603  2941 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:35.928360 26547 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:35.882658  2942 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:35.906311  2927 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:35.877055  2819 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 25 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:35.936612 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:35.942704 26473 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:13:35.928671  2742 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:35.947757 27168 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:35.948714 26542 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
W20260709 12:13:35.951916 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 302284us
I20260709 12:13:35.937731  2988 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:35.961933 26467 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:35.960350 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:35.934027  2373 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:35.915506  3030 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:35.951193  3074 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.915s	user 0.003s	sys 0.001s
I20260709 12:13:35.875794  2995 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:35.952458  2882 raft_consensus.cc:2764] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:13:35.968617  2373 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:35.970943 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:35.926285  3087 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:35.970254 26467 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:35.962085  2992 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader election lost for term 35. Reason: could not achieve majority
W20260709 12:13:35.976699 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.952744  2945 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:35.958539  2742 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:35.982254 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:35.989580 26467 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
W20260709 12:13:35.990144 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 203287us
I20260709 12:13:35.954092  3022 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.028s
W20260709 12:13:35.994885 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 182753us
I20260709 12:13:35.934095  2962 raft_consensus.cc:697] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:35.933924  2435 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:36.033846 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 46471.6us
I20260709 12:13:36.035010 27161 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 29: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
W20260709 12:13:36.046967 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48276.9us
I20260709 12:13:35.991287  2942 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:35.994514  2960 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:36.036353 27166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1351) took 3028 ms. Trace:
I20260709 12:13:36.055997 27163 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: [28.18-28.18]
I20260709 12:13:35.995616  2742 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:36.063104 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:36.059363 27166 rpcz_store.cc:276] 0709 12:13:33.008260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.910591 (+902331us) service_pool.cc:224] Handling call
0709 12:13:33.910978 (+   387us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:35.458734 (+1547756us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:35.458769 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:35.468106 (+  9337us) log.cc:844] Serialized 52 byte log entry
0709 12:13:35.801895 (+333789us) raft_consensus.cc:1645] Marking committed up to 21
0709 12:13:36.035784 (+233889us) log.cc:844] Serialized 14 byte log entry
0709 12:13:36.036013 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:36.036094 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:36.036137 (+    43us) raft_consensus.cc:1685] finished
0709 12:13:36.036150 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:36.036292 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1547220,"raft.queue_time_us":1548063,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":25011,"thread_start_us":368336,"threads_started":2,"wal-append.queue_time_us":406819}
W20260709 12:13:36.085024 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 124754us
I20260709 12:13:36.089586 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:36.091038 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:36.091483 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:36.094674 26617 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 29: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:36.089092 27162 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 17.
W20260709 12:13:36.037299 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:36.100533 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 120241us
I20260709 12:13:36.105919  2815 consensus_queue.cc:1059] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:36.107136  3033 raft_consensus.cc:3055] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:36.107589  3033 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:36.108117 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:36.108593  3033 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:36.109180 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 69414.2us
I20260709 12:13:36.110074  3033 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:36.110821 26514 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:36.112409  2815 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:36.115818  2815 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:36.116397  2815 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:36.125803  2654 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:36.131474  3106 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:36.132237  3106 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:36.129616  2941 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:36.137449  3112 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:36.137941  3112 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:36.139029  3112 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:36.143088 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:36.144168 26547 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:36.145573  3106 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:36.145627 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:36.147951 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:36.034339  3062 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 12:13:36.086532  2925 consensus_queue.cc:1243] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 23.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:13:36.156396  2815 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:36.160905  3100 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:13:36.033365  2971 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:36.189673  3070 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.681s	user 0.009s	sys 0.003s
I20260709 12:13:36.171780  2870 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:36.216632 26547 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 27: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:36.219549 26615 raft_consensus.cc:2410] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 26 because replica has last-logged OpId of term: 25 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 15.
I20260709 12:13:36.219471  3062 raft_consensus.cc:3055] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:36.201541  2876 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:36.059278  2819 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:36.231582 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 183265us
I20260709 12:13:36.239842 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:36.227181  3062 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:36.255226 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 159852us
I20260709 12:13:36.265560 26588 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:36.252518 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:36.233057  3116 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:36.271495 26514 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:36.276345 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:36.276710 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:36.278503 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:36.286646 26613 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
W20260709 12:13:36.293401 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:36.292402 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:36.203548  2962 consensus_queue.cc:237] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:36.296173 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:36.254473  2514 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:36.296576 26613 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:13:36.296761 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:36.297560 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:36.297930 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 304107us
I20260709 12:13:36.269578 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:36.316612 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:36.301321 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4513) took 1146 ms. Trace:
I20260709 12:13:36.330416 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:36.334635 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:36.267273  2906 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:36.341116 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:36.335582 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:36.332290 26439 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:36.281836  2920 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election won for term 26
W20260709 12:13:36.339730 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 74247.4us
I20260709 12:13:36.345485  3124 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:36.332216 26468 rpcz_store.cc:276] 0709 12:13:35.154584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.202240 (+ 47656us) service_pool.cc:224] Handling call
0709 12:13:35.202667 (+   427us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:35.203077 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:35.203111 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:35.203732 (+   621us) log.cc:844] Serialized 52 byte log entry
0709 12:13:35.284180 (+ 80448us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:35.788034 (+503854us) log.cc:844] Serialized 14 byte log entry
0709 12:13:36.033672 (+245638us) log.cc:844] Serialized 14 byte log entry
0709 12:13:36.300867 (+267195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:36.300986 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:36.301045 (+    59us) raft_consensus.cc:1685] finished
0709 12:13:36.301063 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:36.301240 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93710,"prepare.queue_time_us":147210,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":3681,"raft.queue_time_us":180229,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":8747,"thread_start_us":957419,"threads_started":4,"wal-append.queue_time_us":93480}
I20260709 12:13:36.355019 26438 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:36.293092  3015 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:36.356956 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:36.296036  2882 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:36.360199 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:36.361414 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 91946.1us
I20260709 12:13:36.333668  3087 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:36.359651  3064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.039s	sys 0.044s
I20260709 12:13:36.354115  2906 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:36.339129  3110 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:36.358667  3124 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:36.347910  3030 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:36.397425 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 4515) took 1047 ms. Trace:
I20260709 12:13:36.410061 26473 rpcz_store.cc:276] 0709 12:13:35.349903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.408684 (+ 58781us) service_pool.cc:224] Handling call
0709 12:13:36.397173 (+988489us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b54002dda54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:36.397338 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1212048640}
I20260709 12:13:36.347270  3115 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:36.359552  2960 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:36.336196  3106 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:13:36.363468  2945 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:36.394804  2882 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:36.405907  3130 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:36.406672  2920 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:36.406796 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 43571.5us
I20260709 12:13:36.406910  2906 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:36.407651  3123 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 12:13:36.391702  3064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.040s	sys 0.044s
I20260709 12:13:36.338948  3109 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 12:13:36.413194  3124 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:36.368597  3129 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:36.393906  3070 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:36.365671  3015 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:36.431813 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 71693.6us
I20260709 12:13:36.485065 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:36.421861 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 65006.8us
I20260709 12:13:36.410743  3125 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:36.422101  2945 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:36.421665  2882 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:36.441537 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 100498us
I20260709 12:13:36.448205 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:36.450438  2969 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:36.451174  2514 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:36.454320  3101 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:36.391906  3062 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:36.458626  3110 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:36.460542 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4458) took 1573 ms. Trace:
I20260709 12:13:36.484824  3129 raft_consensus.cc:697] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:36.510020 26616 rpcz_store.cc:276] 0709 12:13:34.887270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.906516 (+ 19246us) service_pool.cc:224] Handling call
0709 12:13:35.231745 (+325229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:35.232177 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:35.232217 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:35.234424 (+  2207us) log.cc:844] Serialized 26 byte log entry
0709 12:13:35.331011 (+ 96587us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b18003eafa0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:13:35.427389 (+ 96378us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:35.427432 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.427497 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:35.727187 (+299690us) raft_consensus.cc:1685] finished
0709 12:13:35.727208 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:36.460347 (+733139us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b540037b250. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:36.460479 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1762,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":2487,"spinlock_wait_cycles":665992320,"thread_start_us":96183,"threads_started":1,"wal-append.queue_time_us":232032}
I20260709 12:13:36.466630  2822 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:36.467972  2720 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Stepping down as leader of term 34
I20260709 12:13:36.470870  2920 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:36.477329  3103 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.305s	user 0.000s	sys 0.002s
I20260709 12:13:36.478339 26471 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:36.478927  2960 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:36.480089 26469 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:36.537534 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:36.537814 26469 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:36.480333  3046 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:36.425877  2815 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:36.486187 26438 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:36.489835 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:36.499423 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:36.483713  3099 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.726s	user 0.003s	sys 0.004s
I20260709 12:13:36.506906 26622 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:36.507295  3101 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:36.482241  2742 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:36.508757  3062 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:36.492262  3125 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:36.461993 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 3704) took 1139 ms. Trace:
I20260709 12:13:36.562251 26615 rpcz_store.cc:276] 0709 12:13:35.322178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.327292 (+  5114us) service_pool.cc:224] Handling call
0709 12:13:36.461762 (+1134470us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b54001b0654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:36.461928 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1948119296}
I20260709 12:13:36.516748 26542 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:36.518031 26546 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 29 index: 15. (index mismatch)
W20260709 12:13:36.532768  2985 consensus_meta.cc:287] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.658s	user 0.008s	sys 0.005s
I20260709 12:13:36.523816 26543 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:13:36.500605  2882 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:36.533730 26541 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:36.500785  3123 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:36.521823  2720 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:36.531740  3033 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:36.512606  3022 consensus_queue.cc:1175] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aaadfdd9ca9f424c91505f9b43876233" responder_term: 23 status { last_received { term: 21 index: 14 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:13:36.534166 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:36.538935 26469 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 28.14, Last appended by leader: 14, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:36.557476 26540 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 12:13:36.559530 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 73435.5us
I20260709 12:13:36.581302 26469 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:36.581717 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:36.560729  3134 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election won for term 30
W20260709 12:13:36.561293 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 71577.2us
I20260709 12:13:36.571156  3070 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:36.511430  3129 consensus_queue.cc:237] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:36.534231 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:36.584275 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:36.573071  3125 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:36.601094 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:36.603595 26471 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
I20260709 12:13:36.605118 26471 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: []
W20260709 12:13:36.607757  2988 consensus_meta.cc:287] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.639s	user 0.012s	sys 0.001s
I20260709 12:13:36.607839 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:36.608712  2988 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:36.610529 26464 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 27: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:13:36.611263  3137 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:13:36.616452 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:36.589604  3134 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:36.630070 26439 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:36.631410 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:36.572119  3132 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:36.606354  2906 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:36.568607  3046 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:36.625043  3135 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:36.644649 27165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 1139) took 1185 ms. Trace:
I20260709 12:13:36.661007 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:36.627238  3123 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:36.590571  3033 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:36.630198  3109 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:13:36.662027 27168 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 34. Current term is 35. Ops: []
I20260709 12:13:36.662081 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:36.663002 27166 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: [28.18-28.18]
I20260709 12:13:36.636906  2925 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:36.578003  2985 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:36.660226 27165 rpcz_store.cc:276] 0709 12:13:35.459109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.466525 (+  7416us) service_pool.cc:224] Handling call
0709 12:13:35.466862 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:35.495518 (+ 28656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:35.495567 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:35.507132 (+ 11565us) log.cc:844] Serialized 26 byte log entry
0709 12:13:35.610986 (+103854us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:35.611052 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.611128 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:36.480716 (+869588us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:36.634757 (+154041us) raft_consensus.cc:1685] finished
0709 12:13:36.634789 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:36.644576 (+  9787us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28227,"raft.queue_time_us":56818,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"spinlock_wait_cycles":77675776,"thread_start_us":92523,"threads_started":1,"wal-append.queue_time_us":247344}
I20260709 12:13:36.667733 27160 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:13:36.637385  3106 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:36.633514  3134 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:13:36.694185 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:36.700126 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:36.703713  2996 consensus_meta.cc:287] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.803s	user 0.012s	sys 0.002s
I20260709 12:13:36.763867 27161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56886 (request call id 1358) took 1171 ms. Trace:
I20260709 12:13:36.764513 27161 rpcz_store.cc:276] 0709 12:13:35.592377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.592510 (+   133us) service_pool.cc:224] Handling call
0709 12:13:36.763565 (+1171055us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b540056bb54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:36.763779 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":837828352}
W20260709 12:13:36.704823 27133 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.013s	sys 0.013s
I20260709 12:13:36.708141  3102 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:36.642735  3122 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.698150  2720 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 34.22, Last appended by leader: 22, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:36.726444  2925 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:36.699249  2893 consensus_meta.cc:287] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.042s	user 0.013s	sys 0.003s
W20260709 12:13:36.733062  2525 consensus_meta.cc:287] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.851s	user 0.011s	sys 0.001s
I20260709 12:13:36.735499  3101 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:36.736750  2988 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:36.741235  3015 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:36.743026  3046 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:36.799805  2525 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:36.801105 27159 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:36.745355  3116 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:36.767624  3102 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:36.703852  3124 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:36.666164  3132 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:36.667302  2969 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:36.671296  3070 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:36.793187  2809 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:36.783113  3147 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 34.22, Next index: 23, Last known committed idx: 22, Time since last communication: 0.014s
W20260709 12:13:36.789932  3107 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.694s	user 0.000s	sys 0.002s
I20260709 12:13:36.796801  2985 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:36.744992  2742 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:36.771524  2373 consensus_meta.cc:287] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.785s	user 0.013s	sys 0.000s
I20260709 12:13:36.882534 26469 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 14. Preceding OpId from leader: term: 29 index: 15. (index mismatch)
I20260709 12:13:36.929029 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3391) took 1464 ms. Trace:
I20260709 12:13:36.929118  2435 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:36.929634  2435 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:36.747341 26621 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:36.931138 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:36.931954  2435 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:36.758841 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 58113.5us
I20260709 12:13:36.774901 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:36.886319 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:36.802341  2525 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:36.937155 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 51358.7us
I20260709 12:13:36.887552 26465 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 16. (term mismatch)
I20260709 12:13:36.938956  2720 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:13:36.939435 26465 pending_rounds.cc:85] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 15
I20260709 12:13:36.939934 26465 pending_rounds.cc:107] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 12:13:36.940348 26465 raft_consensus.cc:2889] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:36.766229 27133 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.015s	sys 0.015s
I20260709 12:13:36.814385 27159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1363) took 1217 ms. Trace:
I20260709 12:13:36.912854 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:36.919108 26466 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:36.923410 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3725) took 1301 ms. Trace:
I20260709 12:13:36.887708 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3369) took 1624 ms. Trace:
I20260709 12:13:36.929548 26469 rpcz_store.cc:276] 0709 12:13:35.464852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.806052 (+341200us) service_pool.cc:224] Handling call
0709 12:13:35.806425 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:36.479983 (+673558us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b54000a8820. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f5076051dc0 00007f50760dc1c0 00007f50760dd231 00007f50760d9d8f 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c
0709 12:13:36.928486 (+448503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:36.928936 (+   450us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27643264}
I20260709 12:13:36.935122  2435 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:36.818308  2809 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:36.817974  2893 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:36.951138 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:36.817253  2925 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:37.063165  2932 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 29 current term: 29 is higher.
I20260709 12:13:36.843187  2945 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.079816  2809 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.081390  2809 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:36.813799  2969 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:37.083043  2969 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:36.805403  3033 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:36.813912  3102 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.089711  3102 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:36.809021  3112 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:37.094573  3015 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:37.095553  3015 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:36.782799  3122 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:37.099197 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.100430  3062 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.101539  3122 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:36.837460  3125 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.102702 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:37.102272  3022 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.103684 26615 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:13:37.104445  3125 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:37.104781  2893 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:36.944772 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 853189us
I20260709 12:13:32.905208 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:37.105801  2822 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.106276 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:37.107476 26548 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:36.944831 27162 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:37.109747  2915 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:36.945828 26622 rpcz_store.cc:276] 0709 12:13:35.621551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.623602 (+  2051us) service_pool.cc:224] Handling call
0709 12:13:35.623924 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:36.541989 (+918065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:36.922752 (+380763us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b5400032354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:36.923148 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2030104960}
I20260709 12:13:37.110697  2915 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:36.944593 27159 rpcz_store.cc:276] 0709 12:13:35.596891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.597457 (+   566us) service_pool.cc:224] Handling call
0709 12:13:35.615088 (+ 17631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:36.801518 (+1186430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:36.814111 (+ 12593us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540013b5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:36.814316 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2727094016}
I20260709 12:13:37.112323 26368 catalog_manager.cc:5697] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 19 to 24, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 24 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:36.779318  2783 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:37.113803  2915 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:37.114078  2783 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:37.114913  2985 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:37.115721  2985 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 29 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:37.115881  2783 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.117610  2783 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:37.117264  2985 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:36.951097  2654 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:37.119774 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.120047  2654 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:37.120855 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.121264  3130 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.944217  2373 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:37.078168  2927 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.123070  2927 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:37.123769 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:37.124786 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.125108  3105 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.125815  3105 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.087484  2742 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.128082  2742 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.128630  3105 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:37.130044  3114 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:37.058286 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.101212  3062 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.130812  3114 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.132678  3062 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:36.840839  3124 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:36.945657 26466 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:37.103965  3022 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.136475  3022 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:37.136909 26466 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.138486 26466 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:37.139334  2742 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:37.126202  2927 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:37.141609 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:37.075822 26587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.029s	sys 0.036s
W20260709 12:13:37.142484 26587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.030s	sys 0.036s
I20260709 12:13:36.807435  2882 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.106849  2822 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.110055 27133 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:37.154516 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:37.098381  3015 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:37.171307 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:36.945977 26472 rpcz_store.cc:276] 0709 12:13:35.267896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.692305 (+424409us) service_pool.cc:224] Handling call
0709 12:13:35.692825 (+   520us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:35.702547 (+  9722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:35.702597 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:35.709093 (+  6496us) log.cc:844] Serialized 52 byte log entry
0709 12:13:35.935602 (+226509us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:35.953049 (+ 17447us) log.cc:844] Serialized 14 byte log entry
0709 12:13:36.124949 (+171900us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b18000d3ae0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5072fefa40 00007f5072fea4e4 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287 00007f50760f5208
0709 12:13:36.126999 (+  2050us) log.cc:844] Serialized 14 byte log entry
0709 12:13:36.430640 (+303641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:36.444947 (+ 14307us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:36.476692 (+ 31745us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:36.883796 (+407104us) raft_consensus.cc:1685] finished
0709 12:13:36.887062 (+  3266us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:36.887476 (+   414us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2894,"prepare.queue_time_us":19021,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":79,"raft.queue_time_us":182138,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":15553,"spinlock_wait_cycles":72801024,"thread_start_us":523036,"threads_started":2,"wal-append.queue_time_us":335886}
I20260709 12:13:37.133294  3114 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:37.179648 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 69804.1us
I20260709 12:13:37.122047  3130 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.182190  2525 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:37.188796 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:37.192719  2882 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:37.194921 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:37.170591  3138 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:37.194679  3127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.009s	sys 0.032s
W20260709 12:13:37.199198  3127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.010s	sys 0.032s
I20260709 12:13:37.199345  3138 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.199992 26615 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 12:13:37.212257 26621 raft_consensus.cc:2410] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 29 because replica has last-logged OpId of term: 28 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 17.
I20260709 12:13:37.216202 27162 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:13:37.221036 26614 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:37.223443 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:37.226743  2525 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:37.226890 26616 raft_consensus.cc:1217] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Deduplicated request from leader. Original: 23.12->[25.13-28.14]   Dedup: 25.13->[28.14-28.14]
I20260709 12:13:37.227357  2525 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:37.227617 26616 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 28. Current term is 29. Ops: [25.13-28.14]
I20260709 12:13:37.227949  2525 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:37.203290  2654 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:37.226953 26613 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: []
W20260709 12:13:37.230322 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 47347.9us
I20260709 12:13:37.228921 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:37.232734  3109 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.233615  2822 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:37.233485  3109 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.234031 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:37.234761 26615 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:13:37.235349 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:37.235687 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:37.235963  3109 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:37.236927 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:37.238565 26620 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 27
I20260709 12:13:37.236090 26616 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 33.
I20260709 12:13:37.226181 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:37.240712 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:37.238185 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:37.237252 26588 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:37.258436  3116 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:37.258562  2920 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.003s
I20260709 12:13:37.262310 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:37.264293 26619 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:37.271157 26617 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:13:37.277432  2962 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:13:37.278855  3134 consensus_meta.cc:287] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.007s
I20260709 12:13:37.281569 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:37.282565 27160 raft_consensus.cc:2393] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 24: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:37.283565  3134 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.282586 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:37.286952  2925 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.302485  2925 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:37.278875  3138 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:37.295291  3130 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:37.295734 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.308342 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:37.298882 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 72872.1us
I20260709 12:13:37.303725 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:37.265853  2435 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:37.277673 26439 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:37.323407  2932 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.325871  2932 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.328168  2932 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:37.328742  3122 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:37.329471  3122 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.332048  3122 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:37.334547 26615 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:37.334760 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 718267us
I20260709 12:13:37.337911 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:37.349987 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 72472.9us
I20260709 12:13:37.339278 26619 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:13:37.345995  2932 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.362673 26620 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:37.350666  3122 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:37.347856  2945 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:37.348743  3034 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:37.340045  3134 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:37.365185 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.368507 27162 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:13:37.370527 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:37.372828 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:37.376463 27161 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:37.376356 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:37.378520 27160 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:37.379972 26368 catalog_manager.cc:5697] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:37.373134  2932 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.370890 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3718) took 1751 ms. Trace:
I20260709 12:13:37.386508 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:37.385733 26614 rpcz_store.cc:276] 0709 12:13:35.619481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.619615 (+   134us) service_pool.cc:224] Handling call
0709 12:13:35.619948 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:37.221713 (+1601765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.321350 (+ 99637us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400194e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:37.370820 (+ 49470us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3681126784}
W20260709 12:13:37.391351 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 49591.3us
I20260709 12:13:37.390259  2932 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:37.402372 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:37.405714 27160 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:37.411083 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:37.414112 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 76386.8us
I20260709 12:13:37.371301  3034 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:37.392551  3122 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 29 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:37.428871 27161 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:13:37.431383 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:37.392457  2969 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.439014 26466 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 12:13:37.441998  2525 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.430024  2932 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:37.443708  2932 raft_consensus.cc:697] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:37.444941  2932 consensus_queue.cc:237] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.445890 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:37.440747 26466 pending_rounds.cc:85] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 14
I20260709 12:13:37.449893 26466 pending_rounds.cc:107] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 12:13:37.450292 26466 raft_consensus.cc:2889] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:37.462810 26618 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:37.464933 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3398) took 1944 ms. Trace:
I20260709 12:13:37.465721 26615 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:37.465502 26466 rpcz_store.cc:276] 0709 12:13:35.520005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.808298 (+288293us) service_pool.cc:224] Handling call
0709 12:13:35.808573 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:36.918815 (+1110242us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b540044c120. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f5076051dc0 00007f50760dc1c0 00007f50760dd231 00007f50760d9d8f 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c
0709 12:13:37.458775 (+539960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.464852 (+  6077us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":850710912}
W20260709 12:13:37.469537  2888 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 23 current term: 23 is higher.
I20260709 12:13:37.469790 26439 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:37.476027 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 114698us
I20260709 12:13:37.479749 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:37.491120  2925 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:37.492036  2925 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:37.493268  2925 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.494761  3163 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:37.495559  3163 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.497984  3163 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:37.502714 26362 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39184 (request call id 166) took 19505 ms (client timeout 15000 ms). Trace:
I20260709 12:13:37.503515 26368 catalog_manager.cc:5697] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:37.552390 26368 catalog_manager.cc:5697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 13 to 20. New cstate: current_term: 20 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:37.508265 27161 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:13:37.509527  2971 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:37.557907 26439 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:37.525478 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:37.525072  3034 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.560740  3034 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:37.528795  2969 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:37.535346  3164 log.cc:927] Time spent T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:13:37.536463  2525 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:37.536947 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 102754us
I20260709 12:13:37.542583 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:37.548188 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:37.568161 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 86646.2us
W20260709 12:13:37.510673 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 72070.1us
I20260709 12:13:37.569213 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:37.569697 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:37.570448  2971 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:37.570971  2971 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:37.571460  2971 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:37.507055 27134 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:37.572647 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 65820.1us
I20260709 12:13:37.574085  2742 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:37.574594  2969 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:37.574867  2742 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:37.575042  2969 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:37.575433  2742 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 24 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:37.568161 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:37.576565  2742 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.577641 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:37.578575  3112 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:37.579289  3112 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:37.581408  2962 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:37.575490  2969 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:37.587906 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:37.588548 27161 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:37.598786  2983 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:13:37.603240 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 45394.4us
I20260709 12:13:37.599481  2983 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.612886 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:37.615114 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 229258us
W20260709 12:13:37.616295 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 44187.5us
I20260709 12:13:37.618652 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:37.620029 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 177684us
W20260709 12:13:37.623651 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.608577  3163 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.630627 26514 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:37.621058  2888 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:37.637823 26439 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:13:37.639572 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 70500.5us
W20260709 12:13:37.650444 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:37.651212 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:37.659410 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 81862.1us
I20260709 12:13:37.616235  3134 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.622676  2945 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:13:37.551101 26362 rpcz_store.cc:269] 0709 12:13:18.035817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:18.064896 (+ 29079us) service_pool.cc:224] Handling call
0709 12:13:37.502448 (+19437552us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:28.610883 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:28.611921 (+  1038us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:28.611990 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:13:28.612012 (+    22us) tablet.cc:662] Decoding operations
0709 12:13:28.885584 (+273572us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:28.885691 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:28.885725 (+    34us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:13:28.887046 (+  1321us) tablet.cc:701] Row locks acquired
0709 12:13:28.887105 (+    59us) write_op.cc:260] PREPARE: finished
0709 12:13:28.887321 (+   216us) write_op.cc:270] Start()
0709 12:13:28.887479 (+   158us) write_op.cc:276] Timestamp: P: 1783599208887246 usec, L: 0
0709 12:13:28.887517 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:13:28.888260 (+   743us) log.cc:844] Serialized 5516 byte log entry
0709 12:13:29.375708 (+487448us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5072fd00ac 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b
0709 12:13:29.774965 (+399257us) op_driver.cc:464] REPLICATION: finished
0709 12:13:30.052269 (+277304us) write_op.cc:301] APPLY: starting
0709 12:13:30.059818 (+  7549us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:30.377750 (+317932us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:30.377801 (+    51us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:30.740619 (+362818us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:30.740990 (+   371us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0709 12:13:30.741046 (+    56us) write_op.cc:312] APPLY: finished
0709 12:13:30.741500 (+   454us) log.cc:844] Serialized 129 byte log entry
0709 12:13:31.127875 (+386375us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:31.236452 (+108577us) write_op.cc:454] Released schema lock
0709 12:13:31.283559 (+ 47107us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:31.386927 (+103368us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:31.391010 (+  4083us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5092736,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":256243,"apply.run_cpu_time_us":65601,"apply.run_wall_time_us":1308538,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62591,"cfile_init":1,"lbm_read_time_us":632,"lbm_reads_lt_1ms":4,"num_ops":14,"prepare.queue_time_us":263222,"prepare.run_cpu_time_us":32387,"prepare.run_wall_time_us":918361,"raft.queue_time_us":201200,"raft.run_cpu_time_us":66813,"raft.run_wall_time_us":237108,"replication_time_us":887240,"spinlock_wait_cycles":58015488,"thread_start_us":1337775,"threads_started":5,"wal-append.queue_time_us":1216419,"wal-append.run_cpu_time_us":24483,"wal-append.run_wall_time_us":2711785}]]}
I20260709 12:13:37.638677  2882 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:37.670380  3154 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.692605  3022 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:37.642901  2373 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.690582  2985 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:37.691031  3159 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:13:37.690114 27161 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:13:37.636020  3109 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.706136 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:37.709703 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 74651.1us
I20260709 12:13:37.701315 26368 catalog_manager.cc:5697] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 19 to 20, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 20 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:37.722597 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:37.705538  2783 consensus_meta.cc:287] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.587s	user 0.014s	sys 0.004s
I20260709 12:13:37.722254 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:37.718824 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:37.738207 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:37.703855  2882 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:37.620752  3122 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.19, Last appended by leader: 19, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.714285  3125 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:37.711858  3022 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:37.757212  3022 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:37.748346  2882 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:37.763831  2654 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 28.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:37.764981  2654 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:37.765645  2783 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:37.766120  2783 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:37.766539  2783 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:37.766693  2654 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:37.767187  2654 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:37.768651  2654 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.770232  2654 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:37.774483  2925 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:37.775163  2925 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:37.776160  2925 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.18, Last appended by leader: 18, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.784188  2882 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.795071  2920 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:37.795897  2920 raft_consensus.cc:697] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:37.747057  3114 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:13:37.796631  3114 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:37.797025  3114 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:13:37.794826 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 56711.5us
I20260709 12:13:37.794781  2373 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.800393  2373 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:37.800166  3022 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.797044  2920 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.699846  3163 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.764752  3154 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.712507  3015 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.711544  3134 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.806921 26368 catalog_manager.cc:5697] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 18 to 19, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 19 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:37.736114  2985 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.812184  3112 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:37.815809  2915 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.736702  3109 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.785168  2971 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.811659  3125 raft_consensus.cc:697] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:37.741498  2945 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:37.851641 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:37.853644 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.846932 26618 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 29 index: 18. (term mismatch)
I20260709 12:13:37.854578 26618 pending_rounds.cc:85] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 17
I20260709 12:13:37.863431 26618 pending_rounds.cc:107] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 28.18
I20260709 12:13:37.863845 26618 raft_consensus.cc:2889] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:37.874699 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.875294 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:37.875509 26621 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:37.876087 27161 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 35.
I20260709 12:13:37.825282  3015 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.877722  2882 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:37.829444  3022 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:37.878172 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:37.886363 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 239316us
I20260709 12:13:37.885936 26617 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 35.
I20260709 12:13:37.898801 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:37.904894 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:37.914790 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:37.882757  2373 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:37.922283 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:37.906153  3112 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.923375  2888 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:13:37.945776 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.896911  2915 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:37.954541 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:37.955317 26614 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:37.951844 26368 catalog_manager.cc:5697] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 18 to 19, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 19 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:37.963224 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:37.946187  3034 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:37.921696  2525 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.031s
I20260709 12:13:37.969169 26368 catalog_manager.cc:5697] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 20 to 21, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 21 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:37.963971  2882 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.958235  3015 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:37.983578  2654 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.984366  2654 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.984668 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:37.994096 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:37.958492  2995 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
I20260709 12:13:37.968314  3163 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:37.998448 26548 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 28: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:37.982578  2882 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:37.998641 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:37.926765  3125 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:38.004025 27161 raft_consensus.cc:2368] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29.
W20260709 12:13:38.005434 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 98327.1us
I20260709 12:13:37.998828  2971 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:38.010047 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:38.015746  2654 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.017187 26368 catalog_manager.cc:5697] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 8 to 19, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 19 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:37.987761  2373 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.032877 26541 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 29.
W20260709 12:13:38.019848  3178 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:13:38.026427  2995 raft_consensus.cc:3055] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:37.982257  3134 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:38.018860  3173 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:13:38.046110 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:38.046245 27162 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 17. Current term is 18. Ops: []
W20260709 12:13:38.045734 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.034067 26614 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:13:38.044528 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:38.045722 27161 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: [28.18-28.18]
I20260709 12:13:38.001636  3022 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.976362  3112 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.053305 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:38.029196  2932 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:13:38.028146  3154 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:38.059309 26541 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 29: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:38.059791 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:38.049814 26546 raft_consensus.cc:2376] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25. Re-sending same reply.
I20260709 12:13:38.042433  2995 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:38.062083 26548 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:38.040436  2983 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:38.050468  2945 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.069020 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:38.069657 26545 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:38.070544 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 155854us
I20260709 12:13:38.070560 27161 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:38.067821 26368 catalog_manager.cc:5697] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 19 to 20, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 20 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:38.073029 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:38.073944 26544 raft_consensus.cc:2410] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 29 because replica has last-logged OpId of term: 28 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 17.
I20260709 12:13:38.073611 26368 catalog_manager.cc:5697] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 13 to 14, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 14 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:38.075045  3176 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:13:38.079875 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:38.080644 26544 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
W20260709 12:13:38.081000 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.082001 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:38.082643  3134 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.083189 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.083279  3134 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.083896 26614 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 35.
I20260709 12:13:38.085243 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:38.085534  3134 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.086093  3134 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.086676 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:38.086840 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:38.117182 27160 raft_consensus.cc:2368] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24.
I20260709 12:13:38.087607 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:38.088204 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:38.089069 26548 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:13:38.089162 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:38.087648 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:38.091861 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:38.091998  2373 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.093719  2882 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.026854  2888 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.094297 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:38.082665 26546 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:38.090212  2654 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.098845 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.135247  2654 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.136065 26621 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:13:38.083299 26541 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:38.099364 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:38.100147 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:38.137673  2654 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.057781  2932 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.138316  2932 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:13:38.137959 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:38.139540 26541 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 26: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:38.139225  3114 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.140496 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:38.141558  3114 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.056038  3022 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.102803 26368 catalog_manager.cc:5697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 21 to 22, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 22 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
W20260709 12:13:38.107724 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.143208 26368 catalog_manager.cc:5697] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 14 to 15, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 15 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:38.112810 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.120049 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:38.144699 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.065822  2985 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.145517 26541 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:38.121578 27167 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 27: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:38.098685 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:38.125974 27168 raft_consensus.cc:3055] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 22 LEADER]: Stepping down as leader of term 22
W20260709 12:13:38.150611 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.125890 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:38.126588  2983 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:38.127498 26543 raft_consensus.cc:2410] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 25 because replica has last-logged OpId of term: 24 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 17.
I20260709 12:13:38.128090  3109 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.129737 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:38.157505 26544 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:38.130319 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:38.131053 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:38.131407  3172 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.218s	user 0.003s	sys 0.000s
I20260709 12:13:38.133406 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:38.133389  2969 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.528s	user 0.011s	sys 0.002s
I20260709 12:13:38.134544 26466 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:38.143954  3022 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.121291 27163 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:38.150575 27168 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:38.176249 26545 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 27.
I20260709 12:13:38.168418 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:38.167631 26368 catalog_manager.cc:5697] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 9 to 22, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 22 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:38.115212  2742 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:13:38.155387 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:38.177510 26541 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:38.177816 26540 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 28: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:38.171558 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:38.189153 26539 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:13:38.189652 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:38.191078 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:38.197700 26545 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 27: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:38.199571 26472 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:38.203454 26368 catalog_manager.cc:5697] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 21 to 23, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 23 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:38.206590 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:38.209434 26514 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:13:38.216576 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 96384.4us
I20260709 12:13:38.222901 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:38.224005 26545 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:38.225448 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:38.226157 26548 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:13:38.183168  3181 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:38.235301  3181 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:38.237274  2925 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.238300  2925 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:38.180714  2742 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.246685  2742 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:13:38.250631 26545 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:38.250746  2915 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:38.252241 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:38.253062 26545 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:38.259313  3112 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.198016  2995 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:38.261902  2995 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:38.246081  2925 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:38.155099  2945 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.266728 26539 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:13:38.266876  2945 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.268431 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:38.271811 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:38.272764 26540 raft_consensus.cc:2376] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27. Re-sending same reply.
I20260709 12:13:38.273581 26541 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
W20260709 12:13:38.280629 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:38.287873 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 162052us
W20260709 12:13:38.288116 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 132894us
I20260709 12:13:38.289022 26514 leader_election.cc:400] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29.
I20260709 12:13:38.289345 26514 leader_election.cc:403] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Cancelling election due to peer responding with higher term
I20260709 12:13:38.289662 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:38.290025  3022 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260709 12:13:38.290585 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.290803 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:38.294865 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:38.295651 26547 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
W20260709 12:13:38.300410 26514 leader_election.cc:336] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Timed out: RequestConsensusVote RPC to 127.24.179.68:35069 timed out after 1.579s (SENT)
I20260709 12:13:38.301702 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:38.207787 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:38.188596  3034 raft_consensus.cc:2764] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
W20260709 12:13:38.311411 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 93971.5us
I20260709 12:13:38.270123 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:38.327419 26539 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 34: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:38.319145 26546 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
I20260709 12:13:38.274010 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:38.328140 26540 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:38.334008 26545 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:13:38.339111 26616 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:13:38.340903 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.342294 26620 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:38.342964 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.344108 26465 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:38.341017 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.344924 26621 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
W20260709 12:13:38.348313 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 48072.2us
I20260709 12:13:38.349581  2962 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:13:38.351292 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.352406  2925 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.352993  2925 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.355212 26547 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:13:38.356153 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:38.343255  3022 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election lost for term 28. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29.
I20260709 12:13:38.357483 26547 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: [20.13-22.15]
I20260709 12:13:38.355336  2925 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.212410 27168 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:38.257952  2783 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.180572  2969 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.178618  3134 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:38.373751 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.270170  2945 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.370337 26546 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:38.324203  3138 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:38.372694 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.394177 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.396742 27168 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:38.385905 26547 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:38.387053 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:38.391041 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.407068 26619 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:38.408799 26466 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:13:38.358318  3154 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.371861  3109 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:38.377993  3181 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:38.412595 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.419819 26473 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 29: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:38.425454 26439 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:38.425619 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 340434us
I20260709 12:13:38.427047 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:38.378648  2932 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:38.423277  3114 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.412541  2945 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.449090 26470 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:13:38.456295 27168 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:13:38.429149 26544 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 30 because replica has last-logged OpId of term: 29 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 17.
W20260709 12:13:38.433319 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 143704us
I20260709 12:13:38.445052 26469 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 36: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:38.431214  2925 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:38.480546 26548 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:38.446724  3125 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:38.489287 26620 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 12:13:38.443117  3154 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.483850  3015 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.437248  3109 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:38.488199  3125 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.511895 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:38.503300 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 132171us
I20260709 12:13:38.447592  3114 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:38.479408  2925 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.492002  2373 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:38.532969 27163 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:38.533022 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.535930 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:38.504882  3138 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.540700 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:38.540908 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.542135 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.545614 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.554241 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.516531  3125 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:13:38.562455 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.508491  2962 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:38.538108  2925 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:38.506350  2945 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.568852 26614 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:13:38.573300 26466 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:13:38.574750 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.577679 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.512861  3015 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.580493 26613 raft_consensus.cc:3055] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:38.578594 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.583770 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.586099 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:38.582240 26613 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:38.559275  2373 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.597074  2960 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:38.597640  2373 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.598714 26613 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.600052 26613 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:38.559664  3138 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.611013  3138 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.611721  3138 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.618112  3114 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:38.619967  2945 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.623591  3109 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:38.638978 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.639289 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:38.639984 26467 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:38.640476 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.641120 26468 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 33.
I20260709 12:13:38.630667  3134 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:38.642983 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.623911  3015 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.579386  2783 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:38.643832 26464 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:38.624805  2962 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 31.20, Last appended by leader: 20, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.544615  3185 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.055s
I20260709 12:13:38.630086 26613 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:38.612576 26470 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:13:38.648766 26466 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 12:13:38.632050 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 136061us
I20260709 12:13:38.635879 26540 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
W20260709 12:13:38.638307 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.645336 26472 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:13:38.652526 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.588668  2969 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:38.642409 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.653437 26617 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:38.661681 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.642912  3197 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:13:38.641477  2742 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:38.665953 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 141450us
I20260709 12:13:38.666849 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:38.668551 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.668910 26466 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:38.667196 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:38.668347 26613 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:13:38.674731 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:38.675447 26618 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:13:38.676124 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.677583 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.674623 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.680830 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.682188 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.683241 27163 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:13:38.683773 26471 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 30: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:38.674134 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:38.678078 26470 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:13:38.682832 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:38.687446 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:38.688313 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:38.688966 27162 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
W20260709 12:13:38.690109  3183 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:13:38.692991 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.693254 26472 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:38.694852 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.696044  2742 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.665560  2932 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:38.697913 27133 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:38.698770  3200 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:38.699499 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:38.700066  3200 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:38.700503  3200 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:38.701159 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:38.701470  3200 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:38.704573  3154 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.705655 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:38.646458  3138 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.706533 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.707995 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:38.708582 26473 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:38.708716 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:38.709239  3138 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.696060 26472 raft_consensus.cc:2410] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 25 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 12:13:38.715651 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.716526 26472 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:13:38.717744  2969 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:38.718650  2969 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:38.720664 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.721112  3197 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 31 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:38.721206  2983 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:38.722142  3134 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.722385  3109 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:38.722259  3197 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 29.15, Last appended by leader: 15, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.722815  3134 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.723347  3109 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:38.724748  2373 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:38.725195  3134 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.729509 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:38.731441  2893 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:38.732003  2893 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.732149 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.732484  2893 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:38.732975 26471 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
W20260709 12:13:38.735327 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.738509  3190 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.739373 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:38.739190  3190 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.741629  3190 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:38.743016 26464 raft_consensus.cc:2410] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 30 because replica has last-logged OpId of term: 28 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 13.
I20260709 12:13:38.743225  3109 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:38.743070 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:38.743695  2373 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:38.744172 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.744625  2373 consensus_queue.cc:1243] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 21.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 12:13:38.743719  3109 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.745285 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.745478 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.717715 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.746280 26472 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:38.746670 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.747354 26470 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:13:38.748570 26470 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:38.747213 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:38.743749 26542 raft_consensus.cc:2410] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:13:38.750134 26472 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:13:38.750959 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:38.749238  3125 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:38.751804 27163 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 36: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:38.709728 26468 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:38.734063 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:38.754304 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.754660 26471 raft_consensus.cc:2410] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 27 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 12:13:38.710274 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:38.719928  2969 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:38.753037 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 146408us
I20260709 12:13:38.758843 26465 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 29.
I20260709 12:13:38.759821 26470 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: []
W20260709 12:13:38.760345 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.759091 26514 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:38.759896 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:38.764418 26618 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 36.
W20260709 12:13:38.765368 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 64296.7us
I20260709 12:13:38.766075 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:38.762365 26514 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:38.766927 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:38.775481 26615 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 36: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:38.776226 26466 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:13:38.745513  3109 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:38.787654 26467 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:13:38.790252 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:38.767436  3185 raft_consensus.cc:2764] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election decision vote started in defunct term 29: won
I20260709 12:13:38.761693  2985 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:38.817104 27164 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:13:38.800027  2893 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.775031  3198 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:38.806854 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:38.807850 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:38.825945 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.808645  3186 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:38.795079  2783 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:38.809504  3201 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:38.810050  3179 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:38.794901  2932 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:38.774621  2915 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
W20260709 12:13:38.832194 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.838380 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.792284  2525 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:38.842650 27160 pending_rounds.cc:85] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 16
I20260709 12:13:38.839632 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:38.846895 27160 pending_rounds.cc:107] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260709 12:13:38.847278 27160 raft_consensus.cc:2889] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:38.846527 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.794620  3200 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:38.864442 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 91169.6us
I20260709 12:13:38.870772 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:38.834848  3201 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:38.885010 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 174882us
I20260709 12:13:38.845115  2373 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:38.873235  3185 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.022s
W20260709 12:13:38.898828 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 117565us
I20260709 12:13:38.884970  3179 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:13:38.899648 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:38.900146  3179 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 36 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:38.900143  3034 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:38.900861  3181 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:38.901167 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:38.901420  3181 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:38.901582  3034 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 27.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
I20260709 12:13:38.902252  3181 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:38.902763  3034 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:38.902997  3125 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:38.903205  3034 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:38.904250  3034 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.904446  2925 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.905669  3034 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:38.847025  3198 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:38.907269  3198 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.892104  2983 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:13:38.878926  2932 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:38.911864  3181 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:38.912776  2932 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:38.890957  3201 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:38.843930  3154 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:38.917645  3181 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.846458  2525 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:38.932112  3191 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:38.901396  3179 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 34.22, Last appended by leader: 22, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:38.867177  2783 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:38.933902 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 102776us
I20260709 12:13:38.894019  2945 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:38.941246 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:38.942188 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:38.936702 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:38.944916 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:13:38.951496 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:38.953704 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.955945 26615 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 12:13:38.957671 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:38.929358  3154 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.929965  2893 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:38.939095  2525 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:38.977677 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 76587us
W20260709 12:13:38.984113 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.979607 27133 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:38.939385  3191 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:38.990540 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:38.941121  2971 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.050s
W20260709 12:13:38.976806 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 191719us
I20260709 12:13:38.977414  3154 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:39.001708  3199 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 12:13:39.002171 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.997160  3208 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.021s
I20260709 12:13:39.010654  2983 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:39.011838  3197 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:39.012074  2969 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:39.012365  3197 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:39.010074  2783 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:38.993166  2985 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:39.001372 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:39.026302  2945 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:39.030210 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 159831us
I20260709 12:13:39.032693 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:39.033164 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:38.994549  2925 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:39.034016 26541 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:39.038121 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:39.018667 26513 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:39.001350  3181 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:39.028075  3190 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.043144 26548 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:39.043776 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:39.012846  2969 consensus_queue.cc:1243] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 28.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:13:39.048931 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:39.045958 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:39.049427 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:39.045385 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:39.051764 26545 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:39.053992 26544 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
W20260709 12:13:39.056993 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 56736us
W20260709 12:13:39.056912 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 47428.8us
I20260709 12:13:39.012884  2983 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 12:13:39.064498 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:39.075454 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 132211us
I20260709 12:13:39.076157 26547 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:39.042903  3181 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.065490 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:39.048826  3015 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:38.995818  2962 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.065s
I20260709 12:13:39.087334 26548 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
I20260709 12:13:39.054170  3190 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:39.092337 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:39.090198 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:39.085071 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:39.089699 26544 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:13:39.087421 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:39.094800 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:39.116443 26540 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
W20260709 12:13:39.119390 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53979.7us
I20260709 12:13:39.092859 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:39.114876 26618 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25. Ops: []
W20260709 12:13:39.121594 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 124767us
I20260709 12:13:39.122495 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:39.083945  3181 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:39.129941 26543 raft_consensus.cc:2393] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 30: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:39.129995 26545 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:39.084431  3015 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:39.136308  3220 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:39.145496 26473 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 34.
I20260709 12:13:39.134476  3185 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:39.135488  3015 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:39.148663 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 63704.6us
I20260709 12:13:39.136327  2925 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:39.095396  3197 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:39.146375  3220 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.188817 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:39.156159  3209 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 12:13:39.186010 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 52178.7us
I20260709 12:13:39.198452 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:39.205847 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.212486  2373 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:39.213558 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:39.143383  3102 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 12:13:39.218762  3138 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:39.158896  3198 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
I20260709 12:13:39.218585  2985 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:39.218844  3134 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:39.235272  3134 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.235895  3134 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:39.235450  3199 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:13:39.223043  3215 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:13:39.241309 26544 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: [25.16-26.17]
I20260709 12:13:39.232210  3138 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:39.244735 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.226085  2525 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:39.243433  3138 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:39.248276 26539 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:13:39.256505 27163 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:39.261376  2525 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:39.196898  3220 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:39.266557 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.216100 26513 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:39.271400 26540 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:39.283460 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:39.287416 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:39.288166 26615 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:39.289561  3201 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:39.290588  3122 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.290879 26541 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 24: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:39.291178  3122 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:39.291980  3201 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:39.294694  3223 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:13:39.295012 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:39.294097  3122 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:39.296929 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 138612us
I20260709 12:13:39.297550  3190 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:39.298058  3220 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:39.298583 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:39.299520 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:39.300336  3220 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:39.300817 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:39.302452 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:39.302881 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:39.305837 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:39.307907 26545 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:39.308431  3199 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:39.290000  3200 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.314636  3122 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:39.218226  3185 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:39.316759 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:39.317502 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:39.318646 26547 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
W20260709 12:13:39.319150 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 103122us
I20260709 12:13:39.319623 26543 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:39.319941  3214 raft_consensus.cc:2764] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:13:39.361338 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:39.320375  3114 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.321745 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:39.338863  3186 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:13:39.340674 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 57344.2us
I20260709 12:13:39.375870 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:39.342823 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.345104 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:39.350847 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:39.354926 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.349754 26622 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
W20260709 12:13:39.363590 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 62865.3us
I20260709 12:13:39.350289 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:39.382748 26513 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:39.384191 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:39.335183  2742 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:39.336859 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:39.347134  2925 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:39.337826  3220 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 12:13:39.367749  3114 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:39.369172  3185 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:39.370837  3197 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:39.371151 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:39.351560  2932 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:13:39.391507 26615 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:13:39.339125  2985 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:39.371390  3134 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:39.412818 26543 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:39.416734 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:39.418491 26470 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 36 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 34. Current term is 36. Ops: []
I20260709 12:13:39.418499 26547 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:13:39.422019 26469 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:13:39.392566  3201 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:39.427342 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:39.429837 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:39.392910  3122 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:39.431565 26541 raft_consensus.cc:2393] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 24: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:39.412670  2945 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:39.413913  2915 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:39.436551 26469 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:13:39.440143 26543 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:39.417287  3198 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:39.375041  3200 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:39.437984 27133 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:39.453303  3200 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:39.456482 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:39.457731 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:39.433844  3201 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.458747 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:39.459053  3201 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:39.459496 26473 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:39.416718  2962 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.031s
I20260709 12:13:39.462976 26467 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:13:39.464414 26467 pending_rounds.cc:85] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 13
I20260709 12:13:39.464754 26467 pending_rounds.cc:107] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 28.14
I20260709 12:13:39.465071 26467 raft_consensus.cc:2889] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:39.466902 26466 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:13:39.426906  3181 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:39.469398 26468 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 13. (term mismatch)
I20260709 12:13:39.469808 26468 pending_rounds.cc:85] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 12
I20260709 12:13:39.470082 26468 pending_rounds.cc:107] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 24.13
I20260709 12:13:39.470381 26468 raft_consensus.cc:2889] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:39.471891 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:39.472558 26548 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:39.473536 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:39.474853 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:39.476264 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44904.2us
I20260709 12:13:39.428728  3015 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:39.477319 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:39.478312  2962 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:39.478741  2742 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:39.479491  3015 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:39.483707  3198 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.484519  3198 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:39.478757  2962 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:39.487694  3109 consensus_meta.cc:287] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.677s	user 0.013s	sys 0.000s
I20260709 12:13:39.488230  2962 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:39.490856  2960 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:39.491685  2960 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 29 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:39.492931  2960 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.19, Last appended by leader: 19, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:39.472813 26471 raft_consensus.cc:2368] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27.
I20260709 12:13:39.358486  3191 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 30.22, Last appended by leader: 22, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:39.496318  3181 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:39.498184  3213 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 28.19, Next index: 20, Last known committed idx: 18, Time since last communication: 0.052s
W20260709 12:13:39.499830 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 151569us
I20260709 12:13:39.501811 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:39.503082 26543 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:39.505935 26548 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 12:13:39.510761 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:39.506721 26541 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:13:39.508422  3198 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:39.508733  3114 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:39.522218 26469 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 12:13:39.525462 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:39.525846 26465 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
W20260709 12:13:39.509603  2783 consensus_queue.cc:1175] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3262bf0553e543eea76794fc529a9acc" responder_term: 30 status { last_received { term: 30 index: 22 } last_committed_idx: 22 last_received_current_leader { term: 30 index: 22 } }
W20260709 12:13:39.543105 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 220522us
I20260709 12:13:39.553103 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:39.553912 26548 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:39.571170 26543 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:13:39.490306  2962 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:39.587764 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.488164  3109 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:39.592257 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 90531.6us
I20260709 12:13:39.594329 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:39.595680 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 84160.3us
I20260709 12:13:39.602469 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:39.605907 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:39.606557 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:39.607612 26543 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:13:39.610088 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:39.613703 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:39.609331  3200 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:39.609143  3181 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 12:13:39.616662 26514 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.68:35069 timed out after 2.105s (SENT) [suppressed 30 similar messages]
I20260709 12:13:39.599017  2945 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:39.622198 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 228564us
I20260709 12:13:39.627557 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:39.628334 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:39.617702  3199 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:13:39.622959 26587 connection.cc:256] RPC call timeout handler was delayed by -1.1402665179998621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
I20260709 12:13:39.640072 26543 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:39.613443  2525 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.647364 26547 raft_consensus.cc:2368] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27.
W20260709 12:13:39.647364 26514 leader_election.cc:336] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Timed out: RequestConsensusVote RPC to 127.24.179.68:35069 timed out after 2.199s (SENT)
I20260709 12:13:39.624492  3179 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:39.660125 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:39.651382 26545 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 18.
I20260709 12:13:39.653761 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:39.655732 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:39.656682 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:39.658932 26470 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:39.627020  3181 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.655011 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:39.669931 26548 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
I20260709 12:13:39.677441 26619 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:39.680390 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:39.663496 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:39.673357 27162 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:39.638234  2932 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:39.683625 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:39.642792  3199 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.689550 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:39.690999 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:39.693621 26465 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:13:39.694110 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:39.653761  2985 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:13:39.705940 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 86344.1us
I20260709 12:13:39.708422 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:39.681217  3181 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:39.698068 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:39.713657 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:39.661242  3200 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 12:13:39.693912  3199 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:39.714601 26543 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
W20260709 12:13:39.717567 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 77263.2us
I20260709 12:13:39.693876  2882 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:39.727748  3234 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:13:39.726104 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 51442.6us
I20260709 12:13:39.681772  2525 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:39.748425  3154 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.707s	user 0.010s	sys 0.000s
I20260709 12:13:39.748952  3154 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:39.741204 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:39.751852 26514 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:39.753391  3198 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:39.753820  3198 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.754184  3198 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:39.755300  3015 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:39.755930  3015 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:39.756834  3015 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:39.759332  3232 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:13:39.761535  2969 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:39.762583  3221 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:13:39.762904  3130 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:39.763309  2969 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:39.764253  2983 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:39.764180  3221 consensus_queue.cc:1059] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 29.19, Next index: 20, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:13:39.764731  2983 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:39.709569  3210 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 28.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.015s
W20260709 12:13:39.766476 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.769837 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:39.773593 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:39.765710  2983 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:39.766268  3034 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 12:13:39.781674  2983 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:39.782565 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:39.783892 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:39.784579 27168 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:13:39.785609 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:39.765311  2969 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.016s
I20260709 12:13:39.719089  3134 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:39.793669 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:39.794652 26614 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:13:39.796486 26615 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:13:39.722227  3213 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:39.801405 27160 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:39.787165  3130 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:13:39.811969  2983 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:39.812609  2983 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:39.813560  2983 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 28.15, Last appended by leader: 15, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:39.712463  3239 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.089s
I20260709 12:13:39.815012  2932 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:39.815733  3213 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:39.802572  2882 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 12:13:39.816812  3213 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:39.817634  3109 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:39.790421  3208 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:39.826597 26542 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:13:39.800890  3214 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:39.827620 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:39.822432  2985 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:39.844908  2995 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:39.864195 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:39.877206 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:39.878379 27162 raft_consensus.cc:2410] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 29 because replica has last-logged OpId of term: 28 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 18.
I20260709 12:13:39.880968 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:39.837711  2742 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:39.839612  3214 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:39.877564 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 112450us
I20260709 12:13:39.903913 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:39.904286 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:39.906035 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:39.886574 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.897897 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:39.897985 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:39.883802  2995 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:39.925472 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:39.917986 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 232623us
W20260709 12:13:39.930338 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 222019us
I20260709 12:13:39.931385 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:39.934600 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:39.936532 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:39.938455 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:39.939213 27159 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 29 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:39.924273  2995 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.930665  3154 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:39.885752  3201 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:39.964588 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:39.939384  2932 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:39.926805  3114 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:39.939208  3109 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:39.943601 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:39.969782 26587 leader_election.cc:400] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27.
I20260709 12:13:39.973881 26587 leader_election.cc:403] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260709 12:13:39.974689  2969 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:39.975291  2969 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:39.975739  2969 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:39.978163 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 52832.4us
I20260709 12:13:39.979487 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:39.979518 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:39.951661  2995 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:39.984061 26514 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:39.927611  3181 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:39.993858 26621 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
I20260709 12:13:40.002615 26540 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:39.963796  3252 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:40.005033 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 61518.7us
I20260709 12:13:40.007483 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:39.970745  2882 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:40.012025 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:39.977573  3109 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:40.021337 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 51838.7us
I20260709 12:13:39.966535  2962 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:13:40.022146 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:40.024430  3109 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:39.986035  3208 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:40.000190  3154 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:40.025173 26617 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 34 index: 22. Preceding OpId from leader: term: 36 index: 23. (index mismatch)
I20260709 12:13:39.968417  3034 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:13:40.032130  3210 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:40.034449  3242 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader election lost for term 36. Reason: could not achieve majority
I20260709 12:13:40.034811 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:40.035531 26620 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:13:40.035658  3114 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:40.036194  3114 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:39.986030  3236 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 12:13:39.971072  3190 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:13:39.965412  3214 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:40.043468  3179 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:40.044055  3179 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:40.015146  2932 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.029s
I20260709 12:13:40.016047  3221 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:40.044703  3221 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.045109  3221 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:40.025971 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:40.020953  2985 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.026s
I20260709 12:13:40.026247 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:40.047830  2985 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:40.048144 27162 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:40.048414  2985 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:40.049387  2985 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:39.968532  2971 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 12:13:40.020444  2742 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 28.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.030s
I20260709 12:13:40.051199  2373 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:40.051805  2373 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.051605  3198 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:40.052284  2373 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:40.003922  3015 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:40.054913 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.055752  3114 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:40.058259  3201 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:40.025712  3181 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:40.002272  2783 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27.
I20260709 12:13:40.063014  3250 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.096s
W20260709 12:13:40.065546  3255 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:13:40.071738 27162 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:13:40.076117  3154 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.076673  3154 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:40.077967 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:40.078684 27163 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:40.078754 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:40.018407  2525 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:40.084625 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 105196us
I20260709 12:13:40.091245 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:40.091771 26470 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:40.092948 27134 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:40.095420 26543 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 33. Current term is 34. Ops: []
I20260709 12:13:40.095950 26472 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:40.101312 26539 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:13:40.101145 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:40.102203 26464 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:40.102705  3239 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:40.103165  3239 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.103516  3239 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:40.103835 26466 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: [28.18-29.19]
I20260709 12:13:40.106208 26467 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: []
W20260709 12:13:40.106990 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 84947.2us
I20260709 12:13:40.107990 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:40.102705 26542 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:40.110736 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:40.114073 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.114176 26622 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:13:40.117801 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:40.119182 27162 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:40.120327  3200 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:40.120894  2945 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:40.121814 26616 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 29 index: 15. Preceding OpId from leader: term: 31 index: 16. (index mismatch)
I20260709 12:13:40.137018  3186 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:40.137544  3186 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:40.132671  2882 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.006s
I20260709 12:13:40.054291  3198 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:40.108740  3114 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.117704  3122 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:40.149578  2373 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:40.148228 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:40.127056  2932 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:40.166100 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:40.133481  2945 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:40.109470  3199 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:40.192513 26542 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 12:13:40.201454  2373 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:40.202380 27163 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:13:40.145854  2985 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:40.205475 26622 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 17. (term mismatch)
I20260709 12:13:40.205894 26622 pending_rounds.cc:85] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 16
I20260709 12:13:40.206131 26622 pending_rounds.cc:107] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 26.17
I20260709 12:13:40.206444 26622 raft_consensus.cc:2889] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:40.207825 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:40.130589  3201 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 12:13:40.211592 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:40.220422 26465 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 25: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:40.211946 26467 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 27: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:40.170233  3122 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.212983 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:40.227718 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:40.224705 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:40.227031 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:40.229053 26467 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 30: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:40.229633 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:40.233460 26470 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:40.233706 26472 raft_consensus.cc:2376] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30. Re-sending same reply.
W20260709 12:13:40.234570 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:40.231177 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 83026.6us
I20260709 12:13:40.236501 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:40.201340  2945 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:40.170030  2882 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.057s
I20260709 12:13:40.252965 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:40.240070  3267 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:40.253944 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:40.259059 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:40.262763 26622 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:40.204294  3253 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:40.259697 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:40.255491 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:40.264222 26467 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:40.178205  3190 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.060s
W20260709 12:13:40.261336 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 95358.6us
I20260709 12:13:40.233376  3122 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:40.266481 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:40.262657 26470 raft_consensus.cc:2376] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 34. Re-sending same reply.
I20260709 12:13:40.272480 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:40.273522 26465 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:40.278189 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:40.279207 26546 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:40.282063 26513 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:40.283633 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:40.284130 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:40.284471 26470 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:40.184288  3114 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:40.290722 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:40.292348 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:40.263172  3208 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:40.295138 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:40.175799  3186 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:40.304919 26540 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 24: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:40.312350 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:40.315783 26548 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:13:40.313537 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:40.317493 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:40.318140 26468 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:40.322003 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:40.323575 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:40.324313 26542 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:40.304291  3261 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:40.326718 26546 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
W20260709 12:13:40.299702 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 70271.8us
I20260709 12:13:40.348146 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:40.309590  3202 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:40.362140 26546 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:13:40.365938  3015 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:40.358014  3265 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election won for term 30
W20260709 12:13:40.374078  3237 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.650s	user 0.001s	sys 0.003s
I20260709 12:13:40.325632  3201 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:40.326627  2783 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:40.309294  3102 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.046s
I20260709 12:13:40.294055  3253 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:40.394295 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 67984us
I20260709 12:13:40.324988  3252 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 12:13:40.381481  2783 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.383898  3186 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:40.416126 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:40.381749  3265 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:40.412663 26514 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:40.466212 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 53685.1us
I20260709 12:13:40.420498  3268 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.162s
I20260709 12:13:40.422453  3279 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:40.427647  3271 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:13:40.426810  3261 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.429301 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:40.517479 26473 raft_consensus.cc:2376] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31. Re-sending same reply.
I20260709 12:13:40.432327 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:40.352295  3267 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 12:13:40.413372  2783 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:40.434266  3241 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.599s	user 0.002s	sys 0.000s
W20260709 12:13:40.442804  3266 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 12:13:40.443820  3114 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:40.462543 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 46513.4us
I20260709 12:13:40.535511 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:40.479053  2983 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:40.543362 26465 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 28 index: 14. Preceding OpId from leader: term: 31 index: 16. (index mismatch)
I20260709 12:13:40.470934 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:40.403352  3202 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.519480  3208 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:40.493649  3034 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:40.499603  2742 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:40.501037 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.507174 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:40.509989 27160 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 34 index: 22. Preceding OpId from leader: term: 36 index: 23. (index mismatch)
I20260709 12:13:40.514479 27166 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
I20260709 12:13:40.518756 26472 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:40.406570  3283 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:40.465224 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 50855us
I20260709 12:13:40.633543 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:40.549301 26473 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:13:40.487227  3134 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 12:13:40.492929 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 170999us
I20260709 12:13:40.636716 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:40.464799  3200 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 12:13:40.581722 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:40.535851  3199 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:40.530220  3210 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.101s
I20260709 12:13:40.574337  3250 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.679531 26473 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 28. Current term is 29. Ops: []
W20260709 12:13:40.705251 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:40.680820 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44261.7us
I20260709 12:13:40.629904  3208 raft_consensus.cc:697] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:40.519718  3279 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:40.716931 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 83495us
I20260709 12:13:40.717720 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:40.670610 26465 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
W20260709 12:13:40.677858 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 96319.7us
I20260709 12:13:40.718971 26587 leader_election.cc:400] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27.
I20260709 12:13:40.720485 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:40.527547  3261 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:40.712713 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 217164us
I20260709 12:13:40.725721 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:13:40.711176  3179 consensus_meta.cc:287] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.667s	user 0.010s	sys 0.003s
I20260709 12:13:40.574968  3202 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:40.751185 26472 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:13:40.668040  2742 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:40.716009  3267 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:40.768323 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:40.774372 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:40.730036  3102 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:40.734985  3268 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:40.810734  3285 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.078s
I20260709 12:13:40.812307  3261 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:40.813133 27167 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
W20260709 12:13:40.814855  3273 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.416s	user 0.001s	sys 0.000s
I20260709 12:13:40.816747  3249 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:40.817158  3279 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:40.727910  3181 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.071s
I20260709 12:13:40.817720  3246 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:40.819392 26547 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
W20260709 12:13:40.820869  3154 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.744s	user 0.002s	sys 0.010s
I20260709 12:13:40.821412 26547 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: [23.13-24.14]
I20260709 12:13:40.821133  3208 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:40.819563  3295 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:13:40.823423  3109 consensus_meta.cc:287] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.784s	user 0.010s	sys 0.002s
I20260709 12:13:40.823930  3109 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:40.712729  3276 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.076s
I20260709 12:13:40.713574  3250 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:40.821372  3154 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:40.842547 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:40.843268  3015 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 28.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:40.734149 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:40.829980 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 107807us
W20260709 12:13:40.837951  3289 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:13:40.839421  3109 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:40.849642 26469 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
W20260709 12:13:40.852613 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 118589us
I20260709 12:13:40.853812 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:40.854601 26622 consensus_meta.cc:287] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.004s
I20260709 12:13:40.858454 26622 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:40.808868  3268 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.875901  2742 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:40.714895  3265 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:40.882872  3210 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:40.883545  3210 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:40.885963  3202 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:40.887516  3181 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 12:13:40.889246  3282 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.517s	user 0.008s	sys 0.001s
I20260709 12:13:40.908607 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:40.909279 26542 consensus_meta.cc:287] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.000s
I20260709 12:13:40.890378  3275 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.131s
I20260709 12:13:40.865885  3246 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:40.900574 26613 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
W20260709 12:13:40.855589  2969 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.879s	user 0.013s	sys 0.006s
W20260709 12:13:40.903754  3221 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.858s	user 0.008s	sys 0.005s
I20260709 12:13:40.902900  3109 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:40.770665  3179 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:40.904371 26468 consensus_meta.cc:287] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.576s	user 0.005s	sys 0.007s
I20260709 12:13:40.890226  3250 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:40.914104 26542 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:40.809533  3267 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.086s
W20260709 12:13:40.906737 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44740.9us
I20260709 12:13:40.899658  3201 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:40.927417 26468 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:13:40.895499  3268 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:40.885988  3210 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:40.934132 26547 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: [26.14-26.14]
I20260709 12:13:40.947365  3283 raft_consensus.cc:2764] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election decision vote started in defunct term 26: won
I20260709 12:13:40.947600  2742 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:40.948315  2742 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:40.948925  3191 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:40.950989  2742 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:40.926921  2969 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:40.919839  3274 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:40.957461 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1431) took 1037 ms. Trace:
I20260709 12:13:40.918185  3253 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:40.947439 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:40.929039  3221 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:40.954502 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 125988us
I20260709 12:13:40.952572  3181 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.929004  3246 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:40.958068 26541 rpcz_store.cc:276] 0709 12:13:39.919776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:39.919951 (+   175us) service_pool.cc:224] Handling call
0709 12:13:39.935664 (+ 15713us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:39.936269 (+   605us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 12:13:40.453027 (+516758us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b1800375b20. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f5079ad23c7 00007f50760e49a7 00007f50760f40bf 00007f50760f4038
0709 12:13:40.691305 (+238278us) log.cc:844] Serialized 14 byte log entry
0709 12:13:40.895114 (+203809us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:40.902802 (+  7688us) log.cc:844] Serialized 26 byte log entry
0709 12:13:40.902980 (+   178us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:13:40.903547 (+   567us) log.cc:844] Serialized 14 byte log entry
0709 12:13:40.903734 (+   187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:40.903805 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:40.957123 (+ 53318us) raft_consensus.cc:1685] finished
0709 12:13:40.957158 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:40.957362 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16902,"prepare.queue_time_us":325134,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":3279,"raft.queue_time_us":35797,"raft.run_cpu_time_us":469,"raft.run_wall_time_us":15547,"spinlock_wait_cycles":6650752,"thread_start_us":388562,"threads_started":2,"wal-append.queue_time_us":225896}
I20260709 12:13:40.935568  3201 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:40.960978  2995 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.957s	user 0.011s	sys 0.002s
I20260709 12:13:40.976537 26617 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:40.984323 26620 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 30: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:40.985586  3298 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:40.972200 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:40.986246  3298 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:40.988791  3252 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:40.990180  3303 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:40.990651  3303 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:40.991628  3303 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:40.993541  2920 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:40.994025  2920 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:40.995584  2920 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 29.19, Last appended by leader: 19, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:40.997246  2920 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:40.998513  3292 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:40.998762  3236 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:40.999179  3236 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:40.957722  3274 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:41.012130  3274 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:41.026877 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 54855.1us
I20260709 12:13:40.970649  3181 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:41.030095 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:41.077175 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.001748  2995 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:41.003046  3261 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
W20260709 12:13:41.088316 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 58361.6us
W20260709 12:13:41.094496  3239 consensus_meta.cc:287] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.991s	user 0.009s	sys 0.005s
I20260709 12:13:41.096989  3239 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:41.103274 27168 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:41.107252  3239 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:41.099858  3122 consensus_meta.cc:287] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.811s	user 0.008s	sys 0.004s
I20260709 12:13:41.108011  3122 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:41.109468 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:41.111469  3307 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:41.111912  2995 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:41.113029 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:41.113999  3181 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:41.113924  3122 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:41.114318 26513 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:41.115227  2969 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:41.115571  3307 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:13:41.116158  3307 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 34 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:41.118692  3300 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
W20260709 12:13:41.119124  3294 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:13:41.119871  3122 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.120981 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:41.117455  3307 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 32.21, Last appended by leader: 21, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:41.121827  3109 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:41.122625  3253 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:41.122488  3109 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:41.122830 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:41.120846  3122 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:41.123207  3253 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:41.124949  3109 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:41.125444  3253 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:41.125571  3109 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:41.126195  3109 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:41.126756  3298 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:41.127786  3278 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.404s	user 0.003s	sys 0.002s
I20260709 12:13:41.127203  3109 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:41.129207 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3365) took 1017 ms. Trace:
I20260709 12:13:41.129657 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3429) took 1043 ms. Trace:
I20260709 12:13:41.021234  3236 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 29.20, Last appended by leader: 20, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:41.098170  3214 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:41.131088  3236 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:41.136389  3221 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:41.137701  3299 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:13:41.138509  3275 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:41.074834  2925 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.129593 26539 rpcz_store.cc:276] 0709 12:13:40.112293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.114666 (+  2373us) service_pool.cc:224] Handling call
0709 12:13:40.133681 (+ 19015us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:40.134076 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:40.134107 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:40.148843 (+ 14736us) log.cc:844] Serialized 52 byte log entry
0709 12:13:40.365634 (+216791us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:40.365698 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:40.366979 (+  1281us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:41.114228 (+747249us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b24002b3358. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072e739c4 00007f5072e71acb 00007f507302cdc9 00007f507302ca55 00007f507302c09d 00007f5075c5e10e 00007f5075c7588c 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221
0709 12:13:41.128895 (+ 14667us) raft_consensus.cc:1685] finished
0709 12:13:41.128917 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:41.129144 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":200,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":14627,"spinlock_wait_cycles":7079168,"thread_start_us":127158,"threads_started":1,"wal-append.queue_time_us":375777}
I20260709 12:13:41.130141 26469 rpcz_store.cc:276] 0709 12:13:40.086171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.087038 (+   867us) service_pool.cc:224] Handling call
0709 12:13:40.087411 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:40.850178 (+762767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:41.129364 (+279186us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b54003205d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:41.129592 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1744253184}
I20260709 12:13:41.156730 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:41.173223 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 195634us
W20260709 12:13:41.241662 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 85080.3us
I20260709 12:13:41.243072 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:41.364323 26619 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
W20260709 12:13:41.365595 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 126835us
I20260709 12:13:41.074785  3283 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260709 12:13:41.371289 26621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 1569) took 1853 ms (client timeout 1883 ms). Trace:
I20260709 12:13:41.091111  3154 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:41.372013 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3780) took 1141 ms. Trace:
W20260709 12:13:41.372037 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 129031us
W20260709 12:13:41.370379 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 196245us
I20260709 12:13:41.372108 27159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 1158) took 1699 ms. Trace:
I20260709 12:13:41.381585 27159 rpcz_store.cc:276] 0709 12:13:39.665056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:39.665227 (+   171us) service_pool.cc:224] Handling call
0709 12:13:39.665663 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:39.941310 (+275647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:41.361289 (+1419979us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400530a54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:41.364107 (+  2818us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":628648320}
W20260709 12:13:41.374234 26621 rpcz_store.cc:269] 0709 12:13:39.510344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:39.510505 (+   161us) service_pool.cc:224] Handling call
0709 12:13:41.361041 (+1850536us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b540037a854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:41.363914 (+  2873us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007361920}
W20260709 12:13:41.385046  3286 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.538s	user 0.000s	sys 0.010s
I20260709 12:13:41.403501 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:41.405046 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:41.405897 26539 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 28: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:41.406852 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:41.407999 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:41.408610 26539 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:41.409478 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:41.380144 26618 rpcz_store.cc:276] 0709 12:13:40.230563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.230708 (+   145us) service_pool.cc:224] Handling call
0709 12:13:40.231026 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:40.231267 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:13:40.532723 (+301456us) log.cc:844] Serialized 14 byte log entry
0709 12:13:41.371615 (+838892us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:41.371701 (+    86us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:41.371749 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:41.371820 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:41.371952 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15122,"prepare.queue_time_us":135902,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":15533,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":1100005,"threads_started":3,"wal-append.queue_time_us":829478}
I20260709 12:13:41.410708 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:41.411967 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:41.411808  3292 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:41.413452 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:41.398201 26513 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:41.414057 26539 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:41.414732  3309 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:41.415792  3309 consensus_queue.cc:1243] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 24.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:13:41.417734  3198 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:41.365190  3200 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:41.449085 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 51573.7us
I20260709 12:13:41.375895  3275 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:41.462765 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:41.469571 26618 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:41.371070  3300 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:41.371137  3199 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.473059 26539 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:41.088057  3201 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:41.247004  2925 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:41.438580  3186 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.006s	user 0.014s	sys 0.005s
I20260709 12:13:41.500254 26618 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:13:41.084553  3246 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:41.512485 27163 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:13:41.463510  3292 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:41.534204 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:41.542100 26472 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 33. Current term is 34. Ops: []
W20260709 12:13:41.548050  3281 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.466s	user 0.000s	sys 0.001s
I20260709 12:13:41.550559 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3368) took 1420 ms. Trace:
I20260709 12:13:41.550763  3311 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:41.553432 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.555527 26469 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:41.559162 26465 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: [26.14-26.14]
I20260709 12:13:41.502785  3122 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:41.573606 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:41.578035 26469 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: [26.17-26.17]
I20260709 12:13:41.569621 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:41.479110  3197 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.072s
I20260709 12:13:41.588924 26468 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26. Ops: [25.17-25.17]
I20260709 12:13:41.551139 26545 rpcz_store.cc:276] 0709 12:13:40.130147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.132406 (+  2259us) service_pool.cc:224] Handling call
0709 12:13:40.132841 (+   435us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:13:40.186381 (+ 53540us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:40.186428 (+    47us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:13:40.208100 (+ 21672us) log.cc:844] Serialized 78 byte log entry
0709 12:13:40.479742 (+271642us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:40.535052 (+ 55310us) log.cc:844] Serialized 14 byte log entry
0709 12:13:40.979407 (+444355us) log.cc:844] Serialized 14 byte log entry
0709 12:13:40.979707 (+   300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:40.979824 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:41.550157 (+570333us) raft_consensus.cc:1685] finished
0709 12:13:41.550179 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:41.550442 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29501,"prepare.queue_time_us":54530,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":6661,"raft.queue_time_us":203195,"raft.run_cpu_time_us":579,"raft.run_wall_time_us":49371,"thread_start_us":641991,"threads_started":2,"wal-append.queue_time_us":750877}
I20260709 12:13:41.594650 26469 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 12:13:41.540766  3201 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:41.608132 26465 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26. Ops: [25.13-25.13]
I20260709 12:13:41.587941  3190 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:41.552976  3034 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.558182  3221 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.508193  3199 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:41.588331  3312 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.447s	user 0.001s	sys 0.000s
W20260709 12:13:41.625682 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 52159.8us
I20260709 12:13:41.475751  3200 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:41.560812  3179 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:41.535334  3185 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.077s
I20260709 12:13:41.545295  3285 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.067s
W20260709 12:13:41.624571  2945 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.358s	user 0.015s	sys 0.000s
I20260709 12:13:41.561729  3292 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:41.682153 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 526521us
W20260709 12:13:41.601388  3286 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 12:13:41.652264  2985 consensus_meta.cc:287] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.439s	user 0.015s	sys 0.000s
I20260709 12:13:41.610322  3190 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:41.696743  3190 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:41.698575  2971 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.001s
W20260709 12:13:41.687776 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 225971us
I20260709 12:13:41.702033 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3604) took 1374 ms. Trace:
I20260709 12:13:41.716506 26541 rpcz_store.cc:276] 0709 12:13:40.327682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.014936 (+687254us) service_pool.cc:224] Handling call
0709 12:13:41.024965 (+ 10029us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:41.079713 (+ 54748us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:13:41.079748 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:41.085612 (+  5864us) log.cc:844] Serialized 52 byte log entry
0709 12:13:41.518519 (+432907us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:41.528067 (+  9548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:41.528195 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:41.701772 (+173577us) raft_consensus.cc:1685] finished
0709 12:13:41.701793 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:41.701971 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5459,"raft.queue_time_us":49400,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":5099,"thread_start_us":322604,"threads_started":1,"wal-append.queue_time_us":477441}
I20260709 12:13:41.562939  3311 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:41.692478 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 224477us
I20260709 12:13:41.680898  3318 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:41.637920  3221 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:41.642259  3034 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:41.726891 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:41.690959  3186 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:41.745850 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4574) took 1536 ms. Trace:
I20260709 12:13:41.677573  2945 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:41.742609 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:41.747414  2915 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:41.755385  2915 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:41.759284  2915 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:41.761337  2915 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:41.763680 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:41.750193 26464 rpcz_store.cc:276] 0709 12:13:40.209906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.225637 (+ 15731us) service_pool.cc:224] Handling call
0709 12:13:40.225978 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:40.262040 (+ 36062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:40.262073 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:40.265613 (+  3540us) log.cc:844] Serialized 26 byte log entry
0709 12:13:40.565901 (+300288us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:40.678754 (+112853us) log.cc:844] Serialized 14 byte log entry
0709 12:13:40.679032 (+   278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:40.679107 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:41.745608 (+1066501us) raft_consensus.cc:1685] finished
0709 12:13:41.745629 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:41.745769 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31588,"prepare.queue_time_us":113165,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":33140,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":32763,"thread_start_us":247996,"threads_started":1,"wal-append.queue_time_us":441507}
W20260709 12:13:41.746407  3102 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.008s	sys 0.008s
W20260709 12:13:41.773084  3102 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.009s	sys 0.008s
I20260709 12:13:41.773314 26465 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 30: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:41.773180  2915 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:41.727771  2985 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:41.754555  3191 consensus_meta.cc:287] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.805s	user 0.014s	sys 0.000s
I20260709 12:13:41.739642  3318 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:41.785389 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:41.786330 26468 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 30: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:13:41.785542  3236 consensus_meta.cc:287] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.001s
I20260709 12:13:41.802603  3318 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:41.803812  2945 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:41.768164  3307 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.804576  3307 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:41.805428  3015 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:41.780517  3308 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.311s	user 0.001s	sys 0.001s
I20260709 12:13:41.784528  3297 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.220s
I20260709 12:13:41.774494  2985 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:41.806049  3015 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:41.806483  2962 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.810554  3191 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:13:41.808260  3306 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.419s	user 0.000s	sys 0.001s
I20260709 12:13:41.770967  3317 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.340s
I20260709 12:13:41.763023  3186 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:41.816288  3300 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:41.896811 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 261497us
W20260709 12:13:41.863909  3316 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 12:13:41.900346 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3605) took 1539 ms. Trace:
I20260709 12:13:41.864158  2925 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:41.989907 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 51879.4us
I20260709 12:13:41.931646 26543 rpcz_store.cc:276] 0709 12:13:40.361456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.114991 (+753535us) service_pool.cc:224] Handling call
0709 12:13:41.115333 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:41.115719 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:41.115751 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:41.116277 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 12:13:41.473616 (+357339us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:41.864599 (+390983us) log.cc:844] Serialized 14 byte log entry
0709 12:13:41.899991 (+ 35392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:41.900074 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:41.900126 (+    52us) raft_consensus.cc:1685] finished
0709 12:13:41.900141 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:41.900280 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39449,"raft.queue_time_us":3643,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"thread_start_us":649433,"threads_started":2,"wal-append.queue_time_us":480017}
I20260709 12:13:41.896327  2962 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:42.021747 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:41.809406  3292 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.17, Last appended by leader: 17, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:41.933459  3319 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
W20260709 12:13:41.935824  3315 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
I20260709 12:13:41.939096  3328 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:41.914116  3191 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.027416  2971 consensus_queue.cc:1243] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 32.21 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 19
I20260709 12:13:42.028229 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:42.054320 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:42.029933 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:41.991828  2915 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:42.031915 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 289421us
W20260709 12:13:42.033466 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 307942us
I20260709 12:13:41.936544  3199 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:42.048139 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4570) took 1839 ms. Trace:
I20260709 12:13:42.057375 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:42.060359 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:42.061199 27159 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:13:42.065322 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.067282 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:42.059404 26471 rpcz_store.cc:276] 0709 12:13:40.208654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.208770 (+   116us) service_pool.cc:224] Handling call
0709 12:13:40.233200 (+ 24430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:40.631819 (+398619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:40.631871 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:40.689679 (+ 57808us) log.cc:844] Serialized 26 byte log entry
0709 12:13:41.028249 (+338570us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:41.028318 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:41.028433 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:42.036754 (+1008321us) raft_consensus.cc:1685] finished
0709 12:13:42.036783 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.048052 (+ 11269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29491,"raft.queue_time_us":28359,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":63,"thread_start_us":657452,"threads_started":2,"wal-append.queue_time_us":361824}
I20260709 12:13:42.075407 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:42.071249 27160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 1187) took 1148 ms. Trace:
I20260709 12:13:42.024982  3307 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:42.080315 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 85729.7us
I20260709 12:13:42.076645 27160 rpcz_store.cc:276] 0709 12:13:40.922915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.923077 (+   162us) service_pool.cc:224] Handling call
0709 12:13:40.923538 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:40.924002 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:40.924045 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:40.924682 (+   637us) log.cc:844] Serialized 26 byte log entry
0709 12:13:41.248726 (+324044us) raft_consensus.cc:1645] Marking committed up to 22
0709 12:13:41.248768 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:41.248849 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:42.070899 (+822050us) raft_consensus.cc:1685] finished
0709 12:13:42.070932 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.071162 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13096,"raft.queue_time_us":1505,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":6364,"thread_start_us":291615,"threads_started":1,"wal-append.queue_time_us":513577}
I20260709 12:13:42.086352 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:42.058416  3328 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:42.095302 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.100616 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:42.104952  2983 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.547s	user 0.012s	sys 0.003s
W20260709 12:13:42.106873  3329 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 12:13:42.070981  3300 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.19, Last appended by leader: 19, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.114522  3328 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:42.083061  3034 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:42.091348  3320 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.354s	user 0.000s	sys 0.001s
I20260709 12:13:42.091202  3336 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:42.099952  3321 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
I20260709 12:13:42.097853  3221 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:42.148339  3349 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.159006  3349 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:42.133603  3307 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.162910  3307 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:42.167268  3186 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:42.168097  3191 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:42.169446  3015 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:42.169591 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:42.149613  3200 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:42.171207 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:42.171379  3349 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:42.172138 26613 raft_consensus.cc:2410] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 32 because replica has last-logged OpId of term: 30 index: 22, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 21.
I20260709 12:13:42.150451 27164 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 1186) took 1231 ms. Trace:
I20260709 12:13:42.149789 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:42.151562 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:42.147948  3322 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:13:42.192170 26616 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:13:42.193284 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:42.089627  3317 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 12:13:42.115567  3236 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.206624 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:42.207604 27160 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:42.174819 27164 rpcz_store.cc:276] 0709 12:13:40.919264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.919504 (+   240us) service_pool.cc:224] Handling call
0709 12:13:40.931177 (+ 11673us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:40.955239 (+ 24062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:40.955274 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:40.964111 (+  8837us) log.cc:844] Serialized 52 byte log entry
0709 12:13:41.239621 (+275510us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:41.239825 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:41.239935 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:42.150135 (+910200us) raft_consensus.cc:1685] finished
0709 12:13:42.150160 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.150341 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19991,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":239904,"threads_started":1,"wal-append.queue_time_us":509947}
I20260709 12:13:42.210526 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:42.212393 26616 raft_consensus.cc:2410] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 26 because replica has last-logged OpId of term: 24 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 17.
I20260709 12:13:42.145478  3343 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:42.173817  3341 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:42.224778 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 71564.4us
W20260709 12:13:42.280583 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 47612.4us
I20260709 12:13:42.175719  3336 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:42.206506  3034 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.024s
I20260709 12:13:42.289690 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:42.290526 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:42.291383  3214 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.160s	user 0.012s	sys 0.000s
I20260709 12:13:42.298007  3208 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.298619  3208 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:42.300977 26620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 4535) took 2216 ms (client timeout 2741 ms). Trace:
W20260709 12:13:42.301414 26620 rpcz_store.cc:269] 0709 12:13:40.084733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.090999 (+  6266us) service_pool.cc:224] Handling call
0709 12:13:42.300719 (+2209720us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b540020a154. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:42.300889 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2051353856}
W20260709 12:13:42.304709  3342 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:13:42.291553  3337 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
W20260709 12:13:42.292344  3334 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
W20260709 12:13:42.289311 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.294056 27162 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:13:42.213534  3236 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.330571 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:42.217262  3191 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.070s
I20260709 12:13:42.313068 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1300) took 2093 ms. Trace:
I20260709 12:13:42.316619  2962 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:42.216609  3221 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.069s
W20260709 12:13:42.288452  3320 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:13:42.332597 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:42.334689 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:42.335258 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:42.344517 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:42.345319 26620 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 31 because replica has last-logged OpId of term: 29 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 17.
I20260709 12:13:42.345492 26616 raft_consensus.cc:2410] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 31 because replica has last-logged OpId of term: 29 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 17.
I20260709 12:13:42.346191 26615 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 29: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:42.306241  3252 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 12:13:42.218147  3351 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.090s
I20260709 12:13:42.335906 27159 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
W20260709 12:13:42.349086  2783 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.806s	user 0.011s	sys 0.006s
I20260709 12:13:42.349428  3336 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:42.349562  2783 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.343884  3109 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:42.351148  3109 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:42.352144 26614 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27. Ops: [26.16-26.16]
I20260709 12:13:42.353315  2945 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:42.353596  3109 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:42.353937  2945 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.354552  2925 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:42.355214  2925 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.356173  2945 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:42.356396 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3779) took 2131 ms. Trace:
I20260709 12:13:42.356742 26617 rpcz_store.cc:276] 0709 12:13:40.224604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.224744 (+   140us) service_pool.cc:224] Handling call
0709 12:13:40.250739 (+ 25995us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:40.982217 (+731478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:42.356094 (+1373877us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b5400032d54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:42.356300 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1668460800}
I20260709 12:13:42.357442  2925 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:42.358611  3154 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:42.359124  3154 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.359520  3236 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:42.354709  3302 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.534s	user 0.015s	sys 0.022s
I20260709 12:13:42.362084 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3374) took 2157 ms. Trace:
I20260709 12:13:42.323511  3317 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.333056  3034 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:42.365381 26438 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:42.354241  3109 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:42.223572  3341 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:42.364004 26546 rpcz_store.cc:276] 0709 12:13:40.204856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.363280 (+158424us) service_pool.cc:224] Handling call
0709 12:13:40.388631 (+ 25351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:40.412160 (+ 23529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:40.412195 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:40.454891 (+ 42696us) log.cc:844] Serialized 26 byte log entry
0709 12:13:40.782599 (+327708us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:40.782735 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:40.782978 (+   243us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:42.354355 (+1571377us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b24002b3358. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072e739c4 00007f5072e71acb 00007f507302cdc9 00007f507302ca55 00007f507302c09d 00007f5075c5e10e 00007f5075c7588c 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221
0709 12:13:42.361748 (+  7393us) raft_consensus.cc:1685] finished
0709 12:13:42.361779 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.362016 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23128,"raft.queue_time_us":30359,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":24549,"spinlock_wait_cycles":46028160,"thread_start_us":228225,"threads_started":1,"wal-append.queue_time_us":299127}
I20260709 12:13:42.218416  3343 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.361410  3154 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:42.379038 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:42.382336  2962 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:42.385111  3191 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:42.381264 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3598) took 2169 ms. Trace:
I20260709 12:13:42.400288 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:42.382550 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:42.392020  3341 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:42.352047  2783 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:42.393204  2920 consensus_meta.cc:287] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.395s	user 0.008s	sys 0.003s
W20260709 12:13:42.428754 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 49782us
I20260709 12:13:42.343616  3181 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.397179 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:42.403441 26546 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:42.406651 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3372) took 2252 ms. Trace:
W20260709 12:13:42.407343  3268 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.449s	user 0.013s	sys 0.000s
I20260709 12:13:42.380308  3317 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:42.409016  3343 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:42.445528 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:42.447047 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:42.447705 26472 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:13:42.409545  3109 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:42.356755  2945 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:42.401547 26540 rpcz_store.cc:276] 0709 12:13:40.211547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.816575 (+605028us) service_pool.cc:224] Handling call
0709 12:13:40.817067 (+   492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:40.961121 (+144054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:40.961850 (+   729us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:40.976025 (+ 14175us) log.cc:844] Serialized 26 byte log entry
0709 12:13:41.454418 (+478393us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:41.513406 (+ 58988us) log.cc:844] Serialized 14 byte log entry
0709 12:13:41.513654 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:41.513789 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:42.381046 (+867257us) raft_consensus.cc:1685] finished
0709 12:13:42.381069 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.381205 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26097,"prepare.queue_time_us":56560,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":146584,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":43074176,"thread_start_us":572633,"threads_started":2,"wal-append.queue_time_us":552813}
I20260709 12:13:42.440975 26470 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 12:13:42.473917 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:42.476917 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:42.477826 26470 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:13:42.431105 26548 rpcz_store.cc:276] 0709 12:13:40.154496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.318721 (+164225us) service_pool.cc:224] Handling call
0709 12:13:40.325460 (+  6739us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:40.493742 (+168282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:40.493774 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:40.494322 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 12:13:40.706128 (+211806us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:40.706184 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:40.706289 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:42.395424 (+1689135us) spinlock_profiling.cc:243] Waited 7.91 ms on lock 0x7b24002b3358. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072e739c4 00007f5072e71acb 00007f507302cdc9 00007f507302ca55 00007f507302bfb0 00007f5075ca2488 00007f5075ca2be8 00007f5075c7a398 00007f5075c7576a 00007f5075c74bb6
0709 12:13:42.399805 (+  4381us) raft_consensus.cc:1685] finished
0709 12:13:42.399827 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.406561 (+  6734us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5982,"raft.queue_time_us":56687,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4108,"spinlock_wait_cycles":18195840,"thread_start_us":358426,"threads_started":2,"wal-append.queue_time_us":369032}
I20260709 12:13:42.479151 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:42.448998 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:42.452288 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:42.410121  3274 consensus_meta.cc:287] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.331s	user 0.006s	sys 0.007s
I20260709 12:13:42.437143 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:42.393241  3318 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.590s	user 0.007s	sys 0.004s
I20260709 12:13:42.455325 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:42.475630 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.490136 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:42.400261  3246 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:42.481065 26467 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:13:42.500427 26472 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:13:42.398265  3201 consensus_meta.cc:287] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.745s	user 0.009s	sys 0.000s
I20260709 12:13:42.484259 26470 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:42.480384 26468 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:13:42.451177  3122 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:42.519255 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:42.449921  3154 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.504040 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:42.440285  3181 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.416657  3191 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:42.545644 26546 raft_consensus.cc:2410] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 12:13:42.428929  2971 raft_consensus.cc:3055] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:42.430189  2962 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:42.440781  3265 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.516377 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:42.516806 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:42.518005 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:42.518219 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:42.398857  3130 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:42.523169 26539 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:13:42.553995 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:42.554600 27162 raft_consensus.cc:2410] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 31 because replica has last-logged OpId of term: 29 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 17.
I20260709 12:13:42.498313  2945 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.398356  3311 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:42.498003  3275 consensus_meta.cc:287] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.022s	user 0.012s	sys 0.003s
I20260709 12:13:42.381716  3034 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.535207 26620 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 31.
I20260709 12:13:42.536540 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:42.563557 26471 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:13:42.564441 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:42.541359 26548 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:13:42.505203 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:42.489332  3253 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:42.546955 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:42.548985  3221 consensus_queue.cc:1243] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 27.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:13:42.500103  3246 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.489604  3199 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:42.573617  3246 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:42.501379  3179 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.574751  3179 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.503799  3358 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:42.554795 26617 raft_consensus.cc:2376] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25. Re-sending same reply.
I20260709 12:13:42.550673  3362 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:42.559368 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:42.455585  3268 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:42.560860 26465 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:42.561058 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:42.567656 27168 raft_consensus.cc:2410] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 32 because replica has last-logged OpId of term: 30 index: 22, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 21.
I20260709 12:13:42.554092  3130 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:42.581992 26616 raft_consensus.cc:2410] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 31 because replica has last-logged OpId of term: 29 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 19.
I20260709 12:13:42.567930 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:42.556947  3201 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:42.585170 26548 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 31 because replica has last-logged OpId of term: 29 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 17.
I20260709 12:13:42.585436  2915 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:13:42.586591  3361 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:13:42.583386  3214 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:42.587365  3332 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.025s
I20260709 12:13:42.588150 26464 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 30: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:42.573770  3199 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:42.590427  3199 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:42.558178 26613 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 25: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:42.572392  3284 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:42.592022  3284 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.501165  3318 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.586120  2915 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:42.587376  3214 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.596292  3318 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:42.596603  2945 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:42.597087 26618 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:42.583748 26469 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:42.500993  3274 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:42.549391  2971 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:42.615460 26546 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 12:13:42.579180  3292 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:42.625526  3190 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:13:42.625978  3190 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:42.626879  3130 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.557981  3265 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.552094  3154 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.628293  3130 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:42.629861  2969 raft_consensus.cc:3055] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:42.630671 26472 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:42.614354  3122 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:42.585879  3300 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:42.621028  3214 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:42.623420  3303 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:42.622975  2971 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.612331  3284 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:42.624331  3304 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:42.579447  3275 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:42.628369 27163 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 1169) took 2160 ms (client timeout 2730 ms). Trace:
I20260709 12:13:42.620329  3371 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:42.654469 27163 rpcz_store.cc:269] 0709 12:13:40.468101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.470548 (+  2447us) service_pool.cc:224] Handling call
0709 12:13:42.628153 (+2157605us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b540060de54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:42.628274 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2225015040}
I20260709 12:13:42.658325  3371 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.626937  3292 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.639885 26588 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:42.630292  3154 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:42.662636 26469 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 30 index: 19. Preceding OpId from leader: term: 34 index: 22. (index mismatch)
I20260709 12:13:42.633561 26471 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:42.631114  3336 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:42.581292  3253 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:42.628289  3034 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:42.668217 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:42.630306  2969 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:42.663921 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 173575us
I20260709 12:13:42.578203  3358 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:42.673218 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 115963us
I20260709 12:13:42.666358 26588 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:42.678699 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:42.676034 26472 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:42.655685  3304 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:42.667944  3288 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:42.661167  3371 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:42.662209  3274 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:42.683885 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:42.715528 27163 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:13:42.687541  3265 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:42.676010  2971 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:42.669711  3292 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:42.718286 26588 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:42.689038 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1576) took 2194 ms. Trace:
I20260709 12:13:42.597735  3362 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.668937  2920 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:13:42.691896  3122 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.693146  3109 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:42.693940  3317 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:42.626879  3190 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 33.21, Last appended by leader: 21, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.682695  3337 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:42.695077  2969 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.696278  3253 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:42.675261  3336 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.697530 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:42.735014 26471 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:42.735630  3268 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:42.736204 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:42.736923 26471 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:42.736992  2983 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:42.737530  2983 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:42.738497  2983 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.739514  2983 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:42.728344 27162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d"
dest_uuid: "3262bf0553e543eea76794fc529a9acc"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:35448
I20260709 12:13:42.743680 27167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 1182) took 2232 ms. Trace:
I20260709 12:13:42.743908 27162 raft_consensus.cc:606] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:42.744113 27167 rpcz_store.cc:276] 0709 12:13:40.510874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.511128 (+   254us) service_pool.cc:224] Handling call
0709 12:13:40.511456 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:40.813566 (+302110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:42.743325 (+1929759us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b54003b5e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:42.743591 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684180352}
I20260709 12:13:42.744326 27162 raft_consensus.cc:614] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:42.700837  3369 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:42.708813  3358 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:42.713831 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:42.670835  3366 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.721110 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:42.613960  3191 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.719606 26619 rpcz_store.cc:276] 0709 12:13:40.494920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.496524 (+  1604us) service_pool.cc:224] Handling call
0709 12:13:41.363972 (+867448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:41.364810 (+   838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:42.688803 (+1323993us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b540037a850. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:42.688963 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1994001152}
I20260709 12:13:42.724267 26439 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:42.778424 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 54216.7us
I20260709 12:13:42.665596  3311 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.050s
I20260709 12:13:42.745262  3154 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.784446  3154 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.785727  3201 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:42.786955  3154 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:42.748478  3336 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:42.788388  2925 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 12:13:42.752629  3325 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.024s	user 0.003s	sys 0.000s
I20260709 12:13:42.752900 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:13:42.748406  3373 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.753772  2969 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:42.757725 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3612) took 1615 ms. Trace:
I20260709 12:13:42.748972  3374 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:42.798959 26471 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:13:42.761977 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:42.800674 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:42.725255  3221 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:42.764062 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:42.764680 26543 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
W20260709 12:13:42.778169 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.778695 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:42.778936 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:42.713128  3288 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:42.778713 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:42.807266 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:42.774982  3369 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:42.783713  3362 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:42.786521  3304 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.732654  3337 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:42.793634 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:42.779403 26439 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:42.756346 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3603) took 2438 ms. Trace:
I20260709 12:13:42.798545 26539 rpcz_store.cc:276] 0709 12:13:41.142687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.488240 (+345553us) service_pool.cc:224] Handling call
0709 12:13:42.757498 (+1269258us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b54003377d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:42.757636 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2272404864}
I20260709 12:13:42.792392 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:42.759840 26546 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 12:13:42.821146 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3606) took 2435 ms. Trace:
I20260709 12:13:42.821342 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:42.803051  3191 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:42.821586 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:42.763063  2962 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.822837  2962 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:42.764771  3015 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:42.808135 26548 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 18.
I20260709 12:13:42.803226 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:42.821590 26544 rpcz_store.cc:276] 0709 12:13:40.385312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.120723 (+735411us) service_pool.cc:224] Handling call
0709 12:13:41.121129 (+   406us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:41.121521 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:41.121549 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:41.122302 (+   753us) log.cc:844] Serialized 52 byte log entry
0709 12:13:41.487773 (+365471us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:41.487817 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:41.487902 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:42.749848 (+1261946us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:42.815567 (+ 65719us) raft_consensus.cc:1685] finished
0709 12:13:42.815589 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.821071 (+  5482us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2602,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"spinlock_wait_cycles":35894400,"thread_start_us":120535,"threads_started":1,"wal-append.queue_time_us":404777}
I20260709 12:13:42.805449 26514 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:42.815724 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3376) took 2540 ms. Trace:
W20260709 12:13:42.841337 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 62028.8us
I20260709 12:13:42.798367  3341 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.017s
I20260709 12:13:42.801404  3374 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:42.805330  3221 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.809363  3318 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:42.838656 26547 rpcz_store.cc:276] 0709 12:13:40.275602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.824410 (+548808us) service_pool.cc:224] Handling call
0709 12:13:40.932307 (+107897us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:40.940472 (+  8165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:42.813089 (+1872617us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54003386d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:42.815645 (+  2556us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246771456}
I20260709 12:13:42.836912 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:42.818110 26542 rpcz_store.cc:276] 0709 12:13:40.318357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.932968 (+614611us) service_pool.cc:224] Handling call
0709 12:13:40.933390 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:40.954379 (+ 20989us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:13:40.973100 (+ 18721us) log.cc:844] Serialized 14 byte log entry
0709 12:13:41.095367 (+122267us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b180045cd00. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a23a 00007f50760e4a2a
0709 12:13:41.590539 (+495172us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:41.629334 (+ 38795us) log.cc:844] Serialized 26 byte log entry
0709 12:13:41.629524 (+   190us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:42.299238 (+669714us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b180045cd00. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:13:42.755728 (+456490us) log.cc:844] Serialized 14 byte log entry
0709 12:13:42.755970 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:42.756060 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:42.756100 (+    40us) raft_consensus.cc:1685] finished
0709 12:13:42.756113 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.756281 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1602108,"prepare.queue_time_us":1152769,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":63,"raft.queue_time_us":86760,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":13104,"spinlock_wait_cycles":62229888,"thread_start_us":494909,"threads_started":1,"wal-append.queue_time_us":716264}
I20260709 12:13:42.814682  3371 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:42.854012 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:42.849399 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:42.855691 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:42.855845 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:42.856421 26546 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 28.
I20260709 12:13:42.857896 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:42.858686 26548 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 29.
I20260709 12:13:42.842799 26439 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:42.860319 26439 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:42.861487 26439 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:42.794505  3366 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:42.857678 26514 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:42.864084 26439 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:42.829419  3337 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:42.867444 26539 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:42.868289 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:42.869604 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.870741 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:42.802377  3373 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:42.851073  3221 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:42.843739  3362 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:42.844595  3358 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:42.849468  3274 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:42.851399  3318 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:13:42.887392 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.863087  3300 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:42.857260  3130 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:42.863476  3304 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:42.864576  3268 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:42.864372  3198 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:42.853497  3154 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.889761 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:42.864741  3276 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:42.866602  3371 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 29 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:42.884446 26439 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:42.904814 27133 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:42.843986  3015 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:42.936371 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.971403 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:42.983973 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:42.867491  3253 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:13:42.975915 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.885673  3275 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:42.871721  3375 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:13:42.988240 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 103909us
I20260709 12:13:42.989100 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:42.892132  3318 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:42.909587 26438 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:42.973137 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:42.984398 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 79725.1us
W20260709 12:13:42.929445 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:42.987249 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.877511  3373 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:42.977689  3378 log.cc:927] Time spent T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:13:42.952049  3130 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.885600  3358 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.027565 26546 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 29: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:13:43.028605 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:43.039268 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:42.981572  3231 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.609s	user 0.052s	sys 0.092s
W20260709 12:13:43.036302 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 126866us
W20260709 12:13:43.039705 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.036175 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:43.042192  3231 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.670s	user 0.055s	sys 0.095s
I20260709 12:13:43.043110  3109 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:43.045895  3109 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 27.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:43.046839  3375 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:43.047260  3375 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:43.047554 26439 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:43.048621  3109 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:43.048262  3375 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.049888  3375 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:43.051184 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:43.053925 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:42.988399  3275 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.055600  3275 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:43.058833 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:42.953466  3341 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.073s
W20260709 12:13:43.070804 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.024892 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:43.061904 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:43.062601 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:43.064585 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:43.038295  3130 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:43.005043  3362 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:43.079596 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:43.080881 26539 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 12:13:42.990556  3311 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:43.083310 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 58532.8us
I20260709 12:13:43.085259 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:43.085731 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:43.039680  3253 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:42.879021  3288 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.069839  3358 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:43.061365  3373 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:43.089293 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:43.104180 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:43.105435 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:42.987270  3154 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.106739 27167 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
I20260709 12:13:43.118615  3288 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:43.119716  3379 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:13:43.119966  3181 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:43.121989 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:43.123000 26621 raft_consensus.cc:2410] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 25 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 12:13:43.124109 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:43.126138 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:43.112238 26471 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 12:13:43.130992 26471 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26. Ops: [25.17-25.17]
I20260709 12:13:43.133940 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4539) took 2747 ms. Trace:
I20260709 12:13:43.134419 26614 rpcz_store.cc:276] 0709 12:13:40.387094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.389251 (+  2157us) service_pool.cc:224] Handling call
0709 12:13:40.399782 (+ 10531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:42.352638 (+1952856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.133655 (+781017us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b54001b0654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:43.133865 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4489397504}
I20260709 12:13:43.114578  2962 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:43.135685  3371 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.136541  2962 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.115106 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:43.003508  3246 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:43.110857  3373 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.142175  3373 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:43.142315 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:43.143342 26620 raft_consensus.cc:2410] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 28 because replica has last-logged OpId of term: 27 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 16.
I20260709 12:13:43.144330 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:43.145589 26471 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: [26.17-26.17]
I20260709 12:13:43.087735  2525 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:43.127875  3311 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:43.135811 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:43.159924 26621 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:43.172127 26621 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 29 index: 20. Preceding OpId from leader: term: 30 index: 20. (term mismatch)
I20260709 12:13:43.172772 26621 pending_rounds.cc:85] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 19
I20260709 12:13:43.173081 26621 pending_rounds.cc:107] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 29.20
I20260709 12:13:43.173413 26621 raft_consensus.cc:2889] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:43.175702 26621 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:43.176235 26621 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:43.003059  3374 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:43.183970 26621 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.160364  2525 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:43.163609  3311 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:43.198570 26621 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:43.207738 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:43.222692 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:43.223220 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.225333  3317 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:43.199220  3369 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:43.200627  3275 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:43.228082 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:43.229111  3275 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:43.229624  3154 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:43.202690  3292 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.230684  3122 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:43.230261  3154 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:43.231492  3122 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:13:43.231876  3292 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:43.212672  3311 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:43.198908  2962 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:43.232357  3337 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:43.235699  3303 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:43.212769  2525 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:43.236275  3303 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.232445  3358 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.208112  2983 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.239212  3208 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:43.238983  2983 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:43.235275 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:43.243093 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 157910us
W20260709 12:13:43.310329 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.246253 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:43.327261 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 81126.7us
W20260709 12:13:43.325555 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 91571.2us
I20260709 12:13:43.332077 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:43.225998  3317 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:43.240783  3285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.522s	user 0.010s	sys 0.010s
I20260709 12:13:43.342998 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:43.343703 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:43.345323 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.348991 26464 raft_consensus.cc:2393] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 31: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:43.353047 26621 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 14. (term mismatch)
I20260709 12:13:43.353703 26621 pending_rounds.cc:85] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 13
I20260709 12:13:43.354095 26621 pending_rounds.cc:107] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 26.14
I20260709 12:13:43.354543 26621 raft_consensus.cc:2889] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:43.240315  3303 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:43.241320  3246 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:43.324818  3200 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:43.335239  2945 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:13:43.351025  3285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.631s	user 0.010s	sys 0.010s
I20260709 12:13:43.410722  2983 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:43.336833  3368 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:43.359781  3181 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:43.371227 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:43.371008  3200 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.416267 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:43.416669 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.417181 26472 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 30: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:13:43.372507  3385 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
W20260709 12:13:43.373574  3386 log.cc:927] Time spent T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:13:42.336580 26466 rpcz_store.cc:276] 0709 12:13:40.220070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.546810 (+326740us) service_pool.cc:224] Handling call
0709 12:13:40.667619 (+120809us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:40.679665 (+ 12046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:40.679716 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:40.709942 (+ 30226us) log.cc:844] Serialized 26 byte log entry
0709 12:13:41.072747 (+362805us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:41.244079 (+171332us) log.cc:844] Serialized 14 byte log entry
0709 12:13:42.312407 (+1068328us) spinlock_profiling.cc:243] Waited 8.93 ms on lock 0x7b18002bc660. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5072fefa40 00007f5072fea4e4 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287 00007f50760f5208
0709 12:13:42.312622 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:42.312698 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:42.312741 (+    43us) raft_consensus.cc:1685] finished
0709 12:13:42.312841 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.312996 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":148870,"prepare.queue_time_us":171623,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":5378,"raft.queue_time_us":1073832,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":31785,"spinlock_wait_cycles":20536192,"thread_start_us":312900,"threads_started":1,"wal-append.queue_time_us":676571}
I20260709 12:13:43.421929 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:43.348384  3154 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.041s
I20260709 12:13:43.388368  3337 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:43.404383 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:43.435298 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:43.437211 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.416579  3200 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:43.439375 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:43.405418  3362 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:43.408085  3317 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:43.408653  3358 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:43.348639  3331 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:43.422843 26468 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27. Ops: [25.15-26.16]
I20260709 12:13:43.423825 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:43.458108 26613 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:43.425773  3190 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:43.366761  2932 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 12:13:43.341812  3341 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:43.418112 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:43.399252  3130 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.434029 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:43.344149  3369 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.087s
I20260709 12:13:43.429416  3246 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.445008 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:43.489625 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:43.490989 26613 raft_consensus.cc:2410] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 31 because replica has last-logged OpId of term: 29 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 17.
I20260709 12:13:43.445020  3253 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.010s
W20260709 12:13:43.446936  3221 consensus_meta.cc:287] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.002s
I20260709 12:13:43.461381 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:43.461587 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:43.466034  3341 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.504866 26615 raft_consensus.cc:2368] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 29. Current term is 30.
W20260709 12:13:43.506922 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 45652.3us
I20260709 12:13:43.481810 26439 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:43.512321  3390 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:13:43.524501 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:43.525490 26466 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:13:43.530623  3307 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:43.509543  3221 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:43.533046  3382 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.447s	user 0.001s	sys 0.000s
I20260709 12:13:43.533555  3221 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:43.459578  3331 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:43.544622 26619 raft_consensus.cc:2368] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 31. Current term is 32.
I20260709 12:13:43.511333  3341 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:43.517748  3181 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:43.550629 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:43.496132  3246 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.549626  3181 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:13:43.560418 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 301554us
I20260709 12:13:43.570335  3261 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:43.570860  3261 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:43.571166 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 111555us
I20260709 12:13:43.571602  3261 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.572644  3261 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:43.580530 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:43.582808 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.574014 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:43.587189 27166 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Advancing to term 32
I20260709 12:13:43.572752 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:43.573071 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:43.589445 26466 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 12:13:43.589579 26439 leader_election.cc:400] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 29. Current term is 30.
I20260709 12:13:43.594288 26466 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26. Ops: [25.13-25.13]
W20260709 12:13:43.595125 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.589023 27164 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
W20260709 12:13:43.598483 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.591773 26439 leader_election.cc:403] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:43.561631  3181 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:43.598505 26466 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 25. Current term is 26. Ops: []
W20260709 12:13:43.602792 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.609714  3253 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 30
I20260709 12:13:43.602317 26621 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 17. (term mismatch)
I20260709 12:13:43.610615 26621 pending_rounds.cc:85] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 16
I20260709 12:13:43.610926 26621 pending_rounds.cc:107] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 26.17
I20260709 12:13:43.611214 26621 raft_consensus.cc:2889] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:43.611555 26471 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:43.613073 26466 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: [26.14-26.14]
I20260709 12:13:43.617312  3130 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:43.622961  3318 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.581s	user 0.015s	sys 0.000s
I20260709 12:13:43.623454  3318 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.624444  3373 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:43.625591 26471 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:43.625798  3318 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:43.626703 26616 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 32: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:43.628324  3311 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:43.631728  3246 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:43.634923  3304 consensus_meta.cc:287] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.660s	user 0.014s	sys 0.000s
I20260709 12:13:43.635916 26614 raft_consensus.cc:2410] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 25 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 12:13:43.638885 26620 raft_consensus.cc:2410] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 35 because replica has last-logged OpId of term: 33 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 30 index: 19.
I20260709 12:13:43.642771  3373 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:43.643306 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4552) took 1580 ms. Trace:
I20260709 12:13:43.643909 27159 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:13:43.676529 27168 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
W20260709 12:13:43.676960 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 72242.7us
I20260709 12:13:43.676509 27166 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:13:43.643744 26622 rpcz_store.cc:276] 0709 12:13:42.063332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.066705 (+  3373us) service_pool.cc:224] Handling call
0709 12:13:42.067058 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:42.079568 (+ 12510us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 12:13:42.144963 (+ 65395us) log.cc:844] Serialized 14 byte log entry
0709 12:13:42.227196 (+ 82233us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:42.227271 (+    75us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:42.227322 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.643033 (+1415711us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b540003c854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:43.643088 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:43.643244 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21102,"prepare.queue_time_us":35049,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":71630,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":8553,"spinlock_wait_cycles":28096768,"thread_start_us":103743,"threads_started":2,"wal-append.queue_time_us":202371,"wal-append.run_cpu_time_us":1304,"wal-append.run_wall_time_us":1030212}
I20260709 12:13:43.677616  3253 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 29. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 29. Current term is 30.
I20260709 12:13:43.687284  3331 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:43.677065  3246 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.688757  3246 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.691344  3246 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:43.708675 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3783) took 1706 ms. Trace:
I20260709 12:13:43.709246 26618 rpcz_store.cc:276] 0709 12:13:42.002617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.014486 (+ 11869us) service_pool.cc:224] Handling call
0709 12:13:42.014961 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:42.597573 (+582612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.708311 (+1110738us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54002602d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:43.708585 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1338272640}
I20260709 12:13:43.713789 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1435) took 1876 ms. Trace:
I20260709 12:13:43.714372 26543 rpcz_store.cc:276] 0709 12:13:41.837192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.997721 (+160529us) service_pool.cc:224] Handling call
0709 12:13:42.764325 (+766604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:42.802797 (+ 38472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.713485 (+910688us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b54003377d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:43.713698 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1762220416}
I20260709 12:13:43.692993 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4596) took 1249 ms. Trace:
I20260709 12:13:43.685566  3368 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.008s
W20260709 12:13:43.694031  3339 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.488s	user 0.003s	sys 0.000s
I20260709 12:13:43.696452  3179 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:43.697173  3198 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:43.702003 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.723095 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3613) took 2580 ms. Trace:
I20260709 12:13:43.723922 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:43.724687 26621 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:43.695501  2525 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:43.733631 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:43.723547 26541 rpcz_store.cc:276] 0709 12:13:41.142972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.720037 (+577065us) service_pool.cc:224] Handling call
0709 12:13:41.743879 (+ 23842us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:41.752194 (+  8315us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:13:42.760393 (+1008199us) log.cc:844] Serialized 14 byte log entry
0709 12:13:42.868650 (+108257us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:42.869095 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 12:13:42.869225 (+   130us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:42.878298 (+  9073us) log.cc:844] Serialized 14 byte log entry
0709 12:13:43.712492 (+834194us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b18002b8b80. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5072fefa40 00007f5072fea4e4 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287 00007f50760f5208
0709 12:13:43.712779 (+   287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.712900 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:43.722856 (+  9956us) raft_consensus.cc:1685] finished
0709 12:13:43.722881 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:43.723030 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1859021,"prepare.queue_time_us":1018966,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":961362,"raft.run_cpu_time_us":544,"raft.run_wall_time_us":42819,"spinlock_wait_cycles":12433152,"thread_start_us":107855,"threads_started":1,"wal-append.queue_time_us":210677}
W20260709 12:13:43.707072 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 48855.6us
I20260709 12:13:43.716621 26468 rpcz_store.cc:276] 0709 12:13:42.443276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.526734 (+ 83458us) service_pool.cc:224] Handling call
0709 12:13:43.422556 (+895822us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:43.457601 (+ 35045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.692770 (+235169us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b54002de6d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:43.692926 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2000019840}
I20260709 12:13:43.730897 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:43.736474 26622 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:13:43.732479 26439 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:43.739192 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:43.740226 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:43.738320 26439 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:43.737105 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:43.754587 26588 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:43.754769 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:43.760452 26588 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:43.731401  3198 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:43.769925 27166 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:43.772819 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1441) took 1002 ms. Trace:
W20260709 12:13:43.774919 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 194503us
I20260709 12:13:43.733642  3318 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:43.733822  3345 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:43.741371  3311 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:43.758214  3253 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:43.773285 26547 rpcz_store.cc:276] 0709 12:13:42.770120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.845875 (+ 75755us) service_pool.cc:224] Handling call
0709 12:13:42.862777 (+ 16902us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:42.863171 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:42.863202 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:42.879611 (+ 16409us) log.cc:844] Serialized 52 byte log entry
0709 12:13:43.084581 (+204970us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:43.159336 (+ 74755us) log.cc:844] Serialized 14 byte log entry
0709 12:13:43.772431 (+613095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.772518 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:43.772562 (+    44us) raft_consensus.cc:1685] finished
0709 12:13:43.772575 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:43.772750 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1449268,"prepare.queue_time_us":73887,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":1926,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":2537,"thread_start_us":110107,"threads_started":1,"wal-append.queue_time_us":304228}
I20260709 12:13:43.751852  3246 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:43.752945  3265 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:43.752724  3332 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.768252  3337 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:43.765604  3358 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:43.798105 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:43.799592 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:43.799651 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:43.765918  3130 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:13:43.766436  3283 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.807468  3409 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:43.857049 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3608) took 2739 ms. Trace:
I20260709 12:13:43.776295  3122 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 12:13:43.833868  3015 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:43.837325  3214 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:43.840183 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:43.839768 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:43.843907 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:43.843828 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:43.868999 26470 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 30: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:43.741837  3179 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:13:43.846174 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3440) took 2315 ms. Trace:
W20260709 12:13:43.851132 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.845026  3202 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:43.872613 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 73097.6us
I20260709 12:13:43.873821 27133 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:43.846560  3298 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.168s	user 0.015s	sys 0.015s
I20260709 12:13:43.803274  3253 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.860544  2985 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:43.805217  3345 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.799078  3318 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.886346  3185 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:43.883224  3398 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:43.892673  3185 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.892968  3318 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:43.893281  3185 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:43.842557  3246 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.849949  3337 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.891470  3214 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:43.844774  3310 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:43.901422 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:43.902621 26468 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
W20260709 12:13:43.884311 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44224us
I20260709 12:13:43.904858 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:43.843693  3275 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:13:43.857631 26545 rpcz_store.cc:276] 0709 12:13:41.110377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.605314 (+494937us) service_pool.cc:224] Handling call
0709 12:13:41.605785 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:41.606231 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:41.606273 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:41.632065 (+ 25792us) log.cc:844] Serialized 26 byte log entry
0709 12:13:41.927841 (+295776us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:42.761229 (+833388us) log.cc:844] Serialized 14 byte log entry
0709 12:13:42.761474 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:42.761559 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:43.693199 (+931640us) spinlock_profiling.cc:243] Waited 81.7 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:43.841434 (+148235us) raft_consensus.cc:1685] finished
0709 12:13:43.849123 (+  7689us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:43.849291 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":833009,"prepare.queue_time_us":834903,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":78522,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":3612,"spinlock_wait_cycles":187996416,"thread_start_us":243158,"threads_started":1,"wal-append.queue_time_us":440219}
I20260709 12:13:43.871496  3292 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:43.883926  3298 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.244s	user 0.016s	sys 0.016s
I20260709 12:13:43.870215 26473 rpcz_store.cc:276] 0709 12:13:41.529810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.530321 (+   511us) service_pool.cc:224] Handling call
0709 12:13:41.558325 (+ 28004us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:42.349560 (+791235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:42.349595 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:42.350131 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 12:13:42.544736 (+194605us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:42.544787 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.801525 (+1256738us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54002dc154. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:43.801604 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:43.801675 (+    71us) raft_consensus.cc:1685] finished
0709 12:13:43.801696 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:43.845251 (+ 43555us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":667817,"raft.queue_time_us":671414,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"spinlock_wait_cycles":282616704,"thread_start_us":194211,"threads_started":1,"wal-append.queue_time_us":262141,"wal-append.run_cpu_time_us":2109,"wal-append.run_wall_time_us":1069417}
W20260709 12:13:43.900240 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.901383 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:43.870707  3208 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:43.875662  3309 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.889899 26618 raft_consensus.cc:2410] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 32 because replica has last-logged OpId of term: 31 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 14.
I20260709 12:13:43.864557  3358 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:43.867522  3130 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:43.875381  2995 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.887461  3253 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:43.901343  3337 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:43.890689  3307 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:43.849579  3332 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.890983  3345 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:43.887096  3401 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.048s
I20260709 12:13:43.864259  3283 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.923350  2985 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:43.932086  3404 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:43.938997  3130 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 30.22, Last appended by leader: 22, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:43.940153  3201 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:43.941993 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1446) took 1077 ms. Trace:
I20260709 12:13:43.964622 26548 rpcz_store.cc:276] 0709 12:13:42.864740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.864915 (+   175us) service_pool.cc:224] Handling call
0709 12:13:42.865274 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:43.941042 (+1075768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:43.941073 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:43.941121 (+    48us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:13:43.941159 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.941702 (+   543us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002387d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:43.941760 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:43.941914 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2473574144}
I20260709 12:13:43.909102  3310 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.918020  3015 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:43.906244  3246 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:43.983340 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 1588) took 1190 ms. Trace:
W20260709 12:13:43.957948 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.984198  3283 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:43.984640 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.963552  3401 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Stepping down as leader of term 25
W20260709 12:13:43.985091 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.985162  3401 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:43.868415  3341 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:43.896703  3202 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:43.988250  3341 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:43.986182  3401 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.19, Last appended by leader: 19, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:43.989406 27162 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 30: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:43.990157  3401 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:43.922037  3292 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.993881  3292 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:43.967034  2985 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:43.994958  3201 consensus_queue.cc:1243] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 24.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:13:43.995667  3307 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:43.996081  3307 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:43.996430  2985 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:43.997092  3307 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.952230  2995 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.001055  2995 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:43.983851 26619 rpcz_store.cc:276] 0709 12:13:42.793181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.793350 (+   169us) service_pool.cc:224] Handling call
0709 12:13:43.983075 (+1189725us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b54003d7a54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:43.983257 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1657621888}
I20260709 12:13:43.934724  3309 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:43.968894  3404 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:44.007301  3309 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:44.009752  3404 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:43.984242  3310 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:43.924171  3208 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.013208  3208 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:43.976735  3214 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:44.015604 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1586) took 1435 ms. Trace:
I20260709 12:13:44.016263  3202 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:44.018865  3358 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:44.023408  3246 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.026435 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4601) took 1468 ms. Trace:
I20260709 12:13:44.026542  3387 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:44.027015 26469 rpcz_store.cc:276] 0709 12:13:42.558173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.598796 (+ 40623us) service_pool.cc:224] Handling call
0709 12:13:42.599077 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:42.667037 (+ 67960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.026145 (+1359108us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b540006a4d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:44.026337 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131331456}
I20260709 12:13:44.029688  3246 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:44.026093 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 161454us
I20260709 12:13:44.024853  3198 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:43.950871  3403 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.038s
W20260709 12:13:44.031849 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.016117 26617 rpcz_store.cc:276] 0709 12:13:42.580201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.580367 (+   166us) service_pool.cc:224] Handling call
0709 12:13:42.613914 (+ 33547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:42.712108 (+ 98194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:42.712142 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:42.712187 (+    45us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:13:42.712219 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.015366 (+1303147us) spinlock_profiling.cc:243] Waited 98 ms on lock 0x7b5400269154. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:44.015417 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:44.015539 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225344256}
I20260709 12:13:44.015735  3332 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:44.046353 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:43.992261  3181 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.054159 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.055135 26548 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:44.057024 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:44.058179 26545 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 30: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:44.059664 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.053642  3283 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:44.062608  3283 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.064949  3283 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:44.066452  3332 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.066910 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.067113  3332 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.068311 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.068534  3181 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:44.069593 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.070580 26540 raft_consensus.cc:2410] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 25 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 12:13:44.070983  3198 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:44.070779  3253 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.092568 27134 leader_election.cc:400] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 31. Current term is 32.
I20260709 12:13:44.093143 27134 leader_election.cc:403] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:44.094848  3410 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election lost for term 31. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 31. Current term is 32.
I20260709 12:13:44.069566  3332 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:44.053946  3202 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:44.038095  3015 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:44.079548  3197 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.081557 26540 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:44.083168 26547 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:44.085034  3368 raft_consensus.cc:3055] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:44.089602 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.117681 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.107045 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:13:44.115211 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 198929us
I20260709 12:13:44.120465 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.124541 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.126157 26545 raft_consensus.cc:2410] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 25 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 12:13:44.127647 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:44.122702 26513 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:44.128341 26539 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:44.132104 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:44.133152 26548 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:44.118279  3297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.912s	user 0.007s	sys 0.008s
I20260709 12:13:44.142596 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.144857 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.146517 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.147500 26540 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:13:44.116703  3202 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.151938  3015 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:44.153008  3202 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:44.125391  3197 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.154610  3420 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:44.155346  3420 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.155743  3420 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:44.156629  3197 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:44.158084  3252 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 27 current term: 27 is higher.
W20260709 12:13:44.146282  3297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.948s	user 0.008s	sys 0.008s
W20260709 12:13:44.159165 26465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 3454) took 1720 ms (client timeout 1882 ms). Trace:
I20260709 12:13:44.159680  3253 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:44.159629 26465 rpcz_store.cc:269] 0709 12:13:42.439161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.439311 (+   150us) service_pool.cc:224] Handling call
0709 12:13:44.158918 (+1719607us) spinlock_profiling.cc:243] Waited 69.8 ms on lock 0x7b54000dc5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:44.159064 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160642816}
I20260709 12:13:44.119223  3368 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:44.161963  3368 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.162884 26546 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:13:44.163095  3368 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:44.165843 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.166932 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:44.168270 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.168452  2525 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:44.169885 26540 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: [22.15-26.17]
I20260709 12:13:44.166590  3337 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:44.154753 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:44.141981  3328 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.924s	user 0.010s	sys 0.028s
I20260709 12:13:44.174216 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.175376 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.177968 26546 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 22.
I20260709 12:13:44.151093 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.180372 26539 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:44.181051 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.181440 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.183399 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:44.186143 26546 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:44.181661 26545 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:13:44.189363 26548 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
W20260709 12:13:44.179255  3328 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.966s	user 0.011s	sys 0.028s
I20260709 12:13:44.191805 26548 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:44.193610 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:44.194378 26548 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:44.194789 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:44.195771 26469 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
I20260709 12:13:44.201470  3369 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Stepping down as leader of term 25
W20260709 12:13:44.201803  3415 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:13:44.201970  3369 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:44.202688 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:44.203017  3369 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:44.204150 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1447) took 1314 ms. Trace:
I20260709 12:13:44.206882 26542 rpcz_store.cc:276] 0709 12:13:42.889805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.892899 (+  3094us) service_pool.cc:224] Handling call
0709 12:13:42.977018 (+ 84119us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:43.734625 (+757607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:43.734657 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:43.758862 (+ 24205us) log.cc:844] Serialized 52 byte log entry
0709 12:13:43.934879 (+176017us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:43.934940 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.936083 (+  1143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:44.203948 (+267865us) raft_consensus.cc:1685] finished
0709 12:13:44.203969 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:44.204096 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":757086,"raft.queue_time_us":780081,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":1725,"thread_start_us":99131,"threads_started":1,"wal-append.queue_time_us":260339}
I20260709 12:13:44.209661 26542 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:44.209565 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:44.214442 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:44.219540 26465 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 30: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:44.186760  3122 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:44.229060 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.231830 26539 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:44.187099  2525 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.026s
I20260709 12:13:44.259225 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.280824  2525 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:44.281369  2525 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:44.282429  2525 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.20, Last appended by leader: 20, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:44.285506 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.304484 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:44.305881 27162 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:13:44.307085 26548 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:44.312054 26546 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:13:44.314546 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:44.314950 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:44.352208 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:44.352519 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.353283 27163 raft_consensus.cc:2410] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 26 because replica has last-logged OpId of term: 25 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 18.
W20260709 12:13:44.355398 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:44.372470 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 189053us
I20260709 12:13:44.256392  3369 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:44.378952 26548 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 25. Current term is 26. Ops: [25.19-25.19]
I20260709 12:13:44.382148 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.383792 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.384374 26546 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:44.319301  2525 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:44.396451 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:44.403119 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:44.404163 27166 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 29: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:44.402971 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:44.404488 26541 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 29: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:44.383250  3250 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:44.415047 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.415946 26541 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
I20260709 12:13:44.417147 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:44.418512 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.420073 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.312111  3185 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:44.428614 27160 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25. Ops: []
W20260709 12:13:44.418555 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.431296  3337 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:44.433362  2915 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:44.386090  3328 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 19, Time since last communication: 0.052s
W20260709 12:13:44.446959 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.458712 26541 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 30: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:13:44.466720 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:44.470592  3386 log.cc:927] Time spent T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:13:44.471463 26544 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 29. Current term is 30. Ops: [29.20-29.20]
I20260709 12:13:44.478340  3122 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:44.489085 26542 raft_consensus.cc:1217] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 34 LEADER]: Deduplicated request from leader. Original: 30.19->[31.20-33.21]   Dedup: 31.20->[33.21-33.21]
I20260709 12:13:44.489807 26542 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 34 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 33. Current term is 34. Ops: [31.20-33.21]
I20260709 12:13:44.496413  3420 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.497920 26547 raft_consensus.cc:2368] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26.
I20260709 12:13:44.498867 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.499253 26546 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:44.500344  3388 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:44.502133 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.503839  3388 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:44.516976 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.520157  3388 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:44.522342  3122 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.523001  3122 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.525305  3122 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:44.525918  3303 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:44.525326 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:44.526876  3303 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:44.529886  3303 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:44.530620  3261 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.530766  3411 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 27.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:44.531502  3261 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.532199  3411 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:44.532644  3411 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:44.533038  3411 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:44.534554  3366 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:44.534948 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.535167  3366 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.535722  3366 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:44.536350 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:44.537150 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:44.537724 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.537900  3366 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:44.534617  3285 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 28.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.005s
I20260709 12:13:44.525995  2983 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.540509  3307 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:44.539516 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.539935  2983 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.544605  2983 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:44.525578  3304 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:44.545938  3304 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.547995  3185 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:44.548749  3304 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:44.552999  3261 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:44.552551 26617 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 14. (term mismatch)
I20260709 12:13:44.554302 26617 pending_rounds.cc:85] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 13
I20260709 12:13:44.554679 26617 pending_rounds.cc:107] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 24.14
I20260709 12:13:44.554979 26617 raft_consensus.cc:2889] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:44.559013 26619 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:44.552371  3411 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.560349 26618 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:44.561276  3411 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:44.563606 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.564653 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:44.565438 26619 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:44.570731 27133 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:44.587515 26618 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 12:13:44.587528 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.591411 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4595) took 2148 ms. Trace:
I20260709 12:13:44.593699 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:44.591953 26467 rpcz_store.cc:276] 0709 12:13:42.443035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.500857 (+ 57822us) service_pool.cc:224] Handling call
0709 12:13:44.163184 (+1662327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:44.163544 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:44.163571 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:44.164076 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 12:13:44.260945 (+ 96869us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:44.261005 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.261102 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:44.262441 (+  1339us) raft_consensus.cc:1685] finished
0709 12:13:44.262462 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:44.572962 (+310500us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54000dc5d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:44.591336 (+ 18374us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9357,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":8946,"spinlock_wait_cycles":3822073600,"thread_start_us":96443,"threads_started":1,"wal-append.queue_time_us":76448}
I20260709 12:13:44.597610 26464 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:44.600328 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:44.601259 26617 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:44.579463  3366 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.618614 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:44.625748 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:44.626037 26618 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:44.600051  3185 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:44.622241 26619 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
W20260709 12:13:44.642377 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 103204us
I20260709 12:13:44.643203 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:44.639329 26618 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:13:44.641002 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.624445  3190 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.631156  3252 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.633908  3130 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.676676 26614 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:44.648547  3298 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:44.660974  3304 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:44.686880 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.683964 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.689399 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.634347  3366 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.687951 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:44.701758 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.673053  3122 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.696599 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.709225 26614 raft_consensus.cc:2410] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 27 because replica has last-logged OpId of term: 25 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 12.
I20260709 12:13:44.705245 27163 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:13:44.701707  3109 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:13:44.711947  3181 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:44.712929  2945 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:44.713970  3437 consensus_queue.cc:1059] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:44.714745 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.715728  3154 raft_consensus.cc:3055] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:44.716168  3154 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:44.708585 26439 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:44.719311 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.719805 26439 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:44.721473  3411 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:44.721959  3253 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:44.722618  3253 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:44.722673  3276 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:13:44.724786  2925 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:44.726045  2925 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:44.726441  2925 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:44.726763 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:44.727504  2925 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:44.728715  3268 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:44.730484 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:44.731912 26514 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:44.726614  3411 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:44.716182 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:44.735648 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.737169  3411 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:44.737583  3201 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:44.738607  3418 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:44.727535 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:44.740154 27163 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:44.741729 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.694999 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.741523 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:13:44.744072 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 49210.1us
I20260709 12:13:44.744869 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.683861  3345 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:44.687050  2932 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:44.753748 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:44.740973  3201 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:44.684728  3298 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:44.664093  3190 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.753887 27134 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.759073  3420 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:44.761003  3366 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:44.740010  3411 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:44.691344  3197 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.690747  3261 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 28.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.076s
I20260709 12:13:44.677882  3130 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.723757  3253 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.671121  3252 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.784859 27134 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.778779  3185 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:44.774196 26514 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.67:42217 timed out after 1.614s (SENT) [suppressed 11 similar messages]
I20260709 12:13:44.694619  3285 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.075s
I20260709 12:13:44.762882  3358 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:44.755832  3283 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.755357  3109 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:44.756628  3345 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:44.770888  3328 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:44.785477 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.750224  3122 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.784619  3368 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:44.801681 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.789830  3197 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.818279  3190 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:44.799237  2525 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:44.787847  3300 consensus_queue.cc:1059] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:13:44.802210 26614 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 31. Current term is 32. Ops: []
I20260709 12:13:44.803289 26619 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 33 index: 21. Preceding OpId from leader: term: 34 index: 22. (index mismatch)
I20260709 12:13:44.837294 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.838249 26621 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
W20260709 12:13:44.839664 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 54286.5us
I20260709 12:13:44.807325  3345 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:44.840734 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.841079 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.843703 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.847185 26464 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
I20260709 12:13:44.847919 26618 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 29 index: 19. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
I20260709 12:13:44.815464  3341 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:44.849975 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.836156  2932 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:44.799073 27163 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:44.858407 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:44.837543  3246 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.859179 26621 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:13:44.851737 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 87365.7us
I20260709 12:13:44.852424 26617 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:44.860970 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.862469  3250 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:44.862469 26439 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:44.863797  3439 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:13:44.863725  3250 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election won for term 27
W20260709 12:13:44.864327 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.864519  3250 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:13:44.865600  3435 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:13:44.865728  3250 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.873307 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.874567  2983 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:44.875073  2983 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:44.875483  2983 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:44.807722  3283 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.880697 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:44.888128  2932 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 12:13:44.888525  3440 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:13:44.889745 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3825) took 1041 ms. Trace:
I20260709 12:13:44.890645  3197 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:44.890206 26613 rpcz_store.cc:276] 0709 12:13:43.848133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.848381 (+   248us) service_pool.cc:224] Handling call
0709 12:13:43.848856 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:43.849340 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:13:43.867251 (+ 17911us) log.cc:844] Serialized 14 byte log entry
0709 12:13:44.155895 (+288644us) spinlock_profiling.cc:243] Waited 8.43 ms on lock 0x7b18003946c0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:13:44.497899 (+342004us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b18003946c0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5079fae58f 00007f5072fed571 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd
0709 12:13:44.796285 (+298386us) log.cc:844] Serialized 14 byte log entry
0709 12:13:44.797057 (+   772us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:44.810594 (+ 13537us) log.cc:844] Serialized 26 byte log entry
0709 12:13:44.810829 (+   235us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:44.810887 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.810992 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:44.889493 (+ 78501us) raft_consensus.cc:1685] finished
0709 12:13:44.889516 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:44.889677 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":658744,"prepare.queue_time_us":49231,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":98,"raft.queue_time_us":616076,"raft.run_cpu_time_us":533,"raft.run_wall_time_us":23977,"spinlock_wait_cycles":28597376,"thread_start_us":294134,"threads_started":2,"wal-append.queue_time_us":206950}
I20260709 12:13:44.894511 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.895269 26617 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:13:44.853439  3411 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.902030 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.851696  3109 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:44.902585 26613 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:44.904838 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.905586 26618 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:13:44.903824 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.910758 26619 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 31: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:44.919612 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.806540  3298 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.920759 26613 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 30: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:13:44.903659  3438 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:13:44.927513 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.928282  3345 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.926308 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.928718 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.929924 26622 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 28: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:44.930234 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.931186 26617 raft_consensus.cc:2410] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 25 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 12:13:44.931804  3283 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:44.882112  3246 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:44.859238  3436 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.096s
I20260709 12:13:44.945168  3369 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:44.951942  3369 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:44.953593  3345 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:44.933909 26621 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:13:44.904165  3437 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:44.946507 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:44.948691 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:44.933763 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.955471 26465 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:44.955749 26468 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 30: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:44.946008 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:44.946868 26543 raft_consensus.cc:2410] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 27 because replica has last-logged OpId of term: 26 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 15.
I20260709 12:13:44.956681 26542 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:44.934276 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:44.937317 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.941017 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.938171 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:44.959049 26613 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:13:44.928314 26618 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:13:44.887092 26438 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:44.960942 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:44.946923 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.933861 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:44.957810 26467 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:13:44.966060 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:44.967695 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:44.968393 26548 raft_consensus.cc:2376] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28. Re-sending same reply.
I20260709 12:13:44.959371 26469 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:44.971673 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:44.972847 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:44.974548 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:44.975590 26469 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
W20260709 12:13:44.979821 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 92868.2us
I20260709 12:13:44.979914 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:44.984012 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:44.989054 26472 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
W20260709 12:13:44.954295  3441 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:13:44.990633 26469 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 29: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:44.990502 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.991712 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:44.995158 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.017534 26470 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:13:44.999083 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:45.002486 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:45.002920 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:45.019716 26544 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:45.003957 26471 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 12:13:45.004613 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:45.006680 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:44.948240  3122 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:45.004643 26438 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:45.008018 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:45.012001 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:44.932749  3318 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 27.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.059s
I20260709 12:13:44.980297  3276 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:45.020802 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:45.022872 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 248688us
I20260709 12:13:44.990229  3437 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:45.026840 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.046026 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:45.030083 26465 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:13:45.032253 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.025780 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:45.029613 26472 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
W20260709 12:13:45.040298 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.038952 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.007689  3265 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.048346 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.046123 26613 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31. Ops: []
I20260709 12:13:45.049013 26472 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:45.048509  3265 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:45.048507 26468 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:13:45.049815 26473 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:45.051151  3265 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:45.052978 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:45.053548 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:45.054008 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 49478.7us
I20260709 12:13:45.054536 26464 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:13:45.055953 26438 leader_election.cc:400] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26.
I20260709 12:13:45.056285 26438 leader_election.cc:403] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:45.053609 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:45.046659 26470 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:45.060276 26473 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:13:45.043653 26542 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:13:45.061551 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.062489 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:45.063416 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:45.065502 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:45.067996 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:45.068856 26539 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:45.071091 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:45.071854 26548 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:13:45.075013 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:45.034176  3317 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:45.080096 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:45.081308  3190 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:45.104911  3190 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:45.105010  3015 raft_consensus.cc:3055] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:45.105494  3190 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:45.105657  3015 raft_consensus.cc:740] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:45.107698 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.107002  3015 consensus_queue.cc:260] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:45.110442  3252 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:45.081625  3434 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
I20260709 12:13:45.110924 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:45.085397  3437 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:45.111829 26548 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:45.112807 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3632) took 1063 ms. Trace:
I20260709 12:13:45.112668  3437 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:45.113060 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:45.113232 26543 rpcz_store.cc:276] 0709 12:13:44.049751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.059382 (+  9631us) service_pool.cc:224] Handling call
0709 12:13:45.112550 (+1053168us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b54002f8ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:45.112741 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2037928704}
I20260709 12:13:45.087327 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:45.088649  3303 raft_consensus.cc:3055] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:45.045523  3369 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:45.092157  3276 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.075716  3345 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:45.075525  3285 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:45.066542  3371 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:45.095068 26469 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:45.095100 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:45.073693 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:45.100100 26544 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:13:45.101938  2925 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:45.118772 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:45.121083 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:45.122303 26543 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:45.143499 26614 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:45.119900  3122 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:13:45.127219  2932 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:45.145728  2932 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.110277  3015 raft_consensus.cc:3060] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:45.148034  2932 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:45.128476 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:45.149274 26548 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:45.142580 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:45.144338 26542 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
W20260709 12:13:45.141464 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 67865.5us
I20260709 12:13:45.120011  3303 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:45.152035 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:45.152957 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:45.123343  3317 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:45.076598  3265 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.068s
I20260709 12:13:45.126036  3285 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:45.155000 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:45.150938 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:45.126184  3345 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:45.162516 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:45.163471 26613 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:13:45.152518  3428 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:45.148878  3371 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:45.167796 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:45.156929  3411 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:13:45.170591  3297 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:13:45.193379  3297 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.193833  3297 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:13:45.158771  3443 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:45.205127 26473 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31. Ops: []
I20260709 12:13:45.205476  3443 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:45.206036  3443 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:45.209442 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:45.209702  3265 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:45.171352  3250 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:45.210179 26621 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:13:45.172034  3317 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.212256 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.212801 26622 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 29. Current term is 30. Ops: [29.18-29.18]
I20260709 12:13:45.213102 26472 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:45.215057 27133 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:45.216274  3369 raft_consensus.cc:2804] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:45.216396 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:45.216813  3341 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:45.216939  3369 raft_consensus.cc:697] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:45.217381  3341 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:45.217608  3185 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:45.214035 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:45.218070  3185 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:45.174361 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:45.216183 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.176221 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:45.219591 26470 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 30: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:45.219642 26543 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:13:45.163471  3345 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:45.177177 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:45.220408 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:45.221302 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:45.178849 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:45.214032 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.183118  2971 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:45.183858 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:45.183776  3371 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:45.228062 26619 raft_consensus.cc:2393] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 23: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:45.227696 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.229564 26470 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:13:45.186461 26588 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:45.230808 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.230156 26548 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:45.231617 26470 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:45.192318 26542 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:13:45.164812  2525 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.161465  3285 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:45.202812 26614 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:13:45.247704 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:45.248721 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.250137 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:45.250612 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 64316.7us
I20260709 12:13:45.210247  3265 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:45.219058 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:45.254905 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.255963 26472 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:45.256628 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:45.257843 26470 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 31: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:13:45.260289 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.219165 26539 raft_consensus.cc:2410] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 27 because replica has last-logged OpId of term: 25 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 12.
I20260709 12:13:45.224076 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:45.246299 27167 raft_consensus.cc:2393] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 32: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:45.167016  3428 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:45.270970 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 87196.2us
I20260709 12:13:45.273878 26547 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:45.271629 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.218639  3185 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:45.280246 26470 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:13:45.281620 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.209491  3122 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26.
I20260709 12:13:45.227905  2971 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.291428 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.290634 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.244755  3411 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:45.293018 26472 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:45.297483 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:45.298383 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:45.298256 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 46835.1us
I20260709 12:13:45.302692 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:45.303105 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:45.306217 26470 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:45.314258 26514 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:45.259367  2945 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.053s
I20260709 12:13:45.218009  3369 consensus_queue.cc:237] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:45.291538  2971 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:45.296981  3336 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 31.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 12:13:45.259984  2525 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:45.303802  3252 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:45.273751  3214 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 19, Time since last communication: 0.037s
I20260709 12:13:44.077253 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:45.224033  3303 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:45.315749  3445 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:45.346201  2525 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:45.319844  3265 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:45.307873  3428 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 28.15, Last appended by leader: 15, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.356408  3154 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.319105  3198 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.046s
I20260709 12:13:45.326150  3366 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:45.342731  3337 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:45.350605  3214 consensus_queue.cc:1243] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 33.21 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 19
I20260709 12:13:45.342213  3252 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.376375 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:45.386729 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 84149.3us
I20260709 12:13:45.350075  2971 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.415212 27162 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 22. Preceding OpId from leader: term: 32 index: 23. (index mismatch)
I20260709 12:13:45.373819  3304 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:45.382277  3337 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:45.363667  2983 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.423745 27167 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:45.407967  3252 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:13:45.418350  3461 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:13:45.420234  3154 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:45.370663  3411 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.451397 26618 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:45.432117  3304 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:45.458792  3304 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:45.488775  3468 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:45.509680  2983 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:45.512202  3298 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:45.572398  3190 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.574558  3369 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.518946 26472 raft_consensus.cc:1240] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25. Ops: [22.13-24.14]
I20260709 12:13:45.575277  3369 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:45.520490  3458 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:13:45.521257  3459 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 12:13:45.521906  3456 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 12:13:45.522744  3462 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:13:45.547214  2971 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:45.547726  3460 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 12:13:45.495752  3337 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:45.552273  3130 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:45.557199  3345 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.565120  3285 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:45.506217  3457 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:13:45.498958  3358 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.072s
W20260709 12:13:45.582142 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.585248 26362 catalog_manager.cc:5697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 17 to 30. New cstate: current_term: 30 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:45.593344  3443 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.598296  3268 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.672788  3268 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.675640 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:45.676512 26620 raft_consensus.cc:2410] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 27 because replica has last-logged OpId of term: 25 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 16.
I20260709 12:13:45.617331  3443 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:45.623251 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:45.630786  3190 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:45.631201  3185 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:45.632715  3297 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.634140  3252 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.648314 26618 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:13:45.649248 26616 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 29. Current term is 30. Ops: [29.18-29.18]
I20260709 12:13:45.649253 26622 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:13:45.653991  3202 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:13:45.680685  3476 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:13:45.657769  3198 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:45.681286  3198 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:45.683504  3198 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:45.684171  3285 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:45.658452  3214 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.684995  3214 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.685678 26469 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
I20260709 12:13:45.599355  3445 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:45.658954  3283 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:45.687618  3445 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:45.661659 26362 catalog_manager.cc:5697] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 16 to 17, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 17 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:45.665493  3410 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.689157  3410 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:45.689865  3445 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:45.663851  2932 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:45.690533  2932 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:45.691435  3410 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:45.691495  2932 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.18, Last appended by leader: 18, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:45.654155 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 339975us
I20260709 12:13:45.669951 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.669734  3303 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:45.693028 26472 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:13:45.669693 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.693609 26514 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:45.694013 26468 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:13:45.671067 26473 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 31. Current term is 32. Ops: []
I20260709 12:13:45.692634  2932 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:45.694600 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:45.672139 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:45.698930  3202 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:45.699369  3202 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:45.699740  3202 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:45.621078  3246 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:45.679754  3297 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:45.662165 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.687126  3214 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:45.704103  3214 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:45.704424 26514 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:45.704737  3214 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:45.705272  3214 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:45.705896 26514 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:45.687762  3283 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:45.654515 26615 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:45.706600  3201 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:45.708164  3283 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:45.708868  3201 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:45.709368  3201 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:45.710070  3268 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:45.710310  3201 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.712579 26470 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:13:45.673125  3337 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:45.717895 26514 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:45.725113 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:45.732996 26467 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:13:45.747628 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:45.750185  3307 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:45.750886  3307 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:45.729677  3015 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:45.751444  3307 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:45.751585  3015 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 25 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:45.752594  3015 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.753839  3015 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:45.743610  3265 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 12:13:45.739080  3198 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:45.759557  3198 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.760049  3198 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:45.760668  3185 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:45.770038 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 393723us
I20260709 12:13:45.771209 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:45.736570  3410 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.774247 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.777125 26464 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 30.
W20260709 12:13:45.781219 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.782963 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:45.742530  2925 consensus_meta.cc:287] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.592s	user 0.012s	sys 0.000s
I20260709 12:13:45.784152 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:45.787510 26622 raft_consensus.cc:2410] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 25 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 12:13:45.790735 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:45.790023 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.792865 26464 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
I20260709 12:13:45.804970 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.824529 26466 raft_consensus.cc:2410] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 26 because replica has last-logged OpId of term: 25 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 17.
I20260709 12:13:45.801290 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:45.833595 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:45.829810 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:45.837721  3358 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:45.838366  3185 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:45.838840  3185 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.839195  3185 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:45.840382  3442 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:45.840840  3442 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:45.841207  3442 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:45.763741  3246 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.091s
I20260709 12:13:45.834154  3369 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:45.844527  3369 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:45.844878  3369 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.845214  3369 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:45.847906 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:45.848147 26618 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:45.849975  3285 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:45.852485 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:45.855826  3214 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:45.856653  3285 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:45.856724  3214 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:45.857218  3285 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.857674  3285 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:45.835870  3341 consensus_meta.cc:287] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.618s	user 0.012s	sys 0.001s
I20260709 12:13:45.869593  3285 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.873236 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:45.875329  3358 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:45.875735  3358 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.876072  3358 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:45.787416  3303 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:13:45.855283  3442 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.787923  3410 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:45.886354  3358 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.889006  3410 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:45.888823  3185 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:45.890465  3345 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:45.823376  3388 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:45.891218 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:45.900704 26545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:13:45.901511 26545 raft_consensus.cc:606] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:13:45.902009 26545 raft_consensus.cc:614] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:45.905519 26362 catalog_manager.cc:5697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 24 to 28, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 28 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:45.907640 26362 catalog_manager.cc:5697] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 19 to 23, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 23 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:45.912750 26467 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 21. Preceding OpId from leader: term: 32 index: 23. (index mismatch)
I20260709 12:13:45.914604 26464 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:13:45.888098  3442 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:45.871833  3285 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:45.920262 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:45.916160 26470 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
I20260709 12:13:45.867673  3341 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:45.923069 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:45.923756  3341 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:45.924476 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:45.925105 26464 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:45.928949 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:45.929720 26467 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:45.932374 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:45.933786 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:45.937342 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:45.938642 26472 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:13:45.939260 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:45.939445 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:45.939754 26467 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:45.940109 26468 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:45.938689 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:45.940119 26469 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 29: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:45.939791  3418 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:13:45.943495 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:45.944115  3418 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 31 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:45.944340 26472 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:45.944671 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:45.945094  3418 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 31.15, Last appended by leader: 15, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:45.950224 26464 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:45.950510 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:45.951187 26467 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:45.953956  3418 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:45.956204 26472 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:13:45.957492  3285 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:45.896512  2925 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.959242 26362 catalog_manager.cc:5697] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:45.961841 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:45.962767 26467 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:45.963219 27159 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:45.963925 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:45.965106 27159 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 30. Current term is 31. Ops: []
I20260709 12:13:45.965768 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:45.967182 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:45.900542  3411 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:45.968423 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:45.973150 26544 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 26: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:45.973891 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:45.974604 26540 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:45.960229 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 256764us
I20260709 12:13:45.970713 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:45.985571  2525 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:45.970924 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:45.891036  3185 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:45.971848 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:46.001369 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:45.986207  2525 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:45.986801 26473 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 26: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:45.988452 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:45.993780 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:45.996315 26468 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:45.997848 27159 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:46.016791  3482 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.017479  3190 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:46.018357  3190 consensus_queue.cc:1243] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 24.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:13:46.020015  3337 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:46.021281 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:45.974119  3358 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:46.022606  3443 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:45.900626  3388 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:46.023250  3443 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:46.024219  3443 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:46.025121  3388 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:46.026566  3285 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 21, Time since last communication: 0.000s
I20260709 12:13:46.017432  3482 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:46.031139  3482 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:46.035960 26362 catalog_manager.cc:5697] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 25 to 29. New cstate: current_term: 29 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:46.037629 26362 catalog_manager.cc:5697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 26 to 28, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 28 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:46.038582  3252 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:46.039651 26362 catalog_manager.cc:5697] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 21 to 24, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 24 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:46.041379 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:46.041101 26362 catalog_manager.cc:5697] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 23 to 24, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 24 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:46.042192  3252 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:45.959054  3250 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.084s
I20260709 12:13:46.042819  3252 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:46.043322  3250 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:46.043704  3250 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:46.043769  3252 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:46.044660  3250 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:46.045913  3250 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:45.961154  3214 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:46.046813  3214 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:46.048087 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:46.048995  3214 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:45.967787  2925 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:46.050515  3246 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.051200  3478 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:13:46.051105  3246 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:46.008724  3411 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:46.052454 26368 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57052 (request call id 309) took 60682 ms (client timeout 15000 ms). Trace:
I20260709 12:13:46.052794 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:46.053328  3246 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:46.054292  3428 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:46.054868  3428 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:46.052919  3411 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:46.045928 26618 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 31 index: 18. (index mismatch)
I20260709 12:13:46.051734  3478 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:46.058867  2525 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:46.058626 26362 catalog_manager.cc:5697] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 27 to 29. New cstate: current_term: 29 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:46.066542 26545 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:13:46.067485 26362 catalog_manager.cc:5697] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:46.069470 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:46.070123 26545 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:46.071934 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:46.074486 26541 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 31 index: 19. (index mismatch)
I20260709 12:13:46.075055 26540 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
W20260709 12:13:46.076135 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 87800.4us
I20260709 12:13:46.078526 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:46.083665 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:46.070761 26362 catalog_manager.cc:5697] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 21 to 22, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 22 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:46.084975 26544 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
W20260709 12:13:46.078567 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 338727us
I20260709 12:13:46.051683  2925 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:46.094086 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:46.094326 26472 pending_rounds.cc:85] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 14
I20260709 12:13:46.095736 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:46.095990 26472 pending_rounds.cc:107] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 24.15
I20260709 12:13:46.096330 26472 raft_consensus.cc:2889] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:46.097014 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:46.052819 26368 rpcz_store.cc:269] 0709 12:12:45.395955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.398567 (+  2612us) service_pool.cc:224] Handling call
0709 12:13:46.052351 (+60653784us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:38.598805 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:38.599544 (+   739us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:38.599612 (+    68us) write_op.cc:435] Acquired schema lock
0709 12:13:38.599636 (+    24us) tablet.cc:662] Decoding operations
0709 12:13:38.608856 (+  9220us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:38.608994 (+   138us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:38.609024 (+    30us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:13:38.610314 (+  1290us) tablet.cc:701] Row locks acquired
0709 12:13:38.610368 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:13:38.610604 (+   236us) write_op.cc:270] Start()
0709 12:13:38.610777 (+   173us) write_op.cc:276] Timestamp: P: 1783599218610518 usec, L: 0
0709 12:13:38.610817 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 12:13:38.611627 (+   810us) log.cc:844] Serialized 5965 byte log entry
0709 12:13:39.254619 (+642992us) op_driver.cc:464] REPLICATION: finished
0709 12:13:39.438808 (+184189us) write_op.cc:301] APPLY: starting
0709 12:13:39.488728 (+ 49920us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:39.756654 (+267926us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:39.756786 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:40.188174 (+431388us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:40.317743 (+129569us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 12:13:40.345822 (+ 28079us) write_op.cc:312] APPLY: finished
0709 12:13:40.372157 (+ 26335us) log.cc:844] Serialized 139 byte log entry
0709 12:13:42.815499 (+2443342us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5072fd00ac 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b
0709 12:13:43.042732 (+227233us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:43.042921 (+   189us) write_op.cc:454] Released schema lock
0709 12:13:43.043038 (+   117us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:43.043499 (+   461us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:43.043528 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1190757,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":136556,"apply.run_cpu_time_us":176417,"apply.run_wall_time_us":3620476,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66767,"num_ops":15,"prepare.queue_time_us":299878,"prepare.run_cpu_time_us":58953,"prepare.run_wall_time_us":251693,"raft.queue_time_us":165057,"raft.run_cpu_time_us":50884,"raft.run_wall_time_us":191831,"replication_time_us":587794,"spinlock_wait_cycles":5757184,"thread_start_us":3207852,"threads_started":5,"wal-append.queue_time_us":2997830,"wal-append.run_cpu_time_us":6989,"wal-append.run_wall_time_us":2175107}]]}
I20260709 12:13:46.100034 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:46.077310  3214 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:46.022275  3337 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.069s
I20260709 12:13:46.067770  3388 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:46.111534 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:46.076640  3253 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.112712 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:46.098088  3345 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:13:46.098408  3358 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election lost for term 35. Reason: could not achieve majority
I20260709 12:13:46.055768  3428 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:46.112008 26514 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:46.084478  3475 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:46.121336 26544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:13:46.126024 26544 raft_consensus.cc:606] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:13:46.126591 26544 raft_consensus.cc:614] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:46.122785 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:46.098308  3190 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:46.121404  3253 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:46.136606 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:46.123015 26545 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:46.101693  3201 raft_consensus.cc:2764] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election decision vote started in defunct term 27: won
I20260709 12:13:46.078233  3307 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:46.132722 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:46.118423  3481 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:46.139472 26473 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 18. (term mismatch)
I20260709 12:13:46.148743 26473 pending_rounds.cc:85] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 17
I20260709 12:13:46.149147 26473 pending_rounds.cc:107] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 25.18
I20260709 12:13:46.149438 26473 raft_consensus.cc:2889] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:46.117389  3464 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:46.115818  3482 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.011s
I20260709 12:13:46.119421  3285 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:46.152136  3201 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:46.131122  3484 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:46.152844  3201 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:46.153210  3201 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:46.140324  3336 raft_consensus.cc:2764] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 12:13:46.142889 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:46.143826 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:46.159883  3285 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:46.160430  3285 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:46.161429  3285 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:46.138048 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:46.151963  3482 raft_consensus.cc:2764] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 12:13:46.160570 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:46.166373 26620 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:46.118670  3445 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.027s
I20260709 12:13:46.145004 26618 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:46.167649 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:46.174036 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:46.174753  3464 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:46.175514  3464 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:46.176669  3464 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:46.177033  3369 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:46.150665  3190 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.032s
I20260709 12:13:46.180022  3190 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:46.180529 27162 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 29 index: 20. Preceding OpId from leader: term: 30 index: 20. (term mismatch)
I20260709 12:13:46.180917 27166 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 19. (term mismatch)
I20260709 12:13:46.181334 27166 pending_rounds.cc:85] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 18
I20260709 12:13:46.181588 27166 pending_rounds.cc:107] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 25.19
I20260709 12:13:46.181843 27166 raft_consensus.cc:2889] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:46.180948 27162 pending_rounds.cc:85] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 19
I20260709 12:13:46.183578 27162 pending_rounds.cc:107] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 29.20
I20260709 12:13:46.183840 27162 raft_consensus.cc:2889] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:46.193194 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:46.194511 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:46.199853 27162 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:46.121044  3388 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:46.225066 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:46.194761 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:46.212391 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 382443us
I20260709 12:13:46.128070  2971 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
I20260709 12:13:46.238514 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:46.239672 27134 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:46.242513 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:46.248037 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.243443 26544 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 16. (term mismatch)
I20260709 12:13:46.248734 26544 pending_rounds.cc:85] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 15
I20260709 12:13:46.248994 26544 pending_rounds.cc:107] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 26.16
I20260709 12:13:46.249274 26544 raft_consensus.cc:2889] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:46.249996 27166 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:46.245092 26473 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:13:46.245484 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:46.250864 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:46.245708 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:46.247826 26619 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:13:46.245138 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:46.260358 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:46.270494 26439 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:46.246614  3483 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.273175 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:46.185475  3202 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:46.272739  3015 consensus_meta.cc:287] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.519s	user 0.012s	sys 0.002s
I20260709 12:13:46.270695  3410 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:46.299535  3253 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:46.299666  3485 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:46.300396  3485 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:46.302752  3485 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:46.309831 26546 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:46.311143  3202 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:46.272950  3261 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.040s
I20260709 12:13:46.318264 26546 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:46.141106  3478 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 29.19, Last appended by leader: 19, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:46.154295  3201 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 30.18, Last appended by leader: 18, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:46.279110  3198 consensus_meta.cc:287] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.518s	user 0.012s	sys 0.002s
W20260709 12:13:46.330166 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 50750.1us
I20260709 12:13:46.249235  3468 consensus_queue.cc:1059] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:13:46.335966  3468 raft_consensus.cc:3055] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:46.336478  3468 raft_consensus.cc:740] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:46.333416  3368 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.005s
I20260709 12:13:46.282822  3483 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:46.277757  3371 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:46.342778  3371 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.343382  3371 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:46.345077 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:46.349037 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:46.350455 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.259222  3442 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.031s
I20260709 12:13:46.281706  3268 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:46.383953 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:46.395201 27133 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:46.333331  2925 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.406276 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:46.406471 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:46.407127 26464 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 30.
I20260709 12:13:46.408394 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:46.360105  3414 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.363148  3268 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.384738  3246 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:46.362226  2932 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.038s
I20260709 12:13:46.401373  3341 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:13:46.392655  3201 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:46.337479  3468 consensus_queue.cc:260] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:46.408806 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:46.385022  3337 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:46.361789  3198 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:46.423132  3268 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:46.407395  3410 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:46.414623  2925 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:46.442952 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 330999us
I20260709 12:13:46.410846  3488 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:13:46.451987 26514 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:46.461805  3418 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:46.462512  3418 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:46.463092  3418 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:46.438612  3185 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:46.436811  3337 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:46.437664  3307 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:46.422562  3414 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:46.433825  3483 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:46.472160 26514 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:46.473496 26514 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:46.474908 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:46.483212 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:46.483969 26464 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:46.458503  3341 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.467355  3185 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:46.478348  3489 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:13:46.489687 27166 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:46.478096  3468 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:46.499637 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:46.481630  3202 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:46.480484  3336 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:46.482007  3485 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:46.497653  3185 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:13:46.539629 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 276011us
I20260709 12:13:46.506446 26464 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 27.
W20260709 12:13:46.507023 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 370485us
I20260709 12:13:46.549013 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:46.551427 26513 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:46.552896 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 76304.4us
I20260709 12:13:46.519850  3388 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:46.564126 26545 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 30 index: 16. (index mismatch)
I20260709 12:13:46.491776  3341 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:46.530928  3202 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:46.554075  3428 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 12:13:46.560297  3483 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:46.528940  2932 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.499850  3307 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 27.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.041s
I20260709 12:13:46.559806  3481 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:46.564188 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:46.567411 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:46.560372  3490 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:13:46.579923 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:46.604489 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:46.609519 26438 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:46.585055 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 313595us
I20260709 12:13:46.601591 26620 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31. Ops: [30.20-30.20]
I20260709 12:13:46.529955  3337 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 30.19, Last appended by leader: 19, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:46.627806 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:46.624485 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:46.634121 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:46.633572 26614 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:46.638106 26622 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:13:46.589376  3498 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:46.645740 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:46.646649 27160 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 19: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:46.646763 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:46.612684  3015 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:46.611570  3368 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:46.663571 26618 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 31. Current term is 32. Ops: []
I20260709 12:13:46.649448 26617 raft_consensus.cc:1217] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Deduplicated request from leader. Original: 30.19->[31.20-34.22]   Dedup: 31.20->[32.21-34.22]
I20260709 12:13:46.665318 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:46.652654 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:46.608248  3179 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.613075  3445 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:46.676047 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:46.677205 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:46.674969  3502 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:46.612461  3485 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:46.616104  3488 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:46.665477 26617 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 34. Current term is 35. Ops: [31.20-34.22]
I20260709 12:13:46.654839 26621 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:46.628847 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:46.619097  3198 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:46.682583 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.597872  3483 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:46.687366 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:46.691179 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:46.603688  2932 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:46.656816 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:46.648702  3498 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.717423 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:46.654572  3015 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:46.674929  2925 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:46.740914 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:46.663134  3337 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:13:46.743435 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 87003.5us
I20260709 12:13:46.653383  3411 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.066s
I20260709 12:13:46.758003 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:46.758735 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:46.759943 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:46.760552 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:46.763506 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:46.726090  2525 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:46.681466  3445 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.766762 26464 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 15. Preceding OpId from leader: term: 30 index: 16. (index mismatch)
I20260709 12:13:46.643885  3214 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 16, Time since last communication: 0.064s
I20260709 12:13:46.647881  3252 consensus_queue.cc:1059] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.077s
I20260709 12:13:46.705104  3502 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.775959 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:46.653633  3181 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:46.776834 26541 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 30.
I20260709 12:13:46.724299  3488 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:46.758999 26539 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
I20260709 12:13:46.769942 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:46.764703  2525 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:46.685031  3179 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:46.764657 26542 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 29.
I20260709 12:13:46.781759 26543 raft_consensus.cc:1275] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 13. (term mismatch)
I20260709 12:13:46.783241 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:46.787922 26543 pending_rounds.cc:85] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 12
I20260709 12:13:46.788260 26548 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 30.
I20260709 12:13:46.771734  3445 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:46.720476  3442 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 12:13:46.751303  3283 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:46.730525  3498 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:46.788291 26543 pending_rounds.cc:107] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 12:13:46.740482  3485 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.045s
I20260709 12:13:46.678746  3202 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:46.796281 26543 raft_consensus.cc:2889] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:46.798243 26543 pending_rounds.cc:107] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 24.14
I20260709 12:13:46.798599 26543 raft_consensus.cc:2889] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:46.723192 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 113790us
I20260709 12:13:46.797114 26539 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:13:46.799659 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:46.795804 26613 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:13:46.775666  3154 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:46.778935  3502 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:46.803738  2525 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:46.807348 26466 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 31 index: 19. (index mismatch)
W20260709 12:13:46.871788 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 89819.5us
I20260709 12:13:46.802724  3519 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:46.874639 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 75000.1us
I20260709 12:13:46.877887 26465 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
W20260709 12:13:46.865720  3493 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 12:13:46.865108  2925 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:46.890153 26539 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 29. Current term is 30. Ops: [29.18-29.18]
I20260709 12:13:46.894229 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:46.890269 26541 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:46.896287 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:46.808315  3443 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.075s
I20260709 12:13:46.897331 26541 raft_consensus.cc:2410] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 25 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
W20260709 12:13:46.883606  3495 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.317s	user 0.000s	sys 0.002s
I20260709 12:13:46.873994  3341 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:46.882989  3497 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
W20260709 12:13:46.899052 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 124250us
W20260709 12:13:46.900323 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.803290  3283 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:46.919327 26465 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:46.902266 26539 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:13:46.877168  3368 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:46.813582  3154 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:46.881299  3253 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:46.905684 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:46.933794 26613 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:46.931667 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:46.908066 26617 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:46.910709 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:46.880077  3250 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:46.790947  3015 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:46.912480 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:13:46.892444  3503 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
W20260709 12:13:46.901532  3494 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 12:13:46.925526 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:46.950865 26539 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:46.951150 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:46.951999 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:46.952723 26539 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:13:46.952865  3522 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:46.953573  3522 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:46.954074  3522 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:46.954207 26539 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:13:46.955487 26613 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:46.891455  3515 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 12:13:46.960899 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3857) took 1054 ms. Trace:
I20260709 12:13:46.938503  3341 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:46.947480  3501 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
W20260709 12:13:46.944936  3510 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.253s	user 0.001s	sys 0.001s
I20260709 12:13:46.891142  3519 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:46.926503  3485 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 29.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 12:13:46.966848 26539 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:13:46.962096 26615 rpcz_store.cc:276] 0709 12:13:45.906870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.907254 (+   384us) service_pool.cc:224] Handling call
0709 12:13:45.907628 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:45.907970 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:45.907996 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:45.915158 (+  7162us) log.cc:844] Serialized 26 byte log entry
0709 12:13:46.331683 (+416525us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:46.331745 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.331849 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:46.960582 (+628733us) raft_consensus.cc:1685] finished
0709 12:13:46.960611 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:46.960798 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16445,"raft.queue_time_us":555,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":9104,"thread_start_us":277343,"threads_started":1,"wal-append.queue_time_us":494830}
I20260709 12:13:46.900919  2925 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:46.947280  3483 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:46.889825  3488 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:46.975672  3341 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:46.963191  3307 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:13:46.983666  3499 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 12:13:46.984370  3511 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:13:46.934177  3368 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:46.994881  3368 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:46.987960 26540 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
W20260709 12:13:46.982723  3514 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:13:46.997095 26540 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:46.998760  3532 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 31.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:46.961762  3523 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:46.946239  3250 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:46.985317  3509 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
W20260709 12:13:46.982795  3518 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 12:13:47.001441  3201 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.562s	user 0.014s	sys 0.000s
W20260709 12:13:47.002133  3500 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.230s	user 0.000s	sys 0.002s
I20260709 12:13:46.963246  3428 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 12:13:47.023799 26539 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 30 index: 18. Preceding OpId from leader: term: 31 index: 18. (term mismatch)
I20260709 12:13:47.003973  2932 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:47.010134  3508 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:13:47.028081 26539 pending_rounds.cc:85] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 17
I20260709 12:13:46.971355  3464 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:13:47.031149  3179 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:47.005765  3523 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:47.041395 26539 pending_rounds.cc:107] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 30.18
I20260709 12:13:47.044461 26539 raft_consensus.cc:2889] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:47.059048  3154 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:47.060220  3517 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:13:47.051347  3190 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.068708  3190 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:47.023716  3485 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.028s
I20260709 12:13:47.091567  3341 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:47.093408  3411 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:47.095928  3524 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:47.103049  3369 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:47.046922  3523 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:47.111217 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 119517us
I20260709 12:13:47.115007 26514 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:47.124123 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3518) took 1043 ms. Trace:
I20260709 12:13:47.124826 26472 rpcz_store.cc:276] 0709 12:13:46.080654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.081068 (+   414us) service_pool.cc:224] Handling call
0709 12:13:46.094098 (+ 13030us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:46.122219 (+ 28121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:46.122252 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:46.122878 (+   626us) log.cc:844] Serialized 52 byte log entry
0709 12:13:46.443756 (+320878us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:46.443810 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.444771 (+   961us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:47.123753 (+678982us) raft_consensus.cc:1685] finished
0709 12:13:47.123790 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.124023 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1078,"raft.queue_time_us":9373,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":11904,"thread_start_us":312847,"threads_started":1,"wal-append.queue_time_us":539945}
I20260709 12:13:47.119390  3201 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.012s
I20260709 12:13:47.135124  3250 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:47.107976  3411 consensus_queue.cc:1243] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:13:47.109099  3524 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:47.118062  3268 consensus_meta.cc:287] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.662s	user 0.009s	sys 0.005s
I20260709 12:13:47.129998  3283 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:47.182535 27162 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:47.172459  3201 consensus_queue.cc:1243] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 33.21 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 19
W20260709 12:13:47.189872  3512 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.466s	user 0.002s	sys 0.000s
I20260709 12:13:47.189514  3498 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.174504  3307 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:13:47.195263  3185 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.631s	user 0.009s	sys 0.005s
W20260709 12:13:47.418104 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 232742us
I20260709 12:13:47.185168  3268 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:47.427786 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.428277 27134 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:47.303805  3307 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:47.435853  3179 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:47.255864  3190 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:47.204107  3371 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.860s	user 0.010s	sys 0.009s
I20260709 12:13:47.439412  3371 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.441215  3414 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:47.304296  3418 consensus_meta.cc:287] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.839s	user 0.016s	sys 0.000s
W20260709 12:13:47.163558 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 48631.6us
I20260709 12:13:47.443746  3185 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:47.445156  3410 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:47.445880  3410 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:47.446543  3410 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:47.416074 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3864) took 1041 ms. Trace:
W20260709 12:13:47.356312  3468 consensus_meta.cc:287] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.850s	user 0.011s	sys 0.001s
I20260709 12:13:47.359951  3498 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:47.459678 26471 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:47.455164 26619 rpcz_store.cc:276] 0709 12:13:46.377260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.378041 (+   781us) service_pool.cc:224] Handling call
0709 12:13:46.378379 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:46.378742 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:46.378769 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:46.379227 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 12:13:46.585426 (+206199us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:46.585686 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.585966 (+   280us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:47.189153 (+603187us) spinlock_profiling.cc:243] Waited 8.25 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:47.415125 (+225972us) raft_consensus.cc:1685] finished
0709 12:13:47.415182 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.415753 (+   571us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":803,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":12925,"spinlock_wait_cycles":18971392,"thread_start_us":166034,"threads_started":1,"wal-append.queue_time_us":254919}
I20260709 12:13:47.459472  3482 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:47.460984  3498 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 34 LEADER]: Stepping down as leader of term 34
I20260709 12:13:47.461620  3498 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 34 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:47.401865 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:47.416836  2925 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:47.357160  3522 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:47.466602 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:47.434003  3154 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:47.468168  3154 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.456655  3418 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.469447  3522 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:47.362860  3523 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:47.343211  3524 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 17, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.437091  3179 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.445220 26514 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:47.475296  3524 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:47.476204  3179 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:47.433983  3307 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.363309  3502 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.479768  3185 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:47.481000  3502 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:47.483311  3268 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:47.489032  3546 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:47.489996  3546 raft_consensus.cc:697] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:47.491881  3546 consensus_queue.cc:237] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.495024 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:47.496747 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 95461.2us
I20260709 12:13:47.500151  3522 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.501338  3522 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.502638  3523 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:47.496620  3337 consensus_meta.cc:287] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.742s	user 0.013s	sys 0.022s
I20260709 12:13:47.465483  3371 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:47.465171 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:47.508461 26471 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 30 index: 18. (term mismatch)
I20260709 12:13:47.509095 26471 pending_rounds.cc:85] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 17
I20260709 12:13:47.507228 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:47.509418 26471 pending_rounds.cc:107] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 29.18
I20260709 12:13:47.509809 26471 raft_consensus.cc:2889] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:47.511650 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:47.513554 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:47.507333 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:47.515125 26472 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:47.435096 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:47.515558 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:47.516345  3523 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:47.517023  3523 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:47.517640  3523 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:47.518911  3185 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:13:47.516539 26468 raft_consensus.cc:2368] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:13:47.514927  3369 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:47.523974  3478 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Stepping down as leader of term 24
W20260709 12:13:47.515455  3496 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.926s	user 0.009s	sys 0.006s
I20260709 12:13:47.525935  3190 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:47.526926  3337 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:47.527768  3443 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:47.527868  3154 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:47.528100  3411 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.566440  3411 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.567248 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:47.568300 26615 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
I20260709 12:13:47.568681  3388 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:47.461812  3482 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:47.569754  3482 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 25 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:47.569635  3388 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:47.571677 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 57778.3us
I20260709 12:13:47.571565  3482 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.555310 27159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1440) took 1495 ms. Trace:
I20260709 12:13:47.556293  3261 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.556893 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:47.557238 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:47.561326 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:47.574080  3482 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:47.574682  3185 consensus_queue.cc:1048] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:47.575052 27159 rpcz_store.cc:276] 0709 12:13:46.059399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.059608 (+   209us) service_pool.cc:224] Handling call
0709 12:13:46.059963 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:46.064787 (+  4824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:46.064821 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:46.067653 (+  2832us) log.cc:844] Serialized 26 byte log entry
0709 12:13:46.370928 (+303275us) raft_consensus.cc:1645] Marking committed up to 22
0709 12:13:46.370977 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.371068 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:47.514166 (+1143098us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:47.554494 (+ 40328us) raft_consensus.cc:1685] finished
0709 12:13:47.554525 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.555017 (+   492us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4423,"raft.queue_time_us":5115,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":17934,"spinlock_wait_cycles":12904832,"thread_start_us":272520,"threads_started":1,"wal-append.queue_time_us":447878}
I20260709 12:13:47.578734  3261 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.581148  3516 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:47.581878  3516 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:47.535578  3478 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:47.578603  3190 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:47.564590  3443 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.582190 26617 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:47.552740  3285 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:47.563043  3337 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.574092 26619 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 29.
W20260709 12:13:47.584079 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 149352us
I20260709 12:13:47.581957  3261 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:47.536571  3369 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:47.572764  3388 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:47.586221  3522 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:47.621748 26620 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 30.
I20260709 12:13:47.609350  3369 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:47.608872  3411 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:47.641750 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:47.642040 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:47.649328 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:47.652060  3478 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:47.653939  3337 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:47.654887  3410 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:47.657462 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:47.657176  3498 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 34.22, Last appended by leader: 22, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.626657  3418 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:47.666217 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.654789 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:47.672227 26620 raft_consensus.cc:1217] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Deduplicated request from leader. Original: 30.19->[31.20-34.22]   Dedup: 31.20->[32.21-34.22]
I20260709 12:13:47.674605 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:47.685420 26613 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:47.686569  3498 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:13:47.686996 26472 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31. Ops: [28.18-30.20]
W20260709 12:13:47.669162  3505 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.022s	sys 0.009s
I20260709 12:13:47.688191 26464 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27. Ops: [26.19-26.19]
I20260709 12:13:47.680038  3190 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:47.680619 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:47.690271 26620 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 34. Current term is 35. Ops: [31.20-34.22]
I20260709 12:13:47.696776  3268 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 12:13:47.698282  3538 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.396s	user 0.002s	sys 0.000s
I20260709 12:13:47.674633  3154 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.699308  3154 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:47.694095  3445 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.884s	user 0.018s	sys 0.011s
I20260709 12:13:47.699747 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:47.686585  3283 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:47.708086 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:47.708892 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:47.711293  3418 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.711946  3519 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:47.724844 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:47.727051 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 69800.5us
I20260709 12:13:47.724174  3418 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.711844 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:47.704365 26466 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:47.740237 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.719056 26467 raft_consensus.cc:2368] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 25. Current term is 26.
I20260709 12:13:47.699728  3268 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:47.721963  3185 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:47.722492  3543 log.cc:927] Time spent T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.369s	user 0.001s	sys 0.001s
I20260709 12:13:47.718811  3388 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:47.723281 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:47.723496  3443 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:47.728773  3481 consensus_queue.cc:1059] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 29.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:47.686878  3516 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.729455 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:47.732038 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:47.736444 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:47.738047  3418 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:47.723522  3154 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:47.740489  3445 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.741194  3523 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:47.786541 26465 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:47.786978 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:47.788381  3523 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:47.744750 27166 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27. Ops: []
W20260709 12:13:47.690042  3505 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.023s	sys 0.010s
I20260709 12:13:47.790633  3388 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:47.793377  3388 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:47.794775 27159 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:47.750442 26547 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:13:47.795871 26473 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: [28.16-28.16]
I20260709 12:13:47.751065  3410 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:47.752156 26622 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:47.796772  3481 consensus_queue.cc:1243] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 31.20 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 19
I20260709 12:13:47.753027 26540 pending_rounds.cc:85] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 14
I20260709 12:13:47.797473 26540 pending_rounds.cc:107] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 12:13:47.797789 26540 raft_consensus.cc:2889] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:47.797614  3214 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.023s
I20260709 12:13:47.798810 26471 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:47.737830 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:47.800468 26542 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:47.755033 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:47.802122 26539 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
W20260709 12:13:47.808931  3556 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:13:47.770181 26466 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:13:47.772258 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:47.773617 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.782718  3185 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:47.784519 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3522) took 1171 ms. Trace:
W20260709 12:13:47.750066  3336 consensus_meta.cc:287] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.227s	user 0.007s	sys 0.022s
I20260709 12:13:47.768543  3268 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:47.816421  3369 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:47.869123 27160 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31. Ops: []
I20260709 12:13:47.870831 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:47.871896 27166 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 19: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:47.872108  3369 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:47.818275  3185 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:47.873790  3445 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:47.810324 26619 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 19.
I20260709 12:13:47.819766  3534 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:13:47.875072  3534 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 31 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:47.875294 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:47.876291  3534 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 31.16, Last appended by leader: 16, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.877498  3534 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:47.877949 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:47.878787 26615 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 35: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:13:47.842485  3507 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.026s	sys 0.014s
W20260709 12:13:47.879343  3507 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.026s	sys 0.014s
I20260709 12:13:47.879782 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:47.852133 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:47.859225 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 52213.2us
I20260709 12:13:47.861752 26548 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 29: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:47.866969 26472 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:47.835372 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:47.865985 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:47.852581 26471 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 31.
I20260709 12:13:47.876282 26619 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 30: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:47.854957 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:47.873220 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:47.895701 26613 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:13:47.835001 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:47.834147  3478 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:47.909003 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:47.910063 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:47.853130  3464 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.911895 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:47.910876 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:47.913110 26539 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:47.861102  3358 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:47.916649 26614 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:13:47.842618  3015 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:47.915850 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:47.917071 26618 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 26: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:47.922938 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:47.923588  3285 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:47.924427  3285 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:47.925076 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:47.926044  3484 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:47.926558 27164 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:47.926884  3484 consensus_queue.cc:1243] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 27.19 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 18
I20260709 12:13:47.927457  3484 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:47.927886  3484 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:47.818856  3336 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:47.935312 26544 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:47.941232 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:47.941915 26544 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:47.942857 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:47.929150  3484 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:47.944576  3484 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:47.944767 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:47.946818 27160 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:47.948639 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:47.950615 27166 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:13:47.952322 27134 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:47.954537 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:47.957290  3185 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:47.957991  3185 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.963941 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:47.964854 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:47.965358 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:47.965816 26546 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:13:47.966518 26621 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 32: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:47.967314  3464 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:47.970880  3464 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:47.971853  3358 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:47.927582 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:47.979530 26542 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 19.
I20260709 12:13:47.981381 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:47.939553 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:47.923599 26614 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:47.984903 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.939898 26472 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
W20260709 12:13:47.986797 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 61933.2us
I20260709 12:13:47.987881 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:47.984769 26613 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:47.991653 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:47.818581 26470 rpcz_store.cc:276] 0709 12:13:46.613356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.613647 (+   291us) service_pool.cc:224] Handling call
0709 12:13:46.614097 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:46.614534 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:46.614572 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:46.620859 (+  6287us) log.cc:844] Serialized 26 byte log entry
0709 12:13:47.580512 (+959653us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b18000f9a60. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:13:47.688746 (+108234us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:47.688836 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.692331 (+  3495us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:47.756972 (+ 64641us) raft_consensus.cc:1685] finished
0709 12:13:47.756993 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.784274 (+ 27281us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4961,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":20613,"spinlock_wait_cycles":6793472,"thread_start_us":50324,"threads_started":1,"wal-append.queue_time_us":1128307}
I20260709 12:13:47.987540 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:47.994468 26622 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 27: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:47.939306 26541 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:47.992641 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:48.003399 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 84546.4us
W20260709 12:13:48.010309 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 102183us
I20260709 12:13:47.991851  3185 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:48.020326 26465 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:13:48.025245 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:48.016103  3464 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:48.026260 26547 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 35.
I20260709 12:13:48.019614  3337 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.033248 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:48.037508 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:48.033617 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:48.041739  3464 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.046838  3190 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:48.058224 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:48.051112  3515 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.061546  3428 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:48.062065  3428 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:48.062515  3428 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:48.062546 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:48.063645 26620 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 30 index: 18. (index mismatch)
I20260709 12:13:48.069063  2925 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:48.071380  3545 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.013s
I20260709 12:13:48.069945  3337 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:48.071587  3252 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.072537  3252 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:48.074755  3252 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:48.074903  3546 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:48.075160  3190 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:48.077827  3190 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:48.059962  3498 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:48.078624  3515 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:48.079304  3498 raft_consensus.cc:697] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:48.080390  3498 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:48.080930 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 81013.1us
I20260709 12:13:48.081189  3515 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:48.056231  3268 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:48.087811  3563 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:13:48.060438 26514 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:48.055194  3464 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:48.044495  3285 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:48.094058 26546 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:13:48.082000 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:48.095144 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:48.096786 26613 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:48.088261  3345 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.095784 26548 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:13:48.071767 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:48.114012 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 58332.8us
I20260709 12:13:48.099350 26621 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 31. Current term is 32. Ops: []
W20260709 12:13:48.116801 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.057767  3358 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:48.118273  3252 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:48.129742 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:48.130089  3252 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:48.131326 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:48.132660 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:48.133198  3252 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:48.133363 26546 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:13:48.135707  3303 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.136343  3303 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:48.139540 26470 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 31 index: 20. (index mismatch)
I20260709 12:13:48.094708  3337 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:48.125998 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 73659.2us
I20260709 12:13:48.119319 26547 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:13:48.123435  3546 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:48.172072 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:48.172387 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:48.180966 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 93620.1us
W20260709 12:13:48.188083 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.173514  3202 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:48.128163 26543 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:48.127367  3285 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:48.146489  3516 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:48.210137 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 62755.8us
W20260709 12:13:48.205701  3566 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:13:48.222150 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:48.243227 26470 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:48.244141 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:48.139513  3345 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:48.247028  3501 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:13:48.174429  3545 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 12:13:48.255771  3268 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:48.257102  3428 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:48.258961 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.211748  3337 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.263140  3337 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:48.267728 26541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3674) took 1364 ms (client timeout 1771 ms). Trace:
W20260709 12:13:48.268375 26541 rpcz_store.cc:269] 0709 12:13:46.903273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.910239 (+  6966us) service_pool.cc:224] Handling call
0709 12:13:48.267395 (+1357156us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400338bd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:48.267610 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2304807808}
I20260709 12:13:48.269759 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:48.221280 26543 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:48.224654  3546 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:48.226475 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:48.227329  3561 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:13:48.315086 26614 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:48.317260  3428 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:48.229251 27134 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:48.230969 26545 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:13:48.231281 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:48.331079 26544 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
W20260709 12:13:48.331220 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 377504us
I20260709 12:13:48.332021 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:48.332202 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:48.332892 26544 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:48.332973  3410 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:48.333381  3410 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.333742  3410 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:48.222268  3285 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:48.231653 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:48.208946  3369 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.202811  3475 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:48.280310 26617 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:13:48.335289 26547 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:13:48.283257 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:48.283656 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:48.284535 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:48.345085  3261 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:48.345822  3541 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:48.346524  3541 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:48.225705  3303 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:48.346987  3541 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:48.347455 26541 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:48.345643 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:48.350283 26547 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:48.350788  3285 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:48.352255  3285 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:48.353070  3303 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.353647  3303 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:48.292656 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 230255us
I20260709 12:13:48.294970  3336 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:48.355154 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:48.345717  3369 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:48.296917 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:48.357189 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:48.297894 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:48.358482  3268 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:48.300416 26467 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:13:48.300585  3185 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:48.302516 26546 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:48.365084 26514 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:48.304587  3464 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:48.307366 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:48.309128 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:48.310732 26615 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:48.310912 26621 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:48.311358  3505 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.311728  3411 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:13:48.311843 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 67813.9us
I20260709 12:13:48.313043  3546 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:48.314282  3181 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election won for term 33
W20260709 12:13:48.345618 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 62513.5us
I20260709 12:13:48.291574  3534 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:48.359500  3268 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:48.384382 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:48.361123 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:48.290138 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3523) took 1673 ms. Trace:
I20260709 12:13:48.304306 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:48.367456 26470 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 29: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:48.368156 26539 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 27.
I20260709 12:13:48.357535  3369 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:48.371125 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:48.387846 26473 rpcz_store.cc:276] 0709 12:13:46.616533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.616797 (+   264us) service_pool.cc:224] Handling call
0709 12:13:46.617223 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:47.796409 (+1179186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.289793 (+493384us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54000f41d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:48.290062 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2709511936}
I20260709 12:13:48.365778  3214 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:48.395902 26544 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 19. (term mismatch)
I20260709 12:13:48.396406 26544 pending_rounds.cc:85] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 18
I20260709 12:13:48.396714 26544 pending_rounds.cc:107] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 26.19
I20260709 12:13:48.396996 26544 raft_consensus.cc:2889] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:48.373088  3475 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:48.401383 26541 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 31.
I20260709 12:13:48.400059 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:48.383648  3181 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.387008  3336 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:48.416316 26547 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:48.425117 26469 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 19.
I20260709 12:13:48.430609 26548 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: [22.15-27.17]
I20260709 12:13:48.419510  3507 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:48.451321 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:48.451776  3507 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:48.452612  3507 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:48.423633  3181 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:48.440754 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:48.443012  3297 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:48.443269  3442 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:48.444243  3345 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:48.439319  3358 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 16, Time since last communication: 0.009s
I20260709 12:13:48.417644  3484 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 12:13:48.441011 26546 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:13:48.435731  3336 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:48.400030  3505 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:48.463239 26513 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:48.437036 26543 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 30.20, Last appended by leader: 20, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:48.450075  3464 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:48.417464  3568 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.063s
I20260709 12:13:48.410552  3411 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:48.480564 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:48.469921  3297 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.488929 26469 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:13:48.467376  3534 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
W20260709 12:13:48.496074 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 160905us
I20260709 12:13:48.501101 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:48.497537  3297 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:48.493698  3154 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:48.513756 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:48.526286 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:48.527706 27134 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:48.514945  3464 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.017s
I20260709 12:13:48.546104  3541 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:48.546561  3265 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.019s
I20260709 12:13:48.547262 26470 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 12:13:48.537590  3428 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:13:48.548892 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 85845.9us
I20260709 12:13:48.549719  3541 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:48.550804  3541 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:48.551538  3505 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:48.495410  3442 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:48.526902  3214 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:48.531981  3154 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:48.576822 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:48.578827  3445 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:48.570933  3507 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:48.583493 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 69847.9us
W20260709 12:13:48.584163 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.590682 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:48.546604  3411 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:48.596460 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 86403.4us
I20260709 12:13:48.594659 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:48.566465  3185 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:48.631414 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:48.635001 26465 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:13:48.637760 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:48.567574  3568 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.066s
I20260709 12:13:48.604545  3303 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:48.609512  3545 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:48.638592 26622 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:48.655112 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:48.634963 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 54999.3us
I20260709 12:13:48.632649  3371 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:48.634734  3498 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.555125  3336 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:48.637615  3268 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:13:48.676625 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45350.7us
I20260709 12:13:48.679589 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:48.689496 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:48.682341 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:48.680146 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:13:48.700476 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 45471us
W20260709 12:13:48.701241 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 43528.8us
I20260709 12:13:48.697512 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:48.702318 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:48.702380 26588 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:48.705958  3268 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:48.707799 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:48.712049  3268 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:48.708308 27159 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:13:48.709190  3475 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:48.734565 26541 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 12:13:48.738009  3337 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:48.737417 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 59204.4us
I20260709 12:13:48.674255  3371 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:48.685562  3498 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:48.764700  3584 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 12:13:48.784265 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 81995.5us
W20260709 12:13:48.785523 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 83260.3us
W20260709 12:13:48.786254 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 79940.4us
I20260709 12:13:48.788233 26513 leader_election.cc:400] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:13:48.794307 26513 leader_election.cc:403] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260709 12:13:48.671679  3505 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 27.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.101s
I20260709 12:13:48.771011  3190 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:48.817261 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:48.819799 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:48.819983  3545 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:48.822968 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:48.823554  3569 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election won for term 35
W20260709 12:13:48.824726  3579 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:13:48.829478  3428 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:48.831651  3154 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:48.812654  3337 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:48.834498 26588 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:48.839138  3261 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.841028  3015 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:48.842659 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3447) took 2146 ms. Trace:
W20260709 12:13:48.846427  3564 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 12:13:48.813120  3516 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.002s
W20260709 12:13:48.813549  3538 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:13:48.941987  3410 consensus_meta.cc:287] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.602s	user 0.005s	sys 0.015s
I20260709 12:13:48.812294  3475 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election won for term 31
W20260709 12:13:48.880071 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.976516  3475 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:48.883160 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:48.977108  3475 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:48.977515 26548 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:13:48.977762  3285 consensus_meta.cc:287] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.001s
I20260709 12:13:48.952562  3179 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:48.889854 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:48.953547  3411 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:48.979509  3411 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:48.980181 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:48.980856 26539 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:13:48.981762  3411 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:48.789390  3371 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:48.903151 27162 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 20.
I20260709 12:13:48.947412 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:48.949120 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 114751us
I20260709 12:13:48.985839 26588 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:48.878760  3594 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:13:48.882819  3190 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.956281 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:48.991019 26541 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:13:48.948459  3261 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:48.948870 26545 rpcz_store.cc:276] 0709 12:13:46.696298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.696900 (+   602us) service_pool.cc:224] Handling call
0709 12:13:46.697253 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:48.330722 (+1633469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.842300 (+511578us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400140354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:48.842550 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3490132224}
I20260709 12:13:48.960850 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:48.937534  3569 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:13:48.995939 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 178958us
W20260709 12:13:48.851943  3577 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:13:48.956894 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:48.938131  3478 consensus_meta.cc:287] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.023s	user 0.004s	sys 0.011s
I20260709 12:13:48.967120 26542 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:48.974537  3410 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:48.975796  3442 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:48.978796  3179 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:48.992296 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 320193us
I20260709 12:13:48.948768  3015 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:48.997428 26544 raft_consensus.cc:2410] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 36 because replica has last-logged OpId of term: 34 index: 22, which is greater than that of the candidate, which has last-logged OpId of term: 33 index: 21.
I20260709 12:13:48.963526  3505 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:48.960090  3265 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:49.013175 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:49.005312 26622 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
W20260709 12:13:49.014906 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 58121.9us
I20260709 12:13:49.027051 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:48.996109  3190 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:48.990016  3154 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:49.030200 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:49.045400 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:49.010661  3179 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:49.007781  3580 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.007881  3516 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.039129 26439 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:49.006954 26539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:13:49.055962  3516 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.056352  3265 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.003477  3569 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:13:49.057253 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:49.058852 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:49.059422  3265 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:49.059922 27167 raft_consensus.cc:2393] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 24: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:49.060268 26543 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:49.061239  3596 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:49.046296 27163 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 30: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:49.010994  3337 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:49.014662  3505 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.014123  3464 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.051625 27134 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:49.056522 26539 raft_consensus.cc:606] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:13:49.068066 26539 raft_consensus.cc:614] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:49.034869  3442 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:49.065346 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:49.080433 26618 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:49.035512  3507 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:49.048295 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:49.071559  3185 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:49.090479 26543 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 20. Preceding OpId from leader: term: 31 index: 20. (term mismatch)
I20260709 12:13:49.090711  3592 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:49.090981 26543 pending_rounds.cc:85] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 19
I20260709 12:13:49.091516 26543 pending_rounds.cc:107] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 30.20
I20260709 12:13:49.091782 26543 raft_consensus.cc:2889] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:49.068557  3580 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.072351  3464 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:49.073205  3297 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.004s
I20260709 12:13:49.069061  3505 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:49.045215  3411 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:49.071694 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:49.065647  3498 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:49.098073 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3459) took 1361 ms. Trace:
W20260709 12:13:49.072419  3181 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.593s	user 0.005s	sys 0.009s
I20260709 12:13:49.100502 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:13:49.101503  3588 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:13:49.101167  3297 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.090843  3185 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 24 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:13:49.100405  3481 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 31 current term: 31 is higher.
W20260709 12:13:49.105458 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48295.3us
I20260709 12:13:49.127753 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:49.047019  3345 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.046s
I20260709 12:13:49.106309 26543 rpcz_store.cc:276] 0709 12:13:47.731477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.733140 (+  1663us) service_pool.cc:224] Handling call
0709 12:13:47.733667 (+   527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:47.962152 (+228485us) spinlock_profiling.cc:243] Waited 64.7 ms on lock 0x7b540028e220. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f5076051dc0 00007f50760dc1c0 00007f50760dd231 00007f50760d9d8f 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c
0709 12:13:49.059942 (+1097790us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b58004199d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760360aa 00007f50760b8447 00007f50760d0fe7 00007f50760d27de 00007f50760dcb49 00007f50760dd416 00007f50760d9d8f 00007f50760d983e 00007f507b09e419 00007f5074615bd4
0709 12:13:49.092365 (+ 32423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:49.092666 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1450786432}
I20260709 12:13:49.090479  3154 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:49.093420  3265 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:49.131193 26548 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:13:49.104890  3411 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:49.137252 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:49.137830 26473 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:49.138332 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:49.138640  3592 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.138734 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:49.079576  3596 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.152844 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:49.179137 26466 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:13:49.152859 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3468) took 1057 ms. Trace:
I20260709 12:13:49.124816  3369 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:13:49.153144 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:49.157694  3592 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.158665 26468 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:13:49.107628  3268 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.163012  3411 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.175385  3410 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:49.174894  3185 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.175709 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:49.162806 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:49.119769  3181 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.211313 27167 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 31: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:49.180598 26547 rpcz_store.cc:276] 0709 12:13:48.094985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.423996 (+329011us) service_pool.cc:224] Handling call
0709 12:13:48.424446 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:48.471286 (+ 46840us) raft_consensus.cc:1534] Early marking committed up to index 19
0709 12:13:48.699133 (+227847us) log.cc:844] Serialized 14 byte log entry
0709 12:13:49.152566 (+453433us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:49.152619 (+    53us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:13:49.152661 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:49.152717 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:49.152805 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49900,"prepare.queue_time_us":349645,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":51195,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"thread_start_us":532625,"threads_started":2}
I20260709 12:13:49.109424  3015 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.215281  3297 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:49.216035  3015 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:49.219241  3580 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:49.206441 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 506165us
I20260709 12:13:49.227347  3336 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:13:49.229933  3591 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:13:49.232256 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:49.235271  3603 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:13:49.236781  3505 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.260803 26618 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 20.
I20260709 12:13:49.257985  3265 raft_consensus.cc:697] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:49.258926  3580 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:49.238932  3154 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:13:49.273690 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:49.292563 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:49.295398 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 167787us
I20260709 12:13:49.297242 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:49.263121 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:49.265463 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 211766us
I20260709 12:13:49.263160  3336 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:49.293171 26588 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:49.317531 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:49.318450 26617 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 30: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:49.322317 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:49.323403 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:49.320847 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:49.328908 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:49.329926 26614 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
I20260709 12:13:49.331043 26543 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:49.331761 26588 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:49.348376 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:49.352643  3590 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.279s	user 0.001s	sys 0.001s
I20260709 12:13:49.353724  3608 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:49.348697  3442 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:13:49.352656  3507 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:49.354631  3505 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:49.352866 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:49.355556 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:49.350414 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 241220us
I20260709 12:13:49.354199  3608 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:49.356719  3608 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:49.359140  3605 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:49.359836  3605 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.305590  3580 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.362164  3265 consensus_queue.cc:237] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.362735  3285 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:13:49.363226  3285 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.363586  3285 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:49.364313  3580 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:49.364899  3580 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:13:49.366895 26620 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 32: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:49.303942  3593 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:49.356171 26539 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 30.
I20260709 12:13:49.370723 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:13:49.386194 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.387820 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3681) took 1456 ms. Trace:
I20260709 12:13:49.391736 26544 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:49.347617  3369 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 31 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:49.394004 26542 rpcz_store.cc:276] 0709 12:13:47.931642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.980805 (+ 49163us) service_pool.cc:224] Handling call
0709 12:13:49.387625 (+1406820us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b5400140854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:49.387755 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2264674560}
I20260709 12:13:49.352736  3545 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:49.345453  3202 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:49.416836 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:49.418082  3592 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:49.418985  3268 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:49.389660  3575 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.699s	user 0.000s	sys 0.003s
I20260709 12:13:49.406996 27134 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:49.438735 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:49.439424 26542 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:49.439489 27134 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:49.422174 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:49.441267 26541 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:49.422993 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:49.442902 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:49.388396  3574 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.819s	user 0.006s	sys 0.000s
I20260709 12:13:49.362187  3605 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:49.331653  3345 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 12:13:49.471625  3345 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:49.472165  3345 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.473397  3475 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.461061  3545 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.028s
I20260709 12:13:49.475026  3181 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:49.476001  3516 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:49.476178  3545 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:49.476665  3545 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:49.387766  3542 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.370803  3179 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:49.435787  3612 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:13:49.435896 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:49.437023  3445 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.518733 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:49.447522 26543 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 30.
I20260709 12:13:49.448714  3592 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.450896 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:49.452025 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:49.457340 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 99133.8us
W20260709 12:13:49.458242 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 161109us
I20260709 12:13:49.443184 26545 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:13:49.466045  3617 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:49.467440  3569 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.468554  3618 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:49.469319 26539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:13:49.393002  3580 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:49.484419 26544 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 31.
I20260709 12:13:49.485808 26541 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:49.541038 26539 raft_consensus.cc:606] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:13:49.541591 26539 raft_consensus.cc:614] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:13:49.536767 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 100941us
I20260709 12:13:49.543045 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:49.491247 26548 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:13:49.496058 26542 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:49.477656  3545 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.420825  3190 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.495800  3154 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.515187 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:49.500890  3507 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:13:49.544344 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 104801us
W20260709 12:13:49.511257 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 107664us
I20260709 12:13:49.546805 26467 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: [28.18-28.18]
I20260709 12:13:49.547672 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:49.496539  3345 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:49.514744  3614 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:49.496059  3516 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:49.519094  3445 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.560344 26471 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 32
I20260709 12:13:49.590669 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:49.543236  3411 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:49.516834  3596 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:49.515731  3358 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:49.563401 26466 raft_consensus.cc:2410] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 36 because replica has last-logged OpId of term: 34 index: 22, which is greater than that of the candidate, which has last-logged OpId of term: 33 index: 21.
I20260709 12:13:49.404824  3593 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.603801  3569 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:49.604342  3593 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:49.569097 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:49.605185 26470 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:49.605232 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:49.606168 26546 raft_consensus.cc:2368] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27.
I20260709 12:13:49.607056 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:49.608198 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:49.536185  3617 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.610780  3617 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:49.571173  3592 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.612835  3592 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:49.519295  3608 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.444500  3202 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.606168 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:49.495178  3542 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.616183  3608 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:49.617336 26540 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27. Ops: [26.16-26.16]
I20260709 12:13:49.617997  3542 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:49.621590 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3556) took 1292 ms. Trace:
I20260709 12:13:49.622143 26469 rpcz_store.cc:276] 0709 12:13:48.329562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.632946 (+303384us) service_pool.cc:224] Handling call
0709 12:13:48.656206 (+ 23260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:48.992980 (+336774us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:13:49.032728 (+ 39748us) log.cc:844] Serialized 14 byte log entry
0709 12:13:49.491935 (+459207us) log.cc:844] Serialized 14 byte log entry
0709 12:13:49.499812 (+  7877us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:49.532447 (+ 32635us) log.cc:844] Serialized 26 byte log entry
0709 12:13:49.532978 (+   531us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:49.533777 (+   799us) log.cc:844] Serialized 14 byte log entry
0709 12:13:49.534358 (+   581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:49.534648 (+   290us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:49.621293 (+ 86645us) raft_consensus.cc:1685] finished
0709 12:13:49.621322 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:49.621508 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9472,"prepare.queue_time_us":112609,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":118,"raft.queue_time_us":317169,"raft.run_cpu_time_us":506,"raft.run_wall_time_us":74746,"spinlock_wait_cycles":2925952,"thread_start_us":665756,"threads_started":3,"wal-append.queue_time_us":487318}
I20260709 12:13:49.625183  3592 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 26.19, Next index: 20, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:49.625945  3265 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 30.20, Next index: 21, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:49.626135  3592 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 29.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 12:13:49.626713  3598 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:49.627139  3598 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:49.627233  3410 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:49.627915  3410 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.628032  3598 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.629385  3598 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:49.627323  3592 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:49.547132  3618 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.515765  3285 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.548645  3604 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:49.562578  3428 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:49.573766  3507 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.600955  3445 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:49.628441 26540 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27. Ops: [26.19-26.19]
I20260709 12:13:49.594960 26465 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: [28.16-28.16]
I20260709 12:13:49.634739 26471 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
W20260709 12:13:49.643718 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 52690.4us
I20260709 12:13:49.582800 27133 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:49.556061  3580 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:49.677752 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 95099.9us
I20260709 12:13:49.679749 26545 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31. Ops: [30.20-30.20]
I20260709 12:13:49.630652  3620 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:49.595115  3411 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.635049  3621 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.639456  3592 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:49.684739 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:49.681547 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:49.630484  3358 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:49.667815  3593 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.616176  3202 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:49.632730  3190 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:49.630370  3410 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:49.680810  3626 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:13:49.650923 26470 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:49.699115 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:49.703495 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:49.516194  3369 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.709065 26545 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:49.666455  3505 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.033s
I20260709 12:13:49.597193  3516 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.709035 26540 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:13:49.715381 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:49.682740  3185 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:49.688395  3411 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:49.687302  3179 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:49.687008  3620 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:49.727520  3630 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:49.734524 26617 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:49.737185 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:49.738269  3516 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:49.739208 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:49.740305 26614 raft_consensus.cc:2368] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27.
I20260709 12:13:49.739751  3358 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 16, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.741555  3358 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:49.743383 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:49.744278 26613 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:49.745139  3516 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.754449 27163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56886 (request call id 1456) took 1105 ms. Trace:
I20260709 12:13:49.754961 27163 rpcz_store.cc:276] 0709 12:13:48.648935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.663601 (+ 14666us) service_pool.cc:224] Handling call
0709 12:13:49.754181 (+1090580us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b54006cf054. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:49.754328 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769491840}
W20260709 12:13:49.755853  3261 consensus_meta.cc:287] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.744s	user 0.009s	sys 0.003s
I20260709 12:13:49.756369  3261 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.757645 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:49.759552  3371 consensus_meta.cc:287] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.758s	user 0.012s	sys 0.003s
I20260709 12:13:49.760079  3371 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.761147 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:49.761978 26541 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:49.762523 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:49.759310 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:49.741571 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:49.766467 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:49.766785 26545 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:13:49.710449  3428 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:49.762588 26464 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:13:49.794708 26472 raft_consensus.cc:2393] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 32: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:49.745762  3516 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.711248  3618 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:49.778779 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:49.783072 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.688946  3442 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.037s
I20260709 12:13:49.762660  3475 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:49.804930 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:49.808727 26619 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 35: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:49.721230  3185 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:49.764003  3371 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:49.792779  3445 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:49.776104  3202 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.700284  3621 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.774165  3631 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:49.712833  3593 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.814889 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:49.828126 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:49.830857 26613 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:13:49.863683 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:49.864781 26622 raft_consensus.cc:2368] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33.
I20260709 12:13:49.803841  3428 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:49.820178  3185 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:49.818699  3608 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:49.881378 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:49.887477 27164 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:49.874244  3214 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:49.834259  3297 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:49.898767 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 181726us
I20260709 12:13:49.900665 26622 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:49.862776  3614 raft_consensus.cc:697] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 20 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:49.868201  3261 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:49.897135 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:49.875830  3631 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:49.910940 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:49.912060 27163 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:13:49.923856 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 217854us
I20260709 12:13:49.925693 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:49.927172 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:49.929570 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:49.934202 26620 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:49.834618  3202 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.911088 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:49.901685 27133 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.546s (SENT) [suppressed 3 similar messages]
I20260709 12:13:49.940980 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:49.932367  3599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.006s	sys 0.015s
I20260709 12:13:49.944111 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:49.943267 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:49.947643 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45994.1us
I20260709 12:13:49.939921 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:49.910677  3214 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.960517 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:49.948493 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:49.908546  3297 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:49.942152  3261 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:49.947916  3442 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:49.966353  3475 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election won for term 27
W20260709 12:13:49.947398  3599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.006s	sys 0.015s
I20260709 12:13:49.987780 27133 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:49.886848  3592 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 30.20, Last appended by leader: 20, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.959064  3505 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:49.997151 27163 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:13:49.946780  3621 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:50.000756 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:50.008353 26545 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:13:50.016789 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:49.983775  3464 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:49.981473  3015 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:50.043098  3015 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:50.044167  3638 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:13:50.045564  3015 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:49.999137  3442 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:50.046468  3442 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:50.048593 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:50.050462  3505 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:50.050836  3639 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:13:50.051563  3505 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:50.052722 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:50.053558 26543 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:50.003911  3578 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:13:49.939898  3620 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 29.20, Last appended by leader: 20, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:50.056102  3620 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:50.058665  3592 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:50.059588  3214 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:50.061291  3297 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:50.037546  3614 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:50.063294 26620 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31. Ops: []
I20260709 12:13:50.024293  3201 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:50.064605  3201 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:50.006609  3580 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:50.021134  3516 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:50.066901  3201 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:50.030230 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:50.070883 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:50.072793 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:50.073916 26615 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 33: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:50.075094 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:50.030700  3593 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:50.004632  3631 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:49.986833  3428 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:50.033351  3202 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:50.022128  3629 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 12:13:50.036270  3285 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:50.068001 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:50.076856 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:50.112946 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:50.029237  3617 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:50.086629 26439 leader_election.cc:400] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27.
I20260709 12:13:49.998298  3637 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:50.088052 26587 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:50.088922 26545 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:13:50.114485 26620 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:13:50.115880 26439 leader_election.cc:403] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260709 12:13:50.119197 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:50.120645 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:50.129138 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 47237.8us
I20260709 12:13:50.132035 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:50.134351 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:50.131204  3621 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27.
I20260709 12:13:50.094197  3201 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 30.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.044s
I20260709 12:13:50.139660 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:50.128182  3297 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:13:50.087536  3015 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 12:13:50.091832  3622 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.043s
I20260709 12:13:50.144183 26545 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 30: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:13:50.144760 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.143158 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:50.147073  3297 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:50.147604  3645 log.cc:927] Time spent T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:13:50.148566  3481 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:50.155537  3015 raft_consensus.cc:3055] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:50.144969  3202 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.171514  3201 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.142552  3475 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:50.176440  3154 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.177205  3608 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:50.148234  3297 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 30.19, Last appended by leader: 19, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:50.189747 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:50.192435 26473 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:13:50.192926  3201 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:50.163833  3622 consensus_queue.cc:1243] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 28.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260709 12:13:50.155589  3481 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:50.195178  3617 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:50.195012  3475 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:50.195502 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 3560) took 1058 ms. Trace:
I20260709 12:13:50.195791  3608 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:50.196100 26464 rpcz_store.cc:276] 0709 12:13:49.136724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.138023 (+  1299us) service_pool.cc:224] Handling call
0709 12:13:50.195289 (+1057266us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54003151d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:50.195407 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1413485312}
I20260709 12:13:50.197170  3154 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:50.195554  3481 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 30.18, Last appended by leader: 18, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:50.187805  3202 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:50.156103  3015 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:50.199738  3015 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:50.201135  3015 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:50.188755 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:50.188974 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:50.202793 26472 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:50.226958  3597 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:50.229737  3640 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:13:50.230132  3597 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:50.115365 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:50.292821 26617 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
I20260709 12:13:50.135831 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:50.292821 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 162383us
W20260709 12:13:50.296173 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 206007us
I20260709 12:13:50.299412 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:50.299722 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:50.300201 26464 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:50.300341 26470 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:50.301322  3619 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.301584 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:50.301988  3619 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:50.304893  3619 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:50.315594 26464 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
W20260709 12:13:50.316526 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 173633us
I20260709 12:13:50.320799 27162 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 20 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 19. Current term is 20. Ops: []
W20260709 12:13:50.321839 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 242024us
I20260709 12:13:50.322239 27159 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 24 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:50.322324 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:50.322727 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:50.323663 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:50.324568 27168 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:13:50.325810 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:50.327404 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:50.332151 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:50.332914 26467 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:50.319600 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:50.337615 26439 leader_election.cc:400] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33.
I20260709 12:13:50.338076 26439 leader_election.cc:403] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Cancelling election due to peer responding with higher term
I20260709 12:13:50.332898  3597 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:50.341742 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:50.403676 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:50.311280  3481 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:50.345920  3371 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election won for term 33
W20260709 12:13:50.403533 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 58488.6us
I20260709 12:13:50.327070  3619 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:13:50.414516 26543 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:13:50.413352 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:50.347389  3609 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:13:50.346982  3649 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:13:50.467622 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 46310.5us
I20260709 12:13:50.424242 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:50.488919 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:50.410926  3445 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election lost for term 32. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33.
W20260709 12:13:50.491655 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.492205 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.494432 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 70267.1us
I20260709 12:13:50.494326  3599 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:50.424942  3201 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:50.425446  3649 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:13:50.515434 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 102163us
I20260709 12:13:50.414355  3428 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.078s
I20260709 12:13:50.520741 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:50.538506 27164 consensus_meta.cc:287] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.633s	user 0.018s	sys 0.007s
I20260709 12:13:50.539321 27164 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:13:50.543287 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:50.544041 26464 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:13:50.488826  3608 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:50.519230  3649 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:50.529824  3261 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:50.524252  3154 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:50.562649 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:50.524591  3201 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:50.564432 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3572) took 1110 ms. Trace:
I20260709 12:13:50.498731  3179 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.046s
I20260709 12:13:50.564783 26544 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:13:50.554597  3345 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:13:50.567498 26468 rpcz_store.cc:276] 0709 12:13:49.453623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.796611 (+342988us) service_pool.cc:224] Handling call
0709 12:13:49.804145 (+  7534us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:49.835516 (+ 31371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:49.835565 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:49.885385 (+ 49820us) log.cc:844] Serialized 52 byte log entry
0709 12:13:50.120168 (+234783us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:50.121684 (+  1516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.558110 (+436426us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b540027abd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:50.558161 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:50.558209 (+    48us) raft_consensus.cc:1685] finished
0709 12:13:50.558223 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.564360 (+  6137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101,"raft.queue_time_us":419,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":9812,"spinlock_wait_cycles":52128128,"thread_start_us":192024,"threads_started":1,"wal-append.queue_time_us":282524}
I20260709 12:13:50.562203  3261 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.617491  3154 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:50.618009  3154 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:13:50.609395  3411 consensus_meta.cc:287] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.849s	user 0.013s	sys 0.009s
I20260709 12:13:50.609210  3428 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:50.615548  3442 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.569s	user 0.012s	sys 0.006s
I20260709 12:13:50.636415  3442 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:50.610921  3597 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:50.613371  3592 consensus_meta.cc:287] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.554s	user 0.016s	sys 0.004s
I20260709 12:13:50.619870  3261 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:50.624496 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 212971us
I20260709 12:13:50.572597  3630 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:50.627946  3655 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:13:50.618974  3154 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:50.578366  3201 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:50.625916  3371 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:50.621138  3345 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:50.654383 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:50.656908 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:50.661590 26471 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:13:50.658114 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:50.658457 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:50.658623 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:50.658854 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3694) took 1102 ms. Trace:
I20260709 12:13:50.663520 26547 rpcz_store.cc:276] 0709 12:13:49.556905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.634245 (+ 77340us) service_pool.cc:224] Handling call
0709 12:13:49.646828 (+ 12583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:49.668168 (+ 21340us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:13:49.688204 (+ 20036us) log.cc:844] Serialized 14 byte log entry
0709 12:13:50.289618 (+601414us) spinlock_profiling.cc:243] Waited 41.7 ms on lock 0x7b180030cd60. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a23a 00007f50760e4a2a
0709 12:13:50.494385 (+204767us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:50.499383 (+  4998us) log.cc:844] Serialized 26 byte log entry
0709 12:13:50.499584 (+   201us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:50.647856 (+148272us) log.cc:844] Serialized 14 byte log entry
0709 12:13:50.648703 (+   847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.648818 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:50.657555 (+  8737us) raft_consensus.cc:1685] finished
0709 12:13:50.657583 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.658770 (+  1187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":952,"prepare.queue_time_us":13042,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":3846,"raft.queue_time_us":6402,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":15853,"spinlock_wait_cycles":95812480,"thread_start_us":352184,"threads_started":2,"wal-append.queue_time_us":843947}
W20260709 12:13:50.680441 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.647897  3185 consensus_meta.cc:287] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.749s	user 0.016s	sys 0.000s
W20260709 12:13:50.658150 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 49933.6us
I20260709 12:13:50.685655 26473 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:13:50.693774 26467 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:50.696589  3154 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:50.635499  3411 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:50.706779 26618 raft_consensus.cc:2368] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31.
I20260709 12:13:50.707878  3411 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:50.708949  3345 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 31.16, Last appended by leader: 16, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:50.720099  3201 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:50.646193  3597 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:50.725723  3569 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:50.726215  3569 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:50.726311  3597 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:50.727229  3569 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:50.698819 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:50.728703  3569 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:50.729089  3475 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:50.731602 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 1485) took 1409 ms. Trace:
I20260709 12:13:50.732239 26548 rpcz_store.cc:276] 0709 12:13:49.321665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.322936 (+  1271us) service_pool.cc:224] Handling call
0709 12:13:50.731311 (+1408375us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540037df54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:50.731492 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298483968}
I20260709 12:13:50.733693  3442 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:50.735733 26547 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:13:50.736510 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:50.656167  3202 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:50.739059  3627 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:13:50.740885  3507 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:50.743386  3442 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:50.743875  3442 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.744240  3442 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:50.744540  3545 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:50.660482  3630 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:50.753347  3442 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:50.757053 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.762470 27134 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:50.768035 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:50.768879 26548 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:50.778007 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:50.779558 27164 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 26: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
W20260709 12:13:50.775938 26472 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.004s
I20260709 12:13:50.783469 26472 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:13:50.641857  3428 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:50.778745 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:50.789953 26469 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:13:50.795463 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:50.799898 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:50.804214 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:50.802623 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:50.810892 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:50.811669 26465 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:50.812186 26471 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 31. Current term is 33. Ops: []
I20260709 12:13:50.776721  3617 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:50.824081 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:50.825102 26471 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 12:13:50.826545 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53304.4us
I20260709 12:13:50.827602 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:50.830924 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 47955.6us
I20260709 12:13:50.832489 26588 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:50.834780 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:50.835615  3642 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:50.845078 26473 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 31 index: 20. (index mismatch)
I20260709 12:13:50.839558 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:50.840477 26470 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:50.845199 26471 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
I20260709 12:13:50.790493  3609 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.846067 26547 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:50.839090 26465 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:13:50.846855 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:50.852221 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:50.852828 26465 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 31
I20260709 12:13:50.697647  3185 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:50.857237 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:50.859097 26621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.007s	sys 0.009s
W20260709 12:13:50.863222 26621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.008s	sys 0.009s
W20260709 12:13:50.827287  3297 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.003s	sys 0.011s
I20260709 12:13:50.814909  3637 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:50.863821 26548 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:13:50.864775 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:50.865253 26464 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31. Ops: [30.18-30.18]
I20260709 12:13:50.854768 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:50.862035 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:50.860847 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:50.868081 26471 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:13:50.887015 26465 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:13:50.872525 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:50.894819 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:50.901644 26467 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 27: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:50.901579 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:50.895701 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:50.849575  3411 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.906872 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:50.849805  3618 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:13:50.855582  3505 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:50.909122 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:50.925586 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:50.927717 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:50.911180 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:50.882513  3297 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.006s	sys 0.011s
I20260709 12:13:50.912917 27160 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:50.869100  3542 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 12:13:50.912520  3598 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.283s	user 0.017s	sys 0.014s
I20260709 12:13:50.863094  3609 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:50.871701  3637 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:13:50.936810 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.912992  3202 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:50.936859 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:50.963675 26473 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
I20260709 12:13:50.943683 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:50.913426  3015 consensus_meta.cc:287] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.016s
I20260709 12:13:50.954445 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:50.954618  3599 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:50.955478  3593 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:50.955864 26513 leader_election.cc:400] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 25. Current term is 26.
I20260709 12:13:50.970618 26513 leader_election.cc:403] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:50.956629 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:50.957360 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:50.958324 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:50.973950 26544 raft_consensus.cc:2368] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33.
I20260709 12:13:50.966281 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:50.975942 26543 raft_consensus.cc:2368] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31.
I20260709 12:13:50.980960 26541 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:50.971585 26546 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:51.004712 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:50.936728  3201 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:50.941103  3597 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:13:50.865183  3371 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 31.15, Last appended by leader: 15, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:50.915237  3411 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:50.937688  3630 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:51.014159 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:51.010604 26511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.024s	sys 0.078s
I20260709 12:13:51.012454 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:50.940661  3542 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:51.018610 26511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.024s	sys 0.078s
I20260709 12:13:51.037495 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:51.049782 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:50.965742  3637 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:51.009347  3620 consensus_meta.cc:287] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.953s	user 0.023s	sys 0.020s
I20260709 12:13:51.012270  3597 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:51.055742 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 100096us
I20260709 12:13:51.064952 26541 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:51.055964  3505 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:51.069726  3464 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:51.069543  3505 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:51.070170  3464 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:51.071100  3664 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:13:51.060484  3597 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:13:51.071941  3411 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:51.061312 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 217250us
I20260709 12:13:51.038519  3015 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 25. Current term is 26.
I20260709 12:13:51.054214  3542 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:51.078545 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 237533us
I20260709 12:13:51.011982  3593 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:50.999097  3599 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:51.071905  3649 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:51.097353 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:51.099107 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:51.101217  3609 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:51.099117 26617 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:13:51.086894  3201 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.086705  3202 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.108968 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:51.111301 27134 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:51.110056 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4641) took 1154 ms. Trace:
W20260709 12:13:51.102625 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 250399us
I20260709 12:13:51.098125  3668 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.123201 26622 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:13:51.102120  3185 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:51.097615  3428 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:51.102269  3516 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:51.071163  3464 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:51.129597 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:51.133296 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:51.114038 26621 rpcz_store.cc:276] 0709 12:13:49.931670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.931820 (+   150us) service_pool.cc:224] Handling call
0709 12:13:49.944650 (+ 12830us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:49.944882 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:13:50.089433 (+144551us) log.cc:844] Serialized 14 byte log entry
0709 12:13:51.086064 (+996631us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:51.086128 (+    64us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:51.086177 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.086249 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:51.086381 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9839,"prepare.queue_time_us":194821,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":913,"raft.queue_time_us":195735,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":11741,"thread_start_us":1116919,"threads_started":3}
I20260709 12:13:51.113128  3642 raft_consensus.cc:697] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:51.123733  3630 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:13:51.128090  3015 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:51.146237  3675 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 12:13:51.159210  3261 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:51.112077  3201 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:51.163516 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.116104  3202 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:51.165429 26469 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
I20260709 12:13:51.179232 26439 leader_election.cc:400] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31.
I20260709 12:13:51.179823 26439 leader_election.cc:403] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Cancelling election due to peer responding with higher term
I20260709 12:13:51.185446 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:51.185735 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:51.159112 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48913.7us
I20260709 12:13:51.165814  3621 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.137688  3214 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:13:51.191280 26613 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32. Ops: []
I20260709 12:13:51.282487 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:51.282967 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 167750us
W20260709 12:13:51.283742 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 90536.6us
I20260709 12:13:51.285110 26613 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:51.138203  3516 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:51.263784 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 51444.4us
I20260709 12:13:51.187812 26621 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
I20260709 12:13:51.189415 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:51.288933 26614 raft_consensus.cc:2393] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 24: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:51.186358 26622 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 31: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:51.187091 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:51.190699  3683 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:51.131536  3668 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:51.167034  3667 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:51.267663 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:51.167814  3684 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.091s
W20260709 12:13:51.190511  3670 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.105s	user 0.000s	sys 0.002s
W20260709 12:13:51.189357  3676 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.102s	user 0.000s	sys 0.003s
W20260709 12:13:51.277151  3481 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.860s	user 0.001s	sys 0.016s
I20260709 12:13:51.152513  3620 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.188131 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:51.285835 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:51.266808 26615 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 26: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:51.261350  3604 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election lost for term 30. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31.
W20260709 12:13:51.290616 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.295070 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:13:51.365325 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.167150  3015 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:51.192966  3617 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.092s
I20260709 12:13:51.306028 26613 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 12:13:51.313889  3516 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:51.303586  3683 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:51.308708  3642 consensus_queue.cc:237] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:51.316567  3693 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.008s
W20260709 12:13:51.318032  3681 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:13:51.318921  3649 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:51.306850  3608 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 31.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.015s
I20260709 12:13:51.322685  3599 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:51.284533  3568 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:51.318953  3663 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
W20260709 12:13:51.331521  3545 consensus_meta.cc:287] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.587s	user 0.021s	sys 0.001s
I20260709 12:13:51.289877  3621 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:51.375097  3622 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:51.393776 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 106326us
I20260709 12:13:51.380874  3692 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:51.343748  3261 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:51.348770  3569 consensus_meta.cc:287] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.620s	user 0.013s	sys 0.000s
I20260709 12:13:51.351069  3668 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:51.353139  3201 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:51.366997 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 71988.6us
W20260709 12:13:51.374646 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 88891.4us
I20260709 12:13:51.402272  3015 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:51.392699  3568 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:51.402866 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:51.404486  3261 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:13:51.404795  3568 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:51.405054  3261 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:51.407398  3621 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:51.375375  3687 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.385391  3593 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:51.376983  3637 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:51.382548  3428 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:51.333042 27167 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 32 index: 20. (index mismatch)
I20260709 12:13:51.341969  3202 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:51.439304 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:51.393190 26617 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 27.
I20260709 12:13:51.368744  3620 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:51.401902  3622 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:51.410506 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:51.441855 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:51.442194 26548 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:51.442660 26544 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:51.442195 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:51.441869 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:51.441529 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:51.411166 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:51.444525 26473 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:13:51.309238  3688 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 14, Time since last communication: 0.084s
W20260709 12:13:51.441962 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 134886us
I20260709 12:13:51.445819 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:51.446599 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:51.447358 26468 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 26: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:51.447870 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:51.414968 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:51.428218 26464 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:13:51.439759 26472 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:13:51.441520 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:51.414904 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:51.454322 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:51.452522 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:51.456995 26542 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:51.457105 26539 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 16. Preceding OpId from leader: term: 33 index: 17. (index mismatch)
I20260709 12:13:51.460413 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:51.461817 27164 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:51.456087 27166 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:13:51.393977  3542 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:51.408824  3692 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:51.440783  3689 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.471628 26468 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:13:51.473160 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:51.408488  3649 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.061s
I20260709 12:13:51.475821  3507 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:51.406145  3261 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 17, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:51.477834  3542 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:51.480515 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:51.439388  3428 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:51.433461  3597 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:51.492136 26542 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:13:51.492589 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:51.442963  3687 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:51.506445 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:51.493645  3689 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:51.524634 26614 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:13:51.525916  3687 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:51.529992  3622 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:51.531348  3202 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:51.532147  3202 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:51.536314  3620 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:51.503515  3428 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:51.542220 26547 raft_consensus.cc:2368] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 35. Current term is 36.
I20260709 12:13:51.514856  3697 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:51.556785 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:51.561955 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 75436.7us
W20260709 12:13:51.564289 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.572857 27160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1464) took 1692 ms. Trace:
I20260709 12:13:51.573388 27160 rpcz_store.cc:276] 0709 12:13:49.880603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.888431 (+  7828us) service_pool.cc:224] Handling call
0709 12:13:49.907177 (+ 18746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.940496 (+1033319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.572541 (+632045us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54006a68d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:51.572779 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2309740416}
I20260709 12:13:51.574967 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:51.576316 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:51.578161 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:51.551170  3697 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.577500 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:51.583632 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:51.585903 26616 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:51.588619 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:51.595139  3694 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:51.589471  3697 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:51.560792  3692 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:51.607748  3442 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:51.568136  3569 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:51.619585 27133 leader_election.cc:336] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.695s (SENT)
I20260709 12:13:51.620338 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:51.622238 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:51.596179  3649 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:51.617467  3699 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.102s	user 0.001s	sys 0.001s
I20260709 12:13:51.625967  3622 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:51.632712  3637 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:51.634961 26438 leader_election.cc:400] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27.
I20260709 12:13:51.623471  3569 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:51.595796  3683 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:51.636591  3702 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:13:51.623683  3202 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:51.639452 27133 leader_election.cc:336] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.546s (SENT)
I20260709 12:13:51.647514 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:51.652010  3569 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:51.652498  3464 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:51.659955  3637 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:51.667531 26616 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:51.676636 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:51.676096 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:51.627071  3631 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:51.692457  3653 consensus_queue.cc:1059] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:51.693789  3653 raft_consensus.cc:3055] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:51.698230  3694 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.703101  3694 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:51.721921  3694 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:51.709067  3597 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:51.732056 26513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.009s	sys 0.029s
I20260709 12:13:51.701808  3598 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:51.700245  3411 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:51.733098  3411 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:51.735363  3411 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:51.736364  3598 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:51.694155  3653 raft_consensus.cc:740] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:51.103485 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:51.740990  3678 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.588s	user 0.002s	sys 0.001s
I20260709 12:13:51.745272  3665 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:13:51.745929  3665 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:51.752207  3665 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 31.18, Last appended by leader: 18, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:51.754088  3665 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:51.773219 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:51.773813  3371 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:13:51.776202 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.776319 26621 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32. Ops: []
W20260709 12:13:51.783763  3682 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.517s	user 0.002s	sys 0.000s
I20260709 12:13:51.788125 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:51.791977 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:51.794598  3214 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.795424  3214 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:51.797910  3593 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election won for term 28
W20260709 12:13:51.732503 26513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.009s	sys 0.029s
I20260709 12:13:51.798930  3214 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:51.801369 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:51.827514 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.802560 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:51.828677 26619 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:13:51.668922  3689 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:51.641806 26438 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:51.825832 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 52721.1us
W20260709 12:13:51.827368 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 697814us
I20260709 12:13:51.805128 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:51.825006 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:51.844841 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:51.860899 27160 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
W20260709 12:13:51.861246 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 219521us
I20260709 12:13:51.861112 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:51.862351 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:51.865213 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:51.872357 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:51.830256  3568 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:51.839185  3371 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.834026  3631 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.873857  3622 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:51.883342  3597 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.040s
I20260709 12:13:51.869133  3698 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:51.928046 27162 raft_consensus.cc:1240] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:51.930585  3621 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.931308  3621 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:51.933525  3609 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:51.936282  3697 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:51.938637  3428 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:51.939823 26616 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:51.941071  3428 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:51.942001  3653 consensus_queue.cc:260] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:51.943537  3653 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:51.951617  3598 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:51.882723  3481 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.080s
I20260709 12:13:51.934180  3621 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:51.959648  3697 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:51.960959 26618 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:13:51.967990 27134 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:51.885341 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:13:51.883647 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 58766us
I20260709 12:13:51.900913 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:51.974962 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 77196.5us
I20260709 12:13:51.865355  3593 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:51.982244 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:51.992641 27163 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:13:51.870780  3663 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:51.921156  3666 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:51.921833  3214 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:51.917639  3179 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.001967 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:51.964535  3371 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:51.991045  3697 consensus_queue.cc:1059] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.024s
I20260709 12:13:51.990777  3621 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election won for term 29
W20260709 12:13:52.038020 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 152766us
W20260709 12:13:52.051489 26587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.017s	sys 0.016s
W20260709 12:13:52.051875 26587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.017s	sys 0.016s
I20260709 12:13:52.041154 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:52.007974  3684 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:52.024092  3666 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:52.007688  3481 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:51.965518  3631 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:52.089315 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:52.092993 26364 catalog_manager.cc:5697] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 22 to 26, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 26 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:52.099220  3371 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:52.088941  3666 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:52.115020  3593 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:52.051347  3621 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:52.122054 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:52.137116 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47896.3us
I20260709 12:13:52.138761 26438 leader_election.cc:400] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33.
I20260709 12:13:52.140275 26438 leader_election.cc:400] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31.
I20260709 12:13:52.141680 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:52.051013  3179 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:52.143640 26362 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39184 (request call id 167) took 14605 ms (client timeout 15000 ms). Trace:
I20260709 12:13:52.146174  3631 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:52.146950 27164 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 31: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:52.060516  3684 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:52.146766 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:52.057183 26619 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36.
W20260709 12:13:52.170624 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.171981  3179 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:52.150532  3697 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.173615  3697 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:52.176376  3697 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:52.117295  3597 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:13:52.193600 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:52.148087  3621 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:52.149063  3665 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:52.201087 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 272483us
I20260709 12:13:52.202282 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:52.204118 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:52.204577 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:52.149863 26362 rpcz_store.cc:269] 0709 12:13:37.538659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.888145 (+349486us) service_pool.cc:224] Handling call
0709 12:13:52.143344 (+14255199us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:46.788845 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:46.932997 (+144152us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:46.944202 (+ 11205us) write_op.cc:435] Acquired schema lock
0709 12:13:46.944259 (+    57us) tablet.cc:662] Decoding operations
0709 12:13:47.131311 (+187052us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:47.131389 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:47.131427 (+    38us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:13:47.132905 (+  1478us) tablet.cc:701] Row locks acquired
0709 12:13:47.132932 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:13:47.133138 (+   206us) write_op.cc:270] Start()
0709 12:13:47.133302 (+   164us) write_op.cc:276] Timestamp: P: 1783599227133071 usec, L: 0
0709 12:13:47.133335 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:13:47.322459 (+189124us) log.cc:844] Serialized 4750 byte log entry
0709 12:13:47.465311 (+142852us) op_driver.cc:464] REPLICATION: finished
0709 12:13:47.741915 (+276604us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b540007d354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d5e28 00007f5079b10581 00007f5079b0fd58 00007f5079b149f1 00007f5079b149a9 00007f5079b14939 00007f5079b14901 00007f5079b13b2d 0000000000388634 0000000000388479
0709 12:13:47.946653 (+204738us) write_op.cc:301] APPLY: starting
0709 12:13:47.946785 (+   132us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:48.132854 (+186069us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:48.132900 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:48.444559 (+311659us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:48.445012 (+   453us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0709 12:13:48.445089 (+    77us) write_op.cc:312] APPLY: finished
0709 12:13:48.445721 (+   632us) log.cc:844] Serialized 113 byte log entry
0709 12:13:48.631837 (+186116us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:48.795887 (+164050us) write_op.cc:454] Released schema lock
0709 12:13:48.825068 (+ 29181us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:48.825690 (+   622us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:48.825739 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":481806,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":445534,"apply.run_cpu_time_us":36092,"apply.run_wall_time_us":879044,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54239,"num_ops":12,"prepare.queue_time_us":501604,"prepare.run_cpu_time_us":18571,"prepare.run_wall_time_us":961743,"raft.queue_time_us":96606,"raft.run_cpu_time_us":42436,"raft.run_wall_time_us":147764,"replication_time_us":331678,"spinlock_wait_cycles":30000512,"thread_start_us":626410,"threads_started":5,"wal-append.queue_time_us":350284,"wal-append.run_cpu_time_us":5603,"wal-append.run_wall_time_us":2089687}]]}
I20260709 12:13:52.165653 26364 catalog_manager.cc:5697] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 16 to 17, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 17 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:52.183573 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 130066us
I20260709 12:13:52.208237 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:52.201664 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:52.182603  3684 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:52.205041 26615 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:52.211783 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:52.217826 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 76264.6us
I20260709 12:13:52.221298 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:52.222695 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:52.216389 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 175343us
I20260709 12:13:52.225100 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:52.224094 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:52.201421  3481 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:52.235159 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:52.235271 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:52.240787 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:52.234712 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:52.243072 27159 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
W20260709 12:13:52.230211 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 400882us
I20260709 12:13:52.246348 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:52.214722  3622 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:52.250293 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:52.262935 27133 leader_election.cc:336] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.521s (SENT)
I20260709 12:13:52.263510 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:52.256500 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:52.228092  3667 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:13:52.224442  3297 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:13:52.268008 26620 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:52.234752  3569 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:52.271363 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:52.327874 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 56612.9us
W20260709 12:13:52.327596 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 64664.8us
I20260709 12:13:52.330487 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:52.239650  3663 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.239653  3481 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:52.256415  3622 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:52.245692  3371 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:52.321777 26364 catalog_manager.cc:5697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 21 to 24, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 24 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:52.256211  3620 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:52.348416  3698 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:52.378006 26613 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.009s	sys 0.020s
W20260709 12:13:52.439792 26613 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.018s	sys 0.035s
W20260709 12:13:52.438139 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 107797us
I20260709 12:13:52.445657 26364 catalog_manager.cc:5697] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 20 to 30, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 30 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:52.373831  3622 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:52.325058  3202 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:52.346055  3692 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:13:52.318121  3711 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
W20260709 12:13:52.489996 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.350463  3667 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:52.350898  3691 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:13:52.357230  3481 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:52.373558  3297 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:52.439682 26513 connection.cc:256] RPC call timeout handler was delayed by -1.2860726240000986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1734s for a response
W20260709 12:13:52.553887 26513 connection.cc:256] RPC call timeout handler was delayed by -1.0592726240001866s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
I20260709 12:13:52.472334  3569 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 12:13:52.481688 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 134555us
I20260709 12:13:52.556450 26542 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:13:52.556618 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:52.379717  3697 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:52.494186 27133 leader_election.cc:336] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.769s (SENT)
I20260709 12:13:52.560470 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:52.521128 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:52.522423 26437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.008s	sys 0.142s
I20260709 12:13:52.377053  3597 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.519831 26364 catalog_manager.cc:5697] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 20 to 23, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 23 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:52.440807  3649 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:52.541539 27162 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31. Ops: []
I20260709 12:13:52.359814  3663 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:52.550812 26622 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.019s	sys 0.014s
I20260709 12:13:52.390738  3665 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.138s
I20260709 12:13:52.469285  3620 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:52.604218 26364 catalog_manager.cc:5697] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:52.552852 26615 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 31 index: 15. Preceding OpId from leader: term: 33 index: 16. (index mismatch)
W20260709 12:13:52.561414 26437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.009s	sys 0.142s
W20260709 12:13:52.565361 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 76250.2us
I20260709 12:13:52.567790 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:52.562458 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:13:52.611096 27133 leader_election.cc:336] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.969s (SENT)
I20260709 12:13:52.570847 26541 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 31 index: 20. (index mismatch)
W20260709 12:13:52.587272 26622 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.020s	sys 0.014s
I20260709 12:13:52.592070 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:52.594766 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:52.613631 26548 raft_consensus.cc:2376] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24. Re-sending same reply.
I20260709 12:13:52.601403 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:52.615180 26542 raft_consensus.cc:2376] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 31. Re-sending same reply.
I20260709 12:13:52.562866  3569 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.620272 26539 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:52.621876  3569 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:52.628804 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:52.630555 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:13:52.633724  3709 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.567s	user 0.004s	sys 0.000s
I20260709 12:13:52.598007  3649 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:52.636704  3649 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:52.637583  3667 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 34.22, Last appended by leader: 22, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:52.641055  3179 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.641614  3179 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:52.644981 26546 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
W20260709 12:13:52.647162  3718 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 12:13:52.648077  3614 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:52.650827 26547 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 30.
W20260709 12:13:52.651235  3712 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 12:13:52.653390  3714 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:13:52.653884  3704 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
W20260709 12:13:52.654913  3713 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
W20260709 12:13:52.656888  3716 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 12:13:52.659319  3715 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 12:13:52.660276 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4660) took 1476 ms. Trace:
I20260709 12:13:52.660686 26620 rpcz_store.cc:276] 0709 12:13:51.184202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.188374 (+  4172us) service_pool.cc:224] Handling call
0709 12:13:51.188632 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.327217 (+1138585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.659906 (+332689us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400267d54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:52.660192 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2481838976}
W20260709 12:13:52.663416  3717 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.120s	user 0.002s	sys 0.000s
I20260709 12:13:52.663872  3179 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:52.658077  3371 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:52.665587  3371 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:52.668304  3371 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:52.670581 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:52.672731  3297 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 30.18, Last appended by leader: 18, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:52.675896 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1362) took 1165 ms. Trace:
I20260709 12:13:52.672729  3621 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:52.562027  3691 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:52.680413  3621 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:52.680751  3691 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:52.569715  3697 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:52.618209 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:52.692121 26544 raft_consensus.cc:2376] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 30. Re-sending same reply.
W20260709 12:13:52.693409 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 131044us
I20260709 12:13:52.695492 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:13:52.697630 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.676568 26466 rpcz_store.cc:276] 0709 12:13:51.510578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.510752 (+   174us) service_pool.cc:224] Handling call
0709 12:13:51.540965 (+ 30213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:51.546575 (+  5610us) raft_consensus.cc:1534] Early marking committed up to index 19
0709 12:13:51.837851 (+291276us) log.cc:844] Serialized 14 byte log entry
0709 12:13:52.240913 (+403062us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:52.260381 (+ 19468us) log.cc:844] Serialized 26 byte log entry
0709 12:13:52.260536 (+   155us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:13:52.260572 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.260642 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:52.675574 (+414932us) raft_consensus.cc:1685] finished
0709 12:13:52.675608 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.675800 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36574,"prepare.queue_time_us":250467,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":17956,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":36629,"thread_start_us":646316,"threads_started":2,"wal-append.queue_time_us":731125}
I20260709 12:13:52.685912  3697 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:52.707757 26548 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 12:13:52.709007 26548 pending_rounds.cc:85] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 14
I20260709 12:13:52.709352 26548 pending_rounds.cc:107] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 12:13:52.709671 26548 raft_consensus.cc:2889] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:52.718055 27163 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.032s	sys 0.063s
W20260709 12:13:52.719642 27163 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.032s	sys 0.063s
W20260709 12:13:52.720903 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 102915us
I20260709 12:13:52.724534 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:52.574560  3692 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:52.714422  3683 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election won for term 30
W20260709 12:13:52.719749  3666 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.004s
I20260709 12:13:52.577788  3597 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:52.744616 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 49219.6us
I20260709 12:13:52.718283  3609 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:52.556455  3202 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:52.721843  3617 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:52.726042  3697 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:52.734766  3694 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:13:52.715992  3711 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
W20260709 12:13:52.778964 26436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.032s	sys 0.079s
W20260709 12:13:52.781482 26436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.032s	sys 0.079s
I20260709 12:13:52.754544  3683 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:52.760953  3666 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:52.827545 26614 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.021s	sys 0.040s
I20260709 12:13:52.808740  3683 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:52.825150 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:52.782954  3620 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:52.847738 26545 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
W20260709 12:13:52.827986 26614 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.021s	sys 0.040s
I20260709 12:13:52.781553  3505 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.047s
I20260709 12:13:52.876204 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:52.826949 27132 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.24.179.126:41797, user_credentials={real_user=slave}} blocked reactor thread for 94854.4us
I20260709 12:13:52.832564 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:52.834275 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:52.842015 26472 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:13:52.843730 26468 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:52.844168 26469 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 19. Preceding OpId from leader: term: 32 index: 20. (index mismatch)
I20260709 12:13:52.811609  3345 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 12:13:52.821547  3428 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:52.881896 26546 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:13:52.914009  3620 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:52.876852 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:52.952404 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:52.913213 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:52.915253 26542 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:13:52.940640 26472 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:52.901885 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:52.913309 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:52.954420 26545 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:52.942953 26364 catalog_manager.cc:5697] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 16 to 26, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 26 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:52.877405 26471 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 16. Preceding OpId from leader: term: 33 index: 17. (index mismatch)
I20260709 12:13:52.919731  3599 raft_consensus.cc:3055] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:52.956280  3599 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:52.956103 26364 catalog_manager.cc:5697] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 18 to 20, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 20 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:52.957103  3599 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:52.959244 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3921) took 1183 ms. Trace:
I20260709 12:13:52.953099 26546 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:52.959646 26613 rpcz_store.cc:276] 0709 12:13:51.775392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.803123 (+ 27731us) service_pool.cc:224] Handling call
0709 12:13:51.803446 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:51.803841 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.803870 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:51.804350 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:13:52.440536 (+636186us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:52.440602 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.440703 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:52.959016 (+518313us) raft_consensus.cc:1685] finished
0709 12:13:52.959038 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.959193 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":139,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":113,"thread_start_us":635696,"threads_started":1,"wal-append.queue_time_us":988370}
W20260709 12:13:52.940963 26438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.041s	sys 0.075s
W20260709 12:13:52.961886 26438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.041s	sys 0.075s
I20260709 12:13:52.958145 26364 catalog_manager.cc:5697] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
W20260709 12:13:52.962739 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 716431us
I20260709 12:13:52.961820 26470 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 29 index: 17. Preceding OpId from leader: term: 31 index: 18. (index mismatch)
W20260709 12:13:52.966048 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 89281.9us
W20260709 12:13:52.922288 27131 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.077s	sys 0.131s
I20260709 12:13:52.967415 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:13:52.967413 27131 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.078s	sys 0.132s
I20260709 12:13:52.965694 26438 leader_election.cc:400] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 35. Current term is 36.
I20260709 12:13:52.968896 26438 leader_election.cc:403] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Cancelling election due to peer responding with higher term
I20260709 12:13:52.940023  3723 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:52.917265 26439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.018s	sys 0.045s
W20260709 12:13:52.976234 26439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.018s	sys 0.046s
W20260709 12:13:52.982604 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 720926us
I20260709 12:13:52.958149  3599 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:52.960748  3663 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:52.940356  3697 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:52.986163 26364 catalog_manager.cc:5697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 18 to 23. New cstate: current_term: 23 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:52.976053  3695 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:53.023006  3695 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:53.023520  3695 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:53.001439  3663 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 12:13:53.027194 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:52.978063  3732 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 12:13:53.028128 26543 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:53.000495 27163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1477) took 1002 ms. Trace:
I20260709 12:13:53.029424 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:53.001412  3620 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:53.002429 26439 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:53.030647  3597 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:53.031543 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:53.033651 27162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 1247) took 1066 ms. Trace:
I20260709 12:13:53.035121  3666 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:53.020556  3700 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.571s	user 0.004s	sys 0.008s
I20260709 12:13:52.967720  3428 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:52.983362  3665 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:13:52.983934  3723 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:53.039251 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:53.041133 26544 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:13:53.039736 26548 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 30. Current term is 31. Ops: []
I20260709 12:13:53.030764 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1364) took 1433 ms. Trace:
I20260709 12:13:53.037806 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:13:53.047515 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 378203us
I20260709 12:13:53.047736 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:53.020754 26358 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 953d8c981a6c459f8b7f3dbbb66fda45 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3262bf0553e543eea76794fc529a9acc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:13:53.042899 26473 rpcz_store.cc:276] 0709 12:13:51.597210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.597439 (+   229us) service_pool.cc:224] Handling call
0709 12:13:51.598014 (+   575us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:51.609600 (+ 11586us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.609651 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:51.610371 (+   720us) log.cc:844] Serialized 26 byte log entry
0709 12:13:52.059053 (+448682us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:52.059096 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.059174 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:53.027606 (+968432us) spinlock_profiling.cc:243] Waited 39 ms on lock 0x7b240011a9f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072e739c4 00007f5072e71acb 00007f507302cdc9 00007f507302ca55 00007f507302bfb0 00007f5075ca2488 00007f5075ca2be8 00007f5075c7a398 00007f5075c7576a 00007f5075c74bb6
0709 12:13:53.030427 (+  2821us) raft_consensus.cc:1685] finished
0709 12:13:53.030448 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.030697 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89809792,"thread_start_us":447399,"threads_started":1,"wal-append.queue_time_us":835287}
I20260709 12:13:53.029932 27163 rpcz_store.cc:276] 0709 12:13:51.997677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.997821 (+   144us) service_pool.cc:224] Handling call
0709 12:13:52.000880 (+  3059us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:52.004798 (+  3918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:52.004848 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:52.057341 (+ 52493us) log.cc:844] Serialized 26 byte log entry
0709 12:13:52.721376 (+664035us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:13:52.721442 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.721538 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:53.000254 (+278716us) raft_consensus.cc:1685] finished
0709 12:13:53.000274 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.000408 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3324,"raft.queue_time_us":4090,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":17660,"thread_start_us":606594,"threads_started":1,"wal-append.queue_time_us":841556}
I20260709 12:13:53.034045 27162 rpcz_store.cc:276] 0709 12:13:51.966979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.967203 (+   224us) service_pool.cc:224] Handling call
0709 12:13:52.494525 (+527322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.588263 (+ 93738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.033402 (+445139us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b540071c5d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:53.033561 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1131492096}
I20260709 12:13:53.055044 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:53.055980 26543 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:13:53.065950 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:53.066709 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:53.069280 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:53.070075 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:53.070287 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:53.060261 26546 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:53.074011 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:53.075168 26543 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:13:53.075383 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:53.078298 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:53.078145 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:53.079885 26473 raft_consensus.cc:2410] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 32 because replica has last-logged OpId of term: 31 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 19.
I20260709 12:13:53.083343 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:53.084643 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.085491 26470 raft_consensus.cc:2368] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:13:53.009999  3481 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:53.085872 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:53.086377 26472 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:53.081830 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:53.095778 27133 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:53.096601 26468 raft_consensus.cc:2410] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 32 because replica has last-logged OpId of term: 31 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 17.
I20260709 12:13:53.097658 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:53.097872  3614 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:53.088616 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:53.092206 26618 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:53.093389 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:53.099577 26469 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 31: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:53.099644 26470 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:13:53.047072  3732 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:13:53.118944 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:53.122714 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:53.006237  3569 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:53.039600  3598 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:52.985572  3505 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.081s
I20260709 12:13:53.098773 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:53.100919 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:53.093732 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:53.085412  3202 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:53.105123 26468 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 29: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:53.114938 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:53.094085 26546 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:53.076933  3620 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:53.125118 26541 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:53.128801 26473 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 29: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:53.101734 26471 raft_consensus.cc:2410] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 26 because replica has last-logged OpId of term: 25 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:13:53.132206 26464 raft_consensus.cc:2376] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23. Re-sending same reply.
I20260709 12:13:53.133394 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:53.098182 26364 catalog_manager.cc:5697] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 18 to 23, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 23 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:53.135529 26364 catalog_manager.cc:5697] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 19 to 22, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 22 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:13:53.137235 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:53.100425  3428 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:53.137938 26471 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 28
I20260709 12:13:53.040987  3697 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:53.138540 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:53.143055 26473 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:13:53.078510  3666 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.052s
I20260709 12:13:53.140774 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:53.148164 26546 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:13:53.151733 26465 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 28: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:53.153182 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:53.126893  3598 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.153679 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:53.133781  3734 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.165140 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:53.166098 26542 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:53.165880  3734 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:53.166714  3724 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:53.167202  3724 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:53.134006  3620 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.168737 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:53.169205  3620 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:13:53.170198  3725 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.386s	user 0.001s	sys 0.000s
I20260709 12:13:53.171635  3723 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:53.156004  3684 consensus_meta.cc:287] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.922s	user 0.009s	sys 0.005s
I20260709 12:13:53.174911 27161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1476) took 1247 ms. Trace:
I20260709 12:13:53.174955  3684 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:53.175446 27161 rpcz_store.cc:276] 0709 12:13:51.927727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.929043 (+  1316us) service_pool.cc:224] Handling call
0709 12:13:51.929418 (+   375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:51.929843 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.929873 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:51.930557 (+   684us) log.cc:844] Serialized 52 byte log entry
0709 12:13:52.214737 (+284180us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:52.214782 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.214852 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:53.169444 (+954592us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:53.174487 (+  5043us) raft_consensus.cc:1685] finished
0709 12:13:53.174515 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.174819 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":113,"spinlock_wait_cycles":60452736,"thread_start_us":283745,"threads_started":1,"wal-append.queue_time_us":797127}
I20260709 12:13:53.165325  3666 consensus_queue.cc:1243] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 27.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260709 12:13:53.178606 27160 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:53.179283  3684 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:53.165221  3697 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:53.168278  3724 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:53.179848 27160 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56886 (request call id 1474) took 1253 ms (client timeout 1613 ms). Trace:
W20260709 12:13:53.182904 27160 rpcz_store.cc:269] 0709 12:13:51.926848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.965657 (+ 38809us) service_pool.cc:224] Handling call
0709 12:13:53.179661 (+1214004us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54003b6ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:53.179783 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2643250944}
I20260709 12:13:53.187805 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:53.146915  3733 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:53.191365 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.191320 26546 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 31 index: 15. Preceding OpId from leader: term: 33 index: 16. (index mismatch)
I20260709 12:13:53.187541  3724 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:53.197062 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.199021 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:53.159591  3598 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:53.217012 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1654) took 1017 ms. Trace:
I20260709 12:13:53.168817  3734 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:53.217757 26614 rpcz_store.cc:276] 0709 12:13:52.199858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.200205 (+   347us) service_pool.cc:224] Handling call
0709 12:13:52.200571 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.200796 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:13:52.849720 (+648924us) log.cc:844] Serialized 14 byte log entry
0709 12:13:53.216510 (+366790us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:53.216586 (+    76us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:53.216654 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.216754 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.216929 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":620371,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":1005388,"threads_started":2}
I20260709 12:13:53.262017 26471 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:53.275933 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:53.276957 26471 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 33.
W20260709 12:13:53.278723 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 298435us
I20260709 12:13:53.256284  3684 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:53.263818  3711 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:53.285336 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:53.264740  3214 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:53.307195 26511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.008s	sys 0.011s
W20260709 12:13:53.307776 26511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.008s	sys 0.011s
I20260709 12:13:53.204113  3733 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:53.310446 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 214719us
I20260709 12:13:53.312041 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:53.336344 26466 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:13:53.346616 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:53.349920  3720 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.532s	user 0.004s	sys 0.000s
I20260709 12:13:53.351536 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4673) took 1786 ms. Trace:
I20260709 12:13:53.351646 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3922) took 1480 ms. Trace:
I20260709 12:13:53.352012 26617 rpcz_store.cc:276] 0709 12:13:51.565253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.712741 (+147488us) service_pool.cc:224] Handling call
0709 12:13:51.713111 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:51.713559 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.713591 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:51.714187 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 12:13:52.155207 (+441020us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:13:52.155252 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.155327 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:53.346336 (+1191009us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:53.351208 (+  4872us) raft_consensus.cc:1685] finished
0709 12:13:53.351232 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.351464 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5190,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"spinlock_wait_cycles":7268224,"thread_start_us":396845,"threads_started":1,"wal-append.queue_time_us":1033558}
I20260709 12:13:53.352187 26622 rpcz_store.cc:276] 0709 12:13:51.871405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.872691 (+  1286us) service_pool.cc:224] Handling call
0709 12:13:51.873050 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:51.873448 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:13:52.616617 (+743169us) log.cc:844] Serialized 14 byte log entry
0709 12:13:53.199989 (+583372us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:53.260608 (+ 60619us) log.cc:844] Serialized 26 byte log entry
0709 12:13:53.260789 (+   181us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:53.260831 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.260944 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:53.351394 (+ 90450us) raft_consensus.cc:1685] finished
0709 12:13:53.351418 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.351576 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":909470,"prepare.run_cpu_time_us":3424,"prepare.run_wall_time_us":17970,"raft.queue_time_us":61479,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":47754,"thread_start_us":1087640,"threads_started":2,"wal-append.queue_time_us":622501}
I20260709 12:13:53.357107  3569 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:53.303012  3684 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:53.370695 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:53.371858 26465 raft_consensus.cc:2410] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 28 because replica has last-logged OpId of term: 26 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 15.
I20260709 12:13:53.373737 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:53.312824  3214 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:53.381112 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:53.381289 27160 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: []
W20260709 12:13:53.365701  3736 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:13:53.381980 27161 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:13:53.386596 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:53.386972 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:53.387782 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:53.387327 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:53.390901 27166 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:13:53.397948  3481 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:53.369964  3732 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.370180  3428 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.370568  3653 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:53.402042 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:53.404789 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:53.405952 26465 raft_consensus.cc:2368] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 27. Current term is 28.
I20260709 12:13:53.409338 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:53.410848 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:53.386221  3751 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.424757 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:53.415922 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:53.421983 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:53.425613 26620 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:53.423306 26619 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:13:53.425287 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:53.428390 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.431784 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:53.433497 26465 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 29: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:53.425820 26621 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:13:53.396263  3693 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:53.437170 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:53.393842  3748 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:53.437954 26467 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:13:53.440773 26613 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 33 index: 21. Preceding OpId from leader: term: 36 index: 23. (index mismatch)
I20260709 12:13:53.453739 26616 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:13:53.456605 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:53.459067 26467 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 29: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:53.402777  3728 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.043s
I20260709 12:13:53.469687 26438 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:53.440685  3621 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:53.415463  3653 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:53.475800 26617 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:13:53.424134  3428 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:53.501999 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 222007us
W20260709 12:13:53.462534  3753 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:13:53.415325  3732 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:53.459739  3693 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
W20260709 12:13:53.506636  3735 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
W20260709 12:13:53.514070 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 114105us
I20260709 12:13:53.435014  3751 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:53.511268  3738 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:13:53.444089  3748 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:53.512300 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:53.535750 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:53.540947 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:53.537701 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 68752.6us
I20260709 12:13:53.499920  3621 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:53.543076 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:53.515658  3734 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:53.534924  3724 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.508756  3691 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 12:13:53.567590  3684 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:53.568245  3684 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:53.517506  3747 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.035s
W20260709 12:13:53.573622  3695 consensus_meta.cc:287] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.550s	user 0.008s	sys 0.001s
W20260709 12:13:53.557175  3756 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:13:53.558558  3724 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:53.562384  3711 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:53.552778  3505 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:53.566287  3214 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:53.575811  3621 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:53.577821  3748 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:53.580018  3683 consensus_meta.cc:287] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.001s
I20260709 12:13:53.585444  3428 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:53.589085  3622 consensus_meta.cc:287] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.042s	user 0.011s	sys 0.002s
I20260709 12:13:53.589970  3617 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:53.555150  3597 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:53.600327 26620 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
W20260709 12:13:53.602443 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 59394.4us
I20260709 12:13:53.545645  3767 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 12:13:53.618871 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 83194.2us
I20260709 12:13:53.595985  3179 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:53.600824  3723 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.645418  3723 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:53.625159 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:53.627055 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:53.606954  3711 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:53.633026  3770 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 30.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:13:53.633836  3733 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:53.635761  3760 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 12:13:53.636482  3759 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:13:53.615561  3751 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:53.641048  3732 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:53.642282  3719 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.853s	user 0.003s	sys 0.000s
I20260709 12:13:53.642823 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:53.648772 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:53.655871  3598 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:53.656579  3724 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:53.657143  3723 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:53.660682  3620 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:53.669970 27133 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:53.628093  3597 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:53.629166  3767 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:13:53.674220  3599 consensus_meta.cc:287] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.680s	user 0.008s	sys 0.005s
I20260709 12:13:53.681516 27166 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:53.684701 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:53.696880 26464 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 32.
I20260709 12:13:53.684332 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:53.622784  3683 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:53.679322 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 138438us
I20260709 12:13:53.601157  3695 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:53.700816 26468 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 31: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:53.629458  3622 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:53.630981  3617 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:53.705411 26543 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
W20260709 12:13:53.709779 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.716358 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:53.718811 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:53.720118 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:53.729943 27133 leader_election.cc:400] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 27. Current term is 28.
I20260709 12:13:53.712530 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:53.730842 27133 leader_election.cc:403] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Cancelling election due to peer responding with higher term
I20260709 12:13:53.731263 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:53.720937 26613 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:13:53.695863  3767 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:53.701792  3751 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.745564 26470 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:53.745983 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:53.702837  3568 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:53.706265  3505 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:53.750480 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:53.701829  3773 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:53.753834 26613 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:53.755689 26439 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:53.713590  3724 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 12:13:53.773779 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44032.3us
I20260709 12:13:53.748749  3621 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:53.779544 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:13:53.806874 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 105091us
I20260709 12:13:53.776701  3692 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.807821 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:53.787142  3614 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:13:53.751363  3597 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:53.764001  3751 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:53.807834  3665 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.765s	user 0.009s	sys 0.006s
I20260709 12:13:53.823199  3665 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election lost for term 35. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 35. Current term is 36.
I20260709 12:13:53.823392  3784 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:53.823868  3784 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.824138  3781 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:13:53.816102  3617 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:53.824194  3784 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:53.781658  3778 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 12:13:53.834766  3622 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:53.836071  3597 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:53.841475  3751 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:53.820448  3614 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:53.842569  3614 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:53.819382  3692 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:53.843863 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.845347  3692 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:53.814684  3598 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:53.807253  3780 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:53.841552  3653 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:53.863413  3780 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:53.875721  3779 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:13:53.866794  3620 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:53.868351  3683 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:53.884191  3684 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:53.822525  3505 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:53.865995  3784 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:53.902833  3784 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:53.887382 26469 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36.
W20260709 12:13:53.886844 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 282538us
I20260709 12:13:53.910831 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:53.912014  3784 raft_consensus.cc:2764] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election decision vote started in defunct term 27: won
I20260709 12:13:53.918264 26616 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:53.919984  3695 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:53.920835  3711 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:53.921876  3780 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:53.922025 26620 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:53.923532 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:53.921211 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:53.924974 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:53.925258 26616 raft_consensus.cc:2368] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 27. Current term is 28.
I20260709 12:13:53.930934 27166 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:13:53.934036 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:53.936750 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:53.937748 27161 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:53.942114 27168 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:53.932385  3774 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election lost for term 27. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 27. Current term is 28.
I20260709 12:13:53.886528  3767 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:53.948390  3693 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.003s
I20260709 12:13:53.950536  3767 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:53.951928  3614 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:53.953249 27134 leader_election.cc:400] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 27. Current term is 28.
W20260709 12:13:53.960063 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 334979us
I20260709 12:13:53.961231 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:53.961477 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3533) took 1042 ms. Trace:
I20260709 12:13:53.962095 26545 rpcz_store.cc:276] 0709 12:13:52.919478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.955092 (+ 35614us) service_pool.cc:224] Handling call
0709 12:13:52.955404 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.955632 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 20
0709 12:13:53.269227 (+313595us) log.cc:844] Serialized 14 byte log entry
0709 12:13:53.960928 (+691701us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:53.961008 (+    80us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:13:53.961082 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.961183 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.961371 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":576938,"prepare.queue_time_us":388952,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"thread_start_us":427488,"threads_started":2,"wal-append.queue_time_us":114719}
I20260709 12:13:53.966128 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3526) took 1134 ms. Trace:
I20260709 12:13:53.966804 26541 rpcz_store.cc:276] 0709 12:13:52.831888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.832046 (+   158us) service_pool.cc:224] Handling call
0709 12:13:52.832439 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.132854 (+300415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.965726 (+832872us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b5400105ed4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:53.966029 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672465792}
W20260709 12:13:53.969703 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 542874us
W20260709 12:13:53.979058 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.982336  3202 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:53.983201  3202 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:53.985807  3202 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:53.991648  3734 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:53.991871  3711 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:53.992300  3734 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:53.992095 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3524) took 1160 ms. Trace:
I20260709 12:13:53.995088 26539 rpcz_store.cc:276] 0709 12:13:52.831286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.875716 (+ 44430us) service_pool.cc:224] Handling call
0709 12:13:52.903082 (+ 27366us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:13:52.917344 (+ 14262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:52.917378 (+    34us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:13:52.923003 (+  5625us) log.cc:844] Serialized 104 byte log entry
0709 12:13:53.281172 (+358169us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:53.598902 (+317730us) log.cc:844] Serialized 14 byte log entry
0709 12:13:53.991037 (+392135us) log.cc:844] Serialized 14 byte log entry
0709 12:13:53.991470 (+   433us) log.cc:844] Serialized 14 byte log entry
0709 12:13:53.991626 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.991707 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:53.991755 (+    48us) raft_consensus.cc:1685] finished
0709 12:13:53.991767 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.992011 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":391504,"prepare.queue_time_us":67288,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":88,"raft.queue_time_us":411815,"raft.run_cpu_time_us":731,"raft.run_wall_time_us":13099,"thread_start_us":580309,"threads_started":2,"wal-append.queue_time_us":412142}
I20260709 12:13:53.996946  3597 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.997154  3599 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:53.997869  3214 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.998543  3597 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.012903  3733 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:54.013533  3733 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:13:54.000422 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 244834us
W20260709 12:13:54.015208 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 54078.9us
I20260709 12:13:54.016078 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:54.001413  3568 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:13:54.017566  3568 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.018473  3568 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:54.020840  3770 consensus_queue.cc:1059] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:54.002319  3621 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:54.014768  3371 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:54.021828  3770 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:54.021903  3371 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:54.022563  3371 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:54.022224  3621 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:54.022750 26588 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:54.023995  3723 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 26.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:54.024870  3723 raft_consensus.cc:3055] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:54.025233  3723 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:53.999182  3214 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.026784 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:53.998366 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.030265 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:54.032456 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:54.014726  3733 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 30.20, Last appended by leader: 20, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:54.035497 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 214059us
I20260709 12:13:54.051921 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:54.053000 26546 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:53.998926  3599 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.063088 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:54.063879 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:54.063879 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:54.069933 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:54.070762 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:54.071439 26547 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 18. (term mismatch)
I20260709 12:13:54.071839 26547 pending_rounds.cc:85] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 17
I20260709 12:13:54.003069  3667 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:54.077057 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 44677.3us
I20260709 12:13:54.069046 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:54.078387 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:54.074407 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:54.080245 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:54.075177 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:54.008348  3692 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.078778 27160 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 21.
I20260709 12:13:54.081629 26465 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:54.072077 26547 pending_rounds.cc:107] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 26.18
I20260709 12:13:54.088294 26547 raft_consensus.cc:2889] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:54.002606  3614 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:54.037755  3745 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:54.090197 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:54.090996 26542 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:54.086248 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:54.093883 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:54.094938 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:54.095207 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:54.098634 27168 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:54.098690 26513 leader_election.cc:400] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:13:54.099944 26513 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:54.095739 26466 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:13:54.102262 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:54.026073  3723 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.103072 26466 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:54.110458 26513 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:54.117708 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:54.111649 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:54.112061 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:54.041231  3774 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 27.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.058s
I20260709 12:13:54.085089  3620 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:54.129238  3620 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:54.132038  3620 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:54.066877  3732 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.048s
I20260709 12:13:54.097069  3692 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:54.108440  3785 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:13:54.133416  3785 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.133790  3785 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:54.124046  3593 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:54.135938  3593 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:54.138760 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:54.128597  3631 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:54.139883  3631 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:54.140933  3631 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:54.096306  3745 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.144948 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:54.145114 27163 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:54.148214 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:54.149598 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:54.150854 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:54.127983  3723 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:54.139528 26467 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:54.151342 26513 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:54.151834 26542 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:13:54.142351  3631 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:54.153903 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:54.154054 27168 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
W20260709 12:13:54.152407 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 181080us
I20260709 12:13:54.135015  3692 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:54.122298  3622 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:54.122138  3749 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:13:54.169021 26465 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 33.
I20260709 12:13:54.169251 26439 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:13:54.184233 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 72726.9us
I20260709 12:13:54.147128  3745 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:54.187319 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:54.193228 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:54.195231 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:54.196647 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:54.096491  3667 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:54.193401 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:54.164245  3464 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.184935  3620 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:54.224396 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:54.225185 26542 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:54.232275 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.194003  3481 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:54.186527  3202 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election won for term 32
W20260709 12:13:54.243450 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 50113us
I20260709 12:13:54.236769 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:13:54.239723 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.230885  3784 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 28.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.026s
I20260709 12:13:54.205267 27163 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:13:54.263074 26543 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:13:54.253489 26467 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:13:54.228196  3695 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.034s
W20260709 12:13:54.255785 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.201248  3768 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election won for term 31
W20260709 12:13:54.259652 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 108421us
I20260709 12:13:54.200681  3214 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:54.210353  3704 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:13:54.209445  3663 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.055s
I20260709 12:13:54.237300  3732 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:13:54.289532 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52866.2us
I20260709 12:13:54.267647 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:54.289628 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:54.290977 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:54.314500 26547 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:54.315639 26467 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 32: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:54.326575 27160 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:54.262527  3789 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:54.263687  3202 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:54.331679 26542 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:13:54.231980  3464 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:54.312006  3725 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:13:54.290207  3620 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.289439  3748 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:54.259972  3653 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.069s
I20260709 12:13:54.338757 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:54.311909  3609 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:54.312211  3768 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:54.291540  3795 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:54.337297  3202 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:54.387387 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:54.317606  3704 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 33 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:54.329954  3481 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.058s
I20260709 12:13:54.333053  3345 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.057s
I20260709 12:13:54.346415  3599 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:54.337298  3780 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.058s
W20260709 12:13:54.420428 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 81818.5us
I20260709 12:13:54.423728 26513 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:54.420950 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:54.347981  3799 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:54.431583 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 260298us
I20260709 12:13:54.346158  3620 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.434659 26547 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:54.437193 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:54.437693 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:54.434386 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:54.438300 26547 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:54.409338  3798 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:54.446187 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:54.447124 26542 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:54.443630  3768 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 29.20, Last appended by leader: 20, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:54.448995  3797 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:13:54.459381 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:54.461724 26547 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
W20260709 12:13:54.465029 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.466449 26547 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 18. Preceding OpId from leader: term: 31 index: 19. (index mismatch)
W20260709 12:13:54.458444  3796 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.249s	user 0.000s	sys 0.002s
I20260709 12:13:54.468930 26547 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 31 index: 19. (index mismatch)
I20260709 12:13:54.443830  3790 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
W20260709 12:13:54.470819 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 132967us
I20260709 12:13:54.419250  3704 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 32.23, Last appended by leader: 23, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:54.462613  3794 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 12:13:54.476330 26542 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
W20260709 12:13:54.478205  3800 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.146s	user 0.001s	sys 0.001s
I20260709 12:13:54.479229  3568 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.480374 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:54.480963  3803 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:13:54.481698  3568 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:54.478051  3667 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:54.481701 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:54.483621 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 144659us
I20260709 12:13:54.487846 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:54.495273  3801 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:13:54.498656  3593 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:54.504231  3464 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:54.511262 26473 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 31 index: 19. (index mismatch)
I20260709 12:13:54.489805  3371 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:54.517170  3371 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:54.514456  3663 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:54.518482  3663 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.522179  3663 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:54.522519  3597 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:54.524797 26473 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:13:54.530325 26473 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 31 index: 19. (index mismatch)
I20260709 12:13:54.494366 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:54.536338  3814 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:54.539498  3814 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:54.539988  3814 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:54.541262 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:54.561323 26464 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:13:54.568365  3814 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.571064  3814 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:54.594559  3802 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.117s	user 0.000s	sys 0.002s
I20260709 12:13:54.562129  3778 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:13:54.592054  3734 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.599s	user 0.006s	sys 0.007s
W20260709 12:13:54.605193 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.543879  3785 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.613890  3785 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:54.621057 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.624143 26465 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:13:54.630518 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:54.606066  3778 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:54.632396 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:54.635433 26468 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 31. Current term is 32. Ops: []
I20260709 12:13:54.635982 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:54.632989  3747 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.031s	sys 0.052s
I20260709 12:13:54.621676  3734 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:54.637465  3695 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:13:54.635211  3778 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:54.649756  3723 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:54.628096  3653 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.014s
I20260709 12:13:54.638908  3811 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:54.661804  3811 raft_consensus.cc:697] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:54.638339  3780 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:54.658980  3723 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.660503  3745 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:54.645342  3747 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.031s	sys 0.052s
I20260709 12:13:54.663861 26473 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:54.654874  3695 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:54.674063  3745 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:54.669634  3695 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:54.678598  3811 consensus_queue.cc:237] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.680902 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4706) took 1400 ms. Trace:
I20260709 12:13:54.681578 26471 rpcz_store.cc:276] 0709 12:13:53.280168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.280382 (+   214us) service_pool.cc:224] Handling call
0709 12:13:53.281728 (+  1346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:53.282034 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:53.282057 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:53.282597 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 12:13:53.604004 (+321407us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:53.624943 (+ 20939us) log.cc:844] Serialized 14 byte log entry
0709 12:13:53.628766 (+  3823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.628847 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:53.995832 (+366985us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b180032ec60. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fbb2a6 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1
0709 12:13:53.996502 (+   670us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b180032ec60. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:13:54.645073 (+648571us) spinlock_profiling.cc:243] Waited 7.79 ms on lock 0x7b180032ec60. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:13:54.680590 (+ 35517us) raft_consensus.cc:1685] finished
0709 12:13:54.680627 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:54.680815 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31030,"prepare.queue_time_us":27196,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":5133,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":11897,"spinlock_wait_cycles":100465408,"thread_start_us":277923,"threads_started":1,"wal-append.queue_time_us":362279}
I20260709 12:13:54.689550  3734 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:54.690691  3609 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:54.663337  3768 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:54.697868  3723 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:54.701658  3620 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:54.709044  3751 raft_consensus.cc:3055] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:54.709582  3751 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:54.710579  3751 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:54.711722  3751 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:54.694274  3768 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:54.724589 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 290380us
I20260709 12:13:54.732517  3798 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:54.734434  3747 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:54.737104  3667 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:54.749176  3695 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.797758 26618 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:13:54.734004  3799 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:54.744017  3747 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:54.806289 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:54.749500  3809 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.309s	user 0.005s	sys 0.000s
I20260709 12:13:54.749864  3667 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:54.813786 26470 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:54.740661  3767 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.755090  3823 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.806707  3747 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 30.20, Last appended by leader: 20, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:54.819829  3767 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.820132  3823 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.820658  3747 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:54.822459  3692 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 31.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 12:13:54.822131  3823 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:54.755733  3599 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:54.823640  3599 consensus_queue.cc:1243] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 33.21 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 19
I20260709 12:13:54.758719  3778 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:54.760227  3214 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:54.762229  3768 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:54.764961 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:54.770681 26471 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 32. Current term is 33. Ops: []
I20260709 12:13:54.776993  3569 raft_consensus.cc:3055] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Stepping down as leader of term 24
W20260709 12:13:54.830840 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 65980.9us
W20260709 12:13:54.831295 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.787210 26465 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 33. Current term is 34. Ops: [33.17-33.17]
I20260709 12:13:54.789600 26613 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:54.726756  3202 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.790354 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:54.799252 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:54.804297 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:54.836915 26615 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:54.805455 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:54.748759  3798 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.807678 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:54.819142 26616 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 33. Current term is 34. Ops: []
I20260709 12:13:54.815761  3667 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:54.843427 26614 raft_consensus.cc:2410] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 30 because replica has last-logged OpId of term: 28 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 17.
I20260709 12:13:54.844347  3798 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:54.804188  3620 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:54.847216  3620 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.755607 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:54.824443 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:54.824081  3693 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:13:54.852634  3693 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:54.854027  3693 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 31.20, Last appended by leader: 20, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:54.855952  3693 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:54.829064 26621 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:54.822115  3767 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:54.835063  3569 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:54.866550  3569 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.867594  3569 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:54.868783 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.870764  3202 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:54.871141  3789 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 27.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:54.872449  3789 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:54.872795  3811 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:54.826975  3770 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.010s
I20260709 12:13:54.875813  3778 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:54.816910  3179 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:13:54.876796 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 121327us
I20260709 12:13:54.886214 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:54.888741 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:54.877287 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.890362 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:54.872890  3789 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:54.892773 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:54.893517 27166 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
W20260709 12:13:54.893982 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.892804 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:54.894995 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 471385us
I20260709 12:13:54.894289 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:54.895052 27161 raft_consensus.cc:2393] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:54.899247 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:54.899767 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:54.900110 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:54.900749 26464 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:54.850127  3620 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:54.910699 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:54.899448 26615 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:13:54.923696 26439 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:54.865118  3599 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.895466 26514 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:54.926369 26469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 4700) took 1809 ms (client timeout 1853 ms). Trace:
W20260709 12:13:54.926851 26469 rpcz_store.cc:269] 0709 12:13:53.116819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.122378 (+  5559us) service_pool.cc:224] Handling call
0709 12:13:54.926203 (+1803825us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b540006a4d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:54.926308 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611061504}
I20260709 12:13:54.928371 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:54.927655 26514 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:54.895433  3202 raft_consensus.cc:2764] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election decision vote started in defunct term 29: won
I20260709 12:13:54.886886  3811 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:54.979612 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:54.974948  3569 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:54.981499 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53050.4us
I20260709 12:13:54.986804  3811 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 16, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.987206  3569 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.907135  3749 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:54.988584  3749 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:54.930018  3784 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.061s
I20260709 12:13:54.899784  3179 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:54.941280 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:54.902529  3823 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:54.982239 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 58623.9us
W20260709 12:13:54.993957 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:54.955847 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.994580 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:54.996466 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:55.019318 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:54.894905  3214 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:55.041869 26543 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 31. Current term is 32. Ops: []
I20260709 12:13:55.040110 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:55.042325 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:55.069286 26542 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 26
W20260709 12:13:55.071938 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.074079 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:55.080744 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:55.082940 27161 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:13:55.086009 26545 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:54.929750  3799 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:13:55.090620 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 75318.9us
I20260709 12:13:55.090878 27166 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:55.045536  3825 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:55.112509  3825 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:55.113126  3825 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:55.096158 26622 raft_consensus.cc:1217] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Deduplicated request from leader. Original: 30.19->[31.20-36.23]   Dedup: 31.20->[32.21-36.23]
I20260709 12:13:55.114230 26622 pending_rounds.cc:85] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 20
I20260709 12:13:55.114538 26622 pending_rounds.cc:107] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 33.21
I20260709 12:13:55.114786 26622 raft_consensus.cc:2889] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:55.096370 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 155222us
I20260709 12:13:55.097602 26618 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:55.117175 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:55.117362 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:55.018492  3599 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:55.104591  3812 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:54.992756  3179 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:55.084933  3622 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:13:55.111440  3749 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:55.045806  3683 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.066s
I20260709 12:13:55.119722 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:54.992436  3823 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:55.122378 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:55.124349 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:55.046723  3723 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election won for term 33
W20260709 12:13:55.126204 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 138694us
W20260709 12:13:55.130828 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 203277us
W20260709 12:13:55.178778 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:55.212590 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.930469  3781 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.193s
I20260709 12:13:55.182449 26542 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:55.185767 26546 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 30. Current term is 31. Ops: [30.20-30.20]
W20260709 12:13:55.187893 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:55.209313 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 89641.6us
I20260709 12:13:55.245710 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:55.238445 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:55.243908 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.127526  3812 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:55.180177  3202 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election won for term 31
W20260709 12:13:55.260659 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 48811.7us
I20260709 12:13:55.261571 27161 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 24: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:55.267100 26548 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:55.184526  3704 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:55.184075  3622 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 32 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:55.267815 26545 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 12:13:55.241531  3824 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:55.278137  3622 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 30.20, Last appended by leader: 20, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:55.268710 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:55.282141  3823 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:55.187691  3214 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:55.282862  3823 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:55.283757  3214 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.18, Last appended by leader: 18, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:55.289016 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1382) took 1123 ms. Trace:
I20260709 12:13:55.289507 26473 rpcz_store.cc:276] 0709 12:13:54.165587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.535348 (+369761us) service_pool.cc:224] Handling call
0709 12:13:54.535664 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:54.665431 (+129767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.288666 (+623235us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54000a50d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:55.288934 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294342400}
I20260709 12:13:55.292488 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:55.293406 26613 raft_consensus.cc:2368] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 25. Current term is 26.
I20260709 12:13:55.298641 26620 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:55.314579  3599 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:55.123208  3799 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:55.317137  3799 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:55.179070  3789 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:55.259439  3723 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:55.318660  3789 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:55.319604  3723 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 31.18, Last appended by leader: 18, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:55.263906  3202 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.274955 26539 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:55.275321  3704 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:55.184468  3829 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:13:55.282877 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:55.326575 26548 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:55.361411  3829 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:55.361881  3829 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:13:55.362022 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 79225.7us
I20260709 12:13:55.362739 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:55.362848 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:55.363431 26539 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:13:55.363847  3649 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:55.363801 26548 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:13:55.326610 26543 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:55.364482  3649 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:55.364640 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:55.364975  3649 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:55.365731 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:55.366994 26543 raft_consensus.cc:2410] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 32 because replica has last-logged OpId of term: 30 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 17.
I20260709 12:13:55.328210 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:55.368261 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:55.333092  3667 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:55.370925  3297 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:55.371424  3297 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:55.371692  3667 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:55.372387  3297 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:55.373507  3297 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:55.340356  3202 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:55.272383  3569 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:55.386089 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:55.360651  3704 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:55.365890 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:55.380955 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:55.380079 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:55.389889 26548 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:55.263504  3812 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:55.393308  3799 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 12:13:55.375553  3831 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 12:13:55.384510  3826 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.198s	user 0.000s	sys 0.004s
I20260709 12:13:55.412163 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3547) took 1323 ms. Trace:
I20260709 12:13:55.404664 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:55.395532 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:55.412639 26544 rpcz_store.cc:276] 0709 12:13:54.088881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.101242 (+ 12361us) service_pool.cc:224] Handling call
0709 12:13:54.711992 (+610750us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:54.727574 (+ 15582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:54.727603 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:54.730699 (+  3096us) log.cc:844] Serialized 26 byte log entry
0709 12:13:54.981424 (+250725us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:54.981463 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.981539 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:55.112320 (+130781us) raft_consensus.cc:1685] finished
0709 12:13:55.112350 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.396770 (+284420us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b5400106dd0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:55.412053 (+ 15283us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17251,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":6401,"spinlock_wait_cycles":1357885696,"thread_start_us":254887,"threads_started":2,"wal-append.queue_time_us":374137}
I20260709 12:13:55.388175  3733 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:55.415190 26548 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:13:55.423350 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:55.425879 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:55.432338 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:55.466179 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 254790us
I20260709 12:13:55.408798  3599 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.470151 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:55.409262  3799 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:55.481045 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:55.484948 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:55.486027 26467 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:13:55.487200 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:55.491591 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:55.496253 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.498083 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:55.503839 26468 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 34 index: 22. Preceding OpId from leader: term: 36 index: 23. (index mismatch)
I20260709 12:13:55.506770 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:55.420938  3823 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:55.466616  3824 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:55.482951  3799 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:55.515161  3428 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 31.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.004s
I20260709 12:13:55.521582 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:55.507774  3781 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 12:13:55.527215 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:55.529268 26469 raft_consensus.cc:2410] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 32 because replica has last-logged OpId of term: 29 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 17.
I20260709 12:13:55.467933  3749 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.553659 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:55.503425  3767 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election won for term 27
W20260709 12:13:55.559720 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.562309 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:55.564615 26473 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 29: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:55.564987 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:55.550551  3831 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:13:55.568163 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:55.526810  3653 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:55.565042 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:55.573164 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:55.476600  3667 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.082s
I20260709 12:13:55.558495  3569 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:55.569628  3609 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:55.502898  3599 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:55.583554 26544 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 32: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:13:55.583889 26438 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 2.139s (SENT) [suppressed 15 similar messages]
I20260709 12:13:55.552525  3481 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:55.588272 26469 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:55.564311  3747 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:13:55.605778  3747 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:55.587527  3814 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.011s	sys 0.029s
W20260709 12:13:55.609850  3814 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.011s	sys 0.030s
W20260709 12:13:55.593853 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.611370  3599 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:55.614701 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:55.514829  3811 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 32.23, Next index: 24, Last known committed idx: 23, Time since last communication: 0.069s
I20260709 12:13:55.604969  3481 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:55.575619  3653 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.626647  3481 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:55.626982  3693 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.770s	user 0.012s	sys 0.003s
W20260709 12:13:55.630081  3825 consensus_meta.cc:287] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.516s	user 0.000s	sys 0.010s
I20260709 12:13:55.620208  3667 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:55.632572 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1515) took 1589 ms. Trace:
I20260709 12:13:55.687479 26541 rpcz_store.cc:276] 0709 12:13:54.043624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.044849 (+  1225us) service_pool.cc:224] Handling call
0709 12:13:54.045182 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:54.045538 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:54.045564 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:54.781360 (+735796us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b2c0005b0f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:13:54.781835 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:13:54.900879 (+119044us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:55.018839 (+117960us) log.cc:844] Serialized 14 byte log entry
0709 12:13:55.097202 (+ 78363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.097305 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:55.598059 (+500754us) raft_consensus.cc:1685] finished
0709 12:13:55.632281 (+ 34222us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.632475 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77994,"prepare.queue_time_us":140801,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":91159,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":8820,"spinlock_wait_cycles":46416256,"thread_start_us":118710,"threads_started":1,"wal-append.queue_time_us":350133}
I20260709 12:13:55.587498  3767 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:55.587962  3828 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:55.563402  3749 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:55.634176 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:55.635311 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:55.576815  3824 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:55.638600 26617 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:55.639928 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:55.701042 26620 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:13:55.642892  3747 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 33.17, Last appended by leader: 17, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:55.587759  3823 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.059s
I20260709 12:13:55.647537  3751 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.648980  3829 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:55.650429  3653 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:55.654901 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:55.676229 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.677549 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:55.709954 26546 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:55.704802 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:55.646029  3649 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:55.595718  3569 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:55.752308  3569 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:55.754788  3649 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:55.755589  3649 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:55.756101  3649 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:55.697089 26539 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:55.760063 26546 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:13:55.761209 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:55.762406  3749 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:55.763738 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:55.764154  3649 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:55.766785 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:55.766894  3202 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:55.768471 26543 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 31: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:55.768131  3767 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 26.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:55.768927 26539 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:13:55.769935 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:55.772567  3821 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.944s	user 0.005s	sys 0.002s
I20260709 12:13:55.698604  3825 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:55.776602  3825 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:55.720033 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.685168 27163 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:13:55.696328  3828 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.777655  3828 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:55.708067  3824 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:55.778930 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.780532  3824 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:55.692210 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:55.782527 26541 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:13:55.712054 26540 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:55.782837 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:55.783586 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:55.617614  3609 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:55.784514 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:55.736996  3751 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:55.700243  3667 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:55.782423 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:55.742552 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.803208 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:55.757079 26542 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 26: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:55.798305  3202 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:55.805176 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:55.784261 26541 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:55.785053 26545 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31. Ops: []
I20260709 12:13:55.782033 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:55.785223 26514 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:55.784287 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:55.811638 26618 raft_consensus.cc:2410] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 32 because replica has last-logged OpId of term: 30 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 19.
W20260709 12:13:55.766248 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.812033 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:55.788889 26617 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:55.812470 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:55.787096 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:55.812533 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.814157 27161 raft_consensus.cc:2410] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 32 because replica has last-logged OpId of term: 30 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 19.
W20260709 12:13:55.695559 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 449934us
W20260709 12:13:55.821910 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.824697 26541 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:13:55.804243 26540 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:55.827648 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:55.828049 26514 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:55.829924 26514 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:55.831938 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:55.833788 26544 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 26: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:55.789299  3297 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.848385 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:55.854321 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 270470us
W20260709 12:13:55.859524 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 60970.7us
I20260709 12:13:55.862718 27133 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:55.828882  3824 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:55.846915  3823 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:55.853655  3481 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:55.862174  3704 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.847324  3812 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:55.864202  3622 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:55.922574 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:55.860848  3297 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:55.924320 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.886952  3824 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:55.928654 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:55.905755  3768 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:55.938182 26540 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 30. Current term is 31. Ops: []
I20260709 12:13:55.940708 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:55.942312 26466 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 29.
I20260709 12:13:55.918468  3749 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:55.944867 26619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:13:55.947976 26619 raft_consensus.cc:606] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:13:55.926472  3789 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.946030  3768 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:55.947723  3749 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.915416  3704 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:56.010071 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 3958) took 1221 ms. Trace:
I20260709 12:13:56.012475 26541 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 29 index: 20. Preceding OpId from leader: term: 31 index: 21. (index mismatch)
I20260709 12:13:55.946751  3609 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:55.933985  3622 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:56.017388 26616 rpcz_store.cc:276] 0709 12:13:54.788639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.804920 (+ 16281us) service_pool.cc:224] Handling call
0709 12:13:54.805357 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:54.843369 (+ 38012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.009723 (+1166354us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b54001f5ed4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:56.009981 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30970112}
I20260709 12:13:55.966022  3745 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election won for term 28
W20260709 12:13:56.032950 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 217922us
I20260709 12:13:55.990411  3749 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:55.982664  3179 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:13:56.012571 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 68222.2us
I20260709 12:13:56.040146  3745 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:56.043243 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 180604us
I20260709 12:13:56.045735 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:55.980607  3789 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:56.058812 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:56.059631 26547 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:13:56.062966 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:13:56.075366 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 152949us
W20260709 12:13:56.076071 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 208649us
I20260709 12:13:56.077373 26514 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:56.077373 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:56.082940 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:56.083782 26514 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:56.083791 26464 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:13:56.088706 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:56.072500  3843 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:56.093101 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:56.099092 26514 leader_election.cc:400] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 25. Current term is 26.
I20260709 12:13:56.249223 26514 leader_election.cc:403] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:13:56.155401 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:56.259371 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 160553us
I20260709 12:13:56.260871 26514 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:56.075780  3202 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:13:56.065397  3778 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.017s
W20260709 12:13:56.355120 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 262127us
I20260709 12:13:56.356257 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:56.079403  3667 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:56.361600 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:56.355518 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 94755.1us
I20260709 12:13:56.363149 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:56.247934  3481 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:56.074563  3811 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.229s
W20260709 12:13:56.390858  3845 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.462s	user 0.000s	sys 0.001s
I20260709 12:13:56.391377  3704 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:56.392681  3860 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
W20260709 12:13:56.393582  3849 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.473s	user 0.000s	sys 0.001s
I20260709 12:13:56.394698  3791 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:56.395264  3791 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:56.397315  3791 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:56.301395  3214 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 25. Current term is 26.
I20260709 12:13:56.260845  3838 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:56.259586  3798 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:13:56.355309  3846 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 12:13:56.371706  3723 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:56.248900  3824 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:13:56.418596 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3730) took 1153 ms. Trace:
I20260709 12:13:56.431365 26542 rpcz_store.cc:276] 0709 12:13:55.265253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.266503 (+  1250us) service_pool.cc:224] Handling call
0709 12:13:55.404425 (+137922us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:13:56.418300 (+1013875us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54003985d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:56.418520 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":798212736}
I20260709 12:13:56.418852 26539 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26. Ops: []
W20260709 12:13:56.427228 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 354101us
I20260709 12:13:56.306942  3823 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 29.20, Next index: 21, Last known committed idx: 19, Time since last communication: 0.114s
I20260709 12:13:56.384914  3841 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.397261  3622 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:56.414455  3767 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
W20260709 12:13:56.464046 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 107885us
I20260709 12:13:56.444231 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:56.484100  3695 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:56.485700  3179 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:56.445288 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:56.411739  3870 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 27.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.101s
I20260709 12:13:56.446028 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:56.491714 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:56.505533 27161 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:13:56.386528  3693 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 25.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.062s
I20260709 12:13:56.422334  3838 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:56.424968  3812 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:56.497344 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 236533us
I20260709 12:13:56.430770  3867 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:56.509153 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 435635us
I20260709 12:13:56.510339 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:56.517349 26469 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 28.
W20260709 12:13:56.517470 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 72338.8us
I20260709 12:13:56.519110 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:56.460209  3825 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:56.468282  3297 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:56.520500 26438 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:56.520359  3838 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:56.526929 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:56.530444 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:56.494042  3824 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.533929 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:56.543291 26617 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:13:56.439316  3791 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 31.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.075s
I20260709 12:13:56.541972 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4708) took 1446 ms. Trace:
I20260709 12:13:56.522362  3825 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:56.418488  3869 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.116s
I20260709 12:13:56.428934  3745 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:56.548010 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:56.545656 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:56.545864 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:56.496587  3179 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:56.544382 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:56.549966 27160 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:56.533674 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:56.544252 26622 rpcz_store.cc:276] 0709 12:13:55.095261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.095466 (+   205us) service_pool.cc:224] Handling call
0709 12:13:55.095874 (+   408us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:13:55.185319 (+ 89445us) raft_consensus.cc:1534] Early marking committed up to index 20
0709 12:13:55.660358 (+475039us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b18001cb040. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f5079ad23c7 00007f50760e49a7 00007f50760ed5e5 00007f50760ed568
0709 12:13:55.800676 (+140318us) log.cc:844] Serialized 14 byte log entry
0709 12:13:56.028069 (+227393us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:13:56.029670 (+  1601us) log.cc:844] Serialized 78 byte log entry
0709 12:13:56.029879 (+   209us) raft_consensus.cc:1645] Marking committed up to 22
0709 12:13:56.038800 (+  8921us) log.cc:844] Serialized 14 byte log entry
0709 12:13:56.049845 (+ 11045us) log.cc:844] Serialized 14 byte log entry
0709 12:13:56.086425 (+ 36580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.303051 (+216626us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:56.541659 (+238608us) raft_consensus.cc:1685] finished
0709 12:13:56.541685 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:56.541878 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":196526,"prepare.queue_time_us":699772,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":160790,"raft.queue_time_us":133847,"raft.run_cpu_time_us":446,"raft.run_wall_time_us":210801,"spinlock_wait_cycles":15169664,"thread_start_us":366079,"threads_started":2,"wal-append.queue_time_us":716384}
I20260709 12:13:56.535502 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:56.495896  3622 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:56.494306  3823 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Stepping down as leader of term 29
W20260709 12:13:56.534068  3858 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:13:56.556128 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:56.471235  3841 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:56.549149 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 144183us
I20260709 12:13:56.522652  3667 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.505172  3464 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 12:13:56.585341 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:56.583541 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 148849us
I20260709 12:13:56.586715 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:56.588052 27162 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 33 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 32. Current term is 33. Ops: []
I20260709 12:13:56.596060 26587 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:56.588377 26617 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:13:56.597411 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:56.534891  3782 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:56.589156 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:56.536062  3843 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:56.598649 27168 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:56.598974  3843 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.599311  3782 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:56.599596  3843 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:56.600260  3782 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
I20260709 12:13:56.600977  3782 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:13:56.601392  3782 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 32 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:56.602299  3782 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 31.20, Last appended by leader: 20, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:56.533704  3866 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:56.547848  3825 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:56.545212  3812 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:56.554322  3179 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:56.532843  3881 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 12:13:56.613682 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.578891  3823 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:56.623673 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:56.632247 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:56.624114 27166 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 31: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:56.622958 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:56.633631 27159 raft_consensus.cc:3060] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:56.587406  3428 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:56.634836 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:56.549871  3824 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:56.588614  3733 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:56.641686  3780 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.614768  3667 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:56.645424  3767 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:56.693742 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:56.652024  3873 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:13:56.652684  3869 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:56.653327 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:56.654736  3841 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:56.643260  3297 raft_consensus.cc:2804] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:56.657414  3843 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:56.658650  3871 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:13:56.617111  3778 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:13:56.674964  3823 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 29.20, Last appended by leader: 20, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:56.676481 26588 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:56.676625  3464 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.676921 26542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:13:56.678285  3814 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.583503  3622 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:56.529807  3867 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:56.686735 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:56.730039 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:56.689569 27160 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:13:56.690594 26548 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
W20260709 12:13:56.651146  3862 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:13:56.730876 26466 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:13:56.694428 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:56.704200 26464 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 30 index: 17. (index mismatch)
W20260709 12:13:56.662250  3799 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.098s	user 0.010s	sys 0.000s
W20260709 12:13:56.656608  3828 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.878s	user 0.005s	sys 0.007s
I20260709 12:13:56.639499  3863 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 12:13:56.711797 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 58563.5us
I20260709 12:13:56.631138  3812 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:56.724318 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:56.744431 26469 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:13:56.744540 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:56.725288 26542 raft_consensus.cc:606] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:13:56.695873  3825 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:56.727043 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 185815us
I20260709 12:13:56.750735 26514 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:56.709391  3875 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.646555  3428 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:56.723428  3869 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:56.755699 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 32 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:56.726468  3885 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:56.704769  3767 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:56.732280  3823 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:13:56.759275 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 203263us
I20260709 12:13:56.759603 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3649) took 1189 ms. Trace:
I20260709 12:13:56.803814 26472 rpcz_store.cc:276] 0709 12:13:55.570226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.572659 (+  2433us) service_pool.cc:224] Handling call
0709 12:13:55.591955 (+ 19296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:55.758795 (+166840us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:55.758863 (+    68us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:55.758927 (+    64us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:55.758984 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.759344 (+1000360us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b540027abd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:56.759396 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:56.759537 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383157120}
I20260709 12:13:56.804891 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:56.806273 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:56.807575  3866 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:56.730854  3878 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.702472  3780 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:56.760557 26514 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:56.733501  3778 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:56.734174  3791 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:56.760299 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3754) took 1125 ms. Trace:
I20260709 12:13:56.808213 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:56.817389 26545 rpcz_store.cc:276] 0709 12:13:55.635120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.635239 (+   119us) service_pool.cc:224] Handling call
0709 12:13:55.635546 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:55.810721 (+175175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.760058 (+949337us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400110dd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:56.760241 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340550400}
I20260709 12:13:56.758095  3214 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:56.820618 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:56.730154  3464 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:56.824476 26438 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:56.815862  3745 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:56.816047  3898 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 12:13:56.822432 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 61978us
W20260709 12:13:56.810454 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 134069us
W20260709 12:13:56.802696  3653 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.062s	user 0.006s	sys 0.007s
I20260709 12:13:56.733062  3814 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:56.835215  3653 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:56.837381  3814 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:56.837584  3653 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:56.748013  3799 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:56.839058 26547 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:56.840613  3799 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:56.841784 26621 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: [28.18-28.18]
I20260709 12:13:56.803269  3798 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:56.842927  3798 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.843444  3798 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:56.808218  3866 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:56.846720  3866 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:56.838202  3814 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.864746  3653 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 32.23, Next index: 24, Last known committed idx: 23, Time since last communication: 0.001s
I20260709 12:13:56.865736  3653 consensus_queue.cc:1243] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 3262bf0553e543eea76794fc529a9acc log is divergent from this leader: its last log entry 33.24 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 23
I20260709 12:13:56.853456  3814 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:56.873534 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:56.871665  3814 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:56.874933 26622 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 30.
I20260709 12:13:56.826669  3782 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:56.833803 26514 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:56.907641 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 73977.3us
I20260709 12:13:56.818102  3881 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:56.912451 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3573) took 1160 ms. Trace:
I20260709 12:13:56.912963 26539 rpcz_store.cc:276] 0709 12:13:55.751804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.832963 (+ 81159us) service_pool.cc:224] Handling call
0709 12:13:56.418537 (+585574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:56.433084 (+ 14547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.912195 (+479111us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b54003985d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:56.912379 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1281402752}
I20260709 12:13:56.749814  3828 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:56.802678  3885 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:56.878171  3745 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:56.917709  3885 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:56.918027  3745 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:56.904660 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.910902 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:56.828711  3869 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:56.957477  3869 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:56.957898  3869 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:56.958334  3747 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:56.823496  3791 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:56.964486  3791 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:56.922840  3891 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:56.965550  3891 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:56.968223  3891 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:56.923447  3879 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.122s
I20260709 12:13:56.969264  3877 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:56.969928  3877 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:56.970351  3879 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.970925  3879 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:56.973503  3879 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:56.802919  3838 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:56.801380  3875 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:56.929265  3882 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.818998  3297 raft_consensus.cc:697] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:56.931243  3867 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:56.931638  3780 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:56.933208  3464 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:56.912688  3881 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:57.035818  3881 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:56.823643  3778 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.040551  3778 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:56.936204  3622 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:56.938937  3782 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:13:56.940092  3749 consensus_meta.cc:287] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.891s	user 0.006s	sys 0.006s
I20260709 12:13:57.042011  3749 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:56.940487  3428 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:57.023450  3599 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:56.821341  3878 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.046947  3599 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.048709  3878 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:56.941468  3767 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:56.942209  3880 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:56.946954  3667 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:56.947559  3825 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:57.050047 27161 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
W20260709 12:13:56.948724 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.899863  3799 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.052378  3799 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.054000  3751 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:56.951830  3812 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:56.953856 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:56.954108  3865 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:56.954730 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:56.954946 26546 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 31. Current term is 32. Ops: [31.19-31.19]
I20260709 12:13:56.955554 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:56.955924  3883 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:56.956440 27159 raft_consensus.cc:2468] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:56.974124 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:56.972718  3877 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:56.975907 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:56.928504  3843 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:56.949563  3789 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:56.954227  3828 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:56.983220 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 158831us
I20260709 12:13:56.991803 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3654) took 1401 ms. Trace:
I20260709 12:13:57.000648 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:57.086105 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:56.949548  3214 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:13:57.058650 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 32 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.092341 26545 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 31.
I20260709 12:13:57.049501  3599 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:57.062440  3798 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.066365  3622 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.063397  3867 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.064121  3481 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.055800  3838 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:57.066330 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:57.058531 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.054966  3749 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:57.056558  3799 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:57.034227 27165 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:57.085773 26471 rpcz_store.cc:276] 0709 12:13:55.590910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.610158 (+ 19248us) service_pool.cc:224] Handling call
0709 12:13:55.610596 (+   438us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:55.611046 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:55.611095 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:55.611741 (+   646us) log.cc:844] Serialized 52 byte log entry
0709 12:13:55.913642 (+301901us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:55.937118 (+ 23476us) log.cc:844] Serialized 14 byte log entry
0709 12:13:55.943720 (+  6602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.943805 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:56.966024 (+1022219us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b1800423340. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:13:56.983008 (+ 16984us) raft_consensus.cc:1685] finished
0709 12:13:56.991541 (+  8533us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:56.991727 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31324,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":66640,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":21137,"spinlock_wait_cycles":12184320,"thread_start_us":301472,"threads_started":1,"wal-append.queue_time_us":413109}
I20260709 12:13:57.090071 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:57.067404  3667 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:57.092705 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:57.081748  3865 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:57.094908 26618 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Stepping down as leader of term 32
W20260709 12:13:57.092607 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 177728us
I20260709 12:13:57.107638 26618 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:57.066560  3880 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:57.081569  3883 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:57.132849  3883 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 27.20, Last appended by leader: 20, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.134106  3883 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:57.100386 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:57.138615 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:57.139462 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:57.140900 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:57.142367 26465 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 32 index: 23. Preceding OpId from leader: term: 33 index: 24. (index mismatch)
I20260709 12:13:57.143067 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4713) took 1503 ms. Trace:
I20260709 12:13:57.143589 26621 rpcz_store.cc:276] 0709 12:13:55.639516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.640415 (+   899us) service_pool.cc:224] Handling call
0709 12:13:55.640762 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:56.842364 (+1201602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.142715 (+300351us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540020ab54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:57.142974 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2761233280}
I20260709 12:13:57.144778 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:57.145145  3784 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:13:57.145532  3784 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:57.145457 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:57.147192 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:57.132843  3880 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 27.20, Last appended by leader: 20, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.149011  3875 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:57.149626  3903 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 33.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:57.150588  3903 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:13:57.150960  3903 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:57.146080 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:57.151948  3903 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 33.16, Last appended by leader: 16, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.153179  3903 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:57.096980 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:57.156348 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 59489.2us
I20260709 12:13:57.163112 26545 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:57.115942 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:57.119901 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:57.121078 27159 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 30 index: 20. Preceding OpId from leader: term: 32 index: 21. (index mismatch)
I20260709 12:13:57.120922 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:57.167248 27167 raft_consensus.cc:2368] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25.
I20260709 12:13:57.121690 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:57.121865 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:57.083962  3866 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.122699 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3572) took 1371 ms. Trace:
I20260709 12:13:57.100739  3481 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.123000  3297 consensus_queue.cc:237] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.127260 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:57.130640 26618 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 32.23, Last appended by leader: 23, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.133960  3789 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:57.117949 26622 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:13:57.190333 26542 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:57.205215 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:57.206020 26618 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:57.189664 26540 rpcz_store.cc:276] 0709 12:13:55.751554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.827563 (+ 76009us) service_pool.cc:224] Handling call
0709 12:13:55.846947 (+ 19384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:55.950616 (+103669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.122435 (+1171819us) spinlock_profiling.cc:243] Waited 90.9 ms on lock 0x7b54002f85d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:57.122629 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209114880}
W20260709 12:13:57.195272 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 54926.1us
W20260709 12:13:57.196183 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 106245us
I20260709 12:13:57.198366 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:57.209954 26620 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:13:57.093819  3751 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:57.098840  3214 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 31 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:57.091518  3179 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.232815 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:57.232990 26473 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:57.236442 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:57.189522  3790 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
I20260709 12:13:57.240197 26464 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 28: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:57.227715 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:57.205343 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:57.030856  3882 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.228150 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:57.237615 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:57.229730 26465 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:13:57.236467 26439 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:57.208889 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:57.101852  3622 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.098037  3867 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.263875 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:57.247723 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:57.265100 26544 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:57.237367 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:57.266637 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:57.267324 27168 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:13:57.241485 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:57.256381 26619 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
W20260709 12:13:57.257247 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 48432.9us
I20260709 12:13:57.242350 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3759) took 1605 ms. Trace:
I20260709 12:13:57.320674 26541 rpcz_store.cc:276] 0709 12:13:55.636557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.826132 (+189575us) service_pool.cc:224] Handling call
0709 12:13:56.011944 (+185812us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:56.019021 (+  7077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.242128 (+1223107us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b540018b5d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:57.242290 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360067328}
I20260709 12:13:57.322435 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.323386 26541 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:13:57.324595 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.325697 26541 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 31: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:57.259260 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:57.246984 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:57.261365 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:57.327103 26465 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
W20260709 12:13:57.327603 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 80743.9us
I20260709 12:13:57.328488 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:57.329679 26465 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 34: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:57.261693 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:57.200969  3782 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:57.338955 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:57.348598 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:57.270798 26620 raft_consensus.cc:2410] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 37 because replica has last-logged OpId of term: 36 index: 23, which is greater than that of the candidate, which has last-logged OpId of term: 34 index: 22.
I20260709 12:13:57.216454  3751 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:57.232999  3824 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:57.275513 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:57.155274  3667 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.235649  3598 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 30.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.023s
I20260709 12:13:57.294756 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.356928 26540 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:13:57.298988 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:57.299846 26618 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 32 index: 23. Preceding OpId from leader: term: 33 index: 24. (index mismatch)
I20260709 12:13:57.267783 26470 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 29: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:57.264473  3693 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:57.206429  3869 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.308090 26473 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
I20260709 12:13:57.331192 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:57.332574 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.213809  3789 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.352146 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:57.352198 27134 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:57.354225 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:57.362228 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:13:57.370909 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 95540us
I20260709 12:13:57.236640  3784 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 31.19, Last appended by leader: 19, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.282116  3790 consensus_queue.cc:1059] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.081s
W20260709 12:13:57.411280 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 59210.7us
I20260709 12:13:57.411643 26465 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
W20260709 12:13:57.412024 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 199535us
I20260709 12:13:57.375387 26464 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:57.350505  3875 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:57.414049 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:57.419611 26468 raft_consensus.cc:2410] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 26 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 12:13:57.414577 26466 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:13:57.370481 26544 raft_consensus.cc:2410] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 12:13:57.375962 26541 raft_consensus.cc:2410] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 28 because replica has last-logged OpId of term: 27 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 16.
I20260709 12:13:57.421366 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.421895 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.355830  3751 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:57.423157 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.359041  3723 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:57.375073  3781 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 33 current term: 33 is higher.
I20260709 12:13:57.428402 26540 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 26: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:57.428670 26539 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 28.
I20260709 12:13:57.433348 26544 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 32 index: 21. (index mismatch)
I20260709 12:13:57.415071  3841 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:57.374691  3693 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.410880  3879 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:57.360369  3887 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:13:57.370544  3782 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.273175  3865 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.350600  3704 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.075s
I20260709 12:13:57.421717  3875 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:57.430578  3598 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:57.443400 26464 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
W20260709 12:13:57.427098 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 64982us
I20260709 12:13:57.425258  3695 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:57.428313  3798 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:57.455868 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:57.457123 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:57.457806 27167 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:57.458063  3869 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:57.458711 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:57.459450 27167 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:13:57.459681  3622 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:57.435796  3723 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:57.447181 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 210761us
I20260709 12:13:57.419480  3828 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:57.462680  3828 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.464107 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:57.465533 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:57.466202 26464 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
I20260709 12:13:57.444959  3799 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:57.464416 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 47348.6us
I20260709 12:13:57.462132  3723 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:57.431290  3838 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:57.412585 27134 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:57.433825  3880 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:57.474215  3838 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.474442  3880 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:57.474772  3838 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:57.468986 26540 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 31 index: 18. Preceding OpId from leader: term: 33 index: 19. (index mismatch)
I20260709 12:13:57.476645 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.470197 26541 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:57.442513  3693 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:57.467762 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:57.434779  3866 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:57.464838  3828 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:57.450136  3782 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.479797 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:57.453219  3875 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:13:57.480822 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 68302.6us
I20260709 12:13:57.478456 27133 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:57.465823  3869 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:57.413678  3214 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 30.19, Last appended by leader: 19, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.492592 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:57.483157  3854 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:57.449836  3823 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.040s
I20260709 12:13:57.502024 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:57.502964 27167 raft_consensus.cc:2376] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26. Re-sending same reply.
I20260709 12:13:57.504366 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:57.505668 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:57.505455  3864 raft_consensus.cc:3055] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:57.506846  3864 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:57.507817  3864 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.508975  3864 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:57.506327 27167 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:13:57.504357  3878 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:57.483794  3704 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:57.514003 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:57.495025  3791 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:57.515789 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:57.471895  3598 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.519132 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:57.514335 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:57.500608  3906 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.219s	user 0.001s	sys 0.001s
I20260709 12:13:57.495608  3179 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:57.497475  3900 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:57.478492  3799 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.494812  3869 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.529182 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:57.531100 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:57.537251 26465 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:13:57.538177  3789 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:57.539095  3598 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:57.539999 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:57.540437  3867 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:57.540692 27167 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:57.541795  3704 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:57.518579  3878 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.515735  3882 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:57.542754  3704 raft_consensus.cc:697] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:57.500195  3880 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 30.19, Last appended by leader: 19, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.544330  3880 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:57.544174  3704 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.542752  3878 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:57.549198 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:57.550937 27165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1487) took 1004 ms. Trace:
I20260709 12:13:57.486102  3711 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 12:13:57.503389  3481 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:57.512264  3854 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:57.551419 27165 rpcz_store.cc:276] 0709 12:13:56.546859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.547484 (+   625us) service_pool.cc:224] Handling call
0709 12:13:56.580522 (+ 33038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.107471 (+526949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.550646 (+443175us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54006054d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:57.550852 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1042769152}
I20260709 12:13:57.558781 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:57.563064  3667 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:57.563532 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.575274 26539 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:13:57.526327  3791 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:57.567579 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.577610 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:57.569725  3784 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:57.501724  3692 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.056s
I20260709 12:13:57.483680  3907 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.057s
I20260709 12:13:57.588367 26588 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:57.571858 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.574085 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.596400 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.597084 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:57.597394 26543 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
W20260709 12:13:57.577598 27163 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 1263) took 2534 ms (client timeout 2007 ms). Trace:
W20260709 12:13:57.598858 27163 rpcz_store.cc:269] 0709 12:13:55.039412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.039684 (+   272us) service_pool.cc:224] Handling call
0709 12:13:57.573601 (+2533917us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b540060de54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:57.573712 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1309656448}
I20260709 12:13:57.599596 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:57.579936 26614 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:57.583986  3791 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:57.584686 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:57.585692 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.578372 26466 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:13:57.556142  3869 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:57.587311 26439 leader_election.cc:400] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25.
I20260709 12:13:57.604486 26539 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:13:57.605518 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:57.607055 26465 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:57.612830 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:57.612831 26470 raft_consensus.cc:2410] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 28 because replica has last-logged OpId of term: 26 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 12.
I20260709 12:13:57.613580 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:57.615345 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:57.607969 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:57.610098 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:57.608417 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:57.573796  3854 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:57.615345 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:57.619597 26466 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 28: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:57.622817 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:57.623075 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.623699 26543 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:13:57.626494 26466 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 12:13:57.627219 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.619915  3781 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:57.628458 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.629108 26541 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:13:57.614693  3866 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:57.594213  3878 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.635246 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:57.614439  3850 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.220s	user 0.008s	sys 0.005s
I20260709 12:13:57.631343 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:57.611442  3667 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.638988 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:57.639216 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:57.630721  3874 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 1.108s	user 0.004s	sys 0.000s
I20260709 12:13:57.642804 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.622166  3814 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:57.628507  3781 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.646231 26470 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 33. Current term is 34. Ops: [33.17-33.17]
I20260709 12:13:57.633919  3866 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.652091 26466 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:13:57.649044 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:57.649638 27165 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 26: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:57.653940 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:57.654876 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.654259 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:57.656440 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.656905 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:13:57.644793  3850 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.250s	user 0.009s	sys 0.005s
I20260709 12:13:57.660106 26614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2251a6321412417a8079201067ae2d0d"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:13:57.631047  3901 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 29.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.027s
I20260709 12:13:57.658994 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:57.662896 26614 raft_consensus.cc:606] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:13:57.663395 26614 raft_consensus.cc:614] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:57.666298 26468 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 31. Current term is 32. Ops: []
I20260709 12:13:57.664798  3917 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:57.670606  3917 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:57.671061  3917 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:57.649438  3781 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:57.645228  3814 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:13:57.654964  3910 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:13:57.639650  3904 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.020s
W20260709 12:13:57.663218  3883 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.528s	user 0.003s	sys 0.009s
I20260709 12:13:57.656001  3866 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:57.658109  3179 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:57.676321  3907 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:13:57.670828  3912 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:13:57.692699 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:57.644054  3667 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.694770 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3648) took 2121 ms. Trace:
I20260709 12:13:57.697804 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3577) took 1012 ms. Trace:
I20260709 12:13:57.679613  3814 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:57.700584 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.708635 26547 rpcz_store.cc:276] 0709 12:13:56.685621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.686169 (+   548us) service_pool.cc:224] Handling call
0709 12:13:56.687628 (+  1459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:56.839654 (+152026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.697551 (+857897us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54003cf854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:57.697739 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347764096}
I20260709 12:13:57.715468 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.717123 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:57.706959 26467 rpcz_store.cc:276] 0709 12:13:55.569859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.571087 (+  1228us) service_pool.cc:224] Handling call
0709 12:13:55.571487 (+   400us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:55.571875 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:55.571904 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:55.572515 (+   611us) log.cc:844] Serialized 52 byte log entry
0709 12:13:56.019651 (+447136us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b18003c5f20. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:13:56.304921 (+285270us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:56.372388 (+ 67467us) log.cc:844] Serialized 14 byte log entry
0709 12:13:56.586449 (+214061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.586569 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:57.057892 (+471323us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b18003c5f20. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:13:57.147233 (+ 89341us) spinlock_profiling.cc:243] Waited 6.64 ms on lock 0x7b18003c5f20. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:13:57.630089 (+482856us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:57.690699 (+ 60610us) raft_consensus.cc:1685] finished
0709 12:13:57.690731 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.690915 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8712,"prepare.queue_time_us":74884,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":7166,"raft.queue_time_us":108462,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":2763,"spinlock_wait_cycles":113135360,"thread_start_us":498638,"threads_started":2,"wal-append.queue_time_us":836285}
I20260709 12:13:57.717976 26547 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:13:57.723912  3711 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:57.728231  3917 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.730891  3917 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:57.719416  3867 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:57.673408  3875 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.737165 27164 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:13:57.771333 26539 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:13:57.784387 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:57.785108 26467 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:57.734892  3919 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:13:57.795464 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 96825.9us
I20260709 12:13:57.797886 27168 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31. Ops: []
I20260709 12:13:57.747561  3631 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.781414  3778 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Stepping down as leader of term 25
W20260709 12:13:57.807471  3916 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:13:57.732712  3901 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.077s
I20260709 12:13:57.814685 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:57.759280  3693 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.818044 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:57.822633  3850 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 30.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:13:57.823663  3850 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:13:57.824012  3850 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.824332  3850 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:57.832644  3853 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:13:57.833197  3853 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:57.809509  3631 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:57.844383  3923 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:13:57.845455  3829 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:57.846069  3918 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:13:57.812669  3778 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:57.812026  3922 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 30.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.044s
I20260709 12:13:57.861441  3878 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:57.863535  3926 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:57.865520  3922 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:57.865934  3922 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:57.868979  3781 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.870519  3667 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:57.871447  3859 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 1.472s	user 0.008s	sys 0.004s
I20260709 12:13:57.871663  3781 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:57.873241  3179 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:57.874187  3693 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:57.866811  3922 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 30.16, Last appended by leader: 16, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.834128  3853 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 31.19, Last appended by leader: 19, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.876240  3838 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.883962  3768 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:57.884132  3881 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.848s	user 0.013s	sys 0.001s
I20260709 12:13:57.906766  3881 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.907966  3838 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:57.908315  3631 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:57.891546  3896 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:57.891770  3875 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:57.893707  3850 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:57.909909  3911 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.424s	user 0.000s	sys 0.002s
I20260709 12:13:57.910373  3922 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:13:57.901161  3903 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.748s	user 0.011s	sys 0.004s
W20260709 12:13:57.902297  3909 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.408s	user 0.000s	sys 0.001s
I20260709 12:13:57.903316  3782 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:57.904366  3854 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.893693  3751 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.909029  3881 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:57.913141  3853 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:57.878731  3778 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.909780  3896 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:57.898819  3799 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:57.919344  3791 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:57.921236  3867 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:57.922022  3791 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:57.924139  3811 raft_consensus.cc:3055] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:57.924579  3811 raft_consensus.cc:740] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:57.916083  3866 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.916888  3850 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:57.918059  3896 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 29.20, Last appended by leader: 20, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.927485  3879 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.929440  3879 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:13:57.929641  3914 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.463s	user 0.001s	sys 0.001s
I20260709 12:13:57.929575  3896 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:57.920665  3869 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:57.969357 26540 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 26: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:57.971778 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:57.973332 26543 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:57.984943 26546 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:57.853169 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:57.996203 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:57.997790 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 144424us
I20260709 12:13:58.002261 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:58.003561 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:58.007827 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:13:58.010236 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.011044 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:58.012549 26464 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:58.016505 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:58.016889 26540 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 30 index: 17. (index mismatch)
I20260709 12:13:58.018106 26546 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 12:13:58.024622 26540 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 31. Current term is 32. Ops: []
I20260709 12:13:58.029537 26546 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
I20260709 12:13:57.893471 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:58.034161 27159 raft_consensus.cc:2376] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32. Re-sending same reply.
I20260709 12:13:58.035809 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:58.036224 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:58.037096 27159 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:13:58.041131 27166 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 1236) took 1495 ms (client timeout 1756 ms). Trace:
I20260709 12:13:58.047837  3798 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 30.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.002s
I20260709 12:13:58.049078  3695 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:58.049834  3695 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.050273  3745 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:58.050968  3745 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.051551  3745 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:57.925472  3811 consensus_queue.cc:260] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:58.053277  3711 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:57.916131  3778 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:58.041893 27166 rpcz_store.cc:269] 0709 12:13:56.545151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.545394 (+   243us) service_pool.cc:224] Handling call
0709 12:13:58.040489 (+1495095us) spinlock_profiling.cc:243] Waited 74 ms on lock 0x7b54003b5e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:58.040848 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170205952}
I20260709 12:13:58.054760  3695 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:58.069036  3854 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:58.069233 26545 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 27 index: 20. Preceding OpId from leader: term: 28 index: 21. (index mismatch)
I20260709 12:13:58.058693  3828 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:58.070963  3828 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:58.069319  3866 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:58.057359  3749 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:58.083084  3749 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:58.085407  3865 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:58.073261  3828 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 30.19, Last appended by leader: 19, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:58.088481  3828 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:58.090858 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 32 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:58.094040 26471 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:13:57.933658  3869 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:58.063824 27160 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32. Ops: []
W20260709 12:13:58.107949 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:58.117110 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 100968us
I20260709 12:13:58.144861  3814 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:58.148485 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:58.150161 26546 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 31 index: 20. Preceding OpId from leader: term: 32 index: 21. (index mismatch)
I20260709 12:13:58.155274  3879 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:58.161139  3749 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:58.171685 26618 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:58.173877  3711 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 27.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:58.174889  3751 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:58.210991  3869 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.280076  3869 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:58.281260  3811 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:58.282881  3464 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:58.285218  3464 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:58.217130  3711 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:58.286585  3711 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:58.287304 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.287796  3711 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:58.191103  3798 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:58.289322  3798 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:58.231328 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:58.292349  3798 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:58.232080  3879 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:58.232920 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:58.236068 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:58.236822  3620 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:58.295145  3869 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:58.295674  3620 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:58.239706 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:58.240272  3881 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:58.299438  3881 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:58.241084 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:58.302726  3879 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:13:58.302780  3828 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:58.304636  3828 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:58.242944 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:58.307330 26471 raft_consensus.cc:2368] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30.
I20260709 12:13:58.307238  3711 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:58.307662  3814 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:58.243870 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:58.311590 26543 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:13:58.312754 26539 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:58.286128  3464 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:58.244875 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:58.245832 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:58.315848  3481 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.316015 26470 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:13:58.252094 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:58.316568  3481 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:58.317334 26465 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:58.254815  3907 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:58.318583  3907 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:58.256600  3867 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:58.258471  3782 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:58.322643  3481 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:58.323370  3481 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:58.324492 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.325429 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3581) took 1621 ms. Trace:
I20260709 12:13:58.261803  3863 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:58.326305  3863 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:58.326995 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:58.328591  3828 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:58.328785  3863 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:58.259152 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:58.330045  3620 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:58.335047 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:58.336417 26464 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 29.
I20260709 12:13:58.337879 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:13:58.265066 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 116916us
I20260709 12:13:58.340684 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:58.329449 26548 rpcz_store.cc:276] 0709 12:13:56.703515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.733746 (+ 30231us) service_pool.cc:224] Handling call
0709 12:13:56.734244 (+   498us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:57.064875 (+330631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:57.064906 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:57.065530 (+   624us) log.cc:844] Serialized 52 byte log entry
0709 12:13:57.304111 (+238581us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:57.358661 (+ 54550us) log.cc:844] Serialized 14 byte log entry
0709 12:13:57.359085 (+   424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.841032 (+481947us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b18002a10c0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:13:58.252418 (+411386us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b18002a10c0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fbb2a6 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419
0709 12:13:58.324847 (+ 72429us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b54001054d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:13:58.324892 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:58.324982 (+    90us) raft_consensus.cc:1685] finished
0709 12:13:58.324995 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:58.325234 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57,"prepare.queue_time_us":54686,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":2045,"raft.queue_time_us":13601,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":10616,"spinlock_wait_cycles":798052352,"thread_start_us":238099,"threads_started":1,"wal-append.queue_time_us":431657}
I20260709 12:13:58.274555 26467 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
I20260709 12:13:58.343911 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:58.345005 26542 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 26: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:13:58.275403 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 76468.8us
I20260709 12:13:58.277184 27160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 1269) took 1282 ms. Trace:
I20260709 12:13:58.278002 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:58.346061 27160 rpcz_store.cc:276] 0709 12:13:56.994506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.994679 (+   173us) service_pool.cc:224] Handling call
0709 12:13:58.063123 (+1068444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:58.117747 (+ 54624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:58.276916 (+159169us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003b5e50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:13:58.277095 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2447758208}
I20260709 12:13:58.221168 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3671) took 1475 ms. Trace:
I20260709 12:13:58.347467 26469 rpcz_store.cc:276] 0709 12:13:56.745445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.746324 (+   879us) service_pool.cc:224] Handling call
0709 12:13:56.746682 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:56.746907 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 12:13:56.801221 (+ 54314us) log.cc:844] Serialized 14 byte log entry
0709 12:13:58.020124 (+1218903us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b18001a63e0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a23a 00007f50760e4a2a
0709 12:13:58.220186 (+200062us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:58.220335 (+   149us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:58.220487 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:58.220642 (+   155us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:58.220897 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2582,"prepare.queue_time_us":53744,"prepare.run_cpu_time_us":295,"prepare.run_wall_time_us":2896,"raft.queue_time_us":20326,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":265,"spinlock_wait_cycles":5199232,"thread_start_us":110411,"threads_started":1,"wal-append.queue_time_us":1421306}
I20260709 12:13:58.324088  3481 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:58.350682 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:58.351752 27166 raft_consensus.cc:2368] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29.
I20260709 12:13:58.351436  3853 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:58.352972 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:58.353921 27160 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:13:58.352983 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:58.355793 27168 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:58.356364  3881 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:58.350802  3850 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.008s
I20260709 12:13:58.317849  3464 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:58.263590 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:58.360809 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:13:58.361459 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 98207.5us
I20260709 12:13:58.362025  3904 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:58.362423 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:13:58.295218 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 59501.1us
I20260709 12:13:58.362620  3904 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.363529  3904 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:58.363709 27159 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:13:58.342798 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:58.368417 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:58.369381 26548 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:58.325644 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:58.374929 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.378882 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:58.381898  3865 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.382510  3481 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:58.382907  3865 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:58.383836  3891 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:58.384711 26613 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 34.
I20260709 12:13:58.334180  3907 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:58.387748  3853 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 27.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:58.387691  3850 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:58.388878 26541 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:58.269618 26514 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:58.390246 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:58.408039 26543 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 32.
I20260709 12:13:58.387892 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 32 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:58.392575  3782 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:58.403208 26473 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:13:58.414947  3481 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 12:13:58.415439 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 146145us
I20260709 12:13:58.416571 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:58.416328  3695 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:58.417572  3481 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:58.418083  3481 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:58.419000  3481 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:58.413466 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:58.426294 26467 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:58.431041 26468 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:58.432716  3880 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:13:58.434334  3880 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:13:58.434811 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:58.435438 26546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:13:58.436172 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:58.436439  3798 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.436345 26546 raft_consensus.cc:606] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:58.437247 26546 raft_consensus.cc:614] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:58.437506  3631 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:58.437187  3798 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:58.437692  3695 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:58.438105  3631 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 29 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:58.425808  3745 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:58.439275  3631 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:58.439821  3798 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:58.440164 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:58.441232 27166 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 22: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:58.441651  3749 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:58.443358 27160 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 27 index: 20. Preceding OpId from leader: term: 28 index: 21. (index mismatch)
I20260709 12:13:58.445544 27168 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 31 index: 20. Preceding OpId from leader: term: 32 index: 21. (index mismatch)
I20260709 12:13:58.449617 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:58.453014 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:58.453881 26614 raft_consensus.cc:2368] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 31. Current term is 32.
I20260709 12:13:58.455005 26539 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 31.
I20260709 12:13:58.442334  3749 raft_consensus.cc:697] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:13:58.411715  3782 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.460144 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:58.385792  3865 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:58.465907 26620 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:13:58.434808  3880 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:58.471254 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:58.473671 26473 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 32: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:13:58.468178 26588 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:58.474241 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:58.473120 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:58.467017  3867 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.467367  3782 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:58.483287 26539 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:13:58.483984 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:58.485172  3904 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:58.486953  3481 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:58.487895 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:58.496726  3745 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:58.497454  3867 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:58.501708 26464 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 31.
I20260709 12:13:58.469435  3798 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:58.508370 26542 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:58.508255 26541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:13:58.509800 26541 raft_consensus.cc:606] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:13:58.510231 26541 raft_consensus.cc:614] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:13:58.510114 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 46680us
I20260709 12:13:58.515997 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:58.529884 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:58.543239 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:58.513921  3881 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:58.548194 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:58.549031 27159 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Advancing to term 32
I20260709 12:13:58.526190 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:58.550920 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 132661us
I20260709 12:13:58.547405 26620 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 33. Current term is 34. Ops: []
I20260709 12:13:58.531920  3850 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:13:58.559610 26539 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 31: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:13:58.563889 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 90886us
W20260709 12:13:58.564497 26364 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57048 (request call id 308) took 39483 ms (client timeout 15000 ms). Trace:
I20260709 12:13:58.564901 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:58.547384  3749 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:58.566787 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:58.568054 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.568846  3863 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:58.575729 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:58.577896 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:13:58.578513 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.578770  3880 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 31.21, Last appended by leader: 21, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:58.579792 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:58.580524  3880 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:58.582871  3907 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:58.547627  3881 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:58.589241  3214 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.006s
I20260709 12:13:58.594782  3214 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:58.595387  3214 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:58.595731 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 88932.7us
I20260709 12:13:58.596426  3214 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:58.597523 26439 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:58.597963  3214 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:58.598857 26514 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:58.601625  3869 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:58.598934  3828 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:58.608194 26548 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 29.
I20260709 12:13:58.602202  3869 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:58.611229 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:58.616554 26542 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:13:58.592710  3881 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:58.618789 26467 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
I20260709 12:13:58.617861 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:58.620577 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:58.620826 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:58.612843  3907 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:13:58.630327 26514 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:58.612576  3850 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:58.630374 26539 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:13:58.630374 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:58.637750 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:58.639636  3896 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:58.611334  3828 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:58.638098 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:58.645947 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:13:58.647235 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 49872.4us
W20260709 12:13:58.565054 26364 rpcz_store.cc:269] 0709 12:13:19.080916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:19.081151 (+   235us) service_pool.cc:224] Handling call
0709 12:13:58.564191 (+39483040us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:53.520772 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:53.560605 (+ 39833us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:53.560659 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:13:53.560679 (+    20us) tablet.cc:662] Decoding operations
0709 12:13:53.561887 (+  1208us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:53.561992 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:53.562023 (+    31us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:13:53.645279 (+ 83256us) tablet.cc:701] Row locks acquired
0709 12:13:53.645333 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:13:53.645539 (+   206us) write_op.cc:270] Start()
0709 12:13:53.645727 (+   188us) write_op.cc:276] Timestamp: P: 1783599233645462 usec, L: 0
0709 12:13:53.645751 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:13:53.734157 (+ 88406us) log.cc:844] Serialized 4848 byte log entry
0709 12:13:53.976049 (+241892us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b18003bcbc0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:13:54.289253 (+313204us) op_driver.cc:464] REPLICATION: finished
0709 12:13:54.508791 (+219538us) write_op.cc:301] APPLY: starting
0709 12:13:54.523768 (+ 14977us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:54.657405 (+133637us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:54.663056 (+  5651us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:54.689958 (+ 26902us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:54.690558 (+   600us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0709 12:13:54.690641 (+    83us) write_op.cc:312] APPLY: finished
0709 12:13:54.691038 (+   397us) log.cc:844] Serialized 113 byte log entry
0709 12:13:54.692444 (+  1406us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:54.692658 (+   214us) write_op.cc:454] Released schema lock
0709 12:13:54.692718 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:54.729351 (+ 36633us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:54.729926 (+   575us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":457,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":173318,"apply.run_cpu_time_us":21546,"apply.run_wall_time_us":222729,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54239,"num_ops":12,"prepare.queue_time_us":134542,"prepare.run_cpu_time_us":13961,"prepare.run_wall_time_us":355577,"raft.queue_time_us":291365,"raft.run_cpu_time_us":37127,"raft.run_wall_time_us":249920,"replication_time_us":610097,"spinlock_wait_cycles":6019456,"thread_start_us":390786,"threads_started":4,"wal-append.queue_time_us":115657,"wal-append.run_cpu_time_us":35145,"wal-append.run_wall_time_us":1826429}]]}
I20260709 12:13:58.651571 26467 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:58.652920 26514 leader_election.cc:400] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29.
I20260709 12:13:58.653362 26514 leader_election.cc:403] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Cancelling election due to peer responding with higher term
I20260709 12:13:58.654464  3904 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:58.654670  3202 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:13:58.654927  3850 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 30.20, Last appended by leader: 20, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:58.655692  3202 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election lost for term 28. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29.
I20260709 12:13:58.654551 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:58.651705 27134 leader_election.cc:400] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 31. Current term is 32.
I20260709 12:13:58.663285 27134 leader_election.cc:403] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:13:58.665124 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 131911us
I20260709 12:13:58.640668  3863 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:13:58.673480 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:58.679318  3867 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:58.663725 26514 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:58.676573 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:58.680339 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:58.681337 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:58.685240 27159 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:13:58.689232 26614 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:58.691861  3922 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:58.692574  3922 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:58.695102 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 61696.3us
I20260709 12:13:58.696696 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:58.697127 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:58.640376  3896 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:58.682204 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 68733.1us
I20260709 12:13:58.702896 26588 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:58.723101 26618 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:13:58.725212 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:13:58.734617 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:58.684299  3481 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:58.728590  3853 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:13:58.762276 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:58.762549  3841 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:58.766873 27159 raft_consensus.cc:1275] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:13:58.772154  3892 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election lost for term 31. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 31. Current term is 32.
I20260709 12:13:58.759104  3866 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:58.775147  3866 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:58.777498  3464 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:58.778002  3464 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:13:58.779253  3935 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:13:58.779160  3464 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:58.780807  3464 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:58.780925 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4735) took 1552 ms. Trace:
I20260709 12:13:58.744838  3202 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:58.794927 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:58.795387 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:58.796484 26622 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 34.
I20260709 12:13:58.802289  3828 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:58.804594  3853 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:58.805856  3853 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 30.20, Last appended by leader: 20, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:58.807736  3202 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.808265  3202 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:58.811573  3782 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:58.763242 26616 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:58.781561 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:58.781432 26472 rpcz_store.cc:276] 0709 12:13:57.228243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.228362 (+   119us) service_pool.cc:224] Handling call
0709 12:13:57.241979 (+ 13617us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:57.242307 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:57.242336 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:58.092614 (+850278us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b2c000327f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:13:58.093688 (+  1074us) log.cc:844] Serialized 26 byte log entry
0709 12:13:58.476798 (+383110us) raft_consensus.cc:1645] Marking committed up to 22
0709 12:13:58.476847 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:58.494632 (+ 17785us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:58.780427 (+285795us) raft_consensus.cc:1685] finished
0709 12:13:58.780447 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:58.780752 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2990,"raft.queue_time_us":48687,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":10315,"spinlock_wait_cycles":12702976,"thread_start_us":382459,"threads_started":1,"wal-append.queue_time_us":565762}
I20260709 12:13:58.787644 27161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 1276) took 1538 ms. Trace:
I20260709 12:13:58.788093 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:13:58.816174 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.788623  3778 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:58.763280  3841 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.824175 26438 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:58.740229  3904 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.042s
I20260709 12:13:58.821602 26439 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:58.739936  3907 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.042s
W20260709 12:13:58.835551 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.728008  3869 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:58.845075 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:58.825219  3841 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:58.849903  3723 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:58.850586  3723 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:58.852845  3723 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:13:58.852834 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 154545us
I20260709 12:13:58.858083 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:58.858560  3867 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:58.860550  3481 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:13:58.861155  3896 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:58.829152  3814 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.863359  3814 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:58.815658 27161 rpcz_store.cc:276] 0709 12:13:57.190020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.033710 (+843690us) service_pool.cc:224] Handling call
0709 12:13:58.034646 (+   936us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:58.035527 (+   881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:58.035567 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:58.036566 (+   999us) log.cc:844] Serialized 26 byte log entry
0709 12:13:58.195910 (+159344us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:13:58.688835 (+492925us) log.cc:844] Serialized 14 byte log entry
0709 12:13:58.724800 (+ 35965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:58.724884 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:58.724920 (+    36us) raft_consensus.cc:1685] finished
0709 12:13:58.724930 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:58.728350 (+  3420us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35630,"prepare.queue_time_us":196820,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":68289,"raft.run_cpu_time_us":537,"raft.run_wall_time_us":7918,"thread_start_us":445967,"threads_started":2,"wal-append.queue_time_us":200594}
I20260709 12:13:58.864070 26513 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:58.883637 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:13:58.897421 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.830091  3695 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.050s
I20260709 12:13:58.906421 27159 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 31: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:58.884991  3782 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:58.922938 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:58.902102  3778 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:58.912364  3711 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.604s	user 0.014s	sys 0.003s
W20260709 12:13:58.930418 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 70486.5us
I20260709 12:13:58.912624  3828 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:13:58.932618 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 95422.3us
I20260709 12:13:58.967192 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:58.924466  3814 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:58.972882  3782 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:58.985177  3782 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:58.991392  3782 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:58.994407 26465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.083s	sys 0.093s
W20260709 12:13:58.995951 26465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.083s	sys 0.093s
I20260709 12:13:58.937911  3867 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:58.990167  3838 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.979208  3907 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:59.020264  3620 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:59.029294 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:13:59.022591 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 126382us
I20260709 12:13:58.996470  3880 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:59.026050  3907 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:59.040642 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.021325  3778 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
W20260709 12:13:59.090765 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53364.9us
W20260709 12:13:59.073182  3938 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.229s	user 0.001s	sys 0.001s
I20260709 12:13:59.044345  3481 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:59.044399  3907 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:59.097225 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 122215us
I20260709 12:13:59.031352  3838 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:59.042166  3867 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.046748  3904 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.070s
I20260709 12:13:59.077309  3880 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:59.118360  3943 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:13:59.128041 27161 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
W20260709 12:13:59.133988 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 472088us
I20260709 12:13:59.118885  3782 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.119567  3904 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:13:59.166522 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 69501.2us
I20260709 12:13:59.173331 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:13:59.177192  3881 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.008s
W20260709 12:13:59.177860 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 60803us
I20260709 12:13:59.178985 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:59.180137  3481 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:13:59.182334  3904 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.184707  3904 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:59.186498  3864 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election won for term 31
W20260709 12:13:59.187827 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 402676us
I20260709 12:13:59.177718  3881 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:59.198503 26614 consensus_meta.cc:287] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.501s	user 0.023s	sys 0.004s
I20260709 12:13:59.200343 26614 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:13:59.204384 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:59.199153 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:59.204159 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:59.206166 27168 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
I20260709 12:13:59.158776  3695 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.041s
I20260709 12:13:59.217108 26468 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:59.175676  3863 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 34 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:59.220017 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:59.254140 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:59.232944 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:59.236707  3481 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.254824 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4762) took 1009 ms. Trace:
I20260709 12:13:59.238440 26514 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:59.239869  3179 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:13:59.257508 26466 rpcz_store.cc:276] 0709 12:13:58.241946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.246438 (+  4492us) service_pool.cc:224] Handling call
0709 12:13:58.246857 (+   419us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:58.247526 (+   669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:58.247557 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:58.248273 (+   716us) log.cc:844] Serialized 52 byte log entry
0709 12:13:58.543677 (+295404us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:58.543722 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:58.543785 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:59.251213 (+707428us) raft_consensus.cc:1685] finished
0709 12:13:59.251242 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:59.251448 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":182,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":166,"thread_start_us":294897,"threads_started":1,"wal-append.queue_time_us":493683}
I20260709 12:13:59.260455  3481 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:59.261749  3214 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.658s	user 0.012s	sys 0.002s
W20260709 12:13:59.264906  3947 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 12:13:59.265152 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 100870us
W20260709 12:13:59.266168  3950 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:13:59.266599  3814 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 31.19, Next index: 20, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:59.267217  3953 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:59.267632  3814 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:13:59.268096  3814 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:59.267896  3953 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.269156  3814 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 31.19, Last appended by leader: 19, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:59.270885  3945 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.059s	user 0.003s	sys 0.000s
I20260709 12:13:59.273007  3960 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.100s
I20260709 12:13:59.273345  3863 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 33.17, Last appended by leader: 17, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.243937  3881 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:59.177734  3867 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:59.252840 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:59.221247 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.162101  3782 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.193199  3778 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:59.284346 27166 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 20. Preceding OpId from leader: term: 32 index: 21. (index mismatch)
W20260709 12:13:59.284803 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 70693.8us
I20260709 12:13:59.186097  3202 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:59.256009  3828 raft_consensus.cc:993] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: : Instructing follower 01a57027214a411e80874ac7febd628b to start an election
W20260709 12:13:59.279289  3961 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:13:59.292059 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 77549.2us
I20260709 12:13:59.293231 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:13:59.296293 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 58048.3us
I20260709 12:13:59.270296  3953 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:59.282666  3798 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:59.299408  3798 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:59.299849  3798 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:59.300688  3782 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:59.301741  3864 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:59.301808 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:59.302496  3864 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:59.302867 26539 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 32: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:59.302762 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:59.303529 26548 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:13:59.282601  3481 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:59.307260 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.311372 26439 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:59.311901 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:59.312609 26542 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:13:59.316586 26470 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:59.298424  3814 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:59.325387 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:59.326694 26539 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 33. Current term is 34. Ops: [33.19-33.19]
I20260709 12:13:59.308941  3214 raft_consensus.cc:1081] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Signalling peer 01a57027214a411e80874ac7febd628b to start an election
I20260709 12:13:59.330163 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:59.331063 26543 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:13:59.341548 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:59.344977 26439 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:59.358932  3942 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 12:13:59.361377  3939 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.399s	user 0.000s	sys 0.001s
I20260709 12:13:59.362946  3202 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:59.363564 27163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 1282) took 1370 ms. Trace:
I20260709 12:13:59.329113  3963 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:13:59.363989 27163 rpcz_store.cc:276] 0709 12:13:57.992656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.079123 (+ 86467us) service_pool.cc:224] Handling call
0709 12:13:58.079885 (+   762us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:58.081070 (+  1185us) raft_consensus.cc:1534] Early marking committed up to index 20
0709 12:13:58.190666 (+109596us) log.cc:844] Serialized 14 byte log entry
0709 12:13:58.662140 (+471474us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:58.673874 (+ 11734us) log.cc:844] Serialized 26 byte log entry
0709 12:13:58.674049 (+   175us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:13:58.674385 (+   336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:58.674491 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:59.248720 (+574229us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:13:59.363149 (+114429us) raft_consensus.cc:1685] finished
0709 12:13:59.363250 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:59.363384 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35712,"prepare.queue_time_us":311398,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":17018,"raft.run_cpu_time_us":516,"raft.run_wall_time_us":20875,"spinlock_wait_cycles":41159040,"thread_start_us":433596,"threads_started":2,"wal-append.queue_time_us":591290}
I20260709 12:13:59.368399  3853 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:59.369522  3745 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:59.369976  3745 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:59.306339  3778 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.030s
I20260709 12:13:59.375391  3782 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:59.376183  3782 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:59.376807  3782 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:59.378635  3881 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:59.379592  3881 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:59.381080  3881 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.378787 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:59.375198  3745 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.392433 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:59.384550 26543 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
W20260709 12:13:59.385579 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 68854.3us
I20260709 12:13:59.401582  3853 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.404688  3853 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:59.396000  3838 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:13:59.388100  3944 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 12:13:59.398437 26587 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:59.320744  3841 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:59.417958 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 73058.5us
I20260709 12:13:59.390487  3880 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:59.428058  3896 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:59.428447 26543 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 28. Current term is 29. Ops: [28.21-28.21]
I20260709 12:13:59.430662  3922 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:59.437654  3711 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 27.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:59.442852  3695 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:59.443379  3695 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:59.444463  3695 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.438182  3954 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:13:59.454869  3954 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.455302  3954 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:59.462986 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:59.471957  3864 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.476238  3853 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:13:59.477250 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 58409us
I20260709 12:13:59.479554 26439 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:59.482653  3778 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.483417  3778 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.467391  3922 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 12:13:59.435920  3745 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:59.496981 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 59650us
W20260709 12:13:59.491101  3464 consensus_meta.cc:287] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.710s	user 0.011s	sys 0.007s
I20260709 12:13:59.507746  3922 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:59.509107 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:59.509902 26468 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 31
I20260709 12:13:59.512223  3798 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:59.491219  3723 consensus_meta.cc:287] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.638s	user 0.014s	sys 0.001s
I20260709 12:13:59.513621  3723 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.499420  3904 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.015s
I20260709 12:13:59.515031  3880 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:13:59.515453  3880 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:59.515509  3866 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:59.516530  3880 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 33.19, Last appended by leader: 19, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.517913  3880 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:13:59.518635 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.499330 26542 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
W20260709 12:13:59.520936 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.500101 26513 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:59.502514 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:59.503793 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:59.504755 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:59.505716 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:59.526149 26468 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
W20260709 12:13:59.527880 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 121169us
I20260709 12:13:59.532541 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:59.493629  3778 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:59.517812  3954 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:59.562661  3962 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:59.565054  3954 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:59.551589  3896 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.566648  3896 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.569186  3896 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:13:59.551685 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 56555us
I20260709 12:13:59.570358 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:59.551962  3631 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.571477  3631 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:59.572105  3723 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:59.573939  3631 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:59.498888  3864 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:59.553277 26466 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 20. Preceding OpId from leader: term: 32 index: 21. (index mismatch)
I20260709 12:13:59.551429 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:59.575335 27161 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:13:59.551131 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:59.553417  3214 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:59.546006  3850 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.577540  3850 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.577956  3841 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:59.579103  3907 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.580148  3850 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:59.553328 26470 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: [27.14-27.14]
I20260709 12:13:59.554497 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:59.581979 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:59.582716  3723 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:13:59.548979  3866 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:59.583317  3723 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.583653  3866 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:59.583776  3723 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:13:59.584147  3866 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:59.586684  3904 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:59.587209  3904 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:59.587621  3904 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:59.551131 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:13:59.555323 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 75892.1us
I20260709 12:13:59.589975 27159 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:59.590323 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:59.556721  3798 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:59.551059 26546 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 32: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:13:59.591346  3620 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 27.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 12:13:59.551414  3886 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:13:59.592418  3959 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:59.592531  3886 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:59.591581  3962 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:13:59.592968  3959 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:13:59.565881 26540 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33. Ops: [32.21-32.21]
I20260709 12:13:59.596237  3886 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:59.598533 26439 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:59.600739 26439 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:59.602303  3620 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:59.603231  3620 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:59.603660  3620 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:59.604091  3620 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:59.602130 26439 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:59.625041 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.628381 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:59.631735 27159 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:13:59.509127  3922 raft_consensus.cc:3055] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:59.640552 26439 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:59.634717 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:59.639925 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:59.647708 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:59.648540 26614 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
I20260709 12:13:59.650581 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:13:59.651571 27161 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:59.653825  3959 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.21, Last appended by leader: 21, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:59.655897  3959 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:59.656286 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:59.657359 26616 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 34: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:13:59.661116 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 90875.8us
I20260709 12:13:59.665625 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:59.667271 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:13:59.669791 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:59.673223 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.633862  3778 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:59.675676 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:59.675976 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:59.633893  3481 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.680414 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:59.681140 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:59.683796 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:59.685029 26465 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:59.640583  3922 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:59.648200  3179 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:59.697230 27160 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 28. Current term is 29. Ops: [28.21-28.21]
I20260709 12:13:59.677500  3963 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:59.689374 26616 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 29: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:59.650022  3960 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.688050 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:59.648145  3880 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:59.648067  3869 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:59.658819  3962 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:59.679428 26614 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:59.691439 26622 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:59.693174 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:59.687249 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:59.697970 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:59.715363 26546 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:59.684478  3886 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:13:59.704423 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.710809 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:13:59.695622  3179 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:13:59.694944  3798 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.717303 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:13:59.712672 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:59.717581 27160 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 20. Preceding OpId from leader: term: 32 index: 21. (index mismatch)
I20260709 12:13:59.721984 26618 raft_consensus.cc:2393] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 28: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:59.731441 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:59.714555 26617 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:13:59.743242 26621 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 23.
I20260709 12:13:59.718631  3962 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:59.731240  3179 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:59.719902 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:59.694204  3481 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:13:59.740099 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 53826.8us
I20260709 12:13:59.738103 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:59.729753  3880 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 31.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.017s
I20260709 12:13:59.741170 26616 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:13:59.721215 27167 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:13:59.712069  3907 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:59.756054 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:59.690452  3778 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.774971 26615 raft_consensus.cc:2410] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 35 because replica has last-logged OpId of term: 33 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 31 index: 16.
W20260709 12:13:59.779928 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 91840.8us
I20260709 12:13:59.782032 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:59.783004 26548 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:13:59.720160  3960 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.758896  3962 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:59.792204 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:13:59.785774 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 111111us
I20260709 12:13:59.785879 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:59.797174 26539 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 31: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:13:59.787607 26540 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:59.789165 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:59.755576  3869 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:13:59.731576  3886 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:13:59.800666 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 101774us
I20260709 12:13:59.772418  3864 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:59.808372 26616 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: [29.19-29.19]
I20260709 12:13:59.756745  3798 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:59.759771  3782 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.817840 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:13:59.822507 26514 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:59.824743 26466 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
I20260709 12:13:59.824678 27163 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 36.
I20260709 12:13:59.815132  3863 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:59.848764  3695 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:59.848896 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:13:59.849841 26548 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:13:59.823460  3866 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.853327  3869 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.854431 26470 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:13:59.858877 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:59.832805  3214 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:59.867758 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:59.873365 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:59.876555  3886 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:59.878970 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:59.881350 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:59.882251 26622 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
I20260709 12:13:59.882779 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:59.883675 26620 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 29: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:13:59.884677 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:13:59.885398  3481 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:59.885396 26615 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 30.
I20260709 12:13:59.887071  3202 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:13:59.887691  3202 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:13:59.854202  3866 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:59.860462  3850 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:13:59.895603 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:13:59.902860 26470 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:59.907153 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:13:59.907449 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.908871 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:59.916363  3838 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:13:59.918958  3778 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:13:59.920217 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:59.921197  3863 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:59.909312  3975 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:59.923028 26513 leader_election.cc:400] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30.
I20260709 12:13:59.924168 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:59.924957  3863 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:59.925331  3863 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:13:59.925688  3863 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:59.925909 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:13:59.926350  3904 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:13:59.927573 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:59.928890  3777 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:59.896733  3214 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:13:59.930624  3973 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 12:13:59.915817 26439 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:59.914829 26588 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:13:59.945677 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:13:59.947809 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:13:59.957134 26439 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:13:59.959740 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:13:59.928912  3904 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:13:59.970155 27161 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 33.
I20260709 12:13:59.971050 27165 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33. Ops: [32.21-32.21]
I20260709 12:13:59.943179  3866 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:59.972436 26514 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:13:59.947808  3850 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:13:59.948796  3963 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:13:59.992661 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44865us
I20260709 12:13:59.962544  3745 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:59.962718  3778 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:59.977308  3954 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:59.999617 26470 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 32.
I20260709 12:13:59.969316  3975 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:14:00.003214 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 144458us
I20260709 12:13:59.986958 27134 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:14:00.023263 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 66296.8us
I20260709 12:13:59.989759  3980 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:14:00.006275  3481 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:14:00.004127  3778 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.031078  3960 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:00.031533 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.031706  3798 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:13:59.974682  3214 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 27.20, Last appended by leader: 20, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:00.032769  3974 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.046s
I20260709 12:14:00.033948  3867 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 32 LEADER]: Stepping down as leader of term 32
W20260709 12:14:00.034610  3979 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 12:14:00.035755  3977 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 12:14:00.036619  3978 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:14:00.040753  3963 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.046940  3850 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 31.18, Last appended by leader: 18, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.048259  3975 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:00.050453  3464 consensus_queue.cc:1048] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.024s
I20260709 12:14:00.102954 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:00.104396 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:00.008973  3904 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:00.069900 26540 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:14:00.074177 26547 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:14:00.007362  3954 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:00.027617 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:00.081184 26546 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:14:00.026283  3959 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:00.114804 26542 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 32 index: 21. (index mismatch)
I20260709 12:14:00.060652  3886 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:14:00.087119  3481 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 33 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:00.087580  3867 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 32 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:00.101619  3881 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 28.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
W20260709 12:14:00.102058  3723 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.001s
I20260709 12:14:00.116068  3886 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.128647  3886 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:00.128571  3723 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.131172  3723 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:00.087345  3620 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.133781  3620 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:00.103206 26616 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25. Ops: []
I20260709 12:14:00.134542  3981 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:00.053817 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:00.055421  3745 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.135396  3959 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.136345  3782 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:00.136157  3745 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.137665  3959 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:00.137952  3464 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.103425 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:00.107911 26615 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:14:00.088333  3960 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.081957  3778 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:14:00.116806 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 89278.9us
I20260709 12:14:00.117165 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:00.094830 26439 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:00.120191 26619 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:14:00.135136  3867 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 32.21, Last appended by leader: 21, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:00.079308  3869 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:00.114718  3954 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:00.150941 26622 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: []
I20260709 12:14:00.152664 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:00.138542  3464 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.160965  3464 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:00.161959  3214 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.162648  3214 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:00.163340  3970 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:00.138360  3745 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:00.163662  3179 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.165120 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:00.165406  3214 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:00.165822 26544 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:14:00.168151  3853 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.168728  3853 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.174969  3989 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Stepping down as leader of term 28
W20260709 12:14:00.175347 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 80653.4us
I20260709 12:14:00.175923  3959 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:00.175514  3989 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:00.182413 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:00.157732 26514 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:00.183004 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:00.187145 26468 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:14:00.183326 26470 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26. Ops: [25.17-25.17]
I20260709 12:14:00.176424  3959 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:14:00.183982 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 161219us
I20260709 12:14:00.187733 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:00.191121 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:00.190575 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:00.190847 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:00.193022 26621 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
I20260709 12:14:00.190847 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:00.192173 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:00.169966  3886 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:00.206431 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 53826.7us
I20260709 12:14:00.201396 26622 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 29: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:00.198515 26617 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:14:00.203372 26439 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:00.210661 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:00.211763 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:00.212821 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:00.211762 27134 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:00.124966  3863 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.213696 26469 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:14:00.191179  3881 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.216742 27134 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:00.220305 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:00.189105  3179 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:00.200074  3814 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:14:00.200498  3214 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:00.135223  3981 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.196230  3959 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:14:00.233556 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 217487us
I20260709 12:14:00.157853  3960 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:00.175343  3778 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:00.237977 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:00.211174  3880 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:14:00.176970  3869 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.228119  3620 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:14:00.221607  3723 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:00.282842  3692 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:00.283206  3994 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:14:00.283787  3991 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:00.284981  3981 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:00.286861  3864 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 28.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:00.237658  3214 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.287278  3960 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:00.241160  3853 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:00.244447  3881 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.312767 26469 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: [28.15-28.15]
I20260709 12:14:00.302377  3880 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:00.313927  3994 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.199605  3989 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:00.303151  3962 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:00.344017  3778 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:00.345264  3962 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:00.314109  3991 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.333600  3214 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:00.338179  3970 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:14:00.307317 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 95631.9us
W20260709 12:14:00.351398 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 113473us
I20260709 12:14:00.236583  3481 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 31.20, Last appended by leader: 20, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:00.339512  3880 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:14:00.387117 26439 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:14:00.402086 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.391299 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:00.409199 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:00.351446  3994 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:00.411186 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:00.385030  3991 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:00.385367  3723 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:00.420840 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:00.416129 27166 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:14:00.428818 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:00.430091 27167 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 22: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:00.390924  3962 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:00.406502  3975 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:00.417080  3981 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.411846  4002 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:14:00.439059 26439 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:00.390792  3960 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 12:14:00.420287  3202 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:00.431829  3850 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:14:00.426528  3853 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
W20260709 12:14:00.459201 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 176534us
I20260709 12:14:00.439635  3723 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:00.463122  3962 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.445250  3998 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:14:00.462880  3981 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.566035 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:00.509856 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:00.568305 26615 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
W20260709 12:14:00.518677 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.571090 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:00.571878 26544 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:14:00.573580 26540 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:00.527962 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:00.536254 26472 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:14:00.538246 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:00.538329 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:00.528627 26620 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:14:00.537284 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:00.582732 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:00.564668 26513 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:00.589749 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:00.590510 26546 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:14:00.591451 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:00.525038 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:00.558286 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:00.494503  3992 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
W20260709 12:14:00.526240  3996 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:14:00.505178  3975 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:00.496166  3881 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:00.619264 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:00.494967  3863 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:00.599040 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.533766  3866 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:00.610571 26467 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:14:00.612056 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:00.518925  3202 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.526134  3869 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:00.590473  3745 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.601676 26439 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:14:00.630322 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 346304us
I20260709 12:14:00.549984  3853 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.612571  3975 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:00.622804 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 72455us
I20260709 12:14:00.526643  3850 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:00.462061  4002 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.609999 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:00.645229 26540 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:14:00.629164 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:00.518116  3954 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.646493 26464 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:14:00.596068 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:00.648834  3954 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:00.649444 26617 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:14:00.642196  3853 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:00.636596  3202 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:00.641875  3745 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.656920  3202 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:00.657249  3745 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:00.657877  3866 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.660754  3866 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:00.661434 26473 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 36.
I20260709 12:14:00.642067  3963 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:00.664387 26439 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:00.665935  3881 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:00.671555  3881 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.672079  3881 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:00.672112  3962 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:00.609905  3998 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.638597  4013 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:14:00.666016 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:00.674634 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:00.674445  3998 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.676162  4013 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:14:00.677114  3869 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:14:00.677179  3998 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:00.670619  3963 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 32 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:00.679045  3723 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:00.679298  3963 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 31.19, Last appended by leader: 19, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.685333  3867 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:00.667409  3981 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:00.689795  3997 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.384s	user 0.000s	sys 0.002s
I20260709 12:14:00.694734  3971 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:14:00.696484  3971 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 26.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:14:00.698109  4002 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:00.698920 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:00.700562 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:00.703136  3692 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:00.704586  3850 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 29.20, Last appended by leader: 20, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.676304 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:00.707939 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:00.637061 26471 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: []
I20260709 12:14:00.708689 26617 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:14:00.709997 26622 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 22.
I20260709 12:14:00.669606  3880 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.692340  3994 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:00.715420 26466 raft_consensus.cc:1240] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26. Ops: []
I20260709 12:14:00.718997 26514 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:00.720899 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:00.713060 27133 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.802s (SENT) [suppressed 14 similar messages]
I20260709 12:14:00.731679 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:00.733309 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:00.743038 26617 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 33 index: 17. Preceding OpId from leader: term: 34 index: 18. (index mismatch)
I20260709 12:14:00.645728  3975 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:00.717343 26439 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:00.706597  3798 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:14:00.749250 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:00.677340  4013 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:14:00.749709 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:00.747761 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:00.751940 26466 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:00.752506 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:00.753329 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:00.730974  3864 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.023s
I20260709 12:14:00.757390 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:00.717418  3866 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:00.757956 26541 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 27: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:00.761588 26539 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:00.762223 26471 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 28: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:00.731189  3869 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:14:00.770664 26547 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:14:00.743038  3981 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:14:00.762171 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:00.771983 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:00.767176 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:00.769706 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:00.771576 26546 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
I20260709 12:14:00.768280 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:00.777858 26545 raft_consensus.cc:2376] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 31. Re-sending same reply.
I20260709 12:14:00.755007  3179 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:14:00.758363  3976 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:00.754558  3798 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.814886 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:00.748325  3954 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:00.756142  4013 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:00.825029 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:00.822039 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:00.772609  3778 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:00.770841  3869 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:00.841769 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:00.841548 26471 raft_consensus.cc:2368] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 34. Current term is 35.
I20260709 12:14:00.847069 26615 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 35.
I20260709 12:14:00.849324 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:00.772771  3866 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.772025  3711 consensus_queue.cc:1059] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.059s
I20260709 12:14:00.859215 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:00.860396 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:00.860713  3866 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:00.833132  3778 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.826296  3745 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.861724  3778 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:00.862079  3745 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.864351  3863 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:00.864634  3745 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:00.864737  4013 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.832667  3954 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.866111  4013 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:00.856024  3896 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:00.866820  3896 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:00.862634  4018 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:14:00.867255  3896 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:00.867300 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:00.861743 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 32 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:00.823415  3692 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:00.828399  3976 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:00.872400 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 47432.3us
I20260709 12:14:00.873245 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:00.779640  3959 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:00.875031 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:00.875073 26621 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: [29.19-29.19]
I20260709 12:14:00.875442 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:00.912986 26620 raft_consensus.cc:2410] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 33 because replica has last-logged OpId of term: 31 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 30 index: 18.
I20260709 12:14:00.876322 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:00.876360 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:00.877058 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:00.877367 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:00.914849 26464 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
W20260709 12:14:00.860714 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.878566 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:00.831120  3798 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:14:00.842440  3904 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.730s	user 0.013s	sys 0.000s
I20260709 12:14:00.874022 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:00.883755 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:00.916780 26471 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 29: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:00.869086  3863 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:00.887835 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:00.889544 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:00.890509 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:00.852078  3869 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:00.898988  3976 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:00.855088  4012 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:00.967751 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:00.968657 26548 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
W20260709 12:14:00.901490  4014 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:14:00.903883  3464 raft_consensus.cc:3055] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:14:00.905588 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:00.906597  3692 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:00.908167  3880 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:00.885139  3954 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:00.918205 26543 raft_consensus.cc:2376] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 29. Re-sending same reply.
I20260709 12:14:00.823796  3974 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 28.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.047s
I20260709 12:14:00.921564 26546 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:14:00.918982 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 69810.9us
I20260709 12:14:00.927090  3904 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:14:00.926756 27165 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:14:00.931770  3863 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:00.919405  3866 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:14:00.938329  3778 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:00.986024  3464 raft_consensus.cc:740] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:01.019392 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:00.948314 26513 leader_election.cc:400] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 34. Current term is 35.
I20260709 12:14:00.951289  3994 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:00.956243 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:01.020252 26513 leader_election.cc:403] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:00.958326 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:00.966003 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:01.021099 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 72971.6us
I20260709 12:14:01.021251 26544 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 35
I20260709 12:14:00.919231  4005 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:14:00.969990 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:00.928484 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:01.022660 26548 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 26: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:00.989164 26465 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
W20260709 12:14:01.023517 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:00.927397  3970 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.537s	user 0.008s	sys 0.005s
I20260709 12:14:01.024749  3970 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:01.025727 26615 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:14:00.967814  4012 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 32 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:00.918821  3179 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 29 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:01.014169 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:01.008673  3214 consensus_meta.cc:287] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.601s	user 0.013s	sys 0.000s
I20260709 12:14:01.012167 26621 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
I20260709 12:14:01.027164 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:01.028445 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:01.093710 26473 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 31: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:01.028935 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:00.995224  3745 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:01.091645 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:01.094841 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:01.118673 26471 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 30: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:01.028362  4005 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:14:01.093709 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 80303us
I20260709 12:14:01.098574  3179 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.18, Last appended by leader: 18, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.101003  3866 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 35 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:00.989542  3853 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.103281  4004 consensus_queue.cc:1059] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.115s
I20260709 12:14:01.103631 26540 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:14:01.103960  4003 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.104678  4015 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.134s
I20260709 12:14:01.107131 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:01.091794  3880 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.110419  4031 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:14:01.111829 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:01.113986  3981 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:01.096688 26467 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:14:01.125411 26622 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 30: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:01.124805 26544 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 35.
I20260709 12:14:00.971429  3991 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.102550  4026 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 29.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.113s
I20260709 12:14:01.232990 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:01.234149 26544 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 32: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:01.242427  3981 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.244989 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:01.245595 26472 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:14:01.248469 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 231669us
I20260709 12:14:01.251504 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:01.159276 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:01.123497  4014 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:14:01.163378 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:01.172518  3963 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.184345 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:01.273168 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:01.274369 26543 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 31: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:01.275533 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:01.125056  3214 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.123560  3904 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.126614  3723 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.079s
I20260709 12:14:01.208191  3778 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:01.209242  3464 consensus_queue.cc:260] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.219767 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:01.128087  3745 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.227257  3838 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:14:01.292886 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 139291us
I20260709 12:14:01.268718  3974 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:14:01.256345 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:01.229674  3954 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election lost for term 34. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 34. Current term is 35.
I20260709 12:14:01.259727 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:01.282274 26548 raft_consensus.cc:2368] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33.
I20260709 12:14:01.282102 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:01.284663 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:01.296262  3853 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:01.153095 26546 raft_consensus.cc:2410] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 32 because replica has last-logged OpId of term: 31 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 29 index: 20.
I20260709 12:14:01.304699  3841 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:14:01.258213  3695 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.226421  4003 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.309849  3991 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:01.310482  4032 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:14:01.314595  3464 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:01.370746 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:01.371721 26619 raft_consensus.cc:2368] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 28. Current term is 29.
I20260709 12:14:01.315527  4005 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 29.19, Last appended by leader: 19, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.373291  4005 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:01.375049 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:01.375592 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:01.376518 27165 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 27: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:01.376614 26468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb"
dest_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:43606
I20260709 12:14:01.377447 26468 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:01.377488 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:01.378075 26468 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:01.288214  3904 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.416327  3904 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:01.329725 26513 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:01.330772 26544 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:14:01.242617  3880 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.424362 26539 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
I20260709 12:14:01.308190  4027 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:14:01.433216 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:14:01.433537 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 103910us
I20260709 12:14:01.158411  4002 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.338605 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:14:01.348763  3975 consensus_meta.cc:287] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.590s	user 0.010s	sys 0.000s
W20260709 12:14:01.351742 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 69742.2us
I20260709 12:14:01.438544 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:01.439615 27159 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 32: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:01.438565 27166 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 27: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:01.441092 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:01.445825  3464 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:14:01.446452 26539 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 30. Current term is 31. Ops: []
W20260709 12:14:01.447276  4022 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.419s	user 0.002s	sys 0.010s
I20260709 12:14:01.448323 26539 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: []
I20260709 12:14:01.450114 26539 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:14:01.458762 26470 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 27: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:01.301704  3896 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.350466  4001 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:14:01.239486  4012 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 30.19, Last appended by leader: 19, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.357399  4003 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:01.329222  3838 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.360208  3988 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.361892  3778 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:01.326922  3974 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.285929  3963 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.365170  3814 raft_consensus.cc:3055] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Stepping down as leader of term 27
W20260709 12:14:01.367074  3881 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.694s	user 0.008s	sys 0.006s
I20260709 12:14:01.317119  3692 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:01.378551 27163 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 31: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:01.288453  4026 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 31.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.090s
I20260709 12:14:01.379139 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:01.379709  3998 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:14:01.380205  3981 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:01.329183  3962 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.292559  3866 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 33.16, Last appended by leader: 16, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.539781  3850 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.540400  3850 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:01.384477 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.338291  3695 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.385864  4033 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:01.547241  4033 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.548502  3695 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:01.549211  3695 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:01.549852  4033 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:01.387003  3867 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.005s
I20260709 12:14:01.340378  3745 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:01.551005  3745 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:01.551680  3838 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:01.551563  3745 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.389032  3989 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:01.558537  3907 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.533980  3998 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:01.559271  3907 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.291532  3214 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:01.560022  3998 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 29.20, Last appended by leader: 20, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.394191  3976 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.561157  3998 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:01.562305 26466 raft_consensus.cc:2410] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 33 because replica has last-logged OpId of term: 32 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 31 index: 20.
I20260709 12:14:01.392306 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:01.562768  3976 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:01.394655  3886 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:01.507376  3974 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:01.400324 26439 leader_election.cc:400] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 28. Current term is 29.
I20260709 12:14:01.563927 26439 leader_election.cc:403] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Cancelling election due to peer responding with higher term
I20260709 12:14:01.396044  3202 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:14:01.400467  3869 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.564435  3202 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 31 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:01.401515  3798 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.565871 26467 raft_consensus.cc:2410] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 29 because replica has last-logged OpId of term: 28 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 20.
I20260709 12:14:01.403733 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:01.413786 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:01.407070 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:01.566674 26545 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:14:01.406292  3959 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:01.434633 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:01.567193 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:01.427186 26472 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:14:01.436671 27168 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 31 index: 20. Preceding OpId from leader: term: 33 index: 21. (index mismatch)
I20260709 12:14:01.460812 26465 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: []
I20260709 12:14:01.435695 26473 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 31
I20260709 12:14:01.462177  3880 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:01.468595 27133 leader_election.cc:336] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.549s (SENT)
W20260709 12:14:01.466621 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.569244 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:01.469673 26468 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:01.570295 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 101770us
I20260709 12:14:01.496090 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:01.511149  3814 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:01.571472 26468 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:01.444445  3975 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.528038 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:01.572760 26621 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 27: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:01.572371  3814 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.572871 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:01.528816 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:01.532845 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:01.573853  4042 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election won for term 37
I20260709 12:14:01.510649  3988 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.393523 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:01.569269 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:01.563771 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:01.565398  3202 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 31.20, Last appended by leader: 20, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.427179 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:01.567865 26548 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:01.425572 26471 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:14:01.501039  3971 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:01.507102  3778 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:01.574359 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:01.446346  3464 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.576821 26615 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 24. Current term is 25. Ops: []
I20260709 12:14:01.530959  3881 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.579408  4002 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:01.514132  3711 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:01.568171 26540 raft_consensus.cc:2368] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23.
I20260709 12:14:01.502782  4001 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:14:01.596012 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 195903us
I20260709 12:14:01.626072 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:01.601987 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 167488us
W20260709 12:14:01.602324 27133 leader_election.cc:336] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.732s (SENT)
I20260709 12:14:01.627581 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:01.602937 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 106994us
I20260709 12:14:01.549741  3695 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.554076  3745 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:01.607236 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 180120us
I20260709 12:14:01.611477 26468 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
W20260709 12:14:01.614331 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 220913us
I20260709 12:14:01.573925  3975 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:01.579474  4039 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:14:01.628548 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:01.643771 27133 leader_election.cc:336] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.765s (SENT)
I20260709 12:14:01.644265 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:01.629980 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:01.577345  3962 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.650985 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:01.595916  3981 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.609905  3814 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:01.618371  3959 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:01.696913  3907 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:01.605878  4013 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:01.597114  4042 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:01.610508  3960 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:01.777561 27165 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 32 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:01.649542 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:01.615057  3994 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:01.650822 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:01.655700  4034 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:01.656096  3963 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:01.656589  3869 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:01.656985  3695 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:01.657060  4035 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:01.658785  3988 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:01.659049  3896 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:01.638199  3880 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:01.617838  3971 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.618006  3464 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:01.615995  3778 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:01.666724 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:01.792001 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 125354us
I20260709 12:14:01.793411 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:01.639000 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:01.794981 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 156071us
I20260709 12:14:01.795745 26514 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:01.796866 26514 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:01.798592  3989 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:01.667763 26473 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 31.
I20260709 12:14:01.622376  3202 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:01.670415  4041 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:14:01.672931 26543 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:14:01.673099  4016 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:01.638163  3711 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.815661 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:01.816372  3711 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:01.675616 26545 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 29 index: 20. Preceding OpId from leader: term: 30 index: 20. (term mismatch)
I20260709 12:14:01.818296 26545 pending_rounds.cc:85] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 19
I20260709 12:14:01.818689 26545 pending_rounds.cc:107] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 29.20
I20260709 12:14:01.676838  3881 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:01.818998 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 4768) took 1062 ms. Trace:
I20260709 12:14:01.570235  3922 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.819469 26466 rpcz_store.cc:276] 0709 12:14:00.756725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.766606 (+  9881us) service_pool.cc:224] Handling call
0709 12:14:01.818736 (+1052130us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54001c0554. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:01.818920 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696866560}
I20260709 12:14:01.820333  3922 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:01.669533  3723 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:01.822806  3723 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.678467  3981 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.828647  3981 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:01.680034  3886 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:01.658785  3798 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:01.663566 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:01.812232  3963 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:14:01.652524  3214 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.031s
I20260709 12:14:01.831096  3711 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:01.831610  3711 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.832017  3711 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:01.684242  4001 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 29.15, Last appended by leader: 15, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.832326  3998 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:01.819070 26545 raft_consensus.cc:2889] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:01.822829 26468 raft_consensus.cc:1240] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26. Ops: [25.17-25.17]
I20260709 12:14:01.686797  3962 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:01.662647  4003 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:01.641952  4036 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.840323  4036 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.662654  3850 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:01.699982 26472 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: []
I20260709 12:14:01.836894  4003 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.842999 27168 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:01.843283  4003 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:01.655205 26544 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 18. Preceding OpId from leader: term: 34 index: 19. (index mismatch)
I20260709 12:14:01.640220 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:01.765408  3970 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:14:01.845022  3970 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:01.765851 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3711) took 1536 ms. Trace:
I20260709 12:14:01.826038  3723 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:01.768883  3974 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.848693  3962 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:01.852952  3974 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:01.721290  3907 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:01.854212  3907 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.855881  3971 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:01.811710  4005 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:01.856745  3907 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:01.647308 26588 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:01.857273 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 1556) took 1102 ms. Trace:
I20260709 12:14:01.857697 26546 rpcz_store.cc:276] 0709 12:14:00.754590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.861456 (+106866us) service_pool.cc:224] Handling call
0709 12:14:01.857024 (+995568us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x7b540018b5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:01.857206 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116203264}
W20260709 12:14:01.858112 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 210918us
W20260709 12:14:01.781451 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 131951us
I20260709 12:14:01.812654  3954 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:01.786360  4034 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.865142  3850 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election won for term 37
I20260709 12:14:01.787751 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 3714) took 1256 ms. Trace:
I20260709 12:14:01.866783 26470 rpcz_store.cc:276] 0709 12:14:00.527506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.527647 (+   141us) service_pool.cc:224] Handling call
0709 12:14:01.783646 (+1255999us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b54000dcad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:01.783819 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2026965248}
W20260709 12:14:01.867723  4048 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.088s	user 0.003s	sys 0.000s
I20260709 12:14:01.800768 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:01.869163  4034 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:01.809497 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:01.870113 26542 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:14:01.870705 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 3623) took 1329 ms. Trace:
I20260709 12:14:01.783264  3994 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:01.871325 27133 leader_election.cc:336] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.909s (SENT)
I20260709 12:14:01.871559  3994 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:01.872316  3850 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:01.872830  3850 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:01.778174  4042 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:01.784657  4015 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:01.875227 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:01.869659 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 68984us
I20260709 12:14:01.630602  3976 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.897353  3976 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.898298 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:01.899140 26617 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 31: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:01.899788  3976 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:01.900422  3976 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:01.901154 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:01.846887 26469 rpcz_store.cc:276] 0709 12:14:00.229384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.235622 (+  6238us) service_pool.cc:224] Handling call
0709 12:14:00.235964 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:00.338067 (+102103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.765562 (+1427495us) spinlock_profiling.cc:243] Waited 76.5 ms on lock 0x7b54002db754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:01.765786 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175956864}
I20260709 12:14:01.835162 26473 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27. Ops: []
I20260709 12:14:01.902760 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4781) took 1027 ms. Trace:
I20260709 12:14:01.714208 26548 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
W20260709 12:14:01.848071 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 207916us
I20260709 12:14:01.903115 26473 rpcz_store.cc:276] 0709 12:14:00.875666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.810244 (+934578us) service_pool.cc:224] Handling call
0709 12:14:01.810599 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.901924 (+ 91325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.902527 (+   603us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b54002dbc54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:01.902701 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56045312}
I20260709 12:14:01.905184 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:01.869372 26470 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: []
W20260709 12:14:01.830410 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 166908us
I20260709 12:14:01.907198 26473 raft_consensus.cc:2410] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 30 because replica has last-logged OpId of term: 28 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 20.
I20260709 12:14:01.907261 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:01.908530 26473 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:14:01.908641 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:01.909912 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:01.839049 26466 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: [27.14-27.14]
I20260709 12:14:01.876235  3963 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:01.914124 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:01.914557 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:01.915321 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:01.883709 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:01.916427 26615 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 27: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:01.871002 26542 rpcz_store.cc:276] 0709 12:14:00.541701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.541883 (+   182us) service_pool.cc:224] Handling call
0709 12:14:01.809380 (+1267497us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5eee 000000000036eb39 00007f507b0291e0 00007f507b0f20c4 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:14:01.870614 (+ 61234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10112512}
I20260709 12:14:01.846019  3970 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.915401 27163 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
W20260709 12:14:01.930280 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.928102 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:01.931334 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.926160  4041 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:14:01.932803  3970 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:01.933132 26616 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: [29.20-29.20]
I20260709 12:14:01.926450  3866 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.933938  3866 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.885948  3994 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.936431  3866 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:01.937888  3994 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:01.898993  4036 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:01.932067  3850 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.786597  4039 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:01.939213  4033 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:14:01.939708  4033 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:01.939752  4039 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.940956  4033 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 31.18, Last appended by leader: 18, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.798336 26514 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:01.833113  4001 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:14:01.882061 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.950299 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:01.950801 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:01.951020  3723 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.951261  4041 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 31 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:01.932216  4026 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:01.951684  3723 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.952338  4041 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 29.20, Last appended by leader: 20, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.922124  3880 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:01.954556  3971 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:01.955014  3971 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.954977  3880 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.955538  3971 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:01.957432  3880 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:01.952330  4026 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.954571  4007 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:01.958750  4026 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:01.959141  4007 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:01.961509  4007 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:01.962082  4007 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.922607  4045 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:14:01.951092 26544 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 32.
I20260709 12:14:01.963068 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:01.964777  4034 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 12:14:01.965845 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 167574us
I20260709 12:14:01.967443 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:01.967933 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:01.968261 27165 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:01.900913  3976 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:01.969642 26514 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:01.969949 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.970574 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3727) took 1060 ms. Trace:
W20260709 12:14:01.972091 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44121.1us
I20260709 12:14:01.976935 26466 rpcz_store.cc:276] 0709 12:14:00.910287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.820574 (+910287us) service_pool.cc:224] Handling call
0709 12:14:01.820908 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:01.910604 (+ 89696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.929991 (+ 19387us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b54001a8454. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:01.970504 (+ 40513us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32046976}
I20260709 12:14:01.974166  4034 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:14:01.975148  3631 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:01.896605 27168 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:01.975718 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:01.983037 26514 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:01.977327 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:01.987531 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:01.988349 26542 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:14:01.993032 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:01.993095 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:01.994040 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:01.995735 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:02.000885  3214 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:14:01.954190  3723 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:02.006747 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:01.923338  3974 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:14:02.007480 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:02.008627 26466 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 27: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:02.010353 26468 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 28: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:02.017012  3886 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:02.017612  3886 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:02.018008 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:02.018479 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.018793 26468 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:02.019853 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:02.020660 26468 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 27: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:02.021509 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:02.006959 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:02.017104 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:02.023129  3631 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:02.018049  3886 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:02.026005 27134 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:02.029433  3631 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:02.030874 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:02.027361 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:02.031894 26539 raft_consensus.cc:2393] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:02.033735 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:02.034997 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:02.035650 26470 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:14:02.036674  3976 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:02.037130 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:02.038722 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:02.039520 26466 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 32: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:02.040174 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:02.041414  3711 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:02.041325  3464 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:02.044142 26620 raft_consensus.cc:2368] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 27. Current term is 28.
I20260709 12:14:02.045244  4005 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:02.045895  3464 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:02.047374  3989 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:02.064687  3814 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 30.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:14:02.065100 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:02.065760 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:02.067101 26545 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 24. Current term is 25. Ops: []
I20260709 12:14:02.070721  3954 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:14:02.072117  3954 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:14:02.073251  4035 raft_consensus.cc:3055] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:14:02.073721  4035 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:02.077729  3631 consensus_queue.cc:1059] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 24.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:14:02.078475  3745 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.079142  3745 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:02.079463  3631 raft_consensus.cc:3055] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:14:02.080049  3631 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:02.081221  3886 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:02.047564  3711 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:02.047837  4033 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:02.047986  3850 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:01.986941  3998 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:14:02.052141 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:02.131099 26542 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:02.134521 26539 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: []
I20260709 12:14:02.050940 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:02.061803 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48604.5us
I20260709 12:14:02.062474 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:02.136482 26546 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:02.081717  3631 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:02.052858 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:02.082544 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 73316.2us
I20260709 12:14:02.004552  3853 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:14:02.073287  3954 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:14:02.083896  4042 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:02.067451  3814 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:14:02.150468 26514 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:02.087345 27161 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 32. Current term is 33. Ops: []
I20260709 12:14:02.095296  3989 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.098726 26470 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:14:02.006289  3960 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election lost for term 28. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 28. Current term is 29.
W20260709 12:14:02.110831 26585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.050s	sys 0.061s
W20260709 12:14:02.116098 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:02.157814 26585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.050s	sys 0.061s
I20260709 12:14:02.010870  3994 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:14:02.057116  3981 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.056772  4034 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:14:01.974181  4007 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:02.155185 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:02.041819 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:02.172060 27163 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:14:02.165303 26438 leader_election.cc:400] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33.
I20260709 12:14:02.173894 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:02.167606 27165 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 20. Preceding OpId from leader: term: 29 index: 21. (index mismatch)
I20260709 12:14:02.175799 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:02.176760 26470 raft_consensus.cc:2368] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33.
I20260709 12:14:02.146674  3976 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.179828 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:02.182020 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:02.187963 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:02.188726 27163 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:14:02.188534 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:02.189486 26622 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:14:02.190797 26546 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:14:02.151803  3954 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:02.157271  3814 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:02.200095 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:02.210438 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:02.219370 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:02.219728 26546 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 29 index: 20. Preceding OpId from leader: term: 31 index: 21. (index mismatch)
I20260709 12:14:02.220114 26545 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 28
I20260709 12:14:02.151762  3778 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:02.180958  4016 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:02.178292  3998 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 12:14:02.226303 26438 leader_election.cc:400] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23.
I20260709 12:14:02.234189 26438 leader_election.cc:403] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:14:02.210093 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:02.180136  4036 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 12:14:02.232402 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:02.236692 26470 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:02.176637  3994 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:02.199263  3886 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:02.250178 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:02.251094 26619 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:02.232577 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:02.169791  3989 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:02.244678 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:02.244968 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:02.246009 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:02.203598  3881 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:14:02.209925  3631 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:02.275703 26548 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 31 index: 20. Preceding OpId from leader: term: 32 index: 20. (term mismatch)
I20260709 12:14:02.276335 26548 pending_rounds.cc:85] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 19
I20260709 12:14:02.276618 26548 pending_rounds.cc:107] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 31.20
I20260709 12:14:02.276949 26548 raft_consensus.cc:2889] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:02.261498 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:02.278543 26466 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:02.261771 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:02.174589  3981 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:02.265733 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:02.222118  4005 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.271697 26617 raft_consensus.cc:2368] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33.
I20260709 12:14:02.286096 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:02.287357 26621 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 32: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:14:02.288492 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.182762  3853 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.051s
I20260709 12:14:02.195358  3970 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 28.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 12:14:02.197147  3976 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:02.294358 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:02.231777  3907 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election won for term 30
W20260709 12:14:02.296940 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.301234 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:02.292255 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:02.245395  3922 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.300643 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:02.345301 27167 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:02.345888 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:02.348915 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:02.347141 26468 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:14:02.349846 26548 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 34.
I20260709 12:14:02.350997 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:02.351789 26548 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:02.353312 26542 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:14:02.347187 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:02.271082  3974 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:02.354770 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:02.356240 26621 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 27: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:02.356698 26546 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:02.306594  3881 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.371201  3881 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:02.372715 26622 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:14:02.355448  3922 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:02.407181 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:02.407435 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:02.408011 27159 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:02.408612 26621 raft_consensus.cc:2410] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 29 because replica has last-logged OpId of term: 27 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 13.
I20260709 12:14:02.409376 26617 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:02.451107 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:02.454777 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.462472 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:02.345715  4015 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:02.376614  4003 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.001s
I20260709 12:14:02.470536 26470 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:02.472114 26615 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:14:02.473425 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:02.501449 26542 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:14:02.345212  3907 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:02.494241 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:02.303661  4005 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:02.357976  3745 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:02.513864 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:02.515795 26621 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:14:02.498765 26613 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 36. Current term is 37. Ops: []
I20260709 12:14:02.365849  3974 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:02.375012  3880 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23.
I20260709 12:14:02.546068 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:02.533280 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:02.533774 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:02.554586 27159 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 37.
I20260709 12:14:02.540337 26548 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:02.542536 26621 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 28. Current term is 29. Ops: []
I20260709 12:14:02.543352 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:02.566962 26615 raft_consensus.cc:2410] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 27 because replica has last-logged OpId of term: 25 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 16.
I20260709 12:14:02.544243 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:02.567849 26470 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
W20260709 12:14:02.534189 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 309945us
I20260709 12:14:02.509070  4003 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:02.554653 26439 leader_election.cc:400] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33.
I20260709 12:14:02.490023 26546 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:02.573354 26439 leader_election.cc:403] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Cancelling election due to peer responding with higher term
I20260709 12:14:02.514134  3907 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:02.571596 26513 leader_election.cc:400] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33.
I20260709 12:14:02.570964 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1432) took 1561 ms. Trace:
I20260709 12:14:02.612521 26513 leader_election.cc:403] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:02.574887 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:02.614231 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:02.614596 26548 raft_consensus.cc:2368] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33.
I20260709 12:14:02.347582  3814 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 30.17, Last appended by leader: 17, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:02.618955 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:02.625646 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:02.626560 26548 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 32: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:02.547927  3974 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:02.623848 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:02.635000 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:02.642944 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:02.644809 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:02.645922 26548 raft_consensus.cc:2393] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 27: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:02.629664 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:02.612672 26471 rpcz_store.cc:276] 0709 12:14:01.009092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.840136 (+831044us) service_pool.cc:224] Handling call
0709 12:14:01.840501 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.840711 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 20
0709 12:14:02.203709 (+362998us) log.cc:844] Serialized 14 byte log entry
0709 12:14:02.561838 (+358129us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:02.561893 (+    55us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:14:02.561949 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:02.562022 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:02.562205 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7047,"prepare.queue_time_us":569099,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"thread_start_us":694840,"threads_started":2}
W20260709 12:14:02.654577 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 83158.2us
I20260709 12:14:02.655169 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: true dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:02.656041 26548 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:02.657539 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:02.657917 26618 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: []
I20260709 12:14:02.663345 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:02.665994 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 4768) took 1112 ms. Trace:
I20260709 12:14:02.464061  3954 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:02.666536 26620 rpcz_store.cc:276] 0709 12:14:01.524243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.532587 (+  8344us) service_pool.cc:224] Handling call
0709 12:14:02.635947 (+1103360us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b5400032354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:02.636103 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1080092928}
I20260709 12:14:02.680907 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:02.680979 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:02.691386 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:02.691694 26471 raft_consensus.cc:2410] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 35 because replica has last-logged OpId of term: 33 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 31 index: 18.
I20260709 12:14:02.692221 26546 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:14:02.695911  3989 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:02.696007 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:02.696372 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:02.696059  3922 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:02.698941  3922 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.699501  3922 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:02.700227  4013 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
W20260709 12:14:02.701901 26465 consensus_meta.cc:287] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.526s	user 0.012s	sys 0.003s
I20260709 12:14:02.702801 27159 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 36. Current term is 37. Ops: []
I20260709 12:14:02.702359 26465 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:14:02.708899 26546 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:14:02.702787 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:02.706665 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:02.709146 26548 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:14:02.712913 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:02.715998 26548 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 33 index: 16. Preceding OpId from leader: term: 35 index: 17. (index mismatch)
I20260709 12:14:02.721566 26548 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:14:02.535785  3994 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:02.665325  4042 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:02.303248  4026 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:02.677366  3202 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:14:02.674046  3998 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election lost for term 32. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33.
I20260709 12:14:02.508785  4015 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:02.729815 27134 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:02.696694  3954 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:02.729635 26588 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:02.753455 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:14:02.754841 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 184062us
I20260709 12:14:02.760681 26546 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33. Ops: []
I20260709 12:14:02.682098  4007 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:02.734803  4004 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.966s	user 0.014s	sys 0.018s
I20260709 12:14:02.701934  3922 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:02.894085 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 164549us
W20260709 12:14:02.885527 26467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.034s	sys 0.023s
I20260709 12:14:02.905027 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:02.905395 26467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.034s	sys 0.024s
I20260709 12:14:02.906668 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4785) took 2029 ms. Trace:
I20260709 12:14:02.936946 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:02.690856  3880 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.080s
I20260709 12:14:02.907178 26467 rpcz_store.cc:276] 0709 12:14:00.877004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.803508 (+926504us) service_pool.cc:224] Handling call
0709 12:14:01.804076 (+   568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.804368 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 23
0709 12:14:02.271431 (+467063us) log.cc:844] Serialized 14 byte log entry
0709 12:14:02.906147 (+634716us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:02.906224 (+    77us) raft_consensus.cc:1645] Marking committed up to 23
0709 12:14:02.906295 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:02.906410 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:02.906582 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":536377,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":68,"thread_start_us":1044232,"threads_started":2}
I20260709 12:14:02.904735 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:14:02.892943  3853 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.003s	sys 0.011s
I20260709 12:14:02.729985  3778 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:02.976258 26614 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 33: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:02.678908  4034 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.083s
I20260709 12:14:02.992276 26471 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 32 index: 21. Preceding OpId from leader: term: 33 index: 21. (term mismatch)
I20260709 12:14:02.992808 26471 pending_rounds.cc:85] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 20
I20260709 12:14:02.993079 26471 pending_rounds.cc:107] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 32.21
I20260709 12:14:02.993333 26471 raft_consensus.cc:2889] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:02.994184 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4791) took 1068 ms. Trace:
I20260709 12:14:02.730981  4069 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election lost for term 32. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33.
I20260709 12:14:02.994609 26471 rpcz_store.cc:276] 0709 12:14:01.925620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.889468 (+963848us) service_pool.cc:224] Handling call
0709 12:14:02.983064 (+ 93596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:02.993860 (+ 10796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:02.994116 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:02.997071 26467 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: []
W20260709 12:14:02.902613  4004 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.139s	user 0.014s	sys 0.020s
I20260709 12:14:02.984222 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:02.985496  3853 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.003s	sys 0.011s
I20260709 12:14:02.899399  3850 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:14:03.005738 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 101103us
I20260709 12:14:02.897107  3838 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:14:02.976642  3998 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.072522  3976 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:03.073771  4063 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.362s	user 0.001s	sys 0.000s
I20260709 12:14:03.004242  3881 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:03.074146  4072 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.024s
W20260709 12:14:03.076025 27163 consensus_meta.cc:287] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.873s	user 0.030s	sys 0.006s
W20260709 12:14:03.080758 27167 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.730s	user 0.010s	sys 0.003s
I20260709 12:14:02.896858  4042 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:03.091478 26617 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.001s
I20260709 12:14:02.970139  3723 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:03.094367 26588 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:03.067289 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4792) took 1141 ms. Trace:
I20260709 12:14:03.094748  3922 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election won for term 30
W20260709 12:14:03.095866 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 541352us
W20260709 12:14:03.099259 26540 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.038s	sys 0.069s
I20260709 12:14:03.096058  3981 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:03.099123  3778 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:14:03.104933 27163 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 23.
I20260709 12:14:03.105162 27167 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
W20260709 12:14:03.111155 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 433687us
I20260709 12:14:03.122407 26467 rpcz_store.cc:276] 0709 12:14:01.925900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.996352 (+1070452us) service_pool.cc:224] Handling call
0709 12:14:02.996802 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:03.066864 (+ 70062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.067199 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:03.124591 26439 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:03.164279 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:03.165282 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:03.116138 26617 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:14:03.168943 26467 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 31 index: 16. Preceding OpId from leader: term: 34 index: 18. (index mismatch)
W20260709 12:14:03.146513 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 52206.9us
W20260709 12:14:03.151965 26619 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.889s	user 0.014s	sys 0.007s
I20260709 12:14:03.169600 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4794) took 1228 ms. Trace:
I20260709 12:14:03.169834 26619 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
I20260709 12:14:03.169953 26467 rpcz_store.cc:276] 0709 12:14:01.941409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.168237 (+1226828us) service_pool.cc:224] Handling call
0709 12:14:03.168596 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:03.169296 (+   700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.169536 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:03.101938 26466 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.823s	user 0.013s	sys 0.004s
I20260709 12:14:03.170792 26466 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:14:03.171345 26467 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 31. Current term is 32. Ops: [31.20-31.20]
I20260709 12:14:03.172128 26466 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 29 index: 20. Preceding OpId from leader: term: 31 index: 21. (index mismatch)
W20260709 12:14:03.172334 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:03.172760 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3743) took 1208 ms. Trace:
W20260709 12:14:03.173130 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:03.173105 26466 rpcz_store.cc:276] 0709 12:14:01.963916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.171524 (+1207608us) service_pool.cc:224] Handling call
0709 12:14:03.171794 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:03.172509 (+   715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.172707 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:03.174208 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:03.178347 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1442) took 1153 ms. Trace:
I20260709 12:14:03.179358 26466 rpcz_store.cc:276] 0709 12:14:02.024522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.173982 (+1149460us) service_pool.cc:224] Handling call
0709 12:14:03.174283 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:03.178111 (+  3828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:03.178130 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:03.178160 (+    30us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:14:03.178180 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.178218 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:03.178299 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:03.182578 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4796) took 1238 ms. Trace:
I20260709 12:14:03.183094 26467 rpcz_store.cc:276] 0709 12:14:01.944260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.170782 (+1226522us) service_pool.cc:224] Handling call
0709 12:14:03.171115 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:03.182243 (+ 11128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.182511 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:03.138708 26540 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.038s	sys 0.069s
W20260709 12:14:03.183290 26545 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.951s	user 0.015s	sys 0.008s
I20260709 12:14:03.169355 26439 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:14:03.142678 26622 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.033s	sys 0.048s
W20260709 12:14:03.223397 26622 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.034s	sys 0.049s
I20260709 12:14:03.208341 26471 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 28 index: 21. Preceding OpId from leader: term: 29 index: 21. (term mismatch)
I20260709 12:14:03.209268 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:03.181044  4003 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:03.110545  3202 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:03.213797 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 276918us
I20260709 12:14:03.102968  4082 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.135357  3850 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.138119  4042 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:03.189496  3960 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.011s	sys 0.012s
I20260709 12:14:03.179118  3976 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:03.222035 26467 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 30 index: 19. Preceding OpId from leader: term: 32 index: 20. (index mismatch)
I20260709 12:14:03.143220  4076 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:03.188889  4005 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:03.223521 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 54246.2us
I20260709 12:14:03.138952  3922 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.139382  3464 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.095s
I20260709 12:14:03.178998  3981 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 36.23, Next index: 24, Last known committed idx: 23, Time since last communication: 0.044s
W20260709 12:14:03.217146  3970 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.006s	sys 0.008s
I20260709 12:14:03.269411 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:03.224505 26471 pending_rounds.cc:85] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 20
I20260709 12:14:03.269858 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:03.292014 26471 pending_rounds.cc:107] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 28.21
I20260709 12:14:03.224138 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:03.252722 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3649) took 1287 ms. Trace:
I20260709 12:14:03.285401 26466 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 33 index: 19. Preceding OpId from leader: term: 34 index: 19. (term mismatch)
I20260709 12:14:03.272230  3922 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:03.224470 26545 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:14:03.173657  3998 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:03.264315  4081 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:03.263474  3976 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.312229 26471 raft_consensus.cc:2889] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:03.313150 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 129882us
I20260709 12:14:03.220865  4071 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader election won for term 37
I20260709 12:14:03.346118 26514 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:03.326894 26541 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
W20260709 12:14:03.336112 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 66317.4us
W20260709 12:14:03.318665  4073 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:14:03.298605  4015 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:03.319460  3981 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election won for term 33
W20260709 12:14:03.310771  4062 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.420s	user 0.001s	sys 0.001s
I20260709 12:14:03.315219  4090 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:03.319576 26466 pending_rounds.cc:85] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 18
I20260709 12:14:03.352329 26466 pending_rounds.cc:107] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 33.19
I20260709 12:14:03.352447 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4793) took 1426 ms. Trace:
I20260709 12:14:03.352648 26466 raft_consensus.cc:2889] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:03.296598  4065 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.240s	user 0.000s	sys 0.000s
I20260709 12:14:03.352865 26471 rpcz_store.cc:276] 0709 12:14:01.941006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.167158 (+1226152us) service_pool.cc:224] Handling call
0709 12:14:03.207888 (+ 40730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:03.352121 (+144233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.352368 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:03.353471 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3746) took 1157 ms. Trace:
W20260709 12:14:03.296130  4059 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:14:03.327394 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 3656) took 1108 ms. Trace:
I20260709 12:14:03.355337 26545 rpcz_store.cc:276] 0709 12:14:02.218924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.219075 (+   151us) service_pool.cc:224] Handling call
0709 12:14:03.327316 (+1108241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35968}
I20260709 12:14:03.338063  4083 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:03.356806  3881 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:03.321697 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4775) took 1149 ms. Trace:
W20260709 12:14:03.340384 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:03.312688 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 3735) took 1806 ms. Trace:
I20260709 12:14:03.353829 26466 rpcz_store.cc:276] 0709 12:14:02.196244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.229812 (+1033568us) service_pool.cc:224] Handling call
0709 12:14:03.284839 (+ 55027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:03.353216 (+ 68377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.353416 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:03.319450 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 49962.5us
I20260709 12:14:03.362425 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:03.321064  4070 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:14:03.322127  4026 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:03.354489  4039 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:03.325265  4016 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:14:03.359484 26465 rpcz_store.cc:276] 0709 12:14:01.506081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.641502 (+135421us) service_pool.cc:224] Handling call
0709 12:14:03.312485 (+1670983us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b54001fead4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:03.312619 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1203280256}
I20260709 12:14:03.313596 26544 rpcz_store.cc:276] 0709 12:14:01.965324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.978680 (+ 13356us) service_pool.cc:224] Handling call
0709 12:14:02.014681 (+ 36001us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:02.069066 (+ 54385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:02.069111 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:02.069773 (+   662us) log.cc:844] Serialized 52 byte log entry
0709 12:14:02.258319 (+188546us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:14:02.895778 (+637459us) log.cc:844] Serialized 14 byte log entry
0709 12:14:03.127599 (+231821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.127689 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:03.252436 (+124747us) raft_consensus.cc:1685] finished
0709 12:14:03.252459 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:03.252642 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84082,"prepare.queue_time_us":406275,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":90433,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":20389,"thread_start_us":724333,"threads_started":3,"wal-append.queue_time_us":560987}
I20260709 12:14:03.324560  4035 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:03.365525  4090 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:03.366092  4035 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:14:03.365957  4090 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:03.366773  4092 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.367313  4092 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:03.368415  4090 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:03.363533  4083 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 36.23, Next index: 24, Last known committed idx: 23, Time since last communication: 0.001s
I20260709 12:14:03.369587  4092 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:03.370172  4092 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:14:03.370564 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:03.371281  4092 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:14:03.371758  4092 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:03.372074 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:14:03.320963  4060 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 12:14:03.373497  4026 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:03.374150  4026 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:03.358382 26618 rpcz_store.cc:276] 0709 12:14:02.172434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.172597 (+   163us) service_pool.cc:224] Handling call
0709 12:14:02.187567 (+ 14970us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:02.658336 (+470769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.321391 (+663055us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b5400194954. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:03.321607 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1081229696}
I20260709 12:14:03.377727 26514 leader_election.cc:400] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 27. Current term is 28.
W20260709 12:14:03.293126  3970 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.006s	sys 0.008s
I20260709 12:14:03.378235 26514 leader_election.cc:403] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:03.375113 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:03.304944  3631 consensus_meta.cc:287] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 1.009s	user 0.010s	sys 0.000s
W20260709 12:14:03.333264  3963 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.411s	user 0.007s	sys 0.007s
I20260709 12:14:03.273222  4076 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:03.397229  3853 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:14:03.345183  3976 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:03.323139  4068 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 36 LEADER]: Stepping down as leader of term 36
I20260709 12:14:03.310722  4042 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:03.401392 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:03.403666  3963 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:03.379771  4016 raft_consensus.cc:697] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:03.440289  4016 consensus_queue.cc:237] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:03.372493  4090 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.032s
I20260709 12:14:03.444012 26469 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 30. Current term is 31. Ops: []
I20260709 12:14:03.405542  4092 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:03.445499  3974 consensus_meta.cc:287] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.781s	user 0.007s	sys 0.003s
W20260709 12:14:03.440300  4057 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.809s	user 0.001s	sys 0.001s
I20260709 12:14:03.450745 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1566) took 1501 ms. Trace:
I20260709 12:14:03.450649  4026 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 30.16, Last appended by leader: 16, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:03.451313 26540 rpcz_store.cc:276] 0709 12:14:01.949150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.969703 (+ 20553us) service_pool.cc:224] Handling call
0709 12:14:01.970057 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:01.974972 (+  4915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:01.975005 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:01.975497 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:14:02.068630 (+ 93133us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b4800270258. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507b003aa1 00007f507affab37 00007f507affa9ca 00007f507b0f226f 00007f507b0f1f37 00007f507b10655c 00007f507b106508 00007f507b106488 00007f507b106443 00007f507b1056ec 00007f507a02fa96
0709 12:14:02.238888 (+170258us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:14:03.202103 (+963215us) log.cc:844] Serialized 14 byte log entry
0709 12:14:03.204494 (+  2391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.204588 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:03.439556 (+234968us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:14:03.450479 (+ 10923us) raft_consensus.cc:1685] finished
0709 12:14:03.450504 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:03.450674 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69205,"prepare.queue_time_us":318427,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":91132,"raft.run_cpu_time_us":2306,"raft.run_wall_time_us":89510,"spinlock_wait_cycles":51443456,"thread_start_us":1119523,"threads_started":2,"wal-append.queue_time_us":531063}
I20260709 12:14:03.455891  3998 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:03.398871  4071 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:03.457283  4071 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 36.23, Last appended by leader: 23, Current term: 37, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:03.458580  4088 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.338546  4081 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.459219  4088 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:03.459928  4081 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:14:03.462150  3971 consensus_meta.cc:287] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.506s	user 0.015s	sys 0.000s
I20260709 12:14:03.412889 27165 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:14:03.462908  3971 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:03.464251 26616 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 34. Current term is 35. Ops: [34.18-34.18]
I20260709 12:14:03.407209  4051 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 27.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.067s
I20260709 12:14:03.414383  4041 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.073s
I20260709 12:14:03.413864  4068 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 36 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:03.332444  3850 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:03.288807  3202 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:03.275425  4082 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:03.403182  4076 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:14:03.423769 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 46207.1us
I20260709 12:14:03.379741  4015 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:14:03.526118 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:03.723767 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:03.723974 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 197940us
W20260709 12:14:03.724272 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:03.625900 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 222420us
I20260709 12:14:03.429276  4005 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election lost for term 27. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 27. Current term is 28.
W20260709 12:14:03.430362  3954 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.000s
W20260709 12:14:03.430562  4066 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:14:03.432845  3922 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:03.434862  3711 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:03.479404 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:03.482646 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:03.771646 26545 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:14:03.483009 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:03.773384 26547 raft_consensus.cc:2410] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 31 because replica has last-logged OpId of term: 29 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 18.
I20260709 12:14:03.483084 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:03.775391 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:03.776422 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 426754us
I20260709 12:14:03.483361 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:03.778214 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:03.778874 26548 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 33
I20260709 12:14:03.502822 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:03.780498 26544 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 26: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:03.517798 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3650) took 1552 ms. Trace:
I20260709 12:14:03.780858 26539 rpcz_store.cc:276] 0709 12:14:01.965637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.033812 (+ 68175us) service_pool.cc:224] Handling call
0709 12:14:02.049794 (+ 15982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:02.142945 (+ 93151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.517455 (+1374510us) spinlock_profiling.cc:243] Waited 84.4 ms on lock 0x7b54002378d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:03.517717 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194109184}
I20260709 12:14:03.721927 27161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1528) took 1680 ms. Trace:
I20260709 12:14:03.484086 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3726) took 2574 ms. Trace:
I20260709 12:14:03.465984  3853 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:03.589180 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:03.446045  3974 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:03.469509  4033 consensus_meta.cc:287] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.337s	user 0.018s	sys 0.004s
I20260709 12:14:03.485460  4004 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.796020 27161 rpcz_store.cc:276] 0709 12:14:02.049957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.060581 (+ 10624us) service_pool.cc:224] Handling call
0709 12:14:02.064605 (+  4024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:02.153969 (+ 89364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.721512 (+1567543us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b54006cf054. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:03.721821 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51757312}
I20260709 12:14:03.508708  3202 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:03.793987 26464 rpcz_store.cc:276] 0709 12:14:00.909956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.817305 (+907349us) service_pool.cc:224] Handling call
0709 12:14:01.817796 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:01.850162 (+ 32366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:01.850198 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:01.974044 (+123846us) log.cc:844] Serialized 26 byte log entry
0709 12:14:02.224539 (+250495us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:14:02.224578 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.483665 (+1259087us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b54003147d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:03.483723 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:03.483767 (+    44us) raft_consensus.cc:1685] finished
0709 12:14:03.483781 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:03.484021 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":73222400,"thread_start_us":175808,"threads_started":1,"wal-append.queue_time_us":666272}
I20260709 12:14:03.499320  4034 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:14:03.802265 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 213227us
I20260709 12:14:03.815240 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:03.816481 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:03.731375  3778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.019s	sys 0.026s
I20260709 12:14:03.465526  3971 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:03.527913  4082 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:03.797513 26622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.042s	sys 0.057s
I20260709 12:14:03.495774  3850 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:03.784525  3745 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:14:03.773444  4015 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:03.861012  3954 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:14:03.782490  3711 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:03.863716 26619 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 33. Current term is 34. Ops: []
W20260709 12:14:03.858891  3778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.020s	sys 0.027s
W20260709 12:14:03.865935 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 49588.2us
W20260709 12:14:03.867003 26622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.042s	sys 0.057s
I20260709 12:14:03.795997  3981 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:03.808512  4005 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:03.810859  3970 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.490103  4068 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 36.23, Last appended by leader: 23, Current term: 36, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:03.889256 26548 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:03.865064  4067 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.896778 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 4056) took 1484 ms. Trace:
I20260709 12:14:03.896842 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:03.901255 26470 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 29 index: 20. Preceding OpId from leader: term: 31 index: 21. (index mismatch)
I20260709 12:14:03.875233  3202 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:03.903187 26622 rpcz_store.cc:276] 0709 12:14:02.412110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.542829 (+130719us) service_pool.cc:224] Handling call
0709 12:14:02.560165 (+ 17336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:02.560452 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 20
0709 12:14:03.227787 (+667335us) log.cc:844] Serialized 14 byte log entry
0709 12:14:03.896174 (+668387us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:03.896267 (+    93us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:14:03.896344 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.896467 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:03.896668 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":112526,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":11843,"raft.queue_time_us":14342,"thread_start_us":1257700,"threads_started":2}
I20260709 12:14:03.884393  3850 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.907652 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:03.915207 26548 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:14:03.916260 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:03.818982  4004 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:03.885090  3778 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:03.919397 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:14:03.907935 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 183238us
I20260709 12:14:03.918608 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:03.921159 26620 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:14:03.862840  4034 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:03.918707 26514 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:03.920385 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:03.924523 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:03.925377 26548 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:14:03.926214 26622 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 29: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:03.901906  3745 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:03.905086  4035 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:14:03.868822  4081 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:03.931923 26618 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 36. Current term is 37. Ops: []
I20260709 12:14:03.927791 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:03.923415 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:04.176191 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 252835us
W20260709 12:14:04.176580 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 248844us
W20260709 12:14:04.178136 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:03.954463  4015 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:03.919432  3850 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:03.935484 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:04.192235 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:04.193251 26548 raft_consensus.cc:2410] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 30 because replica has last-logged OpId of term: 28 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 14.
I20260709 12:14:03.956346  4068 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:03.918938  3954 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:03.955612  3778 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:03.932987  4035 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:03.931918  3998 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:03.935408  3853 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 31.19, Last appended by leader: 19, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:03.914338  4067 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:03.932541  3907 consensus_meta.cc:287] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.300s	user 0.009s	sys 0.005s
I20260709 12:14:04.175154 26540 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:14:04.001582  3745 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:03.906334  3970 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:03.958158  3981 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 31.21, Last appended by leader: 21, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:03.913748  4005 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:04.244596  4005 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 30.19, Last appended by leader: 19, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:03.932364 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.246537 26615 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:14:04.176951  3202 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:04.180562 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1433) took 3171 ms. Trace:
I20260709 12:14:04.180593  3971 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:14:04.181347  4004 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:04.183040  4081 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:04.183347 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 3739) took 2256 ms. Trace:
I20260709 12:14:04.183957  3974 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:04.184370  4034 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:04.187414  4076 consensus_meta.cc:287] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.648s	user 0.017s	sys 0.004s
I20260709 12:14:04.190328 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4778) took 2004 ms. Trace:
I20260709 12:14:04.263713 26468 rpcz_store.cc:276] 0709 12:14:01.926885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.050610 (+123725us) service_pool.cc:224] Handling call
0709 12:14:04.183130 (+2132520us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b54000dc0d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:04.183253 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":485823872}
W20260709 12:14:04.174499  4094 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.302s	user 0.002s	sys 0.009s
I20260709 12:14:04.198179 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:04.191061  3976 consensus_meta.cc:287] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.721s	user 0.012s	sys 0.007s
I20260709 12:14:04.193816  4016 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election won for term 30
W20260709 12:14:04.206857  4087 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.932s	user 0.013s	sys 0.012s
I20260709 12:14:04.209404  3922 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:04.201809  3954 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:04.215381  3214 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.244626  4067 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:04.191761  4088 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.222591 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3732) took 2761 ms. Trace:
I20260709 12:14:04.222311  4035 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.17, Last appended by leader: 17, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.226331  4001 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:14:04.236495  3907 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:04.242007 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 64601.7us
I20260709 12:14:04.248354 26472 rpcz_store.cc:276] 0709 12:14:01.009439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.843293 (+833854us) service_pool.cc:224] Handling call
0709 12:14:01.843662 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.855553 (+ 11891us) raft_consensus.cc:1534] Early marking committed up to index 19
0709 12:14:02.220885 (+365332us) log.cc:844] Serialized 14 byte log entry
0709 12:14:02.514517 (+293632us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:02.514582 (+    65us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:14:02.514645 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.180272 (+1665627us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b540026edd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:04.180325 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:04.180467 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8998,"prepare.queue_time_us":607915,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":127,"raft.run_wall_time_us":28440,"spinlock_wait_cycles":64857344,"thread_start_us":649028,"threads_started":2,"wal-append.queue_time_us":994594}
W20260709 12:14:04.267807 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.264998 26616 rpcz_store.cc:276] 0709 12:14:02.186084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.186278 (+   194us) service_pool.cc:224] Handling call
0709 12:14:02.186822 (+   544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:03.464660 (+1277838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.189991 (+725331us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400032854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:04.190237 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2937158912}
I20260709 12:14:04.233688  3711 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:04.279282 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 103887us
I20260709 12:14:04.263516  3971 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:04.255878  4112 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:04.301975  4112 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:04.285921 26469 rpcz_store.cc:276] 0709 12:14:01.461177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.903000 (+441823us) service_pool.cc:224] Handling call
0709 12:14:01.903260 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:03.444555 (+1541295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.222303 (+777748us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54000f41d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:04.222523 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3542941056}
W20260709 12:14:04.292078 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:04.292171 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.279259  4016 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:04.281968  4104 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.293097  4035 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:04.301450  3971 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:14:04.292516  3896 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:14:04.289569  4001 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:04.270228  4076 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.313516 26616 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 29 index: 20. Preceding OpId from leader: term: 31 index: 21. (index mismatch)
I20260709 12:14:04.312711 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:04.312986  3778 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 32.21, Next index: 22, Last known committed idx: 20, Time since last communication: 0.002s
I20260709 12:14:04.318819 26469 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 29.
W20260709 12:14:04.316989 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.281512  3976 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.286166  3214 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.307256  4016 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:04.304373  4112 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.315225  3896 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:04.318367  4111 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:04.338670  3214 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.334820  4001 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.347849  4001 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:04.350620  3896 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.15, Last appended by leader: 15, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.355695  3896 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:04.356477  3976 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.315122  4104 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:04.377271 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1567) took 2412 ms. Trace:
W20260709 12:14:04.374697 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 105368us
I20260709 12:14:04.378345 26543 rpcz_store.cc:276] 0709 12:14:01.949431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.970369 (+ 20938us) service_pool.cc:224] Handling call
0709 12:14:01.974512 (+  4143us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:01.986257 (+ 11745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:01.986293 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:02.034707 (+ 48414us) log.cc:844] Serialized 26 byte log entry
0709 12:14:02.263652 (+228945us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:14:03.320324 (+1056672us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:14:04.361296 (+1040972us) spinlock_profiling.cc:243] Waited 7.78 ms on lock 0x7b180046d4a0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5075c824bc 00007f5072fd048b 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f5079ad23c7 00007f50760e49a7 00007f50760f40bf
0709 12:14:04.361490 (+   194us) log.cc:844] Serialized 14 byte log entry
0709 12:14:04.361821 (+   331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.361949 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:04.362004 (+    55us) raft_consensus.cc:1685] finished
0709 12:14:04.362015 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:04.362168 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":246422,"prepare.queue_time_us":463143,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":8737,"raft.queue_time_us":5059,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":22895,"spinlock_wait_cycles":52209280,"thread_start_us":585988,"threads_started":2,"wal-append.queue_time_us":732976}
I20260709 12:14:04.333789  4111 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:04.396180 27134 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:04.470135 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 4046) took 2209 ms. Trace:
I20260709 12:14:04.405189  3907 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.509280  4076 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:04.516026 27165 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56886 (request call id 1530) took 2334 ms (client timeout 2238 ms). Trace:
W20260709 12:14:04.516647 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.518041  4005 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.518821  3214 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.519693  3998 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.520347  3998 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.521436  4007 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:04.519619  4088 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.523185  4088 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.525615  4088 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.522002  4007 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:04.518599  4005 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.538070  4005 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.519440  3214 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.539601  4007 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:04.529175  4036 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:04.540422  4036 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:04.541546  3214 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.542783  4036 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:04.546195  3998 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.548573  3981 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:04.549255  3981 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.551959  3981 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.552629  3981 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.553130  3981 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.414402  3954 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:04.554867  4068 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.555469  4068 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.557689  4068 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.557890  4007 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.558488  4007 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.559441 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:04.560113 26469 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:04.561036 26545 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:14:04.562345 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:04.563161 26545 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:14:04.563315 26544 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:14:04.562256 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:04.565500 26546 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 35.
I20260709 12:14:04.567054  4007 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.567935  4007 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.568539  4007 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.558279  4068 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.569834 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1740) took 1398 ms. Trace:
I20260709 12:14:04.401292  4016 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.570375 26619 rpcz_store.cc:276] 0709 12:14:03.171606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.177301 (+  5695us) service_pool.cc:224] Handling call
0709 12:14:03.205206 (+ 27905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:03.881448 (+676242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.569520 (+688072us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54003d7a54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:04.569758 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1513846144}
I20260709 12:14:04.575635  4016 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.571297 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3644) took 3025 ms. Trace:
I20260709 12:14:04.576797 26541 rpcz_store.cc:276] 0709 12:14:01.546099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.645083 (+ 98984us) service_pool.cc:224] Handling call
0709 12:14:01.654826 (+  9743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:03.359110 (+1704284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.570983 (+1211873us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b5400104fd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:04.571211 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3844924800}
W20260709 12:14:04.516515 27165 rpcz_store.cc:269] 0709 12:14:02.181583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.181763 (+   180us) service_pool.cc:224] Handling call
0709 12:14:04.515794 (+2334031us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400221354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:04.515919 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2828781440}
I20260709 12:14:04.425046 27134 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:04.502463 26617 rpcz_store.cc:276] 0709 12:14:02.261193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.345511 (+ 84318us) service_pool.cc:224] Handling call
0709 12:14:04.469809 (+2124298us) spinlock_profiling.cc:243] Waited 60 ms on lock 0x7b5400196754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:04.469998 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138101120}
I20260709 12:14:04.573490 26548 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 30: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:04.574105 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:04.581147 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:04.584263 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:04.608953 26470 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 29: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:04.610344 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:04.611200 26466 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 24: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:04.574474 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:04.613821 26545 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:04.403818  3850 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:04.404510  4104 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:04.585506 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:04.628082 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:04.458756  4113 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:14:04.612454 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 302375us
I20260709 12:14:04.632727 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:04.628587 26465 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:14:04.628785 26464 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:04.626546 26545 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:14:04.631201 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:04.468204  4111 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:04.604090 26469 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 37.
I20260709 12:14:04.633540 26472 raft_consensus.cc:2393] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 26: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:04.634018 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:04.640508 26473 raft_consensus.cc:2410] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 31 because replica has last-logged OpId of term: 29 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 18.
I20260709 12:14:04.605206  4088 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:04.634974 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:04.572292  4007 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.570114  4068 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.578507  4005 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:14:04.645833 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 220853us
I20260709 12:14:04.473815  3971 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:04.639943 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.680907 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:04.636462  3998 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.616042  3214 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:04.391126  4105 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.273s
I20260709 12:14:04.689888 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:04.672628 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:04.673868 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.677021 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:04.698087 26473 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:14:04.672271 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.638576  4016 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.681604 27163 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:14:04.683815 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:04.684078 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:04.701467 26466 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:04.701839 27166 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:14:04.686076 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:04.702575 27160 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:04.627620  4042 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.057s
I20260709 12:14:04.707422 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:04.648687  3981 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:04.693486 26614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 4044) took 2448 ms (client timeout 1797 ms). Trace:
I20260709 12:14:04.694146  4111 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:04.682735 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:14:04.713459 26614 rpcz_store.cc:269] 0709 12:14:02.244578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.244709 (+   131us) service_pool.cc:224] Handling call
0709 12:14:04.693278 (+2448569us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b540003be54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:04.693412 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1467788032}
I20260709 12:14:04.730193 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:04.733933 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.734651 26614 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:14:04.737224 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:04.695001 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:04.695436 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.696545  4007 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:04.741382 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.605408  4003 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.045s
W20260709 12:14:04.641753  3994 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.326s	user 0.011s	sys 0.027s
I20260709 12:14:04.698498 26472 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
W20260709 12:14:04.685348 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.674511  3988 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 12:14:04.705901 26617 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
W20260709 12:14:04.763762  4121 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:14:04.764040 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.764722 26617 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:14:04.765566 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.706611 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.766459 26621 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 30: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:04.767297 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.753077  4015 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.767874 26621 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:14:04.768119  4015 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.706457 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.769668 26616 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:14:04.706759 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:04.698068 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:04.692354  3202 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:04.709985 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:04.684999  4005 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:04.709416 26619 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 33 index: 16. Preceding OpId from leader: term: 35 index: 17. (index mismatch)
I20260709 12:14:04.707422 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.684491  3907 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 28.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 12:14:04.641705  4045 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 30.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.060s
I20260709 12:14:04.711421  3896 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.715147 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:04.715848 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.716149 26618 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31. Ops: []
I20260709 12:14:04.707134  3695 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.712409  4016 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.700096  3214 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:04.720185  3971 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:04.663488  3886 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.059s
I20260709 12:14:04.782990 26613 raft_consensus.cc:2410] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 30 because replica has last-logged OpId of term: 28 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 14.
I20260709 12:14:04.722455 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3670) took 1193 ms. Trace:
I20260709 12:14:04.712628  4128 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.786741 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:04.698181  3998 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.650218  4088 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:04.700671  4113 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 33.24, Next index: 25, Last known committed idx: 24, Time since last communication: 0.030s
I20260709 12:14:04.707018  3853 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.700295  4035 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:04.740164 26473 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:14:04.795645 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.749266 26464 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:04.752146 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:04.751150 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.757516  3881 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:04.754308  4007 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:04.754693  3994 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.442s	user 0.012s	sys 0.027s
I20260709 12:14:04.753494  4042 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:14:04.703537  4076 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:04.711199 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:03.087797 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:04.770601 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.805528 26616 raft_consensus.cc:2393] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 34: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:04.779461 26615 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:14:04.768777 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.807171 26621 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:14:04.808130 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:04.808709 26621 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:14:04.771816 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 73838.4us
I20260709 12:14:04.811856 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:04.779462 26617 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:14:04.722947 26588 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:04.779995 27164 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:14:04.783510 26539 rpcz_store.cc:276] 0709 12:14:03.529458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.397615 (+868157us) service_pool.cc:224] Handling call
0709 12:14:04.398011 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:04.398423 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:04.398470 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:04.399044 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 12:14:04.604454 (+205410us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:14:04.604516 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.604631 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:04.722184 (+117553us) raft_consensus.cc:1685] finished
0709 12:14:04.722207 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:04.722360 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10180,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":2582,"thread_start_us":204916,"threads_started":1,"wal-append.queue_time_us":244714}
I20260709 12:14:04.724047  4068 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.787111 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.817077 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.787542 26472 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:04.818921 26617 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
I20260709 12:14:04.788520  3695 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.821244 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:04.791278 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:04.794127 26469 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 36 index: 23. Preceding OpId from leader: term: 37 index: 24. (index mismatch)
W20260709 12:14:04.837074 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 45898.8us
I20260709 12:14:04.837749 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:04.794608 26465 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 16. Preceding OpId from leader: term: 32 index: 17. (index mismatch)
W20260709 12:14:04.774145 26438 connection.cc:256] RPC call timeout handler was delayed by -1.6718044899998858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
I20260709 12:14:04.794824 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:04.752184  3850 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.841678 26472 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:14:04.797326 26614 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:14:04.772258  4119 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:04.752282  3711 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:04.754978  4004 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:04.850253 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.773838  4005 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:04.770371  4015 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.792202  3981 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:14:04.814867 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:04.821538  4072 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:14:04.816334 26543 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: []
I20260709 12:14:04.789125  3896 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.755545  4111 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.869827 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:04.824319  4011 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:14:04.826148  4093 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.506s	user 0.015s	sys 0.046s
I20260709 12:14:04.826452  4088 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:04.820745  3954 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.008s
I20260709 12:14:04.830188 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:04.831151 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:04.832044  4007 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.832451  4012 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.833362 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:04.889448 26473 raft_consensus.cc:2376] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28. Re-sending same reply.
I20260709 12:14:04.834017  3214 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:04.834898 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.799050  3881 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:04.791003 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:04.892053 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.892366 26470 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 27: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:04.772074  3202 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.840896 26468 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:14:04.836125  3994 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.035s
W20260709 12:14:04.841411 26438 connection.cc:256] RPC call timeout handler was delayed by -1.6673044899998786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
I20260709 12:14:04.792546  4034 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 36.23, Next index: 24, Last known committed idx: 23, Time since last communication: 0.030s
I20260709 12:14:04.753691 26466 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 35.
I20260709 12:14:04.842233 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:04.897632 26465 raft_consensus.cc:2376] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29. Re-sending same reply.
I20260709 12:14:04.844025 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.844923  4068 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:14:04.864346  4072 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:04.846382  3922 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:14:04.848754 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:04.849947 27159 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:14:04.792008  4041 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.030s
I20260709 12:14:04.849571  4119 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:04.852986 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:04.921455  4119 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:04.855126 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:14:04.922690 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 68009.9us
I20260709 12:14:04.924623 26439 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:04.855926  3989 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.004s
I20260709 12:14:04.852722  3711 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.926622  4016 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.927129 26621 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:14:04.860860 26464 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
W20260709 12:14:04.815538 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 92666.7us
I20260709 12:14:04.928088  3711 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:04.928797 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.928797  4083 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 30.20, Next index: 21, Last known committed idx: 19, Time since last communication: 0.001s
W20260709 12:14:04.929668 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.929910  4083 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election won for term 30
W20260709 12:14:04.930372 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.863386 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:04.859951  3981 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:04.857084  4004 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.821704  4042 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:04.932979  3981 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.15, Last appended by leader: 15, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.933399  4042 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 31.19, Last appended by leader: 19, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.805338  4035 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:04.934425  3981 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:04.800544  3853 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:04.788550 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:04.793805  4128 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.937724  3853 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:04.815377  4076 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:04.939535  4128 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.939939  4076 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:04.888548 26471 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:14:04.940673  3970 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:04.893563 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3672) took 1363 ms. Trace:
I20260709 12:14:04.941556  4015 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:14:04.844691  3850 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.942220  4015 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:04.942720  4015 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:04.943275  3907 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:14:04.943756  3907 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:04.944713  3907 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 30.20, Last appended by leader: 20, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:04.947371 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:04.927273  3989 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.021s
I20260709 12:14:04.948235 26613 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 35: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:04.941520 26543 rpcz_store.cc:276] 0709 12:14:03.530046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.408968 (+878922us) service_pool.cc:224] Handling call
0709 12:14:04.449866 (+ 40898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.869693 (+419827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.893239 (+ 23546us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b540037f5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:04.893480 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842154752}
I20260709 12:14:04.917584  3202 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.946100  3907 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:04.951311  3962 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:14:04.918915 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: true dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:04.952153 26615 raft_consensus.cc:2376] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26. Re-sending same reply.
I20260709 12:14:04.901491  4012 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:04.887475  4011 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:04.884064 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 144288us
I20260709 12:14:04.901895  4068 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:04.955695  4068 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:04.955919 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:04.956377  4011 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:04.903321  4036 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.958627  3850 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:04.959314 26622 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:04.959424 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:04.959781  3695 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:04.960011 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:04.960180 27161 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:14:04.930320  4083 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:04.961318  4083 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:04.962441 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3851) took 2306 ms. Trace:
I20260709 12:14:04.962872 26542 rpcz_store.cc:276] 0709 12:14:02.656019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.725385 (+ 69366us) service_pool.cc:224] Handling call
0709 12:14:02.762911 (+ 37526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:02.763343 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:02.763386 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:02.977093 (+213707us) log.cc:844] Serialized 26 byte log entry
0709 12:14:03.345541 (+368448us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:14:03.382413 (+ 36872us) log.cc:844] Serialized 14 byte log entry
0709 12:14:03.423473 (+ 41060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.423610 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:04.825520 (+1401910us) spinlock_profiling.cc:243] Waited 8.7 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:14:04.962094 (+136574us) raft_consensus.cc:1685] finished
0709 12:14:04.962191 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:04.962352 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40680,"prepare.queue_time_us":48705,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":6925,"raft.queue_time_us":244275,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":11952,"spinlock_wait_cycles":20014336,"thread_start_us":253890,"threads_started":1,"wal-append.queue_time_us":223249}
I20260709 12:14:04.964174  4012 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.912002  4072 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:04.964877 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:04.937726 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 149261us
I20260709 12:14:04.968196 26514 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:04.969033  3202 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 33.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:14:04.969802  4034 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:14:04.970002  3202 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 34 LEADER]: Stepping down as leader of term 34
I20260709 12:14:04.927345  3814 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:04.882365  3896 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:04.958900  4036 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:04.933935  4117 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.517s	user 0.002s	sys 0.003s
I20260709 12:14:04.966471 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:04.978078 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 3669) took 1497 ms. Trace:
I20260709 12:14:04.969177 26514 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:04.902194 26438 connection.cc:256] RPC call timeout handler was delayed by -1.5206044900000961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1797s for a response
I20260709 12:14:04.898633 26617 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
W20260709 12:14:05.007941 26438 connection.cc:256] RPC call timeout handler was delayed by -1.512504490000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
W20260709 12:14:05.008592 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.958891 27160 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:14:04.929715 26621 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
W20260709 12:14:05.008996 26438 connection.cc:256] RPC call timeout handler was delayed by -1.3352407759998641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
I20260709 12:14:04.920162 26469 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 37.
I20260709 12:14:04.970335  4034 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:04.934077  4004 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:04.966820  4001 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:14:05.008816 26548 rpcz_store.cc:276] 0709 12:14:03.515829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.197807 (+681978us) service_pool.cc:224] Handling call
0709 12:14:04.977745 (+779938us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b5400140854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:04.977978 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693005184}
W20260709 12:14:05.009492 26438 connection.cc:256] RPC call timeout handler was delayed by -1.2587044899999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
I20260709 12:14:05.008350 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:05.014583 26622 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
W20260709 12:14:05.014804 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48397.5us
W20260709 12:14:05.016377 26540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 3666) took 1536 ms (client timeout 1747 ms). Trace:
I20260709 12:14:05.027069 27167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 1270) took 1132 ms. Trace:
I20260709 12:14:05.004294 26588 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:14:05.025198 26438 connection.cc:256] RPC call timeout handler was delayed by -1.1777407759998368s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
W20260709 12:14:05.028204 26438 connection.cc:256] RPC call timeout handler was delayed by -1.1507044899999528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
W20260709 12:14:05.027366 26540 rpcz_store.cc:269] 0709 12:14:03.479799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.774979 (+295180us) service_pool.cc:224] Handling call
0709 12:14:05.016173 (+1241194us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b5400338bd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:05.016303 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381049600}
W20260709 12:14:05.028793 26438 connection.cc:256] RPC call timeout handler was delayed by -1.1417407759997786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
W20260709 12:14:05.029237 26438 connection.cc:256] RPC call timeout handler was delayed by -1.1147044899998946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
I20260709 12:14:04.928972  4111 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:04.970639  3202 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 34 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:04.912523  3922 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:05.041795 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.027534 27167 rpcz_store.cc:276] 0709 12:14:03.894730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.895054 (+   324us) service_pool.cc:224] Handling call
0709 12:14:03.895555 (+   501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:04.288194 (+392639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:04.288238 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:04.297393 (+  9155us) log.cc:844] Serialized 26 byte log entry
0709 12:14:04.576474 (+279081us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:14:04.576519 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.020283 (+443764us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b540071af54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:05.020372 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:05.020458 (+    86us) raft_consensus.cc:1685] finished
0709 12:14:05.020479 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.026969 (+  6490us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":63222,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":787262848,"thread_start_us":303841,"threads_started":2,"wal-append.queue_time_us":385867}
I20260709 12:14:05.025831 26514 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:05.042714 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.003145  3970 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:05.034121 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.022625  4034 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:05.037730 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.038015 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.025453  3778 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:14:05.043460 26473 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:14:05.044138 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.055636  4111 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:14:05.055861 26465 raft_consensus.cc:2393] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 26: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:05.056169  4111 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:05.056643  4111 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:05.056948 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.057686 26465 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
W20260709 12:14:05.058995 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:05.062363 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 58158.3us
I20260709 12:14:05.062788  3896 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:14:05.063225  3896 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.063482 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:05.066148 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:05.067646 27162 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 36 index: 23. Preceding OpId from leader: term: 37 index: 24. (index mismatch)
I20260709 12:14:05.066148  3971 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:14:05.013855  3711 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:14:05.015618  4069 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.069118  3971 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:05.070169  3971 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:05.036367 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.072031 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.069329  4069 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:05.072827 26473 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:14:05.073947 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.019126  4007 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:14:05.074371  4069 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:05.074658  4007 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.075197  4007 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:05.075812 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.076462 26470 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
I20260709 12:14:05.077387 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.077122  4015 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:05.078243 26470 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 31: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:05.077885  4111 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:05.079201 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.045435 26472 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:14:05.042817 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:05.049012 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:05.083015 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:05.083284  3850 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:14:05.083707  3850 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.084061  3850 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:05.084520 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:05.085908  4130 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:05.086234 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:05.086510  4130 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.086966  4130 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:05.086707  3922 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 32.21, Last appended by leader: 21, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:05.088012  3922 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:05.090036  4128 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:05.079486 26470 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 36. Current term is 37. Ops: []
I20260709 12:14:05.091789 26473 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:14:05.052723 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.063616  3896 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:05.071141 27160 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 32. Current term is 33. Ops: []
I20260709 12:14:05.097368 26464 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
W20260709 12:14:05.045478 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 234175us
I20260709 12:14:05.090554  4128 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.091341 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:05.080214  4111 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:05.026487  4035 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:05.034418  3954 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:14:05.164710 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.047678  3970 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.091516 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:05.155139 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 51348.6us
I20260709 12:14:05.111635  4005 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:14:05.167271 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.110512 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:05.150475  3778 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:05.161523 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:05.086010  3695 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.090s
I20260709 12:14:05.188341  3970 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Advancing to term 36
W20260709 12:14:05.195231 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 270663us
I20260709 12:14:05.192914 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:05.211534 26548 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 32.
I20260709 12:14:05.188750  4035 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:05.195616 26473 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:14:05.178047  3954 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:05.108492  4119 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:05.218228  3954 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:14:05.150866  4128 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:05.192772  4111 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.034s
I20260709 12:14:05.200546 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.201434 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:05.196476  4016 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.204692 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:05.207015  4069 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:05.210834 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.214461 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:05.213384 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:05.200162  3202 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 34.18, Last appended by leader: 18, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:05.217620 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.217163  3778 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 30.20, Last appended by leader: 20, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:05.239084 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:05.239529 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:05.241513 26539 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 18. Preceding OpId from leader: term: 33 index: 20. (index mismatch)
I20260709 12:14:05.249300 26542 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 27.
I20260709 12:14:05.249804 26465 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:14:05.250900 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:05.227975 26464 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:14:05.250535 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:05.359112 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:05.397527 26469 raft_consensus.cc:2410] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 29 because replica has last-logged OpId of term: 28 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 14.
I20260709 12:14:05.407202 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.407859 26544 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 33: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:05.408614 26465 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 31: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:05.357897 26546 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:14:05.360080 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:05.411073 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 172077us
I20260709 12:14:05.356482  4012 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.427011 26438 leader_election.cc:400] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33.
I20260709 12:14:05.428013 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:05.411821 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.427479 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:05.429910 26464 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:14:05.409970  4036 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:05.202847  4005 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:05.251686 26439 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:05.438704 26545 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:14:05.238433 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:05.415485 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 308468us
I20260709 12:14:05.236725  3711 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:05.231380  3988 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:14:05.358326  4067 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:05.220580  4119 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:05.260951  4035 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:05.437582  3881 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.000s
I20260709 12:14:05.254941  3907 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:05.243155  3214 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Stepping down as leader of term 36
I20260709 12:14:05.249503  4069 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:05.425141 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 333877us
I20260709 12:14:05.393253  4039 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.253906 26473 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:14:05.483994 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:05.412504  3981 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:05.441210 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:05.234915  4016 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:05.438927 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:05.218364  4072 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:05.430928  3896 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:05.503955 26542 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:14:05.486110 26473 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 12:14:05.258131  3850 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:05.253448  3202 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:05.251902  3954 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:05.459177 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:05.238641  3989 raft_consensus.cc:2764] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election decision vote started in defunct term 32: won
I20260709 12:14:05.392912  4083 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:05.434563  4135 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:05.474877 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:05.475689 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:05.478688 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:05.479754 26617 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:14:05.520330 26613 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:14:05.522051 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:05.522819 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:05.480399 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:05.468804  3214 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:05.477651 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:05.524499 26616 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:14:05.526283 26616 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 30 index: 19. Preceding OpId from leader: term: 32 index: 20. (index mismatch)
I20260709 12:14:05.528151 26616 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 12:14:05.454936  4007 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:05.483942  4119 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:14:05.462527  4035 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:05.454109  3988 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 33 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:14:05.487926 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:05.245559  4128 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:05.236598  4068 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:05.505158 26539 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:14:05.554168 26473 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 12:14:05.554572 26467 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 30: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:05.506124 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:05.509994 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:05.496366  4039 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:05.513033  4140 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.513157 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:05.453970  4067 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:05.523418 26613 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:14:05.483982  4069 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:05.441793  4036 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:05.523700 26615 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
I20260709 12:14:05.521050 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:05.592131 26621 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:14:05.537683  3989 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:14:05.538347 26616 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 36. Current term is 37. Ops: []
I20260709 12:14:05.486747  3907 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:05.455569  3711 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:05.540267 26618 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 28: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:05.544480 26545 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 16. Preceding OpId from leader: term: 32 index: 17. (index mismatch)
I20260709 12:14:05.593261 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:05.569983  4067 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:05.504760  4015 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:05.436060  4012 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:05.549268 26540 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 20. Current term is 21. Ops: []
I20260709 12:14:05.551072  4132 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:14:05.551143  4130 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:05.557612 26542 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:14:05.558351 26619 raft_consensus.cc:2368] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:14:05.541111  4005 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.18, Last appended by leader: 18, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:05.559087 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 131155us
I20260709 12:14:05.469704  3881 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:05.562376 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 49326.2us
I20260709 12:14:05.569460 26548 raft_consensus.cc:2368] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25.
I20260709 12:14:05.569701 26514 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:05.571656 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 320020us
I20260709 12:14:05.568612  4140 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:05.548199  4119 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:05.576771 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 149406us
I20260709 12:14:05.516141  3981 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:05.577936 26468 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:05.599252 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:05.666373 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:05.666735 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:05.667279 26545 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:05.545354 26617 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:05.571143  4131 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:14:05.631415 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:05.519598  4088 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:05.602272  3989 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:05.633380 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:05.634219  4016 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:05.635476 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 3762) took 1007 ms. Trace:
I20260709 12:14:05.683733 26466 rpcz_store.cc:276] 0709 12:14:04.628370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.630812 (+  2442us) service_pool.cc:224] Handling call
0709 12:14:05.635284 (+1004472us) spinlock_profiling.cc:243] Waited 67.5 ms on lock 0x7b54002de1d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:05.635406 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155275520}
I20260709 12:14:05.635926  3896 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:05.637921  3881 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:05.602489  4036 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:05.623798  3214 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 36.23, Last appended by leader: 23, Current term: 36, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:05.638911 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:05.639518  3962 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.640378 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:05.642110  4039 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:05.598433  3988 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 33.24, Last appended by leader: 24, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:05.643983 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:05.647223 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 77603.1us
I20260709 12:14:05.632709 26439 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:05.737658 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:05.738168 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 105532us
I20260709 12:14:05.631174 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:05.691794 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 58479us
I20260709 12:14:05.740005 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:05.690042 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 58715.2us
I20260709 12:14:05.740556 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:05.741110 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:05.669045  4119 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:14:05.674682  4141 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:14:05.670720  3994 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:14:05.658370  4152 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.676091 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:05.756940 27167 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 33: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:05.738984 26439 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:05.734932 26545 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
W20260709 12:14:05.737119  4139 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 12:14:05.747303 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:05.749768 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:05.688357  4072 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:05.745049 26541 raft_consensus.cc:2368] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31.
I20260709 12:14:05.745775 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:05.709794  4150 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:05.758603 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:05.743021  3214 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:05.759470  4016 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:14:05.743076  3907 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:14:05.706473  4088 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:05.761106 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:05.835886 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:05.761955 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 4069) took 1051 ms. Trace:
I20260709 12:14:05.746650  3881 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:14:05.750860  3994 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:05.763643  4036 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:05.735248 26617 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
W20260709 12:14:05.820803  3814 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.802s	user 0.017s	sys 0.000s
I20260709 12:14:05.791899  3998 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:05.861104 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:05.798758 26544 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 12:14:05.707221  4076 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:05.802371 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:05.805575 26539 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31. Ops: [30.20-30.20]
W20260709 12:14:05.820452 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 74810.2us
I20260709 12:14:05.725652  3962 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:14:05.832450 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 82778.4us
I20260709 12:14:05.759850 27162 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 30 index: 19. Preceding OpId from leader: term: 32 index: 20. (index mismatch)
I20260709 12:14:05.838598 26471 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 25. Ops: []
I20260709 12:14:05.760165  3989 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:05.886924 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:05.887940  3881 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:05.889604  4012 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:05.889905 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:05.843364  4127 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.086s	user 0.010s	sys 0.000s
I20260709 12:14:05.835680  4135 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:14:05.831346  4122 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.068s	user 0.006s	sys 0.017s
I20260709 12:14:05.894047  3998 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.884183  3988 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:05.894747  3998 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:05.831921  4016 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:05.896001  4016 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:05.897023  3998 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:05.897331  4088 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:05.897655  3998 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.846668 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1578) took 1067 ms. Trace:
I20260709 12:14:05.753006  4131 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:05.761731  4151 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:14:05.853523 26620 rpcz_store.cc:276] 0709 12:14:04.710760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.710921 (+   161us) service_pool.cc:224] Handling call
0709 12:14:05.761728 (+1050807us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b540003be54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:05.761884 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1629197696}
W20260709 12:14:05.857170 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 96196.7us
I20260709 12:14:05.663385  4015 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.077s
I20260709 12:14:05.792865  4007 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:05.838177  3907 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.903126  3907 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:14:05.905216 26367 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57044 (request call id 315) took 112962 ms (client timeout 15000 ms). Trace:
W20260709 12:14:05.905678 26367 rpcz_store.cc:269] 0709 12:12:12.943043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.943414 (+   371us) service_pool.cc:224] Handling call
0709 12:14:05.904969 (+112961555us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":51}
I20260709 12:14:05.907181 26362 catalog_manager.cc:5697] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 19 to 28, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 28 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:05.908782  4129 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 1.142s	user 0.008s	sys 0.000s
I20260709 12:14:05.835492  4042 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:05.910784 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:05.903151 26614 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:14:05.913039 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 4795) took 1116 ms. Trace:
I20260709 12:14:05.913450 26614 rpcz_store.cc:276] 0709 12:14:04.796790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.849977 (+ 53187us) service_pool.cc:224] Handling call
0709 12:14:05.912814 (+1062837us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400032d54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:05.912961 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2419635456}
I20260709 12:14:05.900939 26547 rpcz_store.cc:276] 0709 12:14:04.779486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.779622 (+   136us) service_pool.cc:224] Handling call
0709 12:14:04.792779 (+ 13157us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:04.793132 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:04.793164 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:04.796865 (+  3701us) log.cc:844] Serialized 26 byte log entry
0709 12:14:05.634822 (+837957us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b18003ca300. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:14:05.715961 (+ 81139us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:14:05.716085 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.716297 (+   212us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:05.846165 (+129868us) raft_consensus.cc:1685] finished
0709 12:14:05.846196 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:05.846516 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3745,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":6399,"spinlock_wait_cycles":2399104,"thread_start_us":80275,"threads_started":1,"wal-append.queue_time_us":1038877}
I20260709 12:14:05.918527 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:05.917969 26362 catalog_manager.cc:5697] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 18 to 25. New cstate: current_term: 25 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:05.862103  3850 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:05.851125  4146 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 12:14:05.927855 27159 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:05.930351 26362 catalog_manager.cc:5697] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 19 to 24, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 24 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.931926 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:05.933000 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:05.923686 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:05.940900 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:05.919211  4150 raft_consensus.cc:2764] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election decision vote started in defunct term 29: won
I20260709 12:14:05.885372  4130 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:05.949118 26362 catalog_manager.cc:5697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 24 to 27, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 27 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:05.951040 26543 raft_consensus.cc:2410] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 35 because replica has last-logged OpId of term: 34 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 31 index: 16.
I20260709 12:14:05.951278 26362 catalog_manager.cc:5697] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.935021 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:05.926864  4148 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.956754  4148 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:05.942521  3853 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:14:05.883319  4155 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.076s
I20260709 12:14:05.959386  4148 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:05.928009  4135 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:14:05.918237  3994 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:05.964299  3981 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:05.964906  4035 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:05.966313 26542 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 30: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:14:05.968959  3970 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.750s	user 0.008s	sys 0.002s
I20260709 12:14:05.969442  3970 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:05.929152  3814 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:05.970808  3814 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.971177  3814 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:05.923079  3881 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 12:14:05.977932  4034 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.869s	user 0.008s	sys 0.000s
W20260709 12:14:05.981875  3922 consensus_meta.cc:287] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.893s	user 0.009s	sys 0.000s
W20260709 12:14:05.945984 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:05.937305  4068 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:05.922816  4151 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:05.987872  4151 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 29.15, Last appended by leader: 15, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:05.988597 26620 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 29. Current term is 30. Ops: [28.18-29.19]
I20260709 12:14:05.989185 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:05.989888 26618 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:14:05.923513  4104 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.990300 26613 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 35. Current term is 36. Ops: [35.17-35.17]
I20260709 12:14:05.861586  3954 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:05.861931  4128 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:05.991089 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:05.958884  4016 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:05.801369  4152 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:05.990728  4104 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:05.995425 26622 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 33.
I20260709 12:14:05.993055 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:06.009338 26614 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:14:05.954094 26362 catalog_manager.cc:5697] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 18 to 31, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 31 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.884563  4140 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:05.945547 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:05.973774  3711 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.020848 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:06.015838 27159 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
W20260709 12:14:06.017679 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 72224.8us
I20260709 12:14:06.022612 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:06.025012 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:06.027041 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 86291.3us
I20260709 12:14:06.028846 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:06.025955 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:06.030717 26469 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 30: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:05.929756  4131 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.087s
I20260709 12:14:05.898208  3998 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.047027 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:05.992734  4036 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:14:05.997376  4016 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:06.062182 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 38 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:06.063412 26471 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 37.
I20260709 12:14:06.064965 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:06.036854 26438 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:14:06.052444 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 306769us
I20260709 12:14:06.061987 26468 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 33. Current term is 34. Ops: []
I20260709 12:14:05.959115  4003 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.089s
I20260709 12:14:06.036437  3881 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:06.060161 26362 catalog_manager.cc:5697] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 20 to 22, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 22 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:06.030550  4068 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:06.072507 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:06.073431 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:06.048987  4102 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:14:06.039222  4135 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:06.105672 27133 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:06.059239  4042 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:06.103246 26622 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:06.074250 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:06.104061 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:05.997339  4152 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:05.995050  4034 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.132611 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 38 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:06.136268 27166 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
W20260709 12:14:06.106148  4113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.014s	sys 0.027s
W20260709 12:14:06.138206  4113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.014s	sys 0.028s
I20260709 12:14:06.035677  3981 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.068s
I20260709 12:14:06.048120  4148 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.070s
I20260709 12:14:06.102464  3881 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.124234  4016 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:14:06.125442 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:06.125444 26362 catalog_manager.cc:5697] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 26 to 29, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 29 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:06.127269 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:06.134569 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:06.158784 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.104940  4068 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:06.076033  3922 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:14:06.102152  3853 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 12:14:06.124109 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 53443.3us
I20260709 12:14:06.147647 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:06.087234 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:06.145566 26545 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 28: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:06.165043 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:06.168669 26614 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 32.
I20260709 12:14:06.170253 27161 raft_consensus.cc:2368] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26.
I20260709 12:14:06.174054 27164 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 29 index: 20. Preceding OpId from leader: term: 33 index: 22. (index mismatch)
I20260709 12:14:06.175570 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:06.175810 26542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:14:06.183105 26542 raft_consensus.cc:606] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:06.183590 26542 raft_consensus.cc:614] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:06.153970 26622 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:14:06.170153 26439 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:06.195955 27162 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 30: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:06.175024 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:06.134819  4042 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.139791  4039 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 12:14:06.218086 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 130942us
I20260709 12:14:06.134321  4102 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:06.077574  3994 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.145069  4034 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:06.048483  4150 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.147s
I20260709 12:14:06.201947 26514 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:06.176397  4068 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:06.172623  3881 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:06.218211 26362 catalog_manager.cc:5697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 23 to 26, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 26 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:06.247114 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 77066.2us
I20260709 12:14:06.169720  4035 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:06.176836  3853 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.226653  4076 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:14:06.224663 26588 leader_election.cc:400] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26.
W20260709 12:14:06.298883 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 262108us
I20260709 12:14:06.301611 26588 leader_election.cc:403] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 12:14:06.295601 26439 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:06.302646 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:06.257786 26542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:14:06.176651  3922 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.230669  4042 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:06.272665  3814 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.240430  4131 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:06.279479 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:14:06.287294 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 109985us
I20260709 12:14:06.312847 26514 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:06.312847 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:06.313848 26514 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:06.314248 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:06.315249 26514 leader_election.cc:400] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:14:06.315609 26514 leader_election.cc:403] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260709 12:14:06.267735  4064 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:14:06.230083  3989 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.052s
W20260709 12:14:06.254803 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 79908.6us
I20260709 12:14:06.291510  4083 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:06.305516 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 81073.5us
I20260709 12:14:06.284559  3970 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:06.303568 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:06.296713  4016 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:06.319552 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:06.303558 26542 raft_consensus.cc:606] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:14:06.287250  4005 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.359453 26542 raft_consensus.cc:614] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:06.357896 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:06.300509  3853 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:06.322337 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:06.362162 26619 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 30: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:06.305188  3922 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:14:06.362000 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 58505us
I20260709 12:14:06.318591  4035 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election won for term 33
W20260709 12:14:06.385353 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:06.385708 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 63455us
I20260709 12:14:06.356827  3850 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election won for term 33
W20260709 12:14:06.365216 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 47257.8us
I20260709 12:14:06.358783 26362 catalog_manager.cc:5697] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 18 to 25. New cstate: current_term: 25 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:06.318950  4067 consensus_meta.cc:287] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.694s	user 0.009s	sys 0.002s
I20260709 12:14:06.308712  3778 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26.
I20260709 12:14:06.312314  4131 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.415730 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:06.417214 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 53533.6us
I20260709 12:14:06.418790 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:06.418223 26545 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 24. Current term is 25. Ops: []
I20260709 12:14:06.358687  3896 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:14:06.318578  4003 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:06.457768 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:06.361963  3998 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:06.357647  3711 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:06.413352  4069 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.837s	user 0.011s	sys 0.002s
W20260709 12:14:06.501473 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.358831  4016 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.357931  4034 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:06.460139 26362 catalog_manager.cc:5697] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 22 to 23, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 23 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:06.488541 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 130735us
W20260709 12:14:06.517073 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 101522us
I20260709 12:14:06.358805  4004 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.124s
I20260709 12:14:06.362048  3970 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:06.510342  4131 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:06.415639  4035 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.390098  4083 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election won for term 33
W20260709 12:14:06.541589 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 83969.9us
I20260709 12:14:06.543154 26546 raft_consensus.cc:2410] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 34 because replica has last-logged OpId of term: 31 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 29 index: 20.
I20260709 12:14:06.321548  4164 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 12:14:06.475992 26513 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.577s (SENT) [suppressed 11 similar messages]
W20260709 12:14:06.552253 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.517694  4171 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:14:06.414268  4140 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.385803  4064 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Leader pre-election won for term 38
I20260709 12:14:06.509055  4003 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.461829  3850 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.382509  4148 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 33.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.158s
I20260709 12:14:06.509488  3896 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:06.559087 26362 catalog_manager.cc:5697] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 22 to 28. New cstate: current_term: 28 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:06.479844  4011 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:06.416836  4168 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:06.515283  4149 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:06.510051  4151 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:06.551210  3907 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.648s	user 0.011s	sys 0.001s
I20260709 12:14:06.413698  4005 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.583854  3850 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:06.545027  4016 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:14:06.546622 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 244032us
I20260709 12:14:06.591091  3994 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:06.574908  3962 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.673s	user 0.007s	sys 0.004s
I20260709 12:14:06.565404  3970 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:06.561273  3998 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election won for term 32
W20260709 12:14:06.565761  4170 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.207s	user 0.001s	sys 0.001s
I20260709 12:14:06.625114  3998 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.625594  3998 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:06.577273 26543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:14:06.626237 26543 raft_consensus.cc:606] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:14:06.626639 26543 raft_consensus.cc:614] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:14:06.627017  4119 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.870s	user 0.014s	sys 0.006s
I20260709 12:14:06.563709  3711 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:14:06.627463  4119 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:06.568356  4035 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:06.628376  4005 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:06.629839  4174 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:14:06.630069 27167 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 28: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:06.568696  4083 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.573078  4164 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:06.611730  4172 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:06.634791  4083 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:06.634904  4164 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:06.635398  4172 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.635905  4172 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:06.585897 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 131337us
I20260709 12:14:06.568430  4165 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 12:14:06.644084  3970 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:06.645987 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:06.646471 26545 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:14:06.646965 26542 raft_consensus.cc:2368] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26.
W20260709 12:14:06.590217 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 43884.8us
I20260709 12:14:06.593816 26362 catalog_manager.cc:5697] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 22 to 25, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 25 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:06.482676  4102 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 33.24, Last appended by leader: 24, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:06.650717 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:06.649113  4164 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.651511 26544 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:06.653033  4164 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:06.582633  4003 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:06.589757  3989 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.654309  3989 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.656622  3989 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:06.589454  3896 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:14:06.569209 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:06.658834 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 89760.8us
I20260709 12:14:06.659548 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:06.661708  4111 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:14:06.588814  4036 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:06.662257  4111 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:06.662572 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:06.580061  4140 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.663892  4036 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:06.664355 26540 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 19. Preceding OpId from leader: term: 33 index: 20. (index mismatch)
I20260709 12:14:06.665349  4140 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:06.545938  4069 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.665930  4140 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:06.595405  4149 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.666698  4149 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:06.666652 26465 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 34. Current term is 35. Ops: [34.19-34.19]
I20260709 12:14:06.663317  4111 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:06.667657  4069 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:06.619185  4169 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.158s	user 0.001s	sys 0.001s
I20260709 12:14:06.619752  4179 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:14:06.605641  4148 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:06.622874  4182 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 35 LEADER]: Stepping down as leader of term 35
I20260709 12:14:06.595772  4011 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:06.670676  4182 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 35 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:06.596912  4168 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.682689 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:06.623755  4034 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:14:06.613368  3962 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.599042  3814 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:06.602762  4151 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:06.627816  3711 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:06.515271  4067 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:06.579677  4064 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:06.667524 27162 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: []
I20260709 12:14:06.608036  3907 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.666635 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:06.672878 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:06.674556 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:06.724658 26613 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:06.676326 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:06.677031 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:06.677817 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:06.726500 26616 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:14:06.727552 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:06.727948 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:06.728597 26622 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:14:06.729000 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:06.729799 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:06.678874 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:06.679636 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.686870 26614 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 25: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:06.686932 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:06.638206  4172 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:06.691771  4011 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:06.693960 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:06.694778 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:06.664393  4036 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:06.697206 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:06.699322  4182 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 35.17, Last appended by leader: 17, Current term: 35, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.730315 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:06.741173 26547 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:14:06.732802 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:06.704823 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:06.736598 26542 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 36: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:06.737675 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:06.743438 26545 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:14:06.743906 26541 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 30: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:06.744187 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:06.744370 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:06.745033 26545 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:14:06.745597 26542 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 35. Current term is 36. Ops: [35.17-35.17]
I20260709 12:14:06.712776 26544 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:14:06.746150 26616 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:06.666312  4140 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:06.672982  4119 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:06.697865 26540 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 31 index: 21. (index mismatch)
I20260709 12:14:06.746832  4140 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:06.733693 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:06.733091 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:06.731467 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:06.748867 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:06.732484 26619 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:14:06.751255 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:14:06.708750 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.752933 26619 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 28: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:06.753799 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:06.750133 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:06.724172 27161 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 33.
I20260709 12:14:06.755543 26614 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 30: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:14:06.758436 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 282491us
I20260709 12:14:06.731709 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:06.742738 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:06.760761 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:06.764030 26469 raft_consensus.cc:2393] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 34: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:06.761142 26548 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:14:06.713766 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:06.767307 26620 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 36: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:06.763461 26547 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:06.773172 26468 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:14:06.775503 26618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:60224
I20260709 12:14:06.776185 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:06.776816 26466 raft_consensus.cc:3060] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:06.778187 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:06.778967 26469 raft_consensus.cc:2376] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 37. Re-sending same reply.
I20260709 12:14:06.770035 26439 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:14:06.770886 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 57205.6us
I20260709 12:14:06.781320 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:06.783041 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:06.785081 26466 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:14:06.717603  4155 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.809306 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:06.792752 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:06.787990 27160 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 33: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:06.812139 26466 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
I20260709 12:14:06.812943 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:06.813467 26464 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:14:06.812994 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:06.809870 26469 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 19. Preceding OpId from leader: term: 33 index: 20. (index mismatch)
I20260709 12:14:06.755736  4064 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:06.820118 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:06.821497 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:06.822312 26464 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 30: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:06.824544 26613 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:14:06.825012 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:06.736406  4182 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:06.826412 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:06.827811 26466 raft_consensus.cc:2368] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28.
I20260709 12:14:06.776532  3814 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:06.834198 26618 raft_consensus.cc:606] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:14:06.723762  4181 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.093s
I20260709 12:14:06.808969  3989 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election won for term 30
W20260709 12:14:06.816458  4129 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:14:06.771648  4069 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:06.714458  4131 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.768546  4172 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.857321 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:06.827265  4171 raft_consensus.cc:697] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:06.834211  4005 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:06.831589  4167 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:06.840975  4076 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:14:06.723794  4042 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:06.833209  3994 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:14:06.775800  4034 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.069s
I20260709 12:14:06.879547 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:06.858814 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:06.840847  4102 raft_consensus.cc:2764] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election decision vote started in defunct term 30: won
I20260709 12:14:06.840870  4178 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.883119 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:06.885991 26616 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:14:06.889163 26619 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: [28.17-28.17]
I20260709 12:14:06.892084 26464 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 28: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:06.886193 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:06.847587  3989 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.817812  3850 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.911193  3850 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:06.855634  3954 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:14:06.912575  3954 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.913074  3954 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.913745 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:06.914496 26468 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:14:06.915474 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:06.916095 26468 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 33.
I20260709 12:14:06.916353  3954 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:06.917126 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:06.919570 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:06.921141 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:06.921412  4067 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:06.922996 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:06.924247 26468 raft_consensus.cc:2368] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:14:06.925375 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:06.928000 26468 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 28: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:06.931823 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:06.903095 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:06.938868 26464 raft_consensus.cc:2368] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:14:06.940151 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:06.940894 26464 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:14:06.896704  4016 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.944654  4016 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:06.840607  4105 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.046s
I20260709 12:14:06.908202 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:06.941975 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:06.945834 26471 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:06.946192 26464 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 28: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:06.947126 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:06.948235 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:06.949203 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:06.949832 26464 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 30: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:14:06.908646  3881 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.604s	user 0.009s	sys 0.003s
I20260709 12:14:06.908775  3989 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:06.867127  4069 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:06.932403  4042 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:06.933156 26617 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 31. Current term is 32. Ops: [31.21-31.21]
I20260709 12:14:06.820917  4155 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.956874 26471 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:14:06.878727  4005 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.960281 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:06.961431 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 178435us
I20260709 12:14:06.950675 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:06.985816 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:06.889642  3994 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:06.889907  4076 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:06.994917 26464 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:14:06.996925 26464 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 33. Current term is 34. Ops: [33.21-33.21]
I20260709 12:14:06.881388  3711 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 33.17, Last appended by leader: 17, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.878264  4172 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.998572  4105 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:14:07.000120  4105 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:07.001154  4172 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.003682 26473 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 20. Preceding OpId from leader: term: 31 index: 21. (index mismatch)
I20260709 12:14:07.008502 26464 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: [29.21-29.21]
I20260709 12:14:06.950670  3881 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:06.963435  3922 consensus_meta.cc:287] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.005s
I20260709 12:14:06.961820  4164 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:14:06.961498  4041 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
W20260709 12:14:07.019385 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 194481us
I20260709 12:14:07.021363 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:07.003979  3853 consensus_meta.cc:287] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.001s
I20260709 12:14:07.032339 26464 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:14:07.003204  3994 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:07.007228  4076 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:14:07.026098 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 110324us
I20260709 12:14:06.952327  4178 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:06.997295  4005 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:07.001421  4105 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:06.996034  4035 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.039438 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:07.023934  4068 consensus_meta.cc:287] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.723s	user 0.011s	sys 0.001s
I20260709 12:14:07.049491 26587 leader_election.cc:400] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25.
I20260709 12:14:07.049896 26587 leader_election.cc:403] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
W20260709 12:14:06.986471 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 173441us
I20260709 12:14:07.041666 26438 leader_election.cc:400] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31.
I20260709 12:14:07.017719  4164 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:07.027230  3922 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:07.056178  3981 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:14:07.056643  3981 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 32 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:07.057098  3922 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:07.057667 26615 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 12:14:07.057560  3981 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 32.20, Last appended by leader: 20, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.058681  4083 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.059471  4164 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:07.042064  4016 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.021s
I20260709 12:14:07.052150 26514 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:07.051425 26438 leader_election.cc:403] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Cancelling election due to peer responding with higher term
I20260709 12:14:07.088817 26539 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 33: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:14:07.089392 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47880.7us
I20260709 12:14:07.046206  3962 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.041019  4165 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.031301  4036 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:07.079690 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:07.034333  3853 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.111744  3853 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:07.063004  3907 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.113586  4140 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:07.116354  4140 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:07.085626 26587 leader_election.cc:400] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26.
I20260709 12:14:07.089409 26514 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:07.138782 26541 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 29. Current term is 30. Ops: [29.19-29.19]
W20260709 12:14:07.139349 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 50022.9us
I20260709 12:14:07.093588 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:07.095777 26466 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 33: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:07.060151  4034 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:07.098433  4035 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.144524  4035 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:07.144964  4035 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:07.099203  4105 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:07.145228  3907 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
W20260709 12:14:07.147768 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.147948 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3781) took 2059 ms. Trace:
I20260709 12:14:07.148590 26465 rpcz_store.cc:276] 0709 12:14:05.088378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.423078 (+334700us) service_pool.cc:224] Handling call
0709 12:14:05.425267 (+  2189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:06.667349 (+1242082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.147537 (+480188us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54000690d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:07.147849 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2854359808}
I20260709 12:14:07.149778  3907 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.150460  3907 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.155967  4083 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.157956 26621 raft_consensus.cc:2368] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:14:07.160895  4195 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:14:07.161454  4195 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:07.161803  4195 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:07.145291 27167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56886 (request call id 1553) took 1042 ms. Trace:
I20260709 12:14:07.169960 27167 rpcz_store.cc:276] 0709 12:14:06.103063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.103792 (+   729us) service_pool.cc:224] Handling call
0709 12:14:07.145050 (+1041258us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b540071acd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:07.145224 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1142368640}
I20260709 12:14:07.172243  4036 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:07.174911 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:14:07.178089 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 84618.5us
I20260709 12:14:07.179229  4155 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.181752  4151 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:07.182878 26546 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33. Ops: [32.20-32.20]
W20260709 12:14:07.183113  4003 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.004s
I20260709 12:14:07.183528  4003 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.184669  4064 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:07.145308  4035 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:07.185886 27163 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 37. Current term is 38. Ops: []
I20260709 12:14:07.187215  3907 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:07.187956 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 102562us
I20260709 12:14:07.184700 26622 raft_consensus.cc:2368] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29.
I20260709 12:14:07.086730 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:07.092017  3981 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:07.215441  4167 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 29.21, Next index: 22, Last known committed idx: 20, Time since last communication: 0.000s
W20260709 12:14:07.215875  3998 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.000s
I20260709 12:14:07.216477  4167 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:14:07.216377  3998 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.216914  4167 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:07.217795  4167 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 29.21, Last appended by leader: 21, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:07.104111 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53402.4us
I20260709 12:14:07.221052  4167 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:07.221597 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:07.184669  3994 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:07.223544 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:07.091215  4072 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 24. Current term is 25.
I20260709 12:14:07.224566  3994 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:07.225003 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:07.225237  3994 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:07.225804 26464 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 29: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:07.104887  4196 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 12:14:07.034412  4171 consensus_queue.cc:237] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.105840  4165 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:07.048472  4192 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.064s
I20260709 12:14:07.247161 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:07.095220  4191 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.016s
I20260709 12:14:07.050666  4068 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.119100  4152 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.125720  4131 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:07.195055 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:07.197130 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:07.263309 26547 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:07.181072 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:07.198994 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:07.266506 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:07.267714 26613 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 29: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:07.268813 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:07.268927  3989 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.200531 26620 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 29. Current term is 30. Ops: [28.18-29.19]
I20260709 12:14:07.271981 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:07.273083 26620 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 37.
I20260709 12:14:07.201480 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:07.275719 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:07.276547 26615 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:14:07.096680  4172 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election lost for term 30. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31.
I20260709 12:14:07.212726 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:07.213219  4177 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.023s
W20260709 12:14:07.213591  3896 consensus_meta.cc:287] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.556s	user 0.017s	sys 0.003s
I20260709 12:14:07.215093  4150 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:14:07.224375 26467 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 27: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:07.278491 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:07.278574  4150 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:07.279189 26468 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:14:07.226508 26470 raft_consensus.cc:2410] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 36 because replica has last-logged OpId of term: 35 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 33 index: 16.
I20260709 12:14:07.226783 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:07.101393  4149 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:07.279867  4150 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.19, Last appended by leader: 19, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.280905  4150 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:07.281771  4149 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.197620 26514 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:07.282649 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 85158us
I20260709 12:14:07.283435 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:07.283926  4155 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:07.284373  4155 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:07.284723  4155 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:07.228673 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:07.285609  4016 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:14:07.230261 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:07.282641 27161 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33. Ops: [32.20-32.20]
I20260709 12:14:07.286687 26545 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 30: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:07.287685 26468 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:14:07.289424 26439 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:07.289666  4150 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.195374 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:07.290230  4182 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader pre-election won for term 38
I20260709 12:14:07.290717 26541 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:07.291729 26547 raft_consensus.cc:2410] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 35 because replica has last-logged OpId of term: 34 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 31 index: 18.
I20260709 12:14:07.291782 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:07.292421 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 111431us
I20260709 12:14:07.293395 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:07.244077 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:07.244633 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:07.244860 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:07.106803  4168 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.248008 26616 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 28: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:07.293678  4164 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.249470 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:07.250221 26619 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:14:07.251055 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:07.261977 27166 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 33: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:07.277976  3896 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:07.228186 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:07.287652 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:07.232966 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:07.274266 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:07.226913 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:07.294533 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:07.296938 26469 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:07.249293  3814 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:07.295320  3907 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:14:07.302866 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:07.336843 26541 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:07.323550 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:07.293460 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:07.304141 26439 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:07.305351  3989 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.308799  4076 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.291127  4182 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:07.245167  4072 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.051s
I20260709 12:14:07.317121 26546 raft_consensus.cc:2368] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28.
I20260709 12:14:07.324115 26545 raft_consensus.cc:3060] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 27
W20260709 12:14:07.336145 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.325253 26544 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 20. Current term is 21. Ops: []
I20260709 12:14:07.295101  3998 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.326712 26540 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 28: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:07.327136 26613 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 33: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:14:07.330631 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 102042us
I20260709 12:14:07.342103 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:07.367322 26619 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:07.328164  4039 raft_consensus.cc:3055] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:14:07.335624  4016 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.325702 26620 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 24: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:14:07.361611 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 68276.7us
I20260709 12:14:07.377723 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:07.379879 26438 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:07.362946 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:07.381943 26544 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 33.
I20260709 12:14:07.265622  4152 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:07.368458 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 66058.4us
I20260709 12:14:07.319381  4064 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.320535  3881 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.315948  4003 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:07.345227 26542 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 25. Current term is 26. Ops: []
I20260709 12:14:07.363834  3989 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:07.345074  4177 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader election won for term 37
I20260709 12:14:07.324184  3896 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:07.317866  4164 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.366196 26587 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:14:07.577596 27162 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.068s	sys 0.159s
W20260709 12:14:07.577708 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 211691us
W20260709 12:14:07.578266 27162 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.068s	sys 0.159s
I20260709 12:14:07.578071 27165 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 33 index: 24. Preceding OpId from leader: term: 34 index: 25. (index mismatch)
I20260709 12:14:07.580322 26587 leader_election.cc:400] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28.
I20260709 12:14:07.580833 26587 leader_election.cc:403] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Cancelling election due to peer responding with higher term
I20260709 12:14:07.346681  4172 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:07.343603  4104 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:07.314266  4195 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.432613 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:07.360383  4151 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.173s
W20260709 12:14:07.594888 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 162429us
I20260709 12:14:07.597841 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:07.298214  4150 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:07.601605  4168 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:07.353983  4182 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:07.603379 26513 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:07.604301  4168 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:14:07.607128 26513 leader_election.cc:400] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:14:07.547132 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 38 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:07.610064 26513 leader_election.cc:403] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:14:07.554425 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:07.554498 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.371031  4039 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:07.384270  4036 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:07.518148 26545 raft_consensus.cc:2468] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:14:07.594115 26619 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:14:07.522993 26468 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 32. Current term is 33. Ops: []
I20260709 12:14:07.599757  4164 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:07.588980  4172 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:07.363858  3994 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:07.539567  4176 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:14:07.614738 26469 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 29 index: 19. Preceding OpId from leader: term: 30 index: 19. (term mismatch)
I20260709 12:14:07.673355 26469 pending_rounds.cc:85] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 18
I20260709 12:14:07.673743 26469 pending_rounds.cc:107] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 29.19
I20260709 12:14:07.674054 26469 raft_consensus.cc:2889] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:07.659071 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:07.661631 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:07.675812 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:07.676162 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:07.676679 26469 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
I20260709 12:14:07.664127 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:07.585362  4083 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:07.387653  4016 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.528000 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:07.679076 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 151210us
I20260709 12:14:07.677155 26465 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:14:07.683113 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:07.683328 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:07.684891 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:07.687227  4104 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:14:07.687551  3886 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:14:07.688582  4207 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:14:07.690577  4083 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:07.690531  4182 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.693913  4012 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:14:07.696549 26464 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 38: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:07.698275 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:07.700030 27133 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:07.668689  4191 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 31.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.032s
I20260709 12:14:07.701668  4191 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Stepping down as leader of term 34
I20260709 12:14:07.702178  4191 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:07.702675  4041 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:07.703298  4041 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:07.703845  4041 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:07.703451  4191 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 34.19, Last appended by leader: 19, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.704914  4191 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:07.693151  4016 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.708417  4152 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.701975  4067 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:14:07.716370 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:07.717447 26473 raft_consensus.cc:2368] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:14:07.657518  4111 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:14:07.718884  4152 consensus_queue.cc:1059] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:14:07.719491  4173 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:14:07.721035  4067 raft_consensus.cc:3055] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:14:07.721627  4067 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:07.722901  4067 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:07.684641 26465 raft_consensus.cc:2376] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31. Re-sending same reply.
W20260709 12:14:07.736971  4005 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.685s	user 0.008s	sys 0.001s
I20260709 12:14:07.657949  4164 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:07.738883  4164 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:07.738257  3886 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:07.751156  4039 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:07.617401  3907 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.141s
I20260709 12:14:07.753274  3994 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.756166  3994 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.741364  4041 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:07.765748  4041 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.616770  4177 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:07.616427  4196 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election lost for term 27. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28.
I20260709 12:14:07.671020  3989 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:07.777568  3989 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.651472  4036 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:07.789073  4036 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:07.795601 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:07.797448  4069 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:07.809149  4155 consensus_meta.cc:287] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.524s	user 0.005s	sys 0.005s
I20260709 12:14:07.827546  4076 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:07.696437  4195 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.842638  4150 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:07.849227 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:07.951262 26471 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 34.
I20260709 12:14:07.853680 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 4827) took 1146 ms. Trace:
I20260709 12:14:07.952555 26622 rpcz_store.cc:276] 0709 12:14:06.707423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.729560 (+ 22137us) service_pool.cc:224] Handling call
0709 12:14:07.853367 (+1123807us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b54002602d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:07.853583 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1043943808}
I20260709 12:14:07.954334 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 34 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:07.856251 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 3801) took 1064 ms. Trace:
I20260709 12:14:07.955344 26470 rpcz_store.cc:276] 0709 12:14:06.791730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.792506 (+   776us) service_pool.cc:224] Handling call
0709 12:14:07.855925 (+1063419us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b54002db254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:07.856148 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":953309568}
I20260709 12:14:07.856616 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3867) took 1123 ms. Trace:
I20260709 12:14:07.957388 26539 rpcz_store.cc:276] 0709 12:14:06.732756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.732875 (+   119us) service_pool.cc:224] Handling call
0709 12:14:07.856276 (+1123401us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54001059d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:07.856512 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741049728}
I20260709 12:14:07.857867 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1755) took 1714 ms. Trace:
I20260709 12:14:07.958937 26617 rpcz_store.cc:276] 0709 12:14:06.143205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.145899 (+  2694us) service_pool.cc:224] Handling call
0709 12:14:06.146349 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:06.984443 (+838094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.857422 (+872979us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b540037a354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:07.857769 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1808663936}
I20260709 12:14:07.941237 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:07.960831 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:07.858070 27160 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 1279) took 2170 ms (client timeout 2202 ms). Trace:
W20260709 12:14:07.962625 27160 rpcz_store.cc:269] 0709 12:14:05.687724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.688002 (+   278us) service_pool.cc:224] Handling call
0709 12:14:07.857720 (+2169718us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400530a54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:07.857974 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2406562048}
W20260709 12:14:07.942947 26541 consensus_meta.cc:287] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.596s	user 0.012s	sys 0.009s
I20260709 12:14:07.860250 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:07.861182 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:07.773386  4177 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 36.23, Last appended by leader: 23, Current term: 37, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.669405  4172 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:07.867233  4178 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:07.868324  3981 consensus_meta.cc:287] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.652s	user 0.007s	sys 0.003s
I20260709 12:14:07.871110  4083 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:07.947381  4067 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:07.884325 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:07.947381  3994 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:07.890323  4068 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.893119 27167 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 12:14:07.894930 27163 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 33. Current term is 34. Ops: []
I20260709 12:14:07.897254  4187 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.898931 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:07.900888 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:07.901876 26439 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:07.903679  4165 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.905395 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:07.905732  4182 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.906770  4039 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:14:08.023085 26466 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:08.028067 27162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 1314) took 1018 ms. Trace:
I20260709 12:14:08.028537 27162 rpcz_store.cc:276] 0709 12:14:07.009464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.009621 (+   157us) service_pool.cc:224] Handling call
0709 12:14:07.025631 (+ 16010us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:07.039064 (+ 13433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:07.039111 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:07.042383 (+  3272us) log.cc:844] Serialized 52 byte log entry
0709 12:14:07.578952 (+536569us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:14:07.578998 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.906363 (+327365us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b54003b5e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:07.906458 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:08.027723 (+121265us) raft_consensus.cc:1685] finished
0709 12:14:08.027760 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:08.027996 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2724,"raft.queue_time_us":7094,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":13627,"spinlock_wait_cycles":23414656,"thread_start_us":509766,"threads_started":1,"wal-append.queue_time_us":925645}
W20260709 12:14:07.907485  4167 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.686s	user 0.008s	sys 0.002s
I20260709 12:14:07.907907  3711 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.035228  3711 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.909687 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:08.039909 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:08.040725 26618 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:07.910043 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:08.043725 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:08.045176 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:07.910743 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:07.912643 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:08.047602 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 38 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:08.049069 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:07.914765 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:08.052007 26615 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
I20260709 12:14:07.737634  4005 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:07.923208 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:08.063244 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 140191us
I20260709 12:14:08.064092 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:07.935320 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:07.913101 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:08.067058 26620 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 33: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:14:07.937700 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.992094  4016 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election won for term 31
W20260709 12:14:08.069530 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 134509us
I20260709 12:14:07.649124 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:07.943818 26547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.050s	sys 0.087s
W20260709 12:14:07.944466 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 261456us
W20260709 12:14:08.070891 26547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.050s	sys 0.087s
I20260709 12:14:07.945088 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:07.859447 27168 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33. Ops: []
I20260709 12:14:07.964212 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:07.965248 26541 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 33.
I20260709 12:14:07.965912 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:07.608361  3974 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.330s
W20260709 12:14:07.942113  4171 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.068s	sys 0.109s
W20260709 12:14:07.972196 27132 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.050s	sys 0.099s
W20260709 12:14:08.105321 27132 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.050s	sys 0.100s
I20260709 12:14:07.592967  3814 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.357s
I20260709 12:14:07.936631  4196 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.872870  4152 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 32.20, Next index: 21, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:14:07.980235 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:07.595086  4003 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.354s
I20260709 12:14:07.977458 26514 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:07.946919  4181 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:07.886607 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:08.000698 26468 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: [28.17-28.17]
I20260709 12:14:08.023061 26472 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 33: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:14:08.124184 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 146819us
I20260709 12:14:08.124625 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:08.068352  4182 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:14:08.125540 26540 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 32: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:08.075911  3907 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:08.046183 26621 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:08.128684 27168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 1309) took 1993 ms. Trace:
I20260709 12:14:08.125880 26466 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:14:08.129097 27168 rpcz_store.cc:276] 0709 12:14:06.135062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.138077 (+  3015us) service_pool.cc:224] Handling call
0709 12:14:07.859107 (+1721030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:08.072296 (+213189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:08.128496 (+ 56200us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b5400530a50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:08.128627 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3957076224}
I20260709 12:14:08.131742 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:08.106261  4111 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:08.147433 26514 leader_election.cc:400] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:14:08.148792 26514 leader_election.cc:400] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29.
I20260709 12:14:08.149183 26514 leader_election.cc:403] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Cancelling election due to peer responding with higher term
I20260709 12:14:07.588861  4042 raft_consensus.cc:2804] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:14:08.072402 26469 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 28: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:08.072813 26615 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 29 index: 15. Preceding OpId from leader: term: 31 index: 16. (index mismatch)
I20260709 12:14:08.084137 26541 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 34. Current term is 35. Ops: []
I20260709 12:14:08.103524 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:08.104103 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:08.038156  3711 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:08.110617 26548 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 32. Current term is 33. Ops: [32.17-32.17]
W20260709 12:14:08.092192 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 443159us
I20260709 12:14:08.169855 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:08.102182  4039 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 12:14:08.074836  3981 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election lost for term 35. Reason: could not achieve majority
I20260709 12:14:08.107520 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:08.109179 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.179440 26542 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:08.152351  4168 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:14:08.185182  4164 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:08.107069 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:08.068670  3989 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:07.947486  4155 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:08.198169 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:08.055779 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 153975us
W20260709 12:14:08.106315  4171 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.069s	sys 0.109s
I20260709 12:14:08.050330 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:08.202382 26613 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:08.004886  3994 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:08.144842  4111 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:08.061669 26473 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:08.171018 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:08.115197  4016 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 31 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:08.172194 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:08.154095 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:08.175093 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:08.175906  4181 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 37.24, Next index: 25, Last known committed idx: 23, Time since last communication: 0.001s
I20260709 12:14:08.176721  4076 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.001s
I20260709 12:14:08.218557 27162 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 34.
I20260709 12:14:08.120904  4196 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:08.128372  3907 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:08.186533 26539 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 33. Current term is 34. Ops: [33.20-33.20]
W20260709 12:14:08.187448 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 80458.8us
I20260709 12:14:08.108693  4193 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.171587 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:08.234604 26541 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 30: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:08.189134 26616 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 21. Current term is 22. Ops: []
I20260709 12:14:08.106282  4192 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 31.21, Next index: 22, Last known committed idx: 19, Time since last communication: 0.042s
I20260709 12:14:08.193522 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:08.159742 26467 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.034s	sys 0.053s
W20260709 12:14:08.243876 26467 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.035s	sys 0.054s
I20260709 12:14:08.194954 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:08.196537 26542 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
W20260709 12:14:08.198350 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.244576 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1466) took 1033 ms. Trace:
I20260709 12:14:08.199151 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:08.246055 26466 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 30: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:14:08.246693 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 47666.8us
I20260709 12:14:08.133100 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:08.248189 26465 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:14:08.147002  4034 consensus_meta.cc:287] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.003s	user 0.009s	sys 0.008s
I20260709 12:14:08.109311  3896 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.082s
I20260709 12:14:08.220885 26546 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 28: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:08.234270 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:08.172173 26540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:14:08.237495 26472 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 33 index: 24. Preceding OpId from leader: term: 34 index: 25. (index mismatch)
I20260709 12:14:08.263238 26540 raft_consensus.cc:606] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:08.263619 26540 raft_consensus.cc:614] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:08.157354  4182 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:08.197798  4104 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election lost for term 36. Reason: could not achieve majority
I20260709 12:14:08.062003  4187 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:08.244935 26467 rpcz_store.cc:276] 0709 12:14:07.211121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.279089 (+ 67968us) service_pool.cc:224] Handling call
0709 12:14:07.279406 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:07.279626 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 21
0709 12:14:07.617077 (+337451us) log.cc:844] Serialized 14 byte log entry
0709 12:14:08.244229 (+627152us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:08.244290 (+    61us) raft_consensus.cc:1645] Marking committed up to 21
0709 12:14:08.244335 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:08.244399 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:08.244502 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32806,"prepare.queue_time_us":320682,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":95184,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":131,"thread_start_us":931070,"threads_started":2}
I20260709 12:14:08.205480  4042 raft_consensus.cc:697] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:08.256163 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:08.262495 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 69030.8us
I20260709 12:14:08.271056 26614 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:08.142781 26621 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:14:08.220466  4111 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:08.168125  4195 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 27.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.061s
I20260709 12:14:08.288587 26465 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
W20260709 12:14:08.257628  4011 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.020s	sys 0.068s
I20260709 12:14:08.303366 26613 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
I20260709 12:14:08.262154  3989 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:14:08.267681  4034 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:08.242677  3907 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:08.292117 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:08.292517 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:08.167950  4167 consensus_queue.cc:1059] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 12:14:08.273613  4178 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.201629  4165 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 29.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.060s
W20260709 12:14:08.297214  4011 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.021s	sys 0.069s
I20260709 12:14:08.296900  4119 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:08.348745 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:08.307006  4105 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:08.269630  4157 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Leader election lost for term 38. Reason: could not achieve majority
I20260709 12:14:08.273515 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:08.335254  4119 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:08.326155  4208 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.010s	sys 0.014s
W20260709 12:14:08.243103  3853 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.028s	sys 0.013s
W20260709 12:14:08.376576  3853 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.028s	sys 0.014s
I20260709 12:14:08.261720  4193 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:08.269389  4083 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 32.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.067s
I20260709 12:14:08.319087  4192 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:14:08.379878  4192 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:08.380841  4193 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:08.381058  4192 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:08.382299  4208 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.010s	sys 0.015s
I20260709 12:14:08.390102  3922 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:14:08.390877  3922 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:14:08.391191  4216 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:14:08.392251  3922 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 31.21, Last appended by leader: 21, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:08.394826  4155 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:08.395752  4155 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:14:08.365995  4119 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:08.323259  4016 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.19, Last appended by leader: 19, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:08.370755  4164 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:08.352809  4005 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:08.371471  4120 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:14:08.353263  4182 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.15, Last appended by leader: 15, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:08.372072  4187 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:08.338407  4034 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election lost for term 28. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29.
W20260709 12:14:08.373876  4036 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.584s	user 0.007s	sys 0.002s
I20260709 12:14:08.407413  4036 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:08.409821  4036 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:08.360698  4042 consensus_queue.cc:237] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:08.410960  4217 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:14:08.367496  4105 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:08.366364  4064 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:08.376044  4035 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 1.190s	user 0.017s	sys 0.000s
I20260709 12:14:08.379149  4083 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:14:08.359823  4152 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.325766  4178 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:08.390223  4165 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:14:08.417943  4064 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:08.428975  4196 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:08.413965  4120 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 32 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:08.424665  4165 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:08.416922  4083 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 32 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:08.416814  4035 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:08.272228 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:08.630355  4171 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 12:14:08.631829 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 359542us
I20260709 12:14:08.260370 26473 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:14:08.536901 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:14:08.537132 26470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.003s	sys 0.009s
I20260709 12:14:08.639382 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 4864) took 1022 ms. Trace:
I20260709 12:14:08.651175 26473 rpcz_store.cc:276] 0709 12:14:07.616370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.898541 (+282171us) service_pool.cc:224] Handling call
0709 12:14:08.639084 (+740543us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:08.640511 26465 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: [27.18-27.18]
I20260709 12:14:08.655763 26464 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 16. Preceding OpId from leader: term: 35 index: 18. (index mismatch)
W20260709 12:14:08.642758 26470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.004s	sys 0.009s
I20260709 12:14:08.658669  4068 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.643597 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:08.659536  4068 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:08.485919  4111 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:08.556258 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 386303us
I20260709 12:14:08.328626 26543 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:14:08.560901 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3711) took 1327 ms. Trace:
I20260709 12:14:08.315770 26614 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 34.
I20260709 12:14:08.354579 26618 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
W20260709 12:14:08.311661 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 77519.8us
I20260709 12:14:08.671145 26544 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: [28.16-28.16]
I20260709 12:14:08.672753  4111 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:08.673151 26617 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27. Ops: [26.17-26.17]
I20260709 12:14:08.673903  4187 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.674747  4187 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:08.575765  3994 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:08.576162  4072 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.445065  4120 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 32.20, Last appended by leader: 20, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:08.462841  4083 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 32.21, Last appended by leader: 21, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:08.452359  4105 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:08.424119  4152 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:08.687340  4083 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:08.480773  4165 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 31.21, Last appended by leader: 21, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:08.493429  4172 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
I20260709 12:14:08.719766  4172 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:08.721091 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:08.468990  4178 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:08.495095  4191 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.790s	user 0.010s	sys 0.005s
I20260709 12:14:08.618810  4214 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:14:08.628140  4067 consensus_meta.cc:287] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.635s	user 0.013s	sys 0.000s
I20260709 12:14:08.441537  4064 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:08.574928  3981 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:08.684288  4072 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:08.680729  4187 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:08.632773  4035 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:08.731236 26588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.007s	sys 0.011s
I20260709 12:14:08.747610 26471 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 32: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:14:08.742553 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:08.746521 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:08.778534 26588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.009s	sys 0.013s
W20260709 12:14:08.767362 26543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3878) took 1607 ms (client timeout 1595 ms). Trace:
I20260709 12:14:08.759663  4172 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:08.761457  4152 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:08.793071 26543 rpcz_store.cc:269] 0709 12:14:07.159219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.194678 (+ 35459us) service_pool.cc:224] Handling call
0709 12:14:08.766777 (+1572099us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002369d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:08.766986 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2450720640}
W20260709 12:14:08.799436 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 608742us
I20260709 12:14:08.679497 26547 rpcz_store.cc:276] 0709 12:14:07.232726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.297057 (+ 64331us) service_pool.cc:224] Handling call
0709 12:14:07.297409 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:07.297834 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:07.297863 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:07.336678 (+ 38815us) log.cc:844] Serialized 52 byte log entry
0709 12:14:08.071625 (+734947us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:14:08.071676 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:08.071777 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:08.559873 (+488096us) raft_consensus.cc:1685] finished
0709 12:14:08.559954 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:08.560522 (+   568us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":697283,"threads_started":1,"wal-append.queue_time_us":860155}
I20260709 12:14:08.747195  3896 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:14:08.804132 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:08.836054 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.835477  4036 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.802642  4187 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:14:08.867851  4177 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.009s	sys 0.008s
I20260709 12:14:08.869439  4072 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:08.762152  4178 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.095s
I20260709 12:14:08.870296  3922 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:08.870497  4214 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:08.873797  4214 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:08.875643  4119 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:08.878003  4181 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.025s	sys 0.046s
W20260709 12:14:08.878538  4181 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.026s	sys 0.046s
I20260709 12:14:08.879503 26622 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
W20260709 12:14:08.880326 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 111542us
I20260709 12:14:08.881408  4172 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:08.882477  4172 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:08.883955 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4853) took 1270 ms. Trace:
I20260709 12:14:08.884582 26470 rpcz_store.cc:276] 0709 12:14:07.613118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.956735 (+343617us) service_pool.cc:224] Handling call
0709 12:14:07.957208 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:07.957510 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:07.957549 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:07.958204 (+   655us) log.cc:844] Serialized 26 byte log entry
0709 12:14:08.658822 (+700618us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:14:08.828291 (+169469us) log.cc:844] Serialized 14 byte log entry
0709 12:14:08.844001 (+ 15710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:08.861825 (+ 17824us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:08.865490 (+  3665us) raft_consensus.cc:1685] finished
0709 12:14:08.865518 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:08.883842 (+ 18324us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14847,"thread_start_us":828726,"threads_started":2,"wal-append.queue_time_us":742819}
I20260709 12:14:08.885869  4172 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:08.886694  4187 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:08.888847 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 158965us
I20260709 12:14:08.889276 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 4862) took 1273 ms. Trace:
I20260709 12:14:08.889652  4016 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:14:08.891214  4182 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:08.869630 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:08.867280  3981 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:08.754777  3814 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.104s
I20260709 12:14:08.895047 26471 rpcz_store.cc:276] 0709 12:14:07.615829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.952201 (+336372us) service_pool.cc:224] Handling call
0709 12:14:08.888953 (+936752us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b54000f41d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:08.889198 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1391296384}
W20260709 12:14:08.864799 26514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.007s	sys 0.003s
W20260709 12:14:08.908674 26466 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.008s	sys 0.001s
I20260709 12:14:08.911157  4068 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:08.904342 26545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.004s	sys 0.028s
W20260709 12:14:08.896322  3998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.002s	sys 0.044s
W20260709 12:14:08.928344 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 80693.2us
I20260709 12:14:08.914003  3981 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:08.934924 26545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.005s	sys 0.029s
W20260709 12:14:08.930805 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 146276us
I20260709 12:14:08.939013  4230 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.940250  4230 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:08.942523 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 221831us
W20260709 12:14:08.943672  3998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.003s	sys 0.045s
I20260709 12:14:08.943944 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:08.914732  4119 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:08.945238  4164 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:08.950328 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:08.960592  4230 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:08.960855  4016 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election lost for term 36. Reason: could not achieve majority
I20260709 12:14:08.955529  4119 consensus_queue.cc:1059] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.008s
I20260709 12:14:08.956835  4164 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:08.963917  4119 raft_consensus.cc:3055] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:14:08.964377  4119 raft_consensus.cc:740] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:08.965628  4119 consensus_queue.cc:260] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:08.966566  4164 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:08.955979 27134 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:08.967895  4119 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:14:08.969488  4005 raft_consensus.cc:3055] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:14:08.970065  4005 raft_consensus.cc:740] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:08.970768 27167 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 34. Current term is 35. Ops: [34.25-34.25]
I20260709 12:14:08.959282  4182 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:08.971596 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:08.968446  4011 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader election won for term 34
W20260709 12:14:08.939407 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:08.914460  4168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.012s	sys 0.000s
I20260709 12:14:08.972564  4165 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:08.948297  4187 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:08.987080  4011 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 34 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:08.867569  4036 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:08.972195 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:09.010191 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.005033 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:08.946036  4072 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260709 12:14:09.011682  4168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.013s	sys 0.000s
I20260709 12:14:09.024061  4168 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:09.029237 27161 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:14:09.029485  4005 consensus_queue.cc:260] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:09.030320  4034 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:14:09.029973  4011 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 32.21, Last appended by leader: 21, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:09.031317  4005 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:14:09.035179 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:09.036624 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:14:09.038561 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 88495.7us
I20260709 12:14:09.041963 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:09.042778  4187 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:09.043327  4120 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:09.044739  4239 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 31.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:14:09.046967 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:09.047427  3974 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Stepping down as leader of term 37
I20260709 12:14:09.051230 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 4843) took 1135 ms. Trace:
I20260709 12:14:09.030920  4034 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:09.052937  4192 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:09.051909 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:09.047353 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:09.056386 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:09.068132 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 122004us
I20260709 12:14:09.072350  4036 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:09.038178  4228 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.162s	user 0.000s	sys 0.003s
I20260709 12:14:09.046903  4072 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.089540 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 35 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:09.100806  4177 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:09.101141 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 59345.9us
I20260709 12:14:09.101810  4177 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.103103 26613 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:14:09.103266 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3717) took 1022 ms. Trace:
I20260709 12:14:09.104535  4177 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:09.103705 26545 rpcz_store.cc:276] 0709 12:14:08.080762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.081457 (+   695us) service_pool.cc:224] Handling call
0709 12:14:08.081964 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:08.082490 (+   526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:08.082536 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:08.105975 (+ 23439us) log.cc:844] Serialized 26 byte log entry
0709 12:14:08.955611 (+849636us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:14:08.955700 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:08.955832 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:09.037121 (+ 81289us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:14:09.102871 (+ 65750us) raft_consensus.cc:1685] finished
0709 12:14:09.102896 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:09.103202 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1934,"raft.queue_time_us":894,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":41065088,"thread_start_us":791072,"threads_started":1,"wal-append.queue_time_us":740318}
I20260709 12:14:09.106652 26616 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 36.
I20260709 12:14:09.106884  4239 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:09.107798  4164 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:14:09.108295  4164 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 33 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:09.109350  4164 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 33.21, Last appended by leader: 21, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:09.111207 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:09.112314  4177 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
W20260709 12:14:09.112752 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 140840us
I20260709 12:14:09.113374 26587 leader_election.cc:400] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28.
I20260709 12:14:09.107832  4239 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.115244  4239 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:09.117373  4177 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 33.24, Next index: 25, Last known committed idx: 24, Time since last communication: 0.001s
I20260709 12:14:09.117815  4239 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:09.118588  4177 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Stepping down as leader of term 34
I20260709 12:14:09.118757  4218 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.119067  4177 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:09.119451  4218 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.120126 27134 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:09.120206  4177 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 34.25, Last appended by leader: 25, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:09.090170 26622 rpcz_store.cc:276] 0709 12:14:07.914938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.953971 (+ 39033us) service_pool.cc:224] Handling call
0709 12:14:09.049482 (+1095511us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b540020a154. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:09.050272 (+   790us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2020957440}
W20260709 12:14:09.124553 26514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.008s	sys 0.008s
I20260709 12:14:09.122246  4177 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:09.129134 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:09.129730  4193 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:14:09.129926 26617 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:09.130251  4193 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.089931  3974 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:09.087049  4187 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.130367 27161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 1291) took 1254 ms. Trace:
I20260709 12:14:09.131948 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:09.143628 27161 rpcz_store.cc:276] 0709 12:14:07.876341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.883945 (+  7604us) service_pool.cc:224] Handling call
0709 12:14:09.130128 (+1246183us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b540077c754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:09.130291 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1825427840}
I20260709 12:14:09.144268 26616 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 32: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:09.132719  4193 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:09.132752 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3825) took 1041 ms. Trace:
I20260709 12:14:09.147328 27162 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 37. Current term is 38. Ops: []
I20260709 12:14:09.150061 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:09.150848 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3820) took 1061 ms. Trace:
I20260709 12:14:09.151600 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:09.131417 26614 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: []
I20260709 12:14:09.137744 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:09.146992 26469 rpcz_store.cc:276] 0709 12:14:08.091004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.645740 (+554736us) service_pool.cc:224] Handling call
0709 12:14:08.646335 (+   595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:08.947724 (+301389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:08.948045 (+   321us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:08.949432 (+  1387us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:14:08.949910 (+   478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.132323 (+182413us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400069ad4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:09.132369 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:09.132526 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617084672}
I20260709 12:14:09.163573 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:09.094763  3814 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 12:14:09.139961  3907 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.816s	user 0.018s	sys 0.000s
I20260709 12:14:09.122031  4218 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:09.138348  4168 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.175959 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:09.170059 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:09.138176  4164 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:09.178493  4034 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.17, Last appended by leader: 17, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.166450  4239 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.005s
I20260709 12:14:09.179900  4034 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:09.170956  4182 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:09.137272  4192 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:09.172576  4155 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:09.137526  4072 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.137832  4187 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:09.174820 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:09.174670  3907 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.182606 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:09.192363 27161 raft_consensus.cc:2393] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 26: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:09.199931 26587 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:09.168555  4083 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:09.155454 26466 rpcz_store.cc:276] 0709 12:14:08.089427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.247638 (+158211us) service_pool.cc:224] Handling call
0709 12:14:08.247957 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:08.248168 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:14:08.909589 (+661421us) log.cc:844] Serialized 14 byte log entry
0709 12:14:09.097224 (+187635us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:09.123179 (+ 25955us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:14:09.150479 (+ 27300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.150589 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:09.150791 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30360,"prepare.queue_time_us":655974,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":71,"raft.queue_time_us":67009,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":3648,"thread_start_us":723586,"threads_started":2,"wal-append.queue_time_us":201131}
I20260709 12:14:09.203603 26618 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 24: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:09.210958  4083 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:09.213356  3907 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:09.213510  4083 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:09.210958 26468 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 33. Current term is 34. Ops: []
I20260709 12:14:09.134955  3974 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 37.24, Last appended by leader: 24, Current term: 37, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:09.219839 26438 leader_election.cc:336] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.718s (SENT)
I20260709 12:14:09.227738  3814 raft_consensus.cc:2804] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:14:09.227995 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3817) took 1150 ms. Trace:
I20260709 12:14:09.228559  3814 raft_consensus.cc:697] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:09.228580 26468 rpcz_store.cc:276] 0709 12:14:08.077564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.235945 (+158381us) service_pool.cc:224] Handling call
0709 12:14:08.236387 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:09.214919 (+978532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.219510 (+  4591us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b54001c0f54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:09.227912 (+  8402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2228544896}
I20260709 12:14:09.226810  4181 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 37.24, Next index: 25, Last known committed idx: 23, Time since last communication: 0.005s
I20260709 12:14:09.225535  4119 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.231438  4119 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:09.234195  4072 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:09.235152  3974 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:09.236019  4193 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:09.236981 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 70370.9us
I20260709 12:14:09.236073  4192 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:09.238955 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 1.0903e+06us
I20260709 12:14:09.246519 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:09.246337 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:14:09.253130 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 115540us
I20260709 12:14:09.258710 27168 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 33: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:09.264166  4072 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 30.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:14:09.265413  3814 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.266671  4192 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:14:09.267235  4192 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:09.268568  4192 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 32.17, Last appended by leader: 17, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.270363  4192 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:09.243816  4119 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:09.285245 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.285463 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3821) took 1161 ms. Trace:
I20260709 12:14:09.285573 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:09.286521 26618 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:14:09.285918 26472 rpcz_store.cc:276] 0709 12:14:08.089782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.263713 (+173931us) service_pool.cc:224] Handling call
0709 12:14:08.264025 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:08.264230 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 12:14:08.834742 (+570512us) log.cc:844] Serialized 14 byte log entry
0709 12:14:09.204478 (+369736us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:09.207882 (+  3404us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:14:09.218597 (+ 10715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.222738 (+  4141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:09.251288 (+ 28550us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37408,"prepare.queue_time_us":667062,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":4074,"raft.queue_time_us":14459,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":753100,"threads_started":2,"wal-append.queue_time_us":322197}
I20260709 12:14:09.292460  4168 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:14:09.284204  4193 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:09.295928 26514 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:09.297192  4239 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:14:09.297855  4239 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:09.298967  4239 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 28.15, Last appended by leader: 15, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.303366 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:09.305359  3974 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:14:09.306018  3974 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:09.306646  4042 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 31.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:14:09.307202  3974 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.307778  4042 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:14:09.309085  3922 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:14:09.309499  3922 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:09.309713  4234 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Stepping down as leader of term 28
W20260709 12:14:09.306123 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.310177  4234 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:09.310655  3922 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 33.20, Last appended by leader: 20, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.312459  3922 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:09.312089  4234 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.16, Last appended by leader: 16, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.313769  4234 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:09.316336 26545 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 34 index: 18. Preceding OpId from leader: term: 35 index: 18. (term mismatch)
I20260709 12:14:09.316821 26545 pending_rounds.cc:85] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 17
I20260709 12:14:09.315992 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:09.317193 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.317430 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:09.319147 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 110711us
I20260709 12:14:09.319954 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:09.320339 26544 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: []
W20260709 12:14:09.324513 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:09.326563 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 82344.5us
I20260709 12:14:09.327751 26545 pending_rounds.cc:107] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 34.18
I20260709 12:14:09.331465 26545 raft_consensus.cc:2889] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:09.335443  4155 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:09.335572 26514 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:09.335937 26466 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 37. Current term is 38. Ops: []
I20260709 12:14:09.336365  4155 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:09.337312 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:09.338586 26470 raft_consensus.cc:2410] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 31 because replica has last-logged OpId of term: 28 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 17.
I20260709 12:14:09.339721 26547 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:09.340507 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:09.341851  4230 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:14:09.345494  4230 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:09.337576  4155 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 30.17, Last appended by leader: 17, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.354784 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:09.346038  4168 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election won for term 36
W20260709 12:14:09.358987 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.360495 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:09.362110 26472 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: [28.16-28.16]
I20260709 12:14:09.362309 26470 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:09.349025  4036 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.365569  4230 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.367996 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:09.368943 26539 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:09.371371 26466 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:14:09.364262 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:09.379153 26618 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
I20260709 12:14:09.385699  4036 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.384330 26545 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 12:14:09.384815  4083 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.007s
W20260709 12:14:09.389305 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 69473.9us
I20260709 12:14:09.392485 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3822) took 1160 ms. Trace:
I20260709 12:14:09.388357  4036 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:09.396139 27134 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:09.405196 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:09.389031  4083 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:14:09.411550 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:09.411979 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:09.392692  4016 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election won for term 36
W20260709 12:14:09.416445 26438 leader_election.cc:336] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.922s (SENT)
I20260709 12:14:09.420307 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:09.426558 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.426860 26439 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:09.409520  4083 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:09.414709  4165 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:14:09.394366 26467 rpcz_store.cc:276] 0709 12:14:08.090099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.266136 (+176037us) service_pool.cc:224] Handling call
0709 12:14:08.266572 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:08.266819 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 24
0709 12:14:08.919667 (+652848us) log.cc:844] Serialized 14 byte log entry
0709 12:14:09.207370 (+287703us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:09.218507 (+ 11137us) raft_consensus.cc:1645] Marking committed up to 24
0709 12:14:09.224932 (+  6425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.245746 (+ 20814us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:09.250558 (+  4812us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":278440,"prepare.queue_time_us":676000,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":13860,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":5405,"thread_start_us":501824,"threads_started":2,"wal-append.queue_time_us":227773}
I20260709 12:14:09.415548  4016 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:09.433104 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.432248 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:09.430734  3907 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:09.437829  3981 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:09.437968 26547 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 36 index: 23. Preceding OpId from leader: term: 37 index: 24. (index mismatch)
I20260709 12:14:09.439869  3907 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.442881  3907 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:14:09.462795 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 80200.7us
I20260709 12:14:09.439965  4036 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election won for term 37
I20260709 12:14:09.446584  4168 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.436842  4016 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:09.471735 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:09.472702 26546 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:14:09.473997  3778 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
W20260709 12:14:09.475322  4261 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 12:14:09.488034 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:09.490767 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 70898.6us
I20260709 12:14:09.491887 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:09.494560  4195 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 12:14:09.495472  4195 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:09.494315 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:09.456526  4218 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:09.454537  4254 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.058s
W20260709 12:14:09.500841  4264 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:14:09.501219 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:09.511621 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 95794.7us
I20260709 12:14:09.441103  4165 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:09.518151 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:09.524052 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:09.520015 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:09.520382 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:09.466383  4036 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.469846  4168 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:09.528688 26466 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 30.
W20260709 12:14:09.526674 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 120445us
W20260709 12:14:09.532029 26438 leader_election.cc:336] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.956s (SENT)
I20260709 12:14:09.532509 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:09.533248  3981 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
I20260709 12:14:09.534462  3981 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:09.535115  3981 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:09.524772  4239 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:09.529934  4036 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:09.512701  4187 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:09.555145 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 60939.9us
I20260709 12:14:09.557593 26472 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 24: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:09.568025 26618 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 32 index: 21. Preceding OpId from leader: term: 34 index: 22. (index mismatch)
I20260709 12:14:09.571324 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:09.575829 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 51916.7us
I20260709 12:14:09.561977  4234 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:14:09.577219 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:14:09.583297 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.584158 26513 leader_election.cc:400] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27.
I20260709 12:14:09.574513  4120 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.011s
I20260709 12:14:09.587411 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:09.588274 26470 raft_consensus.cc:2393] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 35: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:09.572465  3981 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:09.554805  4195 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 30.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.026s
I20260709 12:14:09.556259  4083 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.595484  4005 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:09.594283  4164 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:09.610116 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:09.598133  4003 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:09.617982 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:09.613124  4164 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.619386 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:09.620507 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:09.576434  4165 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:09.626555 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:09.627861 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:09.628625 26622 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:14:09.628769 26619 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 28 index: 15. Preceding OpId from leader: term: 30 index: 16. (index mismatch)
W20260709 12:14:09.629050  4267 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.065s	user 0.003s	sys 0.000s
I20260709 12:14:09.633371  4120 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.634035  4120 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:09.634814 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:09.635144 26616 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 32: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:09.635891 27133 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:09.636106 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:09.636605  4120 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:09.637207  4193 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:14:09.638216  4268 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:14:09.642413  4229 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:14:09.642963  4229 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:09.644028  4229 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 32.20, Last appended by leader: 20, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:09.645689  4229 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:09.651343 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:09.652292 27161 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:14:09.653812  4182 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:14:09.654377  4182 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:09.656126  4187 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:09.655741  4182 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.657449  4182 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:09.657938  4164 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:09.659665 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:09.660385 26618 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
W20260709 12:14:09.661434 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 65019.4us
I20260709 12:14:09.633739  3907 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:09.661803 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 91963.5us
I20260709 12:14:09.672135 26513 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:09.662317  4003 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:09.674980  4168 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.636878  4119 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:09.676126  4119 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.676640  4119 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:09.677294  4168 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:09.677968  4168 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:09.672340  3907 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:09.679536  4036 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.681872  4036 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:09.660219 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:09.689395 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:09.696002 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.699545 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:09.700981 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 130269us
I20260709 12:14:09.702318 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:09.716334 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:09.696553  4192 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:09.722000 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.721984 26439 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:09.622421  4016 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.710498  3907 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:09.721222  3981 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:09.719408  4218 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:09.731863  3981 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:09.732481  3981 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.715349  4120 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader election lost for term 35. Reason: could not achieve majority
I20260709 12:14:09.726130  4168 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.010s
I20260709 12:14:09.736382  3974 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:14:09.737576  3974 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:14:09.737972  3974 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:09.720216  4254 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 12:14:09.732897  3981 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:09.738991  3974 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.740335  3974 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:09.721289  3922 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.021s
I20260709 12:14:09.735244  4218 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:14:09.743017  4270 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:14:09.743162  4218 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:09.746912  4083 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:14:09.748720  4269 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 12:14:09.753973 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.762274  4016 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:09.723942  4192 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:09.771699 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.774842  4239 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
I20260709 12:14:09.779946 26514 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:09.780355  3922 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.781677 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:09.782022 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:09.782980 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:09.783428 26545 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 29 index: 15. Preceding OpId from leader: term: 31 index: 16. (index mismatch)
I20260709 12:14:09.781690  3922 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.803465 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:09.803818 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:09.804153  4193 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:14:09.804404 26547 raft_consensus.cc:2410] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
W20260709 12:14:09.804512 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.805274 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:09.805486 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:09.806097 26539 raft_consensus.cc:2393] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:09.786515  4003 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:09.806809  3922 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:09.790719  4229 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:14:09.807756  4229 raft_consensus.cc:697] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:09.808775  4229 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:09.810585 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:09.794709 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 75772us
I20260709 12:14:09.782927 26543 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 27: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:09.806241 26545 raft_consensus.cc:2410] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 29 because replica has last-logged OpId of term: 28 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 16.
I20260709 12:14:09.795423  4192 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:09.810748 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:09.812342 26539 raft_consensus.cc:2410] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 34 because replica has last-logged OpId of term: 33 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 31 index: 20.
I20260709 12:14:09.815244  4149 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.815943  4149 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:09.818328  3814 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.001s
W20260709 12:14:09.818831 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.815214 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:09.819689  4254 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:09.831594  4254 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.832376  4003 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:14:09.832919  4003 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:09.819718  4234 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Stepping down as leader of term 37
I20260709 12:14:09.833747  4234 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:14:09.834744 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 112815us
W20260709 12:14:09.838474 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.822250 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:09.835783 26439 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:09.870625 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:14:09.871454 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.871536 27161 raft_consensus.cc:2393] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 35: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:09.863862  4192 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:09.874099  4192 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.874521  4192 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:09.878444 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 35 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:09.879168 26622 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:09.880940 26546 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 33: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:09.888899  3922 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.864387  4234 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 37.24, Last appended by leader: 24, Current term: 37, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.889580  3922 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.889990  4234 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:09.890780 26367 catalog_manager.cc:5697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 30 to 33, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 33 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:09.891959  3922 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:09.892761 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:09.892889 26367 catalog_manager.cc:5697] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 17 to 20, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 20 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:09.893780 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:09.894654 26614 raft_consensus.cc:2410] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 35 because replica has last-logged OpId of term: 34 index: 25, which is greater than that of the candidate, which has last-logged OpId of term: 33 index: 24.
I20260709 12:14:09.899027  4177 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:14:09.905315 26471 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:14:09.862243  4187 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:09.925315 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:09.914263 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.897449 26367 catalog_manager.cc:5697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 28 to 30. New cstate: current_term: 30 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:09.927618 26622 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 37.
I20260709 12:14:09.865018  4083 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election won for term 32
W20260709 12:14:09.938334 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 125994us
I20260709 12:14:09.939610 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:09.929291 26367 catalog_manager.cc:5697] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 23 to 24, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 24 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:09.946892 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:09.948164 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 116681us
I20260709 12:14:09.945185 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:09.946143 26466 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:14:09.932241  4083 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.950539 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:09.970818 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:09.971712 26542 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:09.958297 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:09.974181 26540 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:14:09.853111  4003 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 33.20, Last appended by leader: 20, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:09.981909 26546 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 30: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:09.928718  4187 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:09.987917 26471 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
W20260709 12:14:10.017522 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.021381 27162 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 12:14:09.973837  4083 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:14:10.036532 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 49006.7us
I20260709 12:14:10.034243  4254 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:10.046998 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 120336us
I20260709 12:14:10.039616 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:10.027637  4193 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.063321 26542 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:10.057893 26439 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:10.069705 26540 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 33. Current term is 34. Ops: []
I20260709 12:14:10.073412 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:10.052073  4261 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:14:10.070595 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:10.073441 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:10.079317 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 94462.5us
I20260709 12:14:10.077751 26547 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 38.
W20260709 12:14:10.084810 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 51104.2us
I20260709 12:14:10.085320  3922 raft_consensus.cc:2764] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election decision vote started in defunct term 33: won
W20260709 12:14:10.086262 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.090830 26471 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 34.
I20260709 12:14:10.094622  4293 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.095394  4293 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:10.101236  4293 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:10.103400  4187 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:10.103502  4289 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:14:10.106355  4218 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:10.108918  4218 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:10.111089  3814 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:14:10.083452  4182 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader election won for term 37
I20260709 12:14:10.112479  4182 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 37 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:10.113610 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:10.113505  4182 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 35.17, Last appended by leader: 17, Current term: 37, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:10.114594  3814 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:10.116029 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:10.116879  3814 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:10.123678 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:10.124306 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:10.124439 26547 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:10.125568 26548 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: []
I20260709 12:14:10.125828 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:10.126708 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:10.127034 26541 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 26. Current term is 27. Ops: [26.17-26.17]
I20260709 12:14:10.131798 26540 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33. Ops: []
I20260709 12:14:10.124416 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:10.140504  4011 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.133692 26547 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:14:10.071607  4193 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:10.141805  3981 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:10.142694  4289 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:14:10.143520  4193 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:10.128352 26548 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:14:10.147833 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:10.156599 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:10.157835 26547 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 29: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:10.160305 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:10.078936  4119 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:10.165298 26542 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 38.
W20260709 12:14:10.166939 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.163805 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:10.161387 26622 raft_consensus.cc:2410] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 36 because replica has last-logged OpId of term: 34 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 31 index: 18.
I20260709 12:14:10.160377 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:10.140389  4149 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:10.171330  4193 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:10.171741  4193 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.171105 26367 catalog_manager.cc:5697] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 26 to 30. New cstate: current_term: 30 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:10.172103  4193 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:10.083635  4003 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:10.144141  3981 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:10.172785 26367 catalog_manager.cc:5697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 23 to 27, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 27 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.182490 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:10.181133 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:10.183730 26622 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:10.185017 26539 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:14:10.151691  4278 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:14:10.202099 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.202661 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:10.203058 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 35 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:10.203552 26616 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 32: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:14:10.205401 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48078.9us
I20260709 12:14:10.205444 26542 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 36.
I20260709 12:14:10.206935  3907 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:10.207041 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:10.207703  3907 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:10.209987  3907 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:10.210619  3907 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election lost for term 35. Reason: could not achieve majority
I20260709 12:14:10.207043  4229 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 12:14:10.214112 26367 catalog_manager.cc:5697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.215970 26367 catalog_manager.cc:5697] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 26 to 30, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 30 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:10.218222 26367 catalog_manager.cc:5697] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 24 to 26, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 26 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.220666 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:10.226811 26614 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 38.
I20260709 12:14:10.220666 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:10.227881 26471 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 33.
I20260709 12:14:10.228066 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:10.186717  4218 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:10.229740  4218 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:10.230072 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:10.229817 26367 catalog_manager.cc:5697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 32 to 36. New cstate: current_term: 36 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:10.231256 26367 catalog_manager.cc:5697] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 29 to 32, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 32 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:10.232043  4218 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:10.232631  4218 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader pre-election won for term 38
I20260709 12:14:10.232971  4218 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:10.233031 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:10.233546  4218 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:10.232910 26367 catalog_manager.cc:5697] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.233837 26614 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:10.224255  4278 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:10.222695 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:10.235100 26439 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:10.235291  4119 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:10.235790 27162 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:10.234741 26367 catalog_manager.cc:5697] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 23 to 27, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 27 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.236512  3981 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:10.236974  3981 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:10.235111  4149 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:10.237607  3981 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:10.237983  4149 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.238456  4149 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:10.239873  4287 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.240439  4287 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:10.243657 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 54682.7us
I20260709 12:14:10.247927 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:10.248605 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:10.247118  3981 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:10.249550 26547 raft_consensus.cc:2410] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 29 because replica has last-logged OpId of term: 27 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 17.
I20260709 12:14:10.250975 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:10.237197 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 85774.7us
I20260709 12:14:10.251374 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:10.252408 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:10.252590 26548 raft_consensus.cc:2410] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 28 because replica has last-logged OpId of term: 25 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 16.
I20260709 12:14:10.253376  4229 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:14:10.253919  4229 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:10.254916  4229 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:10.256111  3981 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:10.258945 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:10.259703 26544 raft_consensus.cc:2376] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30. Re-sending same reply.
I20260709 12:14:10.261226 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:10.261164  4083 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:10.263036 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:10.158365  4011 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:10.265657  4287 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:10.266919 26362 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57048 (request call id 309) took 29540 ms (client timeout 15000 ms). Trace:
W20260709 12:14:10.384486 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.268150 26367 catalog_manager.cc:5697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 28 to 31. New cstate: current_term: 31 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.270385 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:10.270881 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:10.237003  4278 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:10.206365 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:10.392906 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:10.378890 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.387396 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:10.393460 26367 catalog_manager.cc:5697] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 21 to 25. New cstate: current_term: 25 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.394338 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:10.394697 26547 raft_consensus.cc:2410] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 29 because replica has last-logged OpId of term: 28 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 16.
I20260709 12:14:10.380659 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:10.395776 26539 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
W20260709 12:14:10.396553 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.388654 26622 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:14:10.400844  4011 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:10.390226 27167 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 38: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:10.391544 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:10.401813 26468 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:14:10.388794 26362 rpcz_store.cc:269] 0709 12:13:40.726762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.545064 (+11818302us) service_pool.cc:224] Handling call
0709 12:14:10.266620 (+17721556us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:07.664420 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:07.689794 (+ 25374us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:07.689847 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:14:07.689867 (+    20us) tablet.cc:662] Decoding operations
0709 12:14:07.691169 (+  1302us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:07.691295 (+   126us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:07.691323 (+    28us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:14:07.692567 (+  1244us) tablet.cc:701] Row locks acquired
0709 12:14:07.692628 (+    61us) write_op.cc:260] PREPARE: finished
0709 12:14:07.692832 (+   204us) write_op.cc:270] Start()
0709 12:14:07.693012 (+   180us) write_op.cc:276] Timestamp: P: 1783599247692751 usec, L: 0
0709 12:14:07.693046 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:14:07.693821 (+   775us) log.cc:844] Serialized 5183 byte log entry
0709 12:14:09.211625 (+1517804us) op_driver.cc:464] REPLICATION: finished
0709 12:14:09.410898 (+199273us) write_op.cc:301] APPLY: starting
0709 12:14:09.411043 (+   145us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:09.708103 (+297060us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:09.708293 (+   190us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:09.764387 (+ 56094us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:09.764736 (+   349us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 12:14:09.764801 (+    65us) write_op.cc:312] APPLY: finished
0709 12:14:09.765307 (+   506us) log.cc:844] Serialized 121 byte log entry
0709 12:14:09.765542 (+   235us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:09.765880 (+   338us) write_op.cc:454] Released schema lock
0709 12:14:09.765950 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:09.770517 (+  4567us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:09.770570 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":860540,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":181527,"apply.run_cpu_time_us":24616,"apply.run_wall_time_us":365853,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58415,"num_ops":13,"prepare.queue_time_us":515268,"prepare.run_cpu_time_us":26926,"prepare.run_wall_time_us":796577,"raft.queue_time_us":744532,"raft.run_cpu_time_us":74444,"raft.run_wall_time_us":145215,"replication_time_us":1518355,"thread_start_us":1436089,"threads_started":4,"wal-append.queue_time_us":749648}]]}
I20260709 12:14:10.392537 26613 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:14:10.381983 26544 raft_consensus.cc:2376] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33. Re-sending same reply.
I20260709 12:14:10.382771 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:14:10.407500 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 201203us
W20260709 12:14:10.409318 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.408115 27168 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:14:10.408906 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:10.412393  4042 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:10.419425  4042 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:10.419880  4042 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:10.420111 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:10.410298 26439 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:10.421384 26619 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:10.420976 26614 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
I20260709 12:14:10.420311 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:10.436967 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:10.438949 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:10.409245  4192 consensus_meta.cc:287] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.534s	user 0.014s	sys 0.000s
I20260709 12:14:10.442121 26439 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:10.452162 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:10.454885 26547 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:14:10.455626 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:10.410619  4278 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:10.451673  4120 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.007s
I20260709 12:14:10.470747 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:10.453096 26544 raft_consensus.cc:2376] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30. Re-sending same reply.
I20260709 12:14:10.278317  4193 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:10.434705  3907 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election won for term 31
W20260709 12:14:10.476872 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 63891.4us
I20260709 12:14:10.470371 27134 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:10.434427  4287 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.439173  4011 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.448484  4177 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:10.454687  4292 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:10.486137 26467 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 29 index: 15. (index mismatch)
W20260709 12:14:10.504984 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.473582  4278 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.516546  4119 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:14:10.563287 26468 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 31.
I20260709 12:14:10.581691  4120 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.557729  4286 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:10.584064 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:10.623771 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.574090  4003 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.594749 26539 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 28 index: 15. Preceding OpId from leader: term: 30 index: 16. (index mismatch)
I20260709 12:14:10.596168 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:10.516381  4230 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.484935  4293 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:14:10.531548  3907 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:10.524812  4149 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:10.609973 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:10.605212  4278 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:10.680737 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:10.607225  4292 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 32 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:10.614502  4187 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.615603 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:10.623109  4296 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:14:10.699355 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:10.700033 26539 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:10.622951 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:10.610960 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:10.605070  4119 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.605650  4083 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:10.456418  4192 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:10.721031  4192 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:10.688045 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.686930 26541 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:14:10.564313  4177 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:14:10.695010  3814 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.578s	user 0.012s	sys 0.000s
I20260709 12:14:10.696079  4149 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:10.696749 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:10.682307  4155 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.687640  4239 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.697366  4187 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:10.570751  4011 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:10.701224 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:10.703101 26540 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 33: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:10.683526  4120 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:10.706597  3907 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.18, Last appended by leader: 19, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:10.708745 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:10.709471 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:10.699177  4003 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:10.710732  4182 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.710893 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:10.711525 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:10.714053 26542 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 35. Current term is 36. Ops: [35.18-35.18]
I20260709 12:14:10.715462  4292 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 31.21, Last appended by leader: 21, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:10.542778  4287 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:10.722055 26615 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 34: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:10.723408  4193 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:10.711941 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:10.712716 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 34 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:10.761036 26468 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:10.761621 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:10.733542 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:10.744150  3922 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.735499 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:10.769039 26622 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:10.692723  4293 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:10.704535  4119 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:14:10.740554 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:10.734937 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 264643us
I20260709 12:14:10.767392 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:10.774111 26540 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 33: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:10.774797 26541 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 29: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:10.775089 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:10.775719 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:10.776583 26541 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 33: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:10.776460 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:10.777228 26546 raft_consensus.cc:2393] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 27: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:10.777397 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:10.777966 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:10.778524 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:10.779163 26541 raft_consensus.cc:2376] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 38. Re-sending same reply.
I20260709 12:14:10.779672  4120 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:10.775738 26540 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:14:10.744102  4192 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.023s
I20260709 12:14:10.788430  4042 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:10.744776 26547 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:10.741770 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:10.813007 26469 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:14:10.814147 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:10.814961 26469 raft_consensus.cc:2393] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 32: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:10.815801 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:10.817019 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:10.817579 26469 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:10.690176  4230 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:10.710126 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:10.750969 26465 raft_consensus.cc:2368] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 31. Current term is 32.
I20260709 12:14:10.751430 26471 raft_consensus.cc:2410] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 27 because replica has last-logged OpId of term: 26 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 16.
I20260709 12:14:10.693869  4286 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:10.738687  3814 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:10.741962 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:10.730729 26548 raft_consensus.cc:1275] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:14:10.734207  4218 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:10.761168 26467 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
I20260709 12:14:10.737892  4177 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:10.740572 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 35 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:10.789002  4119 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:10.795887  4187 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:10.796160  4003 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:10.750185  4239 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:10.798638  4011 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:10.799935  4300 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:14:10.750728  4155 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:10.802770 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:10.806514  3922 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:10.807686 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:14:10.809175  4261 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.338s	user 0.004s	sys 0.001s
I20260709 12:14:10.809968  4287 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:10.811939 26546 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 33: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:14:10.756532 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.801039  4293 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 32.17, Last appended by leader: 17, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:11.117134 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:10.994246 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.998136 26547 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 20. Current term is 21. Ops: []
I20260709 12:14:11.124944 26542 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 36: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:14:11.123023 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 412964us
W20260709 12:14:10.882419 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.845613 26539 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 34.
I20260709 12:14:10.852433 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:11.129302 26543 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:10.909858 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 4131) took 1033 ms. Trace:
I20260709 12:14:11.096849 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:11.134166 26540 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:10.874183 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:11.137102 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 395221us
I20260709 12:14:11.152129 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:10.919255  3778 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.838268 26622 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:14:11.140120 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:11.159085 26619 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 33: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:11.160573 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:11.160853 27133 leader_election.cc:336] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.555s (SENT)
I20260709 12:14:11.097160  4303 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.143865 26541 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 32. Current term is 33. Ops: []
W20260709 12:14:11.037518 27193 heartbeater.cc:646] Failed to heartbeat to 127.24.179.126:41797 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.24.179.126:41797 timed out after 15.000s (SENT)
I20260709 12:14:11.144575 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:11.018342  4306 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:10.976409 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 268277us
W20260709 12:14:11.154433 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.096633  4308 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.841533  4083 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:11.156538 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 34 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:11.181207 26465 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:11.157351 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:11.157898 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:11.038165  4229 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:11.161526 26471 raft_consensus.cc:2393] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 33: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:11.027659  4042 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:11.132686 26615 rpcz_store.cc:276] 0709 12:14:09.876801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.877653 (+   852us) service_pool.cc:224] Handling call
0709 12:14:10.909490 (+1031837us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b5400346554. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:10.909752 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1904787200}
I20260709 12:14:11.138314  4307 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:14:10.981786 26468 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 34.
I20260709 12:14:10.765815  4182 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:11.196002  4218 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:11.166496 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:11.211654 26467 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 29: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:11.212174 26614 raft_consensus.cc:2410] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 34 because replica has last-logged OpId of term: 33 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 31 index: 19.
I20260709 12:14:11.167352 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:11.169474 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:11.146375  4003 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:11.218379  4003 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.219074  4003 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:11.220266  4308 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:11.173238 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:11.222806  4308 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:11.222869 26622 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:14:11.224386 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.226120  4230 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:11.174171 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.149946  4313 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.230962  4313 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:10.907172  4278 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:11.179683 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.189983 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:11.194320 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:11.168042  3814 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:11.236689  3814 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.237129  3814 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
W20260709 12:14:11.217384 26438 leader_election.cc:336] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.523s (SENT)
I20260709 12:14:11.229836  4042 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.238283  4042 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:11.238791  4286 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:11.240703  4042 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:11.240973  4239 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:11.210448  4187 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:11.243160  4187 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:11.246062 26438 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:11.250144 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 60244.7us
I20260709 12:14:11.254307 26540 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 34.
I20260709 12:14:11.261713 26543 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 37.
I20260709 12:14:11.227341  4314 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.270042 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:11.246163  4187 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:11.276031  4155 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:11.276789  4313 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:11.177742  4303 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:11.249827  4230 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:11.277719  4230 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:11.278097  4314 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:11.279143 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:11.280262  4230 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:11.280650 26472 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:11.281637  4187 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 12:14:11.250941  4218 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.283133  4218 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:11.286158  4303 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:11.256424  4307 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 31 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:11.287719  4307 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 29.21, Last appended by leader: 21, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:11.226774  4229 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:11.292364  4229 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:11.292112  4003 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:11.293027  4304 log.cc:927] Time spent T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:14:11.299439 26472 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:14:11.301321 26468 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 30 index: 16. (index mismatch)
I20260709 12:14:11.286091  4218 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:11.256870  4165 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 12:14:11.213510  4306 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:11.304414 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.310442 26543 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 30.
I20260709 12:14:11.307636 26465 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36.
I20260709 12:14:11.192212  4083 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:11.322805 26471 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31. Ops: [30.19-30.19]
I20260709 12:14:11.327747  4003 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:11.307379  3907 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 12:14:11.329363 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 176051us
I20260709 12:14:11.184271  3778 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:11.319391  3981 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.333238 26464 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:11.334811 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.320793  3922 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:11.353608 26546 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
W20260709 12:14:11.354883 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.357556 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:11.358368 26622 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 30: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:14:11.362602 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 189091us
I20260709 12:14:11.347110  4314 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:11.366907 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 183212us
W20260709 12:14:11.368799 26469 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.516s	user 0.013s	sys 0.000s
I20260709 12:14:11.369621 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:11.371217 26469 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:14:11.376698 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:11.377985 26622 raft_consensus.cc:2410] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 29 because replica has last-logged OpId of term: 28 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 15.
I20260709 12:14:11.367547  4234 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.377987 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.379541 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 39 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:11.380159 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:11.380453  4083 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:11.381548  3814 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:11.381524  4278 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:11.385890 26619 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 12:14:11.391628 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:11.387537 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:11.392531 26546 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
I20260709 12:14:11.395443 26614 raft_consensus.cc:2410] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 34 because replica has last-logged OpId of term: 32 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 30 index: 19.
I20260709 12:14:11.398943 26613 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:14:11.398854  4287 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.400141 26616 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33. Ops: []
W20260709 12:14:11.390229  4309 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.241s	user 0.002s	sys 0.000s
I20260709 12:14:11.404214 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:11.404894 26622 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 20.
I20260709 12:14:11.399847  4287 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:11.407202  4287 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:11.374017  4003 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 12:14:11.355587  3981 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:11.370550  4177 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:11.393297 26615 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 38.
I20260709 12:14:11.387079  4119 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:11.401973 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.402726 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:11.419939 27168 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:14:11.403095 26619 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: [28.17-28.17]
I20260709 12:14:11.403434  3814 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:11.404035 26618 raft_consensus.cc:2368] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33.
I20260709 12:14:11.410727 26617 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31. Ops: [28.18-30.19]
I20260709 12:14:11.408778 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.422489 26543 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 21.
I20260709 12:14:11.422647 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:11.410065 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:11.409409 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 192048us
I20260709 12:14:11.423445 26469 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 34: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:11.410895 26540 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 32 index: 21. Preceding OpId from leader: term: 34 index: 22. (index mismatch)
I20260709 12:14:11.409219 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:11.425690 26539 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:11.410451 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.437248 26545 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 34: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:11.441013 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:14:11.444613 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 93627.9us
I20260709 12:14:11.448730 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.449328 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.449536 26541 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 34.
I20260709 12:14:11.408155  4322 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.452147 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:11.458433 26438 leader_election.cc:336] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.577s (SENT)
I20260709 12:14:11.458282 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 34 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:11.460605 26613 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:14:11.460875 26471 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 36: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:11.458813 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:11.461860 26540 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 34: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:11.463065 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:11.463971 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:11.463145 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:11.468551 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:11.471643 27161 raft_consensus.cc:1240] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 23. Current term is 24. Ops: []
I20260709 12:14:11.467128 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:11.472875 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:11.475167 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 223978us
I20260709 12:14:11.474992 26473 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:14:11.404887  3778 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:11.475879 26546 raft_consensus.cc:2376] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 33. Re-sending same reply.
I20260709 12:14:11.478698 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:11.478912 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 34 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.465655 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:11.483040 27134 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:11.479624 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:11.443212  4289 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:11.486953 26545 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 36: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:11.486536 26542 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 29 index: 15. (index mismatch)
I20260709 12:14:11.486557 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.488018 26543 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 33.
I20260709 12:14:11.488636 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:11.396522  4234 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:11.490976 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:11.493275 26468 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:14:11.494381 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:11.496716 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:11.498325 26540 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:11.498870 27167 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 21.
I20260709 12:14:11.500857 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:11.490190 26439 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:11.505393 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:11.506763 27168 raft_consensus.cc:2410] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 25 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 12:14:11.508764 26465 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:14:11.509080 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.509266 26466 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 30: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:11.503163 26439 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:11.513788 26539 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
I20260709 12:14:11.508805  3907 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:14:11.516036 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:11.516755 26466 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 24.
I20260709 12:14:11.517190  3981 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:11.517660 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 39 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:11.517764 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:11.518374 26472 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 38.
I20260709 12:14:11.518851 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.519712 26541 raft_consensus.cc:2410] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 25 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 12:14:11.519622 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.517925 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:11.520668 26470 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:11.520838 26544 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 21: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:11.522629 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:11.510066 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:11.550370 26548 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 33
I20260709 12:14:11.551242 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 34 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:11.552075 26614 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:11.555258 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.556247 26539 raft_consensus.cc:2410] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 30 because replica has last-logged OpId of term: 28 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 16.
I20260709 12:14:11.556578 26545 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:14:11.557946 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 35 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.558333 26464 raft_consensus.cc:2410] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 34 because replica has last-logged OpId of term: 33 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 31 index: 19.
W20260709 12:14:11.559419 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 92419.8us
I20260709 12:14:11.559680 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:11.495668  4119 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:14:11.495379  4307 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Leader pre-election won for term 39
I20260709 12:14:11.562711 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.562587 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.568423 26540 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:14:11.558633 26541 raft_consensus.cc:2376] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 37. Re-sending same reply.
I20260709 12:14:11.562999 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.569190 26468 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:11.560724 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.569646 26543 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:14:11.571522 26544 raft_consensus.cc:2410] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 12:14:11.571841 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:11.572625 26546 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 30: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:11.572726 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:11.575563 27167 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:14:11.568858 26545 raft_consensus.cc:2376] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 34. Re-sending same reply.
I20260709 12:14:11.579290 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.521167  4326 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:11.576261  4311 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.585325 26545 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 33 index: 16. Preceding OpId from leader: term: 35 index: 17. (index mismatch)
I20260709 12:14:11.586418  4311 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:11.589090  4311 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:11.590441  3974 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.557211  4292 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:11.591154  4292 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.591038  3974 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:11.591694  4292 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:11.592285 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:11.592746 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:11.593664 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:11.595211 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:11.595932 26620 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 33.
I20260709 12:14:11.597153 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:11.597869 26467 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:14:11.596887 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:11.591204 26619 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:14:11.591589 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:11.603816 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:11.582849  4326 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 32 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:11.576884  4306 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:11.604815 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.613860 26468 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:11.604803 26545 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:11.603704  3778 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:14:11.559355  4286 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:14:11.596959 27133 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.982s (SENT) [suppressed 38 similar messages]
I20260709 12:14:11.640815 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:11.641145 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 44215.8us
I20260709 12:14:11.592285 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:11.641659 26472 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
I20260709 12:14:11.641892 27165 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:11.606890 26542 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:14:11.574978  4307 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:11.606036 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 182205us
I20260709 12:14:11.628701 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.636618  3778 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:11.646523 26615 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:14:11.645298 26541 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:14:11.647559 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:11.648656 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:11.649348 26465 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:14:11.486491  4322 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:11.651728 26438 leader_election.cc:336] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.590s (SENT)
I20260709 12:14:11.653136 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:11.653817 27168 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 33.
I20260709 12:14:11.597405  4119 raft_consensus.cc:697] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:14:11.659291 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 58422.4us
I20260709 12:14:11.655637 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:11.654112  3778 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:14:11.650935  4301 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:14:11.646998  4307 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Advancing to term 39
I20260709 12:14:11.670707 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:11.687175 26438 leader_election.cc:336] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Timed out: RequestConsensusVote RPC to 127.24.179.66:40567 timed out after 1.595s (SENT)
W20260709 12:14:11.688659 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.692539 26465 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
W20260709 12:14:11.696516  4330 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:14:11.659552  4011 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.668802  4313 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:14:11.711364 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:11.712136 26541 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:11.719831  4324 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.720515  4324 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:11.723711  4333 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:14:11.727547 26541 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 34.
W20260709 12:14:11.732474 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.704275  4182 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:11.707345  4313 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.732474 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.744053  4313 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:14:11.744299 26541 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:14:11.745795  4326 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.19, Last appended by leader: 19, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:11.746835 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:11.748924  4193 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:14:11.749599  4193 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 34 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:11.756481  4193 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 32.20, Last appended by leader: 20, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:11.759032  4332 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:14:11.760005  4119 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:11.765661  4177 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:11.770860  4234 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:11.770637  4229 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:14:11.772500  3974 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:11.671861  4286 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:11.774978 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 62738.6us
I20260709 12:14:11.726119 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:11.707398  4011 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:11.781104 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 105250us
W20260709 12:14:11.782119 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.790529 26614 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36.
I20260709 12:14:11.791409 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:14:11.742286  4334 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:14:11.815799 27165 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 34.
I20260709 12:14:11.825349 26514 leader_election.cc:400] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33.
I20260709 12:14:11.825904 26514 leader_election.cc:403] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:11.828079 26470 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 35.
I20260709 12:14:11.833192 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:11.839442 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:11.823010  4120 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:14:11.841090  4120 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:11.841574 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.848488 26614 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 38.
I20260709 12:14:11.852334 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:11.853669 26614 raft_consensus.cc:2368] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23.
I20260709 12:14:11.855908 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:11.856766 26543 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Advancing to term 35
W20260709 12:14:11.862609 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 177587us
I20260709 12:14:11.847483  4120 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:11.816138  4229 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.045s
I20260709 12:14:11.850023  4294 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:14:11.854207  4289 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.880627 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.883755 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:11.884058 26546 raft_consensus.cc:2410] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 34 because replica has last-logged OpId of term: 32 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 30 index: 19.
I20260709 12:14:11.885037 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:11.886566 26614 raft_consensus.cc:2410] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 31 because replica has last-logged OpId of term: 28 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 14.
I20260709 12:14:11.870309  4341 consensus_queue.cc:1048] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.003s
I20260709 12:14:11.887775 26543 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 35.
I20260709 12:14:11.840127  3778 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:11.894987 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:11.895753 26617 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 34.
I20260709 12:14:11.899710 26615 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 33 index: 16. Preceding OpId from leader: term: 37 index: 18. (index mismatch)
W20260709 12:14:11.901446 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 62084.2us
I20260709 12:14:11.903159 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:11.861503  4182 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 12:14:11.883787  4218 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 22, Last known committed idx: 20, Time since last communication: 0.025s
I20260709 12:14:11.907477  4311 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.002s
I20260709 12:14:11.909965  4307 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 39 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:11.910495  4337 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.039s
I20260709 12:14:11.911451 27163 raft_consensus.cc:2368] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 39 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 38. Current term is 39.
I20260709 12:14:11.913324  4307 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 39 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:11.907172  4239 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:11.917362  4239 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.917770  4239 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:11.919229 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.920038  4322 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:11.906047  4286 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:11.884582  4011 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:11.925815 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.926695 26547 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 34: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:11.928223 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.930305 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.931021 26542 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:14:11.932377 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:11.886914  4289 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:11.933308 27161 raft_consensus.cc:2410] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 25 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 12:14:11.934968  4289 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:11.935178  4303 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.935670  4303 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:11.935995 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.907742  4324 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:11.938030  4303 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:11.938828 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:11.939107 27165 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 31 index: 21. Preceding OpId from leader: term: 32 index: 22. (index mismatch)
I20260709 12:14:11.874215  4003 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 33.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.029s
I20260709 12:14:11.934070 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:11.937911 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:11.942363 26545 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 31.
W20260709 12:14:11.944052 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 79468.6us
I20260709 12:14:11.958451 26540 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 29 index: 21. Preceding OpId from leader: term: 31 index: 22. (index mismatch)
I20260709 12:14:11.954227 26546 raft_consensus.cc:2376] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26. Re-sending same reply.
I20260709 12:14:11.891111  4294 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 35 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:14:11.960790 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 59861.4us
I20260709 12:14:11.961581 26622 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 29 index: 20. Preceding OpId from leader: term: 32 index: 22. (index mismatch)
I20260709 12:14:11.974009 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 39 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:11.974820 26471 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Advancing to term 39
I20260709 12:14:11.975423 26439 leader_election.cc:400] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 39 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 38. Current term is 39.
I20260709 12:14:11.975800 26439 leader_election.cc:403] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 election: Cancelling election due to peer responding with higher term
I20260709 12:14:11.976008  4177 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.976547  4177 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:11.977629 26468 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 27 index: 20. Preceding OpId from leader: term: 31 index: 22. (index mismatch)
I20260709 12:14:11.979045 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:11.979627  4312 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:14:11.979734 26472 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 35.
I20260709 12:14:11.980144  4312 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:11.980273 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 34 index: 25 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:11.980855  4278 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:14:11.981045 27161 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 35.
I20260709 12:14:11.981516  4278 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 34 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:11.981364  4312 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 30.19, Last appended by leader: 19, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:11.981691  4294 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 33.21, Last appended by leader: 21, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:11.982563  4278 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 32.21, Last appended by leader: 21, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:11.974839 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:11.986989 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:11.987255 26622 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 30 index: 17. Preceding OpId from leader: term: 32 index: 18. (index mismatch)
I20260709 12:14:11.990293 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:11.991057 26622 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:14:11.992273 26470 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:14:11.992553 26548 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:11.988279 26616 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:14:11.998837 26616 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 31 index: 19. (index mismatch)
I20260709 12:14:11.998850 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 39 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:12.000720 26622 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Advancing to term 39
I20260709 12:14:12.010125 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:12.011549 26614 raft_consensus.cc:2410] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 36 because replica has last-logged OpId of term: 34 index: 25, which is greater than that of the candidate, which has last-logged OpId of term: 33 index: 24.
W20260709 12:14:12.019019 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 114105us
I20260709 12:14:12.019879 26514 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:12.021275 26615 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:14:12.018908 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.025542  4312 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:11.995744  4230 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election lost for term 32. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33.
I20260709 12:14:11.997938  4155 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.049352 26471 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 39.
I20260709 12:14:12.051052 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:12.032096  4165 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:12.052989 26622 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 39.
I20260709 12:14:12.030057  4011 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.025s
I20260709 12:14:12.035059  4326 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:12.057827  4326 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:12.053627  4155 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:12.060384  4326 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:12.018725  4292 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:12.052397  4177 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:12.048177  4307 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.014s
I20260709 12:14:12.062706  4292 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:12.063185 26617 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31. Ops: []
I20260709 12:14:12.060447  4155 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:11.949929 26543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "580883b917314b66883009ddb9259ac0"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "aaadfdd9ca9f424c91505f9b43876233"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:14:12.017510  4306 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 12:14:12.067986 26543 raft_consensus.cc:606] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Received request to transfer leadership to TS aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:12.067553 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.069063  4187 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:14:12.066107 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.070216 26588 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:12.072904 26543 raft_consensus.cc:614] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:12.019233  4320 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.057s
I20260709 12:14:12.051247  4182 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Leader election lost for term 38. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 39 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 38. Current term is 39.
W20260709 12:14:12.134792 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 64670.7us
I20260709 12:14:12.146637 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:12.135409 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 81467.2us
I20260709 12:14:12.133747 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:12.137431 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 69959.9us
I20260709 12:14:12.154100 26622 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 32 index: 17. Preceding OpId from leader: term: 33 index: 18. (index mismatch)
I20260709 12:14:12.117839  4311 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.156773 26513 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:12.116787  4165 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:12.152709 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 39 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:12.159512 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:12.143138  4303 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.117883  4155 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:12.145202  4192 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:12.132663  4187 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:12.071703  4292 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.082s
I20260709 12:14:12.167125 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:12.173363 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:12.174242 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.155701  4361 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:12.166441  4218 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader election won for term 38
W20260709 12:14:12.176386 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 61145.5us
I20260709 12:14:12.170228  4337 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:12.193910  4361 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.202127 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.172387  3778 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:12.218972 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:12.175625 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:12.177057 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.194413  4358 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 39 FOLLOWER]: Leader election won for term 39
I20260709 12:14:12.194602  4354 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.220520  4358 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 39 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:12.220553  4354 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:12.207082  4320 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:12.222031  4320 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:12.223062  4354 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:12.194162  4343 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:14:12.167932  4311 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:12.225183 26617 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:14:12.226241  4320 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:12.226300  4311 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:12.227617 26543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:14:12.177732  4322 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:12.231675 26543 raft_consensus.cc:606] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:14:12.235018 26543 raft_consensus.cc:614] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:12.215827  4337 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.173177  4192 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.200135  4359 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.201164  4165 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:12.237661 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:12.233379 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 59242.6us
I20260709 12:14:12.173808  4155 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:12.238641  4337 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:12.240146 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:12.221879  4358 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 37.24, Last appended by leader: 24, Current term: 39, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:12.238708  4343 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:12.206183  4218 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 38 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:14:12.232745 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55754.8us
W20260709 12:14:12.290256 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 52698.1us
I20260709 12:14:12.227052  4312 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:12.247265 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:12.292728 26622 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:12.217258  4361 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:12.259764 26615 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 32 index: 20. (index mismatch)
I20260709 12:14:12.171442  4303 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:12.263979  4239 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:12.264839 26439 leader_election.cc:400] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23.
I20260709 12:14:12.246668  4320 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:14:12.236779  4294 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:14:12.279631 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 131663us
I20260709 12:14:12.307698 26543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:14:12.308214 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:12.242806  4322 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:12.311345  4312 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:12.311194  4322 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 31.16, Last appended by leader: 16, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:12.316048  4239 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:12.302542  4083 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:12.317323  4218 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 36.23, Last appended by leader: 23, Current term: 38, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:12.282342 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:12.198454  4187 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 33.22, Last appended by leader: 22, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:12.323520  4187 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:14:12.318009  4364 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.077s	user 0.003s	sys 0.000s
W20260709 12:14:12.280993  4313 consensus_meta.cc:287] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.536s	user 0.014s	sys 0.000s
I20260709 12:14:12.291577 27133 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:12.337054 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45580us
I20260709 12:14:12.262944 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:12.337613  4011 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:14:12.300519 26439 leader_election.cc:403] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:12.337999  4011 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.338380  4011 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:14:12.338550 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 73925.2us
I20260709 12:14:12.339847 26439 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:12.341935  4278 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 22. Current term is 23.
I20260709 12:14:12.342571  4320 raft_consensus.cc:2764] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election decision vote started in defunct term 33: won
I20260709 12:14:12.342741  4278 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:14:12.343322  4320 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 12:14:12.344098  4357 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.344344  4278 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.344671  4357 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:12.344816  4278 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:12.345081  4349 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:14:12.303860  4155 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:12.308387 26543 raft_consensus.cc:606] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:14:12.347898  4278 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:12.348941 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:12.288998  4343 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.349681  4343 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:12.352061  4307 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:12.352577  4307 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.352988  4307 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:12.279889 27161 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 21.
I20260709 12:14:12.310094 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:12.330716 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:12.353932 26465 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:14:12.331295 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:12.354943 26548 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:12.332064 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:12.332224 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:12.332507 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:12.332408 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:12.332718 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:12.332814 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:12.333889 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 34 index: 25 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:12.360064 26540 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:12.285930  4192 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:12.336055 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:12.365501 26473 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:14:12.336794  4313 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:12.283968  4359 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:12.279230  4120 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:12.360139 26469 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:14:12.334988 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:12.334653 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:12.363154 26614 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:14:12.360200 26546 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:12.391587 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:12.363502 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:12.360512 26467 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 35.
I20260709 12:14:12.291697 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.380517 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.381527 26471 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
W20260709 12:14:12.283078 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 263258us
I20260709 12:14:12.387115 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:12.326408  4341 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:14:12.394776 26539 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 38.
W20260709 12:14:12.394939 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 103317us
I20260709 12:14:12.396117 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.387028 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:12.397737 26464 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
W20260709 12:14:12.400147 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 59044.6us
I20260709 12:14:12.402455 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.405289 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.399487 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:12.407943 26541 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 22: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:12.408589 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.418721 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.419490 26548 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:14:12.424592 26622 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:14:12.422210 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:12.430794 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.435528 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:12.437536 27162 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27. Ops: [26.18-26.18]
W20260709 12:14:12.439430 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 129391us
I20260709 12:14:12.433825 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.443367 26548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:14:12.444208 26548 raft_consensus.cc:606] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:14:12.446153  4292 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 30.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:14:12.447997  4187 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:14:12.398869  4083 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:12.415859  4177 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:14:12.415836  4306 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
I20260709 12:14:12.406701  4278 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:12.397655  4239 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
I20260709 12:14:12.420065  3981 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:12.459579 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:12.451540  4338 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:12.443241  4323 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:12.420245  4341 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:12.454677  4289 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:14:12.459415  4308 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:12.415642  4361 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:12.441340  3778 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:12.466114 26513 leader_election.cc:400] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 31. Current term is 32.
I20260709 12:14:12.467288 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:12.465605  4177 raft_consensus.cc:697] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:12.480198  4323 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.469880  4338 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:12.525892 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 58699.7us
I20260709 12:14:12.479341  4322 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:12.484216  4308 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.532855 26547 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 29: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:12.536737 26540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
W20260709 12:14:12.541581 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 102123us
I20260709 12:14:12.542055 26540 raft_consensus.cc:606] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:14:12.542542 26540 raft_consensus.cc:614] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:12.542462 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.535751 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:12.470654  4357 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:12.555768 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 89844.5us
I20260709 12:14:12.462608  4368 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.078s
I20260709 12:14:12.479948  4311 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 12:14:12.529280  4365 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:14:12.560483 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:12.560927 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 115641us
I20260709 12:14:12.569232 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.532768  4342 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:12.539044  4338 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:12.537716  4322 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.533591  4323 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:12.543876  4308 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:12.539353  4337 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:12.578519  4362 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:12.579388  4341 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 31.21, Last appended by leader: 21, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:12.580539  4367 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:14:12.580329  4366 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.131s
I20260709 12:14:12.581086  4361 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:12.581576  4120 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:12.582894  4359 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:12.558373  4324 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election won for term 39
W20260709 12:14:12.583443  4356 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.560s	user 0.001s	sys 0.002s
I20260709 12:14:12.613653 26439 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:12.574717  3778 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:14:12.572875  4278 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
I20260709 12:14:12.582947  4313 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:12.658176 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 96203.3us
I20260709 12:14:12.630282  4362 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.689338 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.584571  4365 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:12.584971  4342 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.643954  4294 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:12.702661 26464 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:14:12.627657  3981 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.064s
W20260709 12:14:12.711796  4369 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:14:12.656692  4292 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:12.713189  4292 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:12.715520  4292 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:12.716058  4292 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:12.651438  4322 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:12.722582  4292 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:12.725275  4292 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:12.647248  4324 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:12.727097  3981 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:12.734599  4324 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Advancing to term 39
I20260709 12:14:12.726858 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:12.736756  3981 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:12.737273  3981 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:12.737764  3981 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:12.584524  4187 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.113s
I20260709 12:14:12.709312  4234 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.738922  4234 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:12.739621  4337 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:12.741379  4234 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:12.742336  4375 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:12.742975 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.743853  4375 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:12.745771 26438 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.749159 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:12.750281  4375 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
W20260709 12:14:12.708141 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 254336us
I20260709 12:14:12.733930  4322 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:12.704429  4362 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:12.755960 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:12.756668 27161 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:14:12.757136 26438 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.759428 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:12.761336 26615 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 28 index: 15. Preceding OpId from leader: term: 30 index: 16. (index mismatch)
I20260709 12:14:12.762681 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:12.764281 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:12.765570 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:12.766248 26618 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:12.767833 26617 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 31. Current term is 32. Ops: []
W20260709 12:14:12.756840 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 345723us
I20260709 12:14:12.767865 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 39 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:12.769099 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:12.772097 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:12.771991 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:12.656723  4368 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:14:12.770015 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:12.772975 26614 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 32.
I20260709 12:14:12.770471 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:12.773957 26615 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:12.772810 27161 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:14:12.769730 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:12.773521 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:12.775203 26545 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:12.784245 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:12.784883 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.787125 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:12.790326 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:12.791512 26471 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:14:12.795934 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:12.795665 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:12.765852  4192 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:12.812991 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:12.762427  3778 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:12.767222  4313 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.634130  4303 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:12.817202 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:12.832242 27161 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 22.
I20260709 12:14:12.812901 27134 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:12.836217 26545 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:14:12.838879 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:12.772133  4359 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.795634  4375 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260709 12:14:12.853844 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44603.9us
I20260709 12:14:12.810947  4361 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:12.807809  4368 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:12.873935 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:12.652536  4177 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:12.728830  4011 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:12.796452  4119 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.068s
I20260709 12:14:12.878839  4239 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.008s
I20260709 12:14:12.776784  4307 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:12.843784  4229 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:12.907044 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:12.907829 26464 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:14:12.895113 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 110402us
I20260709 12:14:12.861956  4155 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:12.831120  4342 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:12.910444 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.857720  4389 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:14:12.885501 26618 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 34.
I20260709 12:14:12.915369 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:12.921284 26471 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:12.851691  4313 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:12.893392  4341 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Stepping down as leader of term 35
I20260709 12:14:12.903707  4366 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:14:12.864254  4359 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:12.943953 26472 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 31 index: 20. Preceding OpId from leader: term: 35 index: 22. (index mismatch)
I20260709 12:14:12.913897  4155 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:12.929940  4341 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:12.952566  4155 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:12.953619  4376 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.954523 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:12.956470  4386 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.057s
I20260709 12:14:12.957549  4386 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:14:12.957938  4386 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 31 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:12.958818  4386 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 31.20, Last appended by leader: 20, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:12.960079  4386 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:14:12.961843  4387 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 12:14:12.963064  4380 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:14:12.907341  4365 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 34.19, Last appended by leader: 19, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:12.968030 26471 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:14:12.983060 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:12.953255  4341 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 35.18, Last appended by leader: 18, Current term: 35, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:12.985774 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.983966 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 123766us
W20260709 12:14:12.992326 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 82018.5us
I20260709 12:14:12.949986  4182 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:14:12.973116  4083 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:14:12.995151  4083 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:12.996361  4192 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:12.996115  4083 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 30.16, Last appended by leader: 16, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.005873 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:13.001307 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:13.018180 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:13.006554 27161 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 32 index: 21. Preceding OpId from leader: term: 34 index: 22. (index mismatch)
I20260709 12:14:13.018924 26545 raft_consensus.cc:2376] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 31. Re-sending same reply.
I20260709 12:14:12.949105  4322 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:12.950428  4366 raft_consensus.cc:697] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:14:13.029947 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 236712us
I20260709 12:14:13.030570 26615 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:14:13.035574 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:13.039093 26464 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 27.
I20260709 12:14:13.043031 26543 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 33 index: 21. Preceding OpId from leader: term: 35 index: 22. (index mismatch)
I20260709 12:14:13.047896 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:13.032914 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:13.055902 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:13.056617 26472 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:13.066578 26615 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 37 index: 24. Preceding OpId from leader: term: 39 index: 25. (index mismatch)
I20260709 12:14:12.998569  4389 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:13.071106 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 34 index: 25 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:13.072145 27160 raft_consensus.cc:2393] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 36: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
W20260709 12:14:13.072885 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 54238.8us
I20260709 12:14:13.076696  4389 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:13.077312  4389 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:13.077837 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 84442.3us
I20260709 12:14:13.078676 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:13.080408 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:13.077332 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:13.082680 26543 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:12.954242  4376 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:13.087924 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 214100us
I20260709 12:14:12.970829  4155 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:13.095065 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:13.095746 26464 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:13.092980 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:12.947796  3778 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 30.16, Last appended by leader: 16, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.094251 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 34 index: 25 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:13.042697  4375 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.036s
I20260709 12:14:13.102334  4375 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:13.109783 26472 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 36.
I20260709 12:14:13.021912  4384 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.078s
I20260709 12:14:13.112877 26467 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 32 index: 20. Preceding OpId from leader: term: 34 index: 21. (index mismatch)
I20260709 12:14:13.089826  4322 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:14:13.083067  4326 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:13.089843  4182 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:14:13.116474 26543 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:14:13.092267  4341 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:13.124557 26464 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:14:13.095805  4307 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:13.103641  4351 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:13.125352  4343 consensus_meta.cc:287] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.773s	user 0.013s	sys 0.001s
W20260709 12:14:13.146258 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 53319.1us
I20260709 12:14:13.149742 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:12.992470  4368 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.154870 27133 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:13.122035  4229 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:13.127847  4303 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:13.128084  4182 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:13.157240 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:13.175199 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:13.197644 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:13.198820 26473 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:13.162249  4322 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:13.172631  4182 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:13.174932  4307 raft_consensus.cc:2804] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader election won for term 27
W20260709 12:14:13.225869 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55958.9us
I20260709 12:14:13.142557  4326 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.234484  4404 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 12:14:13.237890 27163 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:13.243134  4011 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:13.254585  4382 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.119s
I20260709 12:14:13.155143  4343 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.148687  4351 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.174877  4349 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.057s
W20260709 12:14:13.273522  4383 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
I20260709 12:14:13.221310  4350 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:14:13.174057  4229 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:13.127640  4366 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:13.249876  4384 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:14:13.283810 27163 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 34.
I20260709 12:14:13.291249 26473 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
I20260709 12:14:13.254045  4396 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.261783  4307 raft_consensus.cc:697] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:13.202157  3981 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:13.277127  4359 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:13.287706  4308 consensus_meta.cc:287] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.000s
W20260709 12:14:13.300854 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 133992us
W20260709 12:14:13.304087 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 128962us
I20260709 12:14:13.305948 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:13.254125  4371 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 20, Time since last communication: 0.133s
W20260709 12:14:13.306910 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 78712.6us
I20260709 12:14:13.310431 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:13.311512  4409 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:13.312076  4409 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.296149  4384 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 36 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:14:13.305190  4323 consensus_meta.cc:287] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.653s	user 0.013s	sys 0.000s
W20260709 12:14:13.395728  4403 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 12:14:13.407037  4397 log.cc:927] Time spent T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 12:14:13.407688  4351 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:13.380553  4155 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:13.315256  4187 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.094s
I20260709 12:14:13.436203  4303 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:13.436916  4303 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:13.373191  4389 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:13.408978  4384 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 33.24, Last appended by leader: 24, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:13.410724  4326 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:13.411270  4376 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:13.411998  4307 consensus_queue.cc:237] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:13.442564 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 407236us
I20260709 12:14:13.444103 27165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 1340) took 1242 ms. Trace:
W20260709 12:14:13.381254  4362 consensus_meta.cc:287] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.629s	user 0.013s	sys 0.000s
I20260709 12:14:13.413215  4413 raft_consensus.cc:2764] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election decision vote started in defunct term 28: won
I20260709 12:14:13.415053  4412 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:13.446599 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:13.446705  4362 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.447242  4412 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:13.447754  4412 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:13.449514  4362 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:13.444648 27165 rpcz_store.cc:276] 0709 12:14:12.202171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.202337 (+   166us) service_pool.cc:224] Handling call
0709 12:14:12.215183 (+ 12846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:12.478865 (+263682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:12.478918 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:13.079924 (+601006us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b2c00135838. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:14:13.080373 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 12:14:13.122418 (+ 42045us) raft_consensus.cc:1645] Marking committed up to 21
0709 12:14:13.122461 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.443625 (+321164us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54006054d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:13.443709 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:13.443771 (+    62us) raft_consensus.cc:1685] finished
0709 12:14:13.443791 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:13.444000 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20285,"raft.queue_time_us":123816,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":21854,"spinlock_wait_cycles":346969216,"thread_start_us":138793,"threads_started":2,"wal-append.queue_time_us":122972}
I20260709 12:14:13.415583  4229 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:13.305400  4322 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.16, Last appended by leader: 16, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.415969  4323 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.304744  4308 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.409003  3981 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:13.299242  4396 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.312510  4409 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:14:13.427330  4405 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:14:13.404448  4398 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election won for term 34
W20260709 12:14:13.422292  4324 consensus_meta.cc:287] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.687s	user 0.009s	sys 0.004s
I20260709 12:14:13.431803  4313 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:13.465771 26473 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:14:13.487433 26468 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 17. (term mismatch)
I20260709 12:14:13.487892 26468 pending_rounds.cc:85] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 16
I20260709 12:14:13.488238 26468 pending_rounds.cc:107] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 26.17
I20260709 12:14:13.488513 26468 raft_consensus.cc:2889] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:13.466632 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:13.466919 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:13.469478 26513 leader_election.cc:336] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 2.275s (SENT)
I20260709 12:14:13.472056 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:13.476040 26616 raft_consensus.cc:2393] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 30: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:14:13.481717 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 157967us
I20260709 12:14:13.482178 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:13.482944 26466 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 30 index: 17. Preceding OpId from leader: term: 32 index: 18. (index mismatch)
I20260709 12:14:13.485064 26465 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 32 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:13.493932 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:13.494064 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 39 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:13.495559  4398 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 34 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:13.495846 26466 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:14:13.487948 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:13.497431 26622 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: [28.19-28.19]
I20260709 12:14:13.466169 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:13.498224 26470 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:14:13.503183 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:13.504958 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:13.507256 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:13.507966 26464 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:13.496670  4398 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 32.20, Last appended by leader: 20, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.509204 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:13.478695  4230 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.474324  4323 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:13.514570 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:13.414206  4342 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.515357 26468 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
W20260709 12:14:13.497412  4338 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.867s	user 0.009s	sys 0.003s
W20260709 12:14:13.520025 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 50570us
I20260709 12:14:13.521306 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:13.523474  4357 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 12:14:13.436287  4182 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:13.527256 26513 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:13.516499  4351 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:13.497763  4324 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.565012 26464 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:14:13.566728 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:13.567354 26545 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:13.575273 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:13.562103 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:13.577546 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:13.578159 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:13.579842 26541 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 32 index: 20. Preceding OpId from leader: term: 34 index: 21. (index mismatch)
I20260709 12:14:13.556536  4366 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:13.582710 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:13.516609  4230 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.590461 26619 raft_consensus.cc:2393] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 39: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:13.537972  4338 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.561686  4351 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.596984 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:13.617825 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:13.558274  4354 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.053s
I20260709 12:14:13.562604  4357 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 12:14:13.592062  4182 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:13.594730  4386 consensus_meta.cc:287] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.634s	user 0.012s	sys 0.003s
I20260709 12:14:13.625452 26613 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: [28.16-28.16]
I20260709 12:14:13.625909 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:13.590901  4396 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:13.589921  4324 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:13.581028  4359 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:13.627702 27162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56894 (request call id 1304) took 1708 ms. Trace:
I20260709 12:14:13.594954  4343 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:13.621652  4379 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:14:13.621829 26545 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
I20260709 12:14:13.629930 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:13.632030 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:13.632375 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:13.633051 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:13.622942  4395 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.018s
I20260709 12:14:13.613469  4417 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:13.622812  4239 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:13.718868 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:13.693488 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:13.725324 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:14:13.620653  4423 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.055s	user 0.000s	sys 0.004s
I20260709 12:14:13.646988 26514 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:13.614802  4155 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:13.650025 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:13.651300 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:13.757198 26618 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 31: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:13.619966  4351 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:13.658252  4230 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:13.654629 27162 rpcz_store.cc:276] 0709 12:14:11.919741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.922520 (+  2779us) service_pool.cc:224] Handling call
0709 12:14:11.922879 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:12.438131 (+515252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.627501 (+1189370us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b540077c754. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:13.627655 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1150630272}
I20260709 12:14:13.659816  4308 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:13.786777 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 38 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:13.787627 26546 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 37.
I20260709 12:14:13.789906  4230 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.723999  4359 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.791108  4230 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:13.793757  4359 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:13.675120  4303 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:13.798678  4303 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:13.764689  4182 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.799861  4182 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:13.800685  4400 log.cc:927] Time spent T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.494s	user 0.003s	sys 0.000s
I20260709 12:14:13.804400 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:13.682104  4338 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:13.663210  4412 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.665140 26542 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:14:13.594734  4365 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.032s
I20260709 12:14:13.691864 26470 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 29. Current term is 30. Ops: []
I20260709 12:14:13.697194 26465 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 37 index: 24. Preceding OpId from leader: term: 39 index: 25. (index mismatch)
I20260709 12:14:13.683766 26547 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 21. Preceding OpId from leader: term: 33 index: 22. (index mismatch)
I20260709 12:14:13.692528 26473 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 26. Current term is 27. Ops: []
I20260709 12:14:13.680487 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:13.694525 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:13.721402 26468 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:13.821265 26472 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:13.686750 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:13.682746 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:13.719934 26548 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:13.590514  4229 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.043s
I20260709 12:14:13.733421 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 38 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:13.733718 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 100772us
I20260709 12:14:13.823135 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:13.629609 26464 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 21. Preceding OpId from leader: term: 33 index: 22. (index mismatch)
I20260709 12:14:13.745339 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:13.824082 26545 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:13.749472 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:13.824456 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:13.824719 26544 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Advancing to term 39
I20260709 12:14:13.643563  4341 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election won for term 34
W20260709 12:14:13.752307 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 105395us
I20260709 12:14:13.827363 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:13.765544 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:13.828917 26615 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 29: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:13.657627  4342 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:13.770977 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:13.777643 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:13.830130 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:13.757957  4324 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:13.783655  4415 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:13.809442 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:13.810796  4230 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:13.814706 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:13.748106  4357 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:13.822185 26540 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:13.823135 26513 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:13.737356 26616 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 35 because replica has last-logged OpId of term: 32 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 31 index: 19.
I20260709 12:14:13.825080 26464 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:13.855819 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:13.757686  4366 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:13.831079 27161 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:13.827804 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:13.666280  4409 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.856351 26539 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 35
I20260709 12:14:13.745107  4371 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.073s
I20260709 12:14:13.861449 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:13.868356 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 35 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:13.880419 26471 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:13.869922 26545 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 35.
W20260709 12:14:13.876031 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53001.9us
I20260709 12:14:13.868227 26514 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:13.888083 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:13.880554 26616 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 36.
I20260709 12:14:13.883306 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:13.835193  4177 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader pre-election won for term 38
I20260709 12:14:13.895489 26472 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 35.
I20260709 12:14:13.890044  4239 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:14:13.875718  4415 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:13.854562  4368 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.899008 26617 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31. Ops: [30.16-30.16]
I20260709 12:14:13.861411  4419 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:13.902539 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:13.903535 26464 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 35.
I20260709 12:14:13.888696  4395 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:14:13.945616 26471 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:14:13.896831 26468 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:14:13.922188 27161 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
W20260709 12:14:13.948056 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 45648.5us
I20260709 12:14:13.900856  4177 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.867398  4308 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 19, Time since last communication: 0.081s
I20260709 12:14:13.956406 26472 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:14:13.838279  4119 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.087s
I20260709 12:14:13.894797  4182 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:13.962323 26540 raft_consensus.cc:2410] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 30 because replica has last-logged OpId of term: 28 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 16.
I20260709 12:14:14.037953 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:13.963963 26539 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 35.
W20260709 12:14:14.045903 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 162691us
I20260709 12:14:13.964474  4351 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.855336  4420 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 28.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.082s
I20260709 12:14:13.952945  4419 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.953989  4368 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.988036  4415 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:13.988540  4307 consensus_queue.cc:1059] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 26.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:14:13.989257  4229 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:13.992007 26544 raft_consensus.cc:2468] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 39.
I20260709 12:14:13.894411  4359 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:13.867475  4341 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:14.000975 27168 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:14:13.998219 26545 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 29 index: 15. Preceding OpId from leader: term: 32 index: 17. (index mismatch)
I20260709 12:14:14.067350 26620 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33. Ops: [32.18-32.18]
I20260709 12:14:14.010236  4177 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:13.910770  4382 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:13.869890  4324 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:13.997435 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:13.959923  4338 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:14:14.043431 26472 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:14.045511 26468 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:14:14.054526 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 165921us
I20260709 12:14:14.084802 26472 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 31.16, Last appended by leader: 16, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:14.085479  4351 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:14.085903 26472 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:13.946461  4349 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 29.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.098s
I20260709 12:14:14.086903 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:14.088333 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:14.089797 26539 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 30 index: 19. Preceding OpId from leader: term: 31 index: 19. (term mismatch)
I20260709 12:14:14.090137 26539 pending_rounds.cc:85] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 18
I20260709 12:14:13.998354  4395 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 34 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:14.008296  4239 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:14.007069  4412 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:14.001533 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:14.047021  4357 raft_consensus.cc:2764] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election decision vote started in defunct term 29: won
I20260709 12:14:13.952710  4384 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.105s
I20260709 12:14:14.075805 26470 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:14.058166  4419 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:14.056082  4386 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.102375 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:14.147682 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:14.162374 26544 raft_consensus.cc:2393] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 25: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:14.163582 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 34 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:14.091145 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:14.116990 27161 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33. Ops: []
I20260709 12:14:14.168067 26548 raft_consensus.cc:2368] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 34. Current term is 35.
W20260709 12:14:14.099205 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.096563 26547 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 30 index: 16. Preceding OpId from leader: term: 33 index: 18. (index mismatch)
I20260709 12:14:14.090742 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:14.116214 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:14.170339 26545 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:14.145542 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:14:14.092232 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 94896.6us
I20260709 12:14:14.146174 26588 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:14.165576 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:14.093011  4408 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.670s	user 0.000s	sys 0.004s
W20260709 12:14:14.144833  4429 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:14:14.094853 26472 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 16. Preceding OpId from leader: term: 32 index: 17. (index mismatch)
I20260709 12:14:14.090345 26539 pending_rounds.cc:107] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 30.19
I20260709 12:14:14.180913 26539 raft_consensus.cc:2889] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:14.171415 26465 raft_consensus.cc:2368] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 34. Current term is 35.
I20260709 12:14:14.182922 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:14.173439 26471 raft_consensus.cc:2376] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36. Re-sending same reply.
I20260709 12:14:14.147322  4349 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:14:14.177910 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:14.156361 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 48232.9us
I20260709 12:14:14.193046 26548 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 31: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:14.193696 26540 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32. Ops: [31.16-31.16]
I20260709 12:14:14.149179  4338 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:14.191385 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:14.077797  4229 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:14.095989  4417 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:14:14.206290 26468 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:14:14.208469 27133 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:14.215247 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:14.215550 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:14.224730 27161 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:14:14.081790  4382 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:14.094189  4165 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.086s
I20260709 12:14:14.233952  4368 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:14.235067 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:14.192157  4349 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:14.236469  4349 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 29.20, Last appended by leader: 20, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:14.237373 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:14.238752 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:14.239271 26467 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:14.219681 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:14.246835 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:14.192054  4351 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election lost for term 36. Reason: could not achieve majority
I20260709 12:14:14.247483  4338 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 33.20, Last appended by leader: 20, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:14.228224 26540 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 31 index: 20. Preceding OpId from leader: term: 32 index: 20. (term mismatch)
I20260709 12:14:14.251405 26540 pending_rounds.cc:85] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 19
I20260709 12:14:14.251714 26540 pending_rounds.cc:107] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 31.20
I20260709 12:14:14.251946 26540 raft_consensus.cc:2889] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:14.096587  4341 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 31.18, Last appended by leader: 18, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:14.230654 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:14.230777 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:14.256166 26465 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 30.
I20260709 12:14:14.256425 26472 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 34.
I20260709 12:14:14.257169 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:14.232774  4370 raft_consensus.cc:2804] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:14:14.257834 26465 raft_consensus.cc:2376] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30. Re-sending same reply.
I20260709 12:14:14.233000  4382 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:14.257886 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:14.258082  4370 raft_consensus.cc:697] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:14.224046 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:14.227154  4420 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:14:14.259838 26468 raft_consensus.cc:2368] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30.
I20260709 12:14:14.257257 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:14.260001  4370 consensus_queue.cc:237] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:14.261005 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:14.261670 26465 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:14.246980 26543 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 38. Current term is 39. Ops: []
I20260709 12:14:14.261024 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:14.168213  4386 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:14.263749 26472 raft_consensus.cc:2410] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 33 because replica has last-logged OpId of term: 31 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 29 index: 15.
I20260709 12:14:14.213649  4342 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:14:14.197391 26470 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:14:14.272495 26472 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31. Ops: [28.15-30.16]
I20260709 12:14:14.288985 26468 raft_consensus.cc:1240] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27. Ops: [26.18-26.18]
I20260709 12:14:14.295284 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3886) took 1411 ms. Trace:
I20260709 12:14:14.295769 26469 rpcz_store.cc:276] 0709 12:14:12.874884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.875256 (+   372us) service_pool.cc:224] Handling call
0709 12:14:12.896249 (+ 20993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:12.951657 (+ 55408us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:14:12.954716 (+  3059us) log.cc:844] Serialized 14 byte log entry
0709 12:14:12.954909 (+   193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:12.954957 (+    48us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:14:12.955003 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.285930 (+1330927us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b54002599d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:14.285980 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:14.286131 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2857,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":18564,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":114,"spinlock_wait_cycles":126825856}
I20260709 12:14:14.302290 27162 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:14:14.311838 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:14.291711  4434 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.302258 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:14.321689 26545 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 34.
I20260709 12:14:14.328649 26539 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 32 index: 21. Preceding OpId from leader: term: 34 index: 22. (index mismatch)
I20260709 12:14:14.330111 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:14.331360 26464 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: [28.16-28.16]
I20260709 12:14:14.273453  4420 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:14.280385  4417 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:14.286767  4324 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:14.336740 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:14.337908 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:14.263878  4337 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.094s
I20260709 12:14:14.266502  4343 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.063s
I20260709 12:14:14.355255 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:14.356364 26465 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:14.424607 26614 raft_consensus.cc:3060] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:14.425462 26472 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33. Ops: [32.18-32.18]
I20260709 12:14:14.365248 26469 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:14:14.365187 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:14.427311 26545 raft_consensus.cc:2410] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 31 because replica has last-logged OpId of term: 28 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 16.
I20260709 12:14:14.368324 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:14.553049 26467 raft_consensus.cc:2410] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 36 because replica has last-logged OpId of term: 35 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 33 index: 17.
I20260709 12:14:14.284758  4395 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 32.20, Last appended by leader: 20, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:14.634822 27163 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 1306) took 1879 ms (client timeout 2038 ms). Trace:
W20260709 12:14:14.635527 27163 rpcz_store.cc:269] 0709 12:14:12.755442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.764008 (+  8566us) service_pool.cc:224] Handling call
0709 12:14:14.634550 (+1870542us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b540056bb54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:14.634728 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1087672704}
I20260709 12:14:14.355088  4359 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.282708  4239 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:14.703754 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:14.333328  4434 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:14.722000 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:14.643749  4354 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:14.644061  4311 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:14.726994 26620 raft_consensus.cc:2393] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 36: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:14.654914  4415 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:14:14.751003  4177 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.001s
I20260709 12:14:14.751768  4177 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:14.733748  4420 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:14.755375  4437 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.424s	user 0.000s	sys 0.000s
W20260709 12:14:14.756984  4442 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.385s	user 0.001s	sys 0.000s
W20260709 12:14:14.758083  4443 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.393s	user 0.000s	sys 0.000s
I20260709 12:14:14.758976  4193 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.759606  4193 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:14.761849  4193 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:14.657230  4359 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:14.766841 26468 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: [27.18-28.19]
I20260709 12:14:14.767222 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:14.767692  4440 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:14.768007 26620 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:14:14.768314  4440 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:14.768982  4177 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 38 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:14.770972  4083 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:14.774425  4359 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:14.747829 26614 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 25.
I20260709 12:14:14.776090 26618 raft_consensus.cc:1240] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 37. Current term is 38. Ops: [35.17-37.18]
W20260709 12:14:14.780326 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 443950us
I20260709 12:14:14.783963 26513 leader_election.cc:400] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 34. Current term is 35.
I20260709 12:14:14.789407 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 4169) took 1035 ms. Trace:
I20260709 12:14:14.790745 26513 leader_election.cc:403] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Cancelling election due to peer responding with higher term
W20260709 12:14:14.785702 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 417443us
I20260709 12:14:14.794519 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:14.742928  4415 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:14.791215 26621 rpcz_store.cc:276] 0709 12:14:13.754901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.959986 (+205085us) service_pool.cc:224] Handling call
0709 12:14:14.007705 (+ 47719us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:14.043740 (+ 36035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:14.043778 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:14.062018 (+ 18240us) log.cc:844] Serialized 52 byte log entry
0709 12:14:14.274184 (+212166us) raft_consensus.cc:1645] Marking committed up to 21
0709 12:14:14.787828 (+513644us) log.cc:844] Serialized 14 byte log entry
0709 12:14:14.788360 (+   532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.788446 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:14.788491 (+    45us) raft_consensus.cc:1685] finished
0709 12:14:14.788504 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:14.789320 (+   816us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39342,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":8064,"thread_start_us":645041,"threads_started":2,"wal-append.queue_time_us":299779}
I20260709 12:14:14.826434  4359 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election lost for term 34. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 34. Current term is 35.
I20260709 12:14:14.733245  4417 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 33.20, Last appended by leader: 20, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:14.829080  4386 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:14.842703 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 48313.9us
I20260709 12:14:14.819666  4357 consensus_queue.cc:1059] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.024s
I20260709 12:14:14.839468  4440 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:14.837872  4042 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.840778  4003 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:14.853300  4308 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.863947 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:14.844758  4177 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:14.869182 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 4173) took 1100 ms. Trace:
I20260709 12:14:14.872829 26621 rpcz_store.cc:276] 0709 12:14:13.768669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.852412 (+1083743us) service_pool.cc:224] Handling call
0709 12:14:14.868490 (+ 16078us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:14.868706 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:14.868746 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:14.868808 (+    62us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:14:14.868853 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.868930 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:14.869102 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:14.851850  4338 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.849272  4452 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:14.891081 26514 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:14.894906 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:14.870687  4003 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:14.900038  4003 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:14.899850  4359 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:14:14.901012 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4887) took 2049 ms. Trace:
I20260709 12:14:14.901439 26613 rpcz_store.cc:276] 0709 12:14:12.851976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.889135 (+ 37159us) service_pool.cc:224] Handling call
0709 12:14:12.889515 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:13.625937 (+736422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.900723 (+1274786us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b540009f6d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:14.900919 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1691921664}
I20260709 12:14:14.902879 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:14.904505 26613 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:14.905225 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 4176) took 1135 ms. Trace:
I20260709 12:14:14.905570 26613 rpcz_store.cc:276] 0709 12:14:13.769572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.903989 (+1134417us) service_pool.cc:224] Handling call
0709 12:14:14.904318 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:14.904919 (+   601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.905155 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:14.871218  4308 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:14.908841  4308 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:14.908950  4388 raft_consensus.cc:3055] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:14:14.894186  4311 raft_consensus.cc:3055] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:14:14.909418  4388 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:14.909722  4311 raft_consensus.cc:740] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:14.910776  4434 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:14.910993 26613 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31. Ops: []
I20260709 12:14:14.911759 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 4177) took 1141 ms. Trace:
I20260709 12:14:14.912307 26613 rpcz_store.cc:276] 0709 12:14:13.769893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.906353 (+1136460us) service_pool.cc:224] Handling call
0709 12:14:14.910791 (+  4438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:14.911506 (+   715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.911702 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:14.914909 26514 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:14.867074  4042 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:14.916400 26539 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 31 index: 19. (index mismatch)
I20260709 12:14:14.923594 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:14.924396 26539 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 34.
I20260709 12:14:14.925580 26539 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 31 index: 19. Preceding OpId from leader: term: 34 index: 21. (index mismatch)
W20260709 12:14:14.904340  4451 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:14:14.874883  4440 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:14.890134  4338 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:14.929841  4413 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.936302 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:14.912387  4155 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:14:14.877555  4177 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:14.941437  4165 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:14.934311  4452 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:14.950143 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:14.945356  4413 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:14.957391  4415 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:14.935232  4003 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.958456  4413 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:14.958461  4003 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:14.961488 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 4170) took 1206 ms. Trace:
I20260709 12:14:14.919840  4454 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:14.964048  4454 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:14.965502  4003 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:14.967842 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 4171) took 1200 ms. Trace:
I20260709 12:14:14.962950 26620 rpcz_store.cc:276] 0709 12:14:13.755247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.768765 (+1013518us) service_pool.cc:224] Handling call
0709 12:14:14.769174 (+   409us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:14.774213 (+  5039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:14.774251 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:14.775022 (+   771us) log.cc:844] Serialized 52 byte log entry
0709 12:14:14.927929 (+152907us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:14:14.927973 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.928038 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:14.961252 (+ 33214us) raft_consensus.cc:1685] finished
0709 12:14:14.961273 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:14.961419 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4395,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":152281,"threads_started":1,"wal-append.queue_time_us":183989}
I20260709 12:14:14.940338  4440 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:14.977720 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:14.979033 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:14.979566  4337 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260709 12:14:14.980199 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:14.980757 26464 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 16. Preceding OpId from leader: term: 31 index: 17. (index mismatch)
I20260709 12:14:14.980860 26620 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:14:14.975591  4155 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:14.982945  4155 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.20, Last appended by leader: 20, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:14.984230  4177 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:14.984315 26615 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 34 index: 25. Preceding OpId from leader: term: 36 index: 25. (term mismatch)
I20260709 12:14:14.986106  4165 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:14.988489 26619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 4881) took 2188 ms (client timeout 2655 ms). Trace:
I20260709 12:14:14.987715 26615 pending_rounds.cc:85] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 24
I20260709 12:14:14.976348 26587 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:14.923338  4357 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:14:14.989152 26615 pending_rounds.cc:107] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 34.25
W20260709 12:14:14.988998 26619 rpcz_store.cc:269] 0709 12:14:12.767501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.767633 (+   132us) service_pool.cc:224] Handling call
0709 12:14:14.951992 (+2184359us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b5400196254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:14.952138 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1887727488}
I20260709 12:14:14.991194 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:14.992328 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:14.992949 26540 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:14.940455  4239 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 30.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.053s
I20260709 12:14:14.994477  4464 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:14:14.994966  4464 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:14.989854  4165 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:14.995944  4464 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 32.18, Last appended by leader: 18, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:14.997094  4464 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:14.997702  4229 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:14.988008  4434 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.008s
I20260709 12:14:14.963253  4042 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:15.000703 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:15.002589 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:14.999850 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:14.990496 26615 raft_consensus.cc:2889] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:15.005892 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:14.979590  4440 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:15.013949  4454 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:15.007843  4434 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:14:15.001623  4229 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:14:15.001101  4003 raft_consensus.cc:2804] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Leader election won for term 39
I20260709 12:14:15.013983 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4872) took 2255 ms. Trace:
I20260709 12:14:15.006786  4449 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:14:15.017891 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:15.001322  4420 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 12:14:15.024361 26540 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:14:15.024080 26622 rpcz_store.cc:276] 0709 12:14:12.758490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.759753 (+  1263us) service_pool.cc:224] Handling call
0709 12:14:12.760053 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:13.497884 (+737831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.013667 (+1515783us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b5400346a54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:15.013888 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1695180032}
I20260709 12:14:14.935992  4311 consensus_queue.cc:260] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:15.035857  4457 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:15.036266  4311 raft_consensus.cc:3060] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:15.036507  4457 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:14.991966 26614 rpcz_store.cc:276] 0709 12:14:13.767977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.776273 (+1008296us) service_pool.cc:224] Handling call
0709 12:14:14.776654 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:14.777096 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:14:14.777125 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:14.777660 (+   535us) log.cc:844] Serialized 52 byte log entry
0709 12:14:14.937396 (+159736us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:14:14.937437 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.937503 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:14.967541 (+ 30038us) raft_consensus.cc:1685] finished
0709 12:14:14.967578 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:14.967774 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":232,"raft.queue_time_us":2536,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":2188,"thread_start_us":117388,"threads_started":1,"wal-append.queue_time_us":171433}
I20260709 12:14:15.011240  4239 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
I20260709 12:14:15.034953 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:15.038729  4338 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:15.039340  4362 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.039907 26622 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 34 index: 19. Preceding OpId from leader: term: 36 index: 20. (index mismatch)
I20260709 12:14:15.039888  4362 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.051666 27166 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1608) took 1078 ms. Trace:
I20260709 12:14:15.052205 27166 rpcz_store.cc:276] 0709 12:14:13.972776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.972931 (+   155us) service_pool.cc:224] Handling call
0709 12:14:13.973237 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:14.236373 (+263136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:14.236409 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:14.236455 (+    46us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:14:14.236491 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.051393 (+814902us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54005c30d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:15.051446 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:15.051594 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604666752}
I20260709 12:14:15.055562  4454 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.056161  4454 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.059084 26620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1815) took 1017 ms. Trace:
I20260709 12:14:15.059535 26620 rpcz_store.cc:276] 0709 12:14:14.042037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.981568 (+939531us) service_pool.cc:224] Handling call
0709 12:14:14.981879 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:14.987895 (+  6016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:14.987938 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:14.988055 (+   117us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:14:14.988092 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.058853 (+ 70761us) spinlock_profiling.cc:243] Waited 5.79 ms on lock 0x7b540009f1d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:15.058901 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:15.059027 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13327744}
I20260709 12:14:15.060405  4003 raft_consensus.cc:697] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 39 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:15.015887  4434 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:15.061266  4434 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:15.061424  4003 consensus_queue.cc:237] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 37.24, Last appended by leader: 24, Current term: 39, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.065196  4239 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 27.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:15.066200  4239 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:14:15.066563  4239 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:15.067431  4239 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.19, Last appended by leader: 19, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.068981  4294 raft_consensus.cc:3055] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:14:15.069445  4294 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:15.070477  4294 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:15.069918  4460 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.002s
I20260709 12:14:15.071765  4294 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:15.074836  4165 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:15.017593  4229 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:15.076866 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4889) took 1493 ms. Trace:
I20260709 12:14:15.036844 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:15.077315 26617 rpcz_store.cc:276] 0709 12:14:13.583515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.583653 (+   138us) service_pool.cc:224] Handling call
0709 12:14:13.613020 (+ 29367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:13.948802 (+335782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.076584 (+1127782us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b540037ad54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:15.076803 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":657137408}
I20260709 12:14:15.087402  4306 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:14:15.087954  4306 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:14:15.025205  4419 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.853s	user 0.009s	sys 0.005s
I20260709 12:14:15.089187  4306 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.20, Last appended by leader: 20, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:15.090616  4457 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:15.085969  4409 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:15.093668 26615 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: []
I20260709 12:14:15.093274  4239 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:15.098954  4306 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:14:15.102617 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 65922.6us
I20260709 12:14:15.076936 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 34 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:15.103883 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:15.123534 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:15.130730  4460 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:15.131461  4460 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.132073 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:15.133868  4460 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:15.135169 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:15.133803 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.137413 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:15.114018  4343 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:14:15.138352 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:15.099900  4386 consensus_queue.cc:1059] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 28.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 12:14:15.089188  4419 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.149442 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:15.149772 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:15.156036 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:15.158785 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:15.167303  4362 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:15.146270  4455 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:15.175295  4165 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:15.176800 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.176887  4366 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:14:15.179252 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:15.179955 27161 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:14:15.180827 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:15.181540 26616 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 33. Current term is 34. Ops: [33.18-33.18]
I20260709 12:14:15.182636 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 38 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:15.185943 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 40 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:14:15.124791  4342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.008s	sys 0.007s
I20260709 12:14:15.188064 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:15.190224 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:15.177474  4366 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:15.191272 26540 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:14:15.184134  4230 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:15.193400  4230 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:15.195147  4366 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 30.16, Last appended by leader: 16, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.196666  4366 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:14:15.198933 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 896745us
I20260709 12:14:15.201849  4230 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:15.177510  4419 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:15.203963  4445 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:15.204869  4445 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:15.205425  4445 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.207823  4320 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.208364  4320 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.211804 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 4166) took 1458 ms. Trace:
I20260709 12:14:15.212352 26618 rpcz_store.cc:276] 0709 12:14:13.753526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.891241 (+137715us) service_pool.cc:224] Handling call
0709 12:14:13.947115 (+ 55874us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:14.778986 (+831871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.211498 (+432512us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54001f5ed4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:15.211739 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1905542528}
I20260709 12:14:15.213492  4292 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.214079  4292 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:15.187460  4342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.008s	sys 0.007s
I20260709 12:14:15.217242  4342 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:15.217947 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 34 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:15.221067 26467 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 36.
I20260709 12:14:15.221401 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4918) took 1020 ms. Trace:
I20260709 12:14:15.222539  4326 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.223102  4326 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:15.224202 26546 raft_consensus.cc:1275] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 18. (term mismatch)
I20260709 12:14:15.224267  4239 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 28.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:15.225298  4326 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:15.225592  4239 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:14:15.226016  4239 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:15.226156 26464 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 30 index: 17. (index mismatch)
I20260709 12:14:15.227823 26466 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 33 index: 20. Preceding OpId from leader: term: 35 index: 21. (index mismatch)
I20260709 12:14:15.228704  4376 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.229262  4376 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:15.216180  4292 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:15.231159 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 38 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:15.218182  4342 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.232726 26469 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 18. Preceding OpId from leader: term: 34 index: 19. (index mismatch)
W20260709 12:14:15.234069 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.156433  4343 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:14:15.236286 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 56473.4us
I20260709 12:14:15.236461 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:15.224742 26546 pending_rounds.cc:85] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 17
I20260709 12:14:15.227000  4239 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.236418 27166 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 12:14:15.237051 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:15.221939 26472 rpcz_store.cc:276] 0709 12:14:14.201561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.289843 (+ 88282us) service_pool.cc:224] Handling call
0709 12:14:14.425094 (+135251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:14.426052 (+   958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.221218 (+795166us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54000f41d0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:15.221342 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310096256}
I20260709 12:14:15.237248 26546 pending_rounds.cc:107] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 26.18
W20260709 12:14:15.236305 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.238112 26546 raft_consensus.cc:2889] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:15.238243 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:15.211635 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:15.240404 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:15.242141 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:15.244547 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:15.245555 26465 raft_consensus.cc:2393] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 30: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:15.246301 26438 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:15.247500 26464 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 31 index: 18. Preceding OpId from leader: term: 36 index: 20. (index mismatch)
I20260709 12:14:15.248107 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:15.249924 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.252404 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:15.254374 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:15.255913  4003 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:14:15.257349  4306 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.257225 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:15.258128 26467 raft_consensus.cc:2393] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 27: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:15.258816  4306 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.259326  4341 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:14:15.259894  4341 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:15.261104  4306 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:15.260759  4341 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.261876  4419 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:14:15.262527  4239 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:15.263693 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 35 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:15.264549 26547 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 36: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:15.264993 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3964) took 1019 ms. Trace:
I20260709 12:14:15.265303 26547 rpcz_store.cc:276] 0709 12:14:14.245538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.263400 (+1017862us) service_pool.cc:224] Handling call
0709 12:14:15.264934 (+  1534us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:15.266733  4003 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:15.266942  4343 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.15, Last appended by leader: 15, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.267796  4003 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 30.17, Last appended by leader: 17, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:15.268868 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:15.269323 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.272498 26588 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:15.273909 26588 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:15.278877 27168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1606) took 1306 ms. Trace:
I20260709 12:14:15.275323  4042 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:15.262053 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:15.270251  4445 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:15.277956  4320 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:15.236138  4083 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.279342 27168 rpcz_store.cc:276] 0709 12:14:13.972114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.972303 (+   189us) service_pool.cc:224] Handling call
0709 12:14:14.000700 (+ 28397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:14.073525 (+ 72825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.278659 (+1205134us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b540071acd0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:15.278815 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64060672}
I20260709 12:14:15.282148 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:15.291766 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:15.231444  4376 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:15.293887 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47739.6us
I20260709 12:14:15.294824 26438 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:15.295068 26439 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:15.299070 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:15.300773  4371 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:15.302992  4371 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:15.305289  4371 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:15.300751  4320 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:15.308409  4320 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:15.266054  4434 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:15.310848  4320 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:15.300767  4083 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:15.313494  4083 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:15.314735 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:15.315032  4434 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:15.299973  4042 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:15.318823 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 40 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:15.319622 26466 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 39.
W20260709 12:14:15.321516 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.324216 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:15.325058 26469 raft_consensus.cc:2410] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 12:14:15.326146 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:15.328537 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:15.329383 26464 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:14:15.330626  4440 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:15.331373 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:15.332259 26466 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:14:15.357174 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3786) took 1730 ms. Trace:
I20260709 12:14:15.358349 26541 rpcz_store.cc:276] 0709 12:14:13.626631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.627171 (+   540us) service_pool.cc:224] Handling call
0709 12:14:13.627496 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:13.794698 (+167202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:13.794745 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:13.794815 (+    70us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:14:13.794866 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.356817 (+1561951us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54002f7bd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:15.356898 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:15.357081 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383833344}
W20260709 12:14:15.363050 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 68306.5us
I20260709 12:14:15.363950 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:15.364387 26438 leader_election.cc:400] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 34. Current term is 35.
I20260709 12:14:15.365440 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:15.333729  4368 raft_consensus.cc:2764] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election decision vote started in defunct term 35: won
W20260709 12:14:15.362814 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 63863.2us
I20260709 12:14:15.369575 26439 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:15.370666 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:15.371734 26541 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 30 index: 17. (index mismatch)
I20260709 12:14:15.371935 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:15.298039  4445 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:15.333158  4398 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:15.413879 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1660) took 1087 ms. Trace:
I20260709 12:14:15.416936 26541 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:14:15.399307 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:15.368175  4083 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:14:15.422680 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.368643  3981 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:14:15.424615 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:15.397092  4326 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:15.426438  4230 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:14:15.438156 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:15.439414 26617 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 32 index: 20. Preceding OpId from leader: term: 34 index: 21. (index mismatch)
I20260709 12:14:15.414419  4404 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:15.443897 26622 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 31 index: 19. (index mismatch)
I20260709 12:14:15.444705 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:15.392900  4182 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:15.392551  4376 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.039s
W20260709 12:14:15.451891  4471 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.195s	user 0.002s	sys 0.000s
I20260709 12:14:15.455842 26618 raft_consensus.cc:1240] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 39 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 38. Current term is 39. Ops: []
I20260709 12:14:15.456430 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:15.439467  4119 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 12:14:15.459412 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:15.541536 26539 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:15.378087  4457 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.052s
W20260709 12:14:15.542681 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.543992 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:15.468632 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 40 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:15.500442 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:14:15.511138 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 66513.7us
I20260709 12:14:15.537426 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:15.394208  4377 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:15.538074 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 40 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:15.418768 26540 rpcz_store.cc:276] 0709 12:14:14.326361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.236096 (+909735us) service_pool.cc:224] Handling call
0709 12:14:15.236463 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:15.292665 (+ 56202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:15.292699 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:15.302099 (+  9400us) log.cc:844] Serialized 26 byte log entry
0709 12:14:15.411580 (+109481us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:14:15.411636 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.411753 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:15.413534 (+  1781us) raft_consensus.cc:1685] finished
0709 12:14:15.413566 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:15.413789 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22665,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":43129,"threads_started":1,"wal-append.queue_time_us":74716}
I20260709 12:14:15.441166  4326 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:15.551702 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:14:15.555301 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:15.556859 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 56523.4us
I20260709 12:14:15.560961 26513 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:15.561383 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.463191  4292 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:15.562742 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:15.564705 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:15.565847 27163 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 35: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
W20260709 12:14:15.536103  4478 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:14:15.575306 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 150760us
I20260709 12:14:15.569419 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:15.576166 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:15.578408 26540 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 15. Preceding OpId from leader: term: 31 index: 17. (index mismatch)
I20260709 12:14:15.571812 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:15.535758  4230 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:15.537281  4358 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election won for term 31
W20260709 12:14:15.598884 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 52763.1us
I20260709 12:14:15.600154 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:15.447067  4445 consensus_queue.cc:1059] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 33.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.112s
I20260709 12:14:15.480468  4155 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:15.596230 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:15.597059 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 49904.2us
I20260709 12:14:15.606374 26513 leader_election.cc:400] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30.
I20260709 12:14:15.577623  4386 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:15.566501  4326 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:15.601785 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:15.565632  4395 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:15.497804  4404 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:15.573801  4434 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:15.605556 26470 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 26. Current term is 27. Ops: []
I20260709 12:14:15.606617 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:15.614013 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:15.614672 26466 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:15.617693 26539 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:14:15.606915 26513 leader_election.cc:403] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Cancelling election due to peer responding with higher term
I20260709 12:14:15.480818  4278 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.106s
I20260709 12:14:15.608116 26465 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:14:15.603462 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:15.550859  4308 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
W20260709 12:14:15.633839 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 356704us
I20260709 12:14:15.606662  4230 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:15.623376  4482 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:14:15.610492  4155 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:15.608078  4311 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:14:15.611588  4386 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:15.646827 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:15.647183  4386 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:15.602252  4358 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:15.606009  4491 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:15.621389  4382 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.008s
I20260709 12:14:15.598762  4083 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:15.635569 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:15.636253 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:15.642683 26468 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 33 index: 24. Preceding OpId from leader: term: 36 index: 25. (index mismatch)
I20260709 12:14:15.618592  4372 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:14:15.650454 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44237.2us
I20260709 12:14:15.650341 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1813) took 1644 ms. Trace:
I20260709 12:14:15.696375 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:15.698340 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47039.9us
I20260709 12:14:15.619342  4292 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 32.22, Next index: 23, Last known committed idx: 21, Time since last communication: 0.040s
I20260709 12:14:15.696439 26621 rpcz_store.cc:276] 0709 12:14:14.006567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.930027 (+923460us) service_pool.cc:224] Handling call
0709 12:14:14.951992 (+ 21965us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:14.970526 (+ 18534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:14.970559 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:14.971666 (+  1107us) log.cc:844] Serialized 26 byte log entry
0709 12:14:15.136519 (+164853us) raft_consensus.cc:1645] Marking committed up to 23
0709 12:14:15.139606 (+  3087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.259787 (+120181us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b54003a4654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:15.259835 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:15.451276 (+191441us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:14:15.650005 (+198729us) raft_consensus.cc:1685] finished
0709 12:14:15.650039 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:15.650249 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1768,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"spinlock_wait_cycles":90553344,"thread_start_us":164486,"threads_started":1,"wal-append.queue_time_us":277000}
I20260709 12:14:15.650606  4445 raft_consensus.cc:3055] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 37 LEADER]: Stepping down as leader of term 37
I20260709 12:14:15.653875  4358 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:15.696347  4419 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election won for term 35
W20260709 12:14:15.704594  4482 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:14:15.719910 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:15.719210 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 63377.2us
I20260709 12:14:15.654057  4376 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.059s
I20260709 12:14:15.651777  4447 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 17, Time since last communication: 0.071s
I20260709 12:14:15.653349  4440 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election lost for term 29. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30.
W20260709 12:14:15.710011  4366 consensus_meta.cc:287] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.513s	user 0.012s	sys 0.000s
I20260709 12:14:15.711251  4434 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:15.666683  4377 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.082s
I20260709 12:14:15.720180  4445 raft_consensus.cc:740] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 37 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:14:15.756373 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 136167us
I20260709 12:14:15.657500  4311 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:15.749794 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:15.709703 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:15.657891  4083 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:15.725061  4419 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:15.760691 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 51135.4us
I20260709 12:14:15.725844  4446 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:14:15.700959  4343 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 12:14:15.771906 26469 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 30 index: 17. (index mismatch)
I20260709 12:14:15.702342  4398 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.050s
W20260709 12:14:15.776098 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.713292  4491 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.067s
I20260709 12:14:15.719031  4354 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 12:14:15.724905  4289 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 12:14:15.772222  4419 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:15.769615  4366 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election lost for term 36. Reason: could not achieve majority
I20260709 12:14:15.769439  4379 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.804984 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:15.784212  4306 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election won for term 34
W20260709 12:14:15.809988 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 155313us
I20260709 12:14:15.789537  4192 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:15.813112 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 108242us
I20260709 12:14:15.770680  4446 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 32 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:15.782819  4372 consensus_queue.cc:1048] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.028s
W20260709 12:14:15.836050 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:15.814635  4307 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:15.829476  4306 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:15.824478  4366 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:15.815493  4379 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.859196  4376 raft_consensus.cc:3055] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 38 LEADER]: Stepping down as leader of term 38
I20260709 12:14:15.864866  4376 raft_consensus.cc:740] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 38 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:15.855943 26466 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 35.
I20260709 12:14:15.866302  4376 consensus_queue.cc:260] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 38.24, Last appended by leader: 24, Current term: 38, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.837384  4404 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:15.836887  4453 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.005s	sys 0.024s
I20260709 12:14:15.862572  4366 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.823576  4192 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.835949  4377 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.024s
I20260709 12:14:15.812992  4445 consensus_queue.cc:260] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 37.18, Last appended by leader: 18, Current term: 37, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.861227  4289 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.876094  4289 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:15.869088  4453 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.005s	sys 0.024s
I20260709 12:14:15.886930 26547 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 21. Current term is 22. Ops: []
I20260709 12:14:15.834386  4311 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.17, Last appended by leader: 17, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.870857  4230 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:15.859822  4382 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 12:14:15.872857  4155 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:15.894263 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 79012.2us
W20260709 12:14:15.885627  4493 log.cc:927] Time spent T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:14:15.897789 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:15.899389 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:15.877532  4398 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.028s
I20260709 12:14:15.912636 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:15.854118  4446 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 32.22, Last appended by leader: 22, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:15.907923 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 87274.3us
I20260709 12:14:15.903986  4083 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:15.908268  4003 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.929563 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:15.880419  4499 consensus_queue.cc:1059] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.036s
W20260709 12:14:15.941766 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 83043.1us
I20260709 12:14:15.944332 27133 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:15.947671 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 38 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:15.951615  4230 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:15.951924  4505 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:14:15.959972  4497 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.001s
I20260709 12:14:15.960284  4505 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:15.952287  4230 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:15.961562  4505 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 29.20, Last appended by leader: 20, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:15.941188  4449 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election won for term 37
I20260709 12:14:15.963231  4449 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:15.963672  4449 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:15.964605  4230 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:15.914943  4289 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:15.965454  4289 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader election lost for term 38. Reason: could not achieve majority
I20260709 12:14:15.915577  4366 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:15.957712  4342 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.012s
I20260709 12:14:15.956898 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:15.912187  4343 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:15.922839  4379 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:15.907516  4306 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 32.17, Last appended by leader: 17, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:15.982210  4230 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:15.953473  4507 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 12:14:15.996346 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 48664.5us
I20260709 12:14:15.992175  4343 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:15.946082  4308 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 12:14:15.956668  4499 consensus_queue.cc:1243] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 39.25 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 23
I20260709 12:14:16.007133 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1810) took 2018 ms. Trace:
I20260709 12:14:16.009169 26613 rpcz_store.cc:276] 0709 12:14:13.988438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.929383 (+940945us) service_pool.cc:224] Handling call
0709 12:14:14.932914 (+  3531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:14.947413 (+ 14499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:14.947448 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:14.953541 (+  6093us) log.cc:844] Serialized 26 byte log entry
0709 12:14:15.031743 (+ 78202us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:14:15.031792 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.000562 (+968770us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5400033254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:16.000627 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:16.000680 (+    53us) raft_consensus.cc:1685] finished
0709 12:14:16.000697 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.007046 (+  6349us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3656,"raft.queue_time_us":1818,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":37427,"spinlock_wait_cycles":28337920,"thread_start_us":77749,"threads_started":1,"wal-append.queue_time_us":78100}
I20260709 12:14:16.011638 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:16.014246  4498 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:14:16.018142  4501 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:14:16.000370  4230 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.023061  4379 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:15.953346  4003 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:16.024858  4230 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:16.025679  4003 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:16.027612 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:16.028334 26513 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:16.028627 26540 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 34.
I20260709 12:14:16.029758 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:16.030876 26513 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:16.006032  4371 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:14:16.030329 26540 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:16.037082 26513 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:16.034845  4155 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:16.006176  4343 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:16.042976 26513 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:16.032694 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 77711.3us
I20260709 12:14:16.051579 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:16.058084 26540 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 35.
I20260709 12:14:16.033149  4230 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:16.036237  4379 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:16.059355 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.063409 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:16.044047  4366 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:16.043417  4371 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 35 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:16.057762  4453 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:16.063474  4003 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Leader pre-election won for term 40
I20260709 12:14:16.096350 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.104111 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:16.062721  4354 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:16.109107 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:16.060236  4343 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.036s
I20260709 12:14:16.094722  4434 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.068598  4192 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:16.117376  4371 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 33.22, Last appended by leader: 22, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:16.061764  4419 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.119726 26621 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 34. Current term is 35. Ops: [34.21-34.21]
I20260709 12:14:16.123075  4419 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:16.126204 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:16.098945  4003 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:16.130884 26546 raft_consensus.cc:2410] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 29 because replica has last-logged OpId of term: 28 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 17.
I20260709 12:14:16.134476  4003 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Advancing to term 40
W20260709 12:14:16.137516  4326 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.518s	user 0.005s	sys 0.005s
I20260709 12:14:16.106933  4308 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:14:16.138690  4510 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:14:16.068310  4358 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:16.141309  4358 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:16.146926 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.149044  4230 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:16.153354  4230 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.112021  4515 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:16.154991  4515 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.155388  4515 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:16.155750  4230 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:16.156559  4386 consensus_meta.cc:287] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.000s
I20260709 12:14:16.157013  4386 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:16.137997  4326 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.159466 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:16.129436  4504 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:14:16.162961 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.128077  4434 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:16.166469  4453 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:16.166667  4003 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:16.168061  4434 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:16.169139  4003 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 40 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:16.170105 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.170166 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.175194 26468 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:14:16.176165 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.177263 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.177819 26468 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:14:16.152621  4449 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.179297 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:16.180197 26543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3962) took 1935 ms (client timeout 2469 ms). Trace:
W20260709 12:14:16.180558 26543 rpcz_store.cc:269] 0709 12:14:14.244982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.179020 (+1934038us) service_pool.cc:224] Handling call
0709 12:14:16.180133 (+  1113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.180971  4449 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:16.181397 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.184412 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 37 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.182101 26467 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:14:16.185181 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:16.189873 26513 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:16.192428 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:16.116634  4354 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.173696  4388 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:16.164201  4504 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:16.179230  4386 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:16.194325  4155 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:16.208942 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:16.209322  4155 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:16.209756  4155 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:16.196033  4230 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:16.194557  4453 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:16.196388  4434 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:16.205595 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 96608.1us
I20260709 12:14:16.198741  4366 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:16.210382 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.222002 26467 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 34.
I20260709 12:14:16.243786 26543 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 18. Preceding OpId from leader: term: 34 index: 19. (index mismatch)
I20260709 12:14:16.215332  4504 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:16.210649  4354 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:16.212221  4349 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:16.224328  4388 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:14:16.214707  4230 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:14:16.252691 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 51917.4us
I20260709 12:14:16.256031 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:16.274710  4419 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:16.275213 26543 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 19. Preceding OpId from leader: term: 35 index: 21. (index mismatch)
I20260709 12:14:16.275499  4419 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.254505  4230 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:16.276473 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 35 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:16.277148 26543 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 36.
I20260709 12:14:16.277900  4419 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:16.282729  4519 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:14:16.284444  4354 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:16.284756 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.278151 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:16.284999  4354 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.287331  4376 raft_consensus.cc:3060] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Advancing to term 39
I20260709 12:14:16.287595 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:16.288968 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 35 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.289626 26466 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 36.
I20260709 12:14:16.225585  4434 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:16.290931 26548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3966) took 2044 ms (client timeout 1999 ms). Trace:
W20260709 12:14:16.291390 26548 rpcz_store.cc:269] 0709 12:14:14.246083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.290691 (+2044608us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:16.290835 (+   144us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:16.292454 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:16.292645  4434 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:16.293109 26548 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:14:16.292956  4155 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:16.295790  4083 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.295899  4377 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.287381  4354 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:16.296527  4377 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.296468  4083 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.298997 26548 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 30 index: 17. (term mismatch)
I20260709 12:14:16.299456 26544 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:16.299832 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:16.300150 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.303717 26548 pending_rounds.cc:85] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 16
I20260709 12:14:16.304488 26543 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:16.304643 26548 pending_rounds.cc:107] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 28.17
I20260709 12:14:16.306232 26548 raft_consensus.cc:2889] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:16.304373 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.311828 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:16.312565 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:16.313184 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:16.320932 27168 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 33: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:16.321261 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:16.317091 26548 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:14:16.323592 26548 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 29. Current term is 30. Ops: []
I20260709 12:14:16.325827 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:16.328931 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:16.331003  4308 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.003s
I20260709 12:14:16.316560  4515 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.335508 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:16.357007 26543 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 35.
I20260709 12:14:16.361853 26543 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 33 index: 20. Preceding OpId from leader: term: 35 index: 21. (index mismatch)
I20260709 12:14:16.326602  4434 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:16.368265 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:16.359560  4192 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:16.353092  4365 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.381736  4365 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:16.382721  4504 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:16.383987 26621 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 26. Current term is 27. Ops: []
I20260709 12:14:16.384580  4365 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:16.385214  4306 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:16.385310  4504 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:16.328346  4419 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.039s
I20260709 12:14:16.374814  4434 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:16.388093 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.376998  4414 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.012s
I20260709 12:14:16.379357 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:16.385743  4306 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:16.390821  4306 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:16.392486  4434 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:16.352345  4412 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election won for term 37
I20260709 12:14:16.395370  4412 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.397059 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:16.398554  4412 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:16.378160 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:16.381068 26543 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:14:16.413177  4308 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:14:16.414263  4414 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:14:16.388226  4515 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:16.401702  4192 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:16.419210  4192 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:16.367049  4377 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:16.421380 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3809) took 1395 ms. Trace:
W20260709 12:14:16.424412  4524 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:14:16.377441  4155 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:16.425673  4042 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:16.427332 26542 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 26. Current term is 27. Ops: []
I20260709 12:14:16.428264 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1657) took 2102 ms. Trace:
I20260709 12:14:16.428644 26542 rpcz_store.cc:276] 0709 12:14:14.325470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.968237 (+642767us) service_pool.cc:224] Handling call
0709 12:14:16.426813 (+1458576us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:14:16.427107 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.427916 (+   809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.428183 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27770240}
I20260709 12:14:16.433671  4042 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:16.437623 27166 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 30. Current term is 31. Ops: []
I20260709 12:14:16.421993 26545 rpcz_store.cc:276] 0709 12:14:15.025993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.270733 (+244740us) service_pool.cc:224] Handling call
0709 12:14:16.420389 (+1149656us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:14:16.420647 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.420915 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:16.420957 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:16.421020 (+    63us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:14:16.421067 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.421147 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.421299 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26663808}
I20260709 12:14:16.452350 26615 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 39. Current term is 40. Ops: []
I20260709 12:14:16.441309  4308 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:16.492710  4434 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.500774  4434 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.501756  4454 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:16.444694  4003 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 30.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.028s
I20260709 12:14:16.503201  4434 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:16.503326  4003 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:14:16.503825  4003 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:16.505153  4520 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:16.505304 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:16.505793  4520 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.504844  4308 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 32.20, Last appended by leader: 20, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.520172 27162 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:14:16.520917  4119 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.521462  4119 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:16.472092  4354 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.504824  4003 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 30.20, Last appended by leader: 20, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:16.524628 26614 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 12:14:16.530326 26614 pending_rounds.cc:85] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 15
I20260709 12:14:16.530637 26614 pending_rounds.cc:107] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 12:14:16.530952 26614 raft_consensus.cc:2889] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:16.531864  4003 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:16.527418  4520 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:16.532599  4533 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.525022 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.602510 26467 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
W20260709 12:14:16.566911 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.603539 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:16.526131  4192 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.493984  4371 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 39.25, Next index: 26, Last known committed idx: 23, Time since last communication: 0.030s
I20260709 12:14:16.532961  4230 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.617756 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.528853  4446 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:16.619786 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3812) took 1567 ms. Trace:
I20260709 12:14:16.620285 26541 rpcz_store.cc:276] 0709 12:14:15.051871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.374250 (+322379us) service_pool.cc:224] Handling call
0709 12:14:15.374658 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.418942 (+ 44284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.619512 (+1200570us) spinlock_profiling.cc:243] Waited 42 ms on lock 0x7b5400111cd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:16.619718 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96637184}
W20260709 12:14:16.613090  4530 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.085s	user 0.002s	sys 0.000s
I20260709 12:14:16.609053  4449 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:16.627174 26541 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 32 index: 18. Preceding OpId from leader: term: 33 index: 18. (term mismatch)
I20260709 12:14:16.627648 26541 pending_rounds.cc:85] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 17
I20260709 12:14:16.627921 26541 pending_rounds.cc:107] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 32.18
I20260709 12:14:16.628207 26541 raft_consensus.cc:2889] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:16.630852 26541 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 36 index: 23. Preceding OpId from leader: term: 39 index: 25. (index mismatch)
I20260709 12:14:16.632675 26548 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:16.637250 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:16.645329  4494 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.839s	user 0.001s	sys 0.003s
I20260709 12:14:16.649923 26616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54654 (request call id 4168) took 2895 ms. Trace:
I20260709 12:14:16.650501 26616 rpcz_store.cc:276] 0709 12:14:13.754166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.894500 (+140334us) service_pool.cc:224] Handling call
0709 12:14:13.894918 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:15.181949 (+1287031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.649599 (+1467650us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54003d8e54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:16.649847 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2955584384}
I20260709 12:14:16.655208 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1535) took 1053 ms. Trace:
I20260709 12:14:16.655660 26472 rpcz_store.cc:276] 0709 12:14:15.601664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.602211 (+   547us) service_pool.cc:224] Handling call
0709 12:14:15.602509 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.697050 (+ 94541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:15.697088 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:15.697132 (+    44us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:14:15.697179 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.654951 (+957772us) spinlock_profiling.cc:243] Waited 94.3 ms on lock 0x7b54003fc0d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:16.655001 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.655144 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216914816}
W20260709 12:14:16.659608  4512 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.699s	user 0.000s	sys 0.003s
I20260709 12:14:16.660812 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1663) took 1655 ms. Trace:
I20260709 12:14:16.661250 26544 rpcz_store.cc:276] 0709 12:14:15.005515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.268011 (+262496us) service_pool.cc:224] Handling call
0709 12:14:16.273847 (+1005836us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b5800003098. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0b3fc0 00007f507b09e929 00007f507b09e3d2 00007f5074615bd4
0709 12:14:16.274109 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.303849 (+ 29740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.660551 (+356702us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b54000b4d54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:16.660747 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90655360}
I20260709 12:14:16.662985 26544 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 34. Current term is 35. Ops: [34.19-34.19]
I20260709 12:14:16.664752 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.665153  4354 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:16.667868 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:16.668136  4177 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 31.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:16.668720 26472 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Advancing to term 37
W20260709 12:14:16.669040  4495 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.867s	user 0.001s	sys 0.000s
I20260709 12:14:16.669440  4177 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Stepping down as leader of term 34
I20260709 12:14:16.669898  4177 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:16.670324 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1532) took 1069 ms. Trace:
I20260709 12:14:16.634729  4414 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.036s
I20260709 12:14:16.670727 26471 rpcz_store.cc:276] 0709 12:14:15.600734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.600897 (+   163us) service_pool.cc:224] Handling call
0709 12:14:15.601237 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:15.602873 (+  1636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:15.602905 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:15.608297 (+  5392us) log.cc:844] Serialized 26 byte log entry
0709 12:14:15.724862 (+116565us) raft_consensus.cc:1645] Marking committed up to 23
0709 12:14:15.724916 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:15.724993 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:16.668438 (+943445us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:14:16.670026 (+  1588us) raft_consensus.cc:1685] finished
0709 12:14:16.670047 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.670264 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24458,"raft.queue_time_us":2056,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":5777,"spinlock_wait_cycles":15681920,"thread_start_us":115873,"threads_started":1,"wal-append.queue_time_us":148516}
I20260709 12:14:16.672744 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.673909 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.675151 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:16.675788 26471 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:16.675719  4307 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 39 LEADER]: Stepping down as leader of term 39
I20260709 12:14:16.676493  4307 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 39 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:16.677379  4307 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 39.25, Last appended by leader: 25, Current term: 39, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:16.679162  4307 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 39 FOLLOWER]: Advancing to term 40
I20260709 12:14:16.620127  4306 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.681706  4520 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 23, Time since last communication: 0.001s
W20260709 12:14:16.631815  4531 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:14:16.634558  4449 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:16.685148 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4902) took 1732 ms. Trace:
I20260709 12:14:16.685580 26614 rpcz_store.cc:276] 0709 12:14:14.952417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.037728 (+ 85311us) service_pool.cc:224] Handling call
0709 12:14:15.038082 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.531454 (+1493372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.684887 (+153433us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b540020a654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:16.685071 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3417795968}
I20260709 12:14:16.686213  4177 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 34.19, Last appended by leader: 19, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.687785  4177 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:16.666175 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:16.690682 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:16.691335 26469 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:16.692332 26614 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:16.695990  4412 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.697132  4119 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:16.611207  4533 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.705436 26471 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:14:16.706965  4083 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:16.709337 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.710551  4412 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:16.711843 26471 raft_consensus.cc:2410] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 36 because replica has last-logged OpId of term: 33 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 31 index: 19.
I20260709 12:14:16.714265 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.720180 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:16.720988 26469 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
I20260709 12:14:16.722258 26471 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:16.714780  4229 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.16, Last appended by leader: 16, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.725427 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:16.706018  4533 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:16.725574 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:16.740289 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3821) took 1613 ms. Trace:
I20260709 12:14:16.742251 26472 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 37.
I20260709 12:14:16.744360 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:16.743225 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:16.749683 26619 raft_consensus.cc:1275] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:14:16.751947 26467 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: [28.16-28.16]
I20260709 12:14:16.753573 26467 raft_consensus.cc:1275] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 38 index: 24. Preceding OpId from leader: term: 39 index: 25. (index mismatch)
I20260709 12:14:16.752447 26472 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 36. Current term is 37. Ops: [34.19-36.20]
I20260709 12:14:16.755722 26472 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 19. Preceding OpId from leader: term: 35 index: 21. (index mismatch)
I20260709 12:14:16.740767 26546 rpcz_store.cc:276] 0709 12:14:15.126827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.131803 (+1004976us) service_pool.cc:224] Handling call
0709 12:14:16.132205 (+   402us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:16.132635 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:16.132670 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:16.133371 (+   701us) log.cc:844] Serialized 52 byte log entry
0709 12:14:16.205464 (+ 72093us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:14:16.721803 (+516339us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b18002ce480. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5075c824bc 00007f5072fd048b 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f5079ad23c7 00007f50760e49a7 00007f50760f40bf
0709 12:14:16.722013 (+   210us) log.cc:844] Serialized 14 byte log entry
0709 12:14:16.722266 (+   253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.722354 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:16.725336 (+  2982us) raft_consensus.cc:1685] finished
0709 12:14:16.740023 (+ 14687us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.740220 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":105100,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":4191,"raft.queue_time_us":16486,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":743,"spinlock_wait_cycles":3655936,"thread_start_us":135762,"threads_started":2,"wal-append.queue_time_us":75202}
I20260709 12:14:16.748581  4454 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.758314 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:16.759066  4454 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.759934 26546 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 30.
I20260709 12:14:16.763150 26467 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 31 index: 16. (index mismatch)
I20260709 12:14:16.765980 26471 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
W20260709 12:14:16.768916 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.769238 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:16.774207 26469 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: []
I20260709 12:14:16.773177  4514 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:16.736635  4497 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.750598  4229 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:16.785059  4497 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:16.778540 26472 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 34. Current term is 35. Ops: [34.19-34.19]
I20260709 12:14:16.776854 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:16.791023 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:14:16.792795 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.794528 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:16.794757 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.776099  4083 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:14:16.842805 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44714.5us
I20260709 12:14:16.844367 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:16.834123  4498 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:14:16.798821  4193 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:14:16.799244  4307 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:16.797047  4289 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:16.832811  4354 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:16.871078 26469 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31. Ops: []
I20260709 12:14:16.870262  4434 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.002s
I20260709 12:14:16.872550 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:16.858696  4365 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.873275 26469 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:14:16.873392  4365 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.776757  4165 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.066s
I20260709 12:14:16.868983  4457 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 31.22, Next index: 23, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:14:16.832094  4368 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:16.869483  4386 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:14:16.859458  4155 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 31.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.011s
I20260709 12:14:16.789140  4514 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.885939 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1664) took 1791 ms. Trace:
I20260709 12:14:16.863873  4307 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:16.886544 26539 rpcz_store.cc:276] 0709 12:14:15.094626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.619383 (+524757us) service_pool.cc:224] Handling call
0709 12:14:15.619716 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.697206 (+ 77490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:15.697236 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:15.697271 (+    35us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:14:15.697313 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.885652 (+1188339us) spinlock_profiling.cc:243] Waited 77.3 ms on lock 0x7b54000b4354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:16.885707 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.885875 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177830144}
I20260709 12:14:16.893496 26539 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 34. Current term is 35. Ops: []
W20260709 12:14:16.897992 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 56605.7us
I20260709 12:14:16.902536 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:16.903890  4551 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:16.904489  4551 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.860071  4083 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.883764  4447 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:16.876912  4289 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:16.881012  4349 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 26.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.053s
I20260709 12:14:16.905602  4307 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:16.890476  4497 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:16.908010  4454 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:16.961527  4230 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:16.885337  4370 consensus_queue.cc:1048] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.057s
I20260709 12:14:14.944473 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:16.935415  4551 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:16.881309  4368 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:16.947777  4354 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:14:16.996243 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 120140us
W20260709 12:14:16.999253 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.010272  4514 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:17.012387 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:17.013175  4365 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:17.014494  4354 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 31.22, Last appended by leader: 22, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:17.016171  4368 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:17.018805 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:17.020020 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:17.023414 27161 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 31: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
W20260709 12:14:17.024865 26439 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.67:42217 timed out after 1.586s (SENT) [suppressed 12 similar messages]
I20260709 12:14:16.947556  4447 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:17.038688 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:17.039412 26618 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:14:16.995888  4497 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:17.043596 26539 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 31 index: 21. Preceding OpId from leader: term: 35 index: 23. (index mismatch)
I20260709 12:14:16.984103  4230 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.049s
I20260709 12:14:17.047873 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:17.048564 26539 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 27.
I20260709 12:14:17.037557  4386 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 35 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
W20260709 12:14:17.054930  4537 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 12:14:17.036605  4155 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.062978  4552 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:17.093959  4434 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:14:17.058859  4497 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:17.130861  4434 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:17.085872  4552 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.164729  4552 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:14:17.166219  4540 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260709 12:14:17.169479  4547 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.093s	user 0.000s	sys 0.002s
I20260709 12:14:17.170701 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:17.171193  4507 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 31 LEADER]: Stepping down as leader of term 31
W20260709 12:14:17.171423  4538 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:14:17.171656  4507 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:17.172008 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3830) took 1406 ms. Trace:
I20260709 12:14:17.172647  4507 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 31.22, Last appended by leader: 22, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:17.173858  4507 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:17.070273  4303 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 34.21, Next index: 22, Last known committed idx: 20, Time since last communication: 0.031s
I20260709 12:14:17.177850  4457 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 34 LEADER]: Stepping down as leader of term 34
W20260709 12:14:17.148550  4543 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.111s	user 0.002s	sys 0.000s
I20260709 12:14:17.149708 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1672) took 1296 ms. Trace:
W20260709 12:14:17.149896  4549 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:14:17.150929  4541 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 12:14:17.158008  4446 consensus_meta.cc:287] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.000s
I20260709 12:14:17.211393 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:17.212190 26471 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 27.
I20260709 12:14:17.213423 26466 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
W20260709 12:14:17.163245  4548 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:14:17.164269  4042 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.722s	user 0.011s	sys 0.007s
W20260709 12:14:17.144326 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 52570us
W20260709 12:14:17.179091 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 154270us
I20260709 12:14:17.172386 26548 rpcz_store.cc:276] 0709 12:14:15.765592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.325189 (+559597us) service_pool.cc:224] Handling call
0709 12:14:16.326682 (+  1493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.643626 (+316944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.171756 (+528130us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b5400140354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:17.171948 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":703263488}
I20260709 12:14:17.171458 26473 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:17.129249  4368 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:14:17.170810  4539 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:14:17.085688  4155 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:17.132089  4514 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:17.200341  4555 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.198948  4292 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:17.207530  4192 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:17.222880 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:17.249425 26467 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:14:17.251157 26467 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:17.251215 26473 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
I20260709 12:14:17.188314  4357 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.225783 26464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3927) took 1895 ms. Trace:
I20260709 12:14:17.202504 26542 rpcz_store.cc:276] 0709 12:14:15.853428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.431415 (+577987us) service_pool.cc:224] Handling call
0709 12:14:16.431929 (+   514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:16.432565 (+   636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:16.432624 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:16.433349 (+   725us) log.cc:844] Serialized 26 byte log entry
0709 12:14:16.760823 (+327474us) spinlock_profiling.cc:243] Waited 6.11 ms on lock 0x7b180029dfa0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fbb2a6 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9
0709 12:14:16.965096 (+204273us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:14:16.965164 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.965272 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:17.149283 (+184011us) raft_consensus.cc:1685] finished
0709 12:14:17.149314 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.149633 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1099,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":14161920,"thread_start_us":202944,"threads_started":1,"wal-append.queue_time_us":705580}
I20260709 12:14:17.201548  4230 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.236359 26622 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: [28.16-28.16]
I20260709 12:14:17.253681 26464 rpcz_store.cc:276] 0709 12:14:15.330848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.333191 (+  2343us) service_pool.cc:224] Handling call
0709 12:14:15.333623 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:15.334285 (+   662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:15.334330 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:15.335705 (+  1375us) log.cc:844] Serialized 26 byte log entry
0709 12:14:16.667642 (+1331937us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b180027afc0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:14:16.881058 (+213416us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:14:16.881116 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.881186 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:17.212997 (+331811us) raft_consensus.cc:1685] finished
0709 12:14:17.213017 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.225675 (+ 12658us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":121,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":20030,"spinlock_wait_cycles":10932096,"thread_start_us":210511,"threads_started":1,"wal-append.queue_time_us":1624343}
I20260709 12:14:17.238296 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:17.245357 26619 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: []
I20260709 12:14:17.200897  4457 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 34 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:14:17.265960 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.269493 26618 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 28 index: 20. Preceding OpId from leader: term: 29 index: 21. (index mismatch)
I20260709 12:14:17.272212 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:17.267220 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:17.274266 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:17.275000 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:17.228257  4453 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election won for term 36
W20260709 12:14:17.275802 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 215186us
I20260709 12:14:17.277150 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:17.277419 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:17.279718 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:17.280834 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:17.285456 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:17.286866 26545 raft_consensus.cc:2393] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 35: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:17.288836 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:17.289543 26619 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:14:17.289806 26545 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 33. Current term is 34. Ops: [32.17-33.18]
I20260709 12:14:17.291211 26622 raft_consensus.cc:2410] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 35 because replica has last-logged OpId of term: 34 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 31 index: 18.
I20260709 12:14:17.291996 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:17.281003  4434 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 30.18, Last appended by leader: 18, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:17.307236  4434 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:17.293335 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:17.307790  4326 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:17.308914  4358 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:14:17.309494  4358 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:17.296465 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:17.283141  4508 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:14:17.297860 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 37 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:17.279668  4538 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:14:17.310361  4358 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:17.299279 26471 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31. Ops: [28.17-30.18]
W20260709 12:14:17.311700  4560 log.cc:927] Time spent T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:14:17.311764  4358 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:17.271876  4446 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:17.312937 26619 raft_consensus.cc:2393] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 38: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:17.315493 26545 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 34. Current term is 35. Ops: [32.20-34.21]
I20260709 12:14:17.316200  4557 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:17.316798  4557 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:17.318127 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:17.275768  4289 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:17.227805  4042 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:17.204272  4386 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 31.18, Last appended by leader: 18, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:17.257133  4514 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:17.302150 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:17.320058 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:17.321499 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:17.325717 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:17.232769  4368 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:17.329769 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:17.337661 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:17.310776  4508 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.332473 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:17.287921  4506 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:17.283254  4554 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260709 12:14:17.298316  4229 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:17.262284  4292 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:17.299336  4083 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:17.263214  4357 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:17.257200  4555 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:17.348873 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:17.343444 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:17.317723  4557 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 31.21, Last appended by leader: 21, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:17.268376  4230 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:17.356140 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3835) took 1105 ms. Trace:
I20260709 12:14:17.364487 26543 rpcz_store.cc:276] 0709 12:14:16.251157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.604822 (+353665us) service_pool.cc:224] Handling call
0709 12:14:16.605270 (+   448us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:16.611949 (+  6679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:16.611995 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:16.617116 (+  5121us) log.cc:844] Serialized 52 byte log entry
0709 12:14:16.793880 (+176764us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:14:16.793946 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.794068 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:17.355808 (+561740us) raft_consensus.cc:1685] finished
0709 12:14:17.355837 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.356056 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6113,"raft.queue_time_us":6743,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":4193,"thread_start_us":152430,"threads_started":1,"wal-append.queue_time_us":234160}
I20260709 12:14:17.283576  4165 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 20, Time since last communication: 0.047s
I20260709 12:14:17.369273  4292 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:17.276723  4551 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:17.371572  4551 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:17.374804 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:17.358846 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:17.357597  4229 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.367244  4555 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:17.377317 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:17.353503  4508 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:17.375522 26619 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 29.
I20260709 12:14:17.368247  4368 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:17.379081 26545 raft_consensus.cc:2393] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 35: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:17.405870 27134 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:17.406309 27161 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 28 index: 20. Preceding OpId from leader: term: 29 index: 21. (index mismatch)
I20260709 12:14:17.381533 26544 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:14:17.418717 27161 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 30 index: 19. Preceding OpId from leader: term: 34 index: 21. (index mismatch)
W20260709 12:14:17.356777  4294 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.000s	sys 0.022s
W20260709 12:14:17.434362  4294 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.000s	sys 0.022s
W20260709 12:14:17.435423  4545 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.532s	user 0.002s	sys 0.000s
W20260709 12:14:17.436625 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 162443us
I20260709 12:14:17.437484 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1542) took 1793 ms. Trace:
I20260709 12:14:17.439225 26545 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:17.437934 26465 rpcz_store.cc:276] 0709 12:14:15.643783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.653078 (+  9295us) service_pool.cc:224] Handling call
0709 12:14:15.653467 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:15.698994 (+ 45527us) raft_consensus.cc:1534] Early marking committed up to index 20
0709 12:14:15.713925 (+ 14931us) log.cc:844] Serialized 14 byte log entry
0709 12:14:16.431597 (+717672us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b180046ae60. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:14:16.760317 (+328720us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b180046ae60. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a23a 00007f50760e4a2a
0709 12:14:16.885518 (+125201us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:16.886063 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:14:16.886205 (+   142us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:14:16.886239 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.886305 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:17.434748 (+548443us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:14:17.437238 (+  2490us) raft_consensus.cc:1685] finished
0709 12:14:17.437263 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.437419 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62234,"prepare.queue_time_us":14745,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":6131,"raft.queue_time_us":48153,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":23990,"spinlock_wait_cycles":97275776,"thread_start_us":121080,"threads_started":1,"wal-append.queue_time_us":1149822}
I20260709 12:14:17.440667 26471 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: [29.18-29.18]
I20260709 12:14:17.446444  4449 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:17.448066 27162 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 1318) took 2446 ms (client timeout 1596 ms). Trace:
I20260709 12:14:17.448796 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:17.449162 27166 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31. Ops: []
I20260709 12:14:17.449563 27163 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:14:17.433717 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:17.446444 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3810) took 2395 ms. Trace:
I20260709 12:14:17.450840 26588 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:17.451004 26547 rpcz_store.cc:276] 0709 12:14:15.051219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.315838 (+264619us) service_pool.cc:224] Handling call
0709 12:14:15.316174 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.891005 (+574831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.446143 (+1555138us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54003980d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:17.446325 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304222080}
I20260709 12:14:17.452019  4449 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:14:17.452409  4449 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:17.452821  4449 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:14:17.448580 27162 rpcz_store.cc:269] 0709 12:14:15.002127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.002260 (+   133us) service_pool.cc:224] Handling call
0709 12:14:17.447843 (+2445583us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54006cfcd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:17.447963 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3488307456}
I20260709 12:14:17.452811  4491 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:17.454994 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1826) took 1136 ms. Trace:
I20260709 12:14:17.455122 26464 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 36. Current term is 37. Ops: [34.19-36.20]
I20260709 12:14:17.455721 26621 rpcz_store.cc:276] 0709 12:14:16.318616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.318745 (+   129us) service_pool.cc:224] Handling call
0709 12:14:16.335270 (+ 16525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.384436 (+ 49166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.454739 (+1070303us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b540009f1d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:17.454929 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111538560}
I20260709 12:14:17.370278  4447 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:17.457484 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:17.377349  4229 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:17.460558 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:17.462699 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 35 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:17.463097 26619 raft_consensus.cc:2410] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 35 because replica has last-logged OpId of term: 34 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 31 index: 18.
I20260709 12:14:17.463022 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:17.463410 26471 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:17.463747 26473 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:14:17.465494 26465 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:14:17.466176 26465 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:17.465237  4083 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:17.472048 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:17.333618  4457 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 34.21, Last appended by leader: 21, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:17.468756 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:17.474004 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:17.491438 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:17.492835 26473 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:17.494122 26473 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:14:17.478914 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:17.479926 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:17.422648  4551 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:17.424695  4368 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.357715  4506 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:17.432655  4292 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:17.484419 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:17.486547 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:17.489262 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 35 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:17.494899 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:17.506605 26539 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:17.495431 26473 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260709 12:14:17.496802 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:17.507786  4292 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:17.508255 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:17.509557 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:17.486555  4453 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:17.467211 26465 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 33.18, Last appended by leader: 18, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:17.518625 26465 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:17.503499 26464 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 17. Preceding OpId from leader: term: 33 index: 18. (index mismatch)
I20260709 12:14:17.499120 26471 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 37.
I20260709 12:14:17.514559 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:17.454979  4491 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:17.472807  4306 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:17.482024  4497 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:17.522054 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:17.535974 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:17.537081 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:17.537269 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:17.538167 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.496631  4551 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:17.520192  4562 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:14:17.576512 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:17.577440 27161 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:17.533962 26539 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 37.
I20260709 12:14:17.481488  4414 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.539633 26621 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 12:14:17.483946  4447 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:17.540498 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:17.541213 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:17.533671 26465 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 33 index: 18. Preceding OpId from leader: term: 34 index: 18. (term mismatch)
I20260709 12:14:17.546257 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:17.596449 26465 pending_rounds.cc:85] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 17
I20260709 12:14:17.551059 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:17.552989  4564 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:14:17.555827 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.557960  4365 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Stepping down as leader of term 36
W20260709 12:14:17.608544 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.542717  4182 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:17.496677  4083 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:17.563130  4042 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:17.525379  4563 consensus_queue.cc:1059] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.042s
I20260709 12:14:17.522511  4446 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:17.511543  4457 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:17.566519  4354 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:14:17.568065  4491 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:17.607577  4365 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:17.602599  4414 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:17.522558  4453 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:17.580746 26614 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 34. Current term is 35. Ops: []
I20260709 12:14:17.667165 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3848) took 1213 ms. Trace:
I20260709 12:14:17.588107 26618 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 36. Current term is 37. Ops: []
I20260709 12:14:17.588469  4306 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:14:17.592175 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:17.535640  4559 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 12:14:17.596701 26613 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:14:17.689349 26542 raft_consensus.cc:2410] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 30 because replica has last-logged OpId of term: 28 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 15.
I20260709 12:14:17.597540 26465 pending_rounds.cc:107] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 33.18
I20260709 12:14:17.689855 26465 raft_consensus.cc:2889] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:17.598944 26547 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 16. Preceding OpId from leader: term: 34 index: 18. (index mismatch)
I20260709 12:14:17.558290  4506 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:17.546347  4566 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:14:17.618546 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 79426.8us
I20260709 12:14:17.571841  4551 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:17.511341  4368 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:17.631567 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.631852  4582 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 31.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:14:17.599153  4554 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 31.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.036s
W20260709 12:14:17.636986 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:17.714378 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.714584 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:17.643474 27161 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 35.
I20260709 12:14:17.716208 26619 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 22.
I20260709 12:14:17.567821 26439 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:17.665329 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:17.666548 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:17.717962 26543 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:17.648509  4182 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.579777 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:17.669095 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 152374us
I20260709 12:14:17.616217  4447 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:17.685473 26546 rpcz_store.cc:276] 0709 12:14:16.454025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.760980 (+306955us) service_pool.cc:224] Handling call
0709 12:14:16.761328 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:16.761757 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:16.761788 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:16.762332 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 12:14:17.174191 (+411859us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b4800270258. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507b003aa1 00007f507affab37 00007f507affa9ca 00007f507b0f226f 00007f507b0f1f37 00007f507b10655c 00007f507b106508 00007f507b106488 00007f507b106443 00007f507b1056ec 00007f507a02fa96
0709 12:14:17.227415 (+ 53224us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:14:17.227460 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.227567 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:17.666808 (+439241us) raft_consensus.cc:1685] finished
0709 12:14:17.666834 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.667098 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6452,"raft.run_cpu_time_us":2486,"raft.run_wall_time_us":400199,"spinlock_wait_cycles":4854144,"thread_start_us":463717,"threads_started":1,"wal-append.queue_time_us":594325}
W20260709 12:14:17.722735 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.551975  4292 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:17.700026 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:14:17.647593  4307 consensus_meta.cc:287] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.668s	user 0.012s	sys 0.001s
I20260709 12:14:17.658993  4514 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:17.690663  4011 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:14:17.655761  4230 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:17.724280  4447 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:17.711854 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.662413  4083 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:17.740980 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1545) took 1830 ms. Trace:
W20260709 12:14:17.740276 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 160926us
W20260709 12:14:17.741637 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 173906us
I20260709 12:14:17.742045 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:17.788596 26544 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 19. Preceding OpId from leader: term: 35 index: 21. (index mismatch)
I20260709 12:14:17.700575  4354 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:17.761708 26588 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:17.747313 26547 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 29 index: 16. (term mismatch)
I20260709 12:14:17.647285  4552 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:17.790546 26547 pending_rounds.cc:85] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 15
I20260709 12:14:17.791015 26547 pending_rounds.cc:107] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 28.16
I20260709 12:14:17.791610 26547 raft_consensus.cc:2889] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:17.799669 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 99708.2us
I20260709 12:14:17.800623 26438 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:17.799551 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:17.802549 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 215697us
I20260709 12:14:17.744910 26470 rpcz_store.cc:276] 0709 12:14:15.910710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:15.910836 (+   126us) service_pool.cc:224] Handling call
0709 12:14:15.914027 (+  3191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:15.914255 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 22
0709 12:14:15.914511 (+   256us) log.cc:844] Serialized 14 byte log entry
0709 12:14:16.471093 (+556582us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b1800271d20. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:14:17.606561 (+1135468us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b1800271d20. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5075c824bc 00007f5072fd048b 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a23a
0709 12:14:17.740543 (+133982us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:17.740626 (+    83us) raft_consensus.cc:1645] Marking committed up to 22
0709 12:14:17.740695 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.740782 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.740916 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49956,"prepare.queue_time_us":1521,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":106826,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":19886,"spinlock_wait_cycles":14006272,"thread_start_us":149661,"threads_started":2,"wal-append.queue_time_us":28999,"wal-append.run_cpu_time_us":1086,"wal-append.run_wall_time_us":1044556}
I20260709 12:14:17.738296  4342 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:17.724992  4307 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:17.809193 26543 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 31.
I20260709 12:14:17.761938  4563 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:17.811590  4567 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:14:17.811798  4563 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:17.812649 26466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 3939) took 1588 ms (client timeout 1973 ms). Trace:
W20260709 12:14:17.813112 26466 rpcz_store.cc:269] 0709 12:14:16.223938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.290274 (+ 66336us) service_pool.cc:224] Handling call
0709 12:14:17.812404 (+1522130us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b540027b0d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:17.812536 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2075034368}
I20260709 12:14:17.815773  4563 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:17.816744  4445 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:17.820163  4588 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:14:17.820286 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3947) took 1571 ms. Trace:
I20260709 12:14:17.820838 26472 rpcz_store.cc:276] 0709 12:14:16.249183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.795959 (+546776us) service_pool.cc:224] Handling call
0709 12:14:16.796395 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.906246 (+109851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:16.906296 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:16.906347 (+    51us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:14:16.906417 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.819964 (+913547us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54001fead4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:17.820048 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.820212 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252020096}
I20260709 12:14:17.822685 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 40 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:17.824626 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:17.826871  3778 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Leader election lost for term 40. Reason: could not achieve majority
I20260709 12:14:17.791771  4357 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:17.820853  4588 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:17.829761  4558 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:17.829291  4588 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 34.21, Last appended by leader: 21, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:17.788849  4582 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:17.746454  4292 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 34 LEADER]: Stepping down as leader of term 34
W20260709 12:14:17.848109 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47556.5us
I20260709 12:14:17.743661  4326 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:17.850765 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:17.851372 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1548) took 1126 ms. Trace:
I20260709 12:14:17.851953 26469 rpcz_store.cc:276] 0709 12:14:16.724624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.874043 (+149419us) service_pool.cc:224] Handling call
0709 12:14:16.877378 (+  3335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:16.884430 (+  7052us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:14:16.884477 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:16.885162 (+   685us) log.cc:844] Serialized 52 byte log entry
0709 12:14:17.091640 (+206478us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:14:17.091684 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.091757 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:17.851001 (+759244us) raft_consensus.cc:1685] finished
0709 12:14:17.851038 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.851260 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":143,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":42816,"thread_start_us":131060,"threads_started":1,"wal-append.queue_time_us":295816}
I20260709 12:14:17.743084  4011 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
W20260709 12:14:17.855554 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 56108.9us
I20260709 12:14:17.856532 26439 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:17.835932 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:17.857846 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:17.858165 27168 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 34. Current term is 35. Ops: []
I20260709 12:14:17.859757 26542 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 16. Preceding OpId from leader: term: 31 index: 16. (term mismatch)
I20260709 12:14:17.860167 26542 pending_rounds.cc:85] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 15
I20260709 12:14:17.860415 26542 pending_rounds.cc:107] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 30.16
I20260709 12:14:17.860782 26542 raft_consensus.cc:2889] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:17.861465 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:17.798280  4354 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:17.740686  4182 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:17.830476  4083 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:14:17.793620  4554 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.063s
I20260709 12:14:17.842624  4520 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:17.841427  4514 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.885129 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:17.885917 26469 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
W20260709 12:14:17.885351 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.794305  4581 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.075s
I20260709 12:14:17.845094  4292 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 34 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:14:17.894263 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 172608us
W20260709 12:14:17.860219  4507 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.686s	user 0.015s	sys 0.000s
I20260709 12:14:17.875838  4515 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:14:17.886184 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:17.896652 26472 raft_consensus.cc:2410] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 40 because replica has last-logged OpId of term: 38 index: 24, which is greater than that of the candidate, which has last-logged OpId of term: 36 index: 23.
I20260709 12:14:17.864388  4447 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:17.867019  4446 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
I20260709 12:14:17.897689 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:17.886173 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:17.899068 26514 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:17.842278  4342 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:17.891027  4434 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.583s	user 0.012s	sys 0.002s
I20260709 12:14:17.898061 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:17.909044 27160 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
I20260709 12:14:17.911923 26469 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:14:17.835794  4558 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:17.918802 26466 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 31 index: 22. Preceding OpId from leader: term: 32 index: 23. (index mismatch)
I20260709 12:14:17.891422  4582 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:14:17.887118  4083 raft_consensus.cc:697] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:17.889789  4306 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:14:17.888635  4585 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:17.920140 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:17.926381 26548 raft_consensus.cc:2410] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 31 because replica has last-logged OpId of term: 30 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 16.
I20260709 12:14:17.925863 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:17.927938 26514 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:14:17.930773  4580 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:14:17.930940  4454 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:14:17.931430  4454 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:17.890216  4514 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:17.938519 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:17.935087 26439 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:17.924451  4592 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:17.956159 26439 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:17.957329 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:17.935880  4515 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader election won for term 37
I20260709 12:14:17.944790  4192 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 12:14:17.928699  4230 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.018s
I20260709 12:14:17.937239  4434 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:17.964447  4083 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:17.939953  4357 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:17.965971  4581 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:17.942925  3778 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 18, Time since last communication: 0.024s
I20260709 12:14:17.935549  4292 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 34.21, Last appended by leader: 21, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:17.942740  4306 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:17.967202  4354 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:17.932749  4587 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:17.968068  4182 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:17.970619  4585 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 31.19, Next index: 20, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:14:18.003285  4585 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:14:18.003597  4514 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:18.003710  4585 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:14:17.990854  4506 consensus_queue.cc:1175] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aaadfdd9ca9f424c91505f9b43876233" responder_term: 35 status { last_received { term: 32 index: 20 } last_committed_idx: 20 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 34. Current term is 35. Ops: [34.21-34.21]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:14:17.977218 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:17.963800  4307 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:18.006328  4306 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.007179 27166 raft_consensus.cc:2410] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 12:14:18.002286  4182 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.007s
I20260709 12:14:18.010213  4326 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:14:18.010641  4326 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:17.937521  4520 consensus_queue.cc:1048] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 23, Time since last communication: 0.046s
I20260709 12:14:17.979015 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:18.034713 26466 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
I20260709 12:14:17.979414 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:18.036028 26472 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:17.981575 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:18.037703 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 56227.5us
I20260709 12:14:17.936697  4414 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:17.945039  4386 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:14:17.934418  4557 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.026s
I20260709 12:14:17.952567  4579 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:17.995586  4342 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:18.000969 26470 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 31 index: 18. Preceding OpId from leader: term: 35 index: 19. (index mismatch)
W20260709 12:14:18.001582  4550 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.843s	user 0.005s	sys 0.005s
I20260709 12:14:18.004843  4585 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 31.19, Last appended by leader: 19, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:17.976061 26514 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:17.960652  4368 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:17.980715 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:18.018335 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:18.031652 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 84604.3us
I20260709 12:14:17.923476  4011 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:17.968091  4590 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:17.980971  4582 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:17.986358  4357 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.011682  4326 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 30.21, Last appended by leader: 21, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:18.061275 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 94793.9us
I20260709 12:14:18.044598  4552 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:18.065675 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3851) took 1386 ms. Trace:
I20260709 12:14:18.041751  4520 consensus_queue.cc:1243] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 38.24 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 23
I20260709 12:14:18.043414  4386 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:18.094705 26514 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:18.103253 26472 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
W20260709 12:14:18.103662 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.064309 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:14:18.069435  4508 consensus_meta.cc:287] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.644s	user 0.008s	sys 0.004s
I20260709 12:14:18.141707 27162 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
W20260709 12:14:18.142619 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 48047.5us
I20260709 12:14:18.145659 26514 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:18.146920 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:18.148619 26514 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:18.149703  4572 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:18.066437  4434 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:18.064745  4515 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:18.073158  4357 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:18.150445  4354 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:18.093374 26541 rpcz_store.cc:276] 0709 12:14:16.679060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.786202 (+107142us) service_pool.cc:224] Handling call
0709 12:14:16.786538 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:16.786934 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:14:16.787283 (+   349us) log.cc:844] Serialized 14 byte log entry
0709 12:14:17.440267 (+652984us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:17.440789 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 12:14:17.440938 (+   149us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:14:17.440969 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.441031 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:18.001238 (+560207us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b24002b33e8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072e739c4 00007f5072e71acb 00007f507302cdc9 00007f507302ca55 00007f507302c09d 00007f5075c5e10e 00007f5075c7588c 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221
0709 12:14:18.058105 (+ 56867us) raft_consensus.cc:1685] finished
0709 12:14:18.065446 (+  7341us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:18.065605 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7009,"prepare.queue_time_us":9975,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":114123,"raft.run_cpu_time_us":393,"raft.run_wall_time_us":43489,"spinlock_wait_cycles":50437760,"thread_start_us":652543,"threads_started":2,"wal-append.queue_time_us":347023}
I20260709 12:14:18.158598  4311 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 34.21, Next index: 22, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:14:18.159727  4354 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 36.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:14:18.161016  4311 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 34 LEADER]: Stepping down as leader of term 34
I20260709 12:14:18.161415  4311 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 34 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:18.162526  4569 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:14:18.162325  4311 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 34.21, Last appended by leader: 21, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:18.163166  4569 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 31 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:18.090560  4582 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:18.134310  4585 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:18.166347 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:18.164714 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:18.167407 26544 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:14:18.140890  4386 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:18.140647  4230 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:18.170194 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:18.165371  4311 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:18.171736 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:18.151635  4552 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:18.175300 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:18.171396 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:18.178792 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:18.166427  4582 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:18.190034 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:18.195955 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:18.199321 27161 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 34. Current term is 35. Ops: [32.20-34.21]
I20260709 12:14:18.201411 26438 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:18.208668 26438 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:18.152102  4508 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:18.206095  4590 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:18.211007  4368 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:18.178534  4230 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.262800  4515 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 36.20, Last appended by leader: 20, Current term: 37, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:18.268530  4449 consensus_meta.cc:287] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.815s	user 0.013s	sys 0.001s
I20260709 12:14:18.269043  4449 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:18.248296  4446 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.271173  4446 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.273420  4446 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:18.247826  4368 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:18.274501  4368 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:18.284325  4508 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:18.287811  4449 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:18.288820  4357 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.290254 26542 raft_consensus.cc:2393] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 32: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:18.291224  4446 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:18.292050  4446 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.300740  4446 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:18.302647  4357 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:18.233096  4598 log.cc:927] Time spent T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:14:18.320789  4230 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:18.212275  4569 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 29.20, Last appended by leader: 20, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:18.323738  4368 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.241930 26514 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:18.327575  4230 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:18.328941 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:18.329797 26544 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:14:18.329384 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 87544.3us
I20260709 12:14:18.310634  4590 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.309883  4386 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.335877  4590 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.338835 26514 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:18.340925  4230 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:14:18.341748  4230 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 35 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:18.342749  4230 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 34.21, Last appended by leader: 21, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:18.346098  4585 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:18.238654  4597 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:18.346820  4585 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.349511  4585 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:18.353554  4386 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:18.353878  4445 consensus_meta.cc:287] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.004s
I20260709 12:14:18.398725 26468 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 38.
I20260709 12:14:18.399435  4500 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.326156  4368 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:18.401010  4558 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:18.356024  4311 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.402845  4311 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:18.403604 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.405157  4311 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:18.405920 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:18.406316 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 342121us
I20260709 12:14:18.407333  4588 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:18.407824  4588 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.408172  4588 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:18.408952 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:18.410019  4311 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.410836 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.411583  4584 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 31.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
W20260709 12:14:18.356204  4229 consensus_meta.cc:287] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.866s	user 0.013s	sys 0.000s
I20260709 12:14:18.412182  4596 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:14:18.412899  4229 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.413867 27134 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:18.414211 26540 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 30: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:18.414598  4341 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:14:18.416589  4341 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader election won for term 37
I20260709 12:14:18.417124  4341 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:18.417269 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:18.417369  3778 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:14:18.418792  4457 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:14:18.417143  4306 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.417167  4229 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:18.419342  4457 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:18.420049  4457 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:14:18.419780  4306 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.378914  4155 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:18.422289 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.423274 26615 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 34 index: 19. Preceding OpId from leader: term: 35 index: 19. (term mismatch)
I20260709 12:14:18.423758 26615 pending_rounds.cc:85] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 18
I20260709 12:14:18.423848 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.381325  4454 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.18, Last appended by leader: 18, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.425602  4454 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:14:18.384212 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.384533  4365 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 36.20, Last appended by leader: 20, Current term: 36, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.432942  4365 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:18.434082 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:18.434451  4306 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:18.434877 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:18.435616 27162 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:14:18.403431 26548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 3983) took 1085 ms. Trace:
I20260709 12:14:18.435859  4520 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:14:18.436650  4520 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:18.436398 26548 rpcz_store.cc:276] 0709 12:14:17.317743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.317861 (+   118us) service_pool.cc:224] Handling call
0709 12:14:18.403217 (+1085356us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b54003cf854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:18.403370 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1393487104}
I20260709 12:14:18.437937  4520 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 31.21, Last appended by leader: 21, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.439477  4520 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:18.438100 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:18.442622  4596 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:14:18.444620 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:18.419550 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.410156 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:18.448567 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.449613 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:18.450888 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:18.451052  4155 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:14:18.452433  4155 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.452867  4155 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:18.387723 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 40 candidate_status { last_received { term: 38 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:18.388990 27166 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 31 index: 22. Preceding OpId from leader: term: 32 index: 23. (index mismatch)
I20260709 12:14:18.389300 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:18.455232 26547 raft_consensus.cc:2410] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 31 because replica has last-logged OpId of term: 30 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 16.
I20260709 12:14:18.390025 26513 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:18.455889 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 65961.9us
I20260709 12:14:18.456925 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:18.399926  4500 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.410656  4311 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.418274  4341 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 35.18, Last appended by leader: 18, Current term: 37, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.424078 26615 pending_rounds.cc:107] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 34.19
I20260709 12:14:18.450874 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:18.460085 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 50006.1us
I20260709 12:14:18.478513 26614 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 26. Current term is 27. Ops: []
I20260709 12:14:18.506628 26615 raft_consensus.cc:2889] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:18.483757 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.508590 26621 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
W20260709 12:14:18.480165 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.475872 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:18.510613 26618 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:18.380364  4582 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:18.461114  4544 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 1.393s	user 0.004s	sys 0.004s
I20260709 12:14:18.467103  4229 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:18.467739  4558 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:18.467504  4591 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.001s
I20260709 12:14:18.469040 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:18.470973 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:18.547290 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 76380.6us
I20260709 12:14:18.374157  4590 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:18.371783  4551 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.652s	user 0.009s	sys 0.004s
I20260709 12:14:18.385527  4447 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
W20260709 12:14:18.511755 26439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.004s	sys 0.040s
W20260709 12:14:18.553314 26439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.004s	sys 0.040s
I20260709 12:14:18.481464 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:18.554770 26546 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
W20260709 12:14:18.516726 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 65941.6us
W20260709 12:14:18.522509 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.550189 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1552) took 1789 ms. Trace:
I20260709 12:14:18.555752 26467 rpcz_store.cc:276] 0709 12:14:16.761204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.252465 (+491261us) service_pool.cc:224] Handling call
0709 12:14:17.252886 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:17.363884 (+110998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:17.363916 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:17.363961 (+    45us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:14:17.363994 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.549801 (+1185807us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400165654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:18.549881 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:18.550096 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254772096}
I20260709 12:14:18.551142 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:18.552884 26548 raft_consensus.cc:2410] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 31 because replica has last-logged OpId of term: 30 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 16.
W20260709 12:14:18.553793 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 577402us
I20260709 12:14:18.514330 26544 raft_consensus.cc:2468] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 28.
W20260709 12:14:18.515239  4453 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.814s	user 0.006s	sys 0.008s
I20260709 12:14:18.566197 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:18.566628 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.566197 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.568054 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:18.570324 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.572734 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:18.577200 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:18.578203 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.517627  4457 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:18.487622  3778 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:18.593683 26619 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 27: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:18.476145  4011 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:18.601503 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:18.515239  4229 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.515367  4497 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 40 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.547914  4357 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
W20260709 12:14:18.599759 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47581.7us
I20260709 12:14:18.602676 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:18.603336 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:18.615602 26621 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:18.604743 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.605827 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.606734 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.608512 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.618373 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.553069  4386 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:14:18.620361 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 40 candidate_status { last_received { term: 38 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.621253 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.472515  4354 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.134s
I20260709 12:14:18.623087 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.626698 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.610085  4229 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:18.602298  3778 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:18.599848  4572 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:18.561108  4551 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:18.657115  4386 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:18.657899  4591 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:18.593178  4453 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.548475  4558 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:18.666529 26614 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32. Ops: []
W20260709 12:14:18.627831  4601 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 12:14:18.674700 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 59968.7us
I20260709 12:14:18.669680 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.663429 27168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 1362) took 1760 ms. Trace:
I20260709 12:14:18.690201 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:18.690419 27168 rpcz_store.cc:276] 0709 12:14:16.902985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.903974 (+   989us) service_pool.cc:224] Handling call
0709 12:14:16.904289 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:17.858685 (+954396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.663180 (+804495us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b5400530a54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:18.663366 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2193234176}
I20260709 12:14:18.675972 26618 raft_consensus.cc:2468] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:14:18.701299 26613 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: []
I20260709 12:14:18.677515  4572 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.684024 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.706915 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:18.618703  4497 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 40 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:18.710776 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.713645 27163 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: [29.21-29.21]
I20260709 12:14:18.668165  3778 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
W20260709 12:14:18.717527  4606 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:14:18.718793 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.721364 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:18.722683 26543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1686) took 1088 ms. Trace:
I20260709 12:14:18.723091 26543 rpcz_store.cc:276] 0709 12:14:17.634779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.810013 (+175234us) service_pool.cc:224] Handling call
0709 12:14:17.810435 (+   422us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:17.856161 (+ 45726us) raft_consensus.cc:1534] Early marking committed up to index 21
0709 12:14:17.955001 (+ 98840us) log.cc:844] Serialized 14 byte log entry
0709 12:14:18.232797 (+277796us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:18.554687 (+321890us) log.cc:844] Serialized 52 byte log entry
0709 12:14:18.554872 (+   185us) raft_consensus.cc:1645] Marking committed up to 22
0709 12:14:18.555163 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 12:14:18.562855 (+  7692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.562979 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:18.722456 (+159477us) raft_consensus.cc:1685] finished
0709 12:14:18.722478 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:18.722625 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28756,"prepare.queue_time_us":112359,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":87,"raft.queue_time_us":61694,"raft.run_cpu_time_us":420,"raft.run_wall_time_us":35840,"spinlock_wait_cycles":17115904,"thread_start_us":295781,"threads_started":2,"wal-append.queue_time_us":616863}
I20260709 12:14:18.725394  4386 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.19, Last appended by leader: 19, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.734125 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:18.734575 26543 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 30. Current term is 31. Ops: []
I20260709 12:14:18.737776 26543 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 29 index: 20. Preceding OpId from leader: term: 31 index: 21. (index mismatch)
I20260709 12:14:18.704102  4558 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:18.741978  4515 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:14:18.713828  4324 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
W20260709 12:14:18.757424 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.731739  4311 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:18.755366  4582 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:18.742597  4192 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:18.755620  4342 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 12:14:18.767933  4607 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:18.768576  4607 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.769101  4292 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:18.763047  4083 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:18.732510  4388 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.028s
I20260709 12:14:18.758893  4155 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:18.790160  4155 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:18.751677  4229 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.773630 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:18.799321  4500 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:18.807895 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:18.810566 26472 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:18.808538 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:18.808998 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 37 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:18.809674 26467 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 31 index: 21. Preceding OpId from leader: term: 32 index: 22. (index mismatch)
I20260709 12:14:18.803337 27133 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:18.804162 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.822774 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:18.824493 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:18.795874  4588 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.837226 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:18.840025 26473 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 30
I20260709 12:14:18.841099 26472 raft_consensus.cc:2468] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
I20260709 12:14:18.757802  4449 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 12:14:18.856889 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:18.843550 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:18.858783 26464 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 33.
I20260709 12:14:18.860239 26471 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 33 index: 22. Preceding OpId from leader: term: 35 index: 23. (index mismatch)
W20260709 12:14:18.861706 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 58448.8us
I20260709 12:14:18.849020 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:18.864531 26469 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:14:18.760174  4603 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.087s
I20260709 12:14:18.881423 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:18.887742 27168 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 31: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:18.888459 26470 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: [29.18-29.18]
I20260709 12:14:18.886142 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:18.890712 26466 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 33.
I20260709 12:14:18.787060  4572 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:18.870656  4607 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:18.885898  4349 raft_consensus.cc:2804] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:14:18.909512 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:18.914861 26513 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:18.916859  4572 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
I20260709 12:14:18.921105 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 3857) took 1450 ms. Trace:
I20260709 12:14:18.921655 26540 rpcz_store.cc:276] 0709 12:14:17.470807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.496502 (+ 25695us) service_pool.cc:224] Handling call
0709 12:14:18.920822 (+1424320us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b540037f5d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:18.921021 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2085232896}
I20260709 12:14:18.924150 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:18.928326 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:18.929203 26544 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 36: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:18.931039 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4938) took 1321 ms. Trace:
I20260709 12:14:18.932116  4307 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader election lost for term 35. Reason: could not achieve majority
I20260709 12:14:18.940052  4349 raft_consensus.cc:697] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 28 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:18.941103  4349 consensus_queue.cc:237] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:18.942317  4607 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:18.943050 26468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 4940) took 2785 ms (client timeout 1993 ms). Trace:
W20260709 12:14:18.943545 26468 rpcz_store.cc:269] 0709 12:14:16.157389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.178384 (+ 20995us) service_pool.cc:224] Handling call
0709 12:14:18.942810 (+2764426us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b54002db254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:18.942948 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5090292992}
I20260709 12:14:18.943230  4607 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:18.854470  4457 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:18.946609  4607 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:18.943094  4453 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:18.948200 26616 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 30: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:18.948426 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:18.949097 26470 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:14:18.952445 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:18.851410  4155 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.782109  4083 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:18.931509 26617 rpcz_store.cc:276] 0709 12:14:17.609578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.612323 (+  2745us) service_pool.cc:224] Handling call
0709 12:14:17.972491 (+360168us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:17.985004 (+ 12513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:17.985037 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:17.985531 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:14:18.059106 (+ 73575us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:14:18.091026 (+ 31920us) log.cc:844] Serialized 14 byte log entry
0709 12:14:18.399524 (+308498us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b180032a4c0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5072fefa40 00007f5072fea4e4 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287 00007f50760f5208
0709 12:14:18.399724 (+   200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.399796 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:18.545845 (+146049us) spinlock_profiling.cc:243] Waited 8.02 ms on lock 0x7b180032a4c0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:14:18.805780 (+259935us) raft_consensus.cc:1685] finished
0709 12:14:18.805805 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:18.930859 (+125054us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b540020a650. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:18.930972 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12897,"prepare.queue_time_us":32324,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":326718,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":13104,"spinlock_wait_cycles":955257728,"thread_start_us":73195,"threads_started":1,"wal-append.queue_time_us":108133}
I20260709 12:14:18.957369 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:18.968079 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:18.968959 26618 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:14:18.966444 26439 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:18.971856 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:18.958864 26621 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:14:18.976882 26439 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:18.980906 26439 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:18.990783 26473 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
W20260709 12:14:19.050488 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 93201.8us
W20260709 12:14:19.051200 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 449782us
I20260709 12:14:19.051386 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:19.054319 26513 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:19.057466 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 37 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:19.058290 26613 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 38.
I20260709 12:14:19.058930 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:18.904474  4119 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.146s
I20260709 12:14:19.060452 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:19.057300  4357 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:19.061456  4553 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election won for term 31
W20260709 12:14:19.063266 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.964241  4453 raft_consensus.cc:2804] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:18.975597  4607 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:19.070698  4554 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:14:19.076583  4083 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:19.076766  4554 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:18.987385  4581 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:19.078702  4581 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:19.081025  4581 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:18.975270  4500 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.058070  4572 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:19.082142  4500 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:19.084517  4500 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:19.048463  4590 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:19.048297  4447 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:19.085835 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:19.086561 26468 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:14:19.088172  4592 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:19.088588  4229 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:19.089489  4453 raft_consensus.cc:697] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:19.090543  4453 consensus_queue.cc:237] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 28.15, Last appended by leader: 16, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:19.081593  3778 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:19.091614  4612 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:14:19.057919  4582 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:19.093091  4588 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:19.093716  3778 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:19.094012  4497 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 41 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:19.061946  4354 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election won for term 34
W20260709 12:14:19.054548  4599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.021s	sys 0.068s
I20260709 12:14:19.077739  4554 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:19.069828  4454 consensus_meta.cc:287] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.644s	user 0.004s	sys 0.008s
I20260709 12:14:19.065536  4357 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.065236  4553 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:18.963353  4155 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:19.118285  4569 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:19.127982  4011 consensus_meta.cc:287] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.000s
W20260709 12:14:19.129117  4365 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.696s	user 0.014s	sys 0.000s
W20260709 12:14:19.148233  4599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.021s	sys 0.069s
W20260709 12:14:19.170291  4520 consensus_meta.cc:287] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.722s	user 0.012s	sys 0.000s
I20260709 12:14:19.145812  4354 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:19.149679  4553 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:19.149812  4357 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:19.219648  4572 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
I20260709 12:14:19.252907  4558 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:19.256042  4558 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:19.206199  4569 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:19.259586  4569 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:19.311899 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:19.313663 26470 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:19.318464 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:19.319557 26468 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:14:19.341858 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 273056us
I20260709 12:14:19.345206 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:19.350474 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:19.354458 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:19.356194 26469 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 33: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
W20260709 12:14:19.358274 26541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.011s	sys 0.007s
W20260709 12:14:19.358651 26545 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.018s	sys 0.039s
I20260709 12:14:19.358848 26539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3989) took 1886 ms. Trace:
W20260709 12:14:19.359318 26545 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.018s	sys 0.039s
I20260709 12:14:19.359994 26547 raft_consensus.cc:2393] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 33: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:14:19.358294 26542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.004s	sys 0.029s
W20260709 12:14:19.361286 26542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.004s	sys 0.029s
I20260709 12:14:19.359584 26539 rpcz_store.cc:276] 0709 12:14:17.472351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.738417 (+266066us) service_pool.cc:224] Handling call
0709 12:14:17.738908 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:17.789182 (+ 50274us) raft_consensus.cc:1534] Early marking committed up to index 19
0709 12:14:17.800398 (+ 11216us) log.cc:844] Serialized 14 byte log entry
0709 12:14:18.390114 (+589716us) spinlock_profiling.cc:243] Waited 6.71 ms on lock 0x7b18002ac760. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:14:18.674511 (+284397us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b18002ac760. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a23a 00007f50760e4a2a
0709 12:14:19.085544 (+411033us) log.cc:844] Serialized 14 byte log entry
0709 12:14:19.085709 (+   165us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:19.086419 (+   710us) log.cc:844] Serialized 26 byte log entry
0709 12:14:19.086618 (+   199us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:14:19.087303 (+   685us) log.cc:844] Serialized 14 byte log entry
0709 12:14:19.087906 (+   603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:19.089471 (+  1565us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:19.358213 (+268742us) raft_consensus.cc:1685] finished
0709 12:14:19.358258 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:19.358602 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77181,"prepare.queue_time_us":13226,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":125,"raft.queue_time_us":53810,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":5917,"spinlock_wait_cycles":28247040,"thread_start_us":397294,"threads_started":1,"wal-append.queue_time_us":1411958}
W20260709 12:14:19.358928 26541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.011s	sys 0.008s
W20260709 12:14:19.375090 26587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.033s	sys 0.026s
W20260709 12:14:19.375607 26587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.033s	sys 0.026s
W20260709 12:14:19.376073 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 623191us
W20260709 12:14:19.379076 26588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.005s	sys 0.009s
W20260709 12:14:19.379601 26588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.005s	sys 0.009s
I20260709 12:14:19.384969 26469 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 32. Current term is 33. Ops: []
I20260709 12:14:19.384948 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:19.393766 26469 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 34 index: 21. Preceding OpId from leader: term: 35 index: 21. (term mismatch)
I20260709 12:14:19.394346 26469 pending_rounds.cc:85] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 20
I20260709 12:14:19.394721 26469 pending_rounds.cc:107] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 34.21
I20260709 12:14:19.395090 26469 raft_consensus.cc:2889] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:19.396595 26468 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
W20260709 12:14:19.400072 27131 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.007s	sys 0.002s
W20260709 12:14:19.417060 27131 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.007s	sys 0.002s
W20260709 12:14:19.400892 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 489468us
I20260709 12:14:19.402581 27162 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 27.
I20260709 12:14:19.414887 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:19.423324 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:19.430174 27163 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 19. Preceding OpId from leader: term: 35 index: 22. (index mismatch)
I20260709 12:14:19.431970 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:19.433295 27168 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 33: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:19.433452 26513 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:19.435631 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:19.436003 27166 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 22. Current term is 23. Ops: []
I20260709 12:14:19.436738 27163 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:19.436890  3778 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:19.439219 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:19.449070 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:19.450378 26540 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
W20260709 12:14:19.452924 26438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.455003  4177 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:14:19.455219  4229 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:19.456940  4155 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:19.457768  4155 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:19.438964  3778 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:19.441731 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:19.459427  4229 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:19.460119  4229 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:19.443907 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 41 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:19.460693  4229 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:19.461427 26613 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 40.
I20260709 12:14:19.445250 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:19.458843  4155 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:19.472141 26542 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 35.
I20260709 12:14:19.485754  4365 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:19.487215  4582 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:14:19.462950  4292 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.207204  4354 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:14:19.496146  4341 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.002s	sys 0.006s
W20260709 12:14:19.559051 26467 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.011s	sys 0.018s
W20260709 12:14:19.559661 26467 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.012s	sys 0.019s
W20260709 12:14:19.549101  4341 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.002s	sys 0.006s
W20260709 12:14:19.560760 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 62709.6us
I20260709 12:14:19.562795  4558 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.563366 27134 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:19.563844  4558 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:19.567790  4558 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:19.568063  4303 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:19.569139  4630 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:14:19.570665  4590 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:19.571383  4083 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.569077  4303 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:19.590900 26470 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36.
W20260709 12:14:19.577683 26439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.062s	sys 0.036s
W20260709 12:14:19.597497 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 164324us
W20260709 12:14:19.606460 26439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.063s	sys 0.036s
I20260709 12:14:19.606632 26468 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 35. Current term is 36. Ops: [33.20-35.21]
W20260709 12:14:19.616289 26473 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.014s	sys 0.025s
I20260709 12:14:19.617594  4311 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:19.618583  4311 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:19.619886  3778 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:19.621838  4311 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:19.624065 27163 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:14:19.595780  4083 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:19.571929  4590 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:19.648734 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:19.651851  4497 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.077s
I20260709 12:14:19.652554  4447 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:14:19.653201  4447 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:19.653690  4447 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:14:19.653823 26548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 4002) took 1265 ms (client timeout 1570 ms). Trace:
I20260709 12:14:19.654146  4572 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:14:19.654474 26548 rpcz_store.cc:269] 0709 12:14:18.387899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.437793 (+ 49894us) service_pool.cc:224] Handling call
0709 12:14:19.653322 (+1215529us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54003cf854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:19.653603 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253077888}
I20260709 12:14:19.655112  4572 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:19.656922 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1692) took 1461 ms. Trace:
I20260709 12:14:19.657450  4294 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:19.613641  4365 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:19.666111  4155 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:19.657404 26541 rpcz_store.cc:276] 0709 12:14:18.195370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.199683 (+  4313us) service_pool.cc:224] Handling call
0709 12:14:18.200126 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:18.795322 (+595196us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:14:18.795666 (+   344us) log.cc:844] Serialized 14 byte log entry
0709 12:14:19.364624 (+568958us) log.cc:844] Serialized 14 byte log entry
0709 12:14:19.365054 (+   430us) log.cc:844] Serialized 14 byte log entry
0709 12:14:19.365247 (+   193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:19.365308 (+    61us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:14:19.365429 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:19.656487 (+291058us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b5400106dd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:19.656539 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:19.656852 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104273,"prepare.queue_time_us":286393,"prepare.run_cpu_time_us":146,"prepare.run_wall_time_us":148,"raft.queue_time_us":234969,"raft.run_cpu_time_us":491,"raft.run_wall_time_us":492,"spinlock_wait_cycles":1368448128,"thread_start_us":567751,"threads_started":1,"wal-append.queue_time_us":472617}
I20260709 12:14:19.661859 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:19.658094  4294 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.676858  4581 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:14:19.594761  4292 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:19.686964  4572 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:19.686812 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 123724us
I20260709 12:14:19.688354 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 41 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:19.689667  4303 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:19.690558  4508 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 40 FOLLOWER]: Leader pre-election won for term 41
I20260709 12:14:19.686918 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 37 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:19.691263  4508 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 40 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.691773  4508 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 40 FOLLOWER]: Advancing to term 41
I20260709 12:14:19.691732 26541 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 38.
I20260709 12:14:19.694917 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 25 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:19.696441  4292 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:19.705087  4551 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:19.715070  4365 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:19.716492 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:19.717509 26541 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 34.
I20260709 12:14:19.721714 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:19.722826 26470 raft_consensus.cc:2410] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 35 because replica has last-logged OpId of term: 32 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 30 index: 16.
I20260709 12:14:19.723266 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:19.723963 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:19.725064 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:19.726751  4590 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:19.728397 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 747529us
I20260709 12:14:19.722872 26467 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:14:19.731192  4558 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:19.731103 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 34 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:19.732653 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:19.736328  4557 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:19.737195 26545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 3987) took 2278 ms. Trace:
W20260709 12:14:19.690768 26471 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.022s	sys 0.016s
I20260709 12:14:19.740552 27162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 1364) took 1174 ms. Trace:
I20260709 12:14:19.684460  4294 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:19.767275 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:19.768206 27162 rpcz_store.cc:276] 0709 12:14:18.565756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.565907 (+   151us) service_pool.cc:224] Handling call
0709 12:14:19.740262 (+1174355us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b54006ce3d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:19.740461 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920704384}
W20260709 12:14:19.769205 26471 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.028s	sys 0.019s
I20260709 12:14:19.769269 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:19.714147  4292 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:19.708284  4083 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:19.774050 26470 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:14:19.748486 26545 rpcz_store.cc:276] 0709 12:14:17.459034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.459436 (+   402us) service_pool.cc:224] Handling call
0709 12:14:17.459753 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:17.460172 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 12:14:17.967952 (+507780us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b1800487a80. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:14:18.484393 (+516441us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b1800487a80. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f5079ad23c7 00007f50760e49a7 00007f50760ed5e5 00007f50760ed568
0709 12:14:19.360156 (+875763us) log.cc:844] Serialized 14 byte log entry
0709 12:14:19.640193 (+280037us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:19.732179 (+ 91986us) log.cc:844] Serialized 26 byte log entry
0709 12:14:19.733847 (+  1668us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:14:19.734905 (+  1058us) log.cc:844] Serialized 14 byte log entry
0709 12:14:19.735970 (+  1065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:19.736840 (+   870us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:19.736889 (+    49us) raft_consensus.cc:1685] finished
0709 12:14:19.736910 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:19.737093 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8250,"prepare.queue_time_us":25584,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":82,"raft.queue_time_us":9737,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":41337,"spinlock_wait_cycles":65031040,"thread_start_us":1129856,"threads_started":2,"wal-append.queue_time_us":323543}
I20260709 12:14:19.778842 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:19.745008  4581 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:19.658872  4553 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:19.782807  4634 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.165s	user 0.003s	sys 0.002s
I20260709 12:14:19.773937  4641 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.783455 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 36 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:19.784826  4557 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:19.786751 26439 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:19.787828  4592 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:19.787446  4558 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:19.784857 26543 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 35. Current term is 36. Ops: []
I20260709 12:14:19.790279 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:19.799255 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 34 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:19.802758 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:19.782855  4292 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:19.811439 26540 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 35.
I20260709 12:14:19.812244 26467 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 37.
I20260709 12:14:19.812671 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:19.816192 26540 raft_consensus.cc:2410] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 36 because replica has last-logged OpId of term: 35 index: 23, which is greater than that of the candidate, which has last-logged OpId of term: 33 index: 22.
W20260709 12:14:19.816934 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 145773us
I20260709 12:14:19.816188  4292 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:19.789042  4590 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:19.826462 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 81044.4us
I20260709 12:14:19.830739  4326 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:19.831296  4641 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:19.835693  4553 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:19.837833 26543 raft_consensus.cc:1240] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 30. Current term is 31. Ops: []
I20260709 12:14:19.842607  4365 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:14:19.843371  4365 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:19.844668  4365 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 35.21, Last appended by leader: 21, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:19.846735 26617 consensus_meta.cc:287] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.874s	user 0.010s	sys 0.013s
I20260709 12:14:19.846836 26548 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 30 index: 18. (term mismatch)
I20260709 12:14:19.847270 26548 pending_rounds.cc:85] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 17
I20260709 12:14:19.847304 26617 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:14:19.847628 26548 pending_rounds.cc:107] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 29.18
I20260709 12:14:19.848008 26548 raft_consensus.cc:2889] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:19.834050  4641 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:19.851460 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 64973.7us
I20260709 12:14:19.852725 26439 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:19.854750 26539 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: []
I20260709 12:14:19.855895  4558 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:19.858558  4506 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:19.819443  4592 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:19.859637 26363 catalog_manager.cc:5697] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 23 to 28, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 28 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:19.860266  4581 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 16, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:19.842685  4358 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.863265  4358 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:19.827999  4447 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:19.866739  4386 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.001s
I20260709 12:14:19.867667 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55088 (request call id 4006) took 1478 ms. Trace:
I20260709 12:14:19.868119 26547 rpcz_store.cc:276] 0709 12:14:18.388905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.550807 (+161902us) service_pool.cc:224] Handling call
0709 12:14:19.867420 (+1316613us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b54002378d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:19.867608 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1844641024}
I20260709 12:14:19.869019  4447 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:19.869442 26467 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 31. Current term is 32. Ops: [28.15-31.16]
I20260709 12:14:19.308290 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:19.850045  4590 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:19.879760 26544 raft_consensus.cc:1240] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 32. Current term is 33. Ops: []
I20260709 12:14:19.859670  4506 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:19.868922 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:19.861583 26363 catalog_manager.cc:5697] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 15 to 28. New cstate: current_term: 28 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:19.878196  4590 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:19.893158 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:19.894681  4641 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:19.895248  4641 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:19.882915 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:19.862234  4592 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:19.901352 26513 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:19.898491  4641 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:19.897993  4558 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:19.913532 26545 raft_consensus.cc:1240] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 31. Current term is 32. Ops: [31.16-31.16]
I20260709 12:14:19.910532 26467 pending_rounds.cc:85] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 23
I20260709 12:14:19.919685 26467 pending_rounds.cc:107] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 38.24
I20260709 12:14:19.920074 26467 raft_consensus.cc:2889] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:19.907972  4358 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:19.933514 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:19.919293  4592 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader pre-election won for term 38
I20260709 12:14:19.935655  4447 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election won for term 39
I20260709 12:14:19.962123 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:19.947744  4592 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.969381 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:19.962409  4447 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:19.975178 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 64379.4us
I20260709 12:14:19.975313  4607 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:14:19.970384  4229 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.505s	user 0.016s	sys 0.002s
I20260709 12:14:19.979322 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:19.967940  4592 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:19.972688 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:19.985409 26464 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 30: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:19.971127  4177 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:19.991977 26539 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:19.989253 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:19.979136  4447 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Advancing to term 39
W20260709 12:14:19.982611  4649 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.115s	user 0.003s	sys 0.000s
W20260709 12:14:20.011118 26616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 4951) took 1535 ms (client timeout 1845 ms). Trace:
W20260709 12:14:20.012271 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 60161us
I20260709 12:14:20.014674  4354 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.047919  4354 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:20.024395 26363 catalog_manager.cc:5697] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 26 to 27, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 27 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:20.026582  4607 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:20.027771  4177 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:20.031958 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 44765.5us
W20260709 12:14:20.033047 26367 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39184 (request call id 168) took 24085 ms (client timeout 15000 ms). Trace:
I20260709 12:14:19.990824  4590 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election won for term 35
W20260709 12:14:20.043952 26616 rpcz_store.cc:269] 0709 12:14:18.449239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.449355 (+   116us) service_pool.cc:224] Handling call
0709 12:14:19.957254 (+1507899us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54001f68d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:19.984352 (+ 27098us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064737536}
W20260709 12:14:20.035077  4357 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.751s	user 0.008s	sys 0.007s
I20260709 12:14:20.036844 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:19.987972  4229 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.056999 26514 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:20.059082 26620 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 31 index: 21. Preceding OpId from leader: term: 32 index: 22. (index mismatch)
I20260709 12:14:20.038563  4326 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:20.060567 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:20.039552 26465 raft_consensus.cc:2410] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 31 because replica has last-logged OpId of term: 30 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 29 index: 20.
I20260709 12:14:20.010433  4554 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:20.040051 26544 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:14:20.018577  4042 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.981454  4552 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:19.993903 26470 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 34 index: 21. Preceding OpId from leader: term: 35 index: 22. (index mismatch)
I20260709 12:14:20.031339  4508 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 41 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:19.986833  4557 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:20.061657 26621 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
W20260709 12:14:20.045549  4652 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:14:20.073522 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:20.082928 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:20.061194  4326 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:20.079032 26464 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: []
I20260709 12:14:20.062413  4083 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.054880  4590 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.105937  4590 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:20.106226  4354 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:20.106638  4386 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.107025  4354 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.107321  4386 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.081493  4357 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.076956 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:20.082417 26363 catalog_manager.cc:5697] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 18 to 22, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 22 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:20.091759 26620 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27. Ops: []
I20260709 12:14:20.092002  4177 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:20.059120  4229 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:20.097747  4558 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:20.097910  4552 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:20.098861  4083 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:20.102703  4660 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 12:14:20.103412 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 135955us
I20260709 12:14:20.104792  4572 raft_consensus.cc:2804] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:14:20.087141  4554 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:20.110365 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 1557) took 1289 ms. Trace:
I20260709 12:14:20.096715 26467 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: [27.18-29.19]
I20260709 12:14:20.136590 26363 catalog_manager.cc:5697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:20.156219 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:20.159473 26542 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: [29.16-29.16]
I20260709 12:14:20.159555 26464 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: [29.16-29.16]
W20260709 12:14:20.160495 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 108747us
I20260709 12:14:20.140647  4558 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:20.153007 26465 rpcz_store.cc:276] 0709 12:14:18.820587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.824135 (+  3548us) service_pool.cc:224] Handling call
0709 12:14:20.110116 (+1285981us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54001fefd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:20.110281 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2791308160}
I20260709 12:14:20.171857 26473 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:20.145864  4582 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 12:14:20.176447 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 119608us
I20260709 12:14:20.152527  4357 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:20.110710  4294 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:20.159279  4354 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:20.157056  4042 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:20.185422  4663 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:20.186861 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:20.187708  4457 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.188160  4596 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:14:20.188223 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:20.188876 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 106049us
I20260709 12:14:20.190315 26363 catalog_manager.cc:5697] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:20.159472  4572 raft_consensus.cc:697] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:20.192870 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:20.196192  4633 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:20.220044 26467 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 32 index: 16. (index mismatch)
I20260709 12:14:20.196609  4326 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:20.221279 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:20.197309 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:20.198087 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:20.198916 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:20.199887 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:20.200313  4554 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:20.171176 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:20.176847 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:20.207175 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:20.223623 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:20.224110 26466 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 30 index: 18. (index mismatch)
I20260709 12:14:20.225883 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:20.194098  4447 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.230423 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:20.230063 26363 catalog_manager.cc:5697] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:20.231032  4572 consensus_queue.cc:237] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.231999 26363 catalog_manager.cc:5697] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:20.232864 26439 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:20.234513 26439 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:20.236269  4292 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
I20260709 12:14:20.236387 26439 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:20.237406  4633 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.230101 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 36 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:20.215448  4663 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.239987  4663 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:20.242017  4155 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:20.242537  4229 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:20.242779  4155 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.243042 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:20.243252  4229 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.244266  4500 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:20.245093  4155 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:20.245000  4500 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 31.19, Next index: 20, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:14:20.245345  4229 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:20.246268 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:20.246937  4506 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:14:20.247407  4506 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:20.247617 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:20.247869 26618 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:14:20.248329 26618 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:20.248468 26616 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
I20260709 12:14:20.248647 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:20.249176 26618 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.19, Last appended by leader: 19, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.250072  4552 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:20.233664 26363 catalog_manager.cc:5697] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 22 to 25, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 25 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:20.251534 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:20.251423 26363 catalog_manager.cc:5697] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 20 to 25, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 25 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:20.250257 26618 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:20.246343 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:20.230443 27163 raft_consensus.cc:2393] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 30: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:20.254248 26363 catalog_manager.cc:5697] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 20 to 25, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 25 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:20.259115 26620 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 28
I20260709 12:14:20.246187  4500 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:20.253897  4457 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:20.264034 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:20.263988 26363 catalog_manager.cc:5697] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 14 to 20, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 20 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:20.269791 26539 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
W20260709 12:14:20.276765 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 115483us
I20260709 12:14:20.280373  4386 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:20.212236  4592 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.279124 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:20.285100 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:20.288025 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:20.261590  4582 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:20.290690  3778 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:20.050324 26367 rpcz_store.cc:269] 0709 12:13:55.986627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.915623 (+9928996us) service_pool.cc:224] Handling call
0709 12:14:06.028107 (+112484us) spinlock_profiling.cc:243] Waited 54.4 ms on lock 0x7b5400260110. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb60b2 00007f507bf2f759 00007f507bec7a76 00007f507be98d58 00007f507bf9704e 00007f507a4582a4 00007f507a458232 00007f507a458161 00007f507a4580dc
0709 12:14:20.032754 (+14004647us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:11.045734 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:11.206870 (+161136us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:11.206948 (+    78us) write_op.cc:435] Acquired schema lock
0709 12:14:11.206977 (+    29us) tablet.cc:662] Decoding operations
0709 12:14:11.209029 (+  2052us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:11.209161 (+   132us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:11.209209 (+    48us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:14:11.299143 (+ 89934us) tablet.cc:701] Row locks acquired
0709 12:14:11.299201 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:14:11.299365 (+   164us) write_op.cc:270] Start()
0709 12:14:11.299553 (+   188us) write_op.cc:276] Timestamp: P: 1783599251299305 usec, L: 0
0709 12:14:11.299576 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:14:11.300337 (+   761us) log.cc:844] Serialized 5899 byte log entry
0709 12:14:11.939970 (+639633us) op_driver.cc:464] REPLICATION: finished
0709 12:14:12.057942 (+117972us) write_op.cc:301] APPLY: starting
0709 12:14:12.058031 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:12.210766 (+152735us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:12.210879 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:12.262038 (+ 51159us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:12.265834 (+  3796us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 12:14:12.265911 (+    77us) write_op.cc:312] APPLY: finished
0709 12:14:12.266468 (+   557us) log.cc:844] Serialized 139 byte log entry
0709 12:14:12.276232 (+  9764us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:12.280788 (+  4556us) write_op.cc:454] Released schema lock
0709 12:14:12.281816 (+  1028us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:12.310490 (+ 28674us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:12.310522 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":362457,"reported_tablets":24,"spinlock_wait_cycles":125179136,"child_traces":[["op",{"apply.queue_time_us":117618,"apply.run_cpu_time_us":25117,"apply.run_wall_time_us":233504,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66767,"num_ops":15,"prepare.queue_time_us":577894,"prepare.run_cpu_time_us":12147,"prepare.run_wall_time_us":414557,"raft.queue_time_us":241807,"raft.run_cpu_time_us":40110,"raft.run_wall_time_us":95594,"replication_time_us":640212,"thread_start_us":726637,"threads_started":4,"wal-append.queue_time_us":180039,"wal-append.run_cpu_time_us":47068,"wal-append.run_wall_time_us":1803702}]]}
I20260709 12:14:20.285842 26464 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
I20260709 12:14:20.275290  4500 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.281498  4508 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 41 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:20.307932 27166 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 34 index: 21. Preceding OpId from leader: term: 35 index: 22. (index mismatch)
I20260709 12:14:20.302815 26545 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 37. Current term is 38. Ops: []
I20260709 12:14:20.307654 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:20.305238  3778 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.306594 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:20.313088 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:20.316241 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:20.317302 26615 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 32: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:20.295972  4341 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:20.318650  4341 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:20.319094  4341 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:20.304339 26613 raft_consensus.cc:3055] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:14:20.319871 26613 raft_consensus.cc:740] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:20.320837 26613 consensus_queue.cc:260] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 31.16, Last appended by leader: 16, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.321904 26613 raft_consensus.cc:3060] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:20.325076 26363 catalog_manager.cc:5697] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 20 to 25, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 25 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:20.303073  4500 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:20.327767  4592 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:20.327939 26363 catalog_manager.cc:5697] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 17 to 23, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 23 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:20.329272 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:20.330601 26514 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:14:20.318284 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 82034us
I20260709 12:14:20.336963 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:20.337687 26464 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
I20260709 12:14:20.338019  4607 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:20.338843 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:20.339960 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:20.341636  4663 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:20.342859 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 65396.8us
I20260709 12:14:20.342654  4592 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:14:20.359108  4592 raft_consensus.cc:3055] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:14:20.359553  4592 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:20.343448  4155 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:14:20.344329 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 31 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:20.304883  4365 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:20.344404  4641 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.344992 26620 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:14:20.301966  4553 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 28.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.043s
I20260709 12:14:20.344412 26618 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 29 index: 19. Preceding OpId from leader: term: 28 index: 19. (term mismatch)
I20260709 12:14:20.301028  4581 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.353245 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:20.375046 26615 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:20.365415 26587 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:20.366554 26464 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:20.341753  4590 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.370329 26618 pending_rounds.cc:85] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 18
I20260709 12:14:20.379591 26618 pending_rounds.cc:107] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 29.19
I20260709 12:14:20.379966 26618 raft_consensus.cc:2889] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:20.371078 26439 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:20.367089  4365 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.350346  4229 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:20.376834 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:20.363602  4652 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:14:20.378695 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:20.401053  3778 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:20.405318 26514 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:20.407182 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 56133.6us
I20260709 12:14:20.407972  4552 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
I20260709 12:14:20.409853  4552 consensus_queue.cc:1059] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 26.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 12:14:20.411072  4552 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:20.411846  4552 raft_consensus.cc:3055] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:14:20.412194  4552 raft_consensus.cc:740] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:20.413048  4552 consensus_queue.cc:260] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 26.20, Last appended by leader: 20, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:20.413816  4083 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:20.369619  4607 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:20.414816  4607 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:20.414929  4289 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 35.21, Next index: 22, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:14:20.416432  4365 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:20.416925  4596 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Stepping down as leader of term 35
I20260709 12:14:20.417104 26613 raft_consensus.cc:1275] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 31 index: 16. Preceding OpId from leader: term: 32 index: 16. (term mismatch)
I20260709 12:14:20.417392  4596 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:20.417796 26613 pending_rounds.cc:85] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 15
I20260709 12:14:20.417881 26514 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:20.418219 26613 pending_rounds.cc:107] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 31.16
I20260709 12:14:20.418303  4042 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:20.418843  4311 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 12:14:20.418922 26613 raft_consensus.cc:2889] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:20.418505  4596 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 35.21, Last appended by leader: 21, Current term: 35, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.420305  4596 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:20.416241  4289 consensus_queue.cc:1059] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 30.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:14:20.421171  4177 consensus_queue.cc:1059] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 32.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:14:20.421088  4592 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:20.422179  4177 raft_consensus.cc:3055] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Stepping down as leader of term 32
W20260709 12:14:20.428922 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.429311  4289 raft_consensus.cc:3055] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:14:20.429749  4289 raft_consensus.cc:740] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:20.380326  4155 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:20.429955 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:20.350706  4386 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 20, Time since last communication: 0.048s
I20260709 12:14:20.428818  4177 raft_consensus.cc:740] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:20.476729  4177 consensus_queue.cc:260] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 32.17, Last appended by leader: 17, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.430817  4508 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:14:20.479856  4641 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:20.433986 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:20.481724 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:20.421207  3778 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:14:20.482750  4457 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:20.483404  3778 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:14:20.399459  4581 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:20.484292  3778 consensus_queue.cc:1243] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 30.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:14:20.434888 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:20.435319 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:20.437134 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:20.425414 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1563) took 1525 ms. Trace:
I20260709 12:14:20.417048  4607 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:20.423724 26470 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 34. Current term is 35. Ops: [34.18-34.18]
W20260709 12:14:20.438956 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 60356.1us
I20260709 12:14:20.438439 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 36 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:20.490520 26467 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:20.441563  4663 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:20.441663  4447 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:20.442904 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:20.523442  4311 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:20.443006  4294 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:20.432611  4341 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.524111  4311 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:20.442178 26514 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:20.446975 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:20.454135  4633 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:20.458972  4587 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:14:20.527942  4587 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:14:20.528362  4587 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:20.529382  4587 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 29.16, Last appended by leader: 16, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.459399  4582 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:20.458993 26464 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
I20260709 12:14:20.531306 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:20.532521 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:20.460033 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 41 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:20.532812  4229 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:20.533371 26619 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Advancing to term 41
I20260709 12:14:20.534109  4587 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:20.461705  4506 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 31.19, Last appended by leader: 19, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:20.462968 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 97700.9us
I20260709 12:14:20.464401  4292 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:20.469584  4590 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:20.392037 26363 catalog_manager.cc:5697] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 22 to 25, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 25 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:20.526912  4341 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:20.473913  4667 log.cc:927] Time spent T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.178s	user 0.002s	sys 0.000s
I20260709 12:14:20.536010  4292 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:20.430744  4289 consensus_queue.cc:260] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 30.17, Last appended by leader: 17, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.431007  4155 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:20.541054 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:20.541914 27162 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:14:20.489931 27133 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:20.422724  4552 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:20.478155  4177 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:20.544907  4551 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:20.546304 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 36 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:20.547418  4596 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 12:14:20.549111  4581 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:20.550201 26470 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
W20260709 12:14:20.514259 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 79016.1us
I20260709 12:14:20.501258 26539 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 12:14:20.521256 26615 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
I20260709 12:14:20.487288 26471 rpcz_store.cc:276] 0709 12:14:18.873686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.874740 (+  1054us) service_pool.cc:224] Handling call
0709 12:14:18.875214 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:18.875503 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:14:19.788445 (+912942us) log.cc:844] Serialized 14 byte log entry
0709 12:14:19.942833 (+154388us) log.cc:844] Serialized 14 byte log entry
0709 12:14:20.034312 (+ 91479us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b1800291d00. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:14:20.106280 (+ 71968us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b1800291d00. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:14:20.330297 (+224017us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b1800291d00. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5075c824bc 00007f5072fd048b 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287
0709 12:14:20.335268 (+  4971us) log.cc:844] Serialized 14 byte log entry
0709 12:14:20.349711 (+ 14443us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:20.361714 (+ 12003us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:14:20.368889 (+  7175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.380927 (+ 12038us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:20.398550 (+ 17623us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76088,"prepare.queue_time_us":763086,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":130,"raft.queue_time_us":19828,"raft.run_cpu_time_us":441,"raft.run_wall_time_us":23038,"spinlock_wait_cycles":17591296,"thread_start_us":941138,"threads_started":3,"wal-append.queue_time_us":174646}
I20260709 12:14:20.522755  4592 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:14:20.522928  4607 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:14:20.533387 26464 raft_consensus.cc:2410] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 38 because replica has last-logged OpId of term: 35 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 33 index: 17.
W20260709 12:14:20.571273 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 81434.2us
W20260709 12:14:20.571538 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 129436us
I20260709 12:14:20.578482 26514 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:20.586721 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:20.484926  4500 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.589560 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:20.592221 26513 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:20.581838 26588 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:20.600694 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:20.552649  4324 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Stepping down as leader of term 37
I20260709 12:14:20.603168 26471 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
I20260709 12:14:20.603899 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:20.621446 26616 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:20.583889  4607 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:20.619257 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 34 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:20.625972 26513 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:20.637306 26466 raft_consensus.cc:2368] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33.
I20260709 12:14:20.605664  4229 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:20.590664  4581 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:14:20.650261 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 114605us
W20260709 12:14:20.655750 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 72323.9us
I20260709 12:14:20.605999  4324 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:20.619234  4554 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:20.660997 26514 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:20.653752 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:20.656880 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:20.663885 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:20.584291  4386 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.068s
I20260709 12:14:20.635854  4365 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:20.670948  4500 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:20.649806  4506 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:20.671463  4311 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:20.672807  4324 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 37.21, Last appended by leader: 21, Current term: 37, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.675169 26439 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:20.681126 26468 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 30 index: 16. (index mismatch)
W20260709 12:14:20.691789 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 65900.2us
I20260709 12:14:20.657897  4229 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:20.649988  4553 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 12:14:20.682940  4365 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:20.720641  4557 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:14:20.727509  4607 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:20.729614  4558 consensus_meta.cc:287] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.005s
I20260709 12:14:20.730121  4558 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.732369  4558 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:20.746217 26616 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 34.
W20260709 12:14:20.756089  4668 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.518s	user 0.000s	sys 0.003s
I20260709 12:14:20.757967 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 4974) took 1909 ms. Trace:
I20260709 12:14:20.758490 26472 rpcz_store.cc:276] 0709 12:14:18.848515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.858320 (+  9805us) service_pool.cc:224] Handling call
0709 12:14:18.858781 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:18.859248 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:18.859294 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:19.949037 (+1089743us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b2c000327f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:14:20.022080 (+ 73043us) log.cc:844] Serialized 26 byte log entry
0709 12:14:20.153708 (+131628us) raft_consensus.cc:1645] Marking committed up to 21
0709 12:14:20.153758 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.164530 (+ 10772us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:20.658466 (+493936us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:14:20.757530 (+ 99064us) raft_consensus.cc:1685] finished
0709 12:14:20.757562 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:20.757744 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27636,"raft.queue_time_us":730,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":32108,"spinlock_wait_cycles":291780736,"thread_start_us":58602,"threads_started":1,"wal-append.queue_time_us":174638}
I20260709 12:14:20.783689  4341 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:14:20.784404  4341 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.784850  4341 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:20.789750  4289 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:14:20.800654 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 125586us
I20260709 12:14:20.707851  4229 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:20.708240  4292 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:20.718191  4554 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:20.824358 26467 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 38.
I20260709 12:14:20.726763  4365 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Advancing to term 36
W20260709 12:14:20.807940  4634 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:14:20.869041 26439 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:20.877473 26622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.017s	sys 0.021s
W20260709 12:14:20.878086 26622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.017s	sys 0.021s
W20260709 12:14:20.878270  4671 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
W20260709 12:14:20.837206  4572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.040s	sys 0.046s
I20260709 12:14:20.867756 26546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
W20260709 12:14:20.882746  4572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.041s	sys 0.046s
I20260709 12:14:20.883140 26546 raft_consensus.cc:606] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:14:20.721163  4581 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 17, Time since last communication: 0.119s
I20260709 12:14:20.883541 26546 raft_consensus.cc:614] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:20.871476  4554 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:20.911629 26619 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 41 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 41.
W20260709 12:14:20.924155  4643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.030s	sys 0.048s
W20260709 12:14:20.924793  4643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.030s	sys 0.048s
I20260709 12:14:20.924046  4292 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
W20260709 12:14:20.943019 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 74109.7us
W20260709 12:14:20.944932 26469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.017s	sys 0.035s
W20260709 12:14:20.945407 26469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.017s	sys 0.035s
I20260709 12:14:20.946492 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 3981) took 1259 ms. Trace:
I20260709 12:14:20.947273  4663 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:20.944455  4551 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:20.953179  4643 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:20.976912 27134 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:20.947055 26469 rpcz_store.cc:276] 0709 12:14:19.687491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.106886 (+419395us) service_pool.cc:224] Handling call
0709 12:14:20.107366 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:20.135360 (+ 27994us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:20.135403 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:20.136127 (+   724us) log.cc:844] Serialized 26 byte log entry
0709 12:14:20.945912 (+809785us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:14:20.945984 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.946090 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:20.946164 (+    74us) raft_consensus.cc:1685] finished
0709 12:14:20.946184 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:20.946381 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20359,"raft.queue_time_us":29950,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":21407,"thread_start_us":809277,"threads_started":1,"wal-append.queue_time_us":750350}
I20260709 12:14:20.979918 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 41 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:20.981580 26439 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:20.982304 26587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.007s	sys 0.006s
W20260709 12:14:20.983225 26587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.007s	sys 0.006s
W20260709 12:14:20.983562 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:20.983812 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 515974us
W20260709 12:14:20.984584 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:20.985551 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:20.988981  3778 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.006s	sys 0.007s
W20260709 12:14:20.996584  3778 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.006s	sys 0.007s
W20260709 12:14:20.997725 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.000964 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.001688 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.969821  4551 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:21.012953 26546 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 27. Current term is 28. Ops: []
I20260709 12:14:20.993708  4508 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:14:20.971194  4554 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 30.18, Last appended by leader: 18, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:20.977152  4292 consensus_queue.cc:1059] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.025s
I20260709 12:14:20.994339  4457 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 41 FOLLOWER]: Leader election won for term 41
I20260709 12:14:21.024264 26542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:14:21.025192 26541 raft_consensus.cc:1240] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 31. Current term is 32. Ops: []
W20260709 12:14:21.023880 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 310857us
I20260709 12:14:21.027523 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:21.028919 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 49904.3us
I20260709 12:14:21.029428 26539 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 33. Current term is 34. Ops: []
I20260709 12:14:21.031919 26542 raft_consensus.cc:606] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:14:21.032390 26542 raft_consensus.cc:614] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:14:21.054534 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 393631us
W20260709 12:14:21.006515  4042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.001s	sys 0.013s
I20260709 12:14:20.977303  4643 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:21.057508 26546 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 30. Current term is 31. Ops: []
I20260709 12:14:21.016290  4447 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:14:21.055310  4508 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 34 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:21.069770 26439 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:21.070562 26545 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 34 index: 21. Preceding OpId from leader: term: 35 index: 22. (index mismatch)
I20260709 12:14:21.072494 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:21.074352 26473 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 35 index: 18. Preceding OpId from leader: term: 37 index: 19. (index mismatch)
I20260709 12:14:21.075906 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:21.079005 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 25 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:21.079493  4515 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.006s	sys 0.006s
I20260709 12:14:21.084733 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:21.086213 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:21.089186 26469 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 37. Current term is 38. Ops: []
I20260709 12:14:21.086316 26514 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:21.089725 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:14:21.089627 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.094959  4515 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.007s	sys 0.006s
W20260709 12:14:21.124284 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 58404.7us
I20260709 12:14:21.097602  4354 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:14:21.090583  4447 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:14:21.087566  4042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.002s	sys 0.013s
I20260709 12:14:21.078105  4155 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.040s
W20260709 12:14:21.210373 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 124402us
I20260709 12:14:21.126431 26466 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 36.
W20260709 12:14:21.123919 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.187469 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 62283.8us
W20260709 12:14:21.160737  4674 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:14:21.121418  4500 raft_consensus.cc:2764] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election decision vote started in defunct term 31: won
W20260709 12:14:21.228621 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 72791.6us
W20260709 12:14:21.183076  4680 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 12:14:21.189956  4675 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
W20260709 12:14:21.187130  4678 log.cc:927] Time spent T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 12:14:21.249023  4551 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:21.160099  4679 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
W20260709 12:14:21.165738  4677 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:14:21.230154 26513 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:21.187625 26472 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:14:21.156153  4685 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.217525  4447 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:14:21.243400 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 244302us
I20260709 12:14:21.187625  4572 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
I20260709 12:14:21.160480  4643 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:21.240245 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 224866us
I20260709 12:14:21.264925 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:21.245566 26514 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:21.214161  4354 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:21.256987 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 4963) took 1053 ms. Trace:
I20260709 12:14:21.265704 26513 leader_election.cc:400] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33.
I20260709 12:14:21.268354 26513 leader_election.cc:403] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:21.121862  4592 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.106s
I20260709 12:14:21.266721 26619 raft_consensus.cc:2393] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 27: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:21.268181 26622 rpcz_store.cc:276] 0709 12:14:20.198002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.200430 (+  2428us) service_pool.cc:224] Handling call
0709 12:14:20.200870 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:20.201402 (+   532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:20.201432 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:20.201957 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:14:20.878675 (+676718us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:14:20.878725 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.878800 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:21.250923 (+372123us) raft_consensus.cc:1685] finished
0709 12:14:21.250953 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.251150 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1416,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":3783,"thread_start_us":676164,"threads_started":1,"wal-append.queue_time_us":767277}
I20260709 12:14:21.272742  4643 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
W20260709 12:14:21.265699  4688 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:14:21.268047  4551 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.262676  4311 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Leader election won for term 38
I20260709 12:14:21.254886  4457 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 41 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:21.277433 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:21.269502  4596 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.294981 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:21.340484 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:21.295701 26466 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:14:21.343165 26514 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:21.275873  4645 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.286824  4643 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 33
I20260709 12:14:21.287814  4515 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.349382 26464 raft_consensus.cc:3055] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:14:21.256726  4508 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 32.22, Last appended by leader: 22, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:21.353897 26464 raft_consensus.cc:740] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:21.360836 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:21.268635  4685 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:21.358877  4552 consensus_meta.cc:287] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.814s	user 0.018s	sys 0.005s
I20260709 12:14:21.345916  4311 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 38 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:21.375005 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:21.353709  4581 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:21.353578  4292 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:14:21.383457 26514 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:21.294610  4551 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:21.380146 26464 consensus_queue.cc:260] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:21.391106  4365 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:21.399932  4684 log.cc:927] Time spent T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:14:21.404281 26514 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:21.406929 26545 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 35. Current term is 36. Ops: []
I20260709 12:14:21.398032  4365 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:21.408916 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 120282us
I20260709 12:14:21.359095  4294 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.033s
I20260709 12:14:21.358959  4596 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:21.353468  4692 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.046s
I20260709 12:14:21.414987 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:21.427254 26542 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 27.
I20260709 12:14:21.369058  4155 consensus_queue.cc:1048] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 12:14:21.346079  4354 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 29.21, Last appended by leader: 21, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:21.366817  4515 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:21.433418 26464 raft_consensus.cc:3060] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:21.371872  4645 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:21.410732  4292 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:21.417730  4641 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
I20260709 12:14:21.437201 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 37 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:21.414302  4607 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:21.410181  4572 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:21.439622  4292 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 30.20, Last appended by leader: 20, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:21.432479  4682 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.010s
I20260709 12:14:21.453725 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:21.441576 26542 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Advancing to term 39
I20260709 12:14:21.432186  4552 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:14:21.460649 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 85755.6us
I20260709 12:14:21.456383  4690 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
W20260709 12:14:21.463224  4694 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 12:14:21.464558  4552 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:21.474225 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:21.484586 26464 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
W20260709 12:14:21.494917 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 69424.7us
I20260709 12:14:21.498580 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:21.496172 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:21.502523  4685 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:21.503196  4645 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:21.504865  4515 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:21.505447  4676 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.510s	user 0.003s	sys 0.000s
I20260709 12:14:21.510238 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:14:21.510313 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.502115 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:21.486891  4641 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.010s
I20260709 12:14:21.511210 26468 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:21.519572 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:21.520185 26542 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 39.
I20260709 12:14:21.520366 26464 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
W20260709 12:14:21.522570 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 48462.2us
I20260709 12:14:21.523351 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:21.476549  4500 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:21.488910  4682 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:21.488098  4607 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:21.500223  4552 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:21.532209 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:21.536972 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:21.535003 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:21.443928  4457 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 39.25, Last appended by leader: 25, Current term: 41, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:21.544737 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:21.545078 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:21.537469  4506 consensus_meta.cc:287] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.842s	user 0.007s	sys 0.007s
I20260709 12:14:21.545975 26544 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 23.
I20260709 12:14:21.550755 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:21.551178 26465 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
I20260709 12:14:21.554632 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:21.555369 26539 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:21.472515  4311 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 36.20, Last appended by leader: 20, Current term: 38, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:21.542259  4572 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:21.566083  4572 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:21.566658  4572 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:21.567884  4324 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:21.554353  4508 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:14:21.572263  4508 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.572618  4508 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:14:21.546110  4643 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election lost for term 32. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33.
I20260709 12:14:21.560492 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:21.564069  4701 log.cc:927] Time spent T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:14:21.543087  4645 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:14:21.575625 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:21.537003  4500 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:21.584880  4551 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:21.558686  4506 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 12:14:21.583433 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 94674.1us
I20260709 12:14:21.548429  4607 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:21.546682  4447 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:21.592023 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:21.583351  4341 consensus_meta.cc:287] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.798s	user 0.015s	sys 0.000s
I20260709 12:14:21.595227 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:21.607216 26468 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36.
I20260709 12:14:21.586151  4645 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:21.607609 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:21.625429  4645 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:21.618018 26539 raft_consensus.cc:2410] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 35 because replica has last-logged OpId of term: 34 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 32 index: 17.
I20260709 12:14:21.622165  4607 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:21.595225  4229 consensus_meta.cc:287] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.728s	user 0.009s	sys 0.008s
I20260709 12:14:21.633296  4590 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:21.589461  4596 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:21.609437  4682 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:14:21.657152 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:21.658097 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:21.658253 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:21.663599 26545 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
I20260709 12:14:21.652671 26438 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:21.665942 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:21.687327 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:21.658795  4155 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:21.615897  4341 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:21.690515 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:21.672468  4690 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:21.696470 27165 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: [29.21-29.21]
I20260709 12:14:21.695868 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:21.644444  4229 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:21.694571  4292 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Leader election won for term 39
I20260709 12:14:21.710012  4696 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:21.707659 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:21.700810  4698 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:21.720610  4341 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:21.721704  4447 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:21.672405  4587 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 27.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.050s
I20260709 12:14:21.743732  4587 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:14:21.744220  4587 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:14:21.744484 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.745170  4587 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:21.746980  4690 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.747601  4690 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:21.747675  4645 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:21.749239 27163 raft_consensus.cc:1240] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27. Ops: []
I20260709 12:14:21.750000  4690 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:21.661499  4607 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 34.22, Next index: 23, Last known committed idx: 22, Time since last communication: 0.035s
W20260709 12:14:21.701138 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.754813 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:21.755836 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:21.756702 26619 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 32: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:21.642467  4508 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:21.759480  4508 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:21.760066  4508 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:21.760612  4508 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:21.672359  4592 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.028s
W20260709 12:14:21.707111  4708 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:14:21.699034  4506 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:21.769178 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:21.771520  4506 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:21.739197 26540 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:21.740842  4698 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:21.740921  4572 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:21.723141  4500 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:21.750785 26539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:14:21.764703 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:14:21.766920 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 140300us
I20260709 12:14:21.776115 26539 raft_consensus.cc:606] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:14:21.776582 26539 raft_consensus.cc:614] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:21.769135 26619 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 35 index: 21. Preceding OpId from leader: term: 36 index: 22. (index mismatch)
I20260709 12:14:21.769879 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:21.770588 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:21.771270 26618 raft_consensus.cc:1275] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:14:21.773907 26615 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 29 index: 16. Preceding OpId from leader: term: 30 index: 16. (term mismatch)
I20260709 12:14:21.778342 26615 pending_rounds.cc:85] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 15
I20260709 12:14:21.778640 26615 pending_rounds.cc:107] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 29.16
I20260709 12:14:21.778875 26615 raft_consensus.cc:2889] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:21.738893  4292 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 39 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:21.698599  4155 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:21.768433  4645 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:21.783174  4691 raft_consensus.cc:2764] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election decision vote started in defunct term 33: won
I20260709 12:14:21.771983  4506 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:21.802803  4698 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:21.809111  4572 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:21.812076  4506 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:21.814859  4354 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:21.780957  4587 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:21.824061  4042 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.824958  4506 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:21.824713  4042 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:21.826581 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 46158.7us
W20260709 12:14:21.831388 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 123864us
I20260709 12:14:21.836002 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:21.836938 27168 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:21.768631  4696 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:21.839282  4696 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:21.839959 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:21.840143  4042 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:21.849102 27168 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:14:21.848703  4691 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 32.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.002s
I20260709 12:14:21.851779  4042 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Stepping down as leader of term 34
I20260709 12:14:21.852218  4042 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:14:21.852506 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.853385 26588 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:21.853148  4042 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 34.18, Last appended by leader: 18, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:21.855106  4706 log.cc:927] Time spent T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.392s	user 0.004s	sys 0.000s
I20260709 12:14:21.855257  4682 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:14:21.849391  4663 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:14:21.855867  4682 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:21.856122  4663 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:21.856596  4663 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:21.856920  4682 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:21.857969  4042 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:21.863431 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:21.830812  4229 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:21.900431 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 25 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:21.901048 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:14:21.904608 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.908533 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:21.912751 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:21.913767 26540 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:14:21.914781  4292 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 37.18, Last appended by leader: 18, Current term: 39, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:21.917447 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:21.919085 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:21.913084 26513 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:21.900507 27168 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 28 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: []
I20260709 12:14:21.921533 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:21.924153 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:21.926344 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:21.929459 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:21.929932 26471 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 35. Current term is 36. Ops: [35.21-35.21]
I20260709 12:14:21.930131 26541 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 35.
I20260709 12:14:21.932031 26472 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 33: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:21.845424  4324 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.072s
I20260709 12:14:21.900552  4341 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election won for term 37
I20260709 12:14:21.948714 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:21.922483  4515 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.951222 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:21.952454 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:21.955150 26465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 5011) took 1520 ms (client timeout 1855 ms). Trace:
I20260709 12:14:21.947870  4341 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:21.956108  4155 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:21.963792 26465 rpcz_store.cc:269] 0709 12:14:20.434652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.481352 (+ 46700us) service_pool.cc:224] Handling call
0709 12:14:21.954951 (+1473599us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001a7f54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:21.955078 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2457956224}
I20260709 12:14:21.963781 26471 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:21.968627 26539 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 27.
I20260709 12:14:21.940102  4572 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:14:21.968780 26540 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:14:21.971571 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:21.977605 26472 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 36.
I20260709 12:14:21.982304 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:21.982167 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:21.983029 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:21.983728 26464 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Advancing to term 36
W20260709 12:14:21.949957  4582 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 26 current term: 26 is higher.
I20260709 12:14:21.985893 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:21.979336  3778 consensus_queue.cc:1059] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 31.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.005s
I20260709 12:14:21.970969  4341 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:21.987778 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:21.990302 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:21.991587 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:21.993702  3778 raft_consensus.cc:3055] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:14:21.994266  3778 raft_consensus.cc:740] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:21.997663 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:21.998219 26465 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: []
I20260709 12:14:21.960409  4289 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 33.22, Next index: 23, Last known committed idx: 22, Time since last communication: 0.027s
I20260709 12:14:21.999989 26472 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 27. Current term is 28. Ops: []
I20260709 12:14:22.001734 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:21.998533 27165 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:14:22.005935 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:21.971032  4515 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.013581 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:22.005360  3778 consensus_queue.cc:260] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 31.20, Last appended by leader: 20, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:21.892218  4687 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.113s
I20260709 12:14:22.047847  4515 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:22.049299  4691 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.048642  4719 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.052695  4719 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:22.008435  4552 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:22.054728  4552 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:22.055123  4552 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:22.055059 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:22.056567 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:22.057476 26613 raft_consensus.cc:2393] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 27: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:22.001843  4572 raft_consensus.cc:697] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:22.049543 26464 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36.
I20260709 12:14:22.058410 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:22.050292  4691 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.059262  4572 consensus_queue.cc:237] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 35.23, Last appended by leader: 23, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:22.059747 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 37 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:22.060343 26613 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Advancing to term 39
I20260709 12:14:22.066718 26465 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 32 index: 19. (index mismatch)
I20260709 12:14:22.066763 26471 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36.
I20260709 12:14:22.073454  3778 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:14:22.084708 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 105476us
I20260709 12:14:22.089550 26587 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:22.100533 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:22.107451 26472 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 31 index: 19. Preceding OpId from leader: term: 36 index: 22. (index mismatch)
W20260709 12:14:22.107615 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.111156 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:22.104729 26613 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 39.
I20260709 12:14:22.109972  4289 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:22.131860  4682 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
I20260709 12:14:22.109689  4590 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:22.117239  4687 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 12:14:22.137775 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:22.096920  4386 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.039s
I20260709 12:14:22.094820  4663 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:22.149513  4590 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:22.150707  4719 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:22.151144  4716 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:22.150947  4728 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:14:22.114475  4515 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 30.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.029s
I20260709 12:14:22.135341  4500 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.164288 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:22.167971 26470 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:22.164386  4691 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:22.174243  4727 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.278s	user 0.002s	sys 0.000s
I20260709 12:14:22.190649 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:14:22.199018 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 81829.1us
I20260709 12:14:22.188890 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:22.157985  4716 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.217260  4590 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:22.220234 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:22.221382  4341 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:22.165489  4500 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.229116 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:22.230556 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 25 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:22.231664 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:22.231926  4716 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:22.235109  4732 log.cc:927] Time spent T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:14:22.235725  4447 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 34 LEADER]: Stepping down as leader of term 34
I20260709 12:14:22.236207  4447 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 34 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:22.237231  4447 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 34.22, Last appended by leader: 22, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:22.238833  4702 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 0.751s	user 0.005s	sys 0.000s
I20260709 12:14:22.242244 26618 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 28.
I20260709 12:14:22.244388 26615 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:14:22.245555 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:22.246634 26615 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:14:22.248850  4508 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:22.243463 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:22.250725 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:22.251030 26620 raft_consensus.cc:2410] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 35 because replica has last-logged OpId of term: 34 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 32 index: 17.
I20260709 12:14:22.257339 26618 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:22.223023  4515 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.256494 26615 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:14:22.265848 27134 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:22.206250  4552 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.268734 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:22.257714  4447 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:22.274266 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:22.226218 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:22.261579  4515 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.270809  4508 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:14:22.276424 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:22.276895  4508 raft_consensus.cc:697] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 24 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:22.277168 26472 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:22.277937  4508 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:22.278662  4738 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:14:22.278761 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:22.285233 26467 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:14:22.285950 26614 raft_consensus.cc:2368] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 41 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 40. Current term is 41.
I20260709 12:14:22.286552 26472 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 35. Current term is 36. Ops: []
I20260709 12:14:22.282070 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:22.288360 26618 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:22.290791 26615 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 32 index: 22. Preceding OpId from leader: term: 34 index: 23. (index mismatch)
I20260709 12:14:22.295125  3778 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.295619  3778 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:22.296177 26470 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:14:22.299661  4341 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:22.305506  4042 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.306103  4042 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.307255  4698 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260709 12:14:22.308272  4042 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:22.277947  4515 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:22.310097  3778 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:22.310798  4744 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:14:22.308272  4552 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:22.313796 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 25 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:22.315786  4687 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:14:22.316239  4687 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:22.314119 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:22.321105 26615 raft_consensus.cc:1240] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 25. Current term is 26. Ops: []
I20260709 12:14:22.328874  4687 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 30.17, Last appended by leader: 17, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.330474 26618 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33. Ops: []
I20260709 12:14:22.271283  4734 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:22.331030 27160 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
W20260709 12:14:22.371243 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:22.372340  4726 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.322s	user 0.003s	sys 0.000s
I20260709 12:14:22.374338 26540 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 35. Current term is 36. Ops: []
I20260709 12:14:22.380774 26540 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:22.373016  4552 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.392573  4552 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.388741  4663 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:22.413285  4324 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.414757  4324 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:22.416811  4582 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:22.417277  4324 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:22.417466  4582 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.432894 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:22.443130 26540 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 34. Current term is 35. Ops: []
I20260709 12:14:22.446753 26545 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 33 index: 17. Preceding OpId from leader: term: 37 index: 19. (index mismatch)
W20260709 12:14:22.465345 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.458806 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:14:22.472527 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.477828 26541 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 35. Current term is 36. Ops: []
I20260709 12:14:22.483131 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:22.483958 27163 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:14:22.441881  4663 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.486802  4552 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:22.487290  4663 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.488646 26464 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 31 index: 18. Preceding OpId from leader: term: 36 index: 20. (index mismatch)
I20260709 12:14:22.488710 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:22.488946 26471 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
I20260709 12:14:22.489624  4663 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:22.470703  4696 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:22.496922 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 202209us
W20260709 12:14:22.497906 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.498134 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:22.498950 26545 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:14:22.499079 26438 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:22.507658 26514 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:22.496143  4641 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.006s	sys 0.020s
I20260709 12:14:22.491199  4740 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:22.539172  4740 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.539615  4740 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:22.539992  4685 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:14:22.540426  4685 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:22.541359  4685 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 33.22, Last appended by leader: 22, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.536742  4365 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:14:22.483726  4500 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:22.531925 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.537792 26514 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:22.537169 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:14:22.536592  4641 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.006s	sys 0.020s
I20260709 12:14:22.490864  4696 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:22.536542  4324 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 32.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.002s
I20260709 12:14:22.550484  4341 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election won for term 37
I20260709 12:14:22.550575 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:22.551062  4341 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.551543  4341 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:22.551815  3778 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Stepping down as leader of term 35
I20260709 12:14:22.552314  3778 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:22.550576  4587 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 29.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 12:14:22.553210  3778 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 35.21, Last appended by leader: 21, Current term: 35, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.543651  4582 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:22.555128  4691 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:22.555202  4685 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:22.555720  4691 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.556136  4691 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:22.553591  4587 raft_consensus.cc:3055] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:14:22.558266  3778 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:22.558544 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:22.569092 26545 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 33: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:22.565585 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:22.522760  4663 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:14:22.576891 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:22.579387 26464 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 27. Current term is 28. Ops: []
I20260709 12:14:22.595398 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:22.579983 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:22.571705  4155 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
W20260709 12:14:22.622028 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 150290us
I20260709 12:14:22.622882 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:22.623268 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:22.600442 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:22.617662 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 25 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:22.565579  4587 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:22.573431  4515 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election won for term 32
W20260709 12:14:22.638034 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 158536us
I20260709 12:14:22.646361 26471 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:22.646847 26588 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:22.647579 26541 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 32: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:22.647647 26469 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:14:22.648026 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 37 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:22.648960 26470 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 38.
I20260709 12:14:22.650134 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:22.573099  4682 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 35.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.059s
I20260709 12:14:22.609486  4663 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:22.644093 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:22.643371 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:22.656648 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:22.579596  4641 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.067s
I20260709 12:14:22.579685  4552 consensus_queue.cc:1048] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.070s
I20260709 12:14:22.680718 26548 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:22.684496 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:22.648445  4289 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.513s	user 0.014s	sys 0.006s
I20260709 12:14:22.688128  3778 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:14:22.701021  3778 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.701429  3778 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:22.601908  4365 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.046s
I20260709 12:14:22.639299  4311 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:22.652993  4324 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.650786  4581 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:22.710968 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:22.682428  4689 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.029s	sys 0.040s
I20260709 12:14:22.640883  4515 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.684042  4155 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:22.725845 26548 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
W20260709 12:14:22.747483 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 98846us
W20260709 12:14:22.734251  4689 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.030s	sys 0.040s
I20260709 12:14:22.746677  4515 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:22.762763 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:22.763836 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 41 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:22.764616 26470 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 39.
I20260709 12:14:22.765887 26470 raft_consensus.cc:1240] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 35. Current term is 36. Ops: []
I20260709 12:14:22.766793 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 37 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:22.768481 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:22.769179 26546 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:14:22.717417  4289 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:22.775381  4641 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:14:22.744390 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 97632us
W20260709 12:14:22.777455 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.755071 26471 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 37.
I20260709 12:14:22.733574  4713 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:22.746223  4324 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.784840 26548 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 33. Current term is 34. Ops: []
I20260709 12:14:22.732260  3778 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:22.780381 26468 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 36. Current term is 37. Ops: []
I20260709 12:14:22.775770 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:22.781234  4663 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 31.19, Last appended by leader: 19, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.781857  4687 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:22.781919 26613 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 41 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 39 index: 25. Preceding OpId from leader: term: 41 index: 26. (index mismatch)
W20260709 12:14:22.765803  4757 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:14:22.788179 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:22.779160  4354 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:14:22.793174  3778 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:22.794888  4324 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:22.796236  4341 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.733686  4311 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.797043  4740 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:22.797816  4552 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:14:22.748250  4762 consensus_queue.cc:1059] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 35.23, Next index: 24, Last known committed idx: 23, Time since last communication: 0.058s
W20260709 12:14:22.799952  4755 log.cc:927] Time spent T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.121s	user 0.003s	sys 0.000s
I20260709 12:14:22.793093  4354 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 27 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:22.824666  4311 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:22.755641 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:22.835753 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 186000us
I20260709 12:14:22.836156  4691 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.791445  4696 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:22.724416  4587 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 29.15, Last appended by leader: 15, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.848970 26468 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 30 index: 21. Preceding OpId from leader: term: 31 index: 21. (term mismatch)
I20260709 12:14:22.813489 26470 raft_consensus.cc:1240] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 35. Current term is 36. Ops: [35.23-35.23]
I20260709 12:14:22.866451 26468 pending_rounds.cc:85] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 20
I20260709 12:14:22.866748 26468 pending_rounds.cc:107] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 30.21
I20260709 12:14:22.862927 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:22.866997 26468 raft_consensus.cc:2889] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:22.867251 27160 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:22.791914  4641 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.872349 27163 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:14:22.872412 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:22.873485 26464 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:14:22.875656  4587 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:22.877576  4776 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.878144  4776 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.878736  4762 raft_consensus.cc:3055] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 35 LEADER]: Stepping down as leader of term 35
I20260709 12:14:22.879191  4762 raft_consensus.cc:740] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 35 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:22.880638  4776 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:22.880183  4762 consensus_queue.cc:260] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 35.23, Last appended by leader: 23, Current term: 35, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:22.882370 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 129841us
I20260709 12:14:22.881848  4762 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:22.883244 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:22.884143  4696 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:22.884598  4696 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:22.884976  4696 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:22.857250  4552 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:22.891367 26470 raft_consensus.cc:3055] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:14:22.891815 26470 raft_consensus.cc:740] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:22.890522  4508 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 23, Time since last communication: 0.002s
I20260709 12:14:22.907049 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 31 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:22.908972 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:22.910112 26539 raft_consensus.cc:3060] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:22.914354 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:22.914547 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 35 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:22.914819 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:22.915279 26545 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 37.
I20260709 12:14:22.916049 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:22.918107 26546 raft_consensus.cc:1240] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28. Ops: []
I20260709 12:14:22.918277 26541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:14:22.919104 26540 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 31: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:22.919039 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:22.911871 26470 consensus_queue.cc:260] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.20, Last appended by leader: 20, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:22.921144  4743 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Stepping down as leader of term 35
I20260709 12:14:22.921563  4743 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:22.921696 26547 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 37 index: 18. Preceding OpId from leader: term: 39 index: 19. (index mismatch)
I20260709 12:14:22.919647 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:22.925236 27160 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
W20260709 12:14:22.926491 26436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.927826 26470 raft_consensus.cc:3060] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:22.929975 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:22.930038 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:22.930001 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 154307us
I20260709 12:14:22.931161 26541 raft_consensus.cc:606] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:14:22.934623 26541 raft_consensus.cc:614] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:22.934726 26513 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:22.925748  4761 raft_consensus.cc:2764] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election decision vote started in defunct term 27: won
I20260709 12:14:22.931143  4582 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader pre-election won for term 38
I20260709 12:14:22.972263 26539 raft_consensus.cc:2468] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:14:22.975695  4515 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:22.983355 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 48716.7us
I20260709 12:14:22.962734 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 41 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:22.984970 26472 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Advancing to term 41
I20260709 12:14:22.950681  4552 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 35.21, Last appended by leader: 21, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.943786  4500 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 12:14:22.968381  4691 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:22.995253  4307 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 35.22, Next index: 23, Last known committed idx: 22, Time since last communication: 0.084s
I20260709 12:14:22.912048  4354 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.992502  4311 raft_consensus.cc:2804] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:14:22.999017  4773 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.007s
I20260709 12:14:23.000350  4740 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:23.000922 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 34 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:23.002332 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:23.002753 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:23.003095 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:23.011545 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:23.012444 26617 raft_consensus.cc:2393] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 32: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:23.012732 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:23.013362 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:23.014056 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:23.015477 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 34 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:22.957890  4641 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:23.007745 26588 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:14:23.060439 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 52843.1us
I20260709 12:14:23.061501  3778 raft_consensus.cc:2804] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:14:23.062453  3778 raft_consensus.cc:697] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:23.008692 26618 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 32 index: 19. (index mismatch)
I20260709 12:14:23.063617  3778 consensus_queue.cc:237] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 26.20, Last appended by leader: 20, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:23.064215 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:23.065035 26618 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
I20260709 12:14:23.018694 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 35 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:23.019345 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:23.067780 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:23.067883 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:23.068259 26541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c"
dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
mode: GRACEFUL
new_leader_uuid: "01a57027214a411e80874ac7febd628b"
 from {username='slave'} at 127.0.0.1:45356
I20260709 12:14:23.068423 26613 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36.
I20260709 12:14:23.069314 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:23.069451 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:23.070104 26613 raft_consensus.cc:2410] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 39 because replica has last-logged OpId of term: 37 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 31 index: 18.
I20260709 12:14:23.019775 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:23.022233 27160 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 34. Current term is 35. Ops: []
I20260709 12:14:23.022432 26466 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:14:22.953720 27133 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.818s (SENT) [suppressed 7 similar messages]
I20260709 12:14:23.025161 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:22.972347  4582 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:23.025405 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 31 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:23.026194 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 41 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:23.026747 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:23.026889 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:23.027276  4289 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.027352  4690 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:23.008896  4734 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.020s
I20260709 12:14:23.028447 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:23.029783  4311 raft_consensus.cc:697] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:23.031662  4687 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 31.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:14:22.922482  4743 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 35.21, Last appended by leader: 21, Current term: 35, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:22.998958  4354 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:23.037643 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:14:23.096339 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 58779.5us
I20260709 12:14:23.097438 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:23.037920  4587 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:14:23.040630  4643 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:23.041289  4572 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:23.110427 26472 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 41 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 41.
I20260709 12:14:23.043627  4710 raft_consensus.cc:3055] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 35 LEADER]: Stepping down as leader of term 35
I20260709 12:14:23.047231  4341 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:23.116393 26469 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 41 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 39 index: 25. Preceding OpId from leader: term: 41 index: 26. (index mismatch)
I20260709 12:14:23.116667 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:23.054543 26514 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:23.059092  4447 consensus_meta.cc:287] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.779s	user 0.015s	sys 0.001s
I20260709 12:14:23.066067 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:23.074101 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:23.120479 26618 raft_consensus.cc:1240] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 36. Current term is 37. Ops: [36.22-36.22]
I20260709 12:14:23.075150 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:23.079599 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:23.121309 27168 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:23.121510 26473 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 36: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:23.080515 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:23.124058 26471 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:14:23.080880 26615 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:14:23.082109 26465 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 33 index: 22. Preceding OpId from leader: term: 36 index: 24. (index mismatch)
I20260709 12:14:23.112766 26470 raft_consensus.cc:1275] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 27 index: 20. Preceding OpId from leader: term: 28 index: 20. (term mismatch)
I20260709 12:14:23.082911 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:23.070358 26621 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:14:23.074443 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:23.105574 26464 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 31.
I20260709 12:14:23.043282  4515 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:23.115021 26439 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:23.142061 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 87596us
I20260709 12:14:23.127662 26470 pending_rounds.cc:85] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 19
I20260709 12:14:23.078691  4582 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:23.143443 26470 pending_rounds.cc:107] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 27.20
I20260709 12:14:23.144038 26470 raft_consensus.cc:2889] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:23.079383  4689 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:23.109990  4773 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.074874 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:23.159556 27160 raft_consensus.cc:2368] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28.
I20260709 12:14:23.049937  4696 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:23.145879 26615 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 36. Current term is 37. Ops: []
I20260709 12:14:23.080111  4776 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:23.151028 26616 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 37 index: 21. Preceding OpId from leader: term: 38 index: 21. (term mismatch)
I20260709 12:14:23.167568 26616 pending_rounds.cc:85] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 20
I20260709 12:14:23.162242 26514 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:23.142796 26468 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
I20260709 12:14:23.140805 26467 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 35.
I20260709 12:14:23.112708  4324 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:23.173596 26616 pending_rounds.cc:107] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 37.21
I20260709 12:14:23.174028 26616 raft_consensus.cc:2889] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:23.111977  4710 raft_consensus.cc:740] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 35 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:23.082412  4289 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:23.174413 26514 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:23.095293  4749 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 35.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.069s
I20260709 12:14:23.128648  4767 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:23.144747  4690 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.176151  4324 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.196023 26514 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:23.152630  4716 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:23.190075 27168 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:14:23.160889  4641 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
I20260709 12:14:23.193456 26613 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 33 index: 16. Preceding OpId from leader: term: 39 index: 19. (index mismatch)
I20260709 12:14:23.194504 27162 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 35. Current term is 36. Ops: []
W20260709 12:14:23.202602 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 88007us
I20260709 12:14:23.205940 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:23.214538 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:23.218201 26466 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 32 index: 22. Preceding OpId from leader: term: 34 index: 23. (index mismatch)
I20260709 12:14:23.219134 26439 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:23.168004  4643 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:23.220429 26439 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:23.184748  4581 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:23.222056 26622 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 12:14:23.222046 26541 raft_consensus.cc:606] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Received request to transfer leadership to TS 01a57027214a411e80874ac7febd628b
I20260709 12:14:23.228689 26439 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:23.227305 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.198339  4365 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:23.237586  4767 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:23.221624  4713 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:23.238384  4713 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.238785  4713 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:23.239675  4770 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:23.241781  4643 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 31.19, Last appended by leader: 19, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:23.229893  4506 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election lost for term 35. Reason: could not achieve majority
I20260709 12:14:23.200739  4324 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:23.178872  4229 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 22, Time since last communication: 0.047s
I20260709 12:14:23.177616  4776 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:23.234025  4581 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.167687  4689 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:23.180773  4771 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.077s
I20260709 12:14:23.259586 26439 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:23.233208  4447 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:14:23.269476 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:23.177162  4773 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:23.277297 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.245349  4716 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election lost for term 36. Reason: could not achieve majority
I20260709 12:14:23.245290  4365 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:23.212883  4763 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 36.25, Next index: 26, Last known committed idx: 25, Time since last communication: 0.047s
I20260709 12:14:23.282270 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:23.213459  4155 consensus_queue.cc:1059] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 35.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.041s
I20260709 12:14:23.216988  4690 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:23.284926  4515 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:23.285198  4447 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
W20260709 12:14:23.286324  4778 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:14:23.287968 26439 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:23.218977  4311 consensus_queue.cc:237] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 35.22, Last appended by leader: 22, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:23.260208  4767 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:23.301107  4682 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:23.302675 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:23.292992  4365 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Advancing to term 36
W20260709 12:14:23.300688 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 346999us
I20260709 12:14:23.273797  4581 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:23.302287 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:23.323252 26439 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:23.283488  4042 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election won for term 39
W20260709 12:14:23.345877 27133 leader_election.cc:336] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.917s (SENT)
I20260709 12:14:23.353551  4506 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:23.359115  4725 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:23.361577  4776 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:23.328758  4716 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:23.366425 26439 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:23.335760  4155 raft_consensus.cc:3055] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Stepping down as leader of term 36
W20260709 12:14:23.374104 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 160039us
I20260709 12:14:23.344225  4042 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.382702 26439 leader_election.cc:400] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 41 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 40. Current term is 41.
I20260709 12:14:23.383083 26439 leader_election.cc:403] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:14:23.388520 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:23.392338 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 89832.4us
I20260709 12:14:23.393842 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:23.406950 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:23.406985 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:23.409152 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:23.410053 26542 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:23.414028 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:23.414883 26473 raft_consensus.cc:3060] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 32
I20260709 12:14:23.367300  4747 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:23.413499 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:14:23.426980  4783 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:14:23.428524 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:23.429886 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:23.430579 26472 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:23.432888 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:23.433590 26543 raft_consensus.cc:3060] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:23.282079  4710 consensus_queue.cc:260] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 35.22, Last appended by leader: 22, Current term: 35, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:23.382345  4447 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:23.438591  4716 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 32.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 12:14:23.379652  4155 raft_consensus.cc:740] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:23.419354  4685 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:23.395612  4229 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.060s
I20260709 12:14:23.455886  4685 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.456539  4685 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:23.456100  4155 consensus_queue.cc:260] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 36.22, Last appended by leader: 22, Current term: 36, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:23.449968 26546 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:23.395516  4042 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Advancing to term 39
I20260709 12:14:23.398101  4341 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader election won for term 37
I20260709 12:14:23.468277 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:23.472061 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 126255us
W20260709 12:14:23.477244 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 59724.8us
I20260709 12:14:23.479233 26439 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:23.401484  4663 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 41 FOLLOWER]: Leader pre-election lost for term 40. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 41 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 40. Current term is 41.
I20260709 12:14:23.481653 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 34 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:23.483619 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:23.484516 26469 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
W20260709 12:14:23.473213  4786 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:14:23.493979 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:23.458133  4447 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:23.475453  4289 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:23.499444  4341 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:23.439139  4767 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 30.20, Last appended by leader: 20, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:23.503096 27161 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 12:14:23.497822  4155 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:23.504351 27166 raft_consensus.cc:1275] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 35 index: 23. Preceding OpId from leader: term: 36 index: 24. (index mismatch)
I20260709 12:14:23.505934 26546 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:14:23.507602 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:23.504272 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:23.534646  4743 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:23.449957  4747 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:23.537087  4784 log.cc:927] Time spent T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:14:23.534162 26542 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
W20260709 12:14:23.510883  4787 log.cc:927] Time spent T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:14:23.547957 27133 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:23.536595 26472 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:14:23.504482  4645 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.554982 26473 raft_consensus.cc:2468] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:14:23.565788 26473 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 35 index: 21. Preceding OpId from leader: term: 36 index: 22. (index mismatch)
I20260709 12:14:23.557214  4689 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:23.569046  4645 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:23.546959  4447 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:23.570652  4769 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:23.587033 26543 raft_consensus.cc:2468] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:14:23.499722  4802 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:23.614923  4663 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:23.624889  4802 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:23.621707  4508 consensus_queue.cc:1059] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 35.22, Next index: 23, Last known committed idx: 22, Time since last communication: 0.019s
W20260709 12:14:23.655366 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.662453 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:23.644085  4768 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:14:23.666908  4768 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:23.667909  4768 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 31.17, Last appended by leader: 17, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:23.669361  4768 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:14:23.671169  4793 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:14:23.674777  4294 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 36 LEADER]: Stepping down as leader of term 36
W20260709 12:14:23.675216  4582 consensus_meta.cc:287] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.510s	user 0.012s	sys 0.000s
I20260709 12:14:23.675395  4294 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 36 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:23.675766  4582 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:23.685041  4801 log.cc:927] Time spent T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:14:23.641126  4663 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:23.633942  4725 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:23.689829 26469 raft_consensus.cc:1240] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 37. Current term is 38. Ops: []
W20260709 12:14:23.691992 27133 leader_election.cc:336] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.502s (SENT)
I20260709 12:14:23.698761 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:23.689419  4689 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.714361  4689 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:23.714684 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:23.634176  4341 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 36.25, Last appended by leader: 25, Current term: 37, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:23.716724  4689 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:23.718228  4645 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:23.689153  4506 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:23.720585  4506 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:23.721168  4506 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:23.721663 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:23.722892  4643 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:14:23.724082  4771 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:23.724017  4713 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:23.719084  4042 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:23.738991 27133 leader_election.cc:336] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 41 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 2.077s (SENT)
I20260709 12:14:23.634970  4781 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 36.25, Next index: 26, Last known committed idx: 25, Time since last communication: 0.076s
I20260709 12:14:23.682312  4747 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:23.746239 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 267046us
I20260709 12:14:23.746838 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:23.644107  4457 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.099s
I20260709 12:14:23.709004  4354 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:23.753739 26622 raft_consensus.cc:1240] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 38. Current term is 39. Ops: [38.21-38.21]
I20260709 12:14:23.713240  4582 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:23.742710 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 222190us
I20260709 12:14:23.792770 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:23.793751 26617 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 34.
I20260709 12:14:23.747437 26439 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:23.685058  4365 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:23.797887 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 50586us
I20260709 12:14:23.799014 26439 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:23.800215  4042 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:23.800374  4810 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:23.801398  4810 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:23.801862  4810 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:23.786620  4689 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:23.803542 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:23.807945 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.811501  4716 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:14:23.815383  4813 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader election lost for term 37. Reason: could not achieve majority
I20260709 12:14:23.817617 26587 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:23.796386  4354 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:23.819767  4799 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:14:23.820538  4354 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:23.821693 26541 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 28. Current term is 29. Ops: []
I20260709 12:14:23.822781  4341 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.823316  4341 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:23.824563  4802 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:23.825507  4341 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:23.827190  4506 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:23.828334 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 37 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:23.828542  4447 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:23.421908 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:23.756497  4641 consensus_queue.cc:1048] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.075s
I20260709 12:14:23.742370  4685 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:23.832711 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:23.834168  4685 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:23.783150  4713 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:23.840127 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.842873 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:23.741976  4229 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.061s
I20260709 12:14:23.834506 26619 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33. Ops: [28.17-32.19]
I20260709 12:14:23.830647 26439 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:23.963697 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 80411.6us
W20260709 12:14:23.964660 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 134810us
I20260709 12:14:23.862865 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:23.872058 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:23.833981 26587 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:23.873549 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:23.880632 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:23.875085 26514 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:23.750661  4324 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:23.972110 27160 raft_consensus.cc:2393] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 35: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:23.966622 26621 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:14:23.967612 26615 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:14:23.915164 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:23.915097 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:23.975823 26541 raft_consensus.cc:2410] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 31 because replica has last-logged OpId of term: 29 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 20.
I20260709 12:14:23.962903 26613 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:14:23.968900 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 93889.7us
I20260709 12:14:23.867563  4685 raft_consensus.cc:2804] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election won for term 34
W20260709 12:14:23.979224 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 147486us
W20260709 12:14:23.980497 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 99968us
I20260709 12:14:23.951869  4689 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:23.979615 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:23.990212 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:23.990561  4687 consensus_queue.cc:1059] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 37.19, Next index: 20, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:23.991852  4687 raft_consensus.cc:3055] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Stepping down as leader of term 37
I20260709 12:14:23.992337  4687 raft_consensus.cc:740] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:23.992408 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:23.993896 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:23.996510  4745 raft_consensus.cc:2804] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:23.997740  4685 raft_consensus.cc:697] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:23.998042 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 36 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:23.998304  4689 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:23.999859 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:23.999929 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:24.003577  4365 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:24.004205  4506 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:24.010207 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 36 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:23.973057  4581 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.005s
W20260709 12:14:23.973353  4822 log.cc:927] Time spent T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:14:24.010723 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:24.037163 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53919.9us
I20260709 12:14:24.018978 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:24.038180 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:24.021761 26469 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:14:24.017197 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:23.993525  4687 consensus_queue.cc:260] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 37.19, Last appended by leader: 19, Current term: 37, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:23.978881  4552 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:23.999984  4447 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
W20260709 12:14:24.035382 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.040130 26439 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:24.039129 26546 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:14:23.973534  4781 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.057s
I20260709 12:14:24.042764 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:24.017942  4698 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:24.023495  4590 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:14:24.097376 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:24.098817 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 119311us
I20260709 12:14:24.099606 26514 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:24.058219 26613 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
W20260709 12:14:24.107344 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 69249.6us
I20260709 12:14:24.041332  4552 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.047825  4582 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:24.115453 26439 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:24.070006  4682 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:24.065412  4716 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:24.065053  4745 raft_consensus.cc:697] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:24.040148  4581 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:24.148255  4582 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:24.106267  4663 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:24.110725  4713 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:24.174710 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:24.180524 27162 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:14:24.183126 26613 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 12:14:24.185328 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 69975.2us
I20260709 12:14:24.151590  4802 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:24.177330  4806 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election won for term 30
W20260709 12:14:24.159371  4823 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:14:24.146080  4506 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:24.116693  4771 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:24.127573  4552 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:24.149971  4685 consensus_queue.cc:237] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 32.17, Last appended by leader: 17, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:24.233256  4771 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:24.239611  4771 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:24.241988 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 5055) took 1097 ms. Trace:
I20260709 12:14:24.242470 26465 rpcz_store.cc:276] 0709 12:14:23.144350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.175673 (+ 31323us) service_pool.cc:224] Handling call
0709 12:14:23.191317 (+ 15644us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:14:23.191883 (+   566us) raft_consensus.cc:1534] Early marking committed up to index 19
0709 12:14:23.561710 (+369827us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b1800370e40. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f5079ad23c7 00007f50760e49a7 00007f50760f40bf 00007f50760f4038
0709 12:14:23.750905 (+189195us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.022765 (+271860us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:14:24.090732 (+ 67967us) log.cc:844] Serialized 78 byte log entry
0709 12:14:24.090976 (+   244us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:14:24.149150 (+ 58174us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.149393 (+   243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.149469 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:24.241707 (+ 92238us) raft_consensus.cc:1685] finished
0709 12:14:24.241731 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.241922 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45488,"prepare.queue_time_us":369872,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":10478,"raft.run_cpu_time_us":467,"raft.run_wall_time_us":49824,"spinlock_wait_cycles":13100544,"thread_start_us":405102,"threads_started":2,"wal-append.queue_time_us":451364}
I20260709 12:14:24.249892  4552 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:24.252851  4552 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:24.256846  4500 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:14:24.257486  4500 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 32 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:24.263615 26548 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 20. Preceding OpId from leader: term: 28 index: 21. (index mismatch)
I20260709 12:14:24.189100 26439 leader_election.cc:400] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28.
I20260709 12:14:24.180625  4582 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:24.195380  4763 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:14:24.207398  4689 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:24.215648 27167 raft_consensus.cc:1275] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 20. Preceding OpId from leader: term: 28 index: 21. (index mismatch)
I20260709 12:14:24.216548  4770 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 35.22, Next index: 23, Last known committed idx: 22, Time since last communication: 0.001s
I20260709 12:14:24.155324  4682 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.219100  4324 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:24.221148  4341 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.228610 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:24.274766 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:24.275103 26469 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:24.173717  4747 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
I20260709 12:14:24.265046 26439 leader_election.cc:403] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 election: Cancelling election due to peer responding with higher term
W20260709 12:14:24.190901  4155 consensus_meta.cc:287] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.632s	user 0.008s	sys 0.005s
I20260709 12:14:24.180986  4713 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.228935  4802 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.187616  4641 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.087s
I20260709 12:14:24.277298 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:24.275400 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:24.284307 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:24.284917 26470 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 33.
I20260709 12:14:24.285092 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:24.264835  4743 consensus_meta.cc:287] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.703s	user 0.003s	sys 0.010s
I20260709 12:14:24.261797  4806 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:24.292690 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:14:24.292346 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 106211us
I20260709 12:14:24.191618  4810 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:24.272044  4777 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:24.286314  4802 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:24.295413 26467 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
I20260709 12:14:24.283488  4713 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:24.272507  4682 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:24.274690  4689 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:24.310223 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:24.311152 26473 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 36: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:24.296753  4506 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader election lost for term 27. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 27. Current term is 28.
I20260709 12:14:24.285293  4770 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Stepping down as leader of term 35
I20260709 12:14:24.309832 26621 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 28. Current term is 29. Ops: []
I20260709 12:14:24.305024 26615 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 31 index: 19. Preceding OpId from leader: term: 33 index: 20. (index mismatch)
I20260709 12:14:24.295265  4821 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:24.314182 26465 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:14:24.295856  4806 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:24.296245  4690 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:24.321597  4294 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 36.25, Last appended by leader: 25, Current term: 36, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:24.323139  4294 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:24.316947 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:24.284418  4341 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:24.338133 26472 raft_consensus.cc:2468] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:14:24.338354 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 37 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:24.310262  4811 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:24.345453 26469 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:24.346959 26467 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33. Ops: []
I20260709 12:14:24.344599 26620 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36.
I20260709 12:14:24.316211  4770 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:24.361651 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 34 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:24.287170  4745 consensus_queue.cc:237] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 30.17, Last appended by leader: 17, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:24.368172 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:24.334573  4821 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:24.372524 27167 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:24.313830  4689 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:24.399693 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:24.400449 26470 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 35.
I20260709 12:14:24.367024  4581 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:24.409250 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:24.414912 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 41 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:14:24.393486 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 161289us
I20260709 12:14:24.415627 26466 raft_consensus.cc:2376] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 41 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 41. Re-sending same reply.
I20260709 12:14:24.417312  4770 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 35.22, Last appended by leader: 22, Current term: 35, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:24.420060  4682 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:24.421064  4341 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:24.423004  4831 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:14:24.425231  4689 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:24.425832  4689 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.425957  4682 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:24.375337  4506 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.040s
I20260709 12:14:24.352593  4811 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:24.419354  4324 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.445151 26613 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:24.441879 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:24.444904 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:24.443329 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1899) took 1380 ms. Trace:
I20260709 12:14:24.370587  4809 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.454218 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:24.454900 26464 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 35
I20260709 12:14:24.416888  4725 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
W20260709 12:14:24.439101  4825 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:14:24.451956 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:24.449010 26618 rpcz_store.cc:276] 0709 12:14:23.070848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.171989 (+101141us) service_pool.cc:224] Handling call
0709 12:14:23.172393 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:23.187752 (+ 15359us) raft_consensus.cc:1534] Early marking committed up to index 25
0709 12:14:23.837941 (+650189us) spinlock_profiling.cc:243] Waited 7.95 ms on lock 0x7b18003bcf80. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5075c824bc 00007f5072fd048b 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f5079ad23c7 00007f50760e49a7 00007f50760f40bf
0709 12:14:23.856803 (+ 18862us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.233367 (+376564us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:24.242325 (+  8958us) log.cc:844] Serialized 26 byte log entry
0709 12:14:24.242586 (+   261us) raft_consensus.cc:1645] Marking committed up to 25
0709 12:14:24.242644 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.242967 (+   323us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:24.442953 (+199986us) raft_consensus.cc:1685] finished
0709 12:14:24.443072 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.443246 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35819,"prepare.queue_time_us":111022,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":29504,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":8629,"spinlock_wait_cycles":18284928,"thread_start_us":353340,"threads_started":2,"wal-append.queue_time_us":422064}
W20260709 12:14:24.437726  4829 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.218s	user 0.002s	sys 0.000s
I20260709 12:14:24.459034 26513 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:24.460842 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 35 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:24.459317 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:24.461530 26468 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:24.433682  4506 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:14:24.435835  4811 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:24.443831  4324 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:24.448343  4641 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.483836  4773 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:24.483924  4641 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:24.484748 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:24.486790  4641 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:24.456593  4590 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:24.466522  4506 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:24.470623  4365 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:24.471297 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 4032) took 1023 ms. Trace:
I20260709 12:14:24.465317 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:24.492630 26471 rpcz_store.cc:276] 0709 12:14:23.447928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.469233 (+ 21305us) service_pool.cc:224] Handling call
0709 12:14:23.469681 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:23.470103 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:23.470142 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:23.474229 (+  4087us) log.cc:844] Serialized 26 byte log entry
0709 12:14:23.685845 (+211616us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b18004a7040. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:14:24.027353 (+341508us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:14:24.027409 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.027497 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:24.438366 (+410869us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:14:24.471059 (+ 32693us) raft_consensus.cc:1685] finished
0709 12:14:24.471080 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.471228 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25994,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":18494,"spinlock_wait_cycles":40406144,"thread_start_us":341287,"threads_started":1,"wal-append.queue_time_us":666836}
I20260709 12:14:24.494884 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:24.495955 26471 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 30: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:24.497502 26464 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
I20260709 12:14:24.498134 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:24.466704  4685 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Leader election lost for term 39. Reason: could not achieve majority
I20260709 12:14:24.458187  4809 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:24.437347  4821 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:24.373384  4777 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 17, Time since last communication: 0.085s
W20260709 12:14:24.509083 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 43836.9us
I20260709 12:14:24.481611  4814 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.003s
I20260709 12:14:24.483281  4324 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:24.487514  4710 raft_consensus.cc:3060] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:24.547008 26587 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:24.478852  4696 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:24.486054 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:24.426383  4689 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:24.442126  4819 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.051s
I20260709 12:14:24.501189 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:24.432984  4771 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:24.599509 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:24.494110  4641 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:24.517530 26468 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36.
I20260709 12:14:24.502143 26588 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:24.546777  4834 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 12:14:24.572971 26616 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
W20260709 12:14:24.613822 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 111746us
I20260709 12:14:24.614446 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:24.492411  4365 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:24.499233 26513 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:24.619877 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:24.610694 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:24.623335 26618 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:24.501205 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:24.625399 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:24.625998 26471 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 33
W20260709 12:14:24.619911 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 120739us
I20260709 12:14:24.599402  4747 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:24.631693 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:24.633420 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:24.641271 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.629215  4324 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:24.632324 26513 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:24.498556 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:14:24.643909 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.574771  4685 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.056s
I20260709 12:14:24.604346  4552 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.726267 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:24.741551 26622 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
W20260709 12:14:24.712918 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 80696.3us
I20260709 12:14:24.643164  4324 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:24.629588  4365 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:24.746941 26616 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36.
I20260709 12:14:24.698124  4814 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:24.640370  4581 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:14:24.753883 26616 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 33. Ops: []
W20260709 12:14:24.731115  4842 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:14:24.704487  4590 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:14:24.733240  4840 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 12:14:24.734290  4841 log.cc:927] Time spent T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:14:24.740186  4812 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:24.767221 26618 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36.
I20260709 12:14:24.700641  4582 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:24.719177  4682 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:24.770210 26471 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:24.740379  4776 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:14:24.732141  4771 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:24.644749  4341 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:24.750586  4837 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election won for term 33
W20260709 12:14:24.788657 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 146079us
I20260709 12:14:24.773162  4814 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:24.805451  4837 raft_consensus.cc:697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:24.744222  4777 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:24.751567  4324 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:24.791018 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:24.809932 26471 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:24.810335 27168 raft_consensus.cc:2468] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36.
W20260709 12:14:24.791675 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 340093us
I20260709 12:14:24.816488 26514 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:24.792590 26464 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 34.
I20260709 12:14:24.818327 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:24.819255 26464 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:14:24.820320 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:24.701561  4747 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:24.608590  4641 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:24.790671  4812 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:24.804252  4341 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:24.732296  4289 consensus_queue.cc:1048] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.064s
I20260709 12:14:24.751278  4696 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:24.822206 26473 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33. Ops: []
I20260709 12:14:24.749271  4552 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:24.786355  4581 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 35 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:24.826637 26514 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:24.831318  4696 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:24.834846  4812 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:24.836025  4696 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:24.838467  4552 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:24.811292  4837 consensus_queue.cc:237] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 31.19, Last appended by leader: 19, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:24.786149  4590 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:24.810531  4776 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:24.811157  4294 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.851598 26514 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:24.852717 26471 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
I20260709 12:14:24.830104  4386 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:14:24.855217 26464 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 31. Current term is 32. Ops: [31.21-31.21]
I20260709 12:14:24.807337  4682 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:24.828531  4689 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:24.856922 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:24.860122 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:24.861692 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:24.863242 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:24.865116 26471 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:14:24.865777 26545 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 31 index: 19. Preceding OpId from leader: term: 33 index: 20. (index mismatch)
I20260709 12:14:24.864358 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:24.855239  4785 log.cc:927] Time spent T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 1.467s	user 0.006s	sys 0.010s
I20260709 12:14:24.868806 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 35 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:24.855988  4713 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.004s
I20260709 12:14:24.850792  4811 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:24.821588  4777 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:24.868158 26513 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:24.853685  4767 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 41 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:24.879110 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:24.880331 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:24.863214  4807 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:24.869822  4809 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:24.878187  4771 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:24.913162  4771 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:24.855471  4294 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:24.856899  4552 consensus_queue.cc:1059] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 36.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.026s
I20260709 12:14:24.896395 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:24.889277  4807 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:24.935238 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:24.900264  4663 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.003s
I20260709 12:14:24.874368  4386 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:24.891007  4767 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 41 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:24.904320 26614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 5008) took 1881 ms. Trace:
I20260709 12:14:24.905828  4682 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:24.907303  4590 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:24.908318  4582 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:24.908998  4820 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.718s	user 0.011s	sys 0.000s
W20260709 12:14:24.910957  4806 consensus_meta.cc:287] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.001s
I20260709 12:14:24.901724  4848 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:24.911803 26619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 5019) took 1254 ms. Trace:
I20260709 12:14:24.888720  4835 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:24.915421 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:24.915751 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:24.909946  4506 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.19, Last appended by leader: 19, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:24.941470  4807 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:14:24.910889  4847 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:14:24.943152  4696 consensus_queue.cc:1048] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:14:24.944463 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:24.936875 26614 rpcz_store.cc:276] 0709 12:14:23.022906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.024119 (+  1213us) service_pool.cc:224] Handling call
0709 12:14:23.029152 (+  5033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:23.029579 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:23.029611 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:23.030065 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 12:14:23.211141 (+181076us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:14:23.211220 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.211332 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:24.785609 (+1574277us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:14:24.904010 (+118401us) raft_consensus.cc:1685] finished
0709 12:14:24.904034 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.904257 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2884,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"spinlock_wait_cycles":13845376,"thread_start_us":180586,"threads_started":1,"wal-append.queue_time_us":281694}
I20260709 12:14:24.881565  4713 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:24.956378 26622 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
I20260709 12:14:24.958333 26618 raft_consensus.cc:1240] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33. Ops: []
I20260709 12:14:24.924914  4698 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.959936 26619 rpcz_store.cc:276] 0709 12:14:23.657255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.657491 (+   236us) service_pool.cc:224] Handling call
0709 12:14:23.657933 (+   442us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:14:23.970479 (+312546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.911390 (+940911us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b5400194954. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:24.911714 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405294464}
I20260709 12:14:24.922509  4814 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:24.929581 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:24.954722  4802 consensus_meta.cc:287] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.633s	user 0.012s	sys 0.000s
I20260709 12:14:24.945216  4811 raft_consensus.cc:3055] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 38 LEADER]: Stepping down as leader of term 38
I20260709 12:14:24.943881  4769 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 23, Time since last communication: 0.028s
I20260709 12:14:24.970315  4552 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.994489 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:24.944178  4773 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:24.964151  4835 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.914273  4771 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 31.21, Last appended by leader: 21, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:24.902438  4581 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 33.22, Last appended by leader: 22, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:24.958372  4837 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:24.955814  4780 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.035s
I20260709 12:14:24.926779  4776 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 34.18, Last appended by leader: 18, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:24.990677  4849 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:25.013382 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:24.990267  4506 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:25.014576 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:24.990276  4710 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:24.964504  4806 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.023209 26470 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 28.
I20260709 12:14:24.994228  4811 raft_consensus.cc:740] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 38 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:25.026732 26614 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:14:25.014751  4835 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:24.971591  4848 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:24.995476  4802 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.047574 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:25.048024 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:25.049556 26471 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:14:25.050486 26542 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: []
I20260709 12:14:24.994344  4698 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:25.052438 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:25.053920 26470 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
W20260709 12:14:25.060148  4824 log.cc:927] Time spent T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.871s	user 0.007s	sys 0.004s
I20260709 12:14:25.064450  4777 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:25.001500  4386 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.066296 26439 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:25.067404  4713 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:25.067759 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:25.068835  4725 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:25.069026 26439 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:25.069506  4696 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:25.069934  4696 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.070291  4696 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:25.048329 26614 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:14:25.011814  4552 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.036729  4853 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.016780  4773 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.040648  4341 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:25.094354 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:25.106634 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.096726 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3930) took 1678 ms. Trace:
I20260709 12:14:25.110882 26545 raft_consensus.cc:2368] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32.
W20260709 12:14:25.123283 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.108825 26540 rpcz_store.cc:276] 0709 12:14:23.418130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.418422 (+   292us) service_pool.cc:224] Handling call
0709 12:14:23.418803 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:23.644205 (+225402us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:14:23.782113 (+137908us) log.cc:844] Serialized 14 byte log entry
0709 12:14:23.959934 (+177821us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:23.981955 (+ 22021us) log.cc:844] Serialized 52 byte log entry
0709 12:14:23.982231 (+   276us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:14:24.026465 (+ 44234us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.107183 (+ 80718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.107305 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:24.835944 (+728639us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b1800086200. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed522 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:14:25.059308 (+223364us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:14:25.096451 (+ 37143us) raft_consensus.cc:1685] finished
0709 12:14:25.096477 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.096655 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":132437,"prepare.queue_time_us":267941,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":148547,"raft.run_cpu_time_us":431,"raft.run_wall_time_us":58174,"spinlock_wait_cycles":122712832,"thread_start_us":519773,"threads_started":3,"wal-append.queue_time_us":277666}
I20260709 12:14:25.121322 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:25.126668 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 91566us
I20260709 12:14:25.069051  4767 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 42 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:25.069945  4725 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:25.129324 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:25.027905  4837 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:25.141511 26587 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:25.072052  4747 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:25.075217  4590 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
I20260709 12:14:25.143700 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 42 candidate_status { last_received { term: 41 index: 26 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:25.132889  4777 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:25.149765 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:25.033594  4849 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.092558  4582 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 32.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.050s
I20260709 12:14:25.160852  4777 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:25.162477  4849 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:25.172776  4852 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:14:25.174811 26470 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 35 index: 22. Preceding OpId from leader: term: 36 index: 23. (index mismatch)
W20260709 12:14:25.176239 26620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 5001) took 2179 ms (client timeout 1684 ms). Trace:
W20260709 12:14:25.176680 26620 rpcz_store.cc:269] 0709 12:14:22.997172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.002046 (+  4874us) service_pool.cc:224] Handling call
0709 12:14:25.176020 (+2173974us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540003be54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:25.176139 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2952074624}
I20260709 12:14:25.177922 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:25.179198 26617 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 35 index: 21. Preceding OpId from leader: term: 36 index: 22. (index mismatch)
I20260709 12:14:25.180579 26617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 5027) took 1323 ms. Trace:
I20260709 12:14:25.180953 26617 rpcz_store.cc:276] 0709 12:14:23.857643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.857829 (+   186us) service_pool.cc:224] Handling call
0709 12:14:25.178768 (+1320939us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.179651 (+   883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.180287 (+   636us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540003be50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:25.180487 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3037132544}
I20260709 12:14:25.184341  4848 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:25.184517  4810 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:25.146510  4663 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:25.185609  4773 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:25.189745 26622 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 36. Current term is 37. Ops: []
I20260709 12:14:25.192800 26620 raft_consensus.cc:2410] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 31 because replica has last-logged OpId of term: 29 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 20.
I20260709 12:14:25.185243  4663 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.199585  4802 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:25.204928 27168 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56894 (request call id 1359) took 1711 ms (client timeout 2123 ms). Trace:
W20260709 12:14:25.205467 27168 rpcz_store.cc:269] 0709 12:14:23.493497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.493648 (+   151us) service_pool.cc:224] Handling call
0709 12:14:25.204724 (+1711076us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540060de54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:25.204852 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2972157696}
I20260709 12:14:25.216217 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:25.141817  4572 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.233511  4849 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:14:25.153719  4641 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:25.234476 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:25.249096 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:25.118970  4853 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.250308 26616 raft_consensus.cc:2393] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 33: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:25.212425  4552 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:25.259188 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 264800us
I20260709 12:14:25.260079 27133 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:25.122447  4811 consensus_queue.cc:260] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 38.21, Last appended by leader: 21, Current term: 38, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.235320  4768 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:14:25.267330 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:25.286854 26617 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:14:25.291859 26540 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:25.262178 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:25.261984 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:25.259464  4773 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:25.287622 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:25.292865 26614 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 33.
I20260709 12:14:25.292371 26439 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:25.295542 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:25.262952 26616 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 28. Current term is 29. Ops: [28.19-28.19]
I20260709 12:14:25.286702  4447 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.298971 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 5069) took 1019 ms. Trace:
I20260709 12:14:25.304852 26472 rpcz_store.cc:276] 0709 12:14:24.279720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.279864 (+   144us) service_pool.cc:224] Handling call
0709 12:14:25.298779 (+1018915us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b54001a9854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:25.298911 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121897216}
I20260709 12:14:25.299057 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:25.305462 26619 raft_consensus.cc:2393] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 37: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:25.233268  4810 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.056s
I20260709 12:14:25.239144  4572 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.307085 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
W20260709 12:14:25.310897 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 50891.6us
I20260709 12:14:25.312291 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:25.329244 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:25.289922  4849 raft_consensus.cc:697] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:25.329967 26471 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36.
I20260709 12:14:25.304417  4773 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:25.336724  4773 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:25.307931  4552 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.030s
I20260709 12:14:25.337632 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:25.338426 26471 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:25.286597  4500 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 32.20, Last appended by leader: 20, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.339895  4500 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:25.293965  4768 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:25.261852  4802 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.345817 26540 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:25.300482  4582 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:25.304147  4747 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:14:25.314121  4710 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:25.353235 26471 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:14:25.328241  4810 consensus_queue.cc:1243] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 32.21 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 20
I20260709 12:14:25.300295  4641 consensus_queue.cc:1059] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.049s
I20260709 12:14:25.351936  4768 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:14:25.351899  4837 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:25.313730  4447 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.350160  4867 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:25.358788  4582 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.351854  4806 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:25.361249 27133 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:25.379837 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43606 (request call id 5063) took 1108 ms. Trace:
I20260709 12:14:25.453310 26465 rpcz_store.cc:276] 0709 12:14:24.271041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.271534 (+   493us) service_pool.cc:224] Handling call
0709 12:14:25.379621 (+1108087us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b540035edd4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:25.379761 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65219328}
W20260709 12:14:25.459371 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 98315.3us
I20260709 12:14:25.460178 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:25.350059  4802 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:25.364069  4868 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:25.467304 26472 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 29. Current term is 30. Ops: []
I20260709 12:14:25.372414  4698 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:25.375304  4747 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:25.473233 26465 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 36 index: 25. Preceding OpId from leader: term: 37 index: 26. (index mismatch)
I20260709 12:14:25.383929  4354 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:14:25.457217  4365 consensus_meta.cc:287] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.671s	user 0.014s	sys 0.000s
I20260709 12:14:25.464180  4641 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:25.468241  4862 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:25.472028  4810 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:25.540346 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3937) took 1539 ms. Trace:
I20260709 12:14:25.481491  4812 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:25.453565  4867 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.562243 26542 rpcz_store.cc:276] 0709 12:14:24.000484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.009388 (+  8904us) service_pool.cc:224] Handling call
0709 12:14:24.009711 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.051086 (+1041375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.540017 (+488931us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54003cf354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:25.540261 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2392932608}
I20260709 12:14:25.514539  4506 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.597947 26468 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
W20260709 12:14:25.611433 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 462036us
I20260709 12:14:25.617204 26587 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:25.480726  4698 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 29.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.112s
I20260709 12:14:25.464018  4849 consensus_queue.cc:237] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 31.20, Last appended by leader: 20, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.637161 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:25.639992 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:25.643448 26542 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 32 index: 17. Preceding OpId from leader: term: 34 index: 18. (index mismatch)
I20260709 12:14:25.646863 26542 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 17. Preceding OpId from leader: term: 32 index: 18. (index mismatch)
I20260709 12:14:25.593439  4868 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:25.654131  4867 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:25.654368  4582 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:25.594729  4810 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.655098  4747 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 30.17, Last appended by leader: 17, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.656819  4810 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:25.566517  4696 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:25.658658  4572 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:25.659168  4696 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:25.518602  4365 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:25.661123 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 5081) took 1239 ms. Trace:
I20260709 12:14:25.661675  4365 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:25.518169  4354 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:25.662618  4853 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:25.661532 26466 rpcz_store.cc:276] 0709 12:14:24.421580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.210471 (+788891us) service_pool.cc:224] Handling call
0709 12:14:25.210957 (+   486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:25.211455 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.211501 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:25.212236 (+   735us) log.cc:844] Serialized 26 byte log entry
0709 12:14:25.464658 (+252422us) raft_consensus.cc:1645] Marking committed up to 21
0709 12:14:25.464710 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.464778 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.660883 (+196105us) raft_consensus.cc:1685] finished
0709 12:14:25.660906 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.661057 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4670,"raft.queue_time_us":1412,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5116,"thread_start_us":252047,"threads_started":1,"wal-append.queue_time_us":422263}
I20260709 12:14:25.598088  4862 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.663470  4862 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:25.664433  4354 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:25.602649  4812 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.611626  4506 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.544360  4641 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.667552  4447 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:25.668066  4506 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:25.668179  4872 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election won for term 31
W20260709 12:14:25.634021  4807 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.645s	user 0.011s	sys 0.001s
I20260709 12:14:25.668812  4872 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:25.669294  4872 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:25.669018  4807 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.671449  4802 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:25.674484  4587 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:25.674983  4587 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:25.675379  4587 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:25.668231  4641 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:25.680353 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 202239us
W20260709 12:14:25.682022  4324 consensus_meta.cc:287] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.857s	user 0.012s	sys 0.001s
I20260709 12:14:25.682529  4324 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:25.683552  4835 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.000s
I20260709 12:14:25.665923  4862 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:25.691928 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.692780 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:25.697933 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:25.701932 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:25.703464 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:25.704418 26622 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 37 because replica has last-logged OpId of term: 35 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 32 index: 20.
I20260709 12:14:25.705324 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:25.706737 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:25.706986 27168 raft_consensus.cc:1275] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 35 index: 22. Preceding OpId from leader: term: 36 index: 23. (index mismatch)
I20260709 12:14:25.685465  4324 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:25.711503  4773 raft_consensus.cc:3055] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:14:25.712011  4773 raft_consensus.cc:740] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:25.712927  4773 consensus_queue.cc:260] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 32.20, Last appended by leader: 20, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.706797 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:25.705976 26622 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:14:25.719918 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:25.720366  4770 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:25.720619 27161 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:14:25.723094  4812 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:25.671386  4807 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:25.723788 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:25.714243  4773 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:25.726145 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:25.727758 26614 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32. Ops: [31.21-31.21]
I20260709 12:14:25.728085 26469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1585) took 1367 ms. Trace:
I20260709 12:14:25.728536 26469 rpcz_store.cc:276] 0709 12:14:24.360479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.364897 (+  4418us) service_pool.cc:224] Handling call
0709 12:14:25.301360 (+936463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.301549 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.301573 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:25.301617 (+    44us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:14:25.301647 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.301701 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.727861 (+426160us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b54001a9850. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:25.728007 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2152909696}
I20260709 12:14:25.697584  4868 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:25.730086 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:25.731956 26469 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:25.732604  4868 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:25.742759 26587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.742547 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:25.748373 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 5086) took 1270 ms. Trace:
I20260709 12:14:25.748843 26471 rpcz_store.cc:276] 0709 12:14:24.477602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.360535 (+882933us) service_pool.cc:224] Handling call
0709 12:14:25.360879 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.361098 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 21
0709 12:14:25.363306 (+  2208us) log.cc:844] Serialized 14 byte log entry
0709 12:14:25.747991 (+384685us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:25.748045 (+    54us) raft_consensus.cc:1645] Marking committed up to 21
0709 12:14:25.748097 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.748161 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.748307 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1391,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"spinlock_wait_cycles":1119104,"thread_start_us":383716,"threads_started":1}
I20260709 12:14:25.751118 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 24 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:25.752890 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 38 candidate_status { last_received { term: 36 index: 25 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:25.754112 26471 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 37.
I20260709 12:14:25.755352  4587 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:25.759927  4861 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.764580 26587 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:25.765373 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.765161 26439 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:25.768543 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:25.684013  4835 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.774516 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:25.778759 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:25.714162  4768 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:25.777396 26542 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:25.751490  4814 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.029s
I20260709 12:14:25.789681  4814 consensus_queue.cc:1243] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 32.21 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 20
I20260709 12:14:25.784129  4877 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Leader pre-election won for term 38
I20260709 12:14:25.793286  4877 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.793823  4877 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:25.796840  4768 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:25.780233  4854 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.799767  4854 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.801163  4587 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:25.777709  4447 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:25.802063  4447 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.802476  4447 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:25.780550  4850 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:14:25.807578 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 4047) took 1104 ms. Trace:
I20260709 12:14:25.768738 26469 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 36.
W20260709 12:14:25.776757 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.807998 26472 rpcz_store.cc:276] 0709 12:14:24.702815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.470261 (+767446us) service_pool.cc:224] Handling call
0709 12:14:25.484483 (+ 14222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.699531 (+215048us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.699563 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:25.699609 (+    46us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:14:25.699643 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.807330 (+107687us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b540025a3d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:25.807386 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.807518 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":494039424}
I20260709 12:14:25.777633  4682 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:25.821130 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:25.823299 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 42 candidate_status { last_received { term: 41 index: 26 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:25.814841 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:25.826440  4878 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:14:25.827195  4878 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 36 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:25.828215  4878 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 34.22, Last appended by leader: 22, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:25.833216  4768 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20260709 12:14:25.801229  4835 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:25.839761 26469 raft_consensus.cc:1275] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 32 index: 17. Preceding OpId from leader: term: 34 index: 18. (index mismatch)
I20260709 12:14:25.842519 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:25.773313  4861 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.824770  4506 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.831856  4740 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 29.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.011s
I20260709 12:14:25.857646 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:25.858345 26542 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:14:25.856025 26469 raft_consensus.cc:1275] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 17. Preceding OpId from leader: term: 32 index: 18. (index mismatch)
I20260709 12:14:25.838574  4682 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.851701  4854 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:25.869309 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:25.856719  4821 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.873986 26469 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 19. Preceding OpId from leader: term: 33 index: 20. (index mismatch)
I20260709 12:14:25.879329 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:25.880940 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:25.881793  4877 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:25.882567 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:25.883617  4872 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.885890  4877 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:25.882535 26615 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 36.
I20260709 12:14:25.886675  4872 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:25.888564  4861 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:25.859707  4506 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.902171 26472 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:14:25.903505  4506 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:25.906209  4849 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:14:25.908032  4294 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:25.910749  4740 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.011s
I20260709 12:14:25.911906 26588 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 42 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:25.923637  4854 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 41 FOLLOWER]: Leader pre-election lost for term 42. Reason: could not achieve majority
I20260709 12:14:25.923871 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:25.913368 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:25.925228 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 38 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:25.925926 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 38 candidate_status { last_received { term: 36 index: 25 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:25.916006 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:25.928869 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 38 candidate_status { last_received { term: 36 index: 25 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:25.927039 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 5036) took 1471 ms. Trace:
I20260709 12:14:25.929657 26618 rpcz_store.cc:276] 0709 12:14:24.456109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.790197 (+334088us) service_pool.cc:224] Handling call
0709 12:14:24.827906 (+ 37709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:24.988006 (+160100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.926804 (+938798us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54000023d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:25.926982 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299481856}
I20260709 12:14:25.913728 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 38 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:25.932523 26540 raft_consensus.cc:2410] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 38 because replica has last-logged OpId of term: 36 index: 22, which is greater than that of the candidate, which has last-logged OpId of term: 35 index: 21.
I20260709 12:14:25.908674  4849 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 12:14:25.936942 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 38 candidate_status { last_received { term: 36 index: 25 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:25.937816 26469 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:25.939456 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 4048) took 1228 ms. Trace:
I20260709 12:14:25.939936 26465 rpcz_store.cc:276] 0709 12:14:24.711343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.520572 (+809229us) service_pool.cc:224] Handling call
0709 12:14:25.590617 (+ 70045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.679146 (+ 88529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.679180 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:25.679222 (+    42us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:14:25.679264 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.939207 (+259943us) spinlock_profiling.cc:243] Waited 88.3 ms on lock 0x7b54002599d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:25.939257 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.939396 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203041536}
I20260709 12:14:25.941458 26465 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:14:25.941756 26465 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:25.947606  4687 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:25.954051  4682 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:25.955300 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:25.964850 26468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43592 (request call id 4043) took 1363 ms. Trace:
I20260709 12:14:25.965323 26468 rpcz_store.cc:276] 0709 12:14:24.601639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.603021 (+  1382us) service_pool.cc:224] Handling call
0709 12:14:25.964647 (+1361626us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b54001c1454. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:25.964775 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2247197056}
I20260709 12:14:25.967779  4849 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 29.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:25.968209 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:25.968786  4777 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:25.970009  4861 consensus_queue.cc:1048] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:14:25.970367  4743 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:25.969460  4849 consensus_queue.cc:1048] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.003s
I20260709 12:14:25.972471 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:25.973520  4849 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:25.973683 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43606 (request call id 5073) took 1656 ms. Trace:
I20260709 12:14:25.974100 26473 rpcz_store.cc:276] 0709 12:14:24.317420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.341750 (+ 24330us) service_pool.cc:224] Handling call
0709 12:14:24.342067 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:24.830639 (+488572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.973422 (+1142783us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b54000a50d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:25.973618 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1103715712}
I20260709 12:14:25.973958 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:25.978245  4849 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:25.979167 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:25.978718  4849 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:25.980314  4872 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:25.980693  4872 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.981072  4872 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:25.980865 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:25.983661  4743 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:14:25.985000  4811 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Advancing to term 39
I20260709 12:14:25.987663  4663 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:25.990495  4849 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:25.991303  4324 raft_consensus.cc:3055] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:14:25.991797  4324 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:25.992690  4324 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:25.996922  4780 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:14:25.997344  4780 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:25.998279  4780 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 31.21, Last appended by leader: 21, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:25.998733 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:25.999639  4780 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:25.905018 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:25.916177 27167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1677) took 1054 ms. Trace:
W20260709 12:14:26.006105 26513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.996507  4821 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:26.010764 26467 raft_consensus.cc:2410] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 38 because replica has last-logged OpId of term: 36 index: 22, which is greater than that of the candidate, which has last-logged OpId of term: 35 index: 21.
I20260709 12:14:25.920073  4710 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:26.051908 26548 raft_consensus.cc:1275] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 32 index: 20. Preceding OpId from leader: term: 33 index: 20. (term mismatch)
I20260709 12:14:26.052405 26548 pending_rounds.cc:85] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 19
I20260709 12:14:26.052663 26548 pending_rounds.cc:107] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 32.20
I20260709 12:14:26.052858 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:26.052932 26548 raft_consensus.cc:2889] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:26.056116  4871 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.583s	user 0.002s	sys 0.000s
I20260709 12:14:26.057910  4837 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:26.058630  4837 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.059115  4837 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:26.060550 26615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48232 (request call id 1902) took 1254 ms. Trace:
I20260709 12:14:26.061005 26615 rpcz_store.cc:276] 0709 12:14:24.806084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.934899 (+128815us) service_pool.cc:224] Handling call
0709 12:14:26.060337 (+1125438us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b540037b254. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:26.060478 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2158237568}
I20260709 12:14:26.063506 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:26.064251 26470 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 33.
I20260709 12:14:26.065310 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:25.994179  4324 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:26.011555 26465 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 31.21, Last appended by leader: 21, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:26.077037 26465 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:26.072317 27134 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:26.081440 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 39 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:26.021700 26469 raft_consensus.cc:2468] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 38.
W20260709 12:14:26.070849  4870 log.cc:927] Time spent T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.553s	user 0.002s	sys 0.000s
I20260709 12:14:26.074570 26513 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:26.084425 26468 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 37. Current term is 38. Ops: [37.26-37.26]
I20260709 12:14:26.094144 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:26.083925 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:26.084750 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:26.096105 26469 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:26.102700 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:26.103637 26467 raft_consensus.cc:2410] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 30 because replica has last-logged OpId of term: 28 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 18.
I20260709 12:14:26.004253 27167 rpcz_store.cc:276] 0709 12:14:24.861324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.861618 (+   294us) service_pool.cc:224] Handling call
0709 12:14:24.878121 (+ 16503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:24.878384 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 19
0709 12:14:24.885650 (+  7266us) log.cc:844] Serialized 14 byte log entry
0709 12:14:25.171284 (+285634us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b180042f760. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:14:25.915536 (+744252us) spinlock_profiling.cc:243] Waited 9.3 ms on lock 0x7b180042f760. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5075c824bc 00007f5072fd048b 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fea455 00007f50760d2060 00007f50760e4716 00007f50760f5287
0709 12:14:25.915764 (+   228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:25.915817 (+    53us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:14:25.915870 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.915946 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.916077 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7013,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":41,"raft.queue_time_us":52523,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":21262,"spinlock_wait_cycles":95006464,"thread_start_us":189779,"threads_started":2,"wal-append.queue_time_us":185756}
I20260709 12:14:26.109098 26513 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:26.120417 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:26.126840 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:26.128036 26466 raft_consensus.cc:2368] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 35. Current term is 36.
I20260709 12:14:26.129685 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:26.149534 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:26.131201 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:26.136240 27134 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:26.052263  4821 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:26.044835  4689 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:26.139200 26544 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:26.152262  4689 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:26.155684  4689 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:26.156783  4763 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:14:26.158154 26544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44706 (request call id 1746) took 1237 ms. Trace:
I20260709 12:14:26.075623  4552 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:26.092453  4769 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:26.158601 26544 rpcz_store.cc:276] 0709 12:14:24.920786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.921005 (+   219us) service_pool.cc:224] Handling call
0709 12:14:24.921446 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.152247 (+1230801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.157910 (+  5663us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54003976d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:26.158088 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2789098752}
I20260709 12:14:26.181097 26466 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 32 index: 17. Preceding OpId from leader: term: 36 index: 19. (index mismatch)
I20260709 12:14:26.137794  4365 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:14:26.135228  4713 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader pre-election won for term 38
I20260709 12:14:26.107219  4663 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.188472 27167 raft_consensus.cc:1240] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 37. Current term is 38. Ops: []
I20260709 12:14:26.134639  4042 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
I20260709 12:14:26.182703 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:26.192313 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:26.173549 26469 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:14:26.190109 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:26.198223 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:26.135401  4837 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:26.203128 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:26.212098  4835 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:26.212705  4835 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:26.213147  4835 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:26.212217 26613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1908) took 1359 ms. Trace:
I20260709 12:14:26.214675 26613 rpcz_store.cc:276] 0709 12:14:24.852685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.193423 (+340738us) service_pool.cc:224] Handling call
0709 12:14:25.193970 (+   547us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:25.236428 (+ 42458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.236461 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:25.236961 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 12:14:25.350832 (+113871us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:14:25.351059 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.351128 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:26.070180 (+719052us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:14:26.200777 (+130597us) raft_consensus.cc:1685] finished
0709 12:14:26.200803 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.212135 (+ 11332us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73018,"raft.queue_time_us":43560,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":12627,"spinlock_wait_cycles":262086400,"thread_start_us":87791,"threads_started":1,"wal-append.queue_time_us":212165}
I20260709 12:14:26.217446  4855 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:26.199935  4365 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:26.218590  4641 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 32.23, Next index: 24, Last known committed idx: 23, Time since last communication: 0.001s
I20260709 12:14:26.218657  4872 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:26.218919  4365 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:26.219843  4641 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:14:26.220235  4641 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:26.221330  4872 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:26.222186 26622 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 33: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:26.226595 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:26.227300 26513 leader_election.cc:400] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 35. Current term is 36.
I20260709 12:14:26.227427 26469 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:26.227669 26513 leader_election.cc:403] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 election: Cancelling election due to peer responding with higher term
I20260709 12:14:26.232800 26465 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 21. Preceding OpId from leader: term: 32 index: 21. (term mismatch)
I20260709 12:14:26.233253 26465 pending_rounds.cc:85] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 20
I20260709 12:14:26.233481 26465 pending_rounds.cc:107] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 31.21
I20260709 12:14:26.233703 26465 raft_consensus.cc:2889] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:26.235602 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:26.221053  4641 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 32.23, Last appended by leader: 23, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:26.238484 26469 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:26.163163  4682 consensus_queue.cc:1048] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.038s
I20260709 12:14:26.240707 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:26.196820  4834 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.192307  4770 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:26.184828  4713 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.262917 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:26.263671 26547 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:26.264533 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:26.265574 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:26.258106 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:26.267620 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:26.217924  4849 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:26.271040 26548 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 20. Preceding OpId from leader: term: 33 index: 21. (index mismatch)
W20260709 12:14:26.252816  4716 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 32 current term: 32 is higher.
W20260709 12:14:26.275939 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.246861  4802 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:26.224252  4710 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:26.176918  4552 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:26.286460 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:26.197455  4663 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:26.255249  4862 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:26.268795  4713 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:26.259100  4743 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:26.268474  4854 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:14:26.306140 27167 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 20. Preceding OpId from leader: term: 32 index: 21. (index mismatch)
I20260709 12:14:26.318579 27161 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32. Ops: [31.21-31.21]
I20260709 12:14:26.279635  4641 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:26.317165 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:26.326718 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:26.252462  4042 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.036s
I20260709 12:14:26.289343  4710 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:26.265316  4834 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:26.306298  4770 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:26.338878 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:14:26.339392 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:26.342911  4888 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:14:26.351924  4849 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:26.353084  4663 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:26.285988  4821 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.045s
I20260709 12:14:26.359591  4770 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:26.322105  4743 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:26.362337  4743 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:26.364151  4552 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:26.371304  4834 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:26.373124  4837 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:26.315905  4862 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:26.376976  4862 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:26.385979 26547 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:26.386979 26588 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:26.378791 27166 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:26.379469 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:14:26.331956  4447 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.001s
I20260709 12:14:26.393069 26588 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:26.389264 27163 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 35.
W20260709 12:14:26.395995 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 423150us
I20260709 12:14:26.397709 26588 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:26.404278 26588 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:26.362242  4770 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:26.406307 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.396414  4837 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:26.402426  4685 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:14:26.405063  4763 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 36 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:26.406054  4850 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:14:26.422519 26514 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:26.409654  4861 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election lost for term 35. Reason: could not achieve majority
I20260709 12:14:26.428071 26514 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:26.400159  4324 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.025s
I20260709 12:14:26.399936  4447 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:26.447628 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:26.487561 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44417us
I20260709 12:14:26.490675 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:26.439231  4806 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:14:26.417833  4770 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.069s
I20260709 12:14:26.498409 26470 raft_consensus.cc:2368] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31.
I20260709 12:14:26.434289  4552 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:26.507736 26613 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 23. Current term is 24. Ops: []
I20260709 12:14:26.494220  4685 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.495072  4837 raft_consensus.cc:3055] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Stepping down as leader of term 37
W20260709 12:14:26.520557 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 448390us
I20260709 12:14:26.494563  4386 consensus_queue.cc:1059] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 27.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.029s
I20260709 12:14:26.563737 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:26.560636 26622 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 33. Current term is 34. Ops: []
I20260709 12:14:26.511756  4806 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:26.557677 27133 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:26.528280  4854 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:26.570662  4854 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 31.17, Last appended by leader: 17, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:26.576318 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:26.576632  4896 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:14:26.581971 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:26.588841  4716 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:26.589309  4716 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:26.589710  4716 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:26.606349  4716 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:26.619727  4447 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:26.509876  4771 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.058s
I20260709 12:14:26.626959  4716 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:26.610016  4897 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 33.20, Next index: 21, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:14:26.646250  4716 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.528379  4763 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 35.22, Last appended by leader: 22, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:26.647760  4716 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:26.650846  4716 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:26.612057 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:26.629485 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:26.686120 26471 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 33: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:26.633651 26468 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 34 index: 22. Preceding OpId from leader: term: 36 index: 23. (index mismatch)
I20260709 12:14:26.687208  4861 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.636183 26622 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 30 index: 17. Preceding OpId from leader: term: 31 index: 18. (index mismatch)
I20260709 12:14:26.688107  4861 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:26.688915 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.639302  4802 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election lost for term 35. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 35. Current term is 36.
I20260709 12:14:26.640370 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:26.689757 26613 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:26.655944 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:26.552856  4687 consensus_meta.cc:287] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.605s	user 0.013s	sys 0.000s
I20260709 12:14:26.692691 26616 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 35.
I20260709 12:14:26.654271 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:26.695631 27163 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Advancing to term 36
W20260709 12:14:26.610504  4892 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:14:26.696161 26439 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:14:26.660352 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 102785us
I20260709 12:14:26.661008  4878 raft_consensus.cc:2804] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Leader election won for term 38
I20260709 12:14:26.609077  4806 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 35.21, Last appended by leader: 21, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:26.672261  4710 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:26.673676 26357 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 953d8c981a6c459f8b7f3dbbb66fda45 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ac3ac2181aa941229a758ccf6b5607cd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 25 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:14:26.674705 26363 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57044 (request call id 318) took 63447 ms (client timeout 15000 ms). Trace:
I20260709 12:14:26.678579  4447 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.678769 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3949) took 1399 ms. Trace:
W20260709 12:14:26.622913  4811 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.637s	user 0.013s	sys 0.000s
I20260709 12:14:26.693372 27166 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:26.569483  4835 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:26.704361  4897 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.028s
I20260709 12:14:26.720947 26541 rpcz_store.cc:276] 0709 12:14:25.279014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.279152 (+   138us) service_pool.cc:224] Handling call
0709 12:14:25.279539 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:25.482208 (+202669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.482249 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:26.233609 (+751360us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b2c0005b0f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:14:26.251311 (+ 17702us) log.cc:844] Serialized 26 byte log entry
0709 12:14:26.503545 (+252234us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:14:26.503596 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.678383 (+174787us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54002387d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:26.678461 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:26.678511 (+    50us) raft_consensus.cc:1685] finished
0709 12:14:26.678525 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.678703 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":398,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":31976,"spinlock_wait_cycles":467930880,"thread_start_us":216927,"threads_started":1,"wal-append.queue_time_us":333219}
I20260709 12:14:26.712397  4867 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:14:26.525207  4837 raft_consensus.cc:740] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:26.748759 27163 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 36.
W20260709 12:14:26.772711 26473 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.028s	sys 0.025s
I20260709 12:14:26.703783  4853 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.774998 26613 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
W20260709 12:14:26.714046 26363 rpcz_store.cc:269] 0709 12:13:23.226842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.839962 (+4613120us) service_pool.cc:224] Handling call
0709 12:13:28.141128 (+301166us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b540007d354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076044090 00007f50760e2f3a 00007f507be98e9c 00007f507bf9704e 00007f507a4582a4 00007f507a458232 00007f507a458161 00007f507a4580dc 00007f507a457392 00007f507441548c 00007f50744148c6
0709 12:14:26.674583 (+58533455us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:21.079427 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:21.080123 (+   696us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:21.080188 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:14:21.080207 (+    19us) tablet.cc:662] Decoding operations
0709 12:14:21.163309 (+ 83102us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:21.163435 (+   126us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:21.163462 (+    27us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:14:21.164923 (+  1461us) tablet.cc:701] Row locks acquired
0709 12:14:21.164980 (+    57us) write_op.cc:260] PREPARE: finished
0709 12:14:21.165146 (+   166us) write_op.cc:270] Start()
0709 12:14:21.165328 (+   182us) write_op.cc:276] Timestamp: P: 1783599261165081 usec, L: 0
0709 12:14:21.165372 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 12:14:21.166194 (+   822us) log.cc:844] Serialized 5965 byte log entry
0709 12:14:22.165447 (+999253us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:14:22.372867 (+207420us) op_driver.cc:464] REPLICATION: finished
0709 12:14:22.465090 (+ 92223us) write_op.cc:301] APPLY: starting
0709 12:14:22.465195 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:22.807124 (+341929us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:22.807188 (+    64us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:23.056046 (+248858us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:23.056435 (+   389us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 12:14:23.056528 (+    93us) write_op.cc:312] APPLY: finished
0709 12:14:23.057126 (+   598us) log.cc:844] Serialized 139 byte log entry
0709 12:14:23.075407 (+ 18281us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:23.075590 (+   183us) write_op.cc:454] Released schema lock
0709 12:14:23.075660 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:23.142547 (+ 66887us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:23.147494 (+  4947us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4664120,"reported_tablets":51,"spinlock_wait_cycles":3979520,"child_traces":[["op",{"apply.queue_time_us":91861,"apply.run_cpu_time_us":26046,"apply.run_wall_time_us":631470,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66767,"num_ops":15,"prepare.queue_time_us":286797,"prepare.run_cpu_time_us":35247,"prepare.run_wall_time_us":279968,"raft.queue_time_us":112696,"raft.run_cpu_time_us":12547,"raft.run_wall_time_us":102002,"replication_time_us":1207316,"spinlock_wait_cycles":44980480,"thread_start_us":519577,"threads_started":4,"wal-append.queue_time_us":266266,"wal-append.run_cpu_time_us":28283,"wal-append.run_wall_time_us":2624136}]]}
W20260709 12:14:26.773406 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 278554us
I20260709 12:14:26.712262  4898 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:26.743065  4447 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:26.844308 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 37 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:26.711817  4861 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:26.844774 26363 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57044 (request call id 320) took 18639 ms (client timeout 15000 ms). Trace:
W20260709 12:14:26.845199 26363 rpcz_store.cc:269] 0709 12:14:08.220050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.844537 (+18624487us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:26.844685 (+   148us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:26.530071  4685 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:26.833922 26473 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.028s	sys 0.025s
I20260709 12:14:26.839998  4506 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:26.699868  4294 consensus_queue.cc:1059] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.030s
I20260709 12:14:26.850023  4447 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:26.853629  4867 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:26.770846  4716 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:26.846436  4663 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:14:26.860737 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.866061  4710 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:26.848136 26439 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:26.869699 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:26.847057  4898 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.900434 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:26.902781 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:26.906375 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:26.907603 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:26.908417 26613 raft_consensus.cc:2376] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36. Re-sending same reply.
I20260709 12:14:26.901573 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:26.910544 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:26.911561 26543 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:26.912420 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:26.730809  4713 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:26.914409 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:26.915274 26618 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 37.
I20260709 12:14:26.916941 26619 raft_consensus.cc:1240] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: []
I20260709 12:14:26.919082 26438 leader_election.cc:400] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32.
I20260709 12:14:26.920083 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:26.892583  4506 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:26.920697 26614 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:26.922760 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:26.923427 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:26.925734 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:26.926360 26613 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:26.926693 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:26.929342 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:26.930612 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:26.933207 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:26.937357 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:26.938532 26618 raft_consensus.cc:2368] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 33. Current term is 34.
I20260709 12:14:26.886549  4341 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:26.898496  4867 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:26.930647 26621 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 38.
I20260709 12:14:26.845947  4853 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:26.955503 26613 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:14:26.910504  4447 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:26.913797  4898 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:26.923635  4802 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:26.965024 26615 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:14:26.966475 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:26.967509 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:26.987588 26618 raft_consensus.cc:2368] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31.
I20260709 12:14:26.988634 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:26.971091 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:26.971318 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:26.951916  4587 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:26.926302  4837 consensus_queue.cc:260] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 37.26, Last appended by leader: 26, Current term: 37, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:26.952942  4663 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:26.952612  4289 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.974642  4814 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
W20260709 12:14:26.975457 26621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 4254) took 2662 ms (client timeout 1719 ms). Trace:
I20260709 12:14:26.978544  4802 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.980171 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 39 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:26.968987 26543 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:14:26.981096 26619 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 34 index: 18. Preceding OpId from leader: term: 36 index: 19. (index mismatch)
I20260709 12:14:26.940703  4872 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:27.011148 26620 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 36: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:27.021800 26618 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 33 index: 22. Preceding OpId from leader: term: 35 index: 23. (index mismatch)
W20260709 12:14:27.032707 26621 rpcz_store.cc:269] 0709 12:14:24.313225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.338064 (+ 24839us) service_pool.cc:224] Handling call
0709 12:14:26.975229 (+2637165us) spinlock_profiling.cc:243] Waited 2.36 s on lock 0x7b5400032854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:26.975383 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5433556736}
I20260709 12:14:26.902999  4716 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:27.029975 26617 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:14:26.971168  4897 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:14:27.036751 26544 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 36.
W20260709 12:14:27.038229 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45834.7us
I20260709 12:14:27.021471  4587 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:27.022467  4572 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:27.051081  4572 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:27.051864  4587 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:27.053305  4572 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:27.054289  4853 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:26.963591  4341 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:26.985546  4447 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:27.065569 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.042742  4802 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:27.076897 26617 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 34. Current term is 35. Ops: []
I20260709 12:14:27.088539 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.093189 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.096063 26616 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 29
I20260709 12:14:27.096472 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:14:27.099802 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 385970us
I20260709 12:14:27.037489  4289 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:27.066262  4897 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:14:27.105878 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 257934us
I20260709 12:14:27.111564 26614 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 32.
I20260709 12:14:27.046051  4872 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:27.137809 26620 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32. Ops: [31.18-31.18]
I20260709 12:14:27.139942 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.142171 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:27.095727  4835 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:27.104408  4861 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.150825 26616 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:14:27.095335  4878 raft_consensus.cc:697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 38 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:27.161653 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:27.162533 27163 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:27.167445 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:27.172247 27163 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:14:27.178679 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.182206 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:27.131423  4763 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.043s
I20260709 12:14:27.187559 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.147027  4710 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 34.23, Next index: 24, Last known committed idx: 23, Time since last communication: 0.031s
W20260709 12:14:27.192436 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.173756  4685 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:27.199102  4909 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.336s	user 0.004s	sys 0.000s
I20260709 12:14:27.207790 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:27.213016 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:27.156534  4861 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:27.190018  4713 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:27.233971 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 187468us
I20260709 12:14:27.235122 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:27.226027  4294 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 34 LEADER]: Stepping down as leader of term 34
W20260709 12:14:27.256969  4915 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:14:27.256888  4294 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 34 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:27.257676  4925 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:27.258303  4925 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:27.259011  4916 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 12:14:27.260399  4918 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:14:27.262030 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 4070) took 1334 ms. Trace:
I20260709 12:14:27.262459 26472 rpcz_store.cc:276] 0709 12:14:25.928011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.151517 (+223506us) service_pool.cc:224] Handling call
0709 12:14:26.152022 (+   505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:26.193394 (+ 41372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.193431 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:26.268097 (+ 74666us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b180023f860. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fbb2a6 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a
0709 12:14:26.660617 (+392520us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b2c000327f8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e3372 00007f5076115a01 00007f50760da43a 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2
0709 12:14:26.661154 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 12:14:26.837358 (+176204us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:14:26.837430 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.837574 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:27.261811 (+424237us) raft_consensus.cc:1685] finished
0709 12:14:27.261836 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.261968 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43338,"raft.queue_time_us":44034,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":95,"spinlock_wait_cycles":21598848,"thread_start_us":175559,"threads_started":1,"wal-append.queue_time_us":385152}
I20260709 12:14:27.261423 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3968) took 1230 ms. Trace:
I20260709 12:14:27.258201  4294 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 34.23, Last appended by leader: 23, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:27.264627 26542 rpcz_store.cc:276] 0709 12:14:26.031228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.043542 (+ 12314us) service_pool.cc:224] Handling call
0709 12:14:26.043919 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:26.075102 (+ 31183us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:14:26.520287 (+445185us) log.cc:844] Serialized 14 byte log entry
0709 12:14:26.883222 (+362935us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:26.887403 (+  4181us) log.cc:844] Serialized 26 byte log entry
0709 12:14:26.887555 (+   152us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:14:26.887590 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.887659 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:27.261158 (+373499us) raft_consensus.cc:1685] finished
0709 12:14:27.261194 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.261347 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30703,"prepare.queue_time_us":365644,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":34563,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":5699,"thread_start_us":763854,"threads_started":2,"wal-append.queue_time_us":544997}
I20260709 12:14:27.267226 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:27.268328 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:27.273952 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.223873  4897 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 29.15, Last appended by leader: 15, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:27.234579  4878 consensus_queue.cc:237] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 36.25, Last appended by leader: 25, Current term: 38, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:27.254333  4919 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:27.285645 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:27.287822 26545 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:27.291684  4926 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:27.292047 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.269629  4447 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:27.297498 27168 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 31 index: 21. Preceding OpId from leader: term: 32 index: 22. (index mismatch)
I20260709 12:14:27.286363  4663 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:27.303133 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.294826  4294 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:27.311900 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:27.317221 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:27.318001 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.321106 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:27.321760 26471 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:14:27.317917 26472 raft_consensus.cc:1275] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 20. Preceding OpId from leader: term: 33 index: 21. (index mismatch)
W20260709 12:14:27.327661 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.293071  4919 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:27.292306  4926 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:27.308889  4928 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 41 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:27.341455 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.339514 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 38 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.373787 26542 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 39.
I20260709 12:14:27.360487 26620 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33. Ops: [28.17-32.19]
I20260709 12:14:27.361884 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:27.363466 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:27.375401 26618 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:27.375555 26621 raft_consensus.cc:2368] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 33. Current term is 34.
I20260709 12:14:27.366554 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:27.367110 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:27.367983 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:27.377401 26465 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:27.368069 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 37 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:27.368659 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:27.378826 26614 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 38: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:27.377322 27168 raft_consensus.cc:2376] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36. Re-sending same reply.
W20260709 12:14:27.384464  4929 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:14:27.386679 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:27.394846 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.333575  4923 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.398605 26622 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31. Ops: []
I20260709 12:14:27.420706 26465 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:14:27.428036 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:27.424093 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.428781 26466 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 36.
I20260709 12:14:27.429450 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:27.430083 26545 raft_consensus.cc:2376] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33. Re-sending same reply.
W20260709 12:14:27.427073 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.425678 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.432601 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.431048 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.435534 26545 raft_consensus.cc:2393] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 33: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:27.437075 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.438215 26545 raft_consensus.cc:2368] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 37. Current term is 38.
I20260709 12:14:27.440092 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.434294 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.336809  4663 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:27.323491  4854 consensus_queue.cc:1059] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 36.25, Next index: 26, Last known committed idx: 25, Time since last communication: 0.068s
I20260709 12:14:27.379761  4581 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.333673  4572 consensus_queue.cc:1048] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.094s
I20260709 12:14:27.471144 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:27.474061 26466 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 36.
I20260709 12:14:27.520233 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 35 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:27.521320 26468 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 35.
W20260709 12:14:27.475044 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 83259.1us
I20260709 12:14:27.524721 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:27.423045  4447 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:27.525406 26545 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:27.528815 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.523646 26513 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:27.527393 26439 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:27.533486 26513 leader_election.cc:400] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31.
I20260709 12:14:27.534040 26513 leader_election.cc:403] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Cancelling election due to peer responding with higher term
I20260709 12:14:27.531863 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:27.534643 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 189441us
I20260709 12:14:27.537701 26466 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 17. Preceding OpId from leader: term: 33 index: 18. (index mismatch)
I20260709 12:14:27.537235 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:27.469097  4926 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:27.555394 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 40 candidate_status { last_received { term: 36 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:27.556398 26468 raft_consensus.cc:2410] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 40 because replica has last-logged OpId of term: 38 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 36 index: 20.
I20260709 12:14:27.389540  4928 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 41 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:27.552044  4919 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:27.455282  4934 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.558640 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:27.559338 26618 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 38.
I20260709 12:14:27.575541 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:27.576692 26466 raft_consensus.cc:2368] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29.
I20260709 12:14:27.535037  4861 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:27.469753  4663 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:27.587635 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:27.582307 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 213721us
I20260709 12:14:27.595198 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:27.448988  4923 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:27.479171  4581 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:27.560268  4939 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:27.626868 27161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56902 (request call id 1383) took 1346 ms. Trace:
I20260709 12:14:27.629050 26542 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 32. Current term is 34. Ops: []
I20260709 12:14:27.544994  4447 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:27.591572  4919 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
W20260709 12:14:27.646749 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 119448us
W20260709 12:14:27.610975 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 79224.9us
I20260709 12:14:27.647957 26439 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:27.648663 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:27.527613  4689 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.047s
I20260709 12:14:27.557322  4354 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:27.561476  4926 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:27.627300 27161 rpcz_store.cc:276] 0709 12:14:26.280416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.280927 (+   511us) service_pool.cc:224] Handling call
0709 12:14:26.318335 (+ 37408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:26.322819 (+  4484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.626626 (+1303807us) spinlock_profiling.cc:243] Waited 8.16 ms on lock 0x7b54003b6ad0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:27.626802 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18760576}
W20260709 12:14:27.636777  4932 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:14:27.637477  4944 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:27.637584  4663 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:27.640282  4928 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 42 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:27.641260  4945 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
W20260709 12:14:27.641862  4922 log.cc:927] Time spent T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.340s	user 0.001s	sys 0.000s
I20260709 12:14:27.557524  4899 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
W20260709 12:14:27.657874  4927 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.347s	user 0.000s	sys 0.001s
I20260709 12:14:27.606498 26514 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:27.607753 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 74432us
I20260709 12:14:27.710345 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.603193  4940 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:27.654628 26545 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:14:27.622295  4943 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.624022  4933 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election won for term 36
W20260709 12:14:27.636777  4921 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260709 12:14:27.593297  4713 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:14:27.672508 26548 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:27.660888  4926 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:27.673267  4904 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.742s	user 0.003s	sys 0.000s
W20260709 12:14:27.674100  4911 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.807s	user 0.002s	sys 0.000s
I20260709 12:14:27.674211  4923 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:27.676772  4956 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader election lost for term 38. Reason: could not achieve majority
I20260709 12:14:27.734882 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:27.677194  4769 raft_consensus.cc:3055] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:14:27.583679  4934 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:27.683053  4663 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:27.684571 27165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1685) took 1500 ms. Trace:
I20260709 12:14:27.735072  4933 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 36 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:14:27.712010 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 126378us
I20260709 12:14:27.649667  4572 consensus_queue.cc:1059] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 28.20, Next index: 21, Last known committed idx: 19, Time since last communication: 0.063s
I20260709 12:14:27.760012 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 40 candidate_status { last_received { term: 36 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:27.719689 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 113420us
W20260709 12:14:27.716674  4814 consensus_meta.cc:287] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.678s	user 0.004s	sys 0.009s
I20260709 12:14:27.763386 27161 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:14:27.747469 27165 rpcz_store.cc:276] 0709 12:14:26.183938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.184100 (+   162us) service_pool.cc:224] Handling call
0709 12:14:26.192197 (+  8097us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:26.192615 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.192652 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:26.196277 (+  3625us) log.cc:844] Serialized 26 byte log entry
0709 12:14:26.691110 (+494833us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b1800191b60. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:14:27.095098 (+403988us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:14:27.095151 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.095239 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:27.684254 (+589015us) raft_consensus.cc:1685] finished
0709 12:14:27.684275 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.684501 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":665,"raft.queue_time_us":4732,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6700,"spinlock_wait_cycles":39670144,"thread_start_us":403769,"threads_started":1,"wal-append.queue_time_us":1042325}
I20260709 12:14:27.735424  4948 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 12:14:27.727170  4867 consensus_meta.cc:287] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.763s	user 0.014s	sys 0.000s
I20260709 12:14:27.737422  4769 raft_consensus.cc:740] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:27.630679  4939 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:27.775009  4939 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:27.729180  4898 consensus_meta.cc:287] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.753s	user 0.012s	sys 0.001s
I20260709 12:14:27.775710  4898 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:27.777920  4898 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:27.733737 26618 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 35 index: 22. Preceding OpId from leader: term: 36 index: 23. (index mismatch)
I20260709 12:14:27.779327 26472 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 35. Current term is 36. Ops: []
I20260709 12:14:27.714705  4912 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election lost for term 30. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31.
I20260709 12:14:27.779489  4933 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 35.22, Last appended by leader: 22, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:27.722358 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 35 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.715132  4944 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.780781  4944 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:27.781589 26548 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 17. Preceding OpId from leader: term: 33 index: 18. (index mismatch)
I20260709 12:14:27.782878  4934 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:27.783093  4944 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:27.735723 26622 raft_consensus.cc:2393] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 29: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:27.784471 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3967) took 1798 ms. Trace:
I20260709 12:14:27.788324  4926 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:27.789013  4867 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:27.791363  4867 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:27.716004  4940 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:27.717265  4943 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:27.770268  4814 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:27.711613 26543 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 33: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:27.771783  4506 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:27.794220  4943 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:27.785030 26540 rpcz_store.cc:276] 0709 12:14:25.986558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.986923 (+   365us) service_pool.cc:224] Handling call
0709 12:14:25.987338 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:25.987752 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:14:26.285484 (+297732us) log.cc:844] Serialized 14 byte log entry
0709 12:14:26.712452 (+426968us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:26.742263 (+ 29811us) log.cc:844] Serialized 26 byte log entry
0709 12:14:26.742442 (+   179us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:14:26.742476 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.742544 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:27.672705 (+930161us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:14:27.729274 (+ 56569us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4800270258. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507b003aa1 00007f507affab37 00007f507affa9ca 00007f507b0f226f 00007f507b0f1f37 00007f507b10655c 00007f507b106508 00007f507b106488 00007f507b106443 00007f507b1056ec 00007f507a02fa96
0709 12:14:27.784181 (+ 54907us) raft_consensus.cc:1685] finished
0709 12:14:27.784205 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.784391 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19211,"prepare.queue_time_us":424237,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":57,"raft.queue_time_us":13841,"raft.run_cpu_time_us":4433,"raft.run_wall_time_us":1010655,"spinlock_wait_cycles":47177984,"thread_start_us":656410,"threads_started":2,"wal-append.queue_time_us":533607}
I20260709 12:14:27.794291  4940 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:27.808282 26467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 4072) took 1871 ms. Trace:
W20260709 12:14:27.810756 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:27.813449  4917 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.764s	user 0.000s	sys 0.001s
I20260709 12:14:27.727062  4716 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:27.761832 26514 leader_election.cc:400] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 33. Current term is 34.
I20260709 12:14:27.723824 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:27.765578 26541 raft_consensus.cc:2410] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 40 because replica has last-logged OpId of term: 38 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 36 index: 20.
W20260709 12:14:27.767920 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 120053us
I20260709 12:14:27.727526  4447 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:27.735700  4713 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:27.772526 27167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1693) took 1081 ms. Trace:
I20260709 12:14:27.816890 27167 rpcz_store.cc:276] 0709 12:14:26.691110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.691713 (+   603us) service_pool.cc:224] Handling call
0709 12:14:26.719912 (+ 28199us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:26.743731 (+ 23819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.743763 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:26.744248 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 12:14:27.180622 (+436374us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:14:27.180678 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.180774 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:27.772226 (+591452us) raft_consensus.cc:1685] finished
0709 12:14:27.772259 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.772445 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23377,"raft.queue_time_us":23961,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":67584,"thread_start_us":416453,"threads_started":1,"wal-append.queue_time_us":540339}
I20260709 12:14:27.798054  4769 consensus_queue.cc:260] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:27.824654  4948 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:27.832589  4948 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:27.834743  4447 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 30.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:14:27.836308  4447 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:14:27.836688  4447 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:27.837575  4447 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 31.18, Last appended by leader: 18, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:27.838791 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 38 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:27.839749 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:27.849810  4925 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:27.756002 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 107463us
I20260709 12:14:27.840425 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:27.841152 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 42 candidate_status { last_received { term: 41 index: 26 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:27.842044 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:27.808760 26467 rpcz_store.cc:276] 0709 12:14:25.936804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.161248 (+224444us) service_pool.cc:224] Handling call
0709 12:14:26.161575 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:26.320351 (+158776us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:14:26.337342 (+ 16991us) log.cc:844] Serialized 14 byte log entry
0709 12:14:26.898637 (+561295us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b180025c240. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a23a 00007f50760e4a2a
0709 12:14:27.132294 (+233657us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:27.135797 (+  3503us) log.cc:844] Serialized 26 byte log entry
0709 12:14:27.135967 (+   170us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:14:27.136000 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.807934 (+671934us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54002de6d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:27.807988 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:27.808039 (+    51us) raft_consensus.cc:1685] finished
0709 12:14:27.808053 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.808216 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65,"prepare.queue_time_us":15767,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":155299,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":12948,"spinlock_wait_cycles":457451648,"thread_start_us":218516,"threads_started":1,"wal-append.queue_time_us":963907}
I20260709 12:14:27.852046 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:27.852708 27167 raft_consensus.cc:2468] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 36.
I20260709 12:14:27.852934 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:27.853796  4872 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:27.854009  4802 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.757s	user 0.014s	sys 0.000s
I20260709 12:14:27.854669  4802 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:27.845364 26617 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 33. Current term is 34. Ops: []
I20260709 12:14:27.886960  4341 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:27.887823 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:27.888947  4802 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:27.845605  4447 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:27.845932 26622 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 39: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:14:27.846572 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 84946.5us
I20260709 12:14:27.847034 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:27.847489  4713 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:27.848148 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:27.892737 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:27.848835 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:27.894183 26616 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:14:27.895282  4771 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:14:27.895910  4771 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 31 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:27.896828  4771 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 29.21, Last appended by leader: 21, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:27.901149 26514 leader_election.cc:400] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31.
I20260709 12:14:27.848955 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 42 candidate_status { last_received { term: 41 index: 26 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:27.903427 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:27.850026 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 34 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:27.904366 26613 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 35: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:27.850795 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 34 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:14:27.815747  4907 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.767s	user 0.004s	sys 0.000s
I20260709 12:14:27.914494 27161 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 35.
I20260709 12:14:27.839341  4930 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:27.916010  4930 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:27.857838  4581 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:27.858249  4853 consensus_queue.cc:1048] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
W20260709 12:14:27.859014 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 106089us
I20260709 12:14:27.859455 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:27.860994  4925 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:27.864090 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 36 index: 25 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:27.864462 27166 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56902 (request call id 1385) took 1555 ms (client timeout 1913 ms). Trace:
I20260709 12:14:27.917025 26473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 4069) took 1989 ms. Trace:
I20260709 12:14:27.864629 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:27.934036 26620 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:27.865221 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:27.866814 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 35 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:27.867522 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:27.935491 26619 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
W20260709 12:14:27.857864 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 235740us
I20260709 12:14:27.869465  4365 raft_consensus.cc:3055] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:14:27.875670  4940 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.877648  4716 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:27.877835 26544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44706 (request call id 1750) took 1630 ms (client timeout 1580 ms). Trace:
I20260709 12:14:27.878082 26545 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 34 index: 22. Preceding OpId from leader: term: 36 index: 23. (index mismatch)
W20260709 12:14:27.939836 26544 rpcz_store.cc:269] 0709 12:14:26.247961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.262452 (+ 14491us) service_pool.cc:224] Handling call
0709 12:14:27.877561 (+1615109us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54003377d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:27.877728 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007216000}
I20260709 12:14:27.914523 26439 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:27.878567  4948 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:27.880856 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:27.942337 27163 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 29: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:27.916582  4930 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:27.885232 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:27.889856 26547 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 34: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:27.848683  4289 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:27.919318 26514 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
W20260709 12:14:27.932595 27166 rpcz_store.cc:269] 0709 12:14:26.308866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.309024 (+   158us) service_pool.cc:224] Handling call
0709 12:14:27.864224 (+1555200us) spinlock_profiling.cc:243] Waited 51.3 ms on lock 0x7b540071af54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:27.864381 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117898624}
W20260709 12:14:27.916560  4812 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.006s	sys 0.006s
W20260709 12:14:27.955493  4812 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.007s	sys 0.006s
I20260709 12:14:27.937572  4365 raft_consensus.cc:740] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:27.880828 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 36 index: 25 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:14:27.958887 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 99499.8us
I20260709 12:14:27.959939 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:27.960882 26513 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.637s (SENT) [suppressed 19 similar messages]
I20260709 12:14:27.917773  4641 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
W20260709 12:14:27.967751 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 53386.7us
I20260709 12:14:27.932737 26473 rpcz_store.cc:276] 0709 12:14:25.927736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.975559 (+ 47823us) service_pool.cc:224] Handling call
0709 12:14:25.976040 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:25.976499 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:14:26.070574 (+ 94075us) log.cc:844] Serialized 14 byte log entry
0709 12:14:27.174046 (+1103472us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:27.174785 (+   739us) log.cc:844] Serialized 26 byte log entry
0709 12:14:27.174971 (+   186us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:14:27.175022 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.175127 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:27.815097 (+639970us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:14:27.916657 (+101560us) raft_consensus.cc:1685] finished
0709 12:14:27.916812 (+   155us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.916960 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93388,"prepare.queue_time_us":93600,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":87,"raft.queue_time_us":62071,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":10671,"spinlock_wait_cycles":31435008,"thread_start_us":1102908,"threads_started":2,"wal-append.queue_time_us":974602}
I20260709 12:14:27.969098 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:27.946182 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:27.976342 26620 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 36.
I20260709 12:14:27.986655 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:27.988556 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:27.937685  4835 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.039s
I20260709 12:14:27.983218 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:27.978605 26514 leader_election.cc:400] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 33. Current term is 34.
W20260709 12:14:27.991142 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 218861us
I20260709 12:14:27.990170 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:27.999063  4289 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:27.990840  4910 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:27.943782  4940 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:27.974736  4943 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:27.972349  4948 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:27.937533  4867 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.036s
I20260709 12:14:28.032382 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:28.038980 26465 raft_consensus.cc:3060] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Advancing to term 38
I20260709 12:14:28.001391 26514 leader_election.cc:403] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 election: Cancelling election due to peer responding with higher term
W20260709 12:14:28.043299 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53229.9us
I20260709 12:14:28.020428 26472 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 29 index: 20. Preceding OpId from leader: term: 32 index: 22. (index mismatch)
I20260709 12:14:28.025966 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:28.046452 26473 raft_consensus.cc:2368] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 33. Current term is 34.
I20260709 12:14:28.004601 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:28.006590 26464 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 29 index: 19. (term mismatch)
I20260709 12:14:28.049492 26464 pending_rounds.cc:85] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Aborting all ops after (but not including) 18
I20260709 12:14:28.049805 26464 pending_rounds.cc:107] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: Aborting uncommitted NO_OP operation due to leader change: 28.19
I20260709 12:14:28.050202 26464 raft_consensus.cc:2889] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:27.941951  4861 consensus_queue.cc:1059] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 28.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.044s
I20260709 12:14:28.053344 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 37 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:28.001250 27167 raft_consensus.cc:2376] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33. Re-sending same reply.
I20260709 12:14:27.995630 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 42 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:28.003608 26467 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 36 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 35. Current term is 36. Ops: []
W20260709 12:14:28.115803 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 120261us
I20260709 12:14:27.951538  4716 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:28.041663 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 67883.2us
I20260709 12:14:27.975175  4925 raft_consensus.cc:2804] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election won for term 37
I20260709 12:14:28.120040 26473 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 38: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:28.117383 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:28.044126 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:27.999907  4933 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:28.128218 26465 raft_consensus.cc:2468] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 38.
W20260709 12:14:28.194021 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 149962us
I20260709 12:14:28.128197 26439 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:28.024986  4386 raft_consensus.cc:3055] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:14:27.991402  4957 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:28.023717  4854 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:28.197942 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 69811.6us
I20260709 12:14:28.048300  4945 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election lost for term 33. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 33. Current term is 34.
I20260709 12:14:28.114153  4685 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:14:28.026126  4948 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:28.213174 26471 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
I20260709 12:14:28.117482  4910 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.219278 26514 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:28.000459  4958 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:28.023816  4878 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.176s
I20260709 12:14:28.233516 26542 raft_consensus.cc:1240] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 33. Current term is 34. Ops: [33.20-33.20]
I20260709 12:14:28.201582  4925 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:28.021514  4940 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:28.113011  4813 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.209729 26439 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:28.210673  4957 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:14:28.226487 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 265644us
I20260709 12:14:28.127578  4943 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 41 FOLLOWER]: Leader pre-election lost for term 42. Reason: could not achieve majority
I20260709 12:14:28.199321  4506 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:28.231333 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:28.203824  4855 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election won for term 37
I20260709 12:14:28.202472  4814 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:28.232865 26547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 3975) took 1339 ms. Trace:
I20260709 12:14:28.214191  4386 raft_consensus.cc:740] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:28.244059 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 38 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:28.199555  4897 consensus_queue.cc:1059] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 33.20, Next index: 21, Last known committed idx: 19, Time since last communication: 0.040s
W20260709 12:14:28.256388 26513 leader_election.cc:336] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.708s (SENT)
W20260709 12:14:28.254034 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 44344.3us
I20260709 12:14:28.296805 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 38 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:28.376302 26620 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 39.
I20260709 12:14:28.376392 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:28.304364 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:28.305068 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:28.377971 26616 raft_consensus.cc:2393] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 34: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:28.307145 26547 rpcz_store.cc:276] 0709 12:14:26.893748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.895755 (+  2007us) service_pool.cc:224] Handling call
0709 12:14:28.232643 (+1336888us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b5400140854. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:28.232802 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2213147904}
I20260709 12:14:28.007530  4365 consensus_queue.cc:260] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 32.19, Last appended by leader: 19, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:28.378779 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:28.301759  4572 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.011s
I20260709 12:14:28.312783  4813 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:28.371907 26613 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
I20260709 12:14:28.300817  4855 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:28.302999 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:28.380860 26614 raft_consensus.cc:1240] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 35. Current term is 36. Ops: [35.23-35.23]
I20260709 12:14:28.375077 26473 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 38.
I20260709 12:14:28.287784  4945 raft_consensus.cc:2804] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Leader election won for term 38
I20260709 12:14:28.243116  4925 raft_consensus.cc:3060] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:28.230535  4802 consensus_queue.cc:1059] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 30.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.144s
W20260709 12:14:28.393626 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 137273us
I20260709 12:14:28.394882 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:28.301666  4958 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:28.306850  4814 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:28.300853  4957 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:28.413506 26439 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:28.366276  4641 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:28.239291  4910 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:28.224069  4854 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:28.452986  4910 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:28.455439  4716 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:28.456977  4698 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.457625  4698 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:28.458811  4386 consensus_queue.cc:260] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.20, Last appended by leader: 20, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:28.460206  4386 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:28.460605  4813 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:28.461139  4948 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 30.17, Last appended by leader: 17, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:28.463671  4806 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:28.409264  4933 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:28.394291  4581 consensus_queue.cc:1175] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aaadfdd9ca9f424c91505f9b43876233" responder_term: 33 status { last_received { term: 27 index: 16 } last_committed_idx: 16 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33. Ops: [28.17-32.19]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:14:28.404554  4855 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:28.465066  4933 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:28.432261  4814 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:28.384002  4867 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:28.392371  4365 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:28.403213  4771 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:28.480908 26465 raft_consensus.cc:1240] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33. Ops: []
W20260709 12:14:28.483038  4967 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 12:14:28.483887  4966 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 12:14:28.484588  4970 log.cc:927] Time spent T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:14:28.408402  4958 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:28.468533  4641 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:28.488004  4933 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:28.408532  4713 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:28.488679  4867 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:28.491917  4698 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:28.494820  4959 log.cc:927] Time spent T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 12:14:28.412349  4943 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:14:28.439755  4921 log.cc:927] Time spent T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:14:28.497845  4837 raft_consensus.cc:3060] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Advancing to term 38
W20260709 12:14:28.538405 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 124977us
I20260709 12:14:28.535840  4958 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:28.547192 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:28.558002 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:28.412582 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 216106us
I20260709 12:14:28.563645 26620 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 29.
W20260709 12:14:28.565994 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.566493 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:28.542155  4716 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:14:28.569617 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:28.576938 26618 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:14:28.570050 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:28.583925 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:28.584919 26465 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 32.
I20260709 12:14:28.591810 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:28.565071  4812 raft_consensus.cc:3055] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:14:28.600590 26466 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 36 index: 25. Preceding OpId from leader: term: 38 index: 26. (index mismatch)
I20260709 12:14:28.569001  4933 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:28.616837 26587 leader_election.cc:400] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29.
I20260709 12:14:28.576189  4940 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:28.659924 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:28.604617  4861 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:28.580441  4685 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:28.618839 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:28.620213  4930 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.649s	user 0.004s	sys 0.008s
I20260709 12:14:28.623072 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:14:28.593451 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 369474us
I20260709 12:14:28.625093 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:14:28.631331  4964 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:14:28.634353 26620 raft_consensus.cc:1240] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 23. Current term is 24. Ops: []
I20260709 12:14:28.611758  4641 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:28.639241  4867 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:28.604681  4515 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.102s
I20260709 12:14:28.745117  4928 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election won for term 39
I20260709 12:14:28.659031  4770 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:28.659899  4814 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:28.722908  4910 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.702664 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:28.758991 26544 raft_consensus.cc:2410] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for term 29 because replica has last-logged OpId of term: 28 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 20.
I20260709 12:14:28.703075 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:28.760418 26539 raft_consensus.cc:2376] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 36. Re-sending same reply.
I20260709 12:14:28.747180  4447 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:14:28.605170  4812 raft_consensus.cc:740] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:28.563087  4943 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:28.720482 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:28.637701 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 34 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:28.724632 27167 raft_consensus.cc:2410] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 33 because replica has last-logged OpId of term: 31 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 29 index: 20.
W20260709 12:14:28.725018 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 102017us
I20260709 12:14:28.774477 27166 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 35.
W20260709 12:14:28.725181 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 106502us
I20260709 12:14:28.639803 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:28.578154  4972 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election won for term 37
I20260709 12:14:28.729312 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:28.672605  4897 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:28.730322 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:28.784121 26545 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 29.
I20260709 12:14:28.616493  4716 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 36 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:28.702734  4861 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:14:28.700973 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 306156us
I20260709 12:14:28.757815  4771 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:28.763789 26542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55088 (request call id 4065) took 1736 ms. Trace:
I20260709 12:14:28.751466  4928 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:28.681917  4933 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:28.748903  4641 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:28.776973 26438 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:28.778457 27161 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 35 index: 22. Preceding OpId from leader: term: 36 index: 23. (index mismatch)
I20260709 12:14:28.753424  4867 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:28.785187  4972 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:28.779572 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 59246.1us
I20260709 12:14:28.801429  4716 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 33.22, Last appended by leader: 22, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:28.721585  4930 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:28.804075  4930 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:28.776185 26439 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:28.765812  4945 raft_consensus.cc:697] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 38 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:28.791862  4861 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:28.791292  4854 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:28.791249 26542 rpcz_store.cc:276] 0709 12:14:27.027753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.654355 (+626602us) service_pool.cc:224] Handling call
0709 12:14:28.233285 (+578930us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.233923 (+   638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.763561 (+529638us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b5400140850. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:28.763720 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1309458304}
W20260709 12:14:28.774868  4963 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:14:28.701709  4940 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:28.778936  4447 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:28.789070 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:28.757303  4770 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:28.808192 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:28.809175 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:28.617197 26587 leader_election.cc:403] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:28.787688  4978 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:28.794094  4928 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Advancing to term 39
I20260709 12:14:28.767104  4910 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:28.783629  4386 consensus_queue.cc:1059] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.026s
I20260709 12:14:28.781472  4855 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:28.820742 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 228657us
I20260709 12:14:28.786039  4925 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:28.806653  4972 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:28.844848 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:28.846865 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:28.847750 26465 raft_consensus.cc:2410] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 34 because replica has last-logged OpId of term: 32 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 16.
I20260709 12:14:28.848026 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 37 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:28.838375 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 49383.4us
I20260709 12:14:28.852510 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:28.853662 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 37 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:28.855214 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:28.831193 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:28.855932 26543 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 35.
I20260709 12:14:28.856308 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:28.857347 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:28.848680 26468 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 38.
I20260709 12:14:28.863569 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:28.865265 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 34 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:28.862073 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:28.868458 26544 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:14:28.821102  4897 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:28.799731  4835 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.033s
I20260709 12:14:28.854442 26541 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 37.
I20260709 12:14:28.800480  4641 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:28.811136  4713 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 35.22, Next index: 23, Last known committed idx: 22, Time since last communication: 0.039s
I20260709 12:14:28.794773  4771 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:28.829257  4854 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election lost for term 28. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29.
I20260709 12:14:28.834717  4515 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 41 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:28.793216  4685 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 32.20, Last appended by leader: 20, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:28.892398 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:28.892737 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:28.930107 26547 raft_consensus.cc:2410] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 34 because replica has last-logged OpId of term: 32 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 16.
W20260709 12:14:28.892221 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 107271us
I20260709 12:14:28.806185  4867 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:28.813568  4975 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.040s
I20260709 12:14:28.943815  4641 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:28.887487  4963 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:14:28.886791  4977 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:28.939061  4958 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:28.990211 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 137789us
I20260709 12:14:28.815480  4812 consensus_queue.cc:260] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 33.20, Last appended by leader: 20, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:28.940500  4771 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:28.940233  4957 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:28.940958  4982 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:14:28.889247  4984 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:14:28.994203 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 62739.6us
W20260709 12:14:28.995461 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.999655 26513 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:28.948654  4897 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election won for term 30
W20260709 12:14:28.997489 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 220589us
I20260709 12:14:28.921541  4919 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.072s
I20260709 12:14:28.989331  4983 raft_consensus.cc:3055] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 35 LEADER]: Stepping down as leader of term 35
I20260709 12:14:28.951625  4977 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.010160 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:28.996497  4713 consensus_queue.cc:1243] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer 01a57027214a411e80874ac7febd628b log is divergent from this leader: its last log entry 36.23 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 22
I20260709 12:14:28.995394  4980 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:28.934664  4515 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 41 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:29.043697 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 267585us
I20260709 12:14:28.880910  4945 consensus_queue.cc:237] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 36.22, Last appended by leader: 22, Current term: 38, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:29.009202  4897 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.018077  4812 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:14:29.041283 26437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.000s	sys 0.031s
I20260709 12:14:29.032534  4977 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:29.012691  4814 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:29.013355  4983 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 35 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:29.042059 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:29.044492 26439 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:29.040362  4872 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Stepping down as leader of term 28
W20260709 12:14:29.061573 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.988742  4447 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 32.23, Last appended by leader: 23, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:29.051502  4987 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader pre-election won for term 40
I20260709 12:14:29.039494  4835 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.040s
W20260709 12:14:29.093370 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 102312us
I20260709 12:14:29.095340 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:29.111092 27163 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 35. Current term is 36. Ops: []
I20260709 12:14:29.112596 26620 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31. Ops: []
I20260709 12:14:29.118963 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:29.076612  4897 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:29.074227  4872 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:29.166247 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:29.163323 26620 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 29 index: 21. Preceding OpId from leader: term: 31 index: 22. (index mismatch)
I20260709 12:14:29.080637  4933 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:29.080374  4987 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.174214 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:29.176775 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:29.176076 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 133935us
I20260709 12:14:29.180109 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:29.156302  4716 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:29.164885  4771 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:29.084896  4943 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:29.189378 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:29.090548  4713 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 20, Time since last communication: 0.099s
W20260709 12:14:29.179849 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.091671  4770 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:29.179591  4837 consensus_meta.cc:287] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.616s	user 0.011s	sys 0.001s
I20260709 12:14:29.190165  4933 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:29.194842  4925 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:29.171805  4814 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:29.203994 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:29.184834  4940 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:29.189282  4989 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:29.189839  4987 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Advancing to term 40
I20260709 12:14:29.202145  4994 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.291615 26615 raft_consensus.cc:2410] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 39 because replica has last-logged OpId of term: 37 index: 26, which is greater than that of the candidate, which has last-logged OpId of term: 36 index: 25.
I20260709 12:14:29.209441  4958 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:29.305776  4992 log.cc:927] Time spent T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
W20260709 12:14:29.304106  4993 log.cc:927] Time spent T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:14:29.316812  4935 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.360296  4716 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:29.378103  5001 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:14:29.360282  4940 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:29.220839  4943 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:29.222158  5007 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:29.279394  4867 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:29.477420 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 254012us
I20260709 12:14:29.423481 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:29.504845 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 34 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:29.505667 26616 raft_consensus.cc:2393] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 35: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:29.422987 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:29.478317 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 466955us
I20260709 12:14:29.506332 26620 raft_consensus.cc:2393] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 24: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:29.510290  4769 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:14:29.510630 26620 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 33 index: 22. Preceding OpId from leader: term: 36 index: 23. (index mismatch)
I20260709 12:14:29.513062  4990 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260709 12:14:29.306763  4989 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.187665  4983 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 35.23, Last appended by leader: 23, Current term: 35, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:29.494072 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:29.423615 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:14:29.553109 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.550654  4984 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.476831  4716 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:29.475034  4814 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:29.401654  4986 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.338s	user 0.001s	sys 0.001s
I20260709 12:14:29.481983  4957 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:29.223259  4872 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:29.627206 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:29.627462 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:29.628087 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:29.628485 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:29.633340 26543 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:29.633992 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:29.634727 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 35 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:29.628860 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:29.628895 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:29.636612 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:29.639298 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:29.636649 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:29.640401 26543 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 36.
I20260709 12:14:29.307874  4933 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:29.607121  4515 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 42 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:29.596616  4989 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:29.353820  4994 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:29.476059  4935 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:29.646994 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:29.638588  4983 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:29.648036 26548 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 35 LEADER]: Stepping down as leader of term 35
W20260709 12:14:29.637298  4930 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.017s	sys 0.056s
I20260709 12:14:29.675384 26613 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 30 index: 17. Preceding OpId from leader: term: 32 index: 18. (index mismatch)
I20260709 12:14:29.624717  4814 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:29.678468  5010 log.cc:927] Time spent T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:14:29.681123  4994 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:29.670271  4930 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.018s	sys 0.056s
I20260709 12:14:29.597581  5007 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:29.617306  4984 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:29.672037  5003 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
W20260709 12:14:29.692965  4506 consensus_meta.cc:287] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 1.323s	user 0.010s	sys 0.005s
I20260709 12:14:29.693718  4506 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:14:29.694238  4996 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 12:14:29.659983  4515 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:29.695775  4515 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:29.611604  4943 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:29.706422  4771 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:14:29.710060  5018 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.004s
W20260709 12:14:29.723694  4991 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.550s	user 0.000s	sys 0.003s
W20260709 12:14:29.737645  4897 consensus_meta.cc:287] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.004s
I20260709 12:14:29.738221  4897 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:29.740195  4910 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:29.744689  4812 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.679s	user 0.011s	sys 0.001s
W20260709 12:14:29.747612  4981 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.861s	user 0.006s	sys 0.006s
W20260709 12:14:29.747936  4928 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.915s	user 0.009s	sys 0.004s
W20260709 12:14:29.743444  4977 consensus_meta.cc:287] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.668s	user 0.012s	sys 0.000s
W20260709 12:14:29.752164  4980 consensus_meta.cc:287] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.692s	user 0.012s	sys 0.000s
I20260709 12:14:29.753543  4980 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:29.757997  4989 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:29.762784  4977 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:29.615549 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 426275us
W20260709 12:14:29.807205 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:29.809491 26470 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.012s	sys 0.003s
W20260709 12:14:29.810545 26511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.037s	sys 0.109s
I20260709 12:14:29.647665 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:29.813136 26544 raft_consensus.cc:2410] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 36 because replica has last-logged OpId of term: 35 index: 23, which is greater than that of the candidate, which has last-logged OpId of term: 33 index: 22.
I20260709 12:14:29.662649 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:29.814518 26622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 5084) took 1509 ms. Trace:
I20260709 12:14:29.653723 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:29.656755 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:29.820436  4861 consensus_meta.cc:287] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.000s	user 0.009s	sys 0.004s
I20260709 12:14:29.831957  5020 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:29.870577  4861 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:29.871191  5020 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:29.821305  4716 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:29.698273  4515 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:29.831866 26621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1939) took 1145 ms. Trace:
I20260709 12:14:29.748684  4928 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:29.669214 26548 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 35 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:29.842037  4812 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 41 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:29.878257  4812 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 41 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:29.879199 26548 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 35.22, Last appended by leader: 22, Current term: 35, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:29.880077  4928 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:29.881102 26548 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:29.881837  4812 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 42 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:29.844801 26470 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.012s	sys 0.003s
I20260709 12:14:29.883977 26470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 4098) took 1037 ms. Trace:
W20260709 12:14:29.859701 26511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.037s	sys 0.110s
I20260709 12:14:29.867421  4641 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
W20260709 12:14:29.868276 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 214511us
I20260709 12:14:29.875084 26621 rpcz_store.cc:276] 0709 12:14:28.672332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.673258 (+   926us) service_pool.cc:224] Handling call
0709 12:14:28.673733 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.674170 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.674210 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:28.695756 (+ 21546us) log.cc:844] Serialized 26 byte log entry
0709 12:14:28.769664 (+ 73908us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b1800402ac0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fcfe07 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b 00007f5075c79d23 00007f5075c7a0d1 00007f5076095a0f
0709 12:14:28.920547 (+150883us) raft_consensus.cc:1645] Marking committed up to 22
0709 12:14:28.920585 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.920656 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:29.814722 (+894066us) raft_consensus.cc:1685] finished
0709 12:14:29.814768 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.817619 (+  2851us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8046,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":18138,"spinlock_wait_cycles":5997312,"thread_start_us":150679,"threads_started":1,"wal-append.queue_time_us":316522}
I20260709 12:14:29.884485 26470 rpcz_store.cc:276] 0709 12:14:28.846588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.847062 (+   474us) service_pool.cc:224] Handling call
0709 12:14:28.847379 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.847591 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 20
0709 12:14:29.047570 (+199979us) log.cc:844] Serialized 14 byte log entry
0709 12:14:29.883229 (+835659us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:29.883379 (+   150us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:14:29.883519 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.883636 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.883895 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18986,"prepare.queue_time_us":355701,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":38189,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":22447,"thread_start_us":991547,"threads_started":3,"wal-append.queue_time_us":163748}
I20260709 12:14:29.887051 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:29.888747  4977 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:29.864456 26622 rpcz_store.cc:276] 0709 12:14:28.304912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.305597 (+   685us) service_pool.cc:224] Handling call
0709 12:14:28.379206 (+ 73609us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.379568 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.379607 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:28.405731 (+ 26124us) log.cc:844] Serialized 26 byte log entry
0709 12:14:28.724837 (+319106us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:14:28.724880 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.724949 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:29.746031 (+1021082us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5075c7586e 00007f5075c74bb6 00007f5075c747d8 00007f5075c7e221 00007f5075c7e1d9 00007f5075c7e169
0709 12:14:29.813481 (+ 67450us) raft_consensus.cc:1685] finished
0709 12:14:29.813542 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:29.814160 (+   618us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":552,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":18387,"spinlock_wait_cycles":54149376,"thread_start_us":270099,"threads_started":1,"wal-append.queue_time_us":431276}
I20260709 12:14:29.893428  5020 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:29.899456  4812 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:29.899549  4861 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:29.901021 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:29.902240  4812 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:29.909394  4983 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 30.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:14:29.911931  4983 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:14:29.913223  4983 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:29.937089  4812 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:29.937618  4935 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:29.938024  4812 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:29.940807  4812 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:29.946507 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 45695.9us
I20260709 12:14:29.915436  4983 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 30.16, Last appended by leader: 16, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:29.956856  4855 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:29.970199  4587 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.970680  4813 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.971196  4587 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:29.971500  4813 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:29.973995  4587 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:29.970321  4935 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.978077 26618 raft_consensus.cc:1275] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 37 index: 26. Preceding OpId from leader: term: 38 index: 26. (term mismatch)
I20260709 12:14:29.977939  4935 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:29.978741  4386 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:29.979764  4386 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:29.981572  4935 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:29.975077 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:29.987375  4983 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:29.975526 26622 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 36. Current term is 37. Ops: []
W20260709 12:14:29.975816 26615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54654 (request call id 4298) took 2112 ms (client timeout 2440 ms). Trace:
I20260709 12:14:29.975544  4835 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
I20260709 12:14:29.973995  4813 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:29.978704 26618 pending_rounds.cc:85] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Aborting all ops after (but not including) 25
I20260709 12:14:29.991039 26618 pending_rounds.cc:107] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: Aborting uncommitted NO_OP operation due to leader change: 37.26
I20260709 12:14:29.991448 26618 raft_consensus.cc:2889] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:29.989619 26615 rpcz_store.cc:269] 0709 12:14:27.863672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.863846 (+   174us) service_pool.cc:224] Handling call
0709 12:14:29.975244 (+2111398us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54003d7a54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:29.975594 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3125087104}
I20260709 12:14:29.992313 26588 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:29.986047  4872 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:29.993920 26618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48232 (request call id 1933) took 1377 ms. Trace:
I20260709 12:14:29.994379 26618 rpcz_store.cc:276] 0709 12:14:28.616366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.617818 (+  1452us) service_pool.cc:224] Handling call
0709 12:14:29.977026 (+1359208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:29.992165 (+ 15139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:29.993612 (+  1447us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54003d7a50. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:29.993819 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3026777344}
W20260709 12:14:29.996202  5024 log.cc:927] Time spent T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:14:29.996587  4289 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:29.997051  4289 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.997577  4289 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Advancing to term 36
W20260709 12:14:29.999164  4972 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 1.110s	user 0.017s	sys 0.009s
I20260709 12:14:29.999958  4972 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:30.001343  4806 raft_consensus.cc:3055] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:14:30.001801  4806 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:30.005735 26619 raft_consensus.cc:1240] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 36. Current term is 37. Ops: [36.19-36.19]
I20260709 12:14:30.007553  4386 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:29.975589 26473 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.011s	sys 0.003s
I20260709 12:14:30.016067  4386 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.017086  4386 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:30.020311  4386 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:30.030992 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:30.031530  5007 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:30.034080  4943 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:30.035380 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:30.036878 26466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1623) took 1416 ms. Trace:
I20260709 12:14:30.037367 26466 rpcz_store.cc:276] 0709 12:14:28.620857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.621686 (+   829us) service_pool.cc:224] Handling call
0709 12:14:28.622043 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.792804 (+170761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.792852 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:28.792912 (+    60us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:14:28.792958 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.036330 (+1243372us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54002dc154. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:30.036414 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.036676 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392130432}
I20260709 12:14:30.033933  4294 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:30.039482 26472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54414 (request call id 1620) took 1466 ms. Trace:
I20260709 12:14:30.039965 26472 rpcz_store.cc:276] 0709 12:14:28.572970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.581884 (+  8914us) service_pool.cc:224] Handling call
0709 12:14:28.582364 (+   480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.810970 (+228606us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.811003 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:28.811062 (+    59us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:14:28.811117 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.039018 (+1227901us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b540035f7d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:30.039080 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.039304 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525210496}
I20260709 12:14:30.050556  4386 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.051808  4386 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:30.050662 26546 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 24. Current term is 25. Ops: []
I20260709 12:14:30.052801 26540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 3999) took 1202 ms. Trace:
I20260709 12:14:30.056290  4386 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:30.057557  4987 consensus_meta.cc:287] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.656s	user 0.009s	sys 0.013s
I20260709 12:14:30.061923  4972 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:30.064271 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 34 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:30.066781 26548 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 35 index: 22. Preceding OpId from leader: term: 36 index: 23. (index mismatch)
I20260709 12:14:30.067232 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:14:30.067893  4581 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 36 current term: 36 is higher.
W20260709 12:14:30.068964 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.069125  4835 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.069991 26469 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 29.
I20260709 12:14:30.069931  4835 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:30.071204  4641 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:30.039885  4294 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:30.067390 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:30.072715 26465 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:14:30.092697 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:30.071827 26469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54414 (request call id 1613) took 2208 ms (client timeout 2080 ms). Trace:
W20260709 12:14:30.130146 26469 rpcz_store.cc:269] 0709 12:14:27.862926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.875250 (+ 12324us) service_pool.cc:224] Handling call
0709 12:14:28.231175 (+355925us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b5800011198. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5e9c 00007f5072fb5a5b 00007f507bece8d9 00007f507b028ee0 00007f507b0f20ab 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:14:30.071460 (+1840285us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400165654. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:30.071673 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3479528320}
I20260709 12:14:30.075862 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:30.133066 26621 raft_consensus.cc:2393] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 37: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:30.086131 27163 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 35.
I20260709 12:14:30.133877 26543 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 36.
I20260709 12:14:30.073529  4835 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:30.067318 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:30.053211 26540 rpcz_store.cc:276] 0709 12:14:28.850694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.854860 (+  4166us) service_pool.cc:224] Handling call
0709 12:14:28.893945 (+ 39085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:29.040169 (+146224us) raft_consensus.cc:1534] Early marking committed up to index 21
0709 12:14:29.209662 (+169493us) log.cc:844] Serialized 14 byte log entry
0709 12:14:29.479334 (+269672us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:29.479417 (+    83us) raft_consensus.cc:1645] Marking committed up to 21
0709 12:14:29.479485 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.052259 (+572774us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54002387d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:30.052327 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.052561 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":512059,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":938,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":140,"spinlock_wait_cycles":335615744,"thread_start_us":421328,"threads_started":2,"wal-append.queue_time_us":525266}
I20260709 12:14:30.152376  4919 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:30.153415 27160 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 32 index: 23. Preceding OpId from leader: term: 33 index: 24. (index mismatch)
I20260709 12:14:30.153817  4923 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:30.154583 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:30.154772  4923 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:30.156859  5005 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:30.157492  5005 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:30.157984  5005 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:14:30.158440 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 427488us
I20260709 12:14:30.159688 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:30.127274  4943 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:30.162454  4294 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:30.162847  4943 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:30.163358 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:30.153455  4919 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:30.165804  4943 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:30.167397 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:30.168301 26619 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 35. Current term is 36. Ops: []
W20260709 12:14:30.169426 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 102274us
I20260709 12:14:30.170185 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 38 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:14:30.172616 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.173444 26620 raft_consensus.cc:2393] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 39: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:30.170514 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:30.081056  4897 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:30.154498 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:30.179294 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 42 candidate_status { last_received { term: 41 index: 26 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:30.176476 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:30.079901  4341 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.095s
I20260709 12:14:30.183045 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:30.163358  4294 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:30.072160  4641 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:30.158219  4923 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:30.058382  4987 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 40 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:30.185597 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:30.196261 27166 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:14:30.197758 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:30.199929 27133 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:30.200722 27160 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:14:30.205159 26615 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:14:30.206606  4872 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
I20260709 12:14:30.208510  4933 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:30.204180 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 121996us
I20260709 12:14:30.198607 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:30.201097  4294 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:30.212095 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:30.213627 26619 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 37: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:30.214088 26542 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 35 index: 22. Preceding OpId from leader: term: 36 index: 23. (index mismatch)
I20260709 12:14:30.188786  4919 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:30.212661  4294 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:30.226722 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 42 candidate_status { last_received { term: 41 index: 26 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:30.217065  4943 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:30.225175 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:30.226502  4294 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:30.232673 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:30.240175 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:30.243216  5007 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:30.243444 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:30.245939 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:30.240020  4769 consensus_meta.cc:287] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.729s	user 0.018s	sys 0.011s
I20260709 12:14:30.253110 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:30.262137  4853 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
I20260709 12:14:30.262629 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:30.262426 27167 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 24.
I20260709 12:14:30.264711 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:30.265779 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:30.231572  4933 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.028s
I20260709 12:14:30.269673 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:30.271024 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 37 index: 26 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:30.271979  4878 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.279953  4878 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:30.283253 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 61416.8us
I20260709 12:14:30.283622 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:30.283296 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:30.288314 27165 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:14:30.291332 27168 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 28. Current term is 29. Ops: []
I20260709 12:14:30.295838  4641 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:30.296949  5007 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:14:30.297652  5007 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 35 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:30.299261 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:30.298929  5007 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 34.23, Last appended by leader: 23, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:30.300351  4812 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.001s
I20260709 12:14:30.300798  4943 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election won for term 33
W20260709 12:14:30.300995 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 44730.3us
I20260709 12:14:30.301304  4943 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:30.294665  4289 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:30.301821  4943 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:30.304041  4289 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:30.300369 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:30.307713 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:30.308861  4853 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election won for term 37
I20260709 12:14:30.309341 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:30.309365  4853 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:30.310333  4933 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:30.310102  4294 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:30.310432  4812 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
I20260709 12:14:30.311228  4933 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:30.313038  4933 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:30.307008  5005 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:30.310190  4853 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:30.314128  4294 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:30.318843 26587 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:30.320226  4289 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:30.320611  4897 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:30.320678  4289 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.321297  4289 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:30.321803  4987 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:30.302044 26438 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:14:30.323812  5028 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:14:30.328944 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:30.330333 26439 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:30.332214 27168 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33. Ops: [32.22-32.22]
I20260709 12:14:30.332369  4812 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election won for term 37
I20260709 12:14:30.332924  4812 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:30.333302  4812 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:30.335525 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:30.336906  4943 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:30.338759  4341 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election won for term 39
I20260709 12:14:30.338763  4897 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:14:30.341517 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 59868.2us
I20260709 12:14:30.344018 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:30.344779  4716 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:30.331488  5005 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:30.344751  4289 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:30.353544  4716 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.349340  4341 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.367818  4897 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:30.368482  4341 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Advancing to term 39
I20260709 12:14:30.379077 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:30.380155 26617 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 33.
I20260709 12:14:30.381467 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:30.362296  4716 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:30.383387 27168 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 28 index: 20. Preceding OpId from leader: term: 31 index: 22. (index mismatch)
I20260709 12:14:30.371938 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 39 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:30.375290 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:30.389355 26618 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
I20260709 12:14:30.401690 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:30.403041 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:30.403769  4814 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:30.403055 26469 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:14:30.403936  4983 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.405014  4983 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:30.408021  4983 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:30.415417 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 42 candidate_status { last_received { term: 41 index: 26 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:30.403908 27167 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 33.
I20260709 12:14:30.416373 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:30.433876 26473 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 41 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 41.
W20260709 12:14:30.416927 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 73061.4us
I20260709 12:14:30.417341 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:30.436024 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:30.436442 26468 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 36.
I20260709 12:14:30.436902  4853 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:30.437726 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:30.437827 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:30.439368 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:30.439705 26544 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 32 index: 20. Preceding OpId from leader: term: 34 index: 21. (index mismatch)
I20260709 12:14:30.419485 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:30.420704 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:30.421643 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:30.422515 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:30.423413  4943 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:30.423707  4814 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:30.423645 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:30.425171 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:30.426529 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 77770.5us
I20260709 12:14:30.434556 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 35 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:30.416640 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:14:30.417797  5032 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:14:30.440655 26541 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
W20260709 12:14:30.442611 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 49050.9us
I20260709 12:14:30.450984 26469 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:30.427325  4987 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:30.456369 26614 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 31: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:30.457819  4814 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:30.460083 26464 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 23.
I20260709 12:14:30.465111  4763 consensus_queue.cc:1048] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.001s
I20260709 12:14:30.465293 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 42 candidate_status { last_received { term: 41 index: 26 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:30.475484 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.463212  4861 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:30.478224 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:30.476413  4861 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:30.479640 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:30.482137  4769 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:14:30.482594  4979 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:30.472266  4983 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:30.483230 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 38 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:30.487175 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:30.487989  4983 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:30.492352  4814 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:30.493131  4853 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:30.492969  4979 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:30.493428  4983 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:30.493912  4989 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:30.495908 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:30.498534 26464 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:30.500089  4763 raft_consensus.cc:3055] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:14:30.500555  4763 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:30.502358 26471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 4107) took 1641 ms. Trace:
I20260709 12:14:30.502818 26471 rpcz_store.cc:276] 0709 12:14:28.860561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.878760 (+ 18199us) service_pool.cc:224] Handling call
0709 12:14:28.879106 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.934284 (+ 55178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.934320 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:28.934363 (+    43us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:14:28.934415 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.501915 (+1567500us) spinlock_profiling.cc:243] Waited 54.7 ms on lock 0x7b54002599d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:30.501987 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:30.502182 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125859712}
I20260709 12:14:30.503829  4979 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:30.506829 26465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43592 (request call id 4100) took 1657 ms. Trace:
I20260709 12:14:30.507359 26465 rpcz_store.cc:276] 0709 12:14:28.849567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.869586 (+ 20019us) service_pool.cc:224] Handling call
0709 12:14:30.072316 (+1202730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:30.145938 (+ 73622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.506566 (+360628us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400165650. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760d98ad 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:30.506727 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2764842880}
I20260709 12:14:30.488272 26621 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Advancing to term 40
I20260709 12:14:30.509279  4861 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:30.516417 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:30.517141 26473 raft_consensus.cc:2376] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 29. Re-sending same reply.
I20260709 12:14:30.514823  4763 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:30.523622 26619 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 12:14:30.518813  4984 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:30.521452  4878 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:30.525501  4853 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:30.528205  4763 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:30.534288 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:30.535076 26616 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:30.539141 26469 raft_consensus.cc:2468] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 37.
W20260709 12:14:30.542737 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:30.542920 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 56429.1us
I20260709 12:14:30.528632  4716 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:30.525748 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 50577.9us
I20260709 12:14:30.549703 26588 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:30.551746 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 34 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:30.552464 27160 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:30.568132 26621 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 40.
I20260709 12:14:30.569767  4853 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:30.486852  4987 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:30.653940  4987 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:30.654958  4853 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:30.655575  4853 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:30.570133 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:30.570808 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 129030us
I20260709 12:14:30.657104 26620 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 24.
I20260709 12:14:30.657392 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:30.575424 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:30.658713 26615 raft_consensus.cc:2368] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 29. Current term is 30.
I20260709 12:14:30.658994 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:30.660284  4814 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:30.578646 26470 raft_consensus.cc:2393] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 33: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:30.661052  4814 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260709 12:14:30.584523 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:30.584657 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:30.665045 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 80486.2us
I20260709 12:14:30.625136  4984 consensus_queue.cc:1059] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 34.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.040s
I20260709 12:14:30.665257 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:30.574754  4812 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:30.665957 26466 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:30.666101  4984 raft_consensus.cc:3055] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Stepping down as leader of term 36
I20260709 12:14:30.585419 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:14:30.587401  5031 log.cc:927] Time spent T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.337s	user 0.004s	sys 0.000s
I20260709 12:14:30.550995  4933 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:30.599983 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:30.600832 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:30.673043 27134 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:30.603543 26468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 35 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:30.675268 26464 raft_consensus.cc:2468] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 33.
I20260709 12:14:30.631192 26514 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:30.580650  4979 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:30.636677 26469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:30.618224 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:30.617285 27160 raft_consensus.cc:2468] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 36.
I20260709 12:14:30.640153 26614 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 36. Current term is 37. Ops: []
I20260709 12:14:30.640228 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:30.639171 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 37 index: 26 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:30.648829 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:30.578253 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:30.585274 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:30.615541  4341 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:30.668834 27165 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:30.675478 26468 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Advancing to term 36
W20260709 12:14:30.676275 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 45193.4us
I20260709 12:14:30.613222 26616 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 30.
I20260709 12:14:30.670753 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:30.667829 26472 raft_consensus.cc:1240] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 36. Current term is 37. Ops: []
I20260709 12:14:30.674130  4935 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
W20260709 12:14:30.683853 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.685441 26514 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:30.686726  4802 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:30.687325  4802 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.687755  4802 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:30.687912  4763 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election won for term 37
I20260709 12:14:30.688469  4763 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:30.688858  4763 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:30.690822 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:30.691509  4769 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:14:30.691977  4769 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.692358  4769 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:30.694937  4989 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:30.695865 26473 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 32.
I20260709 12:14:30.697194 26473 raft_consensus.cc:1240] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 32. Current term is 33. Ops: []
I20260709 12:14:30.702548 26468 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 36.
I20260709 12:14:30.704891 26464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 34 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:30.707631 27165 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:14:30.708521  5020 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:14:30.668395  4984 raft_consensus.cc:740] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:30.623389  4581 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.055s
I20260709 12:14:30.710513 27134 leader_election.cc:400] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 29. Current term is 30.
I20260709 12:14:30.709024  5020 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:30.714488 26467 raft_consensus.cc:1240] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 32. Current term is 33. Ops: []
I20260709 12:14:30.625748  4983 consensus_queue.cc:1059] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 35.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.074s
I20260709 12:14:30.624481  4912 consensus_queue.cc:1059] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.080s
I20260709 12:14:30.709721 26469 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:14:30.716372 27134 leader_election.cc:403] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 election: Cancelling election due to peer responding with higher term
W20260709 12:14:30.726320 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 58736.8us
I20260709 12:14:30.720000  4972 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:30.719638  5020 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:14:30.743999 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 125965us
I20260709 12:14:30.717473  4979 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:30.767391 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 135230us
I20260709 12:14:30.748821  4837 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.750716  4878 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader election lost for term 29. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc for earlier term 29. Current term is 30.
W20260709 12:14:30.797413 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 51115.1us
I20260709 12:14:30.801290  5002 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:30.780658  4987 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.021s
I20260709 12:14:30.799582 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 42 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:30.802227  4289 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:30.816927  4814 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 41 FOLLOWER]: Leader pre-election lost for term 42. Reason: could not achieve majority
W20260709 12:14:30.816722 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 135843us
I20260709 12:14:30.782212  4812 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:30.826442 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 53480.7us
I20260709 12:14:30.807788  5002 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:30.829946 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 111050us
I20260709 12:14:30.753194  4984 consensus_queue.cc:260] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 36.19, Last appended by leader: 19, Current term: 36, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:30.824977 26588 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:30.794904  4837 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:30.896737 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 371000us
I20260709 12:14:30.903687  4933 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:30.903861  4984 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:30.908198  4716 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:30.907482 26364 catalog_manager.cc:5697] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:30.910152  4812 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.910936  4812 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:30.912528 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:30.912741 26439 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:30.913234  4812 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:30.913573 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 42 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:30.913765 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:30.914510  4365 raft_consensus.cc:3055] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 35 LEADER]: Stepping down as leader of term 35
I20260709 12:14:30.914988  4365 raft_consensus.cc:740] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 35 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:30.915298  4806 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 30.20, Last appended by leader: 20, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:30.915985  4365 consensus_queue.cc:260] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 35.19, Last appended by leader: 19, Current term: 35, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:30.916924  4806 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:30.917414  4365 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:30.917781  5059 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:30.924794 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:30.925478 26616 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
W20260709 12:14:30.929612 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 105538us
I20260709 12:14:30.933331 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:30.873497  5002 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:14:30.935861 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 110946us
I20260709 12:14:30.936234 27166 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 35. Current term is 36. Ops: []
I20260709 12:14:30.939670 26616 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
W20260709 12:14:30.941282 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.941668 26466 raft_consensus.cc:2410] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 37 because replica has last-logged OpId of term: 36 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 34 index: 18.
I20260709 12:14:30.918226  5059 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:30.943111 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:14:30.945444 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 66222.8us
I20260709 12:14:30.945091 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:30.946185 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:30.943097 26588 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:30.950727 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:30.918593  4972 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 41 FOLLOWER]: Leader pre-election won for term 42
I20260709 12:14:30.950596 26514 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:30.914523  5007 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:14:30.954030 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:30.950727 26439 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:30.832759  4294 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.103s
W20260709 12:14:30.971086 26513 leader_election.cc:336] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.637s (SENT)
I20260709 12:14:30.978543 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:30.979343 27160 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 29.
I20260709 12:14:30.981622 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:30.956162 26616 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 34.
I20260709 12:14:30.988099 26616 raft_consensus.cc:1240] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31. Ops: []
I20260709 12:14:30.946905  4861 raft_consensus.cc:2804] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:14:30.955998 26364 catalog_manager.cc:5697] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 27 to 29. New cstate: current_term: 29 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:30.991272 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:30.992985 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.965250  4289 raft_consensus.cc:2804] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:14:30.965433  4872 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election won for term 37
I20260709 12:14:30.993387 26439 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:30.998065 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:30.999032 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 37 candidate_status { last_received { term: 35 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:30.955523  4341 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:30.979215  5007 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:30.971587  5057 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:30.952360  5059 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:30.955334  4716 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
W20260709 12:14:30.994011 26513 leader_election.cc:336] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 1.680s (SENT)
W20260709 12:14:31.015102 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 61154.4us
I20260709 12:14:30.980415  4972 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 41 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:30.989730  4812 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:14:30.991250  4989 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 12:14:31.026082  4814 consensus_queue.cc:1059] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.011s
I20260709 12:14:31.038786  4837 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:31.039161  5062 raft_consensus.cc:2804] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 40 FOLLOWER]: Leader election won for term 40
I20260709 12:14:31.039922  5062 raft_consensus.cc:697] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 40 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:31.041069  5062 consensus_queue.cc:237] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 38.21, Last appended by leader: 21, Current term: 40, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:31.054593  5058 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:31.054728 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:31.014545  5055 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:14:31.055912  5055 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.055608  5058 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.058975  5007 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:31.060802  4769 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.061019  4802 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:31.061474 26621 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: [29.18-29.18]
I20260709 12:14:31.010349  4872 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:31.062271  4872 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:31.055517  4835 raft_consensus.cc:3055] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Stepping down as leader of term 36
I20260709 12:14:31.063020  4835 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:31.063395  4989 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:31.030893  4972 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 41 FOLLOWER]: Advancing to term 42
I20260709 12:14:31.063994  4989 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:30.963368  4763 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.065968  4979 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:31.056345  5055 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:31.066839 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:31.067232  4763 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:30.961349  4853 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:30.994695  4641 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:31.024984 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:31.070510 27165 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 36. Current term is 37. Ops: []
W20260709 12:14:31.071298 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.073334 26613 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33. Ops: [32.18-32.18]
I20260709 12:14:31.033150 26364 catalog_manager.cc:5697] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 22 to 25, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 25 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:31.055485  5052 log.cc:927] Time spent T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:14:31.018335  4933 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:31.058149  5058 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:31.088606 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:31.083496 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.016155  4919 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 36.23, Next index: 24, Last known committed idx: 22, Time since last communication: 0.062s
I20260709 12:14:31.100376  4979 consensus_queue.cc:1059] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 31.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
I20260709 12:14:31.100675  5020 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.088397  4933 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.101541 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:31.103252  4987 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 12:14:31.106967 26619 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:31.093190  5057 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.107618  5054 consensus_queue.cc:1059] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:14:31.108355 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:31.108953 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:31.108888  4641 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:31.110152 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:31.111409 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:31.114634 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:31.118918 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 124952us
I20260709 12:14:31.119347 26542 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 35 index: 23. Preceding OpId from leader: term: 36 index: 23. (term mismatch)
I20260709 12:14:31.050248  5002 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:31.122000  4853 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:31.126775 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:31.138512 26542 pending_rounds.cc:85] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 22
I20260709 12:14:31.145030 26542 pending_rounds.cc:107] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 35.23
I20260709 12:14:31.145454 26542 raft_consensus.cc:2889] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:31.132184  4933 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:31.132357 26364 catalog_manager.cc:5697] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 23 to 30, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 30 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:31.183718 26543 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:31.063957  4835 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 36.22, Last appended by leader: 22, Current term: 36, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:31.200616 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:31.195708 26546 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:14:31.205957 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 38 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:31.202775 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 50205.1us
W20260709 12:14:31.206977 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 216505us
I20260709 12:14:31.212035 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:31.212145 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:31.212884 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:31.213655 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:31.217362 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:31.218041 26544 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:14:31.177943  4769 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:31.221834 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 182973us
I20260709 12:14:31.187548  4912 raft_consensus.cc:3055] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:14:31.196590  4341 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.237787 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:14:31.247087 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.247915 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:31.248458 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:31.248872 27167 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:31.235818 26364 catalog_manager.cc:5697] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 21 to 29, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 29 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:31.254223 26548 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 32 index: 23. Preceding OpId from leader: term: 33 index: 24. (index mismatch)
I20260709 12:14:31.225597 26588 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:14:31.282675 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 401162us
I20260709 12:14:31.284245 27133 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:31.294874 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:31.295836 26618 raft_consensus.cc:3060] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:14:31.299893 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 74433.9us
I20260709 12:14:31.300871  4943 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:31.232264  4289 raft_consensus.cc:697] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:31.233664  4912 raft_consensus.cc:740] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:31.227301  4581 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.317588 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:31.246254  4861 raft_consensus.cc:697] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 36 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:31.250563  4989 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:31.253605  4802 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:31.294296  4835 raft_consensus.cc:3060] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:31.321465 26470 raft_consensus.cc:2376] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 38. Re-sending same reply.
I20260709 12:14:31.279356  5007 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:31.362870 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:31.238953  5061 consensus_queue.cc:1059] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 30.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.082s
I20260709 12:14:31.306931  5058 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:14:31.353991 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 82181.5us
I20260709 12:14:31.249403  4983 consensus_queue.cc:1059] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 31.22, Next index: 23, Last known committed idx: 21, Time since last communication: 0.072s
W20260709 12:14:31.377080 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 162071us
W20260709 12:14:31.354588  5045 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:14:31.298733  4341 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:31.373687 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:31.376546 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.350868  4812 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:31.301909  4943 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:31.372959 26466 raft_consensus.cc:2368] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 33. Current term is 34.
I20260709 12:14:31.365293  4989 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.386277 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:31.380580 26587 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:14:31.393682 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 92012.9us
I20260709 12:14:31.396510 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:31.398851 26621 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 29 index: 15. Preceding OpId from leader: term: 31 index: 16. (index mismatch)
I20260709 12:14:31.316622  5037 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 36.23, Next index: 24, Last known committed idx: 22, Time since last communication: 0.061s
I20260709 12:14:31.411545 26467 raft_consensus.cc:1240] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 36. Current term is 37. Ops: []
I20260709 12:14:31.409325 26470 raft_consensus.cc:2468] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:14:31.407914 26364 catalog_manager.cc:5697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 24 to 27. New cstate: current_term: 27 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:31.418144 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 37 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:31.423276  4984 consensus_meta.cc:287] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.519s	user 0.013s	sys 0.000s
I20260709 12:14:31.410941  4989 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:31.424268  5066 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:14:31.424765  5066 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.425127  5066 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:31.426487  4989 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:31.426805  4289 consensus_queue.cc:237] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.20, Last appended by leader: 20, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.427596 26542 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 37.
I20260709 12:14:31.419235 27133 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:31.370512  4972 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 42 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.444180  4972 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 42 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:31.444896 26470 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 38: Already voted for candidate 01a57027214a411e80874ac7febd628b in this term.
I20260709 12:14:31.446020 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:31.421139 26364 catalog_manager.cc:5697] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 17 to 19, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 19 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:31.438952  4641 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:31.440945 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:31.446421 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:31.374148  5007 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:31.456753 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 39 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:31.455617  4687 raft_consensus.cc:2804] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader election won for term 37
I20260709 12:14:31.377942  4581 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.467065 26472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:31.456753 26465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:31.456434 26364 catalog_manager.cc:5697] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 21 to 24. New cstate: current_term: 24 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:31.458243 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:31.439002  5002 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:31.461933  5055 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.467752 26473 raft_consensus.cc:2468] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 27.
I20260709 12:14:31.472714 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:31.473709 26470 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 33.
I20260709 12:14:31.476547 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:31.479647  4948 raft_consensus.cc:3055] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:14:31.480136  4948 raft_consensus.cc:740] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:31.481142  4948 consensus_queue.cc:260] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.18, Last appended by leader: 18, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:31.483853  4581 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:31.484229 26466 raft_consensus.cc:1240] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: [29.19-29.19]
I20260709 12:14:31.485998 26465 raft_consensus.cc:1240] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 35. Current term is 36. Ops: []
I20260709 12:14:31.496485  5070 consensus_queue.cc:1059] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 32.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.025s
I20260709 12:14:31.497005  4812 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 31.18, Last appended by leader: 18, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:31.500007 26620 raft_consensus.cc:2393] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 25: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:31.500308  5055 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:31.500756  5060 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 36 LEADER]: Stepping down as leader of term 36
I20260709 12:14:31.501211  5060 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 36 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:31.502117  4806 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.502677  4806 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.505389  4861 consensus_queue.cc:237] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 34.23, Last appended by leader: 23, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.506657 26468 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 36 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 35. Current term is 36. Ops: []
I20260709 12:14:31.504895  4806 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:31.511087  5067 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.335s	user 0.005s	sys 0.000s
I20260709 12:14:31.511531  4687 raft_consensus.cc:697] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:31.512938  4837 raft_consensus.cc:3055] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:14:31.512636  4687 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 35.21, Last appended by leader: 21, Current term: 37, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:31.513337  4837 raft_consensus.cc:740] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:31.514246  4837 consensus_queue.cc:260] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 32.20, Last appended by leader: 20, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.514858  5057 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:31.502117  5060 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 36.23, Last appended by leader: 23, Current term: 36, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.518054 26472 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 33.
I20260709 12:14:31.518695  4948 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:31.485880 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55090 (request call id 4011) took 1050 ms. Trace:
I20260709 12:14:31.520354 26546 rpcz_store.cc:276] 0709 12:14:30.435073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.439084 (+  4011us) service_pool.cc:224] Handling call
0709 12:14:31.485721 (+1046637us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b54003985d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:14:31.485824 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1737733888}
I20260709 12:14:31.487236  4872 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:31.487659  4943 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:31.487326 26471 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33. Ops: [31.21-32.22]
I20260709 12:14:31.468499 26467 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 34.
I20260709 12:14:31.489699  4923 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:14:31.523114  4923 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 29 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:31.523237  4872 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:31.523684  5065 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.093s
I20260709 12:14:31.524158  4923 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.525723 26364 catalog_manager.cc:5697] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 23 to 25, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 25 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:31.528563  4814 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 36 LEADER]: Stepping down as leader of term 36
I20260709 12:14:31.529045  4814 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 36 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:31.491011  4716 raft_consensus.cc:3055] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 35 LEADER]: Stepping down as leader of term 35
W20260709 12:14:31.533002 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 86442.5us
I20260709 12:14:31.485647 26466 raft_consensus.cc:1240] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33. Ops: []
I20260709 12:14:31.528555 26364 catalog_manager.cc:5697] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 25 to 27, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 27 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
W20260709 12:14:31.538002 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.518877  5020 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:31.489009  4341 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:31.522092 26613 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 36. Current term is 37. Ops: []
I20260709 12:14:31.485808 26473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 38 index: 21 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:31.542044 26473 raft_consensus.cc:3060] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Advancing to term 40
W20260709 12:14:31.535265 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 115575us
I20260709 12:14:31.544165 26470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:31.544775 27167 raft_consensus.cc:2468] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:14:31.545109 26470 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:14:31.548915 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:31.550153 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 42 candidate_status { last_received { term: 41 index: 26 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:31.534466  5060 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:31.535066  4716 raft_consensus.cc:740] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 35 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:31.559983 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:31.561764 27166 raft_consensus.cc:2393] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 25: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:31.513756  4912 consensus_queue.cc:260] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 32.22, Last appended by leader: 22, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.549053  4341 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:31.541414  4814 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 36.23, Last appended by leader: 23, Current term: 36, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.591094 26470 raft_consensus.cc:1240] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 29. Current term is 30. Ops: []
I20260709 12:14:31.590768 26622 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 36 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 35. Current term is 36. Ops: []
I20260709 12:14:31.557269 26364 catalog_manager.cc:5697] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:31.565910 27167 raft_consensus.cc:1240] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 35. Current term is 36. Ops: [35.24-35.24]
W20260709 12:14:31.564905 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 151592us
I20260709 12:14:31.583161 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 37 candidate_status { last_received { term: 35 index: 23 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:31.548846 26618 raft_consensus.cc:2468] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 34.
I20260709 12:14:31.599617 26364 catalog_manager.cc:5697] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:31.597618 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:31.606230 26471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:31.609790 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
W20260709 12:14:31.610157 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 182354us
I20260709 12:14:31.611068 26587 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:31.585207  5086 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:31.610540 26467 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:14:31.583583  4802 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:461: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 1
I20260709 12:14:31.618296 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:31.606048  4814 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:31.624639  4289 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:14:31.624941 26467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b" is_pre_election: true
I20260709 12:14:31.627840 26617 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 30 index: 18. (index mismatch)
W20260709 12:14:31.629330 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.632627  5066 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.561193  5020 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
I20260709 12:14:31.581585  4716 consensus_queue.cc:260] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 35.24, Last appended by leader: 24, Current term: 35, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.635342 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:31.649761 27133 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:31.635990 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 78709.3us
I20260709 12:14:31.637336 26465 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33. Ops: []
I20260709 12:14:31.634509  4802 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.639518 25293 tablet_server.cc:179] TabletServer@127.24.179.65:0 shutting down...
I20260709 12:14:31.640511  5007 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:31.641129 26540 raft_consensus.cc:2410] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 37 because replica has last-logged OpId of term: 36 index: 22, which is greater than that of the candidate, which has last-logged OpId of term: 32 index: 20.
I20260709 12:14:31.641016  4912 raft_consensus.cc:3060] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
W20260709 12:14:31.615041  5059 consensus_meta.cc:287] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.526s	user 0.012s	sys 0.000s
I20260709 12:14:31.652776 26471 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 36 index: 22. Preceding OpId from leader: term: 38 index: 23. (index mismatch)
I20260709 12:14:31.651311 26467 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 33.
I20260709 12:14:31.646067 26473 raft_consensus.cc:2468] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 40 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 40.
I20260709 12:14:31.651340 26466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "01a57027214a411e80874ac7febd628b"
I20260709 12:14:31.656227 26364 catalog_manager.cc:5697] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 26 to 29, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 29 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:31.604115  4341 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.658034 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:31.663107 27133 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:31.664851  4289 raft_consensus.cc:697] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 36 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
W20260709 12:14:31.665591 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.623435  5086 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.670663  5088 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
I20260709 12:14:31.675655  4837 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:31.679826  4802 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:31.680825 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.729905 26546 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 29.
I20260709 12:14:31.682833 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:31.647141  4919 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 12:14:31.737352 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 74321.3us
I20260709 12:14:31.664573 26364 catalog_manager.cc:5697] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:31.738946 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:31.740710 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 82766.7us
I20260709 12:14:31.740222  5055 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election won for term 32
W20260709 12:14:31.721715  5093 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:14:31.751922 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:31.752625 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:31.721594  4983 raft_consensus.cc:3055] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:14:31.682981  5087 raft_consensus.cc:2804] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:14:31.753557 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:14:31.747829 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 86063us
I20260709 12:14:31.759053 26622 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:31.759364 26364 catalog_manager.cc:5697] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 19 to 28, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 28 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:31.764438  5086 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:31.740870  4763 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election won for term 33
W20260709 12:14:31.787233 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.660686  4716 raft_consensus.cc:3060] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:31.755923  5055 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:31.772624  4933 consensus_meta.cc:287] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.003s
I20260709 12:14:31.773687 26621 raft_consensus.cc:1275] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 35 index: 21. Preceding OpId from leader: term: 38 index: 23. (index mismatch)
W20260709 12:14:31.774125 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.660285  5059 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:31.771848  4861 consensus_queue.cc:1059] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 32.21, Next index: 22, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:14:31.795185  4861 raft_consensus.cc:3055] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:14:31.775686  4983 raft_consensus.cc:740] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:31.799074 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:31.797107  4861 raft_consensus.cc:740] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:31.812889  4861 consensus_queue.cc:260] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 32.21, Last appended by leader: 21, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:31.814131  5091 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.193s	user 0.000s	sys 0.002s
I20260709 12:14:31.804917  5059 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:31.805495 26614 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31. Ops: []
I20260709 12:14:31.790004  4763 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:31.797343  5086 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.796327  4933 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:31.789677  5064 consensus_queue.cc:1059] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 36.23, Next index: 24, Last known committed idx: 22, Time since last communication: 0.011s
I20260709 12:14:31.793108  5055 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:31.811107 26588 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:31.811287 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:31.816138  5054 raft_consensus.cc:3055] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:14:31.819263 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:31.820035 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:31.821290  5066 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:31.827045 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.799790 26613 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 24.
I20260709 12:14:31.799412 26514 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:31.832669 27166 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 36. Current term is 37. Ops: []
I20260709 12:14:31.790980  5087 raft_consensus.cc:697] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 33 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:31.837452 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:31.840601 26546 raft_consensus.cc:3060] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:31.856079 26466 raft_consensus.cc:2368] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 34. Current term is 35.
I20260709 12:14:31.863040 27162 raft_consensus.cc:2368] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25.
I20260709 12:14:31.857451 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:31.863476 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:31.835889  4763 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:31.832628  5065 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:14:31.862560 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 63272.7us
I20260709 12:14:31.867187  4948 raft_consensus.cc:2804] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:14:31.867552 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 37 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:31.891654 26548 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Advancing to term 39
I20260709 12:14:31.868436  4710 raft_consensus.cc:3055] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 36 LEADER]: Stepping down as leader of term 36
I20260709 12:14:31.843802  5054 raft_consensus.cc:740] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 31 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:31.869025 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:31.867578 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:31.873504  4341 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:31.847137  4861 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:31.843057  5086 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:31.889467 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:31.886886  5090 log.cc:927] Time spent T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.253s	user 0.002s	sys 0.000s
I20260709 12:14:31.854326  5059 raft_consensus.cc:2804] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election won for term 32
W20260709 12:14:31.899439 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.899564 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:31.904973 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:31.911664 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:31.909338 27162 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:14:31.896520  4710 raft_consensus.cc:740] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 36 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:31.920481 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:31.922676 26439 leader_election.cc:400] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25.
I20260709 12:14:31.927697 26439 leader_election.cc:403] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
W20260709 12:14:31.923050 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 131323us
I20260709 12:14:31.929447 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:31.901726  4294 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:31.932499 26542 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:31.933491  5020 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:31.930888  5061 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 21, Time since last communication: 0.003s
I20260709 12:14:31.943012  4710 consensus_queue.cc:260] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 36.23, Last appended by leader: 23, Current term: 36, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.902560  4948 raft_consensus.cc:697] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 34 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:31.944310 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:31.944847  4948 consensus_queue.cc:237] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 32.19, Last appended by leader: 19, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:31.945957 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:31.919981  4814 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.018s
I20260709 12:14:31.946630 27165 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 25.
I20260709 12:14:31.947032 27167 raft_consensus.cc:1240] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 31. Current term is 32. Ops: [29.21-31.22]
I20260709 12:14:31.946298 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:31.944386  4710 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:31.921880  4983 consensus_queue.cc:260] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 32.18, Last appended by leader: 18, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:31.963726  4983 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:31.920678  5059 raft_consensus.cc:697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:31.894021  4289 consensus_queue.cc:237] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 35.19, Last appended by leader: 19, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:31.967046  5059 consensus_queue.cc:237] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 31.22, Last appended by leader: 22, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.901450  5065 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.970921 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:31.972229  5037 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:31.972489  5065 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:31.973023  5037 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 12:14:31.973100 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:31.908352  4835 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 36.22, Next index: 23, Last known committed idx: 22, Time since last communication: 0.067s
I20260709 12:14:31.976303  5054 consensus_queue.cc:260] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 31.22, Last appended by leader: 22, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.977484  5054 raft_consensus.cc:3060] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:31.977633  4943 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
W20260709 12:14:31.984553 26513 leader_election.cc:336] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Timed out: RequestConsensusVote RPC to 127.24.179.65:45149 timed out after 2.095s (SENT)
I20260709 12:14:31.985414 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:31.986382  4294 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:31.988363  5094 log.cc:927] Time spent T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:14:31.970052 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:31.991670  5086 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:31.991919  4341 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:31.992980 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:31.994303  4935 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 12:14:31.994685  5072 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:31.995129  5072 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:31.995496  5072 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:31.986600  5007 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.999074  5007 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:32.001400  5007 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:32.001703 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:32.004024  4812 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:32.004616  4812 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:32.009985  4812 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:32.010216 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:32.025106 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:32.025784  5007 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:14:32.026571 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:32.027537  4943 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader election lost for term 37. Reason: could not achieve majority
I20260709 12:14:32.028105  5007 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
I20260709 12:14:32.029166  5078 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.001s
I20260709 12:14:32.030779  4763 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:32.013900 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:32.041327  4933 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:32.041874 27161 raft_consensus.cc:2393] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 30: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:32.023242 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:32.043488  5088 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader election lost for term 37. Reason: could not achieve majority
I20260709 12:14:31.958528 26548 raft_consensus.cc:2468] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 39.
I20260709 12:14:32.031432 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:32.032044 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.010640  5071 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
W20260709 12:14:31.984208  4802 consensus_queue.cc:1175] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aaadfdd9ca9f424c91505f9b43876233" responder_term: 32 status { last_received { term: 31 index: 22 } last_committed_idx: 21 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 31. Current term is 32. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:14:32.012835 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:32.038704  5087 consensus_queue.cc:237] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 31.21, Last appended by leader: 21, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:31.990131  4294 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:32.075384  4933 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 40 FOLLOWER]: Leader election lost for term 39. Reason: could not achieve majority
I20260709 12:14:32.077570 26542 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 37.
I20260709 12:14:32.081346 26587 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:32.037792  5072 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:32.085866  4763 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:32.111220 26621 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 30 index: 17. Preceding OpId from leader: term: 33 index: 19. (index mismatch)
I20260709 12:14:32.091481 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:32.116053 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:32.121088 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 37 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:32.122423 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:32.124603 27168 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 20. Preceding OpId from leader: term: 30 index: 21. (index mismatch)
I20260709 12:14:32.125185 27161 raft_consensus.cc:1275] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 34 index: 23. Preceding OpId from leader: term: 36 index: 24. (index mismatch)
I20260709 12:14:32.107728  4341 raft_consensus.cc:2804] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Leader election won for term 39
I20260709 12:14:32.126014  4341 raft_consensus.cc:697] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 39 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:32.118970 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:32.098294  4987 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
I20260709 12:14:32.109931  5078 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.124670 27166 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 32. Current term is 33. Ops: []
I20260709 12:14:31.937393 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:32.107577 26546 raft_consensus.cc:2468] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:14:32.098001  4812 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:14:32.164903 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.155891 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:32.177811 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 240498us
I20260709 12:14:32.178681 26548 raft_consensus.cc:2393] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 25: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:32.138729 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:14:32.155311 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 205700us
I20260709 12:14:32.179803 26616 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:32.157163 26543 raft_consensus.cc:1275] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 20. Preceding OpId from leader: term: 30 index: 21. (index mismatch)
I20260709 12:14:32.134799 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:32.173455 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.139055 26437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.136691  4341 consensus_queue.cc:237] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 37.19, Last appended by leader: 19, Current term: 39, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:32.135501 26614 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 42 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 41. Current term is 42. Ops: []
I20260709 12:14:32.188624 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:32.192298 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:32.194171 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:32.194880 26539 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Advancing to term 37
W20260709 12:14:32.196255 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 61554.1us
I20260709 12:14:32.200940  4814 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.017s
I20260709 12:14:32.210630 26620 raft_consensus.cc:1240] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33. Ops: [32.18-32.18]
I20260709 12:14:32.148396  5007 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:32.149454  5084 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:32.171442  4687 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:14:32.195082  4641 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Stepping down as leader of term 36
I20260709 12:14:32.193426  4835 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:14:32.222286 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 37 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:32.226403 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:32.217048  4641 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:32.228896 26615 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 37: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:32.229805 26616 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 35.
W20260709 12:14:32.230928 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.231472 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.188066  4812 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:32.213467  5007 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:32.216662  4687 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:32.188155  5078 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:32.221738  4814 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:32.239678 26514 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:32.210800  5065 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 30.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.022s
I20260709 12:14:32.242375  4812 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:32.217124  4935 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.022s
I20260709 12:14:32.251482 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:32.250885 26614 raft_consensus.cc:1240] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 29. Current term is 30. Ops: []
I20260709 12:14:32.221274  5066 consensus_queue.cc:1048] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.030s
I20260709 12:14:32.236274  5056 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:32.236080  4983 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:32.235966  5057 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:32.245890  5007 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:32.261715 26540 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 36. Current term is 37. Ops: [36.23-36.23]
I20260709 12:14:32.226410  5088 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 32.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.029s
I20260709 12:14:32.247329  4687 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:32.254725  5062 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election won for term 34
W20260709 12:14:32.267495 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.226560  5060 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 41.26, Next index: 27, Last known committed idx: 26, Time since last communication: 0.027s
I20260709 12:14:32.267575 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:32.226372  4943 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.030s
I20260709 12:14:32.260973  4641 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 36.22, Last appended by leader: 22, Current term: 36, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:32.276499  4835 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.286227  5062 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.269407  5089 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:32.279951  5057 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:32.279142  5088 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:14:32.315490  5088 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:32.316454  5088 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 32.21, Last appended by leader: 21, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:32.317050 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:32.317456  5007 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:32.317785 26540 raft_consensus.cc:2468] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:32.319445  4641 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:32.321362  5007 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:32.312150  5062 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:32.323776  5072 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:32.311147 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:32.311200 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:32.315025  5057 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:32.317860  5088 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:32.313827 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:32.346016 26542 raft_consensus.cc:2410] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 33 because replica has last-logged OpId of term: 32 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 31 index: 18.
I20260709 12:14:32.346947 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:32.309929  5065 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:32.353811 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:32.312304  4835 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:32.352262 26547 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 34.
W20260709 12:14:32.356596 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 46184.1us
I20260709 12:14:32.270648  5068 consensus_queue.cc:1059] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.080s
I20260709 12:14:32.364005 26539 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 37.
W20260709 12:14:32.255120 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 303967us
I20260709 12:14:32.377562 26543 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 36. Current term is 37. Ops: [36.23-36.23]
I20260709 12:14:32.294606  5055 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:32.381114 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:32.396688 26542 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:32.398639 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:32.272925  4983 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:32.397034 26544 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 30 index: 18. (term mismatch)
I20260709 12:14:32.273298  5056 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:32.403468 26544 pending_rounds.cc:85] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 17
I20260709 12:14:32.403954 26544 pending_rounds.cc:107] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 29.18
I20260709 12:14:32.404212 26544 raft_consensus.cc:2889] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:32.397203 26511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.422523 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.419914 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 219904us
I20260709 12:14:32.428267 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:32.431291 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 310958us
I20260709 12:14:32.406562  4923 raft_consensus.cc:3055] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 29 LEADER]: Stepping down as leader of term 29
W20260709 12:14:32.445880 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 285230us
I20260709 12:14:32.421567  5020 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069) with higher term. Message: Invalid argument: T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 24. Current term is 25.
I20260709 12:14:32.456548 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:32.458200 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 203111us
I20260709 12:14:32.430750  5078 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:32.462116 26614 raft_consensus.cc:1275] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 32 index: 19. (index mismatch)
I20260709 12:14:32.460682 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:32.468577 27133 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.473840 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:32.484275 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:32.486678  5078 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:32.487619  5078 raft_consensus.cc:2804] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:32.488126  5078 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:32.488590  5078 raft_consensus.cc:3060] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:32.466566  5064 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 41 LEADER]: Stepping down as leader of term 41
I20260709 12:14:32.490691  4710 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:32.461826  5007 raft_consensus.cc:2764] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader pre-election decision vote started in defunct term 36: won
I20260709 12:14:32.491689  4710 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:32.493667 26513 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:32.490911  5064 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 41 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:32.448886  4923 raft_consensus.cc:740] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:32.472991 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 38 index: 26 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:32.505535 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 38 index: 26 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:32.506632 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:32.507426 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.495939 26439 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:32.507782 26614 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31. Ops: []
I20260709 12:14:32.440028  4812 consensus_queue.cc:1059] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 12:14:32.515278 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:32.521683 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:32.526338 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:32.530779 26619 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 31: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:14:32.505116  4861 consensus_meta.cc:287] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.596s	user 0.012s	sys 0.000s
I20260709 12:14:32.536587 27160 raft_consensus.cc:1240] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 33 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 32. Current term is 33. Ops: [32.22-32.22]
I20260709 12:14:32.496070  5065 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:32.513510  5057 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
I20260709 12:14:32.532963  5061 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:14:32.572293  5055 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:32.573608  4983 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:32.520196  4948 consensus_queue.cc:1048] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 16, Time since last communication: 0.073s
I20260709 12:14:32.589152 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 37 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:32.533291  5086 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:14:32.622130 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 95425.8us
I20260709 12:14:32.504925  5089 consensus_queue.cc:1059] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 27.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.090s
I20260709 12:14:32.533946  4802 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:32.574749  4923 consensus_queue.cc:260] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 29.20, Last appended by leader: 20, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:32.571296  5056 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:32.591784  5064 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 41.26, Last appended by leader: 26, Current term: 41, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:32.532863  4710 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:32.579903 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.585952 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:32.576422  5062 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:32.590227 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:32.569906 26438 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:32.567687 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 71851.4us
I20260709 12:14:32.626041  4983 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.636065  4983 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:32.636672  4835 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:32.583348 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:32.570607  4814 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:32.568533  5105 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:14:32.622035 27167 raft_consensus.cc:2410] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for term 37 because replica has last-logged OpId of term: 36 index: 23, which is greater than that of the candidate, which has last-logged OpId of term: 35 index: 22.
I20260709 12:14:32.623055 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:32.585341  4912 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 30.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:14:32.626590 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:32.656991 26616 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 33.
I20260709 12:14:32.627113 26619 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 42 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 41. Current term is 42. Ops: []
I20260709 12:14:32.610112  5061 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:32.645438  4923 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:14:32.657855 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 88051.4us
I20260709 12:14:32.648283 26618 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:32.659235 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:32.653914 27168 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 37.
I20260709 12:14:32.650264  5058 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:32.660717 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:32.667237 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:32.672984 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:32.641310  5089 raft_consensus.cc:3055] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Stepping down as leader of term 29
W20260709 12:14:32.673198 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.679250 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 37 candidate_status { last_received { term: 35 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:32.678212 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.673530 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 48884.2us
I20260709 12:14:32.683349 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:32.683131 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:32.686504 26587 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:32.681286  5071 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:32.684907  4814 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 12:14:32.717592  5071 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:32.718878  4935 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader election won for term 37
I20260709 12:14:32.719192 26548 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 32 index: 18. Preceding OpId from leader: term: 33 index: 19. (index mismatch)
I20260709 12:14:32.675932  5058 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:32.666131  5105 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 35 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:32.721220  5105 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 33.20, Last appended by leader: 20, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:32.700320 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:32.700647 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:32.672019  4812 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:32.675433  5064 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 41 FOLLOWER]: Advancing to term 42
I20260709 12:14:32.675066  4933 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader election lost for term 37. Reason: could not achieve majority
I20260709 12:14:32.727639 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:32.735069 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:32.732962 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:32.736361 26544 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:32.718168  5071 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:32.730116 26513 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:32.739387 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:32.729512 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:32.685045  4802 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:32.722227  5108 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.681233  5065 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:32.731429 27134 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:32.747468 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 37 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:32.681838  5089 raft_consensus.cc:740] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 29 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:32.749333 26548 raft_consensus.cc:1240] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 33. Current term is 34. Ops: [33.24-33.24]
I20260709 12:14:32.727703  5056 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader pre-election won for term 37
I20260709 12:14:32.727526  5057 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:32.688740  5020 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:32.754408 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:32.754761 26546 raft_consensus.cc:2393] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 39: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:32.771044  5065 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:32.753551  5108 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:32.738768  5037 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:32.780426 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:32.726998  5072 consensus_queue.cc:1048] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.030s
I20260709 12:14:32.776098 26547 raft_consensus.cc:2393] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 32: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:32.778568  5007 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.778717  5060 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.743916  5084 raft_consensus.cc:3055] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:14:32.781194 26540 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:14:32.759949  5054 consensus_meta.cc:287] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.779s	user 0.015s	sys 0.004s
I20260709 12:14:32.730348  4987 consensus_queue.cc:1059] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: INVALID_TERM, Last received: 32.22, Next index: 23, Last known committed idx: 22, Time since last communication: 0.034s
I20260709 12:14:32.784713 27168 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 28 index: 20. Preceding OpId from leader: term: 32 index: 23. (index mismatch)
W20260709 12:14:32.783663 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 44342.9us
I20260709 12:14:32.821662 26543 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
W20260709 12:14:32.824012 26587 leader_election.cc:336] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:32.825016 26541 raft_consensus.cc:1275] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 37 index: 19. Preceding OpId from leader: term: 39 index: 20. (index mismatch)
I20260709 12:14:32.675019  5061 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 30.19, Last appended by leader: 19, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:32.833694 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:32.775244 26545 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 36 index: 22. Preceding OpId from leader: term: 37 index: 22. (term mismatch)
I20260709 12:14:32.757398  5056 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:32.841410 26545 pending_rounds.cc:85] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 21
I20260709 12:14:32.814350 26544 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 35.
I20260709 12:14:32.761543  5087 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:32.762157  5057 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:32.782462  4812 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.759028  4935 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:32.756762  4716 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.843001 26545 pending_rounds.cc:107] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 36.22
I20260709 12:14:32.843266 26546 raft_consensus.cc:1275] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 35 index: 19. Preceding OpId from leader: term: 36 index: 20. (index mismatch)
I20260709 12:14:32.857352 26545 raft_consensus.cc:2889] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:32.836426 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:32.834744 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:32.850844 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:32.853183 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:32.830638  5084 raft_consensus.cc:740] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:32.781865  5020 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:32.868837 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 49246.6us
W20260709 12:14:32.876760 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.844305  4943 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 41 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:32.845139  5056 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:32.844944  5087 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:32.853437  5057 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:32.845789  5108 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:32.854604  4933 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:32.831773  5060 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:32.817494  5037 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:32.869292  4912 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:32.840554  5007 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:32.869513  5086 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:32.878985  5070 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:32.874078  5103 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
I20260709 12:14:32.856856  4814 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.036s
I20260709 12:14:32.864090  4716 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:32.892400  5087 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:32.857769  4812 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:32.904624  4912 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:32.878001  4987 consensus_queue.cc:1048] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 20, Time since last communication: 0.038s
I20260709 12:14:32.956588  5007 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:32.843029  5089 consensus_queue.cc:260] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 29.19, Last appended by leader: 19, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:32.905714  4933 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:32.958933  5111 log.cc:927] Time spent T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:14:32.958775  4837 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.959615  5055 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.959852  5133 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:32.960486  5078 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:32.934650  4814 consensus_queue.cc:1243] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer ac3ac2181aa941229a758ccf6b5607cd log is divergent from this leader: its last log entry 32.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260709 12:14:32.967896  5037 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:32.934480  5061 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:32.893857  4943 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 41 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:32.977181 26540 raft_consensus.cc:2468] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
W20260709 12:14:32.979120 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.981076 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 76038.3us
I20260709 12:14:32.987900  5087 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:32.924121  5084 consensus_queue.cc:260] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 31.16, Last appended by leader: 16, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:32.991889  5065 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:32.992216  5118 log.cc:927] Time spent T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 12:14:32.954437 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 50667.8us
I20260709 12:14:32.915652  5086 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:14:33.011183 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 122526us
I20260709 12:14:33.004627  4912 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:33.023998  5037 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:14:33.024331 26513 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 44 similar messages]
I20260709 12:14:33.007091  5103 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:14:33.030795  4687 consensus_meta.cc:287] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.708s	user 0.006s	sys 0.010s
W20260709 12:14:33.071497 27133 leader_election.cc:336] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:33.071949 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 47735.3us
I20260709 12:14:33.014650  4837 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:33.027163  5089 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:14:33.073006 27133 consensus_peers.cc:597] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:33.053767  5084 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:14:33.092043 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.021875  5055 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:33.036056  5086 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:14:33.081969 27133 leader_election.cc:336] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:33.094036 27133 leader_election.cc:336] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:33.030866  5020 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:33.096768  4837 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 41 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:33.098086  5060 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:33.056867  5106 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.009837  4935 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 36.23, Last appended by leader: 23, Current term: 37, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:33.091394  5058 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:33.035446  5065 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:33.114971  5115 log.cc:927] Time spent T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:14:33.112540  5124 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.075577  5103 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:33.075008  4687 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:33.114558  5020 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:33.124377  5007 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.085124  5037 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:33.140988 26513 leader_election.cc:400] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 34. Current term is 35.
I20260709 12:14:33.158643 26513 leader_election.cc:403] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Cancelling election due to peer responding with higher term
I20260709 12:14:33.158923  5037 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:33.160216  4987 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election lost for term 34. Reason: Vote denied by peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149) with higher term. Message: Invalid argument: T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 34. Current term is 35.
W20260709 12:14:33.160656 26513 leader_election.cc:336] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:33.161154 26513 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:33.142371  4812 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:33.136938  5131 consensus_queue.cc:1048] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.011s
I20260709 12:14:33.144207  5088 consensus_queue.cc:1048] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:14:33.167413 26617 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:33.152719  5078 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:33.153445  5129 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:33.153788  4943 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 42 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:33.138216  5124 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:33.154958  4933 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:33.207302 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:33.207906  4802 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:33.145601  5087 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:33.163476 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:33.165184 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:33.211750 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 35 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:33.145592  4983 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:33.168955 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:33.170526 26540 raft_consensus.cc:1240] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32. Ops: [31.16-31.16]
I20260709 12:14:33.213080 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:33.173076  5062 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:33.175088  5054 raft_consensus.cc:3055] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:14:33.222779  5054 raft_consensus.cc:740] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:33.223448  4835 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:33.180028  5065 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:33.180473  5055 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:33.111539  5106 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:33.137678  5139 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.226823  5088 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:14:33.161763  5020 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:33.226877  5139 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:33.230813  5020 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:33.232746  5139 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:33.185950 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.187747 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:33.191597 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:33.192452 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 38 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:33.236513 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:33.238885  5106 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:33.239037  5060 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:33.239768 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 35 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:33.182262  4687 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:33.202085  5089 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:33.208779 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:33.243391 26614 raft_consensus.cc:2393] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 30: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:33.216516 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 35 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:33.219149 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:33.220358  5103 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:33.220690  5124 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:33.246568  5020 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
I20260709 12:14:33.203038  5129 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:33.249383  5129 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:33.250349 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.164314  5007 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:33.252916  5007 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:33.221869  4716 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:33.196538 26543 pending_rounds.cc:85] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 17
I20260709 12:14:33.167788  5133 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:33.254132 26543 pending_rounds.cc:107] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 32.18
I20260709 12:14:33.254503 26543 raft_consensus.cc:2889] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:33.254629  5133 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:33.223676  5054 consensus_queue.cc:260] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 32.22, Last appended by leader: 22, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:33.256992  5133 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:33.244452 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 79368.8us
W20260709 12:14:33.244678 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.258570 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:33.258605 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:33.259364  4933 consensus_queue.cc:1059] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 32.23, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260709 12:14:33.260172  5064 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Leader election won for term 37
I20260709 12:14:33.245489  4943 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:33.260530  5135 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:33.260996  4943 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:33.261664  5064 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 37 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:33.262243  4716 raft_consensus.cc:3060] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Advancing to term 39
I20260709 12:14:33.262452 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:33.262718  5064 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 36.23, Last appended by leader: 23, Current term: 37, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:33.263566  4943 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:33.264127  4943 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:14:33.202206 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 35 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:33.264577  4943 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:33.264760 26541 raft_consensus.cc:2468] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 36.
I20260709 12:14:33.260237  5105 raft_consensus.cc:3055] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:14:33.265781  5105 raft_consensus.cc:740] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:33.265477  4943 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 30.16, Last appended by leader: 16, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:33.243733 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:33.266741  5105 consensus_queue.cc:260] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 33.24, Last appended by leader: 24, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:33.268085  5105 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:33.261296  5135 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:33.273829 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 42 candidate_status { last_received { term: 41 index: 26 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:33.290525 26617 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:14:33.290558 27161 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 42 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 42.
I20260709 12:14:33.297430 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:33.303746 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:33.304467 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 42 candidate_status { last_received { term: 41 index: 26 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:33.309319 26615 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 42 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 42: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:33.288017  4802 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.205528  5056 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:33.321028 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:33.322280 26616 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 33.
I20260709 12:14:33.311295 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:33.324613 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:33.322319 26541 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:14:33.326560  5135 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:33.326730  4802 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:33.313544 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 171590us
W20260709 12:14:33.314707  5071 consensus_meta.cc:287] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.559s	user 0.007s	sys 0.007s
I20260709 12:14:33.330127 26587 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:33.333832 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:33.334599 26541 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 37.
I20260709 12:14:33.336236  4872 raft_consensus.cc:2804] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:33.336874  4872 raft_consensus.cc:697] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:33.338744  5056 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:33.333706 27134 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:33.373569 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:33.374379 26616 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 31: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:33.375042 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:33.374827 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:33.377199 27166 raft_consensus.cc:2410] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 30 because replica has last-logged OpId of term: 29 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 19.
I20260709 12:14:33.381973 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:33.383009 27163 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:14:33.382207 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:33.306893  4912 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:33.386277 27165 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 33: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:33.386947 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:33.387825 26617 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:33.389384 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:33.337881  4872 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 30.20, Last appended by leader: 20, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:33.399940 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:33.372942  5071 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:33.377163  4294 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:14:33.401743  4294 raft_consensus.cc:697] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 33 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:33.390079 26547 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 37.
I20260709 12:14:33.399613  4802 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:33.402969 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 41 candidate_status { last_received { term: 36 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:33.403574  4294 consensus_queue.cc:237] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 32.20, Last appended by leader: 20, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:33.404803 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:33.405550 26616 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:33.406661 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:33.406102 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:33.412806 26547 raft_consensus.cc:2368] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32.
I20260709 12:14:33.412914  5071 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:33.440214 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:33.441167 26539 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:14:33.453625 26548 raft_consensus.cc:1275] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 31 index: 22. Preceding OpId from leader: term: 32 index: 23. (index mismatch)
I20260709 12:14:33.456084 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:33.457216 26542 raft_consensus.cc:2368] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26.
I20260709 12:14:33.375398  4289 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.077s
I20260709 12:14:33.474941 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:33.476514 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 42 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:33.477810 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:33.480027 26547 raft_consensus.cc:1275] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 32 index: 22. Preceding OpId from leader: term: 33 index: 22. (term mismatch)
I20260709 12:14:33.681869 26547 pending_rounds.cc:85] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 21
I20260709 12:14:33.483750 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:33.485023  4687 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:33.488464 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:33.488756 26587 leader_election.cc:336] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:33.489713  5146 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 41 FOLLOWER]: Leader pre-election won for term 42
I20260709 12:14:33.490324 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:33.491663 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.492086 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 38 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:33.492879 27133 leader_election.cc:336] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:33.775439 26548 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 37.
I20260709 12:14:33.471756  5054 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
W20260709 12:14:33.482043 26513 leader_election.cc:336] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:33.777859 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:33.705569  5108 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:33.706696  4716 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
I20260709 12:14:33.706954  4912 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:33.706808 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:33.709393 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 231663us
I20260709 12:14:33.787202 26618 raft_consensus.cc:2468] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:33.709059  4814 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:33.789072 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 307053us
I20260709 12:14:33.788725  5108 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:33.722923  5057 consensus_meta.cc:287] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.813s	user 0.021s	sys 0.001s
W20260709 12:14:33.789882 26513 leader_election.cc:336] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:33.724344  5084 consensus_meta.cc:287] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.622s	user 0.015s	sys 0.011s
I20260709 12:14:33.728961 26620 raft_consensus.cc:1275] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 36 index: 20. Preceding OpId from leader: term: 40 index: 22. (index mismatch)
I20260709 12:14:33.790429 26513 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:14:33.730844  5086 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: Time spent flushing consensus metadata: real 0.620s	user 0.014s	sys 0.004s
W20260709 12:14:33.738058 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.747229 26514 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:33.750576  5133 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.796929  5133 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:33.796931  5086 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:33.751724 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.752533 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 36 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:33.755043 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.755062 27168 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:14:33.756361 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:33.704495 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:33.769313 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 280560us
I20260709 12:14:33.775381 27133 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:33.804126 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 311258us
I20260709 12:14:33.798995 26622 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 37.
I20260709 12:14:33.493520 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:33.807055 26616 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 37: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:14:33.807778 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 60590.6us
W20260709 12:14:33.806113 27133 consensus_peers.cc:597] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:33.812209 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:33.812546 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:33.782713 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:33.813369 27160 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:33.775965 26547 pending_rounds.cc:107] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 32.22
I20260709 12:14:33.709497  5135 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:33.788867  4814 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:33.802838 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:33.778023  5146 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 41 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
W20260709 12:14:33.846458 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 43704.3us
I20260709 12:14:33.790218  5057 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:33.878679 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:33.816171 26547 raft_consensus.cc:2889] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:33.713497  5138 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:14:33.794296 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 113421us
I20260709 12:14:33.790238  4641 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:33.884266 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:33.879997 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 61076.2us
W20260709 12:14:33.935366 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 145510us
W20260709 12:14:33.936534 26513 leader_election.cc:336] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:33.937083 26513 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:33.938249 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:33.951968  4814 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:33.805387  4861 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:33.952776  4861 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:33.955318  4861 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:33.818518  5135 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:33.778103  4687 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:33.961910 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:33.963152 26546 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 34. Current term is 35. Ops: []
I20260709 12:14:33.878754  4802 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:14:33.966665  5020 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.892095  4716 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.967223  5020 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:33.967564  4716 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:33.969573  5020 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:33.891960  5055 raft_consensus.cc:2764] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election decision vote started in defunct term 25: won
I20260709 12:14:33.948423  5138 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:33.973572  5138 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:33.973986  5108 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:33.960947 27160 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 26.
I20260709 12:14:33.974154  4641 consensus_queue.cc:1048] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:14:33.847167  4923 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:14:33.975596 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:33.890692  5065 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:33.976377  5061 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:33.977680  5086 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:33.947058  5098 log.cc:927] Time spent T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:14:33.930907  5071 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:14:33.991482 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 55010us
I20260709 12:14:33.976154  4716 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:33.894287 27162 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.019s	sys 0.014s
I20260709 12:14:33.941825  5084 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:33.963007  5135 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:33.877228  5146 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 41 FOLLOWER]: Advancing to term 42
I20260709 12:14:34.018568 26614 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 33 index: 20. Preceding OpId from leader: term: 35 index: 21. (index mismatch)
I20260709 12:14:34.020515 26546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 4050) took 1156 ms. Trace:
I20260709 12:14:34.036922 26546 rpcz_store.cc:276] 0709 12:14:32.864483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.865328 (+   845us) service_pool.cc:224] Handling call
0709 12:14:32.887568 (+ 22240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.963832 (+1076264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.020251 (+ 56419us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400105ed4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760dae01 00007f50760d983e 00007f507b09e419 00007f5074615bd4 00007f5074615b62 00007f5074615a91 00007f5074615a0c 00007f5074614cc2 00007f507441548c 00007f50744148c6
0709 12:14:34.020453 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2473172736}
W20260709 12:14:34.037483 26513 leader_election.cc:336] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:34.007105  5007 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.014971  5138 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:34.021883 27167 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 37.
I20260709 12:14:34.022716 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:33.896034 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:34.037981 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:34.046873 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 151868us
I20260709 12:14:34.045291 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:34.038930  5084 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:34.051017 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:34.051941 26619 raft_consensus.cc:2410] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 32 because replica has last-logged OpId of term: 30 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 29 index: 18.
I20260709 12:14:34.042711  5133 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:34.059122 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:34.045455  5071 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:34.048185 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:34.051662  4716 raft_consensus.cc:2804] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election won for term 37
I20260709 12:14:34.061421 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:34.041530  5007 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:34.053047  5061 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
I20260709 12:14:34.045048  5138 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:34.061569  5133 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:34.069141  4814 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:34.071338  4716 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.098074 26614 raft_consensus.cc:2410] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 31 because replica has last-logged OpId of term: 29 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 18.
I20260709 12:14:34.079505  5057 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:34.081779  5071 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election won for term 37
I20260709 12:14:34.080969  5020 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.095729  4716 raft_consensus.cc:3060] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:34.093537  4814 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:34.153156  5084 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:34.153858  5084 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:34.154368  5084 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:34.156601  5084 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:34.137593  5071 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:34.157651  5071 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:34.163854  5138 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:34.165336  5135 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:34.166060  5007 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:34.140570  4687 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:34.166846  5152 log.cc:927] Time spent T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:14:34.158123  5146 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 42 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:34.167776  5105 consensus_meta.cc:287] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.899s	user 0.008s	sys 0.016s
W20260709 12:14:34.177110 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.194550 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 264315us
I20260709 12:14:34.200066 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:34.168841  4814 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:34.147617  5020 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:34.215981 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:34.221532 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:34.223598 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:14:34.226861 27131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.230973 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 416268us
W20260709 12:14:34.233759 26514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.235908 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:34.236101 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:34.236651 26543 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:14:34.232014 26587 leader_election.cc:336] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:34.232990 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 252176us
I20260709 12:14:34.207620  4802 raft_consensus.cc:697] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:34.236109 26514 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:34.216034  5071 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:34.248571 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 185970us
I20260709 12:14:34.261571 26543 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 34.
W20260709 12:14:34.240907 26587 consensus_peers.cc:597] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:34.271276 26587 consensus_peers.cc:597] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:34.271967 26587 consensus_peers.cc:597] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:34.272539 26587 consensus_peers.cc:597] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:34.273084 26587 consensus_peers.cc:597] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:34.266819 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 221594us
I20260709 12:14:34.267063  4912 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:34.274259 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:34.246258 27133 consensus_peers.cc:597] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:34.274299  4912 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:34.275419 27133 consensus_peers.cc:597] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:34.276227 26439 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:34.277149  5105 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:14:34.277412  4912 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:34.268682 26514 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:34.278059 26439 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:34.249432  5086 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader pre-election won for term 38
W20260709 12:14:34.266080 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 204745us
I20260709 12:14:34.243381  5061 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:14:34.270268 26513 leader_election.cc:336] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:34.285523 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:14:34.278168 26587 leader_election.cc:336] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 42 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:34.281019  5133 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
W20260709 12:14:34.276042 27133 consensus_peers.cc:597] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:34.360175 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.397697 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 121704us
I20260709 12:14:34.398922 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:34.339303 26438 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:34.349316 26541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 4052) took 1006 ms. Trace:
I20260709 12:14:34.399276 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 42 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:14:34.367010 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.401515 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 130423us
I20260709 12:14:34.401335 26541 rpcz_store.cc:276] 0709 12:14:33.342876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.343042 (+   166us) service_pool.cc:224] Handling call
0709 12:14:33.343509 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:33.475961 (+132452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:33.475993 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:33.486937 (+ 10944us) log.cc:844] Serialized 26 byte log entry
0709 12:14:34.118351 (+631414us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:14:34.119798 (+  1447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.119882 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:34.349053 (+229171us) raft_consensus.cc:1685] finished
0709 12:14:34.349079 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.349241 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8,"raft.queue_time_us":647,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":3331,"thread_start_us":417731,"threads_started":1,"wal-append.queue_time_us":642040}
I20260709 12:14:34.403017 27160 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 36 index: 23. Preceding OpId from leader: term: 37 index: 24. (index mismatch)
W20260709 12:14:34.398727 27133 leader_election.cc:336] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:34.337829  5007 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:34.335701  5086 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:34.405601 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 131956us
W20260709 12:14:34.406936 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 121460us
I20260709 12:14:34.407964 26619 raft_consensus.cc:1275] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 32 index: 20. Preceding OpId from leader: term: 33 index: 21. (index mismatch)
I20260709 12:14:34.408145 26439 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:34.409889 26513 leader_election.cc:336] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:34.410482 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:34.412245 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 72349.4us
W20260709 12:14:34.411556 27133 leader_election.cc:336] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:34.413605 26438 leader_election.cc:400] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32.
I20260709 12:14:34.343122  5135 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:34.418130 26587 leader_election.cc:336] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:34.420768  5055 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260709 12:14:34.344625  4802 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:34.423836 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:34.352137  5020 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:34.341704  5084 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 40 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.428712  5084 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 40 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:34.343014  4912 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader election won for term 37
I20260709 12:14:34.430783  4912 raft_consensus.cc:697] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 37 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:34.431087  5084 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 41 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:34.414000 26438 leader_election.cc:403] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:34.419689 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
W20260709 12:14:34.417436 26513 leader_election.cc:336] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:34.431885  4912 consensus_queue.cc:237] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 36.23, Last appended by leader: 23, Current term: 37, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:34.432922 26513 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:34.433779  5172 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:14:34.435227 26513 consensus_peers.cc:597] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:34.341800  5146 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 42 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:34.435462  5071 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:34.435973 26513 consensus_peers.cc:597] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:34.427467  5178 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
I20260709 12:14:34.414991  5133 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader pre-election won for term 38
I20260709 12:14:34.438196  5133 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.438632  5133 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:34.440706 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:34.442735 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:34.443627  5084 raft_consensus.cc:2804] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:34.444182  5084 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.444639  5084 raft_consensus.cc:3060] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:34.410995  5088 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 42 FOLLOWER]: Leader election lost for term 42. Reason: could not achieve majority
I20260709 12:14:34.425787 27162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56886 (request call id 1752) took 1094 ms. Trace:
I20260709 12:14:34.412422  4943 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:34.413523 27133 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:34.447196 26587 leader_election.cc:336] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:34.461529 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:34.462760  4641 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:34.463510  4641 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:34.411245  5086 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Advancing to term 38
W20260709 12:14:34.462931 26587 consensus_peers.cc:597] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:34.403712  4716 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:34.423846  5056 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:14:34.449343 27162 rpcz_store.cc:276] 0709 12:14:33.322090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.322234 (+   144us) service_pool.cc:224] Handling call
0709 12:14:33.322589 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.322814 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 24
0709 12:14:34.030081 (+707267us) log.cc:844] Serialized 14 byte log entry
0709 12:14:34.415746 (+385665us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.415811 (+    65us) raft_consensus.cc:1645] Marking committed up to 24
0709 12:14:34.415885 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.415954 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.416080 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86849,"prepare.queue_time_us":635024,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":78325,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":6316,"thread_start_us":947605,"threads_started":2}
W20260709 12:14:34.468312 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 49038.1us
W20260709 12:14:34.468721 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 57205.2us
I20260709 12:14:34.404716  5061 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:34.431077  4814 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:34.459964  4289 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
I20260709 12:14:34.457423  5007 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 12:14:34.467888 26587 leader_election.cc:336] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:34.480011 27133 leader_election.cc:336] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:34.482031 26438 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:34.457715  4943 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:34.465526  5135 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:34.467577  5054 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.502799  5054 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:34.504781  5178 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:14:34.505470  5178 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 34 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:34.475749  5055 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:14:34.510743  4814 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:34.487418 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:34.519937 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52078.4us
I20260709 12:14:34.520402 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:34.520872 26587 consensus_peers.cc:597] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:34.521596  5088 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader election lost for term 37. Reason: could not achieve majority
W20260709 12:14:34.521749 26587 leader_election.cc:336] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:34.503484  5061 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:34.525172 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:34.526605  5055 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:14:34.468900  4294 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 12:14:34.472592  5020 raft_consensus.cc:3060] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 32
W20260709 12:14:34.528393 26587 leader_election.cc:336] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:34.515506  4641 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:34.517237  5054 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:34.531172 26539 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 35 index: 22. Preceding OpId from leader: term: 37 index: 24. (index mismatch)
I20260709 12:14:34.532507 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 31 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:34.529453 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:34.475857  5174 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:34.539682 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 86582.8us
I20260709 12:14:34.550649 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:34.543852  5055 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
W20260709 12:14:34.545251 26587 consensus_peers.cc:597] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:34.494104  4943 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:34.559006 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:34.560745 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:34.562534 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 42 candidate_status { last_received { term: 41 index: 26 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:14:34.554147 26587 consensus_peers.cc:597] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:34.523645  4716 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:34.598273 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:14:34.575232 26587 consensus_peers.cc:597] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:34.599143 27168 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Advancing to term 34
I20260709 12:14:34.588660 27160 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 42 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 42.
I20260709 12:14:34.491526  5087 consensus_queue.cc:1048] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.075s
W20260709 12:14:34.606207 26587 consensus_peers.cc:597] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:34.608814 26587 consensus_peers.cc:597] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:34.596351  5105 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:34.589432  5071 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:34.577679  5146 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:34.556106  5174 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:34.565207  4814 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.053s
I20260709 12:14:34.636771 27168 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 34.
W20260709 12:14:34.638083 26587 leader_election.cc:336] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:34.633343  5146 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:34.692479 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:34.692675 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:34.689319 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:34.687593 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 198690us
I20260709 12:14:34.689986 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 42 candidate_status { last_received { term: 41 index: 26 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:34.694056 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 41 candidate_status { last_received { term: 38 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:34.642168  5174 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:34.576385  5178 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 33.18, Last appended by leader: 18, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:34.694629 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 57148.9us
W20260709 12:14:34.695547 27133 consensus_peers.cc:597] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:34.693369 26621 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 37.
W20260709 12:14:34.702467 26587 leader_election.cc:336] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:34.703701 26587 consensus_peers.cc:597] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:34.696448 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:34.696758 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:34.697183 26615 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 42 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 42: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:34.705096 26622 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:34.705562 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:34.706413 26616 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 30.
I20260709 12:14:34.634011  5071 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:34.701195 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 35 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:34.698341 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:34.701090 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:34.727941 26613 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 31: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:34.709159 26620 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 37: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:34.739352  5174 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:34.740255  5174 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:34.742477 26363 catalog_manager.cc:5697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 33 to 36. New cstate: current_term: 36 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:34.743741  5174 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:34.702346  4802 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.744645 26363 catalog_manager.cc:5697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 27 to 31. New cstate: current_term: 31 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:34.745353  5146 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:34.745325  4802 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:34.751933  4802 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:34.753036 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:34.754781 26620 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 29.
I20260709 12:14:34.756440  5086 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:34.759898  5133 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:34.696800  5088 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:14:34.765619  4872 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:34.766480  4872 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:34.768013  5071 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:34.756811 26514 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:34.776997  4802 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:34.777529  4802 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.778025  4802 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:34.786839  4802 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:34.788441 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:34.789142 26547 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:34.789244  4802 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:34.791093 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:34.754035 26363 catalog_manager.cc:5697] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 24 to 26, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 26 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:34.793059 26541 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 31 index: 19. Preceding OpId from leader: term: 35 index: 21. (index mismatch)
I20260709 12:14:34.794480 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:34.796013 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:34.796932 26546 raft_consensus.cc:2393] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 31: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:34.798049 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:34.799501 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:34.800956 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:34.801990 26548 raft_consensus.cc:2410] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 34 because replica has last-logged OpId of term: 31 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 29 index: 20.
I20260709 12:14:34.801105 26363 catalog_manager.cc:5697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 30 to 34, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 34 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:34.811755 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 83769.7us
I20260709 12:14:34.813432 26622 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 34.
I20260709 12:14:34.816951 26543 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 33. Current term is 34. Ops: []
W20260709 12:14:34.774451 27133 leader_election.cc:336] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:34.828685 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:34.830376 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:34.831501 26542 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:34.804769 26363 catalog_manager.cc:5697] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 30 to 32, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 32 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:34.840090 26541 raft_consensus.cc:1240] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 30. Current term is 31. Ops: []
W20260709 12:14:34.819015 26513 leader_election.cc:336] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:34.841735 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 41 candidate_status { last_received { term: 38 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:34.820098 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 113756us
I20260709 12:14:34.853566 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:34.861351 27133 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:34.863483 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:34.857081 27134 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:34.859798 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:34.874480 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:34.873008 26363 catalog_manager.cc:5697] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:34.883564  4923 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:34.818812  5133 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:34.839450  5167 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:34.850195  5071 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:34.897948 26545 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 38: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:34.902855 26587 leader_election.cc:400] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 25 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 25. Current term is 26.
I20260709 12:14:34.887243 26363 catalog_manager.cc:5697] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 30 to 34, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 34 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:34.904804 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 35 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:34.852825  4716 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:34.886803  5058 consensus_queue.cc:1048] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.048s
I20260709 12:14:34.934860  4716 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:34.937176  4716 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:34.903115  4289 consensus_queue.cc:1048] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.038s
I20260709 12:14:34.937794  5071 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:34.940215  5071 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:34.940793  5167 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:34.872828  4814 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.942974  4814 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:34.905812 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:34.865568  5020 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 31. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32.
I20260709 12:14:34.909340 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 42 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:34.945164  5020 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 42 FOLLOWER]: Leader election won for term 42
I20260709 12:14:34.945364  4814 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:34.914956 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 69617.3us
I20260709 12:14:34.945384 26439 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:14:34.947010 26513 consensus_peers.cc:597] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:34.947571 26513 leader_election.cc:336] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:34.947963 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:34.949105 26513 leader_election.cc:336] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:34.949527 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:34.917904 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:34.950309  4641 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:34.951066  4641 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:34.951826 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:34.933575  5055 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:34.952639  5055 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.953063  5055 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:34.954679 26439 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:34.955533 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:34.903403  5105 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.956956  5105 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:34.957749  5071 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.958276  5071 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:34.958820 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:34.959468  5105 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:34.960139  5105 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader pre-election won for term 38
I20260709 12:14:34.945765  5020 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 42 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:34.960641  5105 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.961108  5105 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:34.960572  5071 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:34.961840  5020 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 41.26, Last appended by leader: 26, Current term: 42, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:34.964941  4294 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election won for term 31
W20260709 12:14:34.965067 26513 leader_election.cc:336] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:34.965476  4294 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.965894  4294 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:34.965829 26513 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:34.899341  5179 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:34.967033  4641 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:34.957293  4716 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:14:34.968204  4716 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 34 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:34.969223  4716 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 32.21, Last appended by leader: 21, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:34.894227  5135 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:34.967500 26513 leader_election.cc:336] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:34.971338  5135 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:34.972810  5189 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:34.973619  5189 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:34.974723  5135 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:34.976176 26363 catalog_manager.cc:5697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 25 to 28, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 28 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:34.978612 26513 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:34.885064  5007 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:34.980473 26513 leader_election.cc:336] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:34.934592 26364 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57044 (request call id 319) took 50456 ms (client timeout 15000 ms). Trace:
I20260709 12:14:34.984170 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:34.985769 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:34.986816 26543 raft_consensus.cc:2368] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 30. Current term is 31.
W20260709 12:14:34.992224 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 71565.4us
I20260709 12:14:34.997678 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:34.979707  4641 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
W20260709 12:14:35.000968 26513 leader_election.cc:336] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:35.018075 26539 raft_consensus.cc:1240] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 33. Current term is 34. Ops: []
I20260709 12:14:35.023099 26513 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:35.006031 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:35.003446 26512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:35.035123 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 161885us
I20260709 12:14:35.031808 26541 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 37.
W20260709 12:14:35.039608 26513 consensus_peers.cc:597] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:35.021423 26363 catalog_manager.cc:5697] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:35.041637 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:35.037534 26545 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 30 index: 16. Preceding OpId from leader: term: 31 index: 17. (index mismatch)
I20260709 12:14:35.042595 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:35.045588 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 31 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:35.046234 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:14:35.045588 26513 consensus_peers.cc:597] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:35.025168 26542 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:35.029804 26544 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 31.
I20260709 12:14:35.060438 26363 catalog_manager.cc:5697] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 29 to 32, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 32 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:35.064136 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:35.061600 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:35.065294 26541 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 31: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
W20260709 12:14:35.051986 26513 leader_election.cc:336] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:35.070902 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:34.966952  5179 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:35.071949 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:35.072768 26541 raft_consensus.cc:2468] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:35.072917 26363 catalog_manager.cc:5697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 36 to 39, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 39 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:35.004717  5086 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:35.072611 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:35.017284  4872 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:35.077463 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:35.044601  5087 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Leader pre-election won for term 38
I20260709 12:14:35.082521 26541 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:14:35.085644 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:35.017912  4912 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:35.092284 26620 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:14:35.094379 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:35.090132 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 36 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:35.095616 26614 raft_consensus.cc:3060] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:35.096952 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:35.097157 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:35.097981 26617 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Advancing to term 31
I20260709 12:14:35.097815 26363 catalog_manager.cc:5697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 31 to 35. New cstate: current_term: 35 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:35.059613  4923 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 22, Time since last communication: 0.031s
I20260709 12:14:35.106700  4802 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
W20260709 12:14:35.114042 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 62121.8us
I20260709 12:14:35.120005 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:35.111764  5189 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:35.116250 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 259304us
I20260709 12:14:35.003935  5007 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:35.138301 26542 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 38.
I20260709 12:14:35.109076  5146 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:35.150178 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:35.159211 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:35.152649 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:35.112133  4814 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:35.147006 26363 catalog_manager.cc:5697] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:35.163028 27168 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
W20260709 12:14:34.984160 26364 rpcz_store.cc:269] 0709 12:13:44.478107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.652504 (+14174397us) service_pool.cc:224] Handling call
0709 12:14:34.934478 (+36281974us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:32.110053 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:32.110780 (+   727us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:32.110853 (+    73us) write_op.cc:435] Acquired schema lock
0709 12:14:32.110887 (+    34us) tablet.cc:662] Decoding operations
0709 12:14:32.226507 (+115620us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:32.241098 (+ 14591us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:32.241136 (+    38us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:14:32.242542 (+  1406us) tablet.cc:701] Row locks acquired
0709 12:14:32.242593 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:14:32.242777 (+   184us) write_op.cc:270] Start()
0709 12:14:32.242940 (+   163us) write_op.cc:276] Timestamp: P: 1783599272242701 usec, L: 0
0709 12:14:32.242979 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:14:32.243724 (+   745us) log.cc:844] Serialized 6008 byte log entry
0709 12:14:32.320010 (+ 76286us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b4400022b4c. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072f13c85 00007f5072f146a2 00007f5075c861db 00007f5075c81aaf 00007f5072fd00ac 00007f507be2a9a9 00007f5072fec69b 00007f5072fea93f 00007f5072fecc02 00007f5075c7420b
0709 12:14:32.934864 (+614854us) op_driver.cc:464] REPLICATION: finished
0709 12:14:33.182181 (+247317us) write_op.cc:301] APPLY: starting
0709 12:14:33.182317 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:33.426123 (+243806us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:33.426161 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:33.981678 (+555517us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:33.982095 (+   417us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 12:14:33.982170 (+    75us) write_op.cc:312] APPLY: finished
0709 12:14:34.039463 (+ 57293us) log.cc:844] Serialized 139 byte log entry
0709 12:14:34.282221 (+242758us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:34.381029 (+ 98808us) write_op.cc:454] Released schema lock
0709 12:14:34.405910 (+ 24881us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:34.421069 (+ 15159us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:34.421105 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":381721,"reported_tablets":51,"spinlock_wait_cycles":1297664,"child_traces":[["op",{"apply.queue_time_us":141172,"apply.run_cpu_time_us":82463,"apply.run_wall_time_us":1256803,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66767,"num_ops":15,"prepare.queue_time_us":296669,"prepare.run_cpu_time_us":20263,"prepare.run_wall_time_us":361221,"raft.queue_time_us":293847,"raft.run_cpu_time_us":9817,"raft.run_wall_time_us":182259,"replication_time_us":649710,"spinlock_wait_cycles":6834560,"thread_start_us":608852,"threads_started":5,"wal-append.queue_time_us":761856,"wal-append.run_cpu_time_us":15304,"wal-append.run_wall_time_us":1167272}]]}
I20260709 12:14:35.118688  4641 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:35.136605 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:35.179782 26363 catalog_manager.cc:5697] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 25 to 29. New cstate: current_term: 29 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:35.152590  5189 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
I20260709 12:14:35.159552  5146 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.131186  5133 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.048s
W20260709 12:14:35.228314 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 269895us
W20260709 12:14:35.192533 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 56061.6us
I20260709 12:14:35.231387 26438 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:35.186252 26363 catalog_manager.cc:5697] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 24 to 26, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 26 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:14:35.232702 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 239369us
I20260709 12:14:35.222158 26617 raft_consensus.cc:2468] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
W20260709 12:14:35.234853  4943 consensus_meta.cc:287] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.629s	user 0.006s	sys 0.006s
I20260709 12:14:35.199021  5146 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:35.242637 26438 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:35.199456  4814 raft_consensus.cc:3060] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:35.230104  5061 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:35.270829 26363 catalog_manager.cc:5697] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 25 to 30, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 30 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:35.275720 26438 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:35.283474 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:35.284608 26542 raft_consensus.cc:2393] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 34: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:35.229430  5055 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:35.290490 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:35.265326  5020 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:35.326066 26542 raft_consensus.cc:1240] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 37. Current term is 38. Ops: [36.23-37.24]
I20260709 12:14:35.246136  4872 consensus_queue.cc:1059] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 34.21, Next index: 22, Last known committed idx: 20, Time since last communication: 0.037s
I20260709 12:14:35.343819 26622 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:35.259784  4943 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:35.350417 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:35.350841 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:35.351132 26617 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:14:35.351737 26620 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
I20260709 12:14:35.353493 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 38 index: 26 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:35.349977 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 74314.9us
I20260709 12:14:35.325567  5135 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:14:35.362886 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 100738us
I20260709 12:14:35.362813  5135 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:35.279578  5061 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:35.371358  5217 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:35.372545 26439 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:35.374927  4861 consensus_queue.cc:1059] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 33.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:35.375216  5206 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:35.374411 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:14:35.380064 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 120859us
W20260709 12:14:35.384307  5084 consensus_meta.cc:287] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.925s	user 0.012s	sys 0.003s
I20260709 12:14:35.381753  5138 raft_consensus.cc:3055] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Stepping down as leader of term 34
I20260709 12:14:35.423625 26614 raft_consensus.cc:2468] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 38.
I20260709 12:14:35.383945  4912 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:35.426481  5086 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:35.426867 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 47602.4us
I20260709 12:14:35.438637  5086 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:35.397043  5219 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
W20260709 12:14:35.432294  5190 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.228s	user 0.001s	sys 0.001s
I20260709 12:14:35.439433 26438 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 41 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:35.385181  5206 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:35.430233  5210 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:35.438083  5055 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:35.441628 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:35.441809  5210 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.438922  5213 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:14:35.436688  5105 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:35.389454  5084 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:35.444464  5213 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.442343  5210 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:35.408408  5138 raft_consensus.cc:740] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:35.401110  5174 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:35.511456  5174 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:35.512075  4814 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:35.513670  5174 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:35.471060 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 107023us
I20260709 12:14:35.472563  5213 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:14:35.483117  5191 log.cc:927] Time spent T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:14:35.451229  4912 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:35.486442  5189 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 40 FOLLOWER]: Leader pre-election lost for term 41. Reason: could not achieve majority
I20260709 12:14:35.488606  5179 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:35.492149  4943 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:35.534581 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:35.497004  4294 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:35.498184  5220 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader election lost for term 37. Reason: could not achieve majority
I20260709 12:14:35.503742  5167 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:35.506805  5086 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:35.508256  5105 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:35.509706  5206 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:35.511703  5138 consensus_queue.cc:260] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 34.21, Last appended by leader: 21, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:35.516989 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 38 index: 26 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:35.567255  5138 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:35.517752 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:35.518563 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:35.477455 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:35.568246 27168 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 25.
W20260709 12:14:35.568759 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 91379.1us
W20260709 12:14:35.569749 27133 consensus_peers.cc:597] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:35.518038 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:35.570838 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 52911.4us
W20260709 12:14:35.573181 27133 consensus_peers.cc:597] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:35.529356 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 155044us
W20260709 12:14:35.494076  5196 log.cc:927] Time spent T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.205s	user 0.003s	sys 0.000s
I20260709 12:14:35.553169 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:35.576306 26614 raft_consensus.cc:3060] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:35.553309  5193 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.553761  4294 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:35.563032  5061 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:35.565472  5007 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:35.586000 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:35.592111 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:35.593106 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:35.593420 26614 raft_consensus.cc:2468] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 31.
I20260709 12:14:35.593999 27168 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 33: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:35.593366 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:35.595096 26617 raft_consensus.cc:2393] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 38: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:35.593943 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:35.595021 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:35.594825 27134 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:35.604720 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:35.540210  5146 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:35.594128  5209 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:35.592585  4923 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:35.634111  5213 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:35.604627  4294 consensus_queue.cc:1059] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 35.22, Next index: 23, Last known committed idx: 22, Time since last communication: 0.031s
I20260709 12:14:35.604161  4872 consensus_queue.cc:1059] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 30.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.044s
I20260709 12:14:35.637555  5135 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:35.608340  5105 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
I20260709 12:14:35.614323  5064 raft_consensus.cc:2804] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:14:35.658183 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:35.661578 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:35.636818  4912 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:35.598245  5193 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:35.648490  5061 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:35.662863  5185 raft_consensus.cc:3055] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Stepping down as leader of term 33
W20260709 12:14:35.677563 27133 leader_election.cc:336] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:35.707369 27133 leader_election.cc:336] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:35.648831  5209 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:35.637884  5210 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:35.713537 26619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45"
dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34370
I20260709 12:14:35.714592 26619 raft_consensus.cc:606] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Received request to transfer leadership
I20260709 12:14:35.715011 26619 raft_consensus.cc:614] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:14:35.719033  5192 log.cc:927] Time spent T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.394s	user 0.001s	sys 0.001s
I20260709 12:14:35.685276 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:35.697746  5135 consensus_queue.cc:1059] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.006s
I20260709 12:14:35.702991 27162 raft_consensus.cc:2468] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 37.
I20260709 12:14:35.691084  5086 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:35.723243  5193 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:35.697275 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 255720us
I20260709 12:14:35.673429  5087 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting leader election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:35.709247 26620 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:35.728845 26613 raft_consensus.cc:2410] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b for term 35 because replica has last-logged OpId of term: 34 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 32 index: 20.
I20260709 12:14:35.728113 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:35.705912  5185 raft_consensus.cc:740] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:35.734674  5185 consensus_queue.cc:260] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 33.18, Last appended by leader: 18, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:35.735854  5185 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:14:35.736094 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 50974.8us
I20260709 12:14:35.736588  5087 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:35.736960 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:35.738045  5225 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:35.724262  5201 raft_consensus.cc:3055] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:14:35.687266  4923 raft_consensus.cc:3055] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 37 LEADER]: Stepping down as leader of term 37
I20260709 12:14:35.738895  5201 raft_consensus.cc:740] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:35.739142  4923 raft_consensus.cc:740] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 37 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:35.739960  5201 consensus_queue.cc:260] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 30.18, Last appended by leader: 18, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:35.738065  4641 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:35.740376  5086 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:14:35.740063  4923 consensus_queue.cc:260] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 37.24, Last appended by leader: 24, Current term: 37, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:35.731621  5146 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:35.745546  4923 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:35.746083  5210 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:35.747087  5213 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:35.751448  5225 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:14:35.753333 26514 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:35.755800  5086 raft_consensus.cc:2804] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:14:35.756565  5086 raft_consensus.cc:697] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 31 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:35.742363 26619 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 42 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 41 index: 26. Preceding OpId from leader: term: 42 index: 27. (index mismatch)
I20260709 12:14:35.707863 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:35.762013 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 54674.5us
W20260709 12:14:35.766690 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 166188us
I20260709 12:14:35.766927 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:35.767571 26614 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:35.768013 26587 leader_election.cc:400] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 30. Current term is 31.
I20260709 12:14:35.768333 26587 leader_election.cc:403] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:35.743301 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:35.718706  5084 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:35.705158  5064 raft_consensus.cc:697] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 31 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:35.727632  5209 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:35.757973  5201 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:35.758682 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:35.725994  5061 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:35.760535  5135 raft_consensus.cc:3055] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:14:35.762701  5086 consensus_queue.cc:237] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 29.19, Last appended by leader: 19, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:35.660609  5007 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.766135 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:35.744058 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:35.776229 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:35.763775 26514 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:35.789316 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 38 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:35.790472 26614 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:14:35.794952 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
I20260709 12:14:35.814747  5213 raft_consensus.cc:2804] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader pre-election won for term 38
I20260709 12:14:35.814649  5007 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:35.815327  5213 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.815784  5213 raft_consensus.cc:3060] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:35.813468 26619 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:35.779865  5210 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:35.818274 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:35.819518  5230 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.819779  5020 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20260709 12:14:35.820166 26439 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:14:35.822278 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 58586us
I20260709 12:14:35.827032 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:35.831447 26543 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:35.831447 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:35.836611 26544 raft_consensus.cc:1240] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 34. Current term is 35. Ops: []
I20260709 12:14:35.797215  5084 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:14:35.791041  5135 raft_consensus.cc:740] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:35.792039  5222 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:35.851644 26540 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 35 index: 22. Preceding OpId from leader: term: 37 index: 24. (index mismatch)
I20260709 12:14:35.790887  5138 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election lost for term 30. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 30. Current term is 31.
W20260709 12:14:35.840811 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.844566 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:35.845481 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:35.846616 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.855185 26613 raft_consensus.cc:2393] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 32: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:35.797426  5233 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:35.821233  5146 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader election won for term 37
I20260709 12:14:35.856233 26544 raft_consensus.cc:1240] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 33. Current term is 34. Ops: []
I20260709 12:14:35.856102 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:35.815958  5219 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.022s
I20260709 12:14:35.831830  4641 raft_consensus.cc:2804] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Leader election won for term 38
I20260709 12:14:35.863796 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:35.868862 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:35.840922  5197 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:14:35.867429 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:35.849603  4912 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.874825  5146 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 37 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:35.857443  5226 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:14:35.875777  5226 raft_consensus.cc:697] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:35.875988  5146 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 36.22, Last appended by leader: 22, Current term: 37, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:35.876863  5226 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:35.867939  5084 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:35.878693  5197 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:35.879354  5084 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 32.21, Last appended by leader: 21, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:35.879771  5197 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 30.19, Last appended by leader: 19, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:35.874459  4912 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:35.884560 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:35.886796  5105 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:35.849645  5071 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:35.895466 26543 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:14:35.897987 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:35.901697 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 106079us
I20260709 12:14:35.901989  5133 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:35.905295 26438 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:35.907047  5133 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader election won for term 38
I20260709 12:14:35.907858  5133 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 38 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:35.839048  5214 consensus_queue.cc:1059] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: INVALID_TERM, Last received: 33.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.049s
W20260709 12:14:35.912947 27133 leader_election.cc:336] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:35.870594  5179 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:35.909152  5133 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 36.23, Last appended by leader: 23, Current term: 38, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:35.920532 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:35.889614  4641 raft_consensus.cc:697] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 38 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:35.909744  5219 raft_consensus.cc:2804] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:35.838553  5230 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:35.937860 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:35.863498  5222 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:35.938367 27133 leader_election.cc:336] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:35.942153 26543 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 33 index: 18. Preceding OpId from leader: term: 34 index: 19. (index mismatch)
W20260709 12:14:35.946128  5238 log.cc:927] Time spent T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:14:35.948338  5222 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:35.943765 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:35.958884 26539 raft_consensus.cc:2393] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 34: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:35.868963  5064 consensus_queue.cc:237] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 29.20, Last appended by leader: 20, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:35.937346  5058 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
W20260709 12:14:35.960968 27133 leader_election.cc:336] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:35.910434  5071 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:35.939509  5219 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.980314 27162 raft_consensus.cc:1275] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 36 index: 23. Preceding OpId from leader: term: 37 index: 24. (index mismatch)
I20260709 12:14:35.980367 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:35.984346 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:35.985666 26619 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:35.964615  5007 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:35.996254 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:35.997161 26539 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 35: Already voted for candidate ac3ac2181aa941229a758ccf6b5607cd in this term.
I20260709 12:14:35.975567  5135 consensus_queue.cc:260] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 31.17, Last appended by leader: 17, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:35.967900  5174 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:36.000735 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:35.979846  5219 raft_consensus.cc:3060] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:36.001442 26547 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:36.002096 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:35.999728 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:36.019138 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.997670  5179 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.002774  4641 consensus_queue.cc:237] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 36.19, Last appended by leader: 19, Current term: 38, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:36.028524  5179 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:36.030687 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:36.032009 26543 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32. Ops: [31.17-31.17]
I20260709 12:14:36.034330 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:36.032714 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:36.035792 26539 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:36.010612  5135 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:36.051046  5061 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:36.052733  5071 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:36.062685  5087 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:36.063540  5213 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:36.064977  4912 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:36.066828  5230 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:36.093230 26547 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 34.
I20260709 12:14:36.104321 26539 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:36.106945 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:36.112360 27168 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 42 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 41 index: 26. Preceding OpId from leader: term: 42 index: 27. (index mismatch)
I20260709 12:14:36.118809 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:14:36.120613 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.087203  5084 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.125059 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:14:36.125746 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 121734us
I20260709 12:14:36.132786 27168 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:36.144955 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:36.147404 26587 consensus_peers.cc:597] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:36.163749 26587 leader_election.cc:336] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 41 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.164301 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 41 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:36.164451 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:36.181277 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:36.148627  5233 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
W20260709 12:14:36.215446 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 51735.2us
W20260709 12:14:36.216356 26587 leader_election.cc:336] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.217347 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:36.218608 27168 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 26.
I20260709 12:14:36.218827 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:36.178220  5146 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:36.185801  5197 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:36.147336  5084 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:36.168183  5209 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:36.186806  5179 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:36.214956  5195 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Leader pre-election lost for term 41. Reason: could not achieve majority
I20260709 12:14:36.219615  4943 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader election lost for term 38. Reason: could not achieve majority
W20260709 12:14:36.231204  5244 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:14:36.215613  5007 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.041s
W20260709 12:14:36.251442  4923 consensus_meta.cc:287] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.000s
I20260709 12:14:36.225174  5020 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:36.267931 26620 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:14:36.270226 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 130250us
W20260709 12:14:36.271109 26513 leader_election.cc:336] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:36.279470 26587 consensus_peers.cc:597] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:36.286597 26513 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:36.286916 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 67965.1us
I20260709 12:14:36.286598 26620 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 34.
I20260709 12:14:36.263085  5249 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 42 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.300331 26544 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 20. Preceding OpId from leader: term: 32 index: 21. (index mismatch)
I20260709 12:14:36.301311  5254 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.301894  5254 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:36.282997  5185 consensus_meta.cc:287] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.004s
I20260709 12:14:36.305264  5213 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:36.308837  5219 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:36.304493  5249 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 42 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:36.311342  5219 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:36.313544  5249 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 43 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:36.315514  5084 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:36.320070  5255 log.cc:927] Time spent T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:14:36.323647  5209 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:36.302870  5105 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:14:36.327840  5201 consensus_meta.cc:287] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.002s
I20260709 12:14:36.288160  5210 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:14:36.335582  5262 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 12:14:36.339954 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 309338us
I20260709 12:14:36.341240 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:36.341531  5254 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:36.342545  5061 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:36.343866  5061 consensus_queue.cc:1048] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.001s
I20260709 12:14:36.346490 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:36.333338 26587 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:36.353196 26438 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:36.354215 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:36.354234 26438 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:36.331658  5201 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 22, Time since last communication: 0.027s
I20260709 12:14:36.358278 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:36.359393  5105 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:14:36.359743  5197 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:36.359982  5105 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:36.361756  5105 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 31.16, Last appended by leader: 16, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:36.357105  5061 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:14:36.367120 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 96052.9us
W20260709 12:14:36.367977 26513 consensus_peers.cc:597] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:36.369130 26513 leader_election.cc:336] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.373371 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 38 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:36.373888 27160 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 37. Current term is 38. Ops: []
W20260709 12:14:36.372717 26513 leader_election.cc:336] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.369593  5087 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:36.376071 26513 leader_election.cc:336] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.379498 26513 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:36.380658 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:36.380867 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:36.381206 26539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:36.386492 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:36.386721 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:36.389626 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:36.361145  5133 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:14:36.381362 26543 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 34.
W20260709 12:14:36.395752 26513 leader_election.cc:336] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.396557 26513 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:36.399576 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:36.399902 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:36.332404  5210 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:36.403126 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:36.403388 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:36.406991 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:36.374724  4802 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:36.408805 26616 raft_consensus.cc:3055] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:14:36.409271 26616 raft_consensus.cc:740] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:36.411583 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:36.412286 27167 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 34.
I20260709 12:14:36.410076 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:36.412307 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:36.415540 26439 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:36.416716 26438 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:36.419335 27160 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 32 index: 21. Preceding OpId from leader: term: 34 index: 22. (index mismatch)
W20260709 12:14:36.416414 26513 leader_election.cc:336] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.420500 26513 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:36.424132 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 43 candidate_status { last_received { term: 41 index: 26 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:36.417559  5020 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
I20260709 12:14:36.403164  5229 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:36.422488 26616 consensus_queue.cc:260] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 33.18, Last appended by leader: 18, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:36.434126 26588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.400840  5172 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:14:36.400496  5233 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 42 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.394945  5219 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:36.449998 26513 consensus_peers.cc:597] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:36.450800 26513 leader_election.cc:336] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.439925 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:36.414459  5133 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 34 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:14:36.447938 26587 leader_election.cc:336] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.448705  5169 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.451807 26544 raft_consensus.cc:2368] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 33. Current term is 34.
I20260709 12:14:36.447274 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:36.425668  5071 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:36.429404  5206 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:36.453595 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 38 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:36.451228 26513 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:36.455174 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:36.421700  5249 consensus_queue.cc:1059] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 37.24, Next index: 25, Last known committed idx: 24, Time since last communication: 0.021s
I20260709 12:14:36.430514  5220 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:36.467661 26439 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:36.469141 26545 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 37.
I20260709 12:14:36.418015  5213 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.046s
I20260709 12:14:36.449378  5061 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
W20260709 12:14:36.524364 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 56818.9us
I20260709 12:14:36.458868  5229 raft_consensus.cc:697] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:36.473078  5071 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.457089  5219 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:36.458149  5233 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 42 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:36.612867  5270 log.cc:927] Time spent T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:14:36.466583  5169 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:36.627295  5210 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:36.449586  5222 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:36.628772  5260 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:14:36.629467 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 181552us
W20260709 12:14:36.477346 26513 leader_election.cc:336] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.472191  5105 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:36.618707  5133 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 32.22, Last appended by leader: 22, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:36.475641  5172 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election lost for term 35. Reason: could not achieve majority
I20260709 12:14:36.426148  5195 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.040s
I20260709 12:14:36.452658  5007 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:36.652840  5064 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.653235  5226 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.663503  4943 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election lost for term 35. Reason: could not achieve majority
W20260709 12:14:36.681617 27133 leader_election.cc:336] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.722442 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:36.683192 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:36.666666  5071 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:36.683871 27160 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 42 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 42.
I20260709 12:14:36.666836  5146 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
W20260709 12:14:36.686432  5273 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.051s	user 0.001s	sys 0.001s
I20260709 12:14:36.687219  5222 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:36.688220  5138 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:36.691031  5135 consensus_meta.cc:287] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.014s
W20260709 12:14:36.692611 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.694468  5233 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 43 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:36.705078 25293 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 26498)
I20260709 12:14:36.707522 26513 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:14:36.707643 26587 leader_election.cc:336] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.690147  5231 raft_consensus.cc:3055] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Stepping down as leader of term 37
I20260709 12:14:36.716647 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 43 candidate_status { last_received { term: 41 index: 26 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:36.686075  5220 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.725412 26621 raft_consensus.cc:1275] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 31 index: 21. (index mismatch)
I20260709 12:14:36.725298  5226 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:36.720636  5007 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:36.722029  5064 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:36.727928  5219 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:36.752331  5233 consensus_queue.cc:1048] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:14:36.753837  5226 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:36.755991  5064 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:36.729476  5169 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:36.757491 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:36.736327 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 35 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:14:36.742246 26587 consensus_peers.cc:597] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:36.743822 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 266530us
I20260709 12:14:36.745298 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:36.733975  5105 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader election lost for term 38. Reason: could not achieve majority
I20260709 12:14:36.730890  5193 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
W20260709 12:14:36.761483 26513 consensus_peers.cc:597] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:36.769927 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.771030 26439 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:36.771123 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:36.771796 26615 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 33.
I20260709 12:14:36.772727  5275 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
I20260709 12:14:36.744767  5231 raft_consensus.cc:740] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Becoming Follower/Learner. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:36.777769 26588 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 43 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:36.778867  5265 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 42 FOLLOWER]: Leader pre-election won for term 43
I20260709 12:14:36.779423  5265 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 42 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:36.779910  5265 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 42 FOLLOWER]: Advancing to term 43
I20260709 12:14:36.780185  5007 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:36.781699  5222 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:36.784097 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 35 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:36.778172 27165 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 37 index: 24. Preceding OpId from leader: term: 38 index: 24. (term mismatch)
I20260709 12:14:36.785323 27165 pending_rounds.cc:85] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Aborting all ops after (but not including) 23
I20260709 12:14:36.785565 27165 pending_rounds.cc:107] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: Aborting uncommitted NO_OP operation due to leader change: 37.24
I20260709 12:14:36.785782 27165 raft_consensus.cc:2889] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:36.744450  5138 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:36.787581 26614 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 30 index: 19. Preceding OpId from leader: term: 31 index: 20. (index mismatch)
I20260709 12:14:36.788419  5138 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:36.760502 26587 leader_election.cc:336] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.733208  5229 consensus_queue.cc:237] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 30.16, Last appended by leader: 16, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:36.736436  5179 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.027s
I20260709 12:14:36.791252 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:36.768646  5276 log.cc:927] Time spent T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 12:14:36.769771 26513 leader_election.cc:336] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.763116 26618 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 36 index: 22. Preceding OpId from leader: term: 37 index: 23. (index mismatch)
I20260709 12:14:36.792282 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:14:36.802173 26513 leader_election.cc:336] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.797317 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:36.799633 27160 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 32 index: 21. Preceding OpId from leader: term: 33 index: 22. (index mismatch)
W20260709 12:14:36.800730 26587 leader_election.cc:336] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.759711  4641 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:36.748835  5220 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:36.800017  5226 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.836146 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 40 candidate_status { last_received { term: 37 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:36.838991  5213 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:14:36.827049 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:36.803200  5138 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:36.798492  5084 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 22, Time since last communication: 0.033s
I20260709 12:14:36.842528  5277 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:36.816023  5087 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:36.847489 26545 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 36 index: 22. Preceding OpId from leader: term: 37 index: 23. (index mismatch)
W20260709 12:14:36.848474 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 124956us
I20260709 12:14:36.834669 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:36.831008 26587 leader_election.cc:336] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.849857 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:36.851872 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:36.851132 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 40 candidate_status { last_received { term: 37 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:36.852924 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:36.854503 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:36.859308 26542 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 30 index: 19. Preceding OpId from leader: term: 31 index: 20. (index mismatch)
I20260709 12:14:36.859645 26615 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 32 index: 21. Preceding OpId from leader: term: 33 index: 22. (index mismatch)
I20260709 12:14:36.867887 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:36.872777 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:36.875267 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:36.880129 26617 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:14:36.880270 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 38 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:36.882500 26513 leader_election.cc:336] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.885262 26438 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:36.883484 26587 leader_election.cc:336] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.836133  5226 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:36.867451  5213 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.021s
I20260709 12:14:36.890379  5226 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:36.829144  5222 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.048s
I20260709 12:14:36.859720  5084 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:36.859479  5211 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:14:36.906069 26513 leader_election.cc:336] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.908102 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:36.867152  5020 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:36.908821 26438 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:36.907935 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:36.928260 26513 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:36.933048 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:36.933990 26542 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
W20260709 12:14:36.955054 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 49017us
W20260709 12:14:36.966717 26513 leader_election.cc:336] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:36.967433 26513 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:36.970660 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 61955.9us
I20260709 12:14:36.927480  5213 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:36.939745  5226 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.038s
I20260709 12:14:36.973392  5206 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:36.979861 27165 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:14:36.898809  5221 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.088s
I20260709 12:14:36.996286  5220 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:36.951603 26615 raft_consensus.cc:1275] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 29 index: 19. Preceding OpId from leader: term: 31 index: 20. (index mismatch)
I20260709 12:14:37.003636  5133 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
I20260709 12:14:37.004417 26438 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:37.004528  5133 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:14:37.006120  5133 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:37.013401 26542 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 29 index: 15. Preceding OpId from leader: term: 33 index: 17. (index mismatch)
W20260709 12:14:37.017014 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 52331us
I20260709 12:14:36.969233  5061 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:37.020535 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:37.024467 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:37.028723 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:37.040324 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:37.041277 26617 raft_consensus.cc:1275] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 34 index: 18. Preceding OpId from leader: term: 38 index: 20. (index mismatch)
I20260709 12:14:37.041339  5064 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Leader election lost for term 38. Reason: could not achieve majority
I20260709 12:14:37.045735 26439 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:37.046687  5007 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:37.048166  5087 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.048707  5087 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:37.023270  5071 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:37.056200  5071 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:37.058130 26617 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 31 index: 16. Preceding OpId from leader: term: 33 index: 17. (index mismatch)
I20260709 12:14:37.064574 26616 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:37.070712 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:37.022869  5084 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:37.077525  5084 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:37.078877 26587 leader_election.cc:400] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 33. Current term is 34.
I20260709 12:14:37.079264 26587 leader_election.cc:403] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: Cancelling election due to peer responding with higher term
I20260709 12:14:37.079932  5084 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:37.082372 26620 raft_consensus.cc:1240] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32. Ops: [31.17-31.17]
I20260709 12:14:37.010700  5210 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.025s
I20260709 12:14:37.031247  5020 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.128630 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:37.129559 26542 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:37.144517 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:37.120190 26513 consensus_peers.cc:597] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:37.153843 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:37.154492 27167 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:37.156368 26542 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 35.
I20260709 12:14:37.158985 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:37.093925  5211 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election lost for term 33. Reason: Vote denied by peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567) with higher term. Message: Invalid argument: T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for earlier term 33. Current term is 34.
I20260709 12:14:37.073274  5087 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:37.165933 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:37.182832 26438 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:37.104859  5146 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.075s
I20260709 12:14:37.194094 27167 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 35.
I20260709 12:14:37.101807  5265 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 43 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:37.191803 27161 raft_consensus.cc:1240] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 33. Current term is 34. Ops: [33.22-33.22]
I20260709 12:14:37.173337  5058 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:37.105137  5216 consensus_queue.cc:1048] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.081s
I20260709 12:14:37.119092  5206 consensus_queue.cc:1048] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.061s
I20260709 12:14:37.120253  5020 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:37.195770  5007 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
I20260709 12:14:37.181449  5221 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.180807  4861 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader pre-election won for term 38
I20260709 12:14:37.181839  5222 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:37.192034 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:37.209941 26616 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 33 index: 18. Preceding OpId from leader: term: 34 index: 19. (index mismatch)
I20260709 12:14:37.211186 26617 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 43 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 42. Current term is 43. Ops: []
I20260709 12:14:37.197122  4802 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.199548 26439 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc; no voters: 
W20260709 12:14:37.215749 26587 leader_election.cc:336] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 43 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:37.220722 26587 leader_election.cc:336] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:37.221977 26587 leader_election.cc:336] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:37.160842  5231 consensus_queue.cc:260] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 37.24, Last appended by leader: 24, Current term: 37, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:37.229840  4802 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:37.196332  5226 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.021s
W20260709 12:14:37.226576  5055 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 34 current term: 34 is higher.
I20260709 12:14:37.252965 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:37.230803  5071 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:14:37.234426  4943 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
W20260709 12:14:37.266270  5287 log.cc:927] Time spent T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:14:37.224754  5222 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:37.218622  5221 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:37.260912  5007 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
W20260709 12:14:37.277952 26439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.273231  5071 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 35 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:37.246798  5084 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 12:14:37.271857  5213 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.015s
W20260709 12:14:37.298415 26419 auto_rebalancer.cc:893] Removing replace marker failed: Replica aaadfdd9ca9f424c91505f9b43876233 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 25 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:14:37.299220 26419 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:14:37.299566 26419 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:14:37.301810  4802 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:37.295554  5087 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:37.298523  5020 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:37.307669 26585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.309757  4861 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:37.314263  5231 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:37.314670  4861 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:37.320336 27167 raft_consensus.cc:1240] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Rejecting Update request from peer aaadfdd9ca9f424c91505f9b43876233 for earlier term 37. Current term is 38. Ops: []
I20260709 12:14:37.294361  5071 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 33.24, Last appended by leader: 24, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:37.312800 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 160010us
W20260709 12:14:37.325224 26513 leader_election.cc:336] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:37.326597 26513 leader_election.cc:336] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:37.327131 26513 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:37.327888  5225 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:37.307879  5221 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:37.330739 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 34 candidate_status { last_received { term: 32 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:14:37.335410 27133 consensus_peers.cc:597] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:37.337492  5055 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.337877  5222 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:37.338093  5055 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:37.340898  5055 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:37.341457  5265 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 43 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:37.330920 26513 consensus_peers.cc:597] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:37.368054  5181 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.368700  5181 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:37.378538 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:37.379254 26548 raft_consensus.cc:2468] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:14:37.380761 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:37.386889 26546 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 35 index: 22. Preceding OpId from leader: term: 38 index: 24. (index mismatch)
I20260709 12:14:37.388489 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 39 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:14:37.397323  5293 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:14:37.398607  5088 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.399230  5088 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:37.400594 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 34 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:37.401298 26542 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 35.
I20260709 12:14:37.401382  5088 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:37.409793 26587 leader_election.cc:336] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:37.416720 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 43 candidate_status { last_received { term: 42 index: 27 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:37.419507 26548 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 32 index: 22. Preceding OpId from leader: term: 34 index: 23. (index mismatch)
I20260709 12:14:37.422516 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:37.424054 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:37.429946 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:37.444622 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:14:37.434507 26513 consensus_peers.cc:597] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:37.452033 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:37.457453 26614 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 32 index: 22. Preceding OpId from leader: term: 34 index: 23. (index mismatch)
I20260709 12:14:37.467876 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:37.468863 26542 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:14:37.466027 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:37.452816  5138 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:37.453224  5226 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:37.483641 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:37.457228  5135 raft_consensus.cc:2804] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:37.500101  4289 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:37.500686  4289 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.501037  4289 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:37.505107 26545 raft_consensus.cc:1275] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 16. Preceding OpId from leader: term: 32 index: 17. (index mismatch)
I20260709 12:14:37.435384  4861 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:37.489264  5055 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:37.477437  5219 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.044s
I20260709 12:14:37.511917  5135 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:37.532536 27133 leader_election.cc:336] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 43 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:37.533345 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 43 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:37.541312 26363 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39184 (request call id 169) took 21278 ms (client timeout 15000 ms). Trace:
W20260709 12:14:37.544839 27133 leader_election.cc:336] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:37.545507 27133 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:37.480172  5020 consensus_queue.cc:1059] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: INVALID_TERM, Last received: 32.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.050s
W20260709 12:14:37.559387 27133 leader_election.cc:336] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:37.519129  5249 consensus_queue.cc:1048] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.039s
I20260709 12:14:37.508844  5221 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 22, Time since last communication: 0.044s
I20260709 12:14:37.537810  5055 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.538825  5135 raft_consensus.cc:3060] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:37.512742  5179 consensus_queue.cc:1059] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 42.27, Next index: 28, Last known committed idx: 26, Time since last communication: 0.040s
I20260709 12:14:37.539644  5218 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:37.551841  5058 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:37.515053  5226 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:37.582337  5055 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Advancing to term 36
W20260709 12:14:37.575419 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 113627us
I20260709 12:14:37.540839  5064 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 42 FOLLOWER]: Leader pre-election lost for term 43. Reason: could not achieve majority
W20260709 12:14:37.541721 26363 rpcz_store.cc:269] 0709 12:14:16.266877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.848722 (+10581845us) service_pool.cc:224] Handling call
0709 12:14:37.535244 (+10686522us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:35.703271 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:35.703915 (+   644us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:35.703950 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:14:35.703968 (+    18us) tablet.cc:662] Decoding operations
0709 12:14:35.739573 (+ 35605us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:35.739636 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:35.739666 (+    30us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:14:35.740941 (+  1275us) tablet.cc:701] Row locks acquired
0709 12:14:35.740963 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:14:35.741125 (+   162us) write_op.cc:270] Start()
0709 12:14:35.741253 (+   128us) write_op.cc:276] Timestamp: P: 1783599275741072 usec, L: 0
0709 12:14:35.741277 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:14:35.744957 (+  3680us) log.cc:844] Serialized 6282 byte log entry
0709 12:14:36.306610 (+561653us) op_driver.cc:464] REPLICATION: finished
0709 12:14:36.367922 (+ 61312us) spinlock_profiling.cc:243] Waited 8.3 ms on lock 0x7b18004558c0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed557 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:14:36.429600 (+ 61678us) write_op.cc:301] APPLY: starting
0709 12:14:36.434780 (+  5180us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:36.838163 (+403383us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:36.838192 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:37.001881 (+163689us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:37.002342 (+   461us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 12:14:37.011848 (+  9506us) write_op.cc:312] APPLY: finished
0709 12:14:37.074684 (+ 62836us) log.cc:844] Serialized 148 byte log entry
0709 12:14:37.074929 (+   245us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:37.075164 (+   235us) write_op.cc:454] Released schema lock
0709 12:14:37.075222 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:37.075731 (+   509us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:37.075769 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":43808,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":122649,"apply.run_cpu_time_us":35709,"apply.run_wall_time_us":646115,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70943,"num_ops":16,"prepare.queue_time_us":304374,"prepare.run_cpu_time_us":54705,"prepare.run_wall_time_us":162118,"raft.queue_time_us":379586,"raft.run_cpu_time_us":37012,"raft.run_wall_time_us":73115,"replication_time_us":565148,"spinlock_wait_cycles":19081472,"thread_start_us":577045,"threads_started":4,"wal-append.queue_time_us":154631}]]}
I20260709 12:14:37.574945  5181 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:37.553603  4943 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.035s
I20260709 12:14:37.609877  5105 raft_consensus.cc:3055] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:14:37.587639  5218 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:37.636150 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:37.640074 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:37.630525  5105 raft_consensus.cc:740] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:14:37.650938  5305 log.cc:927] Time spent T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:14:37.668458  5226 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:37.644577  5308 log.cc:927] Time spent T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:14:37.686653  5138 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:37.686902  4861 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 38 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:37.687307  5138 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:37.655282  4943 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:37.694766 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:37.650705  5317 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:37.717554  5105 consensus_queue.cc:260] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 33.22, Last appended by leader: 22, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:37.719197  5105 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:37.739750  5218 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:37.741338 25293 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 26498)
I20260709 12:14:37.745523  5299 raft_consensus.cc:3055] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 42 LEADER]: Stepping down as leader of term 42
I20260709 12:14:37.765378  5299 raft_consensus.cc:740] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 42 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:37.766610  5299 consensus_queue.cc:260] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 42.27, Last appended by leader: 27, Current term: 42, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:37.770641  5299 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 42 FOLLOWER]: Advancing to term 43
I20260709 12:14:37.702055  4289 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:37.810953 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 38 candidate_status { last_received { term: 37 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:37.769382  5135 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:37.812880 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 152382us
I20260709 12:14:37.815433 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:37.817765 26540 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:14:37.824957 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 38 index: 26 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:37.825291  4289 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:37.825644 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 38 index: 26 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:37.783639  5071 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:37.840938  5084 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.841670  5084 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:37.844065  5084 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:37.848137  5071 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:37.877458  5071 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:37.902825 26616 raft_consensus.cc:1240] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 37. Current term is 38. Ops: []
I20260709 12:14:37.902745  5055 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:37.909170 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:37.923115 26618 raft_consensus.cc:1240] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 43 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 42. Current term is 43. Ops: []
W20260709 12:14:37.926810 26513 leader_election.cc:336] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 39 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:37.927349 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:14:37.906975 27133 leader_election.cc:336] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:37.933713 27133 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:37.948766 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:14:37.950613 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 43677.5us
I20260709 12:14:37.961146 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:37.970736 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:37.971604 26546 raft_consensus.cc:3060] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:37.955041  5233 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
I20260709 12:14:38.007790 26365 catalog_manager.cc:5697] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 16 to 18, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 18 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:38.010012  5055 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:38.008366  5138 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:37.997824  5210 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.011255  5210 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:38.012705  5138 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:38.013731  5210 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:38.014604 26619 raft_consensus.cc:1240] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Rejecting Update request from peer 01a57027214a411e80874ac7febd628b for earlier term 31. Current term is 32. Ops: []
I20260709 12:14:37.979493  5133 consensus_queue.cc:1059] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 37.23, Next index: 24, Last known committed idx: 22, Time since last communication: 0.025s
I20260709 12:14:38.018621 26365 catalog_manager.cc:5697] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:38.024315 26365 catalog_manager.cc:5697] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 16 to 19, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 19 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:38.031910 26546 raft_consensus.cc:2468] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 35.
I20260709 12:14:38.033895  4943 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.993754  5321 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
I20260709 12:14:38.048761 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 35 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:38.049466 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 62479.7us
W20260709 12:14:38.057314 26587 leader_election.cc:336] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:38.059280 26587 leader_election.cc:336] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 43 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:38.059892 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 43 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:14:38.061578 26587 consensus_peers.cc:597] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:38.061477 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:38.062824 26587 leader_election.cc:336] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:38.064081 26587 leader_election.cc:336] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:38.064539 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:38.065307 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 35 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:38.065900 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:38.067696 26540 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 32 index: 23. Preceding OpId from leader: term: 35 index: 25. (index mismatch)
I20260709 12:14:38.092161  5135 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:38.069852  5254 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 43 FOLLOWER]: Leader election lost for term 43. Reason: could not achieve majority
I20260709 12:14:38.105618 27167 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 33 index: 24. Preceding OpId from leader: term: 35 index: 25. (index mismatch)
I20260709 12:14:38.055227  4943 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:38.112300 26587 leader_election.cc:336] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 38 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:38.126574  4943 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:38.128419 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 77390.6us
I20260709 12:14:38.132313  5314 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.001s
I20260709 12:14:38.133282  5138 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.133956  5138 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:38.135135  5179 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.135742  5179 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:38.138128  5179 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:38.141530 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:38.144621 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:38.116528  5325 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:14:38.150559 26438 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:38.152422 26438 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:38.153407  5314 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:38.154174  5314 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
I20260709 12:14:38.158586  4814 consensus_queue.cc:1059] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 31.20, Next index: 21, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:14:38.159699  5179 raft_consensus.cc:3055] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:14:38.160140  5179 raft_consensus.cc:740] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:38.160985 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:38.161530  5179 consensus_queue.cc:260] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 31.20, Last appended by leader: 20, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:38.163012 27133 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 150 similar messages]
I20260709 12:14:38.163051  5179 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:14:38.174001 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 49597.9us
I20260709 12:14:38.190917  5138 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:38.196112  5317 raft_consensus.cc:3055] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 37 LEADER]: Stepping down as leader of term 37
I20260709 12:14:38.196770  5317 raft_consensus.cc:740] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 37 LEADER]: Becoming Follower/Learner. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:38.198139  5317 consensus_queue.cc:260] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 37.23, Last appended by leader: 23, Current term: 37, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:38.200157  5317 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Advancing to term 38
W20260709 12:14:38.210410 26513 leader_election.cc:336] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:38.153995 26438 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:38.214048  4641 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
W20260709 12:14:38.222605 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 68715us
I20260709 12:14:38.222791  5133 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:38.229691 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:38.230600  5105 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 12:14:38.237924 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:14:38.214748 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 94052.9us
I20260709 12:14:38.239089 27165 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 38.
I20260709 12:14:38.238631 26513 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:38.254076 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:38.259116 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:38.245276  5007 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:38.304605 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 46110.2us
I20260709 12:14:38.313844 26588 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:38.256752  5218 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:38.244443  5105 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 23, Time since last communication: 0.062s
I20260709 12:14:38.313902 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 38 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:38.335101  5277 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:38.336042  5277 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:38.329082  5211 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election won for term 39
I20260709 12:14:38.340754  5211 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.341162  5211 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Advancing to term 39
I20260709 12:14:38.342788 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:38.343513 26544 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 37.
I20260709 12:14:38.344310 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:38.347981 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 34 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:38.348884 26542 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:38.359397 26438 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:38.368708 26438 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:38.369942 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:38.359754  5277 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:38.345566  5138 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader election lost for term 38. Reason: could not achieve majority
I20260709 12:14:38.404528 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:38.405759 27167 raft_consensus.cc:2393] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 38: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:38.377916 26542 raft_consensus.cc:2468] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 36.
I20260709 12:14:38.353195  5314 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:38.369963  5133 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:38.381022  5179 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
I20260709 12:14:38.318468  5007 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:38.419003  5314 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:38.419711  5007 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:38.423130 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:38.423759 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 36 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:38.426887 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:38.427027 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 36 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:38.421533  5314 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:38.436298 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 122454us
I20260709 12:14:38.437529 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:38.441555 26438 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:38.446175 26438 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:38.445588  5138 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:38.450003 26587 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:38.459434  5138 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.459925  5138 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:38.461975  5337 raft_consensus.cc:2804] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:14:38.447901  5220 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:38.462957  5220 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:38.465332  5220 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:38.467504  5211 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:38.469009 26613 raft_consensus.cc:2368] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 38. Current term is 39.
I20260709 12:14:38.484256 26587 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:38.492197 26438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 46102.9us
I20260709 12:14:38.494947 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:38.495715 26545 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Advancing to term 39
W20260709 12:14:38.498129 26587 leader_election.cc:336] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:38.472446  5337 raft_consensus.cc:697] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:38.473693  5084 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:38.473826  5211 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:38.484225  5007 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
I20260709 12:14:38.516357 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:38.501317  5088 raft_consensus.cc:2804] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:14:38.517068 27167 raft_consensus.cc:3060] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Advancing to term 39
I20260709 12:14:38.522815 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:38.529563 26514 leader_election.cc:400] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 38. Current term is 39.
I20260709 12:14:38.529971 26514 leader_election.cc:403] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:38.509415  5084 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.541097 27167 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 39 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 39.
I20260709 12:14:38.547962  5088 raft_consensus.cc:697] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 36 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:38.561190  5088 consensus_queue.cc:237] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 34.21, Last appended by leader: 21, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:38.563731  5337 consensus_queue.cc:237] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 33.18, Last appended by leader: 18, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:38.544401  5084 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:38.594020  5084 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:38.595234 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:38.596434 26548 raft_consensus.cc:2393] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 36: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:38.601459 26545 raft_consensus.cc:2468] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 39.
I20260709 12:14:38.602922  4802 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader pre-election lost for term 38. Reason: Vote denied by peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217) with higher term. Message: Invalid argument: T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd for earlier term 38. Current term is 39.
I20260709 12:14:38.615526 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:38.619861 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:38.622296 26588 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:38.624480  5211 raft_consensus.cc:2804] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Leader election won for term 39
I20260709 12:14:38.625051  5211 raft_consensus.cc:697] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 39 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:38.619431  5189 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:14:38.643193 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 87500.7us
I20260709 12:14:38.647661 26439 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:38.652081 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:38.651579  5220 raft_consensus.cc:3060] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:38.653602  5211 consensus_queue.cc:237] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 37.24, Last appended by leader: 24, Current term: 39, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:38.643112  5189 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:38.661589  5007 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:14:38.707911 27133 consensus_peers.cc:597] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:38.719870 26587 leader_election.cc:336] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:38.725520 26587 leader_election.cc:336] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:38.725958 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:38.730315  5189 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:38.732406 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:38.741011  5220 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:38.750772 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:38.753084 26438 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:38.754734 25293 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 26498)
I20260709 12:14:38.759624  5320 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:38.754372  5254 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:14:38.754567  5138 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:38.771664  5138 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:38.776463 27133 consensus_peers.cc:597] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:38.776989 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53756.4us
I20260709 12:14:38.790105  4943 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.791208  4943 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:38.797904  4943 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:38.798859 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:38.799086 27133 consensus_peers.cc:597] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:38.804154 27133 consensus_peers.cc:597] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:38.798979 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:38.804466  5343 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:14:38.821388 26587 leader_election.cc:336] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:38.832018 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:38.832937 26540 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:38.841964 26439 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:38.851835 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 269599us
I20260709 12:14:38.870198 26540 raft_consensus.cc:2468] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 32.
I20260709 12:14:38.805362  5343 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:38.881031  5343 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:38.890049 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:38.891039 27167 raft_consensus.cc:2393] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 34: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:38.866582  5220 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:38.894644 26587 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:38.883591  5197 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 40 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.900903  5343 raft_consensus.cc:2804] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:38.907434  5197 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 40 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:38.922948  5343 raft_consensus.cc:697] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:38.927246  5300 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
W20260709 12:14:38.952894 27133 consensus_peers.cc:597] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:38.972800 26587 leader_election.cc:336] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:38.945294  5300 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:38.973333 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:38.981771 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 41 candidate_status { last_received { term: 38 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:38.975378 26362 catalog_manager.cc:5697] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 18 to 23. New cstate: current_term: 23 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
W20260709 12:14:38.975066 27133 consensus_peers.cc:597] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:38.985708 26362 catalog_manager.cc:5697] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 27 to 28, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 28 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:38.979382  5197 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 41 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:38.976594 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 6598ff9cfd5346af8da1e9928f3a5ac9: Illegal state: Replica aaadfdd9ca9f424c91505f9b43876233 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 36 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:38.972946  5343 consensus_queue.cc:237] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 30.18, Last appended by leader: 18, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:38.988866  5341 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:38.992486  5300 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:38.987464 26362 catalog_manager.cc:5697] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 25 to 27, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 27 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:38.994545 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:38.995777 26362 catalog_manager.cc:5697] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 23 to 31, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 31 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:38.997759 26362 catalog_manager.cc:5697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 27 to 28, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 28 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.001768 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 41 candidate_status { last_received { term: 38 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:39.005793 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:39.008203 26438 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:39.008471 26439 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 41 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:39.014513 26587 consensus_peers.cc:597] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:39.010375  5317 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
I20260709 12:14:39.018447 26362 catalog_manager.cc:5697] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
W20260709 12:14:39.019897 26365 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57048 (request call id 307) took 103310 ms (client timeout 15000 ms). Trace:
W20260709 12:14:39.022034 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 14b3fc9b208642ffb7dbc462c4032c67: Illegal state: Replica aaadfdd9ca9f424c91505f9b43876233 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 34 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:39.007258  5197 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.013821  4943 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 40 FOLLOWER]: Leader pre-election lost for term 41. Reason: could not achieve majority
I20260709 12:14:39.031921 26362 catalog_manager.cc:5697] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 25 to 26, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 26 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.038662 26362 catalog_manager.cc:5697] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 24 to 27, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 27 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.043324 26362 catalog_manager.cc:5697] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.028980  5197 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:39.055337 26587 consensus_peers.cc:597] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:39.056174 26587 consensus_peers.cc:597] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:39.057301  5197 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:39.059849 26587 consensus_peers.cc:597] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:39.045642 26362 catalog_manager.cc:5697] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 25 to 27, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 27 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.063362 26362 catalog_manager.cc:5697] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 22 to 25, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 25 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.065477 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:39.065855 26362 catalog_manager.cc:5697] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 23 to 27, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 27 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.068617 26362 catalog_manager.cc:5697] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 30 to 36, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 36 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:39.070454 26362 catalog_manager.cc:5697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 25 to 28, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 28 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.071556 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:39.078053 26438 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:39.079742 26362 catalog_manager.cc:5697] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 25 to 30, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 30 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.084551 26362 catalog_manager.cc:5697] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 28 to 33. New cstate: current_term: 33 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:39.020437 26365 rpcz_store.cc:269] 0709 12:12:55.709336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.709662 (+   326us) service_pool.cc:224] Handling call
0709 12:12:55.807856 (+ 98194us) spinlock_profiling.cc:243] Waited 6.85 ms on lock 0x7b54002600b8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507be98e43 00007f507bf9704e 00007f507a4582a4 00007f507a458232 00007f507a458161 00007f507a4580dc 00007f507a457392 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:12:56.235708 (+427852us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b540007d354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076044090 00007f50760e2f3a 00007f507be98e9c 00007f507bf9704e 00007f507a4582a4 00007f507a458232 00007f507a458161 00007f507a4580dc 00007f507a457392 00007f507441548c 00007f50744148c6
0709 12:14:39.019823 (+102784115us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:38.383396 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:38.383979 (+   583us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:38.384014 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:14:38.384027 (+    13us) tablet.cc:662] Decoding operations
0709 12:14:38.409631 (+ 25604us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:38.416009 (+  6378us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:38.424211 (+  8202us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:14:38.430483 (+  6272us) tablet.cc:701] Row locks acquired
0709 12:14:38.430532 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:14:38.431972 (+  1440us) write_op.cc:270] Start()
0709 12:14:38.435729 (+  3757us) write_op.cc:276] Timestamp: P: 1783599278431884 usec, L: 0
0709 12:14:38.435772 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:14:38.451126 (+ 15354us) log.cc:844] Serialized 1317 byte log entry
0709 12:14:38.588434 (+137308us) op_driver.cc:464] REPLICATION: finished
0709 12:14:38.663917 (+ 75483us) write_op.cc:301] APPLY: starting
0709 12:14:38.664009 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:38.666214 (+  2205us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:38.666313 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:38.736439 (+ 70126us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:38.736660 (+   221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:14:38.736712 (+    52us) write_op.cc:312] APPLY: finished
0709 12:14:38.736956 (+   244us) log.cc:844] Serialized 41 byte log entry
0709 12:14:38.737156 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:38.737290 (+   134us) write_op.cc:454] Released schema lock
0709 12:14:38.737343 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:38.737819 (+   476us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:38.737857 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2270,"reported_tablets":51,"spinlock_wait_cycles":304098432,"child_traces":[["op",{"apply.queue_time_us":75171,"apply.run_cpu_time_us":6692,"apply.run_wall_time_us":73875,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16655,"num_ops":3,"prepare.queue_time_us":307031,"prepare.run_cpu_time_us":20815,"prepare.run_wall_time_us":142236,"raft.queue_time_us":24065,"raft.run_cpu_time_us":27325,"raft.run_wall_time_us":58065,"replication_time_us":152419,"thread_start_us":335207,"threads_started":4,"wal-append.queue_time_us":106981}]]}
I20260709 12:14:39.083902  4814 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:39.090065  4943 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.102581 26540 raft_consensus.cc:1275] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 33 index: 18. Preceding OpId from leader: term: 35 index: 19. (index mismatch)
I20260709 12:14:39.101521  4943 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:39.105854  4943 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:39.107105 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 35 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:39.110647 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 35 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:39.112394  5337 consensus_queue.cc:1048] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:39.117995 27167 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 39 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 37 index: 24. Preceding OpId from leader: term: 39 index: 25. (index mismatch)
I20260709 12:14:39.124562 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:39.133733  5229 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.001s
I20260709 12:14:39.128976  4943 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:39.146173  5317 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.153527  5317 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:39.145538  5197 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:39.158735  5317 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:39.168365 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:39.180264 26540 raft_consensus.cc:1275] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 37 index: 24. Preceding OpId from leader: term: 39 index: 25. (index mismatch)
I20260709 12:14:39.183612 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:39.184633 26545 raft_consensus.cc:2393] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 01a57027214a411e80874ac7febd628b in current term 32: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:39.188374  5343 consensus_queue.cc:1048] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.001s
I20260709 12:14:39.136689  4943 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:39.196864  4943 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:39.214434 26542 raft_consensus.cc:1275] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 34 index: 21. Preceding OpId from leader: term: 36 index: 22. (index mismatch)
I20260709 12:14:39.219888 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:39.228932 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:39.226085  5341 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
W20260709 12:14:39.246969 26587 consensus_peers.cc:597] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:39.224649  5229 consensus_queue.cc:1048] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 20, Time since last communication: 0.021s
I20260709 12:14:39.293002 26438 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:39.295933 26438 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:39.301182  5197 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:39.305627  5321 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.306252  5321 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:39.309528 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:39.310287 26619 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 34.
I20260709 12:14:39.297796  5084 raft_consensus.cc:3060] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:39.314909  5310 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:39.315575  5310 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:39.312143 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:39.322824  4943 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:39.325412  4943 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.325888  4943 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:39.335172  5310 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:39.335438 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 37 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:39.336375 26616 raft_consensus.cc:2393] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 38: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:39.343482 26548 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 30.19, Last appended by leader: 18, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:14:39.344647  5317 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:39.345752 26513 consensus_peers.cc:597] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:39.346577 26513 leader_election.cc:336] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:39.346967 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:39.349148  5300 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.348038  5317 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:39.349745  5300 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:39.351400  5317 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:39.352941 26587 consensus_peers.cc:597] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:39.353586 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:39.354938 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:39.356253 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:39.357446 26587 consensus_peers.cc:597] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:39.354449  4641 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:39.358901 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 36 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:39.354799  5300 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:39.370893 26438 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:39.370883 26587 consensus_peers.cc:597] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:39.376773 26438 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:39.379542  5317 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:39.381224 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:39.385605 27167 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 34.
I20260709 12:14:39.384914  5317 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:39.388013  5317 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:39.376472  5197 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:39.394642 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:39.396353 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:39.372063  5321 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:39.400763 26438 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:39.402935  5320 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 12:14:39.403213  5358 log.cc:927] Time spent T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:14:39.399485  5087 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 42 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:39.409598  5087 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 42 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:39.420580  5087 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 43 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:39.421993 26540 raft_consensus.cc:1275] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 18. Preceding OpId from leader: term: 32 index: 19. (index mismatch)
I20260709 12:14:39.422798 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 43 candidate_status { last_received { term: 42 index: 27 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:39.441146 26616 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 43 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 43: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:14:39.425529 26587 consensus_peers.cc:597] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:39.397856  5317 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:39.442792 26513 consensus_peers.cc:597] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:39.426491  5321 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:39.442179  5084 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:39.440876  5320 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:39.475042  5084 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.457368  5055 consensus_queue.cc:1048] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.027s
I20260709 12:14:39.469172  5321 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:39.517674 26514 consensus_peers.cc:597] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cff430729a9d4c8183d8ddad129d6ecf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:39.480295  5320 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:39.520413  4814 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.508751  5084 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:39.555604 26616 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 30 index: 19. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
W20260709 12:14:39.563961  5366 log.cc:927] Time spent T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:14:39.571935  5317 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.572577  5317 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:39.576073  4943 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:39.578791  5225 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:14:39.579306  5310 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:39.579862  5310 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:39.551151  4641 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
I20260709 12:14:39.557461  4814 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:39.585335  4814 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:39.587914  5321 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:39.588641  5320 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:39.591527 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:39.592398 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:39.593274 26621 raft_consensus.cc:2393] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 32: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:39.593636  5084 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:39.597779 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:39.597970 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 37 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:39.599701 26541 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 38.
I20260709 12:14:39.601958 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:39.582177  5310 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:39.595989  5365 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 12:14:39.610859 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 88199.9us
I20260709 12:14:39.578377  4943 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:39.611968  5320 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election won for term 39
I20260709 12:14:39.635525 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:39.636459 26587 consensus_peers.cc:597] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:39.646426  5317 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:39.625313  5320 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.651185  5320 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Advancing to term 39
W20260709 12:14:39.659354 26513 consensus_peers.cc:597] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:39.660960 26513 leader_election.cc:336] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:39.661423 26513 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:39.662784 26513 consensus_peers.cc:597] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:39.662897  5377 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:14:39.663625 26513 consensus_peers.cc:597] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:39.667780  5369 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 43 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.668419  5369 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 43 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:39.673081 26587 consensus_peers.cc:597] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:39.674053 26587 consensus_peers.cc:597] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:39.676090  5369 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 44 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:39.680790 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:39.682232 26621 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:39.691102 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:39.692142 27161 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:39.693894 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:39.695600 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:39.699106 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:39.701043 26621 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 35.
W20260709 12:14:39.698436 27133 leader_election.cc:336] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 43 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:39.702831 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:39.703780 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 44 candidate_status { last_received { term: 42 index: 27 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:39.714303 27160 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 42 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 42.
I20260709 12:14:39.707897 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:39.708704 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 37 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:39.716986 26613 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 38.
I20260709 12:14:39.707929  5377 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:39.709302 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 44 candidate_status { last_received { term: 42 index: 27 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:39.717974 26439 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:39.718155 26617 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 43 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 43.
I20260709 12:14:39.718892  5317 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
I20260709 12:14:39.711073 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:39.723578 26439 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:39.724443  5317 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:39.727228 26439 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:39.728684  5317 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:14:39.729444  5317 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 35 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
W20260709 12:14:39.711745 26587 consensus_peers.cc:597] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:39.702297 27133 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 43 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:39.730568  5317 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 33.22, Last appended by leader: 22, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:39.731797  5290 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 42 FOLLOWER]: Advancing to term 43
W20260709 12:14:39.742051 26513 consensus_peers.cc:597] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:39.754549 27161 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 35.
W20260709 12:14:39.756158 25293 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 26498)
I20260709 12:14:39.757078 26439 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:39.767460 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 44 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:39.770592 26439 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:39.772929  5369 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 43 FOLLOWER]: Leader pre-election won for term 44
I20260709 12:14:39.776046  5369 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 43 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.776484  5369 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 43 FOLLOWER]: Advancing to term 44
I20260709 12:14:39.779770  5374 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:14:39.782542 26513 consensus_peers.cc:597] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:39.783339  5372 raft_consensus.cc:2955] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Committing config change with OpId 30.20: config changed from index -1 to 20, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
W20260709 12:14:39.788363 27133 consensus_peers.cc:597] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:39.792008 26616 raft_consensus.cc:2955] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Committing config change with OpId 30.20: config changed from index -1 to 20, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:14:39.772239  5375 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:14:39.804208 26587 consensus_peers.cc:597] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:39.820478  5375 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.821113  5375 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:39.831015  5375 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:39.832768 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:39.835532 26618 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:14:39.835801 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:39.837324 26439 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:39.836498 26547 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 32.
I20260709 12:14:39.842602  5290 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 43 FOLLOWER]: Leader pre-election lost for term 43. Reason: could not achieve majority
W20260709 12:14:39.844146 26362 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57052 (request call id 312) took 35014 ms (client timeout 15000 ms). Trace:
I20260709 12:14:39.846626  5375 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:39.847348  5375 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.847831  5375 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Advancing to term 33
W20260709 12:14:39.844645 26362 rpcz_store.cc:269] 0709 12:14:04.829697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.518066 (+5688369us) service_pool.cc:224] Handling call
0709 12:14:39.844042 (+29325976us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:39.237594 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:39.238294 (+   700us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:39.238341 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:14:39.238362 (+    21us) tablet.cc:662] Decoding operations
0709 12:14:39.239913 (+  1551us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:39.240003 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:39.240042 (+    39us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:14:39.241415 (+  1373us) tablet.cc:701] Row locks acquired
0709 12:14:39.241437 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:14:39.241605 (+   168us) write_op.cc:270] Start()
0709 12:14:39.241741 (+   136us) write_op.cc:276] Timestamp: P: 1783599279241548 usec, L: 0
0709 12:14:39.241764 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:14:39.250295 (+  8531us) log.cc:844] Serialized 6358 byte log entry
0709 12:14:39.357257 (+106962us) op_driver.cc:464] REPLICATION: finished
0709 12:14:39.582817 (+225560us) write_op.cc:301] APPLY: starting
0709 12:14:39.582915 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:39.684057 (+101142us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:39.684196 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:39.763404 (+ 79208us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:39.763726 (+   322us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 12:14:39.763791 (+    65us) write_op.cc:312] APPLY: finished
0709 12:14:39.764489 (+   698us) log.cc:844] Serialized 148 byte log entry
0709 12:14:39.771257 (+  6768us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:39.771465 (+   208us) write_op.cc:454] Released schema lock
0709 12:14:39.771533 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:39.779801 (+  8268us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:39.779844 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":50362,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":181162,"apply.run_cpu_time_us":24289,"apply.run_wall_time_us":196969,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70943,"num_ops":16,"prepare.queue_time_us":114453,"prepare.run_cpu_time_us":5762,"prepare.run_wall_time_us":21713,"replication_time_us":82776,"thread_start_us":161244,"threads_started":2}]]}
I20260709 12:14:39.798966  5369 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 44 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:39.858580 26364 catalog_manager.cc:5697] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 31 to 39, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 39 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
W20260709 12:14:39.869328 26513 consensus_peers.cc:597] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:39.829627  5320 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:39.878679  5320 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:39.881603 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 37 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:39.882218 26548 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Advancing to term 39
I20260709 12:14:39.876395 26364 catalog_manager.cc:5697] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 29 to 35. New cstate: current_term: 35 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:39.885340 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 37 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:39.886023 26618 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Advancing to term 39
I20260709 12:14:39.887609 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 44 candidate_status { last_received { term: 42 index: 27 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:39.885262  5369 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 44 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:39.888234 26616 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 43 FOLLOWER]: Advancing to term 44
I20260709 12:14:39.885571 26364 catalog_manager.cc:5697] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 19 to 27. New cstate: current_term: 27 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.892164 26548 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 39.
I20260709 12:14:39.893424 26438 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:39.894070 26364 catalog_manager.cc:5697] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 23 to 26. New cstate: current_term: 26 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:39.895043 26618 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 39.
I20260709 12:14:39.896360 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 44 candidate_status { last_received { term: 42 index: 27 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:39.897018 27161 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 43 FOLLOWER]: Advancing to term 44
I20260709 12:14:39.898312  5369 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Leader election won for term 39
I20260709 12:14:39.898926  5369 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 39 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:39.899824  5369 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 37.23, Last appended by leader: 23, Current term: 39, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:39.905500 26364 catalog_manager.cc:5697] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 36 to 37, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 37 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:39.906978 26364 catalog_manager.cc:5697] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 14 to 27. New cstate: current_term: 27 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:39.909233 26364 catalog_manager.cc:5697] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 28 to 32, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 32 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:39.910370 26616 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 44 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 44.
I20260709 12:14:39.910259 26364 catalog_manager.cc:5697] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 27 to 30, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 30 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.913537 27161 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 44 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 44.
I20260709 12:14:39.915769 26439 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 44 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:39.916079 26364 catalog_manager.cc:5697] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 39 to 41. New cstate: current_term: 41 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:39.920445 26364 catalog_manager.cc:5697] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 27 to 29, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 29 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.921690 26364 catalog_manager.cc:5697] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 26 to 30. New cstate: current_term: 30 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:39.928210 26364 catalog_manager.cc:5697] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 30 to 35, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 35 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.931941 26364 catalog_manager.cc:5697] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 32 to 34, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 34 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:39.934558 26364 catalog_manager.cc:5697] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 26 to 28, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 28 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:39.936869 26364 catalog_manager.cc:5697] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 27 to 30, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 30 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:39.943193 26364 catalog_manager.cc:5697] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.945784 26364 catalog_manager.cc:5697] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 36 to 39, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 39 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.923719  5320 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 44 FOLLOWER]: Leader election won for term 44
I20260709 12:14:39.954007 26364 catalog_manager.cc:5697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 28 to 32, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 32 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:39.956002 26364 catalog_manager.cc:5697] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 19 to 25, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 25 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:39.957693 26364 catalog_manager.cc:5697] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 15 to 30, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 30 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:39.959939 26364 catalog_manager.cc:5697] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 30 to 33. New cstate: current_term: 33 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.961869 26364 catalog_manager.cc:5697] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 33 to 37. New cstate: current_term: 37 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:39.966815 26587 consensus_peers.cc:597] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:39.955574  5320 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 44 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:39.971179  5320 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 42.27, Last appended by leader: 27, Current term: 44, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:39.966445  5386 ts_tablet_manager.cc:933] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:39.987871  5375 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:39.992198 26548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:39.992877 26548 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:40.002158  5386 tablet_copy_client.cc:323] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.66:40567
I20260709 12:14:40.004248 26558 tablet_copy_service.cc:140] P ac3ac2181aa941229a758ccf6b5607cd: Received BeginTabletCopySession request for tablet cff430729a9d4c8183d8ddad129d6ecf from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:44706)
I20260709 12:14:40.004869 26558 tablet_copy_service.cc:161] P ac3ac2181aa941229a758ccf6b5607cd: Beginning new tablet copy session on tablet cff430729a9d4c8183d8ddad129d6ecf from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:44706: session id = 3262bf0553e543eea76794fc529a9acc-cff430729a9d4c8183d8ddad129d6ecf
I20260709 12:14:40.009428  5375 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:40.052775 26548 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
W20260709 12:14:40.055694 26419 auto_rebalancer.cc:629] Failed to schedule move for tablet 78002f4d800445a3befddbc1cce2750d: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:40.060145 26438 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:40.088593 26558 tablet_copy_source_session.cc:215] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:40.091727 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:40.093103 26616 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:40.122141  4814 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:40.122551  4943 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.123317  4814 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:40.123687  4943 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:40.128088 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:40.128840  5084 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:14:40.138976  5320 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.140064  5320 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:40.144395  5317 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:40.145370  5317 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:40.156100  5320 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:40.136147 26616 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a57027214a411e80874ac7febd628b in term 33.
I20260709 12:14:40.166770  5386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff430729a9d4c8183d8ddad129d6ecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.178834  4943 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:40.181361  4814 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:40.181900 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:40.187264 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:40.192698 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:40.217021  5084 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Becoming Leader. State: Replica: 01a57027214a411e80874ac7febd628b, State: Running, Role: LEADER
I20260709 12:14:40.219149  5084 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 31.20, Last appended by leader: 20, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:40.237319 27161 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 32 index: 21. Preceding OpId from leader: term: 35 index: 23. (index mismatch)
I20260709 12:14:40.247968 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:40.256395 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:40.260778  5197 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:40.274019 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:40.261718  5197 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:40.224977  5317 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:40.326824 26513 consensus_peers.cc:597] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:40.333007  5197 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:40.336582 26513 consensus_peers.cc:597] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:40.342991 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:40.344815  5300 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 12:14:40.348446 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 51245.3us
I20260709 12:14:40.350579  5317 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.351619  5317 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:40.365607 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:40.362811  5317 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:40.372913 26439 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:40.378139 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:40.382814  5386 tablet_copy_client.cc:806] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:40.383745  5386 tablet_copy_client.cc:670] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
W20260709 12:14:40.385306 26513 consensus_peers.cc:597] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:40.402948 26438 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:40.386613  5084 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:40.392562 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:40.393780 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:40.426640  5386 tablet_copy_client.cc:538] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:40.428903  5084 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:40.438687  5300 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
W20260709 12:14:40.449918 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 77121us
I20260709 12:14:40.454339  5317 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 21, Time since last communication: 0.001s
I20260709 12:14:40.455853  5386 tablet_bootstrap.cc:492] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:14:40.476756 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:40.488402 26614 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 33 index: 22. Preceding OpId from leader: term: 35 index: 23. (index mismatch)
I20260709 12:14:40.490144 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:40.495930 26547 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 37 index: 23. Preceding OpId from leader: term: 39 index: 24. (index mismatch)
I20260709 12:14:40.511842  5084 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.001s
I20260709 12:14:40.517836  5317 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.526674 26616 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 44 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 42 index: 27. Preceding OpId from leader: term: 44 index: 28. (index mismatch)
I20260709 12:14:40.528659  5317 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:40.531488  5317 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:40.534763 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:40.546535 26587 consensus_peers.cc:597] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:40.566566  5084 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.578970  5084 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:40.581894  5084 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:40.605178 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:40.625008 26618 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 37 index: 23. Preceding OpId from leader: term: 39 index: 24. (index mismatch)
I20260709 12:14:40.630039 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:40.674544  5300 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 21, Time since last communication: 0.001s
W20260709 12:14:40.680985 27133 consensus_peers.cc:597] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:40.706880 26439 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:40.718931 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 47737.4us
I20260709 12:14:40.726336  4943 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
W20260709 12:14:40.775089 25293 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 26498)
I20260709 12:14:40.755168  5197 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 26, Time since last communication: 0.028s
W20260709 12:14:40.785470 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 57283.6us
I20260709 12:14:40.757284  5084 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:40.798867 26439 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 75168.5us
I20260709 12:14:40.810552 26439 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:40.811685  5398 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 22, Time since last communication: 0.001s
I20260709 12:14:40.815317  5317 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:40.816659 26439 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:40.819046  4943 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:40.826552  5084 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:40.828635 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:40.829486  5084 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:40.832252 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:40.861454 27165 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 44 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 42 index: 27. Preceding OpId from leader: term: 44 index: 28. (index mismatch)
I20260709 12:14:40.881732 26621 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 31 index: 20. Preceding OpId from leader: term: 33 index: 21. (index mismatch)
I20260709 12:14:40.948200 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:40.950534  5084 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.951287  5084 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:40.950603  5300 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:40.956372  5300 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:40.960254  5084 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:40.960999  5300 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:40.966887 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:40.972368 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:40.946183 26364 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57052 (request call id 313) took 15189 ms (client timeout 15000 ms). Trace:
W20260709 12:14:40.974928 26364 rpcz_store.cc:269] 0709 12:14:25.756998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.279055 (+9522057us) service_pool.cc:224] Handling call
0709 12:14:40.945842 (+5666787us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:39.992888 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:39.999180 (+  6292us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:39.999221 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:14:39.999253 (+    32us) tablet.cc:662] Decoding operations
0709 12:14:40.012946 (+ 13693us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:40.013014 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:40.013039 (+    25us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:14:40.014073 (+  1034us) tablet.cc:701] Row locks acquired
0709 12:14:40.014086 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:14:40.014208 (+   122us) write_op.cc:270] Start()
0709 12:14:40.014327 (+   119us) write_op.cc:276] Timestamp: P: 1783599280014168 usec, L: 0
0709 12:14:40.014339 (+    12us) op_driver.cc:348] REPLICATION: starting
0709 12:14:40.015265 (+   926us) log.cc:844] Serialized 8719 byte log entry
0709 12:14:40.017988 (+  2723us) op_driver.cc:464] REPLICATION: finished
0709 12:14:40.018455 (+   467us) write_op.cc:301] APPLY: starting
0709 12:14:40.018549 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:40.328623 (+310074us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:40.328835 (+   212us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:40.466618 (+137783us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:40.466982 (+   364us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=0,mrs_lookups=0
0709 12:14:40.467040 (+    58us) write_op.cc:312] APPLY: finished
0709 12:14:40.467700 (+   660us) log.cc:844] Serialized 196 byte log entry
0709 12:14:40.511663 (+ 43963us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:40.540304 (+ 28641us) write_op.cc:454] Released schema lock
0709 12:14:40.540388 (+    84us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:40.541037 (+   649us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:40.541078 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1808,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":130,"apply.run_cpu_time_us":38838,"apply.run_wall_time_us":522497,"cfile_cache_hit":88,"cfile_cache_hit_bytes":91872,"num_ops":22,"prepare.queue_time_us":18889,"prepare.run_cpu_time_us":5067,"prepare.run_wall_time_us":24967,"replication_time_us":3465,"thread_start_us":91072,"threads_started":1}]]}
I20260709 12:14:41.017642 26547 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Refusing update from remote peer 01a57027214a411e80874ac7febd628b: Log matching property violated. Preceding OpId in replica: term: 31 index: 20. Preceding OpId from leader: term: 33 index: 21. (index mismatch)
I20260709 12:14:41.019965  5084 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 12:14:41.027055  5084 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.027869  5084 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:41.030701  5084 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:41.051151  5300 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.001s
I20260709 12:14:41.057065  5386 tablet_bootstrap.cc:492] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=21 overwritten=1 applied=20 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:41.058429  5386 tablet_bootstrap.cc:492] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:14:41.059377  5386 ts_tablet_manager.cc:1403] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.604s	user 0.069s	sys 0.017s
I20260709 12:14:41.069272  5386 raft_consensus.cc:359] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [term 30 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:14:41.070259  5386 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [term 30 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:14:41.071060  5386 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 20, Last appended: 30.20, Last appended by leader: 20, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:14:41.080644  5386 ts_tablet_manager.cc:1434] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:14:41.084846 26439 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:41.086215  5402 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
I20260709 12:14:41.097199 26558 tablet_copy_service.cc:342] P ac3ac2181aa941229a758ccf6b5607cd: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-cff430729a9d4c8183d8ddad129d6ecf received from {username='slave'} at 127.0.0.1:44706
I20260709 12:14:41.110173 26558 tablet_copy_service.cc:434] P ac3ac2181aa941229a758ccf6b5607cd: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-cff430729a9d4c8183d8ddad129d6ecf on tablet cff430729a9d4c8183d8ddad129d6ecf with peer 3262bf0553e543eea76794fc529a9acc
W20260709 12:14:41.110700  5409 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:14:41.110842  5300 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:14:41.114984 26439 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:41.121579  5084 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
I20260709 12:14:41.122630  5084 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.123396  5084 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:41.127761 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 40 candidate_status { last_received { term: 37 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:41.146854  5084 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:41.157441  5300 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:41.158236  5300 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:41.162518  5300 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:41.161921 26362 catalog_manager.cc:5697] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 37 to 38, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 38 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:41.164068 26362 catalog_manager.cc:5697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 31 to 33, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 33 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:41.167054 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:41.165874 26362 catalog_manager.cc:5697] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:41.177691 26362 catalog_manager.cc:5697] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 26 to 30, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 30 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:41.182487 26362 catalog_manager.cc:5697] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 29 to 36, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 36 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:41.184376 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:41.184187 26362 catalog_manager.cc:5697] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 34 to 37. New cstate: current_term: 37 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:41.192153 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:41.199220 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 35 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:41.202329 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 35 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:41.208958 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 40 candidate_status { last_received { term: 37 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:41.212282  5300 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.214332  5300 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:41.222566 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:41.223945  5300 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:41.226758 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 36 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:41.237039 26439 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:41.238360 26439 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:41.239274  5317 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:41.240906 26439 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:41.239508  4814 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:41.246649  5317 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
I20260709 12:14:41.247011 26439 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:41.248204  5402 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:41.259642 26439 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:41.266151 26362 catalog_manager.cc:5697] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 34 to 36, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 36 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:41.267493  5402 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:41.268962 26362 catalog_manager.cc:5697] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 35 to 36, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 36 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:41.270484 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 36 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:41.272886 26362 catalog_manager.cc:5697] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 29 to 33. New cstate: current_term: 33 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:41.276444 26362 catalog_manager.cc:5697] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 26 to 28, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 28 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:14:41.289984 27133 consensus_peers.cc:597] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:41.308475 26439 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:41.316041  5401 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
W20260709 12:14:41.320232 27133 consensus_peers.cc:597] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:41.334568 26362 catalog_manager.cc:5697] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 23 to 27, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 27 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:41.336730 26362 catalog_manager.cc:5697] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 30 to 32. New cstate: current_term: 32 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:14:41.358024 26366 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57052 (request call id 308) took 137270 ms (client timeout 15000 ms). Trace:
W20260709 12:14:41.366580 26366 rpcz_store.cc:269] 0709 12:12:24.087243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.090672 (+  3429us) service_pool.cc:224] Handling call
0709 12:14:41.357790 (+137267118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81824,"reported_tablets":50}
I20260709 12:14:41.582355  5084 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.583029  5084 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:41.585597  5084 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:41.586160 26587 consensus_peers.cc:597] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:41.590819 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:41.597687 26362 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39184 (request call id 170) took 7622 ms. Trace:
I20260709 12:14:41.600314  4943 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.606899  4943 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:41.609023 26587 consensus_peers.cc:597] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:41.609380  4943 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:41.610102 26362 rpcz_store.cc:276] 0709 12:14:33.975030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.850592 (+5875562us) service_pool.cc:224] Handling call
0709 12:14:41.597579 (+1746987us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:41.374720 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:41.375279 (+   559us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:41.375328 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:14:41.375347 (+    19us) tablet.cc:662] Decoding operations
0709 12:14:41.376528 (+  1181us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:41.376629 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:41.376657 (+    28us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:14:41.377741 (+  1084us) tablet.cc:701] Row locks acquired
0709 12:14:41.377775 (+    34us) write_op.cc:260] PREPARE: finished
0709 12:14:41.377943 (+   168us) write_op.cc:270] Start()
0709 12:14:41.378087 (+   144us) write_op.cc:276] Timestamp: P: 1783599281377878 usec, L: 0
0709 12:14:41.378109 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:14:41.395071 (+ 16962us) log.cc:844] Serialized 4750 byte log entry
0709 12:14:41.463342 (+ 68271us) op_driver.cc:464] REPLICATION: finished
0709 12:14:41.469484 (+  6142us) write_op.cc:301] APPLY: starting
0709 12:14:41.469591 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:41.513734 (+ 44143us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:41.513889 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:41.567407 (+ 53518us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:41.567726 (+   319us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0709 12:14:41.567786 (+    60us) write_op.cc:312] APPLY: finished
0709 12:14:41.568193 (+   407us) log.cc:844] Serialized 113 byte log entry
0709 12:14:41.568433 (+   240us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:41.568594 (+   161us) write_op.cc:454] Released schema lock
0709 12:14:41.568658 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:41.569171 (+   513us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:41.569210 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":93415,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":5789,"apply.run_cpu_time_us":19408,"apply.run_wall_time_us":99650,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54239,"num_ops":12,"prepare.queue_time_us":18353,"prepare.run_cpu_time_us":4805,"prepare.run_wall_time_us":20786,"replication_time_us":85027,"thread_start_us":21518,"threads_started":2}]]}
I20260709 12:14:41.626065 26368 catalog_manager.cc:5697] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:41.627442 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:41.630204 27133 consensus_peers.cc:597] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:41.634799 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:41.636651 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 32 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:41.637976 27165 raft_consensus.cc:1217] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [term 30 LEARNER]: Deduplicated request from leader. Original: 30.19->[30.20-30.20]   Dedup: 30.20->[]
I20260709 12:14:41.639335 26438 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:41.640261 26368 catalog_manager.cc:5697] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 28 to 29, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 29 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:41.641954  4943 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:41.644192 26438 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:41.646826  5300 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:41.647051 26368 catalog_manager.cc:5697] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 21 to 28. New cstate: current_term: 28 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:41.661056 27133 consensus_peers.cc:597] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:41.661778 27133 consensus_peers.cc:597] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:41.707643 26587 consensus_peers.cc:597] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:41.730067 26587 consensus_peers.cc:597] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:41.748559 26587 consensus_peers.cc:597] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:41.754804 26513 consensus_peers.cc:597] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:41.775624 25293 thread.cc:527] Waited for 6000ms trying to join with heartbeat (tid 26498)
W20260709 12:14:41.776402 26368 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57052 (request call id 311) took 64019 ms (client timeout 15000 ms). Trace:
W20260709 12:14:41.776974 26368 rpcz_store.cc:269] 0709 12:13:37.757231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.134580 (+8377349us) service_pool.cc:224] Handling call
0709 12:13:46.348123 (+213543us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b5400260110. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb60b2 00007f507bf2f759 00007f507bec7a76 00007f507be98d58 00007f507bf9704e 00007f507a4582a4 00007f507a458232 00007f507a458161 00007f507a4580dc
0709 12:13:46.363016 (+ 14893us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b540007d354. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076044090 00007f50760e2f3a 00007f507be98e9c 00007f507bf9704e 00007f507a4582a4 00007f507a458232 00007f507a458161 00007f507a4580dc 00007f507a457392 00007f507441548c 00007f50744148c6
0709 12:14:41.776308 (+55413292us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:41.659468 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:41.660074 (+   606us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:41.660111 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:14:41.660132 (+    21us) tablet.cc:662] Decoding operations
0709 12:14:41.660750 (+   618us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:41.660834 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:41.660863 (+    29us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:14:41.661230 (+   367us) tablet.cc:701] Row locks acquired
0709 12:14:41.661251 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:14:41.661405 (+   154us) write_op.cc:270] Start()
0709 12:14:41.661527 (+   122us) write_op.cc:276] Timestamp: P: 1783599281661352 usec, L: 0
0709 12:14:41.661553 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:14:41.662271 (+   718us) log.cc:844] Serialized 1317 byte log entry
0709 12:14:41.664160 (+  1889us) op_driver.cc:464] REPLICATION: finished
0709 12:14:41.664551 (+   391us) write_op.cc:301] APPLY: starting
0709 12:14:41.664653 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:41.666894 (+  2241us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:41.667013 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:41.669293 (+  2280us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:41.669497 (+   204us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:14:41.669558 (+    61us) write_op.cc:312] APPLY: finished
0709 12:14:41.669850 (+   292us) log.cc:844] Serialized 41 byte log entry
0709 12:14:41.683435 (+ 13585us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:41.683557 (+   122us) write_op.cc:454] Released schema lock
0709 12:14:41.683611 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:41.684071 (+   460us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:41.684104 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":106,"reported_tablets":50,"spinlock_wait_cycles":79985280,"child_traces":[["op",{"apply.queue_time_us":119,"apply.run_cpu_time_us":6141,"apply.run_wall_time_us":19472,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12528,"num_ops":3,"prepare.queue_time_us":990,"prepare.run_cpu_time_us":3166,"prepare.run_wall_time_us":3175,"replication_time_us":2456}]]}
W20260709 12:14:41.823812 26587 consensus_peers.cc:597] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:41.827124 26587 consensus_peers.cc:597] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:41.828164 27133 consensus_peers.cc:597] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:41.831115 26587 consensus_peers.cc:597] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:41.832288 26362 catalog_manager.cc:5697] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 20 to 26, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 26 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:41.838343 26362 catalog_manager.cc:5697] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 37 to 38, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 38 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:14:41.856348 26587 consensus_peers.cc:597] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:41.840279 26362 catalog_manager.cc:5697] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 32 to 35, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 35 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:41.858222 26362 catalog_manager.cc:5697] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 33 to 35. New cstate: current_term: 35 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:41.860399 26362 catalog_manager.cc:5697] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 28 to 32. New cstate: current_term: 32 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:41.861896 26362 catalog_manager.cc:5697] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 35 to 39. New cstate: current_term: 39 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:14:41.862501 26513 consensus_peers.cc:597] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:41.863737 26362 catalog_manager.cc:5697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 41 to 44, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 44 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:41.865264 26362 catalog_manager.cc:5697] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 28 to 37. New cstate: current_term: 37 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:14:41.876822 26369 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57044 (request call id 317) took 105767 ms (client timeout 15000 ms). Trace:
W20260709 12:14:41.877426 26369 rpcz_store.cc:269] 0709 12:12:56.109088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.140417 (+ 31329us) service_pool.cc:224] Handling call
0709 12:14:41.876577 (+105736160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87,"reported_tablets":51,"spinlock_wait_cycles":5888}
I20260709 12:14:41.866848 26362 catalog_manager.cc:5697] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 28 to 31, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 31 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:41.880189 26362 catalog_manager.cc:5697] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 23 to 26, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 26 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:41.881963 26362 catalog_manager.cc:5697] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 32 to 33, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 33 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:41.884528 26362 catalog_manager.cc:5697] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 32 to 34, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 34 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:41.888788 26362 catalog_manager.cc:5697] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index -1 to 20, term changed from 29 to 30, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66), NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 30 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
W20260709 12:14:41.964460 26587 consensus_peers.cc:597] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:41.985816 26587 consensus_peers.cc:597] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:42.050203 26513 consensus_peers.cc:597] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:42.058936  4943 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:42.059754  4943 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:42.062891  4943 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:42.065220  4802 raft_consensus.cc:1064] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:14:42.071943 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:42.073585 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:42.077450 26439 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:42.078321  5084 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
W20260709 12:14:42.062427 26513 consensus_peers.cc:597] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:42.085276  4802 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 30.20, Last appended by leader: 18, Current term: 30, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:42.104733 26587 consensus_peers.cc:597] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:42.106128  5402 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.106906  5402 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:42.109304  5402 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:42.111742 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:42.119642 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:42.123040  5084 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.123721  5084 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:42.125939  5084 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:42.126492 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:42.130362 26439 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:42.131863  5402 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:42.138254 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:42.151628 26439 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:42.157234  5300 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:42.159209 27165 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [term 30 LEARNER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 30 index: 20. Preceding OpId from leader: term: 30 index: 21. (index mismatch)
I20260709 12:14:42.166550 26614 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 30 index: 20. Preceding OpId from leader: term: 30 index: 21. (index mismatch)
W20260709 12:14:42.170765 26513 consensus_peers.cc:597] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:42.173460  5310 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:14:42.180310  4641 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
W20260709 12:14:42.194447 26587 consensus_peers.cc:597] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:42.206457 26513 consensus_peers.cc:597] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:42.240278 26370 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57048 (request call id 305) took 149972 ms (client timeout 15000 ms). Trace:
W20260709 12:14:42.241389 26370 rpcz_store.cc:269] 0709 12:12:12.267496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.273873 (+  6377us) service_pool.cc:224] Handling call
0709 12:14:42.240052 (+149966179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15736,"reported_tablets":51}
I20260709 12:14:42.252460  5402 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:42.253273  5402 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:42.256524 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 38 index: 26 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:42.259460 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 38 index: 26 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:42.261080 26439 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:42.255965  5402 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:42.263794  5300 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
I20260709 12:14:42.304915  5310 raft_consensus.cc:2955] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Committing config change with OpId 30.21: config changed from index 20 to 21, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:42.306015 26614 raft_consensus.cc:2955] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Committing config change with OpId 30.21: config changed from index 20 to 21, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:14:42.315824 26371 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57052 (request call id 310) took 95338 ms (client timeout 15000 ms). Trace:
W20260709 12:14:42.316426 26371 rpcz_store.cc:269] 0709 12:13:06.977693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:06.978112 (+   419us) service_pool.cc:224] Handling call
0709 12:14:42.315602 (+95337490us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151437,"reported_tablets":50,"spinlock_wait_cycles":1920}
I20260709 12:14:42.314539 26363 catalog_manager.cc:5697] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 27 to 30, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 30 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.333316 26363 catalog_manager.cc:5697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 27 to 36, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 36 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:42.336054 26363 catalog_manager.cc:5697] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 28 to 36. New cstate: current_term: 36 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
W20260709 12:14:42.338544 26513 consensus_peers.cc:597] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:42.340687 26363 catalog_manager.cc:5697] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 26 to 33, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 33 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.345458 26363 catalog_manager.cc:5697] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 29 to 34. New cstate: current_term: 34 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:42.345408 27165 raft_consensus.cc:2955] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Committing config change with OpId 30.21: config changed from index 20 to 21, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:42.358522 26363 catalog_manager.cc:5697] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 31 to 33. New cstate: current_term: 33 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:42.370054 26363 catalog_manager.cc:5697] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 27 to 31, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 31 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.376051 26363 catalog_manager.cc:5697] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 27 to 32. New cstate: current_term: 32 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:42.378659 26363 catalog_manager.cc:5697] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 25 to 33. New cstate: current_term: 33 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:42.381364 26363 catalog_manager.cc:5697] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b reported cstate change: term changed from 28 to 36, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 36 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:42.442876 26371 catalog_manager.cc:5697] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 20 to 21, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 30 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:42.513690  5402 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.514497  5402 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:42.516824 26513 consensus_peers.cc:597] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:42.517220  5402 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:42.516530 26365 catalog_manager.cc:5697] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 29 to 38, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 38 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.519416 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:42.519170 26365 catalog_manager.cc:5697] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 27 to 29, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 29 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:42.521705 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:42.523491 26363 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57044 (request call id 321) took 10244 ms. Trace:
I20260709 12:14:42.523865 26439 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:42.526338  5300 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:42.526049 26365 catalog_manager.cc:5697] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 28 to 33. New cstate: current_term: 33 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:42.523955 26363 rpcz_store.cc:276] 0709 12:14:32.278995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:37.628583 (+5349588us) service_pool.cc:224] Handling call
0709 12:14:42.523395 (+4894812us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:42.387857 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:42.388403 (+   546us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:42.388438 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:14:42.388450 (+    12us) tablet.cc:662] Decoding operations
0709 12:14:42.389425 (+   975us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:42.389481 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:42.389509 (+    28us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:14:42.390264 (+   755us) tablet.cc:701] Row locks acquired
0709 12:14:42.390279 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:14:42.390469 (+   190us) write_op.cc:270] Start()
0709 12:14:42.390603 (+   134us) write_op.cc:276] Timestamp: P: 1783599282390416 usec, L: 0
0709 12:14:42.390629 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:14:42.391315 (+   686us) log.cc:844] Serialized 4030 byte log entry
0709 12:14:42.405019 (+ 13704us) op_driver.cc:464] REPLICATION: finished
0709 12:14:42.405409 (+   390us) write_op.cc:301] APPLY: starting
0709 12:14:42.405514 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:42.411128 (+  5614us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:42.411232 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:42.425358 (+ 14126us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:42.425645 (+   287us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 12:14:42.425710 (+    65us) write_op.cc:312] APPLY: finished
0709 12:14:42.426082 (+   372us) log.cc:844] Serialized 97 byte log entry
0709 12:14:42.427100 (+  1018us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:42.427263 (+   163us) write_op.cc:454] Released schema lock
0709 12:14:42.427324 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:42.459089 (+ 31765us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:42.459129 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23193,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":136,"apply.run_cpu_time_us":14657,"apply.run_wall_time_us":22317,"cfile_cache_hit":40,"cfile_cache_hit_bytes":41760,"num_ops":10,"prepare.queue_time_us":166,"prepare.run_cpu_time_us":3754,"prepare.run_wall_time_us":5828,"replication_time_us":14208}]]}
W20260709 12:14:42.540850 26513 consensus_peers.cc:597] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:42.551981 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:42.555585 25293 tablet_replica.cc:333] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:42.557770 25293 raft_consensus.cc:2243] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:42.558583 25293 raft_consensus.cc:2272] T f90484c8608940e99361799cdda3a0f7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:42.562131 25293 tablet_replica.cc:333] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:42.583801 25293 raft_consensus.cc:2243] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:14:42.591825 25293 raft_consensus.cc:2272] T 02fc28e9bbd743569e5c7c101c4688fb P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:42.595206 25293 tablet_replica.cc:333] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:42.608539 25293 raft_consensus.cc:2243] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:42.619349  5084 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.619666 25293 raft_consensus.cc:2272] T 69e1490de99a4232a6717e72242a0f00 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:42.620046  5084 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:42.624151  5084 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:42.625000  5402 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:42.625715  5402 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:42.628556  5402 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:42.629592 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:42.633543 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:42.636986 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 36 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:42.648751 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:42.651314 25293 tablet_replica.cc:333] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:42.652799 25293 raft_consensus.cc:2243] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:42.653776 25293 raft_consensus.cc:2272] T 12729361d003466aada20ab37328d285 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:42.655151 26587 consensus_peers.cc:597] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:42.658104 26439 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:42.659574  5084 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
I20260709 12:14:42.663162 25293 tablet_replica.cc:333] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:42.665047 26439 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:42.671144  5402 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:14:42.669314 26587 consensus_peers.cc:597] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:42.676966 25293 raft_consensus.cc:2243] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:42.683107 25293 raft_consensus.cc:2272] T d2e173b367e6460b8f654b2de1aabfae P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:42.685035  5402 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:42.685737  5402 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:42.689996  5402 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:42.691980 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:42.698676 25293 tablet_replica.cc:333] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:42.700294 25293 raft_consensus.cc:2243] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:42.705503 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:42.714632 25293 raft_consensus.cc:2272] T 953d8c981a6c459f8b7f3dbbb66fda45 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:42.720532 26513 consensus_peers.cc:597] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:42.721154 25293 tablet_replica.cc:333] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:42.722537 25293 raft_consensus.cc:2243] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:42.723800 26367 catalog_manager.cc:5697] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 25 to 28. New cstate: current_term: 28 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.739809 25293 raft_consensus.cc:2272] T 8036dd24c55a4bc18661cc64c049a704 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:42.726116 26439 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:42.749073 25293 tablet_replica.cc:333] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:42.750257 25293 raft_consensus.cc:2243] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:42.772118  5084 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:42.775297 25293 raft_consensus.cc:2272] T 9275c8cfbe54472fba36a4ef3bf770f7 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:42.783414 26587 consensus_peers.cc:597] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:42.783741 25293 tablet_replica.cc:333] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:42.792441 25293 raft_consensus.cc:2243] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 39 LEADER]: Raft consensus shutting down.
I20260709 12:14:42.812705 25293 raft_consensus.cc:2272] T 5cba10e68f094822a7c267bdbd205a17 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:42.809795 26513 consensus_peers.cc:597] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:42.793154 26365 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57048 (request call id 311) took 10222 ms. Trace:
W20260709 12:14:42.818737 27133 consensus_peers.cc:597] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:42.818209  5084 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.819753  5084 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:42.825356 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 35 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:42.818672 26365 rpcz_store.cc:276] 0709 12:14:32.571198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.098507 (+6527309us) service_pool.cc:224] Handling call
0709 12:14:42.793068 (+3694561us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:42.574490 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:42.575029 (+   539us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:42.575072 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:14:42.575085 (+    13us) tablet.cc:662] Decoding operations
0709 12:14:42.575687 (+   602us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:42.575745 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:42.575770 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:14:42.576111 (+   341us) tablet.cc:701] Row locks acquired
0709 12:14:42.576124 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:14:42.576278 (+   154us) write_op.cc:270] Start()
0709 12:14:42.576382 (+   104us) write_op.cc:276] Timestamp: P: 1783599282576225 usec, L: 0
0709 12:14:42.576396 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 12:14:42.577057 (+   661us) log.cc:844] Serialized 1313 byte log entry
0709 12:14:42.579744 (+  2687us) op_driver.cc:464] REPLICATION: finished
0709 12:14:42.581208 (+  1464us) write_op.cc:301] APPLY: starting
0709 12:14:42.581316 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:42.583649 (+  2333us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:42.583782 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:42.585800 (+  2018us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:42.586000 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:14:42.586051 (+    51us) write_op.cc:312] APPLY: finished
0709 12:14:42.586317 (+   266us) log.cc:844] Serialized 41 byte log entry
0709 12:14:42.587880 (+  1563us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:42.587986 (+   106us) write_op.cc:454] Released schema lock
0709 12:14:42.588029 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:42.590096 (+  2067us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:42.590144 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15704,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":1196,"apply.run_cpu_time_us":5913,"apply.run_wall_time_us":8866,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12528,"num_ops":3,"prepare.queue_time_us":11497,"prepare.run_cpu_time_us":2896,"prepare.run_wall_time_us":2896,"replication_time_us":3205}]]}
I20260709 12:14:42.826762  5084 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:42.828140 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 38 candidate_status { last_received { term: 35 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:42.856597 26364 catalog_manager.cc:5697] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 35 to 36, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 36 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:42.858261 25293 tablet_replica.cc:333] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:42.859462 25293 raft_consensus.cc:2243] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:42.858805 26364 catalog_manager.cc:5697] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 33 to 34, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 34 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:42.860262 25293 raft_consensus.cc:2272] T 724bc8274ed84709a5b83825934b7f03 P 01a57027214a411e80874ac7febd628b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:42.861400 26364 catalog_manager.cc:5697] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 36 to 39, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 39 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:42.863622 26439 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:42.863358 26364 catalog_manager.cc:5697] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 29 to 37. New cstate: current_term: 37 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:42.865582  5084 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
I20260709 12:14:42.886338 25293 tablet_replica.cc:333] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:42.887796 25293 raft_consensus.cc:2243] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:42.887269 26364 catalog_manager.cc:5697] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 30 to 32. New cstate: current_term: 32 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:42.889286 26364 catalog_manager.cc:5697] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 28 to 34. New cstate: current_term: 34 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:42.891328 25293 raft_consensus.cc:2272] T 3288c98248464af5b8f3227349002ec7 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:42.896536 26364 catalog_manager.cc:5697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 26 to 35, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 35 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:42.899093 26364 catalog_manager.cc:5697] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 30 to 32, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 32 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:42.905062 25293 tablet_replica.cc:333] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:42.909396 26364 catalog_manager.cc:5697] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 31 to 33. New cstate: current_term: 33 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:42.906170 25293 raft_consensus.cc:2243] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:42.911187 25293 pending_rounds.cc:70] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Trying to abort 2 pending ops.
I20260709 12:14:42.911235 26364 catalog_manager.cc:5697] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 28 to 40, leader changed from aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 40 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:42.911635 25293 pending_rounds.cc:77] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Aborting op as it isn't in flight: id { term: 36 index: 19 } timestamp: 7305622589758566400 op_type: NO_OP noop_request { }
I20260709 12:14:42.915966 25293 raft_consensus.cc:2889] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:42.916435 25293 pending_rounds.cc:77] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b: Aborting op as it isn't in flight: id { term: 34 index: 18 } timestamp: 7305622552807677952 op_type: NO_OP noop_request { }
I20260709 12:14:42.916786 25293 raft_consensus.cc:2889] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:42.917872 25293 raft_consensus.cc:2272] T 67d6a6aed08548acab4272e6f5f1480a P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:42.923148 26367 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57048 (request call id 310) took 37075 ms (client timeout 15000 ms). Trace:
I20260709 12:14:42.924476 25293 tablet_replica.cc:333] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:42.917415 26364 catalog_manager.cc:5697] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 36 to 38. New cstate: current_term: 38 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:42.925532 25293 raft_consensus.cc:2243] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Raft consensus shutting down.
I20260709 12:14:42.925467 26364 catalog_manager.cc:5697] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 27 to 36, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 36 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:42.929491 25293 raft_consensus.cc:2272] T d6e6ed3d8ee44750a4d06294867e92bc P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:42.924408 26367 rpcz_store.cc:269] 0709 12:14:05.847948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.519941 (+14671993us) service_pool.cc:224] Handling call
0709 12:14:42.923040 (+22403099us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:42.754710 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:42.755283 (+   573us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:42.755319 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:14:42.755337 (+    18us) tablet.cc:662] Decoding operations
0709 12:14:42.755736 (+   399us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:42.755805 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:42.755831 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:14:42.756090 (+   259us) tablet.cc:701] Row locks acquired
0709 12:14:42.756118 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:14:42.756338 (+   220us) write_op.cc:270] Start()
0709 12:14:42.756468 (+   130us) write_op.cc:276] Timestamp: P: 1783599282756281 usec, L: 0
0709 12:14:42.756493 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:14:42.757146 (+   653us) log.cc:844] Serialized 541 byte log entry
0709 12:14:42.759018 (+  1872us) op_driver.cc:464] REPLICATION: finished
0709 12:14:42.759420 (+   402us) write_op.cc:301] APPLY: starting
0709 12:14:42.759502 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:42.760391 (+   889us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:42.760484 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:42.761174 (+   690us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:42.761326 (+   152us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:14:42.761367 (+    41us) write_op.cc:312] APPLY: finished
0709 12:14:42.761550 (+   183us) log.cc:844] Serialized 25 byte log entry
0709 12:14:42.761708 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:42.761807 (+    99us) write_op.cc:454] Released schema lock
0709 12:14:42.761845 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:42.762213 (+   368us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:42.762243 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":47575,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":226,"apply.run_cpu_time_us":2746,"apply.run_wall_time_us":2746,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4176,"num_ops":1,"prepare.queue_time_us":4101,"prepare.run_cpu_time_us":2770,"prepare.run_wall_time_us":2770,"replication_time_us":2404}]]}
I20260709 12:14:42.932832 26364 catalog_manager.cc:5697] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 29 to 31. New cstate: current_term: 31 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:42.945684 26364 catalog_manager.cc:5697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 32 to 34, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 34 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:42.947394 26364 catalog_manager.cc:5697] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 30 to 32, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 32 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:42.932817 25293 tablet_replica.cc:333] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:42.954332 25293 raft_consensus.cc:2243] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:42.952152 26364 catalog_manager.cc:5697] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 33 to 35. New cstate: current_term: 35 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:42.956192 25293 raft_consensus.cc:2272] T d1ee0545deb746aeb5c1c14751b96826 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:42.967615 25293 tablet_replica.cc:333] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:42.968915 25293 raft_consensus.cc:2243] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:42.969625 25293 pending_rounds.cc:70] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Trying to abort 1 pending ops.
I20260709 12:14:42.969884 25293 pending_rounds.cc:77] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b: Aborting op as it isn't in flight: id { term: 35 index: 24 } timestamp: 7305622611174203392 op_type: NO_OP noop_request { }
I20260709 12:14:42.970237 25293 raft_consensus.cc:2889] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:42.970611 25293 raft_consensus.cc:2272] T 3ce8bbdf417f47e7aabb967886d8c95a P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:42.976660 25293 tablet_replica.cc:333] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:42.977636 25293 raft_consensus.cc:2243] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:42.978688 25293 raft_consensus.cc:2272] T 3d83c4273cd74e768f756e0c8ba65432 P 01a57027214a411e80874ac7febd628b [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:42.982016 25293 tablet_replica.cc:333] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:42.956001 26364 catalog_manager.cc:5697] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 37 to 39. New cstate: current_term: 39 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:42.995206 25293 raft_consensus.cc:2243] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:42.996138 25293 raft_consensus.cc:2272] T c22baf3ebbed46a6a23a4c6cfd24710b P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:42.999389 25293 tablet_replica.cc:333] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.000524 25293 raft_consensus.cc:2243] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.001394 25293 raft_consensus.cc:2272] T ceda449be0d044e0b465f42ed3047751 P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.004518 25293 tablet_replica.cc:333] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.005405 25293 raft_consensus.cc:2243] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 34 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.015101 25293 raft_consensus.cc:2272] T 75c9184ee6b7472fb72209c9dfd651b6 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:43.023056 26513 consensus_peers.cc:597] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:43.025102  5084 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.025731  5084 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:43.032229  5084 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:43.032895 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:43.033764 25293 tablet_replica.cc:333] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.034322 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 34 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:43.034832 25293 raft_consensus.cc:2243] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.035514 25293 pending_rounds.cc:70] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Trying to abort 1 pending ops.
I20260709 12:14:43.035785 25293 pending_rounds.cc:77] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: Aborting op as it isn't in flight: id { term: 31 index: 17 } timestamp: 7305622625278734336 op_type: NO_OP noop_request { }
I20260709 12:14:43.036170 25293 raft_consensus.cc:2889] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:43.036537 25293 raft_consensus.cc:2272] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.037289 26438 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:43.038075 26438 raft_consensus.cc:2686] T b9bd8978cfc74b93bcc4755ec8254fa7 P 01a57027214a411e80874ac7febd628b: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:14:43.064072 25293 tablet_replica.cc:333] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.072153  5402 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.072800  5402 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:43.075245  5402 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:43.071336 25293 raft_consensus.cc:2243] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.082939 25293 raft_consensus.cc:2272] T 5c23e0d03a4d457fa50856e09fe2f649 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.083308 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:43.088900 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 35 candidate_status { last_received { term: 33 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:43.108137 26438 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:43.111150  4943 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:43.110333 25293 tablet_replica.cc:333] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.114713 25293 raft_consensus.cc:2243] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.126608 25293 pending_rounds.cc:70] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Trying to abort 1 pending ops.
I20260709 12:14:43.127033 25293 pending_rounds.cc:77] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b: Aborting op as it isn't in flight: id { term: 33 index: 21 } timestamp: 7305622592164511744 op_type: NO_OP noop_request { }
I20260709 12:14:43.127467 25293 raft_consensus.cc:2889] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:43.127885 25293 raft_consensus.cc:2272] T 5fceaa32ed834cedaeb85b54a55fc4ed P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.158448 25293 tablet_replica.cc:333] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.159852 25293 raft_consensus.cc:2243] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.161258 25293 raft_consensus.cc:2272] T fce5ecc0a3714c80861557f318edce9d P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:43.170080 26587 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 342 similar messages]
I20260709 12:14:43.171844  4943 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.172463  4943 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:43.180794 25293 tablet_replica.cc:333] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.181011 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 40 candidate_status { last_received { term: 37 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:43.186594 26364 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57052 (request call id 314) took 1857 ms. Trace:
I20260709 12:14:43.187134 26364 rpcz_store.cc:276] 0709 12:14:41.329494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.329720 (+   226us) service_pool.cc:224] Handling call
0709 12:14:43.186529 (+1856809us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:43.036015 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:43.036564 (+   549us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:43.036597 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:14:43.036615 (+    18us) tablet.cc:662] Decoding operations
0709 12:14:43.038148 (+  1533us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:43.038213 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:43.038248 (+    35us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:14:43.039583 (+  1335us) tablet.cc:701] Row locks acquired
0709 12:14:43.039604 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:14:43.039755 (+   151us) write_op.cc:270] Start()
0709 12:14:43.039895 (+   140us) write_op.cc:276] Timestamp: P: 1783599283039704 usec, L: 0
0709 12:14:43.039919 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:14:43.040653 (+   734us) log.cc:844] Serialized 6750 byte log entry
0709 12:14:43.044748 (+  4095us) op_driver.cc:464] REPLICATION: finished
0709 12:14:43.045984 (+  1236us) write_op.cc:301] APPLY: starting
0709 12:14:43.046069 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:43.053816 (+  7747us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:43.053918 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:43.090694 (+ 36776us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:43.090959 (+   265us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 12:14:43.091002 (+    43us) write_op.cc:312] APPLY: finished
0709 12:14:43.091356 (+   354us) log.cc:844] Serialized 156 byte log entry
0709 12:14:43.092345 (+   989us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:43.092531 (+   186us) write_op.cc:454] Released schema lock
0709 12:14:43.092584 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:43.096543 (+  3959us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:43.096579 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":29674,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":972,"apply.run_cpu_time_us":20290,"apply.run_wall_time_us":50521,"cfile_cache_hit":68,"cfile_cache_hit_bytes":70992,"num_ops":17,"prepare.queue_time_us":1306,"prepare.run_cpu_time_us":4982,"prepare.run_wall_time_us":8338,"replication_time_us":4701}]]}
I20260709 12:14:43.192368  4943 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:43.201177 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 40 candidate_status { last_received { term: 37 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:43.206463 26439 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:43.207608  5084 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
I20260709 12:14:43.215940 25293 raft_consensus.cc:2243] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 34 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.220029 25293 raft_consensus.cc:2272] T 799bbccef316451b8fb8dbd051728db0 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.232791 25293 tablet_replica.cc:333] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.233832 25293 raft_consensus.cc:2243] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:43.253715 27133 consensus_peers.cc:597] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:43.244529 26365 catalog_manager.cc:5697] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 30 to 33, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 01a57027214a411e80874ac7febd628b (127.24.179.65). New cstate: current_term: 33 leader_uuid: "01a57027214a411e80874ac7febd628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } }
I20260709 12:14:43.258575 25293 raft_consensus.cc:2272] T 6d235a62666644668508e208ad8d21d3 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.262365 25293 tablet_replica.cc:333] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.263546 25293 raft_consensus.cc:2243] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.264995 25293 raft_consensus.cc:2272] T 0e9f2c921ba4426a8185f516aa2d8deb P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.268447 25293 tablet_replica.cc:333] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.269680 25293 raft_consensus.cc:2243] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.270422 25293 raft_consensus.cc:2272] T 54a09e3d025e44058af04b7f7fff12f3 P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.273877 25293 tablet_replica.cc:333] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.274951 25293 raft_consensus.cc:2243] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 35 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.278995 25293 raft_consensus.cc:2272] T 01f2ec42332f4afd97d2dbfac0d5ee00 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.282992 25293 tablet_replica.cc:333] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.284107 25293 raft_consensus.cc:2243] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.284883 25293 raft_consensus.cc:2272] T 68aec546ef604f45adc4b6dedb13e41f P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.289007 25293 tablet_replica.cc:333] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.290221 25293 raft_consensus.cc:2243] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.291235 25293 raft_consensus.cc:2272] T 63a71194fb3446e6b7b3135fde882816 P 01a57027214a411e80874ac7febd628b [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.326221 25293 tablet_replica.cc:333] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.327178 25293 raft_consensus.cc:2243] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.327899 25293 raft_consensus.cc:2272] T fc3ac2eaa71249dc96238b05adbd6b9b P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.331147 25293 tablet_replica.cc:333] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.332007 25293 raft_consensus.cc:2243] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 34 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.333266 25293 raft_consensus.cc:2272] T 14b3fc9b208642ffb7dbc462c4032c67 P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.336016  4943 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.336545  4943 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:43.338734  4943 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:43.341470 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:43.342113 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "01a57027214a411e80874ac7febd628b" candidate_term: 39 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:43.343988 26438 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01a57027214a411e80874ac7febd628b; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:43.344914  4943 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
I20260709 12:14:43.368539 25293 tablet_replica.cc:333] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.369518 25293 raft_consensus.cc:2243] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.370316 25293 raft_consensus.cc:2272] T 366874f8c4424fa2a9f169e9c3d6e97e P 01a57027214a411e80874ac7febd628b [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.373605 25293 tablet_replica.cc:333] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.366684 26543 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 30.21, Last appended by leader: 18, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:43.382514 25293 raft_consensus.cc:2243] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.383365 25293 pending_rounds.cc:70] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Trying to abort 2 pending ops.
I20260709 12:14:43.383622 25293 pending_rounds.cc:77] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Aborting op as it isn't in flight: id { term: 36 index: 22 } timestamp: 7305622569052516352 op_type: NO_OP noop_request { }
I20260709 12:14:43.384024 25293 raft_consensus.cc:2889] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:43.384338 25293 pending_rounds.cc:77] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b: Aborting op as it isn't in flight: id { term: 35 index: 21 } timestamp: 7305622548138508288 op_type: NO_OP noop_request { }
I20260709 12:14:43.384685 25293 raft_consensus.cc:2889] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:43.385017 25293 raft_consensus.cc:2272] T 78002f4d800445a3befddbc1cce2750d P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.387940 25293 tablet_replica.cc:333] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.389040 25293 raft_consensus.cc:2243] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 39 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.406492 25293 raft_consensus.cc:2272] T ea50d3c1de374dff938c733fb02faf8c P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.410845 25293 tablet_replica.cc:333] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.411823 25293 raft_consensus.cc:2243] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 36 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.413154 25293 raft_consensus.cc:2272] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 01a57027214a411e80874ac7febd628b [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.420226 27165 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 30 index: 21. Preceding OpId from leader: term: 30 index: 22. (index mismatch)
I20260709 12:14:43.422714 26616 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 30 index: 21. Preceding OpId from leader: term: 30 index: 22. (index mismatch)
I20260709 12:14:43.428547  5425 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
I20260709 12:14:43.432294 25293 tablet_replica.cc:333] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.432041  5423 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
I20260709 12:14:43.433298 25293 raft_consensus.cc:2243] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.434248 25293 raft_consensus.cc:2272] T 86001e7eca0b4ca4aed965b7d7e5820c P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.437325 25293 tablet_replica.cc:333] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.451115 25293 raft_consensus.cc:2243] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 35 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.452450 25293 raft_consensus.cc:2272] T ffdceca3c04a40cdba75f01fa9ded9f8 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.455684 25293 tablet_replica.cc:333] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.456583 25293 raft_consensus.cc:2243] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 44 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.463135  5425 raft_consensus.cc:2955] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Committing config change with OpId 30.22: config changed from index 21 to 22, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:43.474805 25293 raft_consensus.cc:2272] T 541724f47bb04d5185dd369750546cbf P 01a57027214a411e80874ac7febd628b [term 44 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.478345 25293 tablet_replica.cc:333] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.479266 25293 raft_consensus.cc:2243] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.480029 25293 raft_consensus.cc:2272] T ad6ce9ef10d748ecbe957fb8e6de47b0 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:43.502537 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 47372.2us
I20260709 12:14:43.505357 25293 tablet_replica.cc:333] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.506300 25293 raft_consensus.cc:2243] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 35 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.515018 25293 raft_consensus.cc:2272] T de4e2c4be7474864b847ef2e617f6f49 P 01a57027214a411e80874ac7febd628b [term 35 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.515774 27165 raft_consensus.cc:2955] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Committing config change with OpId 30.22: config changed from index 21 to 22, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:43.518298 25293 tablet_replica.cc:333] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.519239 25293 raft_consensus.cc:2243] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.526892 25293 raft_consensus.cc:2272] T f9abba0c7cca40c4b2a9ffbcde803684 P 01a57027214a411e80874ac7febd628b [term 37 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.535420 25293 tablet_replica.cc:333] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.536258 25293 raft_consensus.cc:2243] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.536990 25293 pending_rounds.cc:70] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Trying to abort 1 pending ops.
I20260709 12:14:43.537247 25293 pending_rounds.cc:77] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b: Aborting op as it isn't in flight: id { term: 37 index: 19 } timestamp: 7305622564067360768 op_type: NO_OP noop_request { }
I20260709 12:14:43.537659 25293 raft_consensus.cc:2889] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:43.538050 25293 raft_consensus.cc:2272] T 7c931e3af68c4073a5ed978eb0f43f3f P 01a57027214a411e80874ac7febd628b [term 39 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.558728 25293 tablet_replica.cc:333] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.559723 25293 raft_consensus.cc:2243] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.560324 25293 pending_rounds.cc:70] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Trying to abort 1 pending ops.
I20260709 12:14:43.560567 25293 pending_rounds.cc:77] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b: Aborting op as it isn't in flight: id { term: 36 index: 23 } timestamp: 7305622593023004672 op_type: NO_OP noop_request { }
I20260709 12:14:43.560942 25293 raft_consensus.cc:2889] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:43.561314 25293 raft_consensus.cc:2272] T f6ba7060b20a4d598344385607b29c70 P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.564500 25293 tablet_replica.cc:333] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.565397 25293 raft_consensus.cc:2243] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 40 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.573774 26616 raft_consensus.cc:2955] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Committing config change with OpId 30.22: config changed from index 21 to 22, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:43.577965 26365 catalog_manager.cc:5697] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 21 to 22, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New cstate: current_term: 30 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:43.566314 25293 raft_consensus.cc:2272] T 2251a6321412417a8079201067ae2d0d P 01a57027214a411e80874ac7febd628b [term 40 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.585681 25293 tablet_replica.cc:333] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.586661 25293 raft_consensus.cc:2243] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.587502 25293 raft_consensus.cc:2272] T cff430729a9d4c8183d8ddad129d6ecf P 01a57027214a411e80874ac7febd628b [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.607122 25293 tablet_replica.cc:333] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.615123 25293 raft_consensus.cc:2243] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 38 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.616670 25293 raft_consensus.cc:2272] T 94f480c16e1e4f31abd8773ea56f244b P 01a57027214a411e80874ac7febd628b [term 38 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.623013  4289 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:43.624082 25293 tablet_replica.cc:333] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.623755  4289 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:43.630833  4289 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:43.633759 25293 raft_consensus.cc:2243] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:43.634147 26587 leader_election.cc:336] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:43.635838 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:43.637914 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:43.638638 25293 raft_consensus.cc:2272] T 012eaf6f22154b85929ab516a788db5f P 01a57027214a411e80874ac7febd628b [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.639981  5422 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:43.646328 25293 tablet_replica.cc:333] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.647367 25293 raft_consensus.cc:2243] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 33 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.663204 25293 raft_consensus.cc:2272] T c4646c5ce9a9467da50e9f3587b11ad5 P 01a57027214a411e80874ac7febd628b [term 33 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:43.664811 27133 consensus_peers.cc:597] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:43.672493 25293 tablet_replica.cc:333] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.679136 25293 raft_consensus.cc:2243] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.679904 25293 raft_consensus.cc:2272] T 2c246551966f4307a9c8a66e2f024385 P 01a57027214a411e80874ac7febd628b [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.683497 25293 tablet_replica.cc:333] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b: stopping tablet replica
I20260709 12:14:43.684255 25293 raft_consensus.cc:2243] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.684924 25293 raft_consensus.cc:2272] T 78bbb48570954bf4ad1039abff47c036 P 01a57027214a411e80874ac7febd628b [term 32 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:43.693674 27133 consensus_peers.cc:597] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:43.719986 26357 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cff430729a9d4c8183d8ddad129d6ecf with cas_config_opid_index 21: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:14:43.800311 26357 catalog_manager.cc:4755] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cff430729a9d4c8183d8ddad129d6ecf: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 12:14:43.852432 26587 consensus_peers.cc:597] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:43.958745 27133 consensus_peers.cc:597] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:43.985895  5429 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:43.986682  5429 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:43.998745 26513 leader_election.cc:336] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.001030  5429 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:44.002348 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 39 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:44.003973 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:44.005872  5429 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
I20260709 12:14:44.014843  5429 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.020067  5429 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.022500  5429 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:44.023634 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:44.024400 26616 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 30.
I20260709 12:14:44.026997 26514 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:44.028788  5310 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:44.029294  5310 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.029722  5310 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:14:44.033047 26513 leader_election.cc:336] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:44.050134 26587 consensus_peers.cc:597] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:44.071632 26587 consensus_peers.cc:597] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:44.077144  5310 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.080845 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:44.081534 26616 raft_consensus.cc:3060] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:14:44.082479 27133 consensus_peers.cc:597] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:44.084293  5310 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:44.089320 26616 raft_consensus.cc:2468] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 31.
W20260709 12:14:44.090306 26513 leader_election.cc:336] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.092106 26514 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:44.093747  5429 raft_consensus.cc:2804] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:14:44.094589  5429 raft_consensus.cc:697] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 31 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:44.096081  5429 consensus_queue.cc:237] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 30.18, Last appended by leader: 18, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.136713 26364 catalog_manager.cc:5697] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 30 to 31, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 31 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:44.149865 27133 consensus_peers.cc:597] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:44.187458 26587 consensus_peers.cc:597] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:44.188673  5434 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.189332  5434 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.192227  5434 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:44.194615 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:44.201850 26587 leader_election.cc:336] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.203430 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:44.206650  5434 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:44.211424  5434 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.212080  5434 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.214509  5434 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:44.215195 26587 consensus_peers.cc:597] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:44.221742 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 40 candidate_status { last_received { term: 39 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:44.222584 26547 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 39.
I20260709 12:14:44.225265 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:44.227672  5434 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Leader pre-election won for term 40
I20260709 12:14:44.228209  5434 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.228647  5434 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Advancing to term 40
W20260709 12:14:44.238301 26587 leader_election.cc:336] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 40 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:44.249683 26587 consensus_peers.cc:597] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:44.252147 26587 consensus_peers.cc:597] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:44.254803  5434 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:44.284729 26513 consensus_peers.cc:597] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:44.285925  5434 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 40 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:44.287632  5429 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.288228  5422 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.288794  5422 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:44.290777  5433 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.291316  5433 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:44.293510  5433 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:44.295475  5438 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.288234  5429 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.295382 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:44.297223  5421 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.296170  5438 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.297741  5421 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:44.299914  5421 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:44.302919 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:44.304348 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:44.305030 26614 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 34.
I20260709 12:14:44.305305  5438 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:44.307987 26513 leader_election.cc:336] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.308516 26513 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:44.309762  5438 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:44.310128 27134 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
W20260709 12:14:44.311116 27133 leader_election.cc:336] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.312880  5422 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:44.314615 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:44.315290 27161 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:14:44.317008 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:44.317684 26614 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 33.
I20260709 12:14:44.318934 26514 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:44.319459 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:44.320132  5425 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:44.320571  5425 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.320919  5425 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:14:44.324425 26513 leader_election.cc:336] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.326589  5433 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:44.327059  5433 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.327450  5433 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:44.340945 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 40 candidate_status { last_received { term: 39 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:44.341881 26547 raft_consensus.cc:3060] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Advancing to term 40
I20260709 12:14:44.333279  5429 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:44.340025  5421 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:44.345578  5421 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.346112  5421 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:44.370644  5433 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:44.371616 27133 consensus_peers.cc:597] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:44.358914  5425 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.380112 26547 raft_consensus.cc:2468] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 40 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 40.
I20260709 12:14:44.381728 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:44.379793  5433 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:44.383740 26587 leader_election.cc:336] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.384258 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:44.387862  5055 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:14:44.388006 26587 leader_election.cc:336] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.379459  5421 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:44.389070 26587 leader_election.cc:336] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 40 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.389593 27161 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 35: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:44.393474  5425 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:44.394637 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:44.395320 26616 raft_consensus.cc:3060] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:14:44.399693 27133 leader_election.cc:336] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.400671  5421 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:44.403420 26513 leader_election.cc:336] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.408377 26587 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 40 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:44.405290 26616 raft_consensus.cc:2468] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 34.
I20260709 12:14:44.405414 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:44.410048 26614 raft_consensus.cc:2393] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 35: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:44.411335 26514 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:44.412223 27134 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 35 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:44.405812  5425 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.406592  5444 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.413509  5310 raft_consensus.cc:2804] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:14:44.413674  5444 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.413620  5425 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.414223  5310 raft_consensus.cc:697] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 34 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:44.413702  5420 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader election lost for term 35. Reason: could not achieve majority
I20260709 12:14:44.409269  5433 raft_consensus.cc:2804] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Leader election won for term 40
I20260709 12:14:44.416172  5444 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:44.415499  5310 consensus_queue.cc:237] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 33.21, Last appended by leader: 21, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.416937  5425 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:44.422506 26513 consensus_peers.cc:597] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:44.423137 26513 leader_election.cc:336] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.425441 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:44.427222 26514 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:44.428917  5443 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
W20260709 12:14:44.431572 26587 consensus_peers.cc:597] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:44.433756  5433 raft_consensus.cc:697] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 40 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:44.436493  5433 consensus_queue.cc:237] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 39.19, Last appended by leader: 19, Current term: 40, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.441598 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:44.444267 26587 consensus_peers.cc:597] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:44.444818 26587 leader_election.cc:336] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.445207 26587 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:44.446607  5422 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election lost for term 35. Reason: could not achieve majority
I20260709 12:14:44.455814 26364 catalog_manager.cc:5697] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 33 to 34, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 34 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:44.466812  5420 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:14:44.467141 26587 leader_election.cc:336] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.467659 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:44.467504  5420 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:44.470224  5420 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:44.471282 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:44.472016 26616 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 26.
I20260709 12:14:44.473893 27134 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:44.474895  5420 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:14:44.475476  5422 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:44.476620  5422 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.477190  5422 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.479346  5422 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:44.479930  5310 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.480527  5310 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:44.484969 26513 consensus_peers.cc:597] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.489845  5310 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:44.475422  5420 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.491823  5420 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:44.491066 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:44.495136 26547 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:14:44.501566 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:44.502338 27133 leader_election.cc:336] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.504705  5422 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:44.507817  5422 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.508390  5422 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:44.508169 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:44.510236  5444 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:14:44.501920 26513 leader_election.cc:336] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.511261  5444 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.513737  5444 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:44.517733 26613 raft_consensus.cc:1275] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 30 index: 18. Preceding OpId from leader: term: 31 index: 19. (index mismatch)
I20260709 12:14:44.521798  5443 consensus_queue.cc:1048] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 12:14:44.550822 26587 leader_election.cc:336] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.550845 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:44.553959  5434 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.554755  5434 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.562378  5310 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.562510  5420 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:44.563259  5310 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.565164  5420 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:44.566424 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:44.567052 26613 raft_consensus.cc:3060] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:14:44.572579 27133 leader_election.cc:336] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.581135 26613 raft_consensus.cc:2468] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 27.
I20260709 12:14:44.582583 27134 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:44.583841  5434 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:44.584373  5421 raft_consensus.cc:2804] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:14:44.584967  5421 raft_consensus.cc:697] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:44.580839  5310 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:44.585580 26513 leader_election.cc:336] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.586100 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 39 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:44.587615 26514 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:44.588769  5310 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
I20260709 12:14:44.585927  5421 consensus_queue.cc:237] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:44.594448 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:44.595175 26543 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 33.
I20260709 12:14:44.594332 26364 catalog_manager.cc:5697] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 39 to 40, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 40 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:44.600648 26587 leader_election.cc:336] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.601363 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:44.602478  5433 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:44.565366  5422 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.608835 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
W20260709 12:14:44.624001 26587 consensus_peers.cc:597] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:44.624601 26587 consensus_peers.cc:597] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:44.625108 26587 leader_election.cc:336] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.624135 26616 raft_consensus.cc:2393] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 35: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:44.629627 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:44.631501 26543 raft_consensus.cc:3060] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:44.628389  5433 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:44.632776  5433 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.624298  5422 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:44.633198  5433 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:44.628572  5444 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.634299 26514 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:44.635056  5444 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:44.640403 26587 consensus_peers.cc:597] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:44.637966  5444 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:44.644963 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:44.645231 26513 consensus_peers.cc:597] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:44.645680 26547 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:14:44.645768  5425 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.646437  5425 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:44.647578 26587 leader_election.cc:336] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.651394 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:44.654167  5444 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:44.652658  5425 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:44.654699 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 39 candidate_status { last_received { term: 38 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:44.655779  5434 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.656471  5434 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:44.654726  5444 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.658701  5444 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:44.659150  5433 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.659945  5434 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:44.660483 26513 leader_election.cc:336] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 39 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.660907 26513 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:44.661321  5433 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:44.661791 26513 consensus_peers.cc:597] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:44.661938  5443 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
W20260709 12:14:44.667100 26587 leader_election.cc:336] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.666985 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 35 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:44.669857 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:44.670192 26543 raft_consensus.cc:2468] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 35.
I20260709 12:14:44.670593 26547 raft_consensus.cc:3060] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:44.671635 26587 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:44.674182  5310 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:44.680203  5448 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.680863  5448 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:44.683538  5434 raft_consensus.cc:2804] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:14:44.684455  5434 raft_consensus.cc:697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:44.685138 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 35 index: 25 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:44.685667 26365 catalog_manager.cc:5697] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 26 to 27, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 27 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:44.688484  5310 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.683305  5448 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:44.689117  5310 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.689152  5421 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.690514  5421 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:44.689757  5422 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:14:44.689669 27133 leader_election.cc:336] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.692886  5310 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:44.692823 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:44.693339 26547 raft_consensus.cc:2468] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:14:44.685539  5434 consensus_queue.cc:237] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 34.23, Last appended by leader: 23, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.679153  5444 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.703338 26616 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
I20260709 12:14:44.703738  5422 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:44.704339 26513 leader_election.cc:336] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.702451  5443 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.705363 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:44.705655  5443 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.707355  5310 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:44.707863  5310 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.708320  5310 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:44.711791  5055 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.712455  5055 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.714787  5055 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:44.706169  5422 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:14:44.696950 26587 leader_election.cc:336] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.700354 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:44.722848 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:44.725281  5448 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:44.727196  5421 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:44.729460  5444 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:44.733126  5433 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
W20260709 12:14:44.733390 26587 leader_election.cc:336] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:44.736863 26587 consensus_peers.cc:597] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:44.737939 27133 leader_election.cc:336] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 39 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.743971 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 40 candidate_status { last_received { term: 39 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:44.744058  5310 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.744789 26547 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 39.
I20260709 12:14:44.747121 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 39 candidate_status { last_received { term: 38 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:44.747869 26542 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 38.
I20260709 12:14:44.747993 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 33 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:44.749516 26513 leader_election.cc:336] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.754895 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:44.749503  5421 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 44 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.756528  5443 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:44.756214  5421 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 44 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:44.752938  5445 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.759142  5310 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:44.760078  5448 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Leader pre-election won for term 39
I20260709 12:14:44.760581  5448 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.761071  5448 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Advancing to term 39
I20260709 12:14:44.758617  5445 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:44.764422  5445 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:44.768286  5421 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 45 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:44.779043 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:44.779699 26547 raft_consensus.cc:3060] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Advancing to term 35
W20260709 12:14:44.778769 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 68952.8us
I20260709 12:14:44.785849 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 35 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:44.786602 26616 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 35.
I20260709 12:14:44.788865 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 45 candidate_status { last_received { term: 44 index: 28 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:44.789561 26616 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 44 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 44.
I20260709 12:14:44.789023 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:44.790026  5055 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 44 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.790580  5055 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 44 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:44.791527  5310 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.789175 26587 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:44.792086  5310 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:44.793537 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 45 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:44.794845 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:44.795564 26616 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36.
I20260709 12:14:44.795955 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 25 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:44.794876  5310 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:44.796612 27161 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
W20260709 12:14:44.801016 26513 leader_election.cc:336] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:44.801749 26513 consensus_peers.cc:597] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:44.803809  5445 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 44 FOLLOWER]: Leader pre-election won for term 45
I20260709 12:14:44.804308  5445 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 44 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.797626 26514 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:44.805637 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:44.807180 26616 raft_consensus.cc:3060] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:44.807988  5438 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:44.798080  5421 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:44.808467  5438 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.808629  5421 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.808974  5438 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:44.809136  5421 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Advancing to term 36
W20260709 12:14:44.812793 26513 leader_election.cc:336] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.814762 26514 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:44.815600  5310 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader pre-election won for term 37
I20260709 12:14:44.815989  5310 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.816309  5310 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:44.816583  5445 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 44 FOLLOWER]: Advancing to term 45
I20260709 12:14:44.813352 26365 catalog_manager.cc:5697] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 34 to 35, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 35 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:44.823347  5055 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 45 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:44.814705 27133 leader_election.cc:336] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.827234 26616 raft_consensus.cc:2468] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36.
W20260709 12:14:44.827268 27133 leader_election.cc:336] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 45 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.832945 26514 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:44.834048  5443 raft_consensus.cc:2804] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:14:44.834692  5443 raft_consensus.cc:697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:44.835613  5443 consensus_queue.cc:237] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 35.21, Last appended by leader: 21, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.837633  5421 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:44.840623 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 45 candidate_status { last_received { term: 44 index: 28 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:44.841122  5055 raft_consensus.cc:2804] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election won for term 34
W20260709 12:14:44.841288 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 52203.7us
I20260709 12:14:44.841791  5055 raft_consensus.cc:697] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:44.843019  5055 consensus_queue.cc:237] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 33.17, Last appended by leader: 17, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.843883  5445 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 45 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:44.845150 27161 raft_consensus.cc:2393] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 45 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 in current term 45: Already voted for candidate 3262bf0553e543eea76794fc529a9acc in this term.
I20260709 12:14:44.847229 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:44.849172 26547 raft_consensus.cc:2468] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 35.
I20260709 12:14:44.852321  5453 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Leader pre-election won for term 40
I20260709 12:14:44.852876  5453 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:44.853257  5453 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Advancing to term 40
I20260709 12:14:44.853469  5445 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 45 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:44.856317  5310 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.871109 26587 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:44.874718 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 45 candidate_status { last_received { term: 44 index: 28 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:44.875423 26616 raft_consensus.cc:3060] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 44 FOLLOWER]: Advancing to term 45
I20260709 12:14:44.876362  5459 raft_consensus.cc:2804] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:14:44.878772  5310 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:44.884357 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
W20260709 12:14:44.884665 25293 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 26494)
I20260709 12:14:44.885098 26613 raft_consensus.cc:3060] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:44.869377  5429 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 01a57027214a411e80874ac7febd628b)
W20260709 12:14:44.894968 26513 leader_election.cc:336] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.897298 26613 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 37.
W20260709 12:14:44.885560 27133 leader_election.cc:336] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 45 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.903568  5438 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:44.910604  5459 raft_consensus.cc:697] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:44.912565  5429 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.904577  5421 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:44.914863  5429 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:44.916199 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 36 candidate_status { last_received { term: 35 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:44.917017 26613 raft_consensus.cc:3060] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:44.916265  5459 consensus_queue.cc:237] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 34.19, Last appended by leader: 19, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.909369  5448 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 39 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:44.922012 26513 leader_election.cc:336] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:44.930085  5448 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 39 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:44.932898  5453 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:44.924978 26616 raft_consensus.cc:2468] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 45 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 45.
I20260709 12:14:44.927775  5438 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:44.947474 27134 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 45 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:44.954339 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 39 candidate_status { last_received { term: 38 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:44.955231 26547 raft_consensus.cc:3060] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Advancing to term 39
I20260709 12:14:44.957598 26613 raft_consensus.cc:2468] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 36.
W20260709 12:14:44.960171 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 89167.1us
W20260709 12:14:44.960417 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 75304.3us
I20260709 12:14:44.965117 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:44.964404 27134 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:44.963930  5448 raft_consensus.cc:2804] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 45 FOLLOWER]: Leader election won for term 45
I20260709 12:14:44.967600  5420 raft_consensus.cc:2804] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:14:44.968904 26613 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 33.
I20260709 12:14:44.973929 26547 raft_consensus.cc:2468] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 39.
I20260709 12:14:44.977645 26365 catalog_manager.cc:5697] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 33 to 34, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 34 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:44.989873 26514 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:44.992698  5420 raft_consensus.cc:697] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 36 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:44.994132 26543 raft_consensus.cc:1275] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 40 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 39 index: 19. Preceding OpId from leader: term: 40 index: 20. (index mismatch)
I20260709 12:14:44.983994  5453 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 40 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:44.990597 26364 catalog_manager.cc:5697] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 35 to 36, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 36 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:45.002823 26514 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:45.004349  5310 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:14:45.004843  5310 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting leader election (detected failure of leader 01a57027214a411e80874ac7febd628b)
I20260709 12:14:45.005229  5310 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:14:45.003228 27133 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 39 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:45.003136  5429 raft_consensus.cc:2804] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader election won for term 37
I20260709 12:14:45.031531 26616 raft_consensus.cc:1275] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 33 index: 21. Preceding OpId from leader: term: 34 index: 22. (index mismatch)
W20260709 12:14:45.038691 26513 leader_election.cc:336] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:45.065425 26513 consensus_peers.cc:597] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:45.069576  5459 consensus_queue.cc:1048] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:14:45.041832  5445 raft_consensus.cc:2804] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 39 FOLLOWER]: Leader election won for term 39
I20260709 12:14:45.041539  5429 raft_consensus.cc:697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 37 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:45.103154 26543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 40 candidate_status { last_received { term: 39 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:45.104092 26543 raft_consensus.cc:3060] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Advancing to term 40
W20260709 12:14:45.109021 26587 leader_election.cc:336] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:45.090698  5445 raft_consensus.cc:697] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 39 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:45.060688  5463 consensus_queue.cc:1048] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.040s
I20260709 12:14:45.080929  5448 raft_consensus.cc:697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 45 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:45.071700  5420 consensus_queue.cc:237] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 35.23, Last appended by leader: 23, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:45.140328  5429 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 36.23, Last appended by leader: 23, Current term: 37, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:14:45.144191 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 141044us
W20260709 12:14:45.145958 26513 consensus_peers.cc:597] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:45.147639 26543 raft_consensus.cc:2468] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 40 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 40.
I20260709 12:14:45.147460  5310 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:45.153693 26616 raft_consensus.cc:1275] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:14:45.191881  5474 consensus_queue.cc:1048] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:14:45.180629 27133 leader_election.cc:336] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 36 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:45.199342 27133 leader_election.cc:336] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 39 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:45.201570 26357 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 82261.7us
I20260709 12:14:45.199227 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 25 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:45.203884 27161 raft_consensus.cc:3060] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:45.198575  5448 consensus_queue.cc:237] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 44.28, Last appended by leader: 28, Current term: 45, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:45.219151  5310 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:45.224558 26513 leader_election.cc:336] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:45.225641 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:45.198571  5445 consensus_queue.cc:237] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 38.24, Last appended by leader: 24, Current term: 39, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:45.226305 26613 raft_consensus.cc:3060] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:14:45.227807 26513 consensus_peers.cc:597] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:45.240749 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 74285.6us
I20260709 12:14:45.244660 26587 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 40 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:45.249197 27161 raft_consensus.cc:2468] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 36.
I20260709 12:14:45.249758 26613 raft_consensus.cc:2468] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 34.
I20260709 12:14:45.253703 26514 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:45.254853  5055 raft_consensus.cc:2804] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Leader election won for term 40
I20260709 12:14:45.255443  5055 raft_consensus.cc:697] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 40 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:45.257653 26514 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b
I20260709 12:14:45.266008  5457 raft_consensus.cc:2804] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:14:45.264917  5055 consensus_queue.cc:237] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 39.24, Last appended by leader: 24, Current term: 40, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:45.255972  5443 raft_consensus.cc:2804] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader election won for term 36
W20260709 12:14:45.269021 26357 catalog_manager.cc:4755] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cff430729a9d4c8183d8ddad129d6ecf: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:45.272006 26587 leader_election.cc:336] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 45 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:45.279966  5479 log.cc:927] Time spent T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:14:45.276418 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 45 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:45.295006  5422 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 45 FOLLOWER]: Leader pre-election lost for term 45. Reason: could not achieve majority
W20260709 12:14:45.288329 26587 consensus_peers.cc:597] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:45.296768 26587 leader_election.cc:336] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 40 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:45.297641 26587 leader_election.cc:336] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:45.298055 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:45.298951  5444 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:45.268697  5457 raft_consensus.cc:697] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 34 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:45.313133 26542 raft_consensus.cc:1275] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 34 index: 23. Preceding OpId from leader: term: 35 index: 24. (index mismatch)
I20260709 12:14:45.287047  5443 raft_consensus.cc:697] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:45.325678  5459 consensus_queue.cc:1048] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.001s
W20260709 12:14:45.329519 26513 consensus_peers.cc:597] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:45.332687 26587 leader_election.cc:336] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 40 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:45.335552  5443 consensus_queue.cc:237] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 35.25, Last appended by leader: 25, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:45.342347 27133 consensus_peers.cc:597] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:45.345475  5457 consensus_queue.cc:237] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 33.19, Last appended by leader: 19, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:45.347196 26365 catalog_manager.cc:5697] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 34 to 35, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 35 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:45.356225 26613 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 32.21, Last appended by leader: 20, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:14:45.358596 26364 catalog_manager.cc:5697] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 35 to 36, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 36 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:45.362213 26367 catalog_manager.cc:5697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 36 to 37, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 37 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:45.368033 26587 consensus_peers.cc:597] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:45.397991 27133 consensus_peers.cc:597] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:45.402957 26542 raft_consensus.cc:1275] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 33 index: 17. Preceding OpId from leader: term: 34 index: 18. (index mismatch)
I20260709 12:14:45.447851 26614 raft_consensus.cc:1275] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 35 index: 21. Preceding OpId from leader: term: 36 index: 22. (index mismatch)
I20260709 12:14:45.450233  5463 consensus_queue.cc:1048] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
W20260709 12:14:45.431716 26513 consensus_peers.cc:597] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:45.464660 26513 consensus_peers.cc:597] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:45.460834 26365 catalog_manager.cc:5697] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 39 to 40, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 40 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:45.479426 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 50375.4us
W20260709 12:14:45.486632 26587 consensus_peers.cc:597] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:45.489068 26587 consensus_peers.cc:597] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:45.484054  5055 consensus_queue.cc:1048] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.007s
I20260709 12:14:45.496063 26543 raft_consensus.cc:1275] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 34 index: 19. Preceding OpId from leader: term: 35 index: 20. (index mismatch)
W20260709 12:14:45.648965  5486 log.cc:927] Time spent T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:14:45.711628 26364 catalog_manager.cc:5697] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 44 to 45, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 45 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:45.716305  5452 log.cc:927] Time spent T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:14:45.716970 26364 catalog_manager.cc:5697] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 38 to 39, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 39 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:45.555043  5422 consensus_queue.cc:1048] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.144s
W20260709 12:14:45.751207  5492 log.cc:927] Time spent T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 12:14:45.775689 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 216705us
W20260709 12:14:45.811278 26587 consensus_peers.cc:597] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:45.842558  5494 log.cc:927] Time spent T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:14:45.881476 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 55115.3us
W20260709 12:14:45.885195 25293 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 26494)
I20260709 12:14:45.918685 26614 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 36 index: 23. Preceding OpId from leader: term: 37 index: 24. (index mismatch)
W20260709 12:14:45.936987 26513 consensus_peers.cc:597] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:45.939180 26547 raft_consensus.cc:1275] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 38 index: 24. Preceding OpId from leader: term: 39 index: 25. (index mismatch)
I20260709 12:14:45.940162  5425 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
W20260709 12:14:45.943216 26513 consensus_peers.cc:597] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:45.943774 26513 consensus_peers.cc:597] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:45.946573 26613 raft_consensus.cc:1275] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 35 index: 23. Preceding OpId from leader: term: 36 index: 24. (index mismatch)
W20260709 12:14:45.949456 26588 consensus_peers.cc:597] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3288c98248464af5b8f3227349002ec7. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:45.968499 26513 consensus_peers.cc:597] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:45.973510 26616 raft_consensus.cc:1275] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 33 index: 19. Preceding OpId from leader: term: 34 index: 20. (index mismatch)
I20260709 12:14:45.976634  5470 consensus_queue.cc:1048] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.001s
I20260709 12:14:45.986016 26613 raft_consensus.cc:1275] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 45 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 44 index: 28. Preceding OpId from leader: term: 45 index: 29. (index mismatch)
W20260709 12:14:45.997403 26587 consensus_peers.cc:597] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:45.998553 26587 consensus_peers.cc:597] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:45.999145 26587 consensus_peers.cc:597] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:46.002192  5469 consensus_queue.cc:1048] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:14:46.020306  5498 consensus_queue.cc:1048] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.001s
I20260709 12:14:46.026573  5468 consensus_queue.cc:1048] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.001s
I20260709 12:14:46.063443 26547 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 32 index: 21. Preceding OpId from leader: term: 32 index: 22. (index mismatch)
I20260709 12:14:46.145442 26546 raft_consensus.cc:1275] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 40 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 39 index: 24. Preceding OpId from leader: term: 40 index: 25. (index mismatch)
W20260709 12:14:46.216387 27133 consensus_peers.cc:597] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:46.217506 27133 consensus_peers.cc:597] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:46.225914 27133 consensus_peers.cc:597] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:46.226543 27133 consensus_peers.cc:597] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:46.231370 27160 raft_consensus.cc:1275] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 35 index: 25. Preceding OpId from leader: term: 36 index: 26. (index mismatch)
W20260709 12:14:46.233951 27133 consensus_peers.cc:597] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:46.234573  5459 consensus_queue.cc:1048] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.003s
I20260709 12:14:46.234838  5444 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.011s
I20260709 12:14:46.248946 26364 catalog_manager.cc:5697] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 33 to 34, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 34 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:46.252775 26364 catalog_manager.cc:5697] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 35 to 36, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 36 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:46.257988  5512 ts_tablet_manager.cc:933] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:46.246228  5469 consensus_queue.cc:1048] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.037s
W20260709 12:14:46.323395 27133 consensus_peers.cc:597] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:46.336357  5503 raft_consensus.cc:2955] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Committing config change with OpId 32.22: config changed from index -1 to 22, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:14:46.363236 26545 raft_consensus.cc:2955] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Committing config change with OpId 32.22: config changed from index -1 to 22, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:14:46.341380  5512 tablet_copy_client.cc:323] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.67:42217
I20260709 12:14:46.400275 26632 tablet_copy_service.cc:140] P aaadfdd9ca9f424c91505f9b43876233: Received BeginTabletCopySession request for tablet 3288c98248464af5b8f3227349002ec7 from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:48232)
I20260709 12:14:46.401062 26632 tablet_copy_service.cc:161] P aaadfdd9ca9f424c91505f9b43876233: Beginning new tablet copy session on tablet 3288c98248464af5b8f3227349002ec7 from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:48232: session id = 3262bf0553e543eea76794fc529a9acc-3288c98248464af5b8f3227349002ec7
W20260709 12:14:46.473531 26357 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 43874.9us
I20260709 12:14:46.489006 26365 catalog_manager.cc:5697] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index -1 to 22, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 32 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
W20260709 12:14:46.534178 26357 catalog_manager.cc:4755] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cff430729a9d4c8183d8ddad129d6ecf: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:46.543897  5503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34372 (request call id 3) took 1194 ms. Trace:
I20260709 12:14:46.544512  5503 rpcz_store.cc:276] 0709 12:14:45.351317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.352622 (+  1305us) service_pool.cc:224] Handling call
0709 12:14:45.361932 (+  9310us) log.cc:844] Serialized 506 byte log entry
0709 12:14:45.756080 (+394148us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b2c000c78e8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e2a0a 00007f50749e2693 00007f50749e2631 00007f5076116b52 00007f5076116cf5 00007f5076053691 00007f5076033eaa 00007f507603ad53 00007f507603acd9 00007f507603ac69
0709 12:14:45.834193 (+ 78113us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b1800456400. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072f67c0a 00007f507c6a7219 00007f5079fae58f 00007f5072fed571 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd
0709 12:14:45.851284 (+ 17091us) spinlock_profiling.cc:243] Waited 9.48 ms on lock 0x7b2c000c78e8. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50749d3a11 00007f50749e2a0a 00007f50749e2693 00007f50749e2631 00007f5076116b52 00007f5076116cf5 00007f5076053691 00007f5076033eaa 00007f507603ad53 00007f507603acd9 00007f507603ac69
0709 12:14:46.543776 (+692492us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":202964,"raft.queue_time_us":284526,"raft.run_cpu_time_us":4651,"raft.run_wall_time_us":112340,"spinlock_wait_cycles":48211456,"thread_start_us":234874,"threads_started":2,"wal-append.queue_time_us":356002}
I20260709 12:14:46.555104 26632 tablet_copy_source_session.cc:215] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:46.560513  5512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3288c98248464af5b8f3227349002ec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.617015  5462 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.617777  5462 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:46.621961 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:46.622794 27165 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 35.
I20260709 12:14:46.624395 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:46.625417  5459 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:46.625972  5459 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.626379  5459 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:46.634550  5462 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
W20260709 12:14:46.636049 26587 consensus_peers.cc:597] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:46.641099  5459 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:46.647435 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 59837.7us
I20260709 12:14:46.653877  5459 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 election: Requested vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:46.655123  5512 tablet_copy_client.cc:806] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:46.655829  5512 tablet_copy_client.cc:670] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:46.683851 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799bbccef316451b8fb8dbd051728db0" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:46.684650 27165 raft_consensus.cc:3060] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:46.710510  5512 tablet_copy_client.cc:538] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:46.722030 27165 raft_consensus.cc:2468] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 36.
I20260709 12:14:46.733472 26588 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:46.735612  5434 raft_consensus.cc:2804] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:14:46.736220  5434 raft_consensus.cc:697] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 36 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:46.737277  5434 consensus_queue.cc:237] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 34.22, Last appended by leader: 22, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:46.751111 26613 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
W20260709 12:14:46.757616 26587 consensus_peers.cc:597] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:46.758726 26587 consensus_peers.cc:597] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:46.762339  5512 tablet_bootstrap.cc:492] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
W20260709 12:14:46.801519 26587 leader_election.cc:336] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:46.802573 26587 leader_election.cc:336] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:46.858481 26367 catalog_manager.cc:5697] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 34 to 36, leader changed from 01a57027214a411e80874ac7febd628b (127.24.179.65) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 36 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:46.862684 26545 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
W20260709 12:14:46.874662 27133 consensus_peers.cc:597] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:46.876899  5459 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:14:46.885787 25293 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 26494)
W20260709 12:14:46.896275 26587 consensus_peers.cc:597] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:46.926677 26588 consensus_peers.cc:597] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 63a71194fb3446e6b7b3135fde882816. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:46.961259 26587 consensus_peers.cc:597] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:47.005549  5462 raft_consensus.cc:2955] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Committing config change with OpId 27.18: config changed from index -1 to 18, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
W20260709 12:14:47.037930 26587 consensus_peers.cc:597] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:47.053541 26367 catalog_manager.cc:5697] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index -1 to 18, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 27 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:47.060811 26513 consensus_peers.cc:597] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:47.065327 26545 raft_consensus.cc:2955] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Committing config change with OpId 27.18: config changed from index -1 to 18, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
W20260709 12:14:47.077528 26587 consensus_peers.cc:597] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:47.078112 26587 consensus_peers.cc:597] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:47.096027  5512 tablet_bootstrap.cc:492] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=25 overwritten=3 applied=22 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:14:47.117357 27133 consensus_peers.cc:597] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:47.120386  5512 tablet_bootstrap.cc:492] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:14:47.127203  5512 ts_tablet_manager.cc:1403] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.372s	user 0.082s	sys 0.003s
I20260709 12:14:47.150032 26616 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 37.22, Last appended by leader: 21, Current term: 37, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
W20260709 12:14:47.154140 26513 consensus_peers.cc:597] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:47.155709 26587 consensus_peers.cc:597] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:47.146270  5512 raft_consensus.cc:359] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc [term 32 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:14:47.156399  5512 raft_consensus.cc:740] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc [term 32 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:14:47.157301  5512 consensus_queue.cc:260] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 22, Last appended: 32.22, Last appended by leader: 22, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:14:47.161051  5512 ts_tablet_manager.cc:1434] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:14:47.163491 26632 tablet_copy_service.cc:342] P aaadfdd9ca9f424c91505f9b43876233: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-3288c98248464af5b8f3227349002ec7 received from {username='slave'} at 127.0.0.1:48232
I20260709 12:14:47.164013 26632 tablet_copy_service.cc:434] P aaadfdd9ca9f424c91505f9b43876233: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-3288c98248464af5b8f3227349002ec7 on tablet 3288c98248464af5b8f3227349002ec7 with peer 3262bf0553e543eea76794fc529a9acc
W20260709 12:14:47.173709 27133 consensus_peers.cc:597] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:47.215557 26513 consensus_peers.cc:597] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:47.223390 26587 consensus_peers.cc:597] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:47.250782 27134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 55811.6us
W20260709 12:14:47.266145 26513 consensus_peers.cc:597] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:47.272908 26545 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 37 index: 22. Preceding OpId from leader: term: 37 index: 23. (index mismatch)
I20260709 12:14:47.276081 27160 raft_consensus.cc:1217] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc [term 32 LEARNER]: Deduplicated request from leader. Original: 32.21->[32.22-32.22]   Dedup: 32.22->[]
W20260709 12:14:47.279253 26588 consensus_peers.cc:597] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9abba0c7cca40c4b2a9ffbcde803684. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.286022  5500 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.001s
W20260709 12:14:47.288730 26587 consensus_peers.cc:597] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.320205  5500 raft_consensus.cc:2955] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Committing config change with OpId 37.23: config changed from index -1 to 23, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:14:47.323336 26545 raft_consensus.cc:2955] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Committing config change with OpId 37.23: config changed from index -1 to 23, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
W20260709 12:14:47.345772 26513 consensus_peers.cc:597] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:47.346628 26513 consensus_peers.cc:597] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:47.364156 26365 catalog_manager.cc:5697] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index -1 to 23, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 37 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:14:47.408398 27160 raft_consensus.cc:1275] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 34 index: 22. Preceding OpId from leader: term: 36 index: 23. (index mismatch)
I20260709 12:14:47.410112  5462 consensus_queue.cc:1048] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260709 12:14:47.440864 26545 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 37.24, Last appended by leader: 23, Current term: 37, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
W20260709 12:14:47.477697 26587 consensus_peers.cc:597] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:47.483351  5512 ts_tablet_manager.cc:933] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:47.522255  5512 tablet_copy_client.cc:323] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.67:42217
I20260709 12:14:47.524379 26632 tablet_copy_service.cc:140] P aaadfdd9ca9f424c91505f9b43876233: Received BeginTabletCopySession request for tablet 63a71194fb3446e6b7b3135fde882816 from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:48232)
I20260709 12:14:47.525068 26632 tablet_copy_service.cc:161] P aaadfdd9ca9f424c91505f9b43876233: Beginning new tablet copy session on tablet 63a71194fb3446e6b7b3135fde882816 from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:48232: session id = 3262bf0553e543eea76794fc529a9acc-63a71194fb3446e6b7b3135fde882816
W20260709 12:14:47.526026 26587 consensus_peers.cc:597] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:47.534830 26513 consensus_peers.cc:597] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:47.538179 26632 tablet_copy_source_session.cc:215] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:47.543798 26618 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 37 index: 24. Preceding OpId from leader: term: 37 index: 25. (index mismatch)
W20260709 12:14:47.546905 26587 consensus_peers.cc:597] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:47.545735  5429 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.003s
I20260709 12:14:47.557989  5512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a71194fb3446e6b7b3135fde882816. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:47.560266 26514 consensus_peers.cc:597] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): Couldn't send request to peer 3262bf0553e543eea76794fc529a9acc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6598ff9cfd5346af8da1e9928f3a5ac9. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:47.563355 26513 consensus_peers.cc:597] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.592161  5522 raft_consensus.cc:2955] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 37 LEADER]: Committing config change with OpId 37.25: config changed from index -1 to 25, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
I20260709 12:14:47.595382 26613 raft_consensus.cc:2955] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Committing config change with OpId 37.25: config changed from index -1 to 25, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
W20260709 12:14:47.595265 26587 consensus_peers.cc:597] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:47.616078  5512 tablet_copy_client.cc:806] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:47.616959  5512 tablet_copy_client.cc:670] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:47.630713  5512 tablet_copy_client.cc:538] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:47.635928 26364 catalog_manager.cc:5697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index -1 to 25, NON_VOTER 3262bf0553e543eea76794fc529a9acc (127.24.179.68) added. New cstate: current_term: 37 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } }
W20260709 12:14:47.642719 26587 consensus_peers.cc:597] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:47.656435 27133 consensus_peers.cc:597] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:47.659267 26513 consensus_peers.cc:597] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:47.688288  5512 tablet_bootstrap.cc:492] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
W20260709 12:14:47.697778 26587 consensus_peers.cc:597] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:47.700306 26587 consensus_peers.cc:597] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:47.809131 26513 consensus_peers.cc:597] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:47.827670  5444 raft_consensus.cc:1064] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:14:47.827695  5512 tablet_bootstrap.cc:492] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=19 overwritten=1 applied=18 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:47.839076  5512 tablet_bootstrap.cc:492] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:14:47.839988  5512 ts_tablet_manager.cc:1403] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.152s	user 0.054s	sys 0.002s
I20260709 12:14:47.843415  5512 raft_consensus.cc:359] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc [term 27 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:14:47.844484  5512 raft_consensus.cc:740] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc [term 27 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:14:47.843459  5444 consensus_queue.cc:237] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 32.22, Last appended by leader: 20, Current term: 32, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:47.845273  5512 consensus_queue.cc:260] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:14:47.850113  5512 ts_tablet_manager.cc:1434] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:14:47.852921 26632 tablet_copy_service.cc:342] P aaadfdd9ca9f424c91505f9b43876233: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-63a71194fb3446e6b7b3135fde882816 received from {username='slave'} at 127.0.0.1:48232
I20260709 12:14:47.853418 26632 tablet_copy_service.cc:434] P aaadfdd9ca9f424c91505f9b43876233: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-63a71194fb3446e6b7b3135fde882816 on tablet 63a71194fb3446e6b7b3135fde882816 with peer 3262bf0553e543eea76794fc529a9acc
W20260709 12:14:47.886533 25293 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 26494)
I20260709 12:14:47.895489  5512 ts_tablet_manager.cc:933] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:48.261369  5512 tablet_copy_client.cc:323] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.67:42217
W20260709 12:14:48.887285 25293 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 26494)
W20260709 12:14:48.946942 26357 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111) [suppressed 434 similar messages]
W20260709 12:14:49.097886 26357 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 150988us
W20260709 12:14:49.101912 26357 catalog_manager.cc:4755] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cff430729a9d4c8183d8ddad129d6ecf: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.218636  5547 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.219353  5547 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.222052  5547 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.232369  5549 raft_consensus.cc:493] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 40 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.233111  5549 raft_consensus.cc:515] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 40 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.235405  5549 leader_election.cc:290] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 41 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.243155  5552 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.243983  5552 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.271211  5557 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.273010  5557 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.299034  5552 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:49.284363  5545 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.302445  5545 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.288362  5550 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:49.340919  5545 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.341329  5557 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:49.343843  5552 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.344089  5563 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.344483  5552 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.348475  5552 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:49.339175  5550 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.344585  5563 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.359243  5550 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.353416  5548 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.361920  5548 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.364225  5548 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:14:49.364748 27165 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 1.503s	user 0.004s	sys 0.029s
W20260709 12:14:49.365257 27165 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 1.504s	user 0.005s	sys 0.029s
I20260709 12:14:49.366242  5563 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:49.383966  5548 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.384675  5548 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.385201  5560 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.385421  5564 raft_consensus.cc:493] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.385869  5560 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.386029  5564 raft_consensus.cc:515] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.387352  5549 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.387899  5549 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Starting pre-election with config: opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:14:49.388319  5560 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.389320  5564 leader_election.cc:290] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.390657  5546 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 39 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.391393  5546 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 39 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.395823  5550 raft_consensus.cc:493] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.396486  5550 raft_consensus.cc:515] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.398015  5567 raft_consensus.cc:493] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:49.398675  5567 raft_consensus.cc:515] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.401094  5564 raft_consensus.cc:493] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.401690  5564 raft_consensus.cc:515] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.402947  5551 raft_consensus.cc:493] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.403674  5567 leader_election.cc:290] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.403529  5551 raft_consensus.cc:515] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.405828  5551 leader_election.cc:290] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.407181  5564 leader_election.cc:290] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.407799  5551 raft_consensus.cc:493] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.414775  5551 raft_consensus.cc:515] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.417433  5551 leader_election.cc:290] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.394280  5546 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.409888  5569 raft_consensus.cc:493] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.412869  5550 leader_election.cc:290] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.408735  5548 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:49.390143  5549 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.420589  5569 raft_consensus.cc:515] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.421418  5549 raft_consensus.cc:493] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.439260  5549 raft_consensus.cc:515] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.440387  5555 raft_consensus.cc:493] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:49.441033  5462 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:49.440968  5555 raft_consensus.cc:515] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.441725  5549 leader_election.cc:290] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.441596  5462 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.424119  5559 raft_consensus.cc:493] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:49.424984  5547 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.442857  5559 raft_consensus.cc:515] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.442951  5547 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.445343  5559 leader_election.cc:290] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.445562  5547 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.442348  5549 raft_consensus.cc:493] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.447100  5555 leader_election.cc:290] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.428619  5557 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.447896  5557 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.433463  5560 raft_consensus.cc:493] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:49.436064  5564 raft_consensus.cc:493] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.450671  5550 raft_consensus.cc:493] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.436672  5567 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.450834  5560 raft_consensus.cc:515] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.451306  5551 raft_consensus.cc:493] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.451349  5567 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.452021  5551 raft_consensus.cc:515] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.452622  5462 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.453303  5560 leader_election.cc:290] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.453718  5567 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.446955  5549 raft_consensus.cc:515] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.426273  5556 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.454631  5556 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.455806  5549 leader_election.cc:290] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.450102  5557 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.456702  5565 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.456905  5556 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:49.457456  5556 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.457334  5565 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.457863  5562 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.458726  5555 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.458588  5550 raft_consensus.cc:515] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.459288  5555 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.450930  5564 raft_consensus.cc:515] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.461241  5550 leader_election.cc:290] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.461723  5555 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:49.462069  5564 leader_election.cc:290] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.428223  5552 raft_consensus.cc:493] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:49.458599  5562 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.463091  5552 raft_consensus.cc:515] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.463729  5563 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:49.464300  5563 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.464670  5562 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:49.465240  5562 raft_consensus.cc:493] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:49.465343  5552 leader_election.cc:290] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.457973  5556 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.466638  5563 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.467489  5569 leader_election.cc:290] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.468281  5556 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:49.472389  5568 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.472689  5569 raft_consensus.cc:493] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.472831  5564 raft_consensus.cc:493] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.473088  5568 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.473290  5569 raft_consensus.cc:515] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.473397  5564 raft_consensus.cc:515] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:14:49.474465  5551 leader_election.cc:290] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.469077  5565 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:49.471635  5559 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:49.479174  5564 leader_election.cc:290] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.479952  5564 raft_consensus.cc:493] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.478868  5551 raft_consensus.cc:493] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 40 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.480294  5555 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.480512  5564 raft_consensus.cc:515] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.480736  5551 raft_consensus.cc:515] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 40 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.480942  5555 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.483088  5564 leader_election.cc:290] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.479671  5559 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.484134  5549 raft_consensus.cc:493] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:49.484800  5549 raft_consensus.cc:515] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.485996  5559 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.486686  5564 raft_consensus.cc:493] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.487341  5564 raft_consensus.cc:515] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.489260  5549 leader_election.cc:290] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.489534  5564 leader_election.cc:290] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.489926  5550 raft_consensus.cc:493] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:49.483592  5555 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.483624  5569 leader_election.cc:290] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.490588  5550 raft_consensus.cc:515] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.492959  5550 leader_election.cc:290] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.493729  5551 leader_election.cc:290] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 41 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.483999  5573 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.494684  5573 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.496266 27165 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc [term 32 LEARNER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 32 index: 22. Preceding OpId from leader: term: 32 index: 23. (index mismatch)
I20260709 12:14:49.497172  5573 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.465739  5562 raft_consensus.cc:515] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.499356 27165 raft_consensus.cc:1217] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc [term 27 LEARNER]: Deduplicated request from leader. Original: 27.17->[27.18-27.18]   Dedup: 27.18->[]
I20260709 12:14:49.499421  5562 leader_election.cc:290] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.503890 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de4e2c4be7474864b847ef2e617f6f49" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 24 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.511795 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e1490de99a4232a6717e72242a0f00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.512032 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.513381 26542 raft_consensus.cc:1275] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 32 index: 22. Preceding OpId from leader: term: 32 index: 23. (index mismatch)
I20260709 12:14:49.518008  5551 raft_consensus.cc:493] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:49.519157  5551 raft_consensus.cc:515] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.521487  5573 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:49.522225  5550 raft_consensus.cc:493] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.522919  5550 raft_consensus.cc:515] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.522707  5573 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.525398  5550 leader_election.cc:290] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.521715  5571 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.527513 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.514856 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d83c4273cd74e768f756e0c8ba65432" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.537629  5550 raft_consensus.cc:493] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.551342 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.552186 27160 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 26.
I20260709 12:14:49.552043  5550 raft_consensus.cc:515] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.507051  5568 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:49.513650  5562 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.553818  5562 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.556371  5562 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.526556  5557 raft_consensus.cc:493] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.557698 26632 tablet_copy_service.cc:140] P aaadfdd9ca9f424c91505f9b43876233: Received BeginTabletCopySession request for tablet f9abba0c7cca40c4b2a9ffbcde803684 from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:48232)
I20260709 12:14:49.558542 26632 tablet_copy_service.cc:161] P aaadfdd9ca9f424c91505f9b43876233: Beginning new tablet copy session on tablet f9abba0c7cca40c4b2a9ffbcde803684 from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:48232: session id = 3262bf0553e543eea76794fc529a9acc-f9abba0c7cca40c4b2a9ffbcde803684
I20260709 12:14:49.547732  5546 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.560626  5546 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.538219  5569 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:14:49.562978  5569 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:14:49.565191  5569 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.565850  5556 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.566100  5575 raft_consensus.cc:493] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 45 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:49.566545  5556 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.558293  5557 raft_consensus.cc:515] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.566762  5575 raft_consensus.cc:515] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 45 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.542915  5564 raft_consensus.cc:493] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:49.569330  5575 leader_election.cc:290] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 46 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.569444  5564 raft_consensus.cc:515] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.571816 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea50d3c1de374dff938c733fb02faf8c" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 41 candidate_status { last_received { term: 40 index: 25 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.573383 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.575084 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.539270  5555 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.570642  5559 raft_consensus.cc:493] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:49.589404  5548 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.590164  5556 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 41 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:49.586812  5550 leader_election.cc:290] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.592047  5547 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.592635  5547 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.590077  5548 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.569366  5557 leader_election.cc:290] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.595781  5546 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:49.574965  5575 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.596442  5548 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:49.596561  5551 leader_election.cc:290] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.596704  5575 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:14:49.588203  5555 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting pre-election with config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:14:49.576328  5573 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.543745  5571 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.605104  5559 raft_consensus.cc:515] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.612488  5571 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.607300  5575 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:49.613970  5547 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:49.612511  5559 leader_election.cc:290] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.615087  5564 leader_election.cc:290] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.617162  5555 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:49.621866 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c246551966f4307a9c8a66e2f024385" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.628309 26546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f2ec42332f4afd97d2dbfac0d5ee00" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 37 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.628640 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78002f4d800445a3befddbc1cce2750d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 38 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.646077 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.650283 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.651183 26542 raft_consensus.cc:2468] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 25.
I20260709 12:14:49.652487 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.653095 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d6a6aed08548acab4272e6f5f1480a" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 38 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.656417 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c23e0d03a4d457fa50856e09fe2f649" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.658551 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e6ed3d8ee44750a4d06294867e92bc" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.653334 26632 tablet_copy_source_session.cc:215] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:49.661659 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.662864 26542 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:14:49.663733 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a09e3d025e44058af04b7f7fff12f3" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.670573 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.670868 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bbb48570954bf4ad1039abff47c036" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.673282 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.673659 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c9184ee6b7472fb72209c9dfd651b6" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.672998 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 20 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.674695 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9abba0c7cca40c4b2a9ffbcde803684" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 38 candidate_status { last_received { term: 37 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.676867 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.677126 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.676344 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.678761 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.679406 26544 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 34.
I20260709 12:14:49.682201 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86001e7eca0b4ca4aed965b7d7e5820c" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 39 candidate_status { last_received { term: 38 index: 26 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.686095 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2251a6321412417a8079201067ae2d0d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 41 candidate_status { last_received { term: 40 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.688025 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541724f47bb04d5185dd369750546cbf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 46 candidate_status { last_received { term: 45 index: 29 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.689361 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f2c921ba4426a8185f516aa2d8deb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.694777 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.695559 27160 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 30.
I20260709 12:14:49.699813 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.701474 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce8bbdf417f47e7aabb967886d8c95a" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 24 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.702888 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.703192  5512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9abba0c7cca40c4b2a9ffbcde803684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:49.705852 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3ac2eaa71249dc96238b05adbd6b9b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 37 candidate_status { last_received { term: 36 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.706226 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6ce9ef10d748ecbe957fb8e6de47b0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.709812 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e173b367e6460b8f654b2de1aabfae" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.712327 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22baf3ebbed46a6a23a4c6cfd24710b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.712685 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce5ecc0a3714c80861557f318edce9d" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.713176 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c931e3af68c4073a5ed978eb0f43f3f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 39 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.713560 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a71194fb3446e6b7b3135fde882816" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.713935 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fceaa32ed834cedaeb85b54a55fc4ed" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.714656 26621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.715015 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fc28e9bbd743569e5c7c101c4688fb" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.714730 26619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.715543 26620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12729361d003466aada20ab37328d285" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.716979 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceda449be0d044e0b465f42ed3047751" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.710044 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.717756 26616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bd8978cfc74b93bcc4755ec8254fa7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.715070 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d235a62666644668508e208ad8d21d3" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 37 candidate_status { last_received { term: 36 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.718954 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b3fc9b208642ffb7dbc462c4032c67" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.720109 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:49.738622 26513 leader_election.cc:336] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.741335  5555 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.001s
W20260709 12:14:49.742558 26513 leader_election.cc:336] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:49.743211 26513 leader_election.cc:336] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:49.743712 26513 leader_election.cc:336] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 41 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:49.745139 26513 leader_election.cc:336] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:49.746141 26513 leader_election.cc:336] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:49.746683 26513 leader_election.cc:336] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:49.747251 26513 consensus_peers.cc:597] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:49.747658 26513 leader_election.cc:336] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:49.748127 26513 leader_election.cc:336] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:49.748586 26513 leader_election.cc:336] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:49.749032 26513 leader_election.cc:336] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.749656 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:49.750690  5575 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:14:49.751168  5575 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.751605  5575 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:49.760818  5575 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.761284 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.766678  5575 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.766809 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.767361 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.768625 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdceca3c04a40cdba75f01fa9ded9f8" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 26 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.761375 26615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cba10e68f094822a7c267bdbd205a17" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 41 candidate_status { last_received { term: 40 index: 20 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.769762 26617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012eaf6f22154b85929ab516a788db5f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 36 candidate_status { last_received { term: 35 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.771100 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
W20260709 12:14:49.762059 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 107389us
I20260709 12:14:49.764483 26588 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:49.773759 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3288c98248464af5b8f3227349002ec7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.774792 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.775663 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f90484c8608940e99361799cdda3a0f7" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.776530 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.778271  5575 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:49.778370 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9275c8cfbe54472fba36a4ef3bf770f7" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 23 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.778851  5575 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:49.782811 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:49.784168 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.786271 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 31 candidate_status { last_received { term: 30 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.787505 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:49.788264 27161 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:49.788658 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8036dd24c55a4bc18661cc64c049a704" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 37 candidate_status { last_received { term: 36 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.788832 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ba7060b20a4d598344385607b29c70" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 38 candidate_status { last_received { term: 37 index: 24 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.788259 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.779313  5575 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:14:49.796520 26513 leader_election.cc:336] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:49.797220 26513 leader_election.cc:336] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 41 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.797760 26513 leader_election.cc:304] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 41 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:49.798339 27161 raft_consensus.cc:2468] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 27.
I20260709 12:14:49.798611  5564 raft_consensus.cc:2749] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 40 FOLLOWER]: Leader pre-election lost for term 41. Reason: could not achieve majority
W20260709 12:14:49.799773 26513 consensus_peers.cc:597] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:49.804657 26588 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:49.805661  5555 raft_consensus.cc:2804] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:14:49.806272  5555 raft_consensus.cc:697] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:49.807518  5555 consensus_queue.cc:237] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:49.800496 26513 consensus_peers.cc:597] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:49.811779 26513 leader_election.cc:336] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.812251 26513 leader_election.cc:304] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:49.814819  5564 raft_consensus.cc:2749] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
W20260709 12:14:49.815984 26513 leader_election.cc:336] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:49.816588 26513 consensus_peers.cc:597] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:49.817327 26513 leader_election.cc:336] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:49.817812 26513 leader_election.cc:336] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.818174 26514 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:49.821064  5571 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
I20260709 12:14:49.829035 27165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee06ad5f38b42f99fdbc1d71eee680f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.834695  5582 ts_tablet_manager.cc:933] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:14:49.845872 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.854430  5582 tablet_copy_client.cc:323] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Beginning tablet copy session from remote peer at address 127.24.179.66:40567
I20260709 12:14:49.858776 27164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3c1161f4dab4d0e9f9b0053e38dfe10" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 33 candidate_status { last_received { term: 32 index: 23 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.855556 27160 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27. Ops: []
I20260709 12:14:49.855734 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 38 candidate_status { last_received { term: 37 index: 25 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:49.856359 27167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f480c16e1e4f31abd8773ea56f244b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.856827 27168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b9da257a1d4dadbbe3027844b5b140" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.857247 27162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953d8c981a6c459f8b7f3dbbb66fda45" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.857602 27166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580883b917314b66883009ddb9259ac0" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 31 candidate_status { last_received { term: 30 index: 21 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.858667 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aec546ef604f45adc4b6dedb13e41f" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 34 candidate_status { last_received { term: 33 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.870436 26514 leader_election.cc:304] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:49.871297  5559 consensus_queue.cc:1048] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.001s
I20260709 12:14:49.872234  5564 raft_consensus.cc:2749] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:49.874156 26514 leader_election.cc:304] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:49.875026  5551 raft_consensus.cc:2749] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:49.870265  5575 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting leader election with config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.881454 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:49.882429  5512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56886 (request call id 1927) took 2021 ms. Trace:
I20260709 12:14:49.882871  5512 rpcz_store.cc:276] 0709 12:14:47.860982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.861360 (+   378us) service_pool.cc:224] Handling call
0709 12:14:47.896012 (+ 34652us) ts_tablet_manager.cc:934] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc: Initiating tablet copy from peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
0709 12:14:49.702043 (+1806031us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:14:49.764350 (+ 62307us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:49.764484 (+   134us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:14:49.881632 (+117148us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:14:49.881922 (+   290us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:49.882282 (+   360us) ts_tablet_manager.cc:989] Replica registered.
0709 12:14:49.882345 (+    63us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":262,"tablet-copy.queue_time_us":33640,"thread_start_us":1868396,"threads_started":2}
I20260709 12:14:49.883641  5575 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.884605  5512 tablet_copy_client.cc:806] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:49.885197  5512 tablet_copy_client.cc:670] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:49.886022 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724bc8274ed84709a5b83825934b7f03" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
W20260709 12:14:49.887957 25293 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 26494)
I20260709 12:14:49.889809  5512 tablet_copy_client.cc:538] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:14:49.818271 26513 leader_election.cc:336] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:49.895066 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 76811us
W20260709 12:14:49.895690 26513 leader_election.cc:336] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.896087 26513 leader_election.cc:304] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:49.900964  5512 tablet_bootstrap.cc:492] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
I20260709 12:14:49.903499 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:49.904524  5559 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:14:49.904544 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.905256  5559 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:49.905783  5559 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:49.907087 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee0545deb746aeb5c1c14751b96826" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.910327 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2747b6998c418ab70cbcbd2f2deeaa" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 40 candidate_status { last_received { term: 39 index: 25 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.912140 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366874f8c4424fa2a9f169e9c3d6e97e" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:49.915346  5551 raft_consensus.cc:2749] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:49.917516 26514 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:49.917606  5559 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.918632  5551 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:49.919729 26514 leader_election.cc:304] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:49.920614  5551 raft_consensus.cc:2749] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:49.921218 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:14:49.921964 26513 leader_election.cc:336] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.922577 26513 leader_election.cc:304] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:49.923426  5551 raft_consensus.cc:2749] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:49.924702 26622 raft_consensus.cc:1240] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 26. Current term is 27. Ops: []
I20260709 12:14:49.926246 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:49.926738 26622 raft_consensus.cc:1240] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 30. Current term is 31. Ops: []
I20260709 12:14:49.927251  5575 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:49.927711  5575 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:49.928113  5575 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:14:49.931213  5559 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.931758 26514 leader_election.cc:304] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:49.934579 26545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc3920d73734952bc159eff19f3567d" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:49.937011 26513 consensus_peers.cc:597] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:49.937733 26513 consensus_peers.cc:597] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:49.938184 26513 leader_election.cc:336] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.938660 26513 leader_election.cc:304] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:49.940047 26514 leader_election.cc:304] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:49.941778 26587 leader_election.cc:336] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.944276 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:49.944846 26364 catalog_manager.cc:5697] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 26 to 27, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 27 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:49.946297  5564 raft_consensus.cc:2749] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:49.951587  5564 raft_consensus.cc:2749] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:49.952251  5575 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:49.952840 26513 leader_election.cc:336] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:49.953528 26513 leader_election.cc:336] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.953956 26513 leader_election.cc:304] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:14:49.955098 26587 consensus_peers.cc:597] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:49.955989 26587 leader_election.cc:336] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.956527 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:49.959444 26587 leader_election.cc:336] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.959512  5563 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:49.960323 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:49.958338  5555 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:49.961367 27159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:14:49.962255 26587 consensus_peers.cc:597] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:49.962994 26587 consensus_peers.cc:597] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:49.963492  5556 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
W20260709 12:14:49.964109 26587 leader_election.cc:336] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.964597 26587 leader_election.cc:304] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:49.964850  5574 raft_consensus.cc:2749] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:49.965441  5556 raft_consensus.cc:2749] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
W20260709 12:14:49.966363 26587 leader_election.cc:336] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.960127  5575 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:49.966856 26514 leader_election.cc:304] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:49.966120  5551 raft_consensus.cc:2749] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:49.968087  5574 raft_consensus.cc:2749] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
W20260709 12:14:49.966996 26513 leader_election.cc:336] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.969102 26513 leader_election.cc:304] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:49.971843 26514 leader_election.cc:304] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 41 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:49.972779  5574 raft_consensus.cc:2749] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 40 FOLLOWER]: Leader pre-election lost for term 41. Reason: could not achieve majority
I20260709 12:14:49.974133 26514 leader_election.cc:304] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:49.975025  5574 raft_consensus.cc:2749] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:49.976886 26514 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:49.979542  5574 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:49.967212 26587 leader_election.cc:304] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:49.981105 26514 leader_election.cc:304] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:49.981740  5556 raft_consensus.cc:2749] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
W20260709 12:14:49.968904 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 55660.2us
W20260709 12:14:49.982028 26587 leader_election.cc:336] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.983619  5551 raft_consensus.cc:2749] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
W20260709 12:14:49.983382 26513 leader_election.cc:336] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.985652 26587 leader_election.cc:304] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:49.988238 26513 leader_election.cc:304] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:49.987716  5550 consensus_queue.cc:1059] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 30.22, Next index: 23, Last known committed idx: 22, Time since last communication: 0.004s
I20260709 12:14:49.982416  5574 raft_consensus.cc:2749] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:49.985013  5564 consensus_queue.cc:1059] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.005s
I20260709 12:14:49.994045  5569 raft_consensus.cc:2749] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
W20260709 12:14:49.994452 26513 leader_election.cc:336] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.991858  5555 raft_consensus.cc:2749] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:14:49.994614 26587 leader_election.cc:336] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.995252 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:49.991060 27133 consensus_peers.cc:597] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:49.995574  5550 raft_consensus.cc:3055] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:14:49.996064  5555 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
I20260709 12:14:49.996102  5550 raft_consensus.cc:740] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 30 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:49.996989  5564 consensus_queue.cc:1243] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 27.19 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 18
W20260709 12:14:49.997305 26587 leader_election.cc:336] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:49.998221 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:49.997287  5550 consensus_queue.cc:260] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 30.22, Last appended by leader: 22, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:49.999054  5555 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:49.999711  5550 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:49.998368  5573 raft_consensus.cc:3055] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:14:50.001201  5573 raft_consensus.cc:740] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:50.002187  5573 consensus_queue.cc:260] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:50.003348 26587 leader_election.cc:336] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:50.003600  5573 raft_consensus.cc:3060] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:50.003888 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:50.006407  5555 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 12:14:50.007828 26587 leader_election.cc:336] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:50.008350 26587 leader_election.cc:304] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:50.011036  5555 raft_consensus.cc:2749] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 12:14:50.013532 26587 leader_election.cc:336] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:50.014039 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:49.995519 26513 leader_election.cc:304] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:50.016712  5555 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:50.018579  5574 raft_consensus.cc:2749] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
W20260709 12:14:50.023095 26587 leader_election.cc:336] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:50.024775 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:50.025664  5575 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 12:14:50.026032 26587 leader_election.cc:336] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:50.027647 26514 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:50.039530 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:50.040640 26587 leader_election.cc:336] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:50.040695 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:50.041193 26587 leader_election.cc:304] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:50.042544  5574 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:50.042644 26514 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:50.042577  5571 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:50.045783 26514 leader_election.cc:304] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:50.046638  5571 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:50.047349  5571 raft_consensus.cc:2749] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
I20260709 12:14:50.048667 26514 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:50.050770 26514 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:50.051187  5555 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:50.051402  5573 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:50.052227  5556 raft_consensus.cc:2749] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
I20260709 12:14:50.057704  5573 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:14:50.059052 26587 leader_election.cc:336] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 46 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:50.059685 26587 leader_election.cc:304] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 46 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:50.059197 26514 leader_election.cc:304] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:14:50.060812 26587 leader_election.cc:336] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 41 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:50.061195 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 41 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:14:50.062575 26587 leader_election.cc:336] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:50.063057 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:50.062043  5575 raft_consensus.cc:2749] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 45 FOLLOWER]: Leader pre-election lost for term 46. Reason: could not achieve majority
I20260709 12:14:50.064363  5556 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Leader pre-election lost for term 41. Reason: could not achieve majority
I20260709 12:14:50.065466  5575 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 12:14:50.066810 26587 leader_election.cc:336] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:50.067289 26587 leader_election.cc:304] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:50.068058  5575 raft_consensus.cc:2749] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:50.069684 27133 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:50.071810 27133 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:50.071808 26514 leader_election.cc:304] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:50.073140 26558 tablet_copy_service.cc:140] P ac3ac2181aa941229a758ccf6b5607cd: Received BeginTabletCopySession request for tablet 6598ff9cfd5346af8da1e9928f3a5ac9 from peer 3262bf0553e543eea76794fc529a9acc ({username='slave'} at 127.0.0.1:44706)
I20260709 12:14:50.073159  5546 raft_consensus.cc:2749] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:50.070894  5548 raft_consensus.cc:2749] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:50.071169  5571 raft_consensus.cc:2749] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:50.075907 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:50.076953 26558 tablet_copy_service.cc:161] P ac3ac2181aa941229a758ccf6b5607cd: Beginning new tablet copy session on tablet 6598ff9cfd5346af8da1e9928f3a5ac9 from peer 3262bf0553e543eea76794fc529a9acc at {username='slave'} at 127.0.0.1:44706: session id = 3262bf0553e543eea76794fc529a9acc-6598ff9cfd5346af8da1e9928f3a5ac9
I20260709 12:14:50.077186 26514 leader_election.cc:304] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:50.074349 27133 leader_election.cc:304] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:50.078944 27133 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:50.078315  5547 raft_consensus.cc:2749] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:50.076737  5550 raft_consensus.cc:2749] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:50.077811  5571 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:14:50.083709  5548 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
I20260709 12:14:50.085346 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff430729a9d4c8183d8ddad129d6ecf" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 31 candidate_status { last_received { term: 30 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:50.094035 26547 raft_consensus.cc:2468] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 31.
I20260709 12:14:50.095750 26514 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:50.096048 26542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:50.108431 26514 leader_election.cc:304] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac3ac2181aa941229a758ccf6b5607cd; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:50.094878  5573 raft_consensus.cc:2749] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:50.111364  5571 raft_consensus.cc:2749] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Leader pre-election lost for term 40. Reason: could not achieve majority
I20260709 12:14:50.113687 27133 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:50.115124 27133 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:50.116739 27133 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:50.117770  5546 raft_consensus.cc:2749] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:50.118602  5546 raft_consensus.cc:2749] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:50.119388  5546 raft_consensus.cc:2749] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:50.115243  5550 raft_consensus.cc:2749] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:50.140293  5512 tablet_bootstrap.cc:492] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=25 overwritten=2 applied=23 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:50.141597  5512 tablet_bootstrap.cc:492] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
I20260709 12:14:50.142750  5512 ts_tablet_manager.cc:1403] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.242s	user 0.064s	sys 0.007s
I20260709 12:14:50.163479 26558 tablet_copy_source_session.cc:215] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:14:50.195513 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 78845.2us
W20260709 12:14:50.197542 27133 consensus_peers.cc:597] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:50.198257 27133 leader_election.cc:336] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:50.199126 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:50.201484  5582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6598ff9cfd5346af8da1e9928f3a5ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:50.211148 26622 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 27. Current term is 28. Ops: []
W20260709 12:14:50.212623 27133 leader_election.cc:336] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:50.213155 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:50.214447  5548 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:50.214690  5547 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:14:50.215906  5547 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:14:50.216275  5547 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:50.217160  5547 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:50.217921  5512 raft_consensus.cc:359] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc [term 37 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:14:50.220790  5512 raft_consensus.cc:740] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc [term 37 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:14:50.222888 26547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:50.221482  5512 consensus_queue.cc:260] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 23, Last appended: 37.23, Last appended by leader: 23, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
W20260709 12:14:50.239352 27133 consensus_peers.cc:597] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:50.240016 27133 leader_election.cc:336] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:50.239639 26587 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd; no voters: 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:50.240566 27133 leader_election.cc:304] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:50.226411  5547 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:50.241677  5546 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
W20260709 12:14:50.251317 27133 leader_election.cc:336] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:50.252163 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:50.252734  5592 raft_consensus.cc:2749] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:50.254249  5512 ts_tablet_manager.cc:1434] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.000s
W20260709 12:14:50.255756 27133 leader_election.cc:336] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:50.255911  5546 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
I20260709 12:14:50.257620 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:50.258446  5546 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:50.264264  5575 raft_consensus.cc:2804] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:14:50.264870  5575 raft_consensus.cc:697] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:50.267691 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:50.269811 26587 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:50.274932  5593 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:14:50.278620 26632 tablet_copy_service.cc:342] P aaadfdd9ca9f424c91505f9b43876233: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-f9abba0c7cca40c4b2a9ffbcde803684 received from {username='slave'} at 127.0.0.1:48232
I20260709 12:14:50.279245 26632 tablet_copy_service.cc:434] P aaadfdd9ca9f424c91505f9b43876233: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-f9abba0c7cca40c4b2a9ffbcde803684 on tablet f9abba0c7cca40c4b2a9ffbcde803684 with peer 3262bf0553e543eea76794fc529a9acc
I20260709 12:14:50.282321  5593 raft_consensus.cc:2749] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election lost for term 35. Reason: could not achieve majority
I20260709 12:14:50.283171  5556 raft_consensus.cc:2955] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Committing config change with OpId 32.23: config changed from index 22 to 23, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:50.285215  5559 raft_consensus.cc:1064] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:14:50.265800  5575 consensus_queue.cc:237] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 30.22, Last appended by leader: 22, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:50.309217 27159 raft_consensus.cc:2955] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Committing config change with OpId 32.23: config changed from index 22 to 23, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:50.322034  5582 tablet_copy_client.cc:806] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:50.317566  5559 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 16, Current term: 27, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:50.328990 26587 leader_election.cc:336] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:50.329612 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:50.330449  5596 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
I20260709 12:14:50.329843  5582 tablet_copy_client.cc:670] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:50.331282 27161 raft_consensus.cc:1217] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc [term 37 LEARNER]: Deduplicated request from leader. Original: 37.22->[37.23-37.23]   Dedup: 37.23->[]
W20260709 12:14:50.344278 27133 consensus_peers.cc:597] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:50.387882 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 52258us
I20260709 12:14:50.389681 26544 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:14:50.417876 27161 raft_consensus.cc:1275] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:14:50.384091 26540 raft_consensus.cc:2955] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Committing config change with OpId 32.23: config changed from index 22 to 23, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:14:50.410563 27189 debug-util.cc:398] Leaking SignalData structure 0x7b0800137700 after lost signal to thread 25296
W20260709 12:14:50.421329 27189 debug-util.cc:398] Leaking SignalData structure 0x7b0800321620 after lost signal to thread 26405
I20260709 12:14:50.421967 27159 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc [term 27 LEARNER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:14:50.421602 26365 catalog_manager.cc:5697] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 22 to 23, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 32 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:14:50.424191 27189 debug-util.cc:398] Leaking SignalData structure 0x7b08000d0440 after lost signal to thread 26572
I20260709 12:14:50.424376 26364 catalog_manager.cc:5697] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 30 to 31, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 31 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:50.430824 27189 debug-util.cc:398] Leaking SignalData structure 0x7b080019be20 after lost signal to thread 26646
W20260709 12:14:50.452644 27189 debug-util.cc:398] Leaking SignalData structure 0x7b08000b47a0 after lost signal to thread 27192
I20260709 12:14:50.433635 26548 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:14:50.437898 26622 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Rejecting Update request from peer 3262bf0553e543eea76794fc529a9acc for earlier term 34. Current term is 35. Ops: []
I20260709 12:14:50.437924  5575 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:50.438911  5596 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:50.466054  5592 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 34.22, Next index: 23, Last known committed idx: 22, Time since last communication: 0.007s
I20260709 12:14:50.477392  5546 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 34 LEADER]: Stepping down as leader of term 34
I20260709 12:14:50.477941  5546 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 34 LEADER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:50.479562  5546 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 34.22, Last appended by leader: 22, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:50.481349  5546 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 34 FOLLOWER]: Advancing to term 35
W20260709 12:14:50.521021 26587 consensus_peers.cc:597] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:50.523258 26587 consensus_peers.cc:597] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:50.555032  5594 consensus_queue.cc:1048] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:50.558727  5594 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 12:14:50.579723 26587 consensus_peers.cc:597] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:50.605187  5582 tablet_copy_client.cc:538] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:50.707219  5582 tablet_bootstrap.cc:492] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc: Bootstrap starting.
W20260709 12:14:50.725152 27133 consensus_peers.cc:597] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:50.755640 27133 consensus_peers.cc:597] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:50.759208 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 64975.9us
I20260709 12:14:50.784823  5559 raft_consensus.cc:2955] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Committing config change with OpId 27.19: config changed from index 18 to 19, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:14:50.787395 27133 consensus_peers.cc:597] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:50.788022 27133 consensus_peers.cc:597] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:50.849502 26542 raft_consensus.cc:2955] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Committing config change with OpId 27.19: config changed from index 18 to 19, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:50.852131 26544 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 22. Preceding OpId from leader: term: 31 index: 23. (index mismatch)
I20260709 12:14:50.858601 27163 raft_consensus.cc:2955] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Committing config change with OpId 27.19: config changed from index 18 to 19, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:14:50.862985 27133 consensus_peers.cc:597] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:50.871971 26364 catalog_manager.cc:5697] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index 18 to 19, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 27 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:50.883327 26587 consensus_peers.cc:597] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:50.889683 25293 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 26494)
I20260709 12:14:50.896606 26622 consensus_queue.cc:237] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:50.930055 26513 consensus_peers.cc:597] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:50.931977  5575 raft_consensus.cc:1064] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
I20260709 12:14:50.936996  5575 consensus_queue.cc:237] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 37.23, Last appended by leader: 21, Current term: 37, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:50.940940 27163 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 12:14:50.944677  5563 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:14:50.957564  5556 raft_consensus.cc:2955] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Committing config change with OpId 27.20: config changed from index 19 to 20, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:50.967571  5594 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.001s
I20260709 12:14:50.966017 27160 raft_consensus.cc:2955] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Committing config change with OpId 27.20: config changed from index 19 to 20, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:14:50.983049 26513 consensus_peers.cc:597] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:51.023733 27163 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc [term 37 LEARNER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 37 index: 23. Preceding OpId from leader: term: 37 index: 24. (index mismatch)
I20260709 12:14:51.025924  5594 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.001s
I20260709 12:14:51.027940 26542 raft_consensus.cc:1275] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 12:14:51.056809 26358 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 63a71194fb3446e6b7b3135fde882816 with cas_config_opid_index 19: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:51.064734 27163 raft_consensus.cc:3060] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:14:51.075526 26513 consensus_peers.cc:597] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:51.078328 27163 raft_consensus.cc:1275] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 30 index: 22. Preceding OpId from leader: term: 31 index: 23. (index mismatch)
I20260709 12:14:51.085920  5555 consensus_queue.cc:1048] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.001s
I20260709 12:14:51.088879 26365 catalog_manager.cc:5697] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: config changed from index 19 to 20, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New cstate: current_term: 27 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:51.146559 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 63557.8us
W20260709 12:14:51.152526  5612 log.cc:927] Time spent T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 12:14:51.158826 26586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:51.172470  5582 log.cc:927] Time spent T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc: Append to log took a long time: real 0.102s	user 0.003s	sys 0.009s
W20260709 12:14:51.173357  5587 log.cc:927] Time spent T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: Append to log took a long time: real 0.076s	user 0.010s	sys 0.011s
W20260709 12:14:51.202739 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55385.4us
I20260709 12:14:51.205687  5556 consensus_queue.cc:1048] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:14:51.214056 26548 raft_consensus.cc:1275] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 37 index: 23. Preceding OpId from leader: term: 37 index: 24. (index mismatch)
W20260709 12:14:51.242244 26513 consensus_peers.cc:597] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:51.267432 26587 consensus_peers.cc:597] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:51.268311 26587 consensus_peers.cc:597] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:51.272794 26548 raft_consensus.cc:2955] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Committing config change with OpId 27.20: config changed from index 19 to 20, VOTER 01a57027214a411e80874ac7febd628b (127.24.179.65) evicted. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:51.292595  5615 consensus_queue.cc:1048] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.001s
W20260709 12:14:51.314843 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 61236.5us
I20260709 12:14:51.316301  5582 tablet_bootstrap.cc:492] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc: Bootstrap replayed 1/1 log segments. Stats: ops{read=27 overwritten=2 applied=25 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:51.318081  5582 tablet_bootstrap.cc:492] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc: Bootstrap complete.
W20260709 12:14:51.326308 26587 consensus_peers.cc:597] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.330513  5582 ts_tablet_manager.cc:1403] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc: Time spent bootstrapping tablet: real 0.628s	user 0.075s	sys 0.029s
W20260709 12:14:51.330772 26587 consensus_peers.cc:597] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:51.334582  5582 raft_consensus.cc:359] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [term 37 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:14:51.335673  5582 raft_consensus.cc:740] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [term 37 LEARNER]: Becoming Follower/Learner. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Initialized, Role: LEARNER
I20260709 12:14:51.336585  5582 consensus_queue.cc:260] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 25, Last appended: 37.25, Last appended by leader: 25, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } }
I20260709 12:14:51.343235  5582 ts_tablet_manager.cc:1434] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
W20260709 12:14:51.346735 26357 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 69666.3us
W20260709 12:14:51.372324 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 47500.7us
W20260709 12:14:51.376094 26357 catalog_manager.cc:4755] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 63a71194fb3446e6b7b3135fde882816: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:51.401518 26587 consensus_peers.cc:597] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:51.402917 26587 consensus_peers.cc:597] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:51.465178 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 83118.3us
W20260709 12:14:51.466418 26587 consensus_peers.cc:597] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:51.467218 26587 consensus_peers.cc:597] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:51.481389  5596 raft_consensus.cc:2955] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Committing config change with OpId 37.24: config changed from index 23 to 24, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:51.491972 27163 raft_consensus.cc:2955] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Committing config change with OpId 37.24: config changed from index 23 to 24, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:51.499385 27161 raft_consensus.cc:1217] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [term 37 LEARNER]: Deduplicated request from leader. Original: 37.24->[37.25-37.25]   Dedup: 37.25->[]
I20260709 12:14:51.537544 26542 raft_consensus.cc:2955] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Committing config change with OpId 37.24: config changed from index 23 to 24, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:51.541524 26367 catalog_manager.cc:5697] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc reported cstate change: config changed from index 23 to 24, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 37 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
W20260709 12:14:51.552004 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 53881.4us
I20260709 12:14:51.561837 26558 tablet_copy_service.cc:342] P ac3ac2181aa941229a758ccf6b5607cd: Request end of tablet copy session 3262bf0553e543eea76794fc529a9acc-6598ff9cfd5346af8da1e9928f3a5ac9 received from {username='slave'} at 127.0.0.1:44706
I20260709 12:14:51.562434 26558 tablet_copy_service.cc:434] P ac3ac2181aa941229a758ccf6b5607cd: ending tablet copy session 3262bf0553e543eea76794fc529a9acc-6598ff9cfd5346af8da1e9928f3a5ac9 on tablet 6598ff9cfd5346af8da1e9928f3a5ac9 with peer 3262bf0553e543eea76794fc529a9acc
W20260709 12:14:51.605628 26513 consensus_peers.cc:597] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.622994 26587 consensus_peers.cc:597] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:51.644155 27133 consensus_peers.cc:597] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:51.693820 26513 consensus_peers.cc:597] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:51.725281 26513 consensus_peers.cc:597] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:51.726233 26513 consensus_peers.cc:597] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:51.763597  5626 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:51.768615  5626 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:51.778817 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 52622.6us
I20260709 12:14:51.783425 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:51.805931 26622 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 28: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:51.784981  5626 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:51.789772 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:51.810312 27163 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
W20260709 12:14:51.804965 27133 consensus_peers.cc:597] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:51.811796 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:51.813045  5626 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:14:51.813506  5626 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:51.813952  5626 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:14:51.858716 26587 consensus_peers.cc:597] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:51.859715 26587 consensus_peers.cc:597] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:51.860345 26587 consensus_peers.cc:597] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:51.867488 26513 consensus_peers.cc:597] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:51.877547 26587 consensus_peers.cc:597] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:51.888784  5626 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:51.891976 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:51.892877 26622 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 28: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:14:51.907335 25293 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 26494)
I20260709 12:14:51.911036  5626 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:51.912724 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:14:51.925431 26513 consensus_peers.cc:597] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:51.928524 27163 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 28.
I20260709 12:14:51.929754 26514 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:51.931339  5619 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:14:51.931908  5619 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:51.935488  5619 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:51.945181  5621 raft_consensus.cc:1064] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: attempting to promote NON_VOTER 3262bf0553e543eea76794fc529a9acc to VOTER
W20260709 12:14:51.949129 26513 consensus_peers.cc:597] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:51.953238  5621 consensus_queue.cc:237] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 37.25, Last appended by leader: 23, Current term: 37, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:51.956912 26587 consensus_peers.cc:597] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:51.974833 26622 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 37 index: 25. Preceding OpId from leader: term: 37 index: 26. (index mismatch)
I20260709 12:14:51.979276  5573 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.001s
I20260709 12:14:51.985888 27163 raft_consensus.cc:1275] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [term 37 LEARNER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 37 index: 25. Preceding OpId from leader: term: 37 index: 26. (index mismatch)
I20260709 12:14:51.991564  5573 consensus_queue.cc:1048] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.001s
W20260709 12:14:51.988320 26513 consensus_peers.cc:597] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:51.996901 26365 catalog_manager.cc:5697] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 27 to 28, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 28 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:52.025645 26513 consensus_peers.cc:597] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.040866  5573 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:52.041465  5573 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:52.043891  5573 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:52.047952 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:52.050272 27161 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
I20260709 12:14:52.052021 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:52.053042 26622 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 35: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:52.062695 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: 
I20260709 12:14:52.069706  5622 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:14:52.072275  5622 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Starting leader election (detected failure of leader 3262bf0553e543eea76794fc529a9acc)
I20260709 12:14:52.072702  5622 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Advancing to term 35
W20260709 12:14:52.084895 26513 consensus_peers.cc:597] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:52.088241 26513 consensus_peers.cc:597] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.096758 26513 consensus_peers.cc:597] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:52.113018  5622 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:52.137446 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:52.138289 26622 raft_consensus.cc:2393] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate ac3ac2181aa941229a758ccf6b5607cd in current term 35: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:52.146075  5621 raft_consensus.cc:2955] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 37 LEADER]: Committing config change with OpId 37.26: config changed from index 25 to 26, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:52.152613 27163 raft_consensus.cc:2955] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Committing config change with OpId 37.26: config changed from index 25 to 26, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:52.161840  5622 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 election: Requested vote from peers aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:52.164044 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "ac3ac2181aa941229a758ccf6b5607cd" candidate_term: 35 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
W20260709 12:14:52.196377 27133 consensus_peers.cc:597] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:14:52.216001 26622 raft_consensus.cc:2955] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Committing config change with OpId 37.26: config changed from index 25 to 26, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } } }
I20260709 12:14:52.227391 26365 catalog_manager.cc:5697] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: config changed from index 25 to 26, 3262bf0553e543eea76794fc529a9acc (127.24.179.68) changed from NON_VOTER to VOTER. New cstate: current_term: 37 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:52.222882 27161 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac3ac2181aa941229a758ccf6b5607cd in term 35.
I20260709 12:14:52.255468 26514 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:52.256498  5621 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:14:52.257270  5621 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 35 LEADER]: Becoming Leader. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:52.258330  5621 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 34.22, Last appended by leader: 22, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:52.262614 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55783.6us
W20260709 12:14:52.259047 27133 consensus_peers.cc:597] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:52.280520  5555 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.280821  5575 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.281530  5575 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:52.281243  5555 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:52.285228  5555 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:52.292455 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:52.294430  5575 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:52.293316 27161 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 28.
I20260709 12:14:52.296752 26588 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:52.298375 27163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:52.305264 27163 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 35.
I20260709 12:14:52.307760 26588 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:52.308645  5596 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:52.309096  5596 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:52.309443  5596 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:14:52.321237 27133 consensus_peers.cc:597] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:52.326638  5555 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:52.327179  5555 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:52.327594  5555 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:52.315196 26364 catalog_manager.cc:5697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd reported cstate change: term changed from 34 to 35, leader changed from 3262bf0553e543eea76794fc529a9acc (127.24.179.68) to ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66). New cstate: current_term: 35 leader_uuid: "ac3ac2181aa941229a758ccf6b5607cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:52.335139  5596 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:52.336719 27163 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Refusing update from remote peer ac3ac2181aa941229a758ccf6b5607cd: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:14:52.338615  5622 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 12:14:52.350831 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 78539.5us
I20260709 12:14:52.358899  5555 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:52.367980  5596 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:52.372426  5555 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:52.377696 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:52.380748 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc"
I20260709 12:14:52.381420 27160 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:52.394309 27160 raft_consensus.cc:2468] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaadfdd9ca9f424c91505f9b43876233 in term 36.
I20260709 12:14:52.396013 26588 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 
I20260709 12:14:52.397037  5596 raft_consensus.cc:2804] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:14:52.397593  5596 raft_consensus.cc:697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 36 LEADER]: Becoming Leader. State: Replica: aaadfdd9ca9f424c91505f9b43876233, State: Running, Role: LEADER
I20260709 12:14:52.398577  5596 consensus_queue.cc:237] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 34.22, Last appended by leader: 22, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:52.417343 26622 raft_consensus.cc:1240] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 28. Current term is 29. Ops: []
I20260709 12:14:52.422614  5621 consensus_queue.cc:1059] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:14:52.423766  5622 raft_consensus.cc:3055] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:14:52.424222  5622 raft_consensus.cc:740] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 28 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:52.422210 26364 catalog_manager.cc:5697] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 reported cstate change: term changed from 35 to 36, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67). New cstate: current_term: 36 leader_uuid: "aaadfdd9ca9f424c91505f9b43876233" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:52.425093  5622 consensus_queue.cc:260] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:52.426559  5622 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:52.451593 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
W20260709 12:14:52.456276 26587 consensus_peers.cc:597] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:52.458119 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:52.476349 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:52.477789 26540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e7c4f1de5d4e28a4c1bf09d4fb099b" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 36 candidate_status { last_received { term: 34 index: 22 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
W20260709 12:14:52.489365 26587 consensus_peers.cc:597] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:52.516320 26513 consensus_peers.cc:597] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:52.532038 26541 raft_consensus.cc:2410] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 29 because replica has last-logged OpId of term: 28 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 17.
I20260709 12:14:52.574194 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:52.576753  5596 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260709 12:14:52.593850 27133 consensus_peers.cc:597] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:52.604115 26587 consensus_peers.cc:597] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.683635 26587 consensus_peers.cc:597] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.689245 26587 consensus_peers.cc:597] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.691018 26357 catalog_manager.cc:4755] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 63a71194fb3446e6b7b3135fde882816: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:14:52.730351 26617 raft_consensus.cc:1240] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 36 LEADER]: Rejecting Update request from peer ac3ac2181aa941229a758ccf6b5607cd for earlier term 35. Current term is 36. Ops: []
I20260709 12:14:52.733156  5622 consensus_queue.cc:1059] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260709 12:14:52.733959  5622 consensus_queue.cc:1243] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [LEADER]: Peer aaadfdd9ca9f424c91505f9b43876233 log is divergent from this leader: its last log entry 36.23 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 22
I20260709 12:14:52.734555  5622 raft_consensus.cc:3055] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 35 LEADER]: Stepping down as leader of term 35
I20260709 12:14:52.734921  5622 raft_consensus.cc:740] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 35 LEADER]: Becoming Follower/Learner. State: Replica: ac3ac2181aa941229a758ccf6b5607cd, State: Running, Role: LEADER
I20260709 12:14:52.736310  5622 consensus_queue.cc:260] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 35.23, Last appended by leader: 23, Current term: 35, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:52.737768  5622 raft_consensus.cc:3060] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:52.904834 26544 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 35 index: 23. Preceding OpId from leader: term: 36 index: 23. (term mismatch)
I20260709 12:14:52.905282 26544 pending_rounds.cc:85] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Aborting all ops after (but not including) 22
I20260709 12:14:52.905510 26544 pending_rounds.cc:107] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: Aborting uncommitted NO_OP operation due to leader change: 35.23
I20260709 12:14:52.905810 26544 raft_consensus.cc:2889] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:52.907882 25293 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 26494)
I20260709 12:14:52.908914  5632 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.001s
I20260709 12:14:52.921686 27163 raft_consensus.cc:1275] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Refusing update from remote peer aaadfdd9ca9f424c91505f9b43876233: Log matching property violated. Preceding OpId in replica: term: 34 index: 22. Preceding OpId from leader: term: 36 index: 23. (index mismatch)
I20260709 12:14:52.924897  5632 consensus_queue.cc:1048] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
W20260709 12:14:52.972316 27133 consensus_peers.cc:597] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:53.010984 27133 consensus_peers.cc:597] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:53.137598 26587 consensus_peers.cc:597] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:53.152729 26587 consensus_peers.cc:597] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:53.157323 27133 consensus_peers.cc:597] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:53.164508 26587 consensus_peers.cc:597] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:53.204555 27133 consensus_peers.cc:597] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:53.234201 27133 consensus_peers.cc:597] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:53.359516 26513 consensus_peers.cc:597] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:53.474457 26587 consensus_peers.cc:597] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:53.486753 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 46857.4us
W20260709 12:14:53.531659 26513 consensus_peers.cc:597] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:53.518532 27133 consensus_peers.cc:597] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:53.544891 26513 consensus_peers.cc:597] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:53.559303 26513 consensus_peers.cc:597] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:53.593978 26513 consensus_peers.cc:597] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:53.601730 27133 consensus_peers.cc:597] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:53.733995 26357 catalog_manager.cc:4755] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 63a71194fb3446e6b7b3135fde882816: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:53.756981 26587 consensus_peers.cc:597] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:53.784336 26587 consensus_peers.cc:597] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:53.813443 26587 consensus_peers.cc:597] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:53.908464 25293 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 26494)
I20260709 12:14:53.934783  5624 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:53.935546  5624 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:53.940889 26587 consensus_peers.cc:597] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:53.943581  5624 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:53.945560 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:14:53.946844 26622 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 29: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
W20260709 12:14:53.950348 26513 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111) [suppressed 487 similar messages]
I20260709 12:14:53.957007 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:53.957787 26544 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 29.
I20260709 12:14:53.969063 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:53.970073  5624 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:53.971313  5624 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting leader election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:14:53.971751  5624 raft_consensus.cc:3060] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:14:53.986783 26587 consensus_peers.cc:597] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:53.990996 26587 consensus_peers.cc:597] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:14:54.001351  5624 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:53.996001 26513 consensus_peers.cc:597] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:14:54.043746  5624 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 election: Requested vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:14:54.044773 26622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233"
I20260709 12:14:54.045599 26622 raft_consensus.cc:2393] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 3262bf0553e543eea76794fc529a9acc in current term 29: Already voted for candidate aaadfdd9ca9f424c91505f9b43876233 in this term.
I20260709 12:14:54.048074 26544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd"
I20260709 12:14:54.067248 26544 raft_consensus.cc:2468] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 29.
I20260709 12:14:54.118711 27133 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd; no voters: aaadfdd9ca9f424c91505f9b43876233
I20260709 12:14:54.132617  5624 raft_consensus.cc:2804] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:14:54.133553  5624 raft_consensus.cc:697] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 29 LEADER]: Becoming Leader. State: Replica: 3262bf0553e543eea76794fc529a9acc, State: Running, Role: LEADER
I20260709 12:14:54.134654  5624 consensus_queue.cc:237] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:14:54.172554 26513 consensus_peers.cc:597] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:54.182044 26587 consensus_peers.cc:597] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:54.183629 26364 catalog_manager.cc:5697] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc reported cstate change: term changed from 28 to 29, leader changed from ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66) to 3262bf0553e543eea76794fc529a9acc (127.24.179.68). New cstate: current_term: 29 leader_uuid: "3262bf0553e543eea76794fc529a9acc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:54.260684 26513 consensus_peers.cc:597] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:54.286916 27133 consensus_peers.cc:597] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:54.292667 26513 consensus_peers.cc:597] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:54.300446 26587 consensus_peers.cc:597] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:54.314569 26513 consensus_peers.cc:597] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:54.318512 26587 consensus_peers.cc:597] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:54.525189 26513 consensus_peers.cc:597] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:54.544317 26513 consensus_peers.cc:597] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:54.549233 26513 consensus_peers.cc:597] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:54.602293  5652 raft_consensus.cc:493] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.603101  5652 raft_consensus.cc:515] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:14:54.605535  5652 leader_election.cc:290] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:14:54.606822 27161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:14:54.631809 26622 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
W20260709 12:14:54.632002 26513 consensus_peers.cc:597] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:14:54.637832  5624 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 12:14:54.639631 26513 consensus_peers.cc:597] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:54.639907 27133 consensus_peers.cc:597] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:14:54.656243 26541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff21e283775e459c8757d4d1c245c531" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ac3ac2181aa941229a758ccf6b5607cd" is_pre_election: true
I20260709 12:14:54.657401 26541 raft_consensus.cc:2410] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaadfdd9ca9f424c91505f9b43876233 for term 30 because replica has last-logged OpId of term: 28 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 17.
I20260709 12:14:54.699165 26587 leader_election.cc:304] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 3262bf0553e543eea76794fc529a9acc, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:14:54.702312  5659 raft_consensus.cc:2749] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:14:54.706139 26587 consensus_peers.cc:597] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:54.738795 26587 consensus_peers.cc:597] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:54.739562 26587 consensus_peers.cc:597] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:54.746904 26541 raft_consensus.cc:1275] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Refusing update from remote peer 3262bf0553e543eea76794fc529a9acc: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:14:54.750023  5663 consensus_queue.cc:1048] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 12:14:54.756006 27133 consensus_peers.cc:597] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:54.774346 26587 consensus_peers.cc:597] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:54.790802 26587 consensus_peers.cc:597] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:54.833782 27133 consensus_peers.cc:597] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:54.865463 26587 consensus_peers.cc:597] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:54.909026 25293 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 26494)
W20260709 12:14:54.956777 26587 consensus_peers.cc:597] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:55.045506 26513 consensus_peers.cc:597] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:55.051098 27133 consensus_peers.cc:597] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:55.312613 26587 consensus_peers.cc:597] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:55.374629 27133 consensus_peers.cc:597] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:55.551601 27133 consensus_peers.cc:597] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:55.608434 27133 consensus_peers.cc:597] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:55.704100 27133 consensus_peers.cc:597] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:55.777558 26587 consensus_peers.cc:597] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:55.819070 26513 consensus_peers.cc:597] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:55.830128 26587 consensus_peers.cc:597] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:55.842195 26513 consensus_peers.cc:597] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:55.843109 26357 catalog_manager.cc:4755] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 63a71194fb3446e6b7b3135fde882816: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:14:55.905045 26587 consensus_peers.cc:597] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:55.909642 25293 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 26494)
W20260709 12:14:55.930997 27133 consensus_peers.cc:597] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:56.008833 27133 consensus_peers.cc:597] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:56.082821 26513 consensus_peers.cc:597] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:56.089375 27133 consensus_peers.cc:597] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:56.097087 26513 consensus_peers.cc:597] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:56.146987 26513 consensus_peers.cc:597] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:56.274287 26587 consensus_peers.cc:597] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:56.274855 26587 consensus_peers.cc:597] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:56.275269 26587 consensus_peers.cc:597] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:56.334215 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 55906.8us
W20260709 12:14:56.338168 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 52719.2us
W20260709 12:14:56.341141 26587 consensus_peers.cc:597] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:56.361014 26513 consensus_peers.cc:597] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:56.425485 26587 consensus_peers.cc:597] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:56.538002 26587 consensus_peers.cc:597] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:56.595768 26587 consensus_peers.cc:597] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:56.632725 26513 consensus_peers.cc:597] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:56.651765 26587 consensus_peers.cc:597] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:56.663968 26587 consensus_peers.cc:597] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:56.705263 26587 consensus_peers.cc:597] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:56.768328 26513 consensus_peers.cc:597] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:56.887408 26513 consensus_peers.cc:597] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:56.910169 25293 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 26494)
W20260709 12:14:56.928131 26513 consensus_peers.cc:597] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:56.944262 26513 consensus_peers.cc:597] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:56.955155 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 64268.8us
W20260709 12:14:57.004841 26513 consensus_peers.cc:597] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:57.033872 26513 consensus_peers.cc:597] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:57.036316 26587 consensus_peers.cc:597] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:57.039534 26587 consensus_peers.cc:597] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:57.044430 27133 consensus_peers.cc:597] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:57.074515 27133 consensus_peers.cc:597] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:57.098598 26513 consensus_peers.cc:597] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:57.128055 26513 consensus_peers.cc:597] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:57.172839 26587 consensus_peers.cc:597] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:57.188417 27133 consensus_peers.cc:597] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:57.192070 26587 consensus_peers.cc:597] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:57.332382 27133 consensus_peers.cc:597] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:57.359688 27133 consensus_peers.cc:597] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:57.693241 26587 consensus_peers.cc:597] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:57.739215 26513 consensus_peers.cc:597] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:57.873960 26587 consensus_peers.cc:597] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:57.910784 25293 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 26494)
W20260709 12:14:57.987490 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 46496.4us
W20260709 12:14:57.997426 26514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:42217, user_credentials={real_user=slave}} blocked reactor thread for 49950.7us
W20260709 12:14:58.026849 27133 consensus_peers.cc:597] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:58.110078 27133 consensus_peers.cc:597] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:58.238483 26513 consensus_peers.cc:597] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:58.243131 27133 consensus_peers.cc:597] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:58.279487 27133 consensus_peers.cc:597] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:58.311018 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 49518.8us
W20260709 12:14:58.440917 26513 consensus_peers.cc:597] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:58.463754 27133 consensus_peers.cc:597] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:58.465579 26513 consensus_peers.cc:597] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:58.481324 26587 consensus_peers.cc:597] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:58.484556 26587 consensus_peers.cc:597] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:58.579501 26513 consensus_peers.cc:597] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:58.698192 27133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 49298.2us
W20260709 12:14:58.730641 27133 consensus_peers.cc:597] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:58.816334 27133 consensus_peers.cc:597] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:58.844975 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 58802.9us
W20260709 12:14:58.909157 26513 consensus_peers.cc:597] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:58.911312 25293 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 26494)
W20260709 12:14:58.952124 27133 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111) [suppressed 458 similar messages]
W20260709 12:14:58.971697 26513 consensus_peers.cc:597] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:59.072886 26513 consensus_peers.cc:597] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:59.272588 26587 consensus_peers.cc:597] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:59.286511 26587 consensus_peers.cc:597] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:59.290549 27133 consensus_peers.cc:597] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:59.275631 26513 consensus_peers.cc:597] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:59.396059 26513 consensus_peers.cc:597] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:59.407541 27133 consensus_peers.cc:597] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:59.428620 26587 consensus_peers.cc:597] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:59.429201 26587 consensus_peers.cc:597] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:59.457768 26587 consensus_peers.cc:597] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:59.458796 26587 consensus_peers.cc:597] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:59.459321 26587 consensus_peers.cc:597] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:59.548203 26513 consensus_peers.cc:597] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:59.624784 26587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:40567, user_credentials={real_user=slave}} blocked reactor thread for 60651.8us
W20260709 12:14:59.641386 26513 consensus_peers.cc:597] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:59.673220 26587 consensus_peers.cc:597] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:59.674371 26587 consensus_peers.cc:597] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:59.675112 26587 consensus_peers.cc:597] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:59.690908 26587 consensus_peers.cc:597] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:59.722170 26513 consensus_peers.cc:597] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:59.737267 26587 consensus_peers.cc:597] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:59.736639 26588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:35069, user_credentials={real_user=slave}} blocked reactor thread for 59418.1us
W20260709 12:14:59.744863 26513 consensus_peers.cc:597] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:59.745519 26513 consensus_peers.cc:597] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:59.756093 26587 consensus_peers.cc:597] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:59.757086 26513 consensus_peers.cc:597] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:59.902086 26587 consensus_peers.cc:597] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:59.912478 25293 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 26494)
W20260709 12:14:59.937652 27133 consensus_peers.cc:597] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:00.013772 26357 catalog_manager.cc:4755] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 63a71194fb3446e6b7b3135fde882816: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:00.021914 26587 consensus_peers.cc:597] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:00.034725 27133 consensus_peers.cc:597] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:00.071734 27133 consensus_peers.cc:597] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:00.094939 26587 consensus_peers.cc:597] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:00.119454 26513 consensus_peers.cc:597] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:00.388077 26587 consensus_peers.cc:597] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:00.497635 26587 consensus_peers.cc:597] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:00.498315 26587 consensus_peers.cc:597] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:00.511759 27133 consensus_peers.cc:597] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:00.684820 27133 consensus_peers.cc:597] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:00.759583 27133 consensus_peers.cc:597] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:00.783684 26513 consensus_peers.cc:597] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:00.811201 27133 consensus_peers.cc:597] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:00.913259 25293 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 26494)
W20260709 12:15:00.959757 26513 consensus_peers.cc:597] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:00.967015 26587 consensus_peers.cc:597] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:01.046808 26513 consensus_peers.cc:597] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:01.079571 26513 consensus_peers.cc:597] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:01.166205 26513 consensus_peers.cc:597] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:01.219318 26513 consensus_peers.cc:597] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:01.301946 27133 consensus_peers.cc:597] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:01.327898 26587 consensus_peers.cc:597] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:01.339239 26587 consensus_peers.cc:597] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:01.360321 27133 consensus_peers.cc:597] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:01.383111 27133 consensus_peers.cc:597] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:01.421808 26587 consensus_peers.cc:597] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:01.538324 26357 catalog_manager.cc:4755] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cff430729a9d4c8183d8ddad129d6ecf: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:01.558272 26587 consensus_peers.cc:597] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:01.619712 27133 consensus_peers.cc:597] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:01.690168 26587 consensus_peers.cc:597] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:01.710117 26587 consensus_peers.cc:597] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:01.770169 27133 consensus_peers.cc:597] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:01.865209 26587 consensus_peers.cc:597] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:01.913888 25293 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 26494)
W20260709 12:15:01.948590 26587 consensus_peers.cc:597] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:02.003424 26587 consensus_peers.cc:597] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:02.061599 26587 consensus_peers.cc:597] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:02.119005 26587 consensus_peers.cc:597] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:02.166508 26587 consensus_peers.cc:597] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:02.211717 26587 consensus_peers.cc:597] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:02.218294 26587 consensus_peers.cc:597] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:02.313103 26587 consensus_peers.cc:597] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:02.447520 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 47283.1us
W20260709 12:15:02.491140 26513 consensus_peers.cc:597] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:02.492252 26513 consensus_peers.cc:597] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:02.530237 27133 consensus_peers.cc:597] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:02.544601 26513 consensus_peers.cc:597] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:02.573514 26587 consensus_peers.cc:597] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:02.631503 27133 consensus_peers.cc:597] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:02.693070 27133 consensus_peers.cc:597] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:02.721423 26513 consensus_peers.cc:597] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:02.787992 26513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:45149, user_credentials={real_user=slave}} blocked reactor thread for 50420.6us
W20260709 12:15:02.797112 26513 consensus_peers.cc:597] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:02.805145 26513 consensus_peers.cc:597] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:02.931766 26513 consensus_peers.cc:597] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:02.987896 26587 consensus_peers.cc:597] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:03.021147 26587 consensus_peers.cc:597] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:03.169101 27133 consensus_peers.cc:597] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:03.278533 26513 consensus_peers.cc:597] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:03.342339 26587 consensus_peers.cc:597] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:03.374444 27133 consensus_peers.cc:597] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:03.375702 27133 consensus_peers.cc:597] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:03.420270 26587 consensus_peers.cc:597] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:03.420907 27133 consensus_peers.cc:597] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:03.421000 26587 consensus_peers.cc:597] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:03.426643 26513 consensus_peers.cc:597] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:03.484822 26587 consensus_peers.cc:597] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:03.515177 26513 consensus_peers.cc:597] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:15:03.515760 25293 tablet_server.cc:196] TabletServer@127.24.179.65:0 shutdown complete.
I20260709 12:15:03.679275 25293 tablet_server.cc:179] TabletServer@127.24.179.66:0 shutting down...
W20260709 12:15:03.693542 26587 consensus_peers.cc:597] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:03.694543 26587 consensus_peers.cc:597] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:03.741711 26587 consensus_peers.cc:597] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:03.746573 26587 consensus_peers.cc:597] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:03.747324 27133 consensus_peers.cc:597] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:03.795938 26587 consensus_peers.cc:597] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:03.797140 26587 consensus_peers.cc:597] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:03.800761 26587 consensus_peers.cc:597] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:03.805300 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:03.806741 25293 tablet_replica.cc:333] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.807835 25293 raft_consensus.cc:2243] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:03.808530 26587 consensus_peers.cc:597] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:03.808828 25293 raft_consensus.cc:2272] T dee06ad5f38b42f99fdbc1d71eee680f P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.812163 25293 tablet_replica.cc:333] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.813197 25293 raft_consensus.cc:2243] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 31 LEADER]: Raft consensus shutting down.
I20260709 12:15:03.814908 25293 raft_consensus.cc:2272] T 02fc28e9bbd743569e5c7c101c4688fb P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.818156 25293 tablet_replica.cc:333] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.819195 25293 raft_consensus.cc:2243] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.819991 25293 raft_consensus.cc:2272] T f90484c8608940e99361799cdda3a0f7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.823093 25293 tablet_replica.cc:333] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.824232 25293 raft_consensus.cc:2243] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.825130 25293 raft_consensus.cc:2272] T 12729361d003466aada20ab37328d285 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.828768 25293 tablet_replica.cc:333] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.829919 25293 raft_consensus.cc:2243] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.831001 25293 raft_consensus.cc:2272] T d2e173b367e6460b8f654b2de1aabfae P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:03.831593 26569 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba940 after lost signal to thread 25296
W20260709 12:15:03.833091 26569 debug-util.cc:398] Leaking SignalData structure 0x7b080019f400 after lost signal to thread 26405
I20260709 12:15:03.834055 25293 tablet_replica.cc:333] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.835175 25293 raft_consensus.cc:2243] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:03.835413 26587 consensus_peers.cc:597] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:03.835951 25293 raft_consensus.cc:2272] T 953d8c981a6c459f8b7f3dbbb66fda45 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:03.837932 26587 consensus_peers.cc:597] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:03.839151 25293 tablet_replica.cc:333] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
W20260709 12:15:03.840134 26569 debug-util.cc:398] Leaking SignalData structure 0x7b080035bf80 after lost signal to thread 26572
I20260709 12:15:03.840165 25293 raft_consensus.cc:2243] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:03.841676 26569 debug-util.cc:398] Leaking SignalData structure 0x7b080036baa0 after lost signal to thread 26646
I20260709 12:15:03.841917 25293 raft_consensus.cc:2272] T 1a2747b6998c418ab70cbcbd2f2deeaa P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:03.842919 26587 consensus_peers.cc:597] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:03.844116 26569 debug-util.cc:398] Leaking SignalData structure 0x7b080033c140 after lost signal to thread 27192
I20260709 12:15:03.845485 25293 tablet_replica.cc:333] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.846454 25293 raft_consensus.cc:2243] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 34 LEADER]: Raft consensus shutting down.
I20260709 12:15:03.847925 25293 raft_consensus.cc:2272] T d6e6ed3d8ee44750a4d06294867e92bc P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:03.850608 26587 consensus_peers.cc:597] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:03.851915 25293 tablet_replica.cc:333] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.854054 25293 raft_consensus.cc:2243] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.854795 25293 raft_consensus.cc:2272] T d1ee0545deb746aeb5c1c14751b96826 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.857627 25293 tablet_replica.cc:333] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.858620 25293 raft_consensus.cc:2243] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 38 LEADER]: Raft consensus shutting down.
I20260709 12:15:03.860188 25293 raft_consensus.cc:2272] T 67d6a6aed08548acab4272e6f5f1480a P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.863485 25293 tablet_replica.cc:333] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.864470 25293 raft_consensus.cc:2243] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.865180 25293 raft_consensus.cc:2272] T 75c9184ee6b7472fb72209c9dfd651b6 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.868852 25293 tablet_replica.cc:333] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.869827 25293 raft_consensus.cc:2243] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.870613 25293 raft_consensus.cc:2272] T ceda449be0d044e0b465f42ed3047751 P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:03.871125 26587 consensus_peers.cc:597] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:15:03.874212 25293 tablet_replica.cc:333] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.875371 25293 raft_consensus.cc:2243] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.876559 25293 raft_consensus.cc:2272] T 3288c98248464af5b8f3227349002ec7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.879604 25293 tablet_replica.cc:333] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.881699 25293 raft_consensus.cc:2243] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.882510 25293 raft_consensus.cc:2272] T b9bd8978cfc74b93bcc4755ec8254fa7 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.885444 25293 tablet_replica.cc:333] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.886363 25293 raft_consensus.cc:2243] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.887641 25293 raft_consensus.cc:2272] T f3c1161f4dab4d0e9f9b0053e38dfe10 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.890841 25293 tablet_replica.cc:333] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
W20260709 12:15:03.891093 27133 consensus_peers.cc:597] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:03.891798 25293 raft_consensus.cc:2243] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.892648 25293 raft_consensus.cc:2272] T c22baf3ebbed46a6a23a4c6cfd24710b P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.895618 25293 tablet_replica.cc:333] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.897192 25293 raft_consensus.cc:2243] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 34 LEADER]: Raft consensus shutting down.
I20260709 12:15:03.898681 25293 raft_consensus.cc:2272] T 5c23e0d03a4d457fa50856e09fe2f649 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.901700 25293 tablet_replica.cc:333] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.902594 25293 raft_consensus.cc:2243] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.903551 25293 raft_consensus.cc:2272] T 5fceaa32ed834cedaeb85b54a55fc4ed P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.906561 25293 tablet_replica.cc:333] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.907562 25293 raft_consensus.cc:2243] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.908447 25293 raft_consensus.cc:2272] T 34b9da257a1d4dadbbe3027844b5b140 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.911330 25293 tablet_replica.cc:333] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.912266 25293 raft_consensus.cc:2243] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.913190 25293 raft_consensus.cc:2272] T fce5ecc0a3714c80861557f318edce9d P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.916188 25293 tablet_replica.cc:333] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.917878 25293 raft_consensus.cc:2243] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.918687 25293 raft_consensus.cc:2272] T 366874f8c4424fa2a9f169e9c3d6e97e P ac3ac2181aa941229a758ccf6b5607cd [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.921543 25293 tablet_replica.cc:333] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.922506 25293 raft_consensus.cc:2243] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.923287 25293 raft_consensus.cc:2272] T 2fc3920d73734952bc159eff19f3567d P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.926229 25293 tablet_replica.cc:333] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.927269 25293 raft_consensus.cc:2243] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 38 LEADER]: Raft consensus shutting down.
I20260709 12:15:03.928885 25293 raft_consensus.cc:2272] T 78002f4d800445a3befddbc1cce2750d P ac3ac2181aa941229a758ccf6b5607cd [term 38 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.931948 25293 tablet_replica.cc:333] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.932879 25293 raft_consensus.cc:2243] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 40 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.933611 25293 raft_consensus.cc:2272] T ea50d3c1de374dff938c733fb02faf8c P ac3ac2181aa941229a758ccf6b5607cd [term 40 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.937098 25293 tablet_replica.cc:333] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.938000 25293 raft_consensus.cc:2243] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Raft consensus shutting down.
I20260709 12:15:03.940074 25293 raft_consensus.cc:2272] T ffdceca3c04a40cdba75f01fa9ded9f8 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:03.942643 27133 consensus_peers.cc:597] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:15:03.943147 25293 tablet_replica.cc:333] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.944097 25293 raft_consensus.cc:2243] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.945009 25293 raft_consensus.cc:2272] T ad6ce9ef10d748ecbe957fb8e6de47b0 P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.948110 25293 tablet_replica.cc:333] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.949047 25293 raft_consensus.cc:2243] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.950021 25293 raft_consensus.cc:2272] T 6d235a62666644668508e208ad8d21d3 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.952898 25293 tablet_replica.cc:333] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.953801 25293 raft_consensus.cc:2243] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 31 LEADER]: Raft consensus shutting down.
W20260709 12:15:03.954285 26587 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 483 similar messages]
I20260709 12:15:03.955255 25293 raft_consensus.cc:2272] T 54a09e3d025e44058af04b7f7fff12f3 P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:03.965626 27133 consensus_peers.cc:597] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:03.967384 25293 tablet_replica.cc:333] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
W20260709 12:15:03.969672 27133 consensus_peers.cc:597] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:03.974884 27133 consensus_peers.cc:597] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:03.976068 26513 consensus_peers.cc:597] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:15:03.970541 25293 raft_consensus.cc:2243] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:03.984279 27133 consensus_peers.cc:597] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:15:03.985540 25293 raft_consensus.cc:2272] T 94f480c16e1e4f31abd8773ea56f244b P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.988691 25293 tablet_replica.cc:333] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.989626 25293 raft_consensus.cc:2243] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:03.974052 26587 consensus_peers.cc:597] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:03.990283 27133 consensus_peers.cc:597] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:03.990733 25293 raft_consensus.cc:2272] T 012eaf6f22154b85929ab516a788db5f P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.995000 25293 tablet_replica.cc:333] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:03.995967 25293 raft_consensus.cc:2243] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 37 LEADER]: Raft consensus shutting down.
I20260709 12:15:03.997834 25293 raft_consensus.cc:2272] T f6ba7060b20a4d598344385607b29c70 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:04.000984 25293 tablet_replica.cc:333] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:04.001852 25293 raft_consensus.cc:2243] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:04.003109 25293 raft_consensus.cc:2272] T 7c931e3af68c4073a5ed978eb0f43f3f P ac3ac2181aa941229a758ccf6b5607cd [term 39 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:04.006270 25293 tablet_replica.cc:333] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
W20260709 12:15:04.007542 26587 consensus_peers.cc:597] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:04.008356 25293 raft_consensus.cc:2243] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 37 LEADER]: Raft consensus shutting down.
W20260709 12:15:04.008426 26587 consensus_peers.cc:597] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:04.010190 26587 consensus_peers.cc:597] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:04.010814 25293 raft_consensus.cc:2272] T 6598ff9cfd5346af8da1e9928f3a5ac9 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:04.010988 26587 consensus_peers.cc:597] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:04.011863 26587 consensus_peers.cc:597] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:04.013947 25293 tablet_replica.cc:333] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:04.014933 25293 raft_consensus.cc:2243] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:04.016343 25293 raft_consensus.cc:2272] T 63a71194fb3446e6b7b3135fde882816 P ac3ac2181aa941229a758ccf6b5607cd [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:04.017074 26587 consensus_peers.cc:597] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:04.017843 26587 consensus_peers.cc:597] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:15:04.019925 25293 tablet_replica.cc:333] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:04.020862 25293 raft_consensus.cc:2243] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:04.021548 25293 raft_consensus.cc:2272] T fc3ac2eaa71249dc96238b05adbd6b9b P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:04.024385 25293 tablet_replica.cc:333] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:04.026497 25293 raft_consensus.cc:2243] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:04.029341 25293 raft_consensus.cc:2272] T 724bc8274ed84709a5b83825934b7f03 P ac3ac2181aa941229a758ccf6b5607cd [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:04.032435 25293 tablet_replica.cc:333] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:04.033308 25293 raft_consensus.cc:2243] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Raft consensus shutting down.
I20260709 12:15:04.034613 25293 raft_consensus.cc:2272] T 8036dd24c55a4bc18661cc64c049a704 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:04.037973 25293 tablet_replica.cc:333] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:04.038834 25293 raft_consensus.cc:2243] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Raft consensus shutting down.
I20260709 12:15:04.040139 25293 raft_consensus.cc:2272] T 9275c8cfbe54472fba36a4ef3bf770f7 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:04.041947 27133 consensus_peers.cc:597] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:15:04.043073 25293 tablet_replica.cc:333] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:04.043938 25293 raft_consensus.cc:2243] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 40 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:04.044638 25293 raft_consensus.cc:2272] T 5cba10e68f094822a7c267bdbd205a17 P ac3ac2181aa941229a758ccf6b5607cd [term 40 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:04.047312 25293 tablet_replica.cc:333] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:04.048084 25293 raft_consensus.cc:2243] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:04.049088 25293 raft_consensus.cc:2272] T 14b3fc9b208642ffb7dbc462c4032c67 P ac3ac2181aa941229a758ccf6b5607cd [term 35 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:04.051780 25293 tablet_replica.cc:333] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:04.052568 25293 raft_consensus.cc:2243] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 36 LEADER]: Raft consensus shutting down.
I20260709 12:15:04.053712 25293 raft_consensus.cc:2272] T 01f2ec42332f4afd97d2dbfac0d5ee00 P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:04.056463 25293 tablet_replica.cc:333] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:04.057215 25293 raft_consensus.cc:2243] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:04.057997 25293 raft_consensus.cc:2272] T 68aec546ef604f45adc4b6dedb13e41f P ac3ac2181aa941229a758ccf6b5607cd [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:04.060895 25293 tablet_replica.cc:333] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:04.065387 25293 raft_consensus.cc:2243] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:04.067276 25293 raft_consensus.cc:2272] T cff430729a9d4c8183d8ddad129d6ecf P ac3ac2181aa941229a758ccf6b5607cd [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:04.070142 25293 tablet_replica.cc:333] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
W20260709 12:15:04.070824 26587 consensus_peers.cc:597] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:04.070945 25293 raft_consensus.cc:2243] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:04.074309 25293 raft_consensus.cc:2272] T ff21e283775e459c8757d4d1c245c531 P ac3ac2181aa941229a758ccf6b5607cd [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:04.078828 25293 tablet_replica.cc:333] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:04.079674 25293 raft_consensus.cc:2243] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:04.080438 25293 raft_consensus.cc:2272] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P ac3ac2181aa941229a758ccf6b5607cd [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:04.085091 25293 tablet_replica.cc:333] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:04.087414 25293 raft_consensus.cc:2243] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:04.088133 25293 raft_consensus.cc:2272] T 580883b917314b66883009ddb9259ac0 P ac3ac2181aa941229a758ccf6b5607cd [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:04.090870 25293 tablet_replica.cc:333] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:04.091638 25293 raft_consensus.cc:2243] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:04.092943 25293 raft_consensus.cc:2272] T f9abba0c7cca40c4b2a9ffbcde803684 P ac3ac2181aa941229a758ccf6b5607cd [term 37 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:04.095621 25293 tablet_replica.cc:333] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:04.096467 25293 raft_consensus.cc:2243] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 32 LEADER]: Raft consensus shutting down.
W20260709 12:15:04.096508 27133 consensus_peers.cc:597] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:04.095445 26513 consensus_peers.cc:597] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:15:04.098582 25293 raft_consensus.cc:2272] T 78bbb48570954bf4ad1039abff47c036 P ac3ac2181aa941229a758ccf6b5607cd [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:04.101254 25293 tablet_replica.cc:333] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
W20260709 12:15:04.101315 26587 consensus_peers.cc:597] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:04.101999 25293 raft_consensus.cc:2243] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 26 LEADER]: Raft consensus shutting down.
W20260709 12:15:04.102579 26587 consensus_peers.cc:597] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:04.108412 25293 raft_consensus.cc:2272] T 2c246551966f4307a9c8a66e2f024385 P ac3ac2181aa941229a758ccf6b5607cd [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:04.113803 25293 tablet_replica.cc:333] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
I20260709 12:15:04.114619 25293 raft_consensus.cc:2243] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 40 LEADER]: Raft consensus shutting down.
I20260709 12:15:04.116190 25293 raft_consensus.cc:2272] T 2251a6321412417a8079201067ae2d0d P ac3ac2181aa941229a758ccf6b5607cd [term 40 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:04.119347 26587 consensus_peers.cc:597] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:04.120035 25293 tablet_replica.cc:333] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd: stopping tablet replica
W20260709 12:15:04.120450 26587 consensus_peers.cc:597] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:04.120831 25293 raft_consensus.cc:2243] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 34 LEADER]: Raft consensus shutting down.
I20260709 12:15:04.122747 25293 raft_consensus.cc:2272] T c4646c5ce9a9467da50e9f3587b11ad5 P ac3ac2181aa941229a758ccf6b5607cd [term 34 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:04.124248 26587 consensus_peers.cc:597] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:04.125329 26587 consensus_peers.cc:597] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:04.175884 27133 consensus_peers.cc:597] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:04.202267 26402 debug-util.cc:398] Leaking SignalData structure 0x7b08003fed80 after lost signal to thread 25296
W20260709 12:15:04.203806 26402 debug-util.cc:398] Leaking SignalData structure 0x7b08000c0680 after lost signal to thread 26405
W20260709 12:15:04.205617 26402 debug-util.cc:398] Leaking SignalData structure 0x7b08002c2240 after lost signal to thread 26572
W20260709 12:15:04.217007 26402 debug-util.cc:398] Leaking SignalData structure 0x7b08003f2fa0 after lost signal to thread 26646
W20260709 12:15:04.218691 26402 debug-util.cc:398] Leaking SignalData structure 0x7b08003aac20 after lost signal to thread 27192
W20260709 12:15:04.227509 26587 consensus_peers.cc:597] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:04.243156 26587 consensus_peers.cc:597] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:04.244938 26512 connection.cc:466] server connection from 127.0.0.1:55090 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55090 (request call id 5403) could send its response
W20260709 12:15:04.245638 26587 consensus_peers.cc:597] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:04.252557 27133 consensus_peers.cc:597] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:04.248342 26587 consensus_peers.cc:597] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:04.419317 26587 consensus_peers.cc:597] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:04.487267 26587 consensus_peers.cc:597] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:04.514093 26587 consensus_peers.cc:597] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:04.514695 26587 consensus_peers.cc:597] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:04.583796 26587 consensus_peers.cc:597] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:15:04.642586 26587 consensus_peers.cc:597] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:04.670276 26587 consensus_peers.cc:597] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:04.807926 26587 consensus_peers.cc:597] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:04.829314 26587 consensus_peers.cc:597] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:15:04.866763  5704 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:04.867479  5704 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:15:04.870791  5704 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:15:04.886709  5703 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:04.887446  5703 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:15:04.889995  5703 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:15:04.899117 27133 leader_election.cc:336] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:04.901155 27133 leader_election.cc:336] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:04.901705 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:04.902570  5703 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
W20260709 12:15:04.903564 26587 leader_election.cc:336] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:04.905300 26587 leader_election.cc:336] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:04.905823 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:04.906761  5712 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 12:15:04.913470 26587 consensus_peers.cc:597] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:15:04.942592  5712 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:04.943229  5712 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:15:04.948172  5712 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:15:04.976462 26587 leader_election.cc:336] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:04.977538 26587 leader_election.cc:336] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:04.978129 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:04.979053  5712 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:15:05.048118  5703 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:05.048842  5703 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:15:05.051755  5703 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:15:05.060652 27133 leader_election.cc:336] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:05.061728 27133 leader_election.cc:336] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:05.062278 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:05.063390  5703 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
W20260709 12:15:05.069988 27133 consensus_peers.cc:597] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:05.079617 26587 consensus_peers.cc:597] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:15:05.096978  5703 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:05.097769  5703 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:15:05.100646  5703 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:15:05.107206  5712 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
W20260709 12:15:05.107769 27133 leader_election.cc:336] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:15:05.108012  5712 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:15:05.109968 27133 leader_election.cc:336] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:05.110522 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:05.111531  5712 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:15:05.112371  5703 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
I20260709 12:15:05.124220  5704 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:05.124960  5704 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:15:05.127817  5704 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:15:05.154354  5703 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:05.155076  5703 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:15:05.157611  5703 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:15:05.165706 26587 leader_election.cc:336] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:05.167518 26587 leader_election.cc:336] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:05.168210 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:05.177574  5704 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 12:15:05.182271 26587 leader_election.cc:336] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:05.180482 27133 leader_election.cc:336] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:15:05.186241  5712 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:05.187199  5712 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:15:05.190456  5704 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:05.191260  5704 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
W20260709 12:15:05.185688 27133 leader_election.cc:336] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:05.195104 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:05.197499  5703 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:15:05.196542  5712 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:15:05.199532  5704 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:15:05.205506 26587 leader_election.cc:336] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:05.206106 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:05.208290  5704 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
W20260709 12:15:05.228790 26587 leader_election.cc:336] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
W20260709 12:15:05.233825 26587 leader_election.cc:336] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
W20260709 12:15:05.238487 26587 leader_election.cc:336] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:15:05.239346 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:15:05.240415 26587 leader_election.cc:336] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:15:05.241531  5704 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:15:05.248015 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:05.249346  5704 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
W20260709 12:15:05.281849 25293 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 26569)
I20260709 12:15:05.290553  5704 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:05.291241  5704 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:15:05.293843  5704 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:15:05.304554 26587 leader_election.cc:336] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:05.308015 26587 leader_election.cc:336] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:05.308562 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:05.310570  5712 raft_consensus.cc:2749] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
W20260709 12:15:05.307243 27133 consensus_peers.cc:597] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:15:05.386371  5711 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:05.387090  5711 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Starting pre-election with config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:15:05.390278  5711 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069)
I20260709 12:15:05.392695 27160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "aaadfdd9ca9f424c91505f9b43876233" candidate_term: 38 candidate_status { last_received { term: 37 index: 26 } } ignore_live_leader: false dest_uuid: "3262bf0553e543eea76794fc529a9acc" is_pre_election: true
I20260709 12:15:05.404402  5711 raft_consensus.cc:493] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:05.405702  5711 raft_consensus.cc:515] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:15:05.413770  5711 leader_election.cc:290] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:15:05.417011  5692 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:05.424996  5692 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting pre-election with config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:15:05.431526  5692 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:15:05.435154 26618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598ff9cfd5346af8da1e9928f3a5ac9" candidate_uuid: "3262bf0553e543eea76794fc529a9acc" candidate_term: 38 candidate_status { last_received { term: 37 index: 26 } } ignore_live_leader: false dest_uuid: "aaadfdd9ca9f424c91505f9b43876233" is_pre_election: true
I20260709 12:15:05.435914 26618 raft_consensus.cc:2468] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3262bf0553e543eea76794fc529a9acc in term 37.
W20260709 12:15:05.423033 27133 consensus_peers.cc:597] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:15:05.452090  5704 raft_consensus.cc:493] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:05.452921  5704 raft_consensus.cc:515] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:15:05.458360  5704 leader_election.cc:290] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 41 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:15:05.470713  5712 raft_consensus.cc:493] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:05.474720  5712 raft_consensus.cc:515] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:15:05.479092  5712 leader_election.cc:290] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:15:05.494145 27133 leader_election.cc:336] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:05.506886 26587 leader_election.cc:336] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:15:05.509366 26587 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, 3262bf0553e543eea76794fc529a9acc
W20260709 12:15:05.495874 27133 leader_election.cc:336] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:05.510280 27133 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc, aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:05.511423  5692 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
I20260709 12:15:05.518635  5704 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
W20260709 12:15:05.524202 26587 leader_election.cc:336] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:05.532910 26587 leader_election.cc:336] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
W20260709 12:15:05.534149 26587 leader_election.cc:336] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:05.534608 26587 leader_election.cc:304] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:05.535919  5704 raft_consensus.cc:2749] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
W20260709 12:15:05.542613 26587 leader_election.cc:336] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 41 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:05.544276 26587 leader_election.cc:336] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:05.546080 26587 leader_election.cc:336] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 41 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:05.546559 26587 leader_election.cc:304] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 41 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:05.547340  5704 raft_consensus.cc:2749] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Leader pre-election lost for term 41. Reason: could not achieve majority
W20260709 12:15:05.547557 26587 leader_election.cc:336] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:05.548077 26587 leader_election.cc:304] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:05.548844  5704 raft_consensus.cc:2749] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:15:05.556152  5704 raft_consensus.cc:493] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:05.556777  5704 raft_consensus.cc:515] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:15:05.559410  5704 leader_election.cc:290] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:15:05.563755 26587 leader_election.cc:336] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:05.564656 26587 leader_election.cc:336] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:05.565172 26587 leader_election.cc:304] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:05.566606  5712 raft_consensus.cc:2749] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
W20260709 12:15:05.588027 26587 consensus_peers.cc:597] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:05.700266 26587 consensus_peers.cc:597] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:05.709339 27133 consensus_peers.cc:597] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:05.775388 26587 consensus_peers.cc:597] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:05.815145 26587 consensus_peers.cc:597] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:05.821545 27133 consensus_peers.cc:597] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:06.008916 26587 consensus_peers.cc:597] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:06.040463 26587 consensus_peers.cc:597] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.055585 27133 consensus_peers.cc:597] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:06.089838 27133 consensus_peers.cc:597] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:06.111699 26587 consensus_peers.cc:597] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.136677 26587 consensus_peers.cc:597] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:06.142591 27133 consensus_peers.cc:597] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.193434 27133 consensus_peers.cc:597] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:06.252707 26587 consensus_peers.cc:597] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.263137 27133 consensus_peers.cc:597] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.294131 26587 consensus_peers.cc:597] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.313788 27133 consensus_peers.cc:597] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.326979 26587 consensus_peers.cc:597] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:15:06.334659 27133 consensus_peers.cc:597] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.356630 27133 consensus_peers.cc:597] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:06.359076 27133 consensus_peers.cc:597] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.368872 26587 consensus_peers.cc:597] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.369495 26587 consensus_peers.cc:597] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.370885 27133 consensus_peers.cc:597] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:06.382346 26587 consensus_peers.cc:597] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.401836 26587 consensus_peers.cc:597] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.436414 26587 consensus_peers.cc:597] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.449395 26587 consensus_peers.cc:597] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:06.455324 26587 consensus_peers.cc:597] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.483728 26587 consensus_peers.cc:597] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.488466 26587 consensus_peers.cc:597] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.492206 27133 consensus_peers.cc:597] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:06.498580 26587 consensus_peers.cc:597] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.510386 26587 consensus_peers.cc:597] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.518210 27133 consensus_peers.cc:597] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:06.519215 26587 consensus_peers.cc:597] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.519791 26587 consensus_peers.cc:597] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.520226 26587 consensus_peers.cc:597] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.535339 26587 consensus_peers.cc:597] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.544996 26587 consensus_peers.cc:597] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:06.552407 26587 consensus_peers.cc:597] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.563699 27133 consensus_peers.cc:597] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:06.580871  5714 raft_consensus.cc:493] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:06.581523  5714 raft_consensus.cc:515] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:15:06.583936  5714 leader_election.cc:290] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:15:06.591784 26587 consensus_peers.cc:597] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.598448 26587 leader_election.cc:336] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
W20260709 12:15:06.599180 26587 leader_election.cc:336] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:15:06.599565 26587 leader_election.cc:304] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:06.601218  5710 raft_consensus.cc:2749] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 12:15:06.616500 26587 consensus_peers.cc:597] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.621493 26587 consensus_peers.cc:597] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.643548 26587 consensus_peers.cc:597] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.672996 27133 consensus_peers.cc:597] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.677740 26587 consensus_peers.cc:597] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.686957 26587 consensus_peers.cc:597] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:06.690616 26587 consensus_peers.cc:597] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.697237 26587 consensus_peers.cc:597] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:06.752545 26587 consensus_peers.cc:597] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:06.825379 26587 consensus_peers.cc:597] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:06.832981  5714 raft_consensus.cc:493] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:06.833561  5714 raft_consensus.cc:515] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:15:06.835754  5714 leader_election.cc:290] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:15:06.840620 25293 tablet_server.cc:196] TabletServer@127.24.179.66:0 shutdown complete.
W20260709 12:15:06.843676 26587 leader_election.cc:336] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
W20260709 12:15:06.844605 26587 leader_election.cc:336] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:15:06.845149 26587 leader_election.cc:304] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:06.853494  5710 raft_consensus.cc:2749] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:15:06.887866  5710 raft_consensus.cc:493] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:06.888510  5710 raft_consensus.cc:515] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:15:06.891156  5710 leader_election.cc:290] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:15:06.895887 26587 leader_election.cc:336] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:15:06.895902  5716 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:06.896692  5716 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:15:06.898497 26587 leader_election.cc:336] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:06.898813  5716 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:15:06.899097 26587 leader_election.cc:304] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:06.901656  5710 raft_consensus.cc:2749] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:15:06.914126  5716 raft_consensus.cc:493] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:06.914700  5716 raft_consensus.cc:515] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:15:06.915709 27133 leader_election.cc:336] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
W20260709 12:15:06.916471 27133 leader_election.cc:336] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:15:06.916878 27133 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:06.917048  5716 leader_election.cc:290] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:15:06.919509  5716 raft_consensus.cc:2749] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
W20260709 12:15:06.934305 27133 leader_election.cc:336] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:06.935011 27133 leader_election.cc:336] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:06.935384 27133 leader_election.cc:304] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:06.936406  5716 raft_consensus.cc:2749] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
W20260709 12:15:06.954140 26587 consensus_peers.cc:597] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 -> Peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Couldn't send request to peer ac3ac2181aa941229a758ccf6b5607cd. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:06.973848 25293 tablet_server.cc:179] TabletServer@127.24.179.67:0 shutting down...
I20260709 12:15:06.981876  5714 raft_consensus.cc:493] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:06.982756  5714 raft_consensus.cc:515] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:15:06.985656  5710 raft_consensus.cc:493] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:06.986264  5710 raft_consensus.cc:515] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:15:06.988454  5710 leader_election.cc:290] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:15:07.006876  5714 leader_election.cc:290] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:15:07.020632 26587 leader_election.cc:336] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:15:07.021420  5716 raft_consensus.cc:493] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:07.022025  5716 raft_consensus.cc:515] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:15:07.024262  5716 leader_election.cc:290] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:15:07.024958 26587 leader_election.cc:336] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:07.025943 26587 leader_election.cc:336] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:07.026528 26587 leader_election.cc:304] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:07.027361  5714 raft_consensus.cc:2749] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
W20260709 12:15:07.028852 26587 leader_election.cc:336] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:07.029300 26587 leader_election.cc:304] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:07.030097  5714 raft_consensus.cc:2749] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:15:07.031577  5714 raft_consensus.cc:493] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:07.032097  5714 raft_consensus.cc:515] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:15:07.034263  5714 leader_election.cc:290] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:15:07.039531 27134 consensus_peers.cc:597] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:07.041896 26587 leader_election.cc:336] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
W20260709 12:15:07.043373 26587 leader_election.cc:336] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:15:07.043792 26587 leader_election.cc:304] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:07.044566  5714 raft_consensus.cc:2749] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
W20260709 12:15:07.051712 27133 leader_election.cc:336] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:07.055202 27133 leader_election.cc:336] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:07.055670 27133 leader_election.cc:304] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:07.057168  5716 raft_consensus.cc:2749] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:15:07.057384 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:07.062179 25293 tablet_replica.cc:333] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.063359 25293 raft_consensus.cc:2243] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.064692 25293 raft_consensus.cc:2272] T dee06ad5f38b42f99fdbc1d71eee680f P aaadfdd9ca9f424c91505f9b43876233 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:07.066166 27134 consensus_peers.cc:597] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:07.070439 25293 tablet_replica.cc:333] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.071477 25293 raft_consensus.cc:2243] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.072168 25293 raft_consensus.cc:2272] T 02fc28e9bbd743569e5c7c101c4688fb P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:07.072549 27134 consensus_peers.cc:597] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:07.075280 26587 consensus_peers.cc:597] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:15:07.076733 25293 tablet_replica.cc:333] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.077725 25293 raft_consensus.cc:2243] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.078933 25293 raft_consensus.cc:2272] T 12729361d003466aada20ab37328d285 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.083674 25293 tablet_replica.cc:333] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.084627 25293 raft_consensus.cc:2243] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.085256 25293 raft_consensus.cc:2272] T 69e1490de99a4232a6717e72242a0f00 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.085638  5716 raft_consensus.cc:493] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:07.086257  5716 raft_consensus.cc:515] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:15:07.088294 25293 tablet_replica.cc:333] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.088564  5716 leader_election.cc:290] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:15:07.089319 25293 raft_consensus.cc:2243] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.090891 25293 raft_consensus.cc:2272] T f90484c8608940e99361799cdda3a0f7 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:07.093974 26587 consensus_peers.cc:597] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:15:07.094120 25293 tablet_replica.cc:333] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.095228 25293 raft_consensus.cc:2243] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.097007 25293 raft_consensus.cc:2272] T 3288c98248464af5b8f3227349002ec7 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.099251  5704 raft_consensus.cc:493] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:07.099738  5704 raft_consensus.cc:515] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } }
I20260709 12:15:07.101672  5704 leader_election.cc:290] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
I20260709 12:15:07.104926 25293 tablet_replica.cc:333] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
W20260709 12:15:07.105191 27134 consensus_peers.cc:597] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:07.105914 25293 raft_consensus.cc:2243] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 39 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.110062 25293 raft_consensus.cc:2272] T 1a2747b6998c418ab70cbcbd2f2deeaa P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:07.111011 27133 leader_election.cc:336] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:07.111833 27133 leader_election.cc:336] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:07.112262 27133 leader_election.cc:304] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
I20260709 12:15:07.113133 25293 tablet_replica.cc:333] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.114140 25293 raft_consensus.cc:2243] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.114840 25293 raft_consensus.cc:2272] T 953d8c981a6c459f8b7f3dbbb66fda45 P aaadfdd9ca9f424c91505f9b43876233 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.114917  5716 raft_consensus.cc:2749] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:15:07.118009 25293 tablet_replica.cc:333] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.118999 25293 raft_consensus.cc:2243] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.119802 25293 raft_consensus.cc:2272] T d6e6ed3d8ee44750a4d06294867e92bc P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:07.120370 26587 leader_election.cc:336] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:15:07.122818 25293 tablet_replica.cc:333] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
W20260709 12:15:07.121084 26587 consensus_peers.cc:597] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:15:07.123797 25293 raft_consensus.cc:2243] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:07.123895 26587 consensus_peers.cc:597] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:15:07.124598 25293 raft_consensus.cc:2272] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:07.126644 26587 leader_election.cc:336] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:07.127074 26587 leader_election.cc:304] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233 [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaadfdd9ca9f424c91505f9b43876233; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:15:07.127584 26587 raft_consensus.cc:2686] T 67d6a6aed08548acab4272e6f5f1480a P aaadfdd9ca9f424c91505f9b43876233: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:15:07.127810 25293 tablet_replica.cc:333] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.128700 25293 raft_consensus.cc:2243] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.132943 25293 raft_consensus.cc:2272] T b9bd8978cfc74b93bcc4755ec8254fa7 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.135979 25293 tablet_replica.cc:333] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.136816 25293 raft_consensus.cc:2243] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 32 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.137899 25293 raft_consensus.cc:2272] T f3c1161f4dab4d0e9f9b0053e38dfe10 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.140851 25293 tablet_replica.cc:333] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.141682 25293 raft_consensus.cc:2243] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 36 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.143034 25293 raft_consensus.cc:2272] T 3ce8bbdf417f47e7aabb967886d8c95a P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.145948 25293 tablet_replica.cc:333] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.146823 25293 raft_consensus.cc:2243] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.147457 25293 raft_consensus.cc:2272] T 3d83c4273cd74e768f756e0c8ba65432 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.150184 25293 tablet_replica.cc:333] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.151050 25293 raft_consensus.cc:2243] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.151757 25293 raft_consensus.cc:2272] T 5c23e0d03a4d457fa50856e09fe2f649 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.154724 25293 tablet_replica.cc:333] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.155567 25293 raft_consensus.cc:2243] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.156786 25293 raft_consensus.cc:2272] T 5fceaa32ed834cedaeb85b54a55fc4ed P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.159729 25293 tablet_replica.cc:333] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.160530 25293 raft_consensus.cc:2243] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.161650 25293 raft_consensus.cc:2272] T c22baf3ebbed46a6a23a4c6cfd24710b P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.164454 25293 tablet_replica.cc:333] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.165294 25293 raft_consensus.cc:2243] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 39 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.166482 25293 raft_consensus.cc:2272] T ceda449be0d044e0b465f42ed3047751 P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.169360 25293 tablet_replica.cc:333] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.170213 25293 raft_consensus.cc:2243] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.171262 25293 raft_consensus.cc:2272] T 75c9184ee6b7472fb72209c9dfd651b6 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.173489 25293 tablet_replica.cc:333] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.174191 25293 raft_consensus.cc:2243] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 34 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.175684 25293 raft_consensus.cc:2272] T fce5ecc0a3714c80861557f318edce9d P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.178092 25293 tablet_replica.cc:333] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.178861 25293 raft_consensus.cc:2243] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 36 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.179786 25293 raft_consensus.cc:2272] T 799bbccef316451b8fb8dbd051728db0 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.181993 25293 tablet_replica.cc:333] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.182633 25293 raft_consensus.cc:2243] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.183532 25293 raft_consensus.cc:2272] T 34b9da257a1d4dadbbe3027844b5b140 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.185774 25293 tablet_replica.cc:333] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.186349 25293 raft_consensus.cc:2243] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.187330 25293 raft_consensus.cc:2272] T d2e173b367e6460b8f654b2de1aabfae P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.189699 25293 tablet_replica.cc:333] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.190490 25293 raft_consensus.cc:2243] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 36 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.191972 25293 raft_consensus.cc:2272] T 6d235a62666644668508e208ad8d21d3 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.194504 25293 tablet_replica.cc:333] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.195199 25293 raft_consensus.cc:2243] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.195835 25293 raft_consensus.cc:2272] T 0e9f2c921ba4426a8185f516aa2d8deb P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.198000 25293 tablet_replica.cc:333] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.198742 25293 raft_consensus.cc:2243] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.199304 25293 raft_consensus.cc:2272] T 54a09e3d025e44058af04b7f7fff12f3 P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.202337 25293 tablet_replica.cc:333] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.203223 25293 raft_consensus.cc:2243] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.204195 25293 raft_consensus.cc:2272] T 01f2ec42332f4afd97d2dbfac0d5ee00 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.207053 25293 tablet_replica.cc:333] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.207731 25293 raft_consensus.cc:2243] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.208662 25293 raft_consensus.cc:2272] T 63a71194fb3446e6b7b3135fde882816 P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.210836 25293 tablet_replica.cc:333] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.211527 25293 raft_consensus.cc:2243] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 36 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.212600 25293 raft_consensus.cc:2272] T fc3ac2eaa71249dc96238b05adbd6b9b P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.214980 25293 tablet_replica.cc:333] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.215871 25293 raft_consensus.cc:2243] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.217140 25293 raft_consensus.cc:2272] T 14b3fc9b208642ffb7dbc462c4032c67 P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:07.220050 27134 consensus_peers.cc:597] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:07.220263 25293 tablet_replica.cc:333] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.221184 25293 raft_consensus.cc:2243] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 40 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.222677 25293 raft_consensus.cc:2272] T 5cba10e68f094822a7c267bdbd205a17 P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.225744 25293 tablet_replica.cc:333] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.226649 25293 raft_consensus.cc:2243] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.227892 25293 raft_consensus.cc:2272] T 2fc3920d73734952bc159eff19f3567d P aaadfdd9ca9f424c91505f9b43876233 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.230882 25293 tablet_replica.cc:333] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.231817 25293 raft_consensus.cc:2243] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.232842 25293 raft_consensus.cc:2272] T 78002f4d800445a3befddbc1cce2750d P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.235625 25293 tablet_replica.cc:333] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.236433 25293 raft_consensus.cc:2243] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 40 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.236918  5716 raft_consensus.cc:493] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:07.237530  5716 raft_consensus.cc:515] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting pre-election with config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } attrs { replace: true } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:15:07.237805 25293 raft_consensus.cc:2272] T ea50d3c1de374dff938c733fb02faf8c P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.240633  5716 leader_election.cc:290] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:15:07.241328 25293 tablet_replica.cc:333] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.242478 25293 raft_consensus.cc:2243] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 45 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.243127 25293 raft_consensus.cc:2272] T 541724f47bb04d5185dd369750546cbf P aaadfdd9ca9f424c91505f9b43876233 [term 45 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.246224 25293 tablet_replica.cc:333] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
W20260709 12:15:07.246301 27134 leader_election.cc:336] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:07.247545 25293 raft_consensus.cc:2243] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 33 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.248649 25293 raft_consensus.cc:2272] T ad6ce9ef10d748ecbe957fb8e6de47b0 P aaadfdd9ca9f424c91505f9b43876233 [term 33 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:07.249346 27133 leader_election.cc:336] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:15:07.249888 27133 leader_election.cc:304] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:15:07.250731  5716 raft_consensus.cc:2749] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
W20260709 12:15:07.250928 27133 leader_election.cc:336] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Network error: Client connection negotiation failed: client connection to 127.24.179.66:40567: connect: Connection refused (error 111)
I20260709 12:15:07.251817 25293 tablet_replica.cc:333] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.252560 25293 raft_consensus.cc:2243] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.253322 25293 raft_consensus.cc:2272] T 6598ff9cfd5346af8da1e9928f3a5ac9 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.256275 25293 tablet_replica.cc:333] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.257118 25293 raft_consensus.cc:2243] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.257834 25293 raft_consensus.cc:2272] T 86001e7eca0b4ca4aed965b7d7e5820c P aaadfdd9ca9f424c91505f9b43876233 [term 38 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.260442 25293 tablet_replica.cc:333] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.261099 25293 raft_consensus.cc:2243] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 39 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.262261 25293 raft_consensus.cc:2272] T 7c931e3af68c4073a5ed978eb0f43f3f P aaadfdd9ca9f424c91505f9b43876233 [term 39 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.265506 25293 tablet_replica.cc:333] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.266350 25293 raft_consensus.cc:2243] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 35 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.267499 25293 raft_consensus.cc:2272] T 012eaf6f22154b85929ab516a788db5f P aaadfdd9ca9f424c91505f9b43876233 [term 35 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.270268 25293 tablet_replica.cc:333] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.271091 25293 raft_consensus.cc:2243] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.271829 25293 raft_consensus.cc:2272] T 2c246551966f4307a9c8a66e2f024385 P aaadfdd9ca9f424c91505f9b43876233 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.275925 25293 tablet_replica.cc:333] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.276755 25293 raft_consensus.cc:2243] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 36 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.277933 25293 raft_consensus.cc:2272] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.280746 25293 tablet_replica.cc:333] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.281574 25293 raft_consensus.cc:2243] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.282617 25293 raft_consensus.cc:2272] T 580883b917314b66883009ddb9259ac0 P aaadfdd9ca9f424c91505f9b43876233 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.285066 25293 tablet_replica.cc:333] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.285723 25293 raft_consensus.cc:2243] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.286372 25293 raft_consensus.cc:2272] T de4e2c4be7474864b847ef2e617f6f49 P aaadfdd9ca9f424c91505f9b43876233 [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.289215 25293 tablet_replica.cc:333] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.289954 25293 raft_consensus.cc:2243] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.290683 25293 raft_consensus.cc:2272] T 78bbb48570954bf4ad1039abff47c036 P aaadfdd9ca9f424c91505f9b43876233 [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.293370 25293 tablet_replica.cc:333] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.294131 25293 raft_consensus.cc:2243] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.294878 25293 raft_consensus.cc:2272] T 2251a6321412417a8079201067ae2d0d P aaadfdd9ca9f424c91505f9b43876233 [term 40 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.297470 25293 tablet_replica.cc:333] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.298095 25293 raft_consensus.cc:2243] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.298722 25293 raft_consensus.cc:2272] T ff21e283775e459c8757d4d1c245c531 P aaadfdd9ca9f424c91505f9b43876233 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.300935 25293 tablet_replica.cc:333] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.301513 25293 raft_consensus.cc:2243] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 31 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.302510 25293 raft_consensus.cc:2272] T cff430729a9d4c8183d8ddad129d6ecf P aaadfdd9ca9f424c91505f9b43876233 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.304658 25293 tablet_replica.cc:333] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.305189 25293 raft_consensus.cc:2243] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 37 LEADER]: Raft consensus shutting down.
I20260709 12:15:07.306658 25293 raft_consensus.cc:2272] T f9abba0c7cca40c4b2a9ffbcde803684 P aaadfdd9ca9f424c91505f9b43876233 [term 37 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.308792 25293 tablet_replica.cc:333] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233: stopping tablet replica
I20260709 12:15:07.309443 25293 raft_consensus.cc:2243] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.309960 25293 raft_consensus.cc:2272] T c4646c5ce9a9467da50e9f3587b11ad5 P aaadfdd9ca9f424c91505f9b43876233 [term 34 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:07.400296 27134 consensus_peers.cc:597] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.67:42217: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:07.405536 27134 consensus_peers.cc:597] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.67:42217: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:07.486786 27134 consensus_peers.cc:597] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc -> Peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Couldn't send request to peer aaadfdd9ca9f424c91505f9b43876233. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.67:42217: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:07.865319 27133 consensus_peers.cc:597] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:15:07.895967 27133 consensus_peers.cc:597] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:15:07.911871 27133 consensus_peers.cc:597] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:15:08.126438  5719 raft_consensus.cc:493] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:15:08.127072  5719 raft_consensus.cc:515] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:15:08.129443  5719 leader_election.cc:290] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:15:08.134176 27134 leader_election.cc:336] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Network error: Client connection negotiation failed: client connection to 127.24.179.67:42217: connect: Connection refused (error 111)
W20260709 12:15:08.232148 26357 catalog_manager.cc:4755] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 63a71194fb3446e6b7b3135fde882816: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:08.284615 27133 consensus_peers.cc:597] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:15:08.296514 25293 tablet_server.cc:196] TabletServer@127.24.179.67:0 shutdown complete.
I20260709 12:15:08.312016  5715 raft_consensus.cc:493] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:15:08.312924  5715 raft_consensus.cc:515] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Starting pre-election with config: opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:15:08.326498 27134 leader_election.cc:336] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Network error: Client connection negotiation failed: client connection to 127.24.179.67:42217: connect: Connection refused (error 111)
I20260709 12:15:08.330173  5716 raft_consensus.cc:493] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:15:08.331084  5716 raft_consensus.cc:515] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:15:08.333714  5716 leader_election.cc:290] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:15:08.335992  5715 leader_election.cc:290] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:15:08.339059  5715 raft_consensus.cc:493] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:15:08.339836  5715 raft_consensus.cc:515] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
W20260709 12:15:08.341889 27134 leader_election.cc:336] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Network error: Client connection negotiation failed: client connection to 127.24.179.67:42217: connect: Connection refused (error 111)
I20260709 12:15:08.348219  5715 leader_election.cc:290] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:15:08.350512 27133 leader_election.cc:336] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:15:08.351039 27133 leader_election.cc:304] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
W20260709 12:15:08.351902 27134 leader_election.cc:336] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Network error: Client connection negotiation failed: client connection to 127.24.179.67:42217: connect: Connection refused (error 111)
I20260709 12:15:08.352955  5715 raft_consensus.cc:2749] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
W20260709 12:15:08.357353 27133 leader_election.cc:336] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:15:08.357889 27133 leader_election.cc:304] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:15:08.358621  5715 raft_consensus.cc:2749] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:15:08.365200  5715 raft_consensus.cc:493] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:15:08.365818  5715 raft_consensus.cc:515] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:15:08.366511  5723 raft_consensus.cc:493] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:15:08.367309  5723 raft_consensus.cc:515] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:15:08.369961  5715 leader_election.cc:290] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:15:08.369967  5723 leader_election.cc:290] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:15:08.375953 27134 leader_election.cc:336] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Network error: Client connection negotiation failed: client connection to 127.24.179.67:42217: connect: Connection refused (error 111)
W20260709 12:15:08.376638 27134 leader_election.cc:336] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Network error: Client connection negotiation failed: client connection to 127.24.179.67:42217: connect: Connection refused (error 111)
I20260709 12:15:08.428674  5723 raft_consensus.cc:493] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 39 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:15:08.429366  5723 raft_consensus.cc:515] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 39 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:15:08.432323  5723 leader_election.cc:290] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 40 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
W20260709 12:15:08.437595 27134 leader_election.cc:336] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 40 pre-election: RPC error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Network error: Client connection negotiation failed: client connection to 127.24.179.67:42217: connect: Connection refused (error 111)
I20260709 12:15:08.440135 25293 tablet_server.cc:179] TabletServer@127.24.179.68:0 shutting down...
W20260709 12:15:08.456316 27133 consensus_peers.cc:597] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:15:08.476039  5723 raft_consensus.cc:493] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:15:08.476660  5723 raft_consensus.cc:515] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:15:08.479003  5715 raft_consensus.cc:493] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader ac3ac2181aa941229a758ccf6b5607cd)
I20260709 12:15:08.480145  5723 leader_election.cc:290] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:15:08.479929  5715 raft_consensus.cc:515] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:15:08.482955  5715 leader_election.cc:290] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567)
W20260709 12:15:08.494083 27133 leader_election.cc:336] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:08.495875 27134 leader_election.cc:336] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Network error: Client connection negotiation failed: client connection to 127.24.179.67:42217: connect: Connection refused (error 111)
W20260709 12:15:08.509388 27133 consensus_peers.cc:597] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc -> Peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Couldn't send request to peer 01a57027214a411e80874ac7febd628b. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:15:08.518252 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:08.519345 25293 tablet_replica.cc:333] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.520364 25293 raft_consensus.cc:2243] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:08.521422 25293 raft_consensus.cc:2272] T 6598ff9cfd5346af8da1e9928f3a5ac9 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.525900 25293 tablet_replica.cc:333] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.526913 25293 raft_consensus.cc:2243] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:08.527632 25293 raft_consensus.cc:2272] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.530994 25293 tablet_replica.cc:333] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.531932 25293 raft_consensus.cc:2243] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:08.532783 25293 raft_consensus.cc:2272] T 63a71194fb3446e6b7b3135fde882816 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.536012 25293 tablet_replica.cc:333] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.536890 25293 raft_consensus.cc:2243] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:08.537600 25293 raft_consensus.cc:2272] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.540642 25293 tablet_replica.cc:333] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.541510 25293 raft_consensus.cc:2243] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Raft consensus shutting down.
I20260709 12:15:08.543644 25293 pending_rounds.cc:70] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc: Trying to abort 1 pending ops.
I20260709 12:15:08.543920 25293 pending_rounds.cc:77] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc: Aborting op as it isn't in flight: id { term: 2 index: 3 } timestamp: 7305621586285674496 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "c4646c5ce9a9467da50e9f3587b11ad5" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } attrs { replace: true } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: NON_VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: true } } } }
I20260709 12:15:08.545049 25293 raft_consensus.cc:2917] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc [term 2 LEARNER]: Aborting config change with OpId 2.3: Aborted: Op aborted
I20260709 12:15:08.545495 25293 raft_consensus.cc:2889] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc [term 2 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:15:08.545864 25293 raft_consensus.cc:2272] T c4646c5ce9a9467da50e9f3587b11ad5 P 3262bf0553e543eea76794fc529a9acc [term 2 NON_PARTICIPANT]: Raft consensus is shut down!
I20260709 12:15:08.548941 25293 tablet_replica.cc:333] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.549782 25293 raft_consensus.cc:2243] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 33 LEADER]: Raft consensus shutting down.
I20260709 12:15:08.550845 25293 raft_consensus.cc:2272] T 68aec546ef604f45adc4b6dedb13e41f P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.553826 25293 tablet_replica.cc:333] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.554682 25293 raft_consensus.cc:2243] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 33 LEADER]: Raft consensus shutting down.
I20260709 12:15:08.555966 25293 raft_consensus.cc:2272] T 69e1490de99a4232a6717e72242a0f00 P 3262bf0553e543eea76794fc529a9acc [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.559211 25293 tablet_replica.cc:333] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.559912 25293 raft_consensus.cc:2243] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:15:08.560894 25293 raft_consensus.cc:2272] T 953d8c981a6c459f8b7f3dbbb66fda45 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.563441 25293 tablet_replica.cc:333] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.564108 25293 raft_consensus.cc:2243] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:15:08.565094 25293 raft_consensus.cc:2272] T 0e9f2c921ba4426a8185f516aa2d8deb P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.567616 25293 tablet_replica.cc:333] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.568279 25293 raft_consensus.cc:2243] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:15:08.569106 25293 raft_consensus.cc:2272] T 724bc8274ed84709a5b83825934b7f03 P 3262bf0553e543eea76794fc529a9acc [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.571677 25293 tablet_replica.cc:333] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.572293 25293 raft_consensus.cc:2243] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:08.572798 25293 raft_consensus.cc:2272] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.575261 25293 tablet_replica.cc:333] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.575861 25293 raft_consensus.cc:2243] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:08.576462 25293 raft_consensus.cc:2272] T 3ce8bbdf417f47e7aabb967886d8c95a P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.579288 25293 tablet_replica.cc:333] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.579936 25293 raft_consensus.cc:2243] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 45 LEADER]: Raft consensus shutting down.
I20260709 12:15:08.580940 25293 raft_consensus.cc:2272] T 541724f47bb04d5185dd369750546cbf P 3262bf0553e543eea76794fc529a9acc [term 45 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.583473 25293 tablet_replica.cc:333] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.583781  5715 raft_consensus.cc:493] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:15:08.584213 25293 raft_consensus.cc:2243] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:08.584968 25293 raft_consensus.cc:2272] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.584439  5715 raft_consensus.cc:515] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ac3ac2181aa941229a758ccf6b5607cd" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 40567 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:15:08.587334  5715 leader_election.cc:290] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:15:08.588214 25293 tablet_replica.cc:333] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.589012 25293 raft_consensus.cc:2243] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:08.589774 25293 raft_consensus.cc:2272] T 580883b917314b66883009ddb9259ac0 P 3262bf0553e543eea76794fc529a9acc [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.592664 25293 tablet_replica.cc:333] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
W20260709 12:15:08.592592 27134 leader_election.cc:336] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Network error: Client connection negotiation failed: client connection to 127.24.179.67:42217: connect: Connection refused (error 111)
I20260709 12:15:08.593614 25293 raft_consensus.cc:2243] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:08.594165 25293 raft_consensus.cc:2272] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.596467 25293 tablet_replica.cc:333] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.597129 25293 raft_consensus.cc:2243] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 36 LEADER]: Raft consensus shutting down.
I20260709 12:15:08.598462 25293 raft_consensus.cc:2272] T de4e2c4be7474864b847ef2e617f6f49 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.600746 25293 tablet_replica.cc:333] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.601404 25293 raft_consensus.cc:2243] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:08.602046 25293 raft_consensus.cc:2272] T 8036dd24c55a4bc18661cc64c049a704 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.604308 25293 tablet_replica.cc:333] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.604952 25293 raft_consensus.cc:2243] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 39 LEADER]: Raft consensus shutting down.
I20260709 12:15:08.605818 25293 raft_consensus.cc:2272] T 94f480c16e1e4f31abd8773ea56f244b P 3262bf0553e543eea76794fc529a9acc [term 39 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.608166 25293 tablet_replica.cc:333] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.608786 25293 raft_consensus.cc:2243] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:15:08.609629 25293 raft_consensus.cc:2272] T 366874f8c4424fa2a9f169e9c3d6e97e P 3262bf0553e543eea76794fc529a9acc [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.612397 25293 tablet_replica.cc:333] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.613008 25293 raft_consensus.cc:2243] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:08.613662 25293 raft_consensus.cc:2272] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.616412 25293 tablet_replica.cc:333] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.617911 25293 raft_consensus.cc:2243] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 38 LEADER]: Raft consensus shutting down.
I20260709 12:15:08.619128 25293 raft_consensus.cc:2272] T 86001e7eca0b4ca4aed965b7d7e5820c P 3262bf0553e543eea76794fc529a9acc [term 38 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.625164 25293 tablet_replica.cc:333] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.626052 25293 raft_consensus.cc:2243] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:08.626750 25293 raft_consensus.cc:2272] T 9275c8cfbe54472fba36a4ef3bf770f7 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.629958 25293 tablet_replica.cc:333] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.630802 25293 raft_consensus.cc:2243] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:08.631546 25293 raft_consensus.cc:2272] T f6ba7060b20a4d598344385607b29c70 P 3262bf0553e543eea76794fc529a9acc [term 37 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.634652 25293 tablet_replica.cc:333] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.635107  5715 raft_consensus.cc:493] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election (detected failure of leader aaadfdd9ca9f424c91505f9b43876233)
I20260709 12:15:08.635456 25293 raft_consensus.cc:2243] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:08.635635  5715 raft_consensus.cc:515] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "01a57027214a411e80874ac7febd628b" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 45149 } } peers { permanent_uuid: "aaadfdd9ca9f424c91505f9b43876233" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 42217 } } peers { permanent_uuid: "3262bf0553e543eea76794fc529a9acc" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 35069 } attrs { promote: false } }
I20260709 12:15:08.636276 25293 raft_consensus.cc:2272] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.637845  5715 leader_election.cc:290] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 01a57027214a411e80874ac7febd628b (127.24.179.65:45149), aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217)
I20260709 12:15:08.639418 25293 tablet_replica.cc:333] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.641178 25293 raft_consensus.cc:2243] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 39 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:08.642998 25293 raft_consensus.cc:2272] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [term 39 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:08.643121 27133 leader_election.cc:336] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
I20260709 12:15:08.646095 25293 tablet_replica.cc:333] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
W20260709 12:15:08.646142 27134 leader_election.cc:336] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer aaadfdd9ca9f424c91505f9b43876233 (127.24.179.67:42217): Network error: Client connection negotiation failed: client connection to 127.24.179.67:42217: connect: Connection refused (error 111)
I20260709 12:15:08.646770 27134 leader_election.cc:304] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, aaadfdd9ca9f424c91505f9b43876233
I20260709 12:15:08.647142 25293 raft_consensus.cc:2243] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:08.648557  5715 raft_consensus.cc:2749] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:15:08.649595 25293 raft_consensus.cc:2272] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.652171 25293 tablet_replica.cc:333] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.652801 25293 raft_consensus.cc:2243] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:08.653338 25293 raft_consensus.cc:2272] T 799bbccef316451b8fb8dbd051728db0 P 3262bf0553e543eea76794fc529a9acc [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.655485 25293 tablet_replica.cc:333] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.656105 25293 raft_consensus.cc:2243] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 31 LEADER]: Raft consensus shutting down.
I20260709 12:15:08.657120 25293 raft_consensus.cc:2272] T 3d83c4273cd74e768f756e0c8ba65432 P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.659418 25293 tablet_replica.cc:333] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.660030 25293 raft_consensus.cc:2243] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:15:08.660835 25293 raft_consensus.cc:2272] T d1ee0545deb746aeb5c1c14751b96826 P 3262bf0553e543eea76794fc529a9acc [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.663096 25293 tablet_replica.cc:333] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.663650 25293 raft_consensus.cc:2243] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:08.664439 25293 raft_consensus.cc:2272] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:08.667208 25293 tablet_replica.cc:333] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc: stopping tablet replica
I20260709 12:15:08.667728 25293 raft_consensus.cc:2243] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:15:08.668529 25293 raft_consensus.cc:2272] T ff21e283775e459c8757d4d1c245c531 P 3262bf0553e543eea76794fc529a9acc [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:08.669838 27132 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:08.707142 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:08.782248 27134 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:08.804548  5585 leader_election.cc:336] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 40 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Service unavailable: reactor is shutting down (error 108)
I20260709 12:15:08.805073  5585 leader_election.cc:304] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 40 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:15:08.805649  5585 raft_consensus.cc:2686] T 1a2747b6998c418ab70cbcbd2f2deeaa P 3262bf0553e543eea76794fc529a9acc: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:15:08.807346 25293 leader_election.cc:336] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Aborted: reactor is shutting down (error 108)
I20260709 12:15:08.807907 25293 leader_election.cc:304] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:15:08.808089  5585 leader_election.cc:336] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Service unavailable: reactor is shutting down (error 108)
W20260709 12:15:08.808585 25293 raft_consensus.cc:2686] T f3c1161f4dab4d0e9f9b0053e38dfe10 P 3262bf0553e543eea76794fc529a9acc: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:15:08.808524  5585 leader_election.cc:304] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:15:08.809216  5585 raft_consensus.cc:2686] T 34b9da257a1d4dadbbe3027844b5b140 P 3262bf0553e543eea76794fc529a9acc: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:15:08.810587 25293 leader_election.cc:336] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Aborted: reactor is shutting down (error 108)
I20260709 12:15:08.811008 25293 leader_election.cc:304] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: 01a57027214a411e80874ac7febd628b, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:15:08.811340  5585 leader_election.cc:336] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Service unavailable: reactor is shutting down (error 108)
W20260709 12:15:08.811607 25293 raft_consensus.cc:2686] T ffdceca3c04a40cdba75f01fa9ded9f8 P 3262bf0553e543eea76794fc529a9acc: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:15:08.811811  5585 leader_election.cc:304] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:15:08.812443  5585 raft_consensus.cc:2686] T 2fc3920d73734952bc159eff19f3567d P 3262bf0553e543eea76794fc529a9acc: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:15:08.813619 25293 leader_election.cc:336] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Aborted: reactor is shutting down (error 108)
I20260709 12:15:08.814073 25293 leader_election.cc:304] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:15:08.814564  5585 leader_election.cc:336] T 3288c98248464af5b8f3227349002ec7 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Service unavailable: reactor is shutting down (error 108)
W20260709 12:15:08.814711 25293 raft_consensus.cc:2686] T 72e7c4f1de5d4e28a4c1bf09d4fb099b P 3262bf0553e543eea76794fc529a9acc: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:15:08.817047  5585 leader_election.cc:336] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Service unavailable: reactor is shutting down (error 108)
I20260709 12:15:08.817473  5585 leader_election.cc:304] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:15:08.818254  5585 raft_consensus.cc:2686] T cff430729a9d4c8183d8ddad129d6ecf P 3262bf0553e543eea76794fc529a9acc: unable to run election callback: Service unavailable: The pool has been shut down.
W20260709 12:15:08.823577  5585 leader_election.cc:336] T f9abba0c7cca40c4b2a9ffbcde803684 P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Service unavailable: reactor is shutting down (error 108)
W20260709 12:15:08.825901  5585 leader_election.cc:336] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer ac3ac2181aa941229a758ccf6b5607cd (127.24.179.66:40567): Service unavailable: reactor is shutting down (error 108)
I20260709 12:15:08.826263  5585 leader_election.cc:304] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3262bf0553e543eea76794fc529a9acc; no voters: aaadfdd9ca9f424c91505f9b43876233, ac3ac2181aa941229a758ccf6b5607cd
W20260709 12:15:08.826781  5585 raft_consensus.cc:2686] T dee06ad5f38b42f99fdbc1d71eee680f P 3262bf0553e543eea76794fc529a9acc: unable to run election callback: Service unavailable: The pool has been shut down.
I20260709 12:15:09.234686 25293 tablet_server.cc:196] TabletServer@127.24.179.68:0 shutdown complete.
I20260709 12:15:09.304803 25293 master.cc:562] Master@127.24.179.126:41797 shutting down...
W20260709 12:15:09.349711 26419 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:15:09.350092 26419 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:15:09.350273 26419 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:15:17.975932 26357 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111) [suppressed 600 similar messages]
W20260709 12:15:17.982729 26357 catalog_manager.cc:4755] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cff430729a9d4c8183d8ddad129d6ecf: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:24.644500 26357 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:24.648675 26357 catalog_manager.cc:4755] TS 01a57027214a411e80874ac7febd628b (127.24.179.65:45149): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 63a71194fb3446e6b7b3135fde882816: Network error: Client connection negotiation failed: client connection to 127.24.179.65:45149: connect: Connection refused (error 111)
W20260709 12:15:26.739454 26358 catalog_manager.cc:4755] TS 3262bf0553e543eea76794fc529a9acc (127.24.179.68:35069): ChangeConfig:REMOVE_PEER RPC failed for tablet 953d8c981a6c459f8b7f3dbbb66fda45: Network error: Client connection negotiation failed: client connection to 127.24.179.68:35069: connect: Connection refused (error 111)
I20260709 12:15:30.602942 25293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:30.604147 25293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.604604 25293 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8f3fd02e9cbb4cbb90df37bb5fd109c3: stopping tablet replica
I20260709 12:15:30.899698 25293 master.cc:584] Master@127.24.179.126:41797 shutdown complete.
I20260709 12:15:30.960418 25293 test_util.cc:182] -----------------------------------------------
I20260709 12:15:30.960707 25293 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894834136-25293-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (375479 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:15:30.964684 25293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.179.126:35651
I20260709 12:15:30.965924 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:30.973062  5733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:30.973564  5736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:30.975054  5734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:30.976634 25293 server_base.cc:1061] running on GCE node
I20260709 12:15:30.981578 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:30.981833 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:30.981953 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599330981942 us; error 0 us; skew 500 ppm
I20260709 12:15:30.982520 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:30.985224 25293 webserver.cc:533] Webserver started at http://127.24.179.126:42339/ using document root <none> and password file <none>
I20260709 12:15:30.985747 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:30.985924 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:30.986140 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:30.987560 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/master-0-root/instance:
uuid: "535313c9291745aeb35e608528f80060"
format_stamp: "Formatted at 2026-07-09 12:15:30 on dist-test-slave-tjfs"
I20260709 12:15:30.992693 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.001s
I20260709 12:15:30.996706  5741 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:30.997687 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:15:30.998039 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/master-0-root
uuid: "535313c9291745aeb35e608528f80060"
format_stamp: "Formatted at 2026-07-09 12:15:30 on dist-test-slave-tjfs"
I20260709 12:15:30.998364 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:31.025014 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:31.026535 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:31.070163 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.126:35651
I20260709 12:15:31.070322  5792 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.126:35651 every 8 connection(s)
I20260709 12:15:31.075217  5793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:31.088387  5793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060: Bootstrap starting.
I20260709 12:15:31.093710  5793 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.098829  5793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060: No bootstrap required, opened a new log
I20260709 12:15:31.101466  5793 raft_consensus.cc:359] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "535313c9291745aeb35e608528f80060" member_type: VOTER }
I20260709 12:15:31.102087  5793 raft_consensus.cc:385] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.102276  5793 raft_consensus.cc:740] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 535313c9291745aeb35e608528f80060, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.102869  5793 consensus_queue.cc:260] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "535313c9291745aeb35e608528f80060" member_type: VOTER }
I20260709 12:15:31.103333  5793 raft_consensus.cc:399] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:31.103535  5793 raft_consensus.cc:493] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:31.103782  5793 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:31.109150  5793 raft_consensus.cc:515] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "535313c9291745aeb35e608528f80060" member_type: VOTER }
I20260709 12:15:31.109818  5793 leader_election.cc:304] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 535313c9291745aeb35e608528f80060; no voters: 
I20260709 12:15:31.111145  5793 leader_election.cc:290] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:31.111514  5796 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:31.113063  5796 raft_consensus.cc:697] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060 [term 1 LEADER]: Becoming Leader. State: Replica: 535313c9291745aeb35e608528f80060, State: Running, Role: LEADER
I20260709 12:15:31.113778  5796 consensus_queue.cc:237] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "535313c9291745aeb35e608528f80060" member_type: VOTER }
I20260709 12:15:31.114557  5793 sys_catalog.cc:565] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:31.120683  5797 sys_catalog.cc:455] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "535313c9291745aeb35e608528f80060" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "535313c9291745aeb35e608528f80060" member_type: VOTER } }
I20260709 12:15:31.120664  5798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 535313c9291745aeb35e608528f80060. Latest consensus state: current_term: 1 leader_uuid: "535313c9291745aeb35e608528f80060" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "535313c9291745aeb35e608528f80060" member_type: VOTER } }
I20260709 12:15:31.121590  5797 sys_catalog.cc:458] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:31.121712  5798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:31.131708  5804 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:31.140282  5804 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:31.141491 25293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:31.151298  5804 catalog_manager.cc:1383] Generated new cluster ID: 6b8adcc517c64e74ad2bb1e683c4a777
I20260709 12:15:31.151613  5804 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:31.183606  5804 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:31.185112  5804 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:31.203531  5804 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060: Generated new TSK 0
I20260709 12:15:31.204242  5804 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:31.273233 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:31.281297  5815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:31.281636  5814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:31.284925  5817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:31.285246 25293 server_base.cc:1061] running on GCE node
I20260709 12:15:31.288511 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:31.288823 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:31.289034 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599331289006 us; error 0 us; skew 500 ppm
I20260709 12:15:31.289669 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:31.292450 25293 webserver.cc:533] Webserver started at http://127.24.179.65:45873/ using document root <none> and password file <none>
I20260709 12:15:31.292985 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:31.293206 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:31.293514 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:31.294883 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-0-root/instance:
uuid: "58ed30c66c784e06ad64609f8d1b4c43"
format_stamp: "Formatted at 2026-07-09 12:15:31 on dist-test-slave-tjfs"
I20260709 12:15:31.299901 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:15:31.304018  5822 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:31.304905 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:15:31.305254 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-0-root
uuid: "58ed30c66c784e06ad64609f8d1b4c43"
format_stamp: "Formatted at 2026-07-09 12:15:31 on dist-test-slave-tjfs"
I20260709 12:15:31.305581 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:31.318131 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:31.319581 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:31.321171 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:31.323768 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:31.324023 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:31.324287 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:31.324482 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:31.372763 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.65:38243
I20260709 12:15:31.372977  5884 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.65:38243 every 8 connection(s)
I20260709 12:15:31.378692 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:31.386891  5889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:31.388922  5890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:31.392797  5892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:31.393380 25293 server_base.cc:1061] running on GCE node
I20260709 12:15:31.395223  5885 heartbeater.cc:344] Connected to a master server at 127.24.179.126:35651
I20260709 12:15:31.396548  5885 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:31.397491 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:15:31.397507  5885 heartbeater.cc:507] Master 127.24.179.126:35651 requested a full tablet report, sending...
W20260709 12:15:31.397837 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:31.398131 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599331398110 us; error 0 us; skew 500 ppm
I20260709 12:15:31.399221 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:31.400631  5758 ts_manager.cc:194] Registered new tserver with Master: 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:31.402495 25293 webserver.cc:533] Webserver started at http://127.24.179.66:38203/ using document root <none> and password file <none>
I20260709 12:15:31.403118 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:31.403115  5758 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36582
I20260709 12:15:31.403388 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:31.403803 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:31.405419 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-1-root/instance:
uuid: "26615d25670745d38490e2d6da247d9e"
format_stamp: "Formatted at 2026-07-09 12:15:31 on dist-test-slave-tjfs"
I20260709 12:15:31.410744 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:15:31.414834  5897 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:31.415725 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:15:31.416234 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-1-root
uuid: "26615d25670745d38490e2d6da247d9e"
format_stamp: "Formatted at 2026-07-09 12:15:31 on dist-test-slave-tjfs"
I20260709 12:15:31.416574 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:31.435832 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:31.437214 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:31.439059 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:31.441608 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:31.441859 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:31.442130 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:31.442312 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:31.487859 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.66:33793
I20260709 12:15:31.487972  5959 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.66:33793 every 8 connection(s)
I20260709 12:15:31.493371 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:31.501833  5963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:31.502655  5964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:31.504932  5966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:31.506080 25293 server_base.cc:1061] running on GCE node
I20260709 12:15:31.507426 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:31.507747 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:31.507982 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599331507959 us; error 0 us; skew 500 ppm
I20260709 12:15:31.508468  5960 heartbeater.cc:344] Connected to a master server at 127.24.179.126:35651
I20260709 12:15:31.508939  5960 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:31.508944 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:31.510100  5960 heartbeater.cc:507] Master 127.24.179.126:35651 requested a full tablet report, sending...
I20260709 12:15:31.512403 25293 webserver.cc:533] Webserver started at http://127.24.179.67:41283/ using document root <none> and password file <none>
I20260709 12:15:31.512960  5758 ts_manager.cc:194] Registered new tserver with Master: 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:31.513178 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:31.513478 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:31.513813 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:31.515035  5758 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36590
I20260709 12:15:31.515484 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-2-root/instance:
uuid: "e29106aa83aa4eebb9b87d6745825a27"
format_stamp: "Formatted at 2026-07-09 12:15:31 on dist-test-slave-tjfs"
I20260709 12:15:31.521314 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:15:31.525146  5971 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:31.526157 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:15:31.526546 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-2-root
uuid: "e29106aa83aa4eebb9b87d6745825a27"
format_stamp: "Formatted at 2026-07-09 12:15:31 on dist-test-slave-tjfs"
I20260709 12:15:31.526875 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:31.540181 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:31.541523 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:31.543292 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:31.545753 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:31.546015 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:31.546283 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:31.546489 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 12:15:31.593032 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.67:34139
I20260709 12:15:31.593155  6033 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.67:34139 every 8 connection(s)
I20260709 12:15:31.598727 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:31.609078  6037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:31.609426  6038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:31.612033  6034 heartbeater.cc:344] Connected to a master server at 127.24.179.126:35651
I20260709 12:15:31.612658  6034 heartbeater.cc:461] Registering TS with master...
W20260709 12:15:31.613062  6040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:31.613996  6034 heartbeater.cc:507] Master 127.24.179.126:35651 requested a full tablet report, sending...
I20260709 12:15:31.614348 25293 server_base.cc:1061] running on GCE node
I20260709 12:15:31.615547 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:31.615872 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:31.616094 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599331616077 us; error 0 us; skew 500 ppm
I20260709 12:15:31.616927 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:31.616796  5758 ts_manager.cc:194] Registered new tserver with Master: e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:31.619129  5758 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36596
I20260709 12:15:31.620363 25293 webserver.cc:533] Webserver started at http://127.24.179.68:43905/ using document root <none> and password file <none>
I20260709 12:15:31.621034 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:31.621218 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:31.621588 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:31.623260 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-3-root/instance:
uuid: "36dfe581d09b46f6a9bfe678170e71cb"
format_stamp: "Formatted at 2026-07-09 12:15:31 on dist-test-slave-tjfs"
I20260709 12:15:31.628818 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 12:15:31.632917  6045 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:31.633852 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:15:31.634210 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-3-root
uuid: "36dfe581d09b46f6a9bfe678170e71cb"
format_stamp: "Formatted at 2026-07-09 12:15:31 on dist-test-slave-tjfs"
I20260709 12:15:31.634594 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:31.661420 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:31.662937 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:31.664428 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:31.667069 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:31.667344 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:31.667606 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:31.667804 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:31.716282 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.68:44517
I20260709 12:15:31.716328  6107 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.68:44517 every 8 connection(s)
I20260709 12:15:31.735528  6108 heartbeater.cc:344] Connected to a master server at 127.24.179.126:35651
I20260709 12:15:31.736014  6108 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:31.736931  6108 heartbeater.cc:507] Master 127.24.179.126:35651 requested a full tablet report, sending...
I20260709 12:15:31.739079  5758 ts_manager.cc:194] Registered new tserver with Master: 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:31.739741 25293 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.019379669s
I20260709 12:15:31.740640  5758 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36612
I20260709 12:15:31.770874  5758 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36616:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:15:32.035171  5850 tablet_service.cc:1511] Processing CreateTablet for tablet 1df660011133455e8ede132d5d56c48f (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:15:32.037056  5850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df660011133455e8ede132d5d56c48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.039788  5849 tablet_service.cc:1511] Processing CreateTablet for tablet 1e05435b58ec4a7ca6d7ea02368e5dcf (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:15:32.040412  5848 tablet_service.cc:1511] Processing CreateTablet for tablet f35395bd69ad41f0b37fd3edca49777c (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:15:32.041623  5849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e05435b58ec4a7ca6d7ea02368e5dcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.042364  5848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f35395bd69ad41f0b37fd3edca49777c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.053123  5847 tablet_service.cc:1511] Processing CreateTablet for tablet 62a474468455492f992eb8dfefad0ca2 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:15:32.055024  5847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62a474468455492f992eb8dfefad0ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.065019  5846 tablet_service.cc:1511] Processing CreateTablet for tablet 29ee607f5bb24b4bab4cd993a2327277 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:15:32.067015  5846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29ee607f5bb24b4bab4cd993a2327277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.073454  5999 tablet_service.cc:1511] Processing CreateTablet for tablet 1df660011133455e8ede132d5d56c48f (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:15:32.075570  5999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df660011133455e8ede132d5d56c48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.076767  5845 tablet_service.cc:1511] Processing CreateTablet for tablet 873d3215e6ba4214a3910fa16e0fd62a (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:15:32.078761  5845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 873d3215e6ba4214a3910fa16e0fd62a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.089569  5998 tablet_service.cc:1511] Processing CreateTablet for tablet 1e05435b58ec4a7ca6d7ea02368e5dcf (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:15:32.091351  5998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e05435b58ec4a7ca6d7ea02368e5dcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.096570  5850 tablet_service.cc:1511] Processing CreateTablet for tablet c9a66f01ced34c71b061ec163494f2b6 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:15:32.098182  5850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a66f01ced34c71b061ec163494f2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.097883  5844 tablet_service.cc:1511] Processing CreateTablet for tablet 0484fe261cb3459cb6a2f532f88c0845 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:15:32.099639  5844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0484fe261cb3459cb6a2f532f88c0845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.099771  5997 tablet_service.cc:1511] Processing CreateTablet for tablet 171e5dfe30b74c94b9753cf4c647695f (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:15:32.101292  5997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 171e5dfe30b74c94b9753cf4c647695f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.105284  5843 tablet_service.cc:1511] Processing CreateTablet for tablet 972a71bd13ef4022b6966d1287868dc4 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:15:32.107088  5843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 972a71bd13ef4022b6966d1287868dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.112638  5996 tablet_service.cc:1511] Processing CreateTablet for tablet 62a474468455492f992eb8dfefad0ca2 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:15:32.114307  5996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62a474468455492f992eb8dfefad0ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.128707  5995 tablet_service.cc:1511] Processing CreateTablet for tablet 873d3215e6ba4214a3910fa16e0fd62a (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:15:32.131240  5841 tablet_service.cc:1511] Processing CreateTablet for tablet 687e45fe6f3444c794271e801c21280d (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:15:32.132979  5841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687e45fe6f3444c794271e801c21280d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:32.133400  5806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:32.128707  5842 tablet_service.cc:1511] Processing CreateTablet for tablet 42fdfcec3d9049a2a38158457d409feb (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:15:32.135461  5995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 873d3215e6ba4214a3910fa16e0fd62a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.138446  5842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42fdfcec3d9049a2a38158457d409feb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.152716  5994 tablet_service.cc:1511] Processing CreateTablet for tablet 8bde6283aae54cca934953a54d9f7483 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:15:32.156791  5994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bde6283aae54cca934953a54d9f7483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.164320  5993 tablet_service.cc:1511] Processing CreateTablet for tablet c9a66f01ced34c71b061ec163494f2b6 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:15:32.166181  5993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a66f01ced34c71b061ec163494f2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.168555  5992 tablet_service.cc:1511] Processing CreateTablet for tablet 972a71bd13ef4022b6966d1287868dc4 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:15:32.174266  5990 tablet_service.cc:1511] Processing CreateTablet for tablet 42fdfcec3d9049a2a38158457d409feb (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:15:32.175900  5992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 972a71bd13ef4022b6966d1287868dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.176702  5990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42fdfcec3d9049a2a38158457d409feb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.171535  5991 tablet_service.cc:1511] Processing CreateTablet for tablet 2c20504b20bf4686afff8a8417bdc035 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:15:32.179564  5991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c20504b20bf4686afff8a8417bdc035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.187446  5843 tablet_service.cc:1511] Processing CreateTablet for tablet 33d81a90a1a04c558e7d4b2e844d22ce (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:15:32.189337  5843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d81a90a1a04c558e7d4b2e844d22ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.218576  5925 tablet_service.cc:1511] Processing CreateTablet for tablet 1e05435b58ec4a7ca6d7ea02368e5dcf (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:15:32.220249  5925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e05435b58ec4a7ca6d7ea02368e5dcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.223778  5924 tablet_service.cc:1511] Processing CreateTablet for tablet f35395bd69ad41f0b37fd3edca49777c (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:15:32.225533  5924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f35395bd69ad41f0b37fd3edca49777c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.227887  5923 tablet_service.cc:1511] Processing CreateTablet for tablet 171e5dfe30b74c94b9753cf4c647695f (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:15:32.229698  5923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 171e5dfe30b74c94b9753cf4c647695f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.231323  5921 tablet_service.cc:1511] Processing CreateTablet for tablet 29ee607f5bb24b4bab4cd993a2327277 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:15:32.233038  5921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29ee607f5bb24b4bab4cd993a2327277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.229223  5922 tablet_service.cc:1511] Processing CreateTablet for tablet 62a474468455492f992eb8dfefad0ca2 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:15:32.235765  5920 tablet_service.cc:1511] Processing CreateTablet for tablet 8bde6283aae54cca934953a54d9f7483 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:15:32.236100  5918 tablet_service.cc:1511] Processing CreateTablet for tablet 0484fe261cb3459cb6a2f532f88c0845 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:15:32.237291  5920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bde6283aae54cca934953a54d9f7483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.227883  6128 tablet_bootstrap.cc:492] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:32.238884  5919 tablet_service.cc:1511] Processing CreateTablet for tablet c9a66f01ced34c71b061ec163494f2b6 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:15:32.241266  5919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a66f01ced34c71b061ec163494f2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.241073  5917 tablet_service.cc:1511] Processing CreateTablet for tablet 2c20504b20bf4686afff8a8417bdc035 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:15:32.243103  5918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0484fe261cb3459cb6a2f532f88c0845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.244096  5922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62a474468455492f992eb8dfefad0ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.249296  5917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c20504b20bf4686afff8a8417bdc035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.277184  5849 tablet_service.cc:1511] Processing CreateTablet for tablet 7ba593a994ff44d7866a70004fd0a946 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:15:32.341127  5993 tablet_service.cc:1511] Processing CreateTablet for tablet 33d81a90a1a04c558e7d4b2e844d22ce (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:15:32.342185  5916 tablet_service.cc:1511] Processing CreateTablet for tablet 42fdfcec3d9049a2a38158457d409feb (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:15:32.343736  5916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42fdfcec3d9049a2a38158457d409feb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.367879  6129 tablet_bootstrap.cc:492] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:32.370749  5993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d81a90a1a04c558e7d4b2e844d22ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.371147  5849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ba593a994ff44d7866a70004fd0a946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.370072  5843 tablet_service.cc:1511] Processing CreateTablet for tablet 32e2e4b0423a493e8f0d323065688bd1 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:15:32.383844  5843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32e2e4b0423a493e8f0d323065688bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.391831  6073 tablet_service.cc:1511] Processing CreateTablet for tablet 1df660011133455e8ede132d5d56c48f (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:15:32.393483  6073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df660011133455e8ede132d5d56c48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.395763  6067 tablet_service.cc:1511] Processing CreateTablet for tablet 0484fe261cb3459cb6a2f532f88c0845 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:15:32.396241  6072 tablet_service.cc:1511] Processing CreateTablet for tablet f35395bd69ad41f0b37fd3edca49777c (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:15:32.397451  6067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0484fe261cb3459cb6a2f532f88c0845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.398752  6071 tablet_service.cc:1511] Processing CreateTablet for tablet 171e5dfe30b74c94b9753cf4c647695f (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:15:32.400573  6065 tablet_service.cc:1511] Processing CreateTablet for tablet 2c20504b20bf4686afff8a8417bdc035 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:15:32.401687  6070 tablet_service.cc:1511] Processing CreateTablet for tablet 29ee607f5bb24b4bab4cd993a2327277 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:15:32.402354  6064 tablet_service.cc:1511] Processing CreateTablet for tablet 687e45fe6f3444c794271e801c21280d (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:15:32.404420  6069 tablet_service.cc:1511] Processing CreateTablet for tablet 873d3215e6ba4214a3910fa16e0fd62a (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:15:32.404940  6066 tablet_service.cc:1511] Processing CreateTablet for tablet 972a71bd13ef4022b6966d1287868dc4 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:15:32.406080  6072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f35395bd69ad41f0b37fd3edca49777c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.406591  6068 tablet_service.cc:1511] Processing CreateTablet for tablet 8bde6283aae54cca934953a54d9f7483 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:15:32.408085  6068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bde6283aae54cca934953a54d9f7483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.410754  5885 heartbeater.cc:499] Master 127.24.179.126:35651 was elected leader, sending a full tablet report...
I20260709 12:15:32.411739  6071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 171e5dfe30b74c94b9753cf4c647695f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.459241  5848 tablet_service.cc:1511] Processing CreateTablet for tablet e2dad9466c8e40558116511df4c6330e (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:15:32.460728  5848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2dad9466c8e40558116511df4c6330e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.462844  6065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c20504b20bf4686afff8a8417bdc035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.465564  5846 tablet_service.cc:1511] Processing CreateTablet for tablet e18f65fb1b1f4544b9e6a96399e38089 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:15:32.413262  5997 tablet_service.cc:1511] Processing CreateTablet for tablet e2dad9466c8e40558116511df4c6330e (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:15:32.467216  5846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18f65fb1b1f4544b9e6a96399e38089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.468024  5997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2dad9466c8e40558116511df4c6330e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.470800  6129 tablet_bootstrap.cc:654] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.428872  5990 tablet_service.cc:1511] Processing CreateTablet for tablet 7ba593a994ff44d7866a70004fd0a946 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:15:32.447675  5994 tablet_service.cc:1511] Processing CreateTablet for tablet 27058558598c4834804424f2de3c1cea (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:15:32.472757  5990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ba593a994ff44d7866a70004fd0a946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.473460  5994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27058558598c4834804424f2de3c1cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.475116  6128 tablet_bootstrap.cc:654] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.479871  5841 tablet_service.cc:1511] Processing CreateTablet for tablet 45528a8d878d46d89244614343fc6e90 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:15:32.481601  5841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45528a8d878d46d89244614343fc6e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.466830  6069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 873d3215e6ba4214a3910fa16e0fd62a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.482877  6066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 972a71bd13ef4022b6966d1287868dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.486864  6070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29ee607f5bb24b4bab4cd993a2327277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.487851  5842 tablet_service.cc:1511] Processing CreateTablet for tablet db31c56e0c1b4701bc388c4d3edf535a (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:15:32.489552  5842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db31c56e0c1b4701bc388c4d3edf535a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.411083  5999 tablet_service.cc:1511] Processing CreateTablet for tablet cd00b832aafb491387eee88b954ff5df (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:15:32.490841  6064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687e45fe6f3444c794271e801c21280d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.490756  5991 tablet_service.cc:1511] Processing CreateTablet for tablet e18f65fb1b1f4544b9e6a96399e38089 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:15:32.496709  5996 tablet_service.cc:1511] Processing CreateTablet for tablet 41f23027ce3e4c149ba8309105929682 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:15:32.519373  5960 heartbeater.cc:499] Master 127.24.179.126:35651 was elected leader, sending a full tablet report...
I20260709 12:15:32.521443  5845 tablet_service.cc:1511] Processing CreateTablet for tablet 27058558598c4834804424f2de3c1cea (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:15:32.503541  6128 tablet_bootstrap.cc:492] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:32.540230  5844 tablet_service.cc:1511] Processing CreateTablet for tablet d48d13e87f1d4964bb74ba350c2e2df5 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:15:32.534821  5999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd00b832aafb491387eee88b954ff5df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.557163  6128 ts_tablet_manager.cc:1403] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.330s	user 0.008s	sys 0.017s
I20260709 12:15:32.569011  6073 tablet_service.cc:1511] Processing CreateTablet for tablet 32e2e4b0423a493e8f0d323065688bd1 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:15:32.576773  5847 tablet_service.cc:1511] Processing CreateTablet for tablet f0199e88be05480094c047ed4a193589 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:15:32.502875  5998 tablet_service.cc:1511] Processing CreateTablet for tablet a7299ddfb5eb4240b757da7c444170c9 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:15:32.584643  5995 tablet_service.cc:1511] Processing CreateTablet for tablet db31c56e0c1b4701bc388c4d3edf535a (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:15:32.587321  5992 tablet_service.cc:1511] Processing CreateTablet for tablet 525a431d53e142a8b9afb97f02fa94bb (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:15:32.574251  5850 tablet_service.cc:1511] Processing CreateTablet for tablet 525a431d53e142a8b9afb97f02fa94bb (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:15:32.591517  5845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27058558598c4834804424f2de3c1cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.621400  6073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32e2e4b0423a493e8f0d323065688bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.622500  6034 heartbeater.cc:499] Master 127.24.179.126:35651 was elected leader, sending a full tablet report...
I20260709 12:15:32.622566  5991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18f65fb1b1f4544b9e6a96399e38089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.627647  6132 tablet_bootstrap.cc:492] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:32.638952  5998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7299ddfb5eb4240b757da7c444170c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.641647  6072 tablet_service.cc:1511] Processing CreateTablet for tablet e18f65fb1b1f4544b9e6a96399e38089 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:15:32.641958  6064 tablet_service.cc:1511] Processing CreateTablet for tablet 33d81a90a1a04c558e7d4b2e844d22ce (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:15:32.643453  6072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18f65fb1b1f4544b9e6a96399e38089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.643738  5850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525a431d53e142a8b9afb97f02fa94bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.644568  5844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d48d13e87f1d4964bb74ba350c2e2df5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.648204  6132 tablet_bootstrap.cc:654] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.655216  6064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d81a90a1a04c558e7d4b2e844d22ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.656682  5847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0199e88be05480094c047ed4a193589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.665810  5996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f23027ce3e4c149ba8309105929682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.665218  5920 tablet_service.cc:1511] Processing CreateTablet for tablet cd00b832aafb491387eee88b954ff5df (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:15:32.674248  6066 tablet_service.cc:1511] Processing CreateTablet for tablet cd00b832aafb491387eee88b954ff5df (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:15:32.675778  5992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525a431d53e142a8b9afb97f02fa94bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.675683  5916 tablet_service.cc:1511] Processing CreateTablet for tablet e2dad9466c8e40558116511df4c6330e (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:15:32.680227  6066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd00b832aafb491387eee88b954ff5df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.680989  5995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db31c56e0c1b4701bc388c4d3edf535a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.683319  5919 tablet_service.cc:1511] Processing CreateTablet for tablet 687e45fe6f3444c794271e801c21280d (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:15:32.685199  5920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd00b832aafb491387eee88b954ff5df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.679742  6128 raft_consensus.cc:359] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:32.692469  6070 tablet_service.cc:1511] Processing CreateTablet for tablet a7299ddfb5eb4240b757da7c444170c9 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:15:32.697350  5990 tablet_service.cc:1511] Processing CreateTablet for tablet f8800c8a47a0449783d57a6275b2f677 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:15:32.699518  5990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8800c8a47a0449783d57a6275b2f677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.699762  6129 tablet_bootstrap.cc:492] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:32.700526  6129 ts_tablet_manager.cc:1403] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.333s	user 0.016s	sys 0.022s
I20260709 12:15:32.705480  5923 tablet_service.cc:1511] Processing CreateTablet for tablet 7ba593a994ff44d7866a70004fd0a946 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:15:32.708868  6070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7299ddfb5eb4240b757da7c444170c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.712226  5919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687e45fe6f3444c794271e801c21280d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.666214  5918 tablet_service.cc:1511] Processing CreateTablet for tablet a7299ddfb5eb4240b757da7c444170c9 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:15:32.706105  5993 tablet_service.cc:1511] Processing CreateTablet for tablet f0199e88be05480094c047ed4a193589 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:15:32.731163  6068 tablet_service.cc:1511] Processing CreateTablet for tablet 45528a8d878d46d89244614343fc6e90 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:15:32.762234  5993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0199e88be05480094c047ed4a193589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.763393  6068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45528a8d878d46d89244614343fc6e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.738528  6133 tablet_bootstrap.cc:492] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:32.743822  6108 heartbeater.cc:499] Master 127.24.179.126:35651 was elected leader, sending a full tablet report...
W20260709 12:15:32.747192  5743 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 67719.9us
I20260709 12:15:32.779676  6073 tablet_service.cc:1511] Processing CreateTablet for tablet 27058558598c4834804424f2de3c1cea (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:15:32.781311  6073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27058558598c4834804424f2de3c1cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.733523  6129 raft_consensus.cc:359] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:32.782629  6129 raft_consensus.cc:385] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.783044  6129 raft_consensus.cc:740] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.779718  5999 tablet_service.cc:1511] Processing CreateTablet for tablet 3a260b81828b4baab927a2d3f2253be4 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:15:32.784085  6129 consensus_queue.cc:260] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:32.688772  6128 raft_consensus.cc:385] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.785863  6128 raft_consensus.cc:740] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.786937  6128 consensus_queue.cc:260] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:32.787619  5999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a260b81828b4baab927a2d3f2253be4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.783934  6065 tablet_service.cc:1511] Processing CreateTablet for tablet 525a431d53e142a8b9afb97f02fa94bb (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:15:32.791232  5991 tablet_service.cc:1511] Processing CreateTablet for tablet 214f52126a2c4bc59473ee7461e4a044 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:15:32.799453  5923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ba593a994ff44d7866a70004fd0a946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.769223  6071 tablet_service.cc:1511] Processing CreateTablet for tablet d48d13e87f1d4964bb74ba350c2e2df5 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:15:32.798810  6065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525a431d53e142a8b9afb97f02fa94bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.801719  5921 tablet_service.cc:1511] Processing CreateTablet for tablet 45528a8d878d46d89244614343fc6e90 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:15:32.805094  6071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d48d13e87f1d4964bb74ba350c2e2df5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.805368  5921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45528a8d878d46d89244614343fc6e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.796917  6067 tablet_service.cc:1511] Processing CreateTablet for tablet f8800c8a47a0449783d57a6275b2f677 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:15:32.803582  5997 tablet_service.cc:1511] Processing CreateTablet for tablet b14d71c733514ec9bc7ddb9d3b7cd80d (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:15:32.815024  5917 tablet_service.cc:1511] Processing CreateTablet for tablet 32e2e4b0423a493e8f0d323065688bd1 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:15:32.812441  6067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8800c8a47a0449783d57a6275b2f677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.814445  6072 tablet_service.cc:1511] Processing CreateTablet for tablet 41f23027ce3e4c149ba8309105929682 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:15:32.823885  5925 tablet_service.cc:1511] Processing CreateTablet for tablet 41f23027ce3e4c149ba8309105929682 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:15:32.825697  5925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f23027ce3e4c149ba8309105929682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.827867  5847 tablet_service.cc:1511] Processing CreateTablet for tablet b14d71c733514ec9bc7ddb9d3b7cd80d (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:15:32.830987  6072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f23027ce3e4c149ba8309105929682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.834079  5847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b14d71c733514ec9bc7ddb9d3b7cd80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.839283  5990 tablet_service.cc:1511] Processing CreateTablet for tablet 6cc7520eb74c4882b7e36fda0f66ca0e (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:15:32.840668  5994 tablet_service.cc:1511] Processing CreateTablet for tablet b75d901511f94357a67c07612cf07d1a (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:15:32.843621  5843 tablet_service.cc:1511] Processing CreateTablet for tablet 45a9878f315d4541b1bcbec3556ad32c (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:15:32.846977  6132 tablet_bootstrap.cc:492] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:32.848119  6069 tablet_service.cc:1511] Processing CreateTablet for tablet 353bf2c0ce2c412e9ca171f2bb150f91 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:15:32.870914  6132 ts_tablet_manager.cc:1403] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.244s	user 0.019s	sys 0.010s
I20260709 12:15:32.871507  6069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 353bf2c0ce2c412e9ca171f2bb150f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.874576  6132 raft_consensus.cc:359] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:32.875526  6132 raft_consensus.cc:385] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.875916  6132 raft_consensus.cc:740] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.876914  6132 consensus_queue.cc:260] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:32.850078  5842 tablet_service.cc:1511] Processing CreateTablet for tablet 214f52126a2c4bc59473ee7461e4a044 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:15:32.810339  5849 tablet_service.cc:1511] Processing CreateTablet for tablet 353bf2c0ce2c412e9ca171f2bb150f91 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:15:32.842177  5924 tablet_service.cc:1511] Processing CreateTablet for tablet db31c56e0c1b4701bc388c4d3edf535a (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:15:32.856801  5847 tablet_service.cc:1511] Processing CreateTablet for tablet a12649b3d49a4a309d961106ba152892 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:15:32.857707  5991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 214f52126a2c4bc59473ee7461e4a044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.856801  5922 tablet_service.cc:1511] Processing CreateTablet for tablet d48d13e87f1d4964bb74ba350c2e2df5 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:15:32.864111  5846 tablet_service.cc:1511] Processing CreateTablet for tablet 3a260b81828b4baab927a2d3f2253be4 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:15:32.881884  5916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2dad9466c8e40558116511df4c6330e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.886041  5848 tablet_service.cc:1511] Processing CreateTablet for tablet aa43bf33a33b443ba5cf0cdcb741f5fa (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:15:32.884277  6128 ts_tablet_manager.cc:1434] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.265s	user 0.006s	sys 0.003s
I20260709 12:15:32.889950  6129 ts_tablet_manager.cc:1434] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.189s	user 0.002s	sys 0.010s
I20260709 12:15:32.947769  6129 tablet_bootstrap.cc:492] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:32.951102  6128 tablet_bootstrap.cc:492] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:32.886040  5996 tablet_service.cc:1511] Processing CreateTablet for tablet a16996642a1b4752b788da1836791f3c (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:15:32.892897  6071 tablet_service.cc:1511] Processing CreateTablet for tablet b75d901511f94357a67c07612cf07d1a (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:15:32.835251  6133 tablet_bootstrap.cc:654] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.952510  6071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b75d901511f94357a67c07612cf07d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.853988  5850 tablet_service.cc:1511] Processing CreateTablet for tablet a16996642a1b4752b788da1836791f3c (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:15:32.899538  6065 tablet_service.cc:1511] Processing CreateTablet for tablet b14d71c733514ec9bc7ddb9d3b7cd80d (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:15:32.955317  5992 tablet_service.cc:1511] Processing CreateTablet for tablet a6e906733ca34216bf4664d81c7b19b2 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:15:32.956171  6065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b14d71c733514ec9bc7ddb9d3b7cd80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.903993  6068 tablet_service.cc:1511] Processing CreateTablet for tablet 45a9878f315d4541b1bcbec3556ad32c (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:15:32.959260  6068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a9878f315d4541b1bcbec3556ad32c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.908713  5842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 214f52126a2c4bc59473ee7461e4a044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.909803  5998 tablet_service.cc:1511] Processing CreateTablet for tablet d852dc979f7843dcbf8477fc409c2c68 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:15:32.930284  5919 tablet_service.cc:1511] Processing CreateTablet for tablet f8800c8a47a0449783d57a6275b2f677 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:15:32.882157  5995 tablet_service.cc:1511] Processing CreateTablet for tablet aa43bf33a33b443ba5cf0cdcb741f5fa (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:15:32.955186  5996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a16996642a1b4752b788da1836791f3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.999859  5992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6e906733ca34216bf4664d81c7b19b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.971280  5924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db31c56e0c1b4701bc388c4d3edf535a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.005417  6064 tablet_service.cc:1511] Processing CreateTablet for tablet a12649b3d49a4a309d961106ba152892 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:15:33.007217  5994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b75d901511f94357a67c07612cf07d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:32.947813  6070 tablet_service.cc:1511] Processing CreateTablet for tablet 214f52126a2c4bc59473ee7461e4a044 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:15:33.007778  6132 ts_tablet_manager.cc:1434] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.136s	user 0.008s	sys 0.029s
I20260709 12:15:32.966133  5920 tablet_service.cc:1511] Processing CreateTablet for tablet 353bf2c0ce2c412e9ca171f2bb150f91 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:15:33.018321  5841 tablet_service.cc:1511] Processing CreateTablet for tablet b081fa5436f34e5e9e477b502f689461 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:15:32.985927  5844 tablet_service.cc:1511] Processing CreateTablet for tablet a6e906733ca34216bf4664d81c7b19b2 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:15:33.045596  6072 tablet_service.cc:1511] Processing CreateTablet for tablet b081fa5436f34e5e9e477b502f689461 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:15:32.971053  6066 tablet_service.cc:1511] Processing CreateTablet for tablet 6cc7520eb74c4882b7e36fda0f66ca0e (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:15:32.966276  6129 tablet_bootstrap.cc:654] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:33.012622  6064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a12649b3d49a4a309d961106ba152892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.022675  6067 tablet_service.cc:1511] Processing CreateTablet for tablet d852dc979f7843dcbf8477fc409c2c68 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:15:33.039939  6068 tablet_service.cc:1511] Processing CreateTablet for tablet d792c0dd53aa459399c3adf5d4f17f58 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:15:33.013278  5993 tablet_service.cc:1511] Processing CreateTablet for tablet b081fa5436f34e5e9e477b502f689461 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:15:33.041623  6133 tablet_bootstrap.cc:492] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:33.014710  5846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a260b81828b4baab927a2d3f2253be4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.056591  6133 ts_tablet_manager.cc:1403] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.386s	user 0.011s	sys 0.009s
I20260709 12:15:33.032661  6132 tablet_bootstrap.cc:492] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:33.059680  5923 tablet_service.cc:1511] Processing CreateTablet for tablet b75d901511f94357a67c07612cf07d1a (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:15:33.026782  5997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b14d71c733514ec9bc7ddb9d3b7cd80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.062850  5843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a9878f315d4541b1bcbec3556ad32c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.064851  6133 raft_consensus.cc:359] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:33.014461  6135 raft_consensus.cc:493] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.015111  5921 tablet_service.cc:1511] Processing CreateTablet for tablet f0199e88be05480094c047ed4a193589 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:15:33.015865  6073 tablet_service.cc:1511] Processing CreateTablet for tablet aa43bf33a33b443ba5cf0cdcb741f5fa (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:15:33.055464  6070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 214f52126a2c4bc59473ee7461e4a044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.014415  5845 tablet_service.cc:1511] Processing CreateTablet for tablet d792c0dd53aa459399c3adf5d4f17f58 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:15:33.067203  6135 raft_consensus.cc:515] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:33.067880  6133 raft_consensus.cc:385] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.069453  6133 raft_consensus.cc:740] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:33.070062  6068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d792c0dd53aa459399c3adf5d4f17f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.068626  5850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a16996642a1b4752b788da1836791f3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.068440  5990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc7520eb74c4882b7e36fda0f66ca0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.071470  5845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d792c0dd53aa459399c3adf5d4f17f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.071885  6066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc7520eb74c4882b7e36fda0f66ca0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.073796  5849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 353bf2c0ce2c412e9ca171f2bb150f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.074632  6073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa43bf33a33b443ba5cf0cdcb741f5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.075103  5848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa43bf33a33b443ba5cf0cdcb741f5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.076056  5841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b081fa5436f34e5e9e477b502f689461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.081435  5847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a12649b3d49a4a309d961106ba152892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.084403  6133 consensus_queue.cc:260] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:33.085110  5995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa43bf33a33b443ba5cf0cdcb741f5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.086270  5993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b081fa5436f34e5e9e477b502f689461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.088512  6067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d852dc979f7843dcbf8477fc409c2c68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.097591  5998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d852dc979f7843dcbf8477fc409c2c68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.103530  6135 leader_election.cc:290] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:33.120146  5844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6e906733ca34216bf4664d81c7b19b2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:33.133526  5886 tablet.cc:2406] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:15:33.133888  5842 tablet_service.cc:1511] Processing CreateTablet for tablet a88edbe785c84f7fb5720879c30d6477 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:15:33.135957  6071 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec4d35ac70348cb95a01355320f5686 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260709 12:15:33.136502  5806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:33.129738  5922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d48d13e87f1d4964bb74ba350c2e2df5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.147014  5917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32e2e4b0423a493e8f0d323065688bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.147723  6065 tablet_service.cc:1511] Processing CreateTablet for tablet 6500f59123914ed198a39756117b4110 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:15:33.150355  5918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7299ddfb5eb4240b757da7c444170c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.124915  6072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b081fa5436f34e5e9e477b502f689461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.159042  5919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8800c8a47a0449783d57a6275b2f677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.176776  6132 tablet_bootstrap.cc:654] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:33.192684  6069 tablet_service.cc:1511] Processing CreateTablet for tablet c3cdb9438c4a44489be534e4c1c147b5 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:15:33.194269  5842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a88edbe785c84f7fb5720879c30d6477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.224517  6136 raft_consensus.cc:493] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.225268  6136 raft_consensus.cc:515] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:33.227231  6137 raft_consensus.cc:493] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.227874  6137 raft_consensus.cc:515] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:33.232236  5921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0199e88be05480094c047ed4a193589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.233415  6065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6500f59123914ed198a39756117b4110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.253594  6137 leader_election.cc:290] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:33.289862  6071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec4d35ac70348cb95a01355320f5686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.302160  5916 tablet_service.cc:1511] Processing CreateTablet for tablet 3a260b81828b4baab927a2d3f2253be4 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:15:33.296016  5920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 353bf2c0ce2c412e9ca171f2bb150f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.315217  6133 ts_tablet_manager.cc:1434] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.258s	user 0.024s	sys 0.016s
I20260709 12:15:33.316735  6133 tablet_bootstrap.cc:492] T c9a66f01ced34c71b061ec163494f2b6 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:33.289978  6136 leader_election.cc:290] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:33.365818  5849 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37644 (request call id 22) took 1010 ms. Trace:
I20260709 12:15:33.339967  6128 tablet_bootstrap.cc:700] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43: Time spent opening tablet: real 0.218s	user 0.002s	sys 0.000s
I20260709 12:15:33.395588  5843 tablet_service.cc:1511] Processing CreateTablet for tablet 6500f59123914ed198a39756117b4110 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:15:33.397209  5843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6500f59123914ed198a39756117b4110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.398837  6128 tablet_bootstrap.cc:654] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:33.399045  5846 tablet_service.cc:1511] Processing CreateTablet for tablet c3cdb9438c4a44489be534e4c1c147b5 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:15:33.400564  5846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3cdb9438c4a44489be534e4c1c147b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.381453  6069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3cdb9438c4a44489be534e4c1c147b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.438568  5918 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 14) took 1086 ms. Trace:
I20260709 12:15:33.441934  5994 tablet_service.cc:1511] Processing CreateTablet for tablet a88edbe785c84f7fb5720879c30d6477 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:15:33.472735  5918 rpcz_store.cc:276] 0709 12:15:32.352282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.665074 (+312792us) service_pool.cc:224] Handling call
0709 12:15:32.810379 (+145305us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b10e831 00007f507b0ebac3 00007f507b09a400 00007f507451faf4 00007f507451fa82 00007f507451f9b1
0709 12:15:32.862638 (+ 52259us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:32.862761 (+   123us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.394097 (+531336us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.437899 (+ 43802us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:33.438490 (+   591us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79315200}
I20260709 12:15:33.473686  5994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a88edbe785c84f7fb5720879c30d6477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.475530  5918 tablet_service.cc:1511] Processing CreateTablet for tablet 45a9878f315d4541b1bcbec3556ad32c (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:15:33.366673  5849 rpcz_store.cc:276] 0709 12:15:32.355200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.809069 (+453869us) service_pool.cc:224] Handling call
0709 12:15:32.932761 (+123692us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:32.932854 (+    93us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.142214 (+209360us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.364879 (+222665us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:33.365709 (+   830us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:33.448489  6073 tablet_service.cc:1511] Processing CreateTablet for tablet 5cb1760bd0ba436eb7077c60542c0a45 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:15:33.449215  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:33.451537  5917 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 13) took 1099 ms. Trace:
I20260709 12:15:33.451817  5993 tablet_service.cc:1511] Processing CreateTablet for tablet c3cdb9438c4a44489be534e4c1c147b5 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:15:33.458544  5996 tablet_service.cc:1511] Processing CreateTablet for tablet 5cb1760bd0ba436eb7077c60542c0a45 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:15:33.459587  5845 tablet_service.cc:1511] Processing CreateTablet for tablet 2c61591bbcaf43839af1cc8373f98c7e (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:15:33.493582  6073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cb1760bd0ba436eb7077c60542c0a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.493582  5996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cb1760bd0ba436eb7077c60542c0a45. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:33.494540  5825 leader_election.cc:343] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.487504  5917 rpcz_store.cc:276] 0709 12:15:32.351953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.814030 (+462077us) service_pool.cc:224] Handling call
0709 12:15:32.863669 (+ 49639us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b10e831 00007f507b0ebac3 00007f507b09a400 00007f507451faf4 00007f507451fa82 00007f507451f9b1
0709 12:15:32.863846 (+   177us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:32.863958 (+   112us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.386410 (+522452us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.450899 (+ 64489us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:33.451465 (+   566us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3356032}
I20260709 12:15:33.485314  5916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a260b81828b4baab927a2d3f2253be4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.521759  5845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c61591bbcaf43839af1cc8373f98c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.522310  5993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3cdb9438c4a44489be534e4c1c147b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.530694  5918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a9878f315d4541b1bcbec3556ad32c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.531806  5992 tablet_service.cc:1511] Processing CreateTablet for tablet 2c61591bbcaf43839af1cc8373f98c7e (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:15:33.533273  5992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c61591bbcaf43839af1cc8373f98c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.535019  5991 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec4d35ac70348cb95a01355320f5686 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:15:33.539877  6143 raft_consensus.cc:493] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.540498  6143 raft_consensus.cc:515] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:33.536453  5991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec4d35ac70348cb95a01355320f5686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.545507  5917 tablet_service.cc:1511] Processing CreateTablet for tablet 6cc7520eb74c4882b7e36fda0f66ca0e (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:15:33.547020  5917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc7520eb74c4882b7e36fda0f66ca0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.548781  5990 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40900 (request call id 26) took 1073 ms. Trace:
I20260709 12:15:33.549274  5990 rpcz_store.cc:276] 0709 12:15:32.475585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.821424 (+345839us) service_pool.cc:224] Handling call
0709 12:15:32.840293 (+ 18869us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:32.840398 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.394132 (+553734us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.548205 (+154073us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:33.548712 (+   507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:33.551848  5999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40900 (request call id 24) took 1099 ms. Trace:
I20260709 12:15:33.552394  5999 rpcz_store.cc:276] 0709 12:15:32.452921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.778266 (+325345us) service_pool.cc:224] Handling call
0709 12:15:32.787045 (+  8779us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:32.787178 (+   133us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.053429 (+266251us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.551125 (+497696us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:33.551738 (+   613us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:33.559599  5999 tablet_service.cc:1511] Processing CreateTablet for tablet b0ace1a67c98413c886c1ce2cfcd66af (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:15:33.551750  5923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b75d901511f94357a67c07612cf07d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.567106  5849 tablet_service.cc:1511] Processing CreateTablet for tablet 626f502ef9684f1b8a6c29e9010f9ed5 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:15:33.569124  5849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 626f502ef9684f1b8a6c29e9010f9ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.573172  5841 tablet_service.cc:1511] Processing CreateTablet for tablet b0ace1a67c98413c886c1ce2cfcd66af (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:15:33.575285  5841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ace1a67c98413c886c1ce2cfcd66af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.569084  5999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ace1a67c98413c886c1ce2cfcd66af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.587867  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fdfcec3d9049a2a38158457d409feb" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:33.588764  5935 raft_consensus.cc:2468] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:33.590725  6064 tablet_service.cc:1511] Processing CreateTablet for tablet 626f502ef9684f1b8a6c29e9010f9ed5 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:15:33.592950  6064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 626f502ef9684f1b8a6c29e9010f9ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.591099  5974 leader_election.cc:304] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:33.579663  5990 tablet_service.cc:1511] Processing CreateTablet for tablet 33adcece08484ff79fd8711ef5dfd78c (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:15:33.614488  5842 tablet_service.cc:1511] Processing CreateTablet for tablet 6a300304455c4851b24de418128a28d0 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:15:33.616294  5842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a300304455c4851b24de418128a28d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.617740  6132 tablet_bootstrap.cc:492] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:33.618332  6132 ts_tablet_manager.cc:1403] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.586s	user 0.011s	sys 0.049s
I20260709 12:15:33.625890  5847 tablet_service.cc:1511] Processing CreateTablet for tablet 219ee6e67c3a4adf9dd72198036646bc (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:15:33.627437  5847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 219ee6e67c3a4adf9dd72198036646bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.636286  5922 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 19) took 1282 ms. Trace:
I20260709 12:15:33.636831  5922 rpcz_store.cc:276] 0709 12:15:32.353921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.855792 (+501871us) service_pool.cc:224] Handling call
0709 12:15:32.932972 (+ 77180us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:32.933071 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.473802 (+540731us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.635695 (+161893us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:33.636219 (+   524us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:33.643333  6129 tablet_bootstrap.cc:492] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:33.644097  6129 ts_tablet_manager.cc:1403] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.697s	user 0.015s	sys 0.047s
I20260709 12:15:33.647689  6129 raft_consensus.cc:359] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:33.649147  6067 tablet_service.cc:1511] Processing CreateTablet for tablet b0ace1a67c98413c886c1ce2cfcd66af (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:15:33.621977  6132 raft_consensus.cc:359] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:33.622828  5990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33adcece08484ff79fd8711ef5dfd78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.660072  6143 leader_election.cc:290] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
W20260709 12:15:33.618285  5743 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 67423.1us
I20260709 12:15:33.661693  6071 tablet_service.cc:1511] Processing CreateTablet for tablet 33adcece08484ff79fd8711ef5dfd78c (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:15:33.709439  6132 raft_consensus.cc:385] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.667759  6068 tablet_service.cc:1511] Processing CreateTablet for tablet 219ee6e67c3a4adf9dd72198036646bc (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:15:33.716434  6132 raft_consensus.cc:740] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:33.674950  5860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fdfcec3d9049a2a38158457d409feb" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:33.717196  5846 tablet_service.cc:1511] Processing CreateTablet for tablet 2e4c5dd41465429eab21af474b88bc05 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:15:33.717499  6132 consensus_queue.cc:260] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:33.718726  5846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e4c5dd41465429eab21af474b88bc05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.684630  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df660011133455e8ede132d5d56c48f" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:33.724040  6067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ace1a67c98413c886c1ce2cfcd66af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.686584  5998 tablet_service.cc:1511] Processing CreateTablet for tablet 6a300304455c4851b24de418128a28d0 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20260709 12:15:33.725769  6047 leader_election.cc:343] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.726089  5998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a300304455c4851b24de418128a28d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.682701  5922 tablet_service.cc:1511] Processing CreateTablet for tablet a16996642a1b4752b788da1836791f3c (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:15:33.728586  5922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a16996642a1b4752b788da1836791f3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.678290  6070 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43386 (request call id 25) took 1229 ms. Trace:
I20260709 12:15:33.701937  5924 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 18) took 1348 ms. Trace:
I20260709 12:15:33.712996  6156 raft_consensus.cc:2804] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:33.730561  6070 rpcz_store.cc:276] 0709 12:15:32.449311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.946645 (+497334us) service_pool.cc:224] Handling call
0709 12:15:33.031237 (+ 84592us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:33.031484 (+   247us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.465400 (+433916us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.677627 (+212227us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:33.678206 (+   579us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:33.723853  6065 tablet_service.cc:1511] Processing CreateTablet for tablet 2e4c5dd41465429eab21af474b88bc05 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:15:33.734810  6070 tablet_service.cc:1511] Processing CreateTablet for tablet 82ede3276c3746638e321c76e4794c86 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:15:33.735898  5994 tablet_service.cc:1511] Processing CreateTablet for tablet 2e4c5dd41465429eab21af474b88bc05 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:15:33.737327  5994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e4c5dd41465429eab21af474b88bc05. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:33.712718  5974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 121904us
I20260709 12:15:33.658066  5850 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37644 (request call id 27) took 1145 ms. Trace:
I20260709 12:15:33.742123  5850 rpcz_store.cc:276] 0709 12:15:32.512687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.852958 (+340271us) service_pool.cc:224] Handling call
0709 12:15:32.955626 (+102668us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:32.955743 (+   117us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.401397 (+445654us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.657491 (+256094us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:33.657988 (+   497us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:33.725026  6071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33adcece08484ff79fd8711ef5dfd78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.708478  6129 raft_consensus.cc:385] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.707856  6066 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43386 (request call id 26) took 1154 ms. Trace:
I20260709 12:15:33.724109  6132 ts_tablet_manager.cc:1434] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.105s	user 0.007s	sys 0.000s
W20260709 12:15:33.755731  5975 leader_election.cc:343] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.755996  5860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df660011133455e8ede132d5d56c48f" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:33.759115  6133 tablet_bootstrap.cc:654] T c9a66f01ced34c71b061ec163494f2b6 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:33.751157  6156 raft_consensus.cc:493] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:33.770735  6156 raft_consensus.cc:3060] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:33.779093  6049 leader_election.cc:343] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.779731  6049 leader_election.cc:304] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:33.780452  5850 tablet_service.cc:1511] Processing CreateTablet for tablet 713888d225a047099a38dc8257276146 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:15:33.781095  6137 raft_consensus.cc:2749] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:33.781983  5850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713888d225a047099a38dc8257276146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.785032  5919 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 20) took 1430 ms. Trace:
I20260709 12:15:33.785537  5919 rpcz_store.cc:276] 0709 12:15:32.354236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.929191 (+574955us) service_pool.cc:224] Handling call
0709 12:15:32.998793 (+ 69602us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:33.006198 (+  7405us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.667373 (+661175us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.784421 (+117048us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:33.784963 (+   542us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:33.787103  6132 tablet_bootstrap.cc:492] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:33.738472  5924 rpcz_store.cc:276] 0709 12:15:32.353590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.841039 (+487449us) service_pool.cc:224] Handling call
0709 12:15:32.932248 (+ 91209us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:32.932359 (+   111us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.461946 (+529587us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.701327 (+239381us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:33.701864 (+   537us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:33.794310  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:33.751590  6129 raft_consensus.cc:740] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:33.795763  6129 consensus_queue.cc:260] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
W20260709 12:15:33.796315  5824 leader_election.cc:343] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.796967  5824 leader_election.cc:304] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:33.797362  6070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ede3276c3746638e321c76e4794c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.806584  6136 raft_consensus.cc:2749] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:33.751813  6066 rpcz_store.cc:276] 0709 12:15:32.499670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.969858 (+470188us) service_pool.cc:224] Handling call
0709 12:15:33.051221 (+ 81363us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:33.051346 (+   125us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.336967 (+285621us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.653843 (+316876us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:33.654366 (+   523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:33.817371  6068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 219ee6e67c3a4adf9dd72198036646bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.818626  5924 tablet_service.cc:1511] Processing CreateTablet for tablet a12649b3d49a4a309d961106ba152892 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:15:33.799090  5848 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37644 (request call id 29) took 1099 ms. Trace:
I20260709 12:15:33.822984  6065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e4c5dd41465429eab21af474b88bc05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.840704  5993 tablet_service.cc:1511] Processing CreateTablet for tablet 82ede3276c3746638e321c76e4794c86 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:15:33.841722  5996 tablet_service.cc:1511] Processing CreateTablet for tablet 713888d225a047099a38dc8257276146 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:15:33.842532  5993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ede3276c3746638e321c76e4794c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.843266  5996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713888d225a047099a38dc8257276146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.819777  5848 rpcz_store.cc:276] 0709 12:15:32.700284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.885133 (+184849us) service_pool.cc:224] Handling call
0709 12:15:32.935288 (+ 50155us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:32.935409 (+   121us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.655172 (+719763us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.796623 (+141451us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:33.798989 (+  2366us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:33.848475  6066 tablet_service.cc:1511] Processing CreateTablet for tablet f5d9e90868894fa78e9f94ca432dc703 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:15:33.850569  5997 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40900 (request call id 22) took 1428 ms. Trace:
I20260709 12:15:33.851048  5997 rpcz_store.cc:276] 0709 12:15:32.422135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.721962 (+299827us) service_pool.cc:224] Handling call
0709 12:15:32.815483 (+ 93521us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:32.815609 (+   126us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.449794 (+634185us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.807756 (+357962us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:33.850498 (+ 42742us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:33.861047  5919 tablet_service.cc:1511] Processing CreateTablet for tablet d852dc979f7843dcbf8477fc409c2c68 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:15:33.862813  6066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d9e90868894fa78e9f94ca432dc703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.871275  6159 raft_consensus.cc:493] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.872021  6159 raft_consensus.cc:515] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:33.872910  5860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fdfcec3d9049a2a38158457d409feb" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
W20260709 12:15:33.874755  5901 leader_election.cc:343] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.876294  5860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a66f01ced34c71b061ec163494f2b6" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
W20260709 12:15:33.878018  5975 leader_election.cc:343] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.862993  5848 tablet_service.cc:1511] Processing CreateTablet for tablet f5d9e90868894fa78e9f94ca432dc703 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:15:33.883616  5848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d9e90868894fa78e9f94ca432dc703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.883711  5924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a12649b3d49a4a309d961106ba152892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.893708  5919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d852dc979f7843dcbf8477fc409c2c68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.904932  5925 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 17) took 1551 ms. Trace:
I20260709 12:15:33.905506  5925 rpcz_store.cc:276] 0709 12:15:32.353269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.822769 (+469500us) service_pool.cc:224] Handling call
0709 12:15:32.825083 (+  2314us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:32.825200 (+   117us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.663834 (+838634us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.873748 (+209914us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:33.904849 (+ 31101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:33.906132  6137 raft_consensus.cc:493] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.906948  6137 raft_consensus.cc:515] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:33.908067  5925 tablet_service.cc:1511] Processing CreateTablet for tablet a6e906733ca34216bf4664d81c7b19b2 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:15:33.894173  5920 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 22) took 1446 ms. Trace:
I20260709 12:15:33.909284  5920 rpcz_store.cc:276] 0709 12:15:32.448138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.965002 (+516864us) service_pool.cc:224] Handling call
0709 12:15:33.040496 (+ 75494us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:33.040601 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.776063 (+735462us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.868671 (+ 92608us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:33.894087 (+ 25416us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:33.911827  5920 tablet_service.cc:1511] Processing CreateTablet for tablet d792c0dd53aa459399c3adf5d4f17f58 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:15:33.923050  5922 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 27) took 1380 ms. Trace:
I20260709 12:15:33.923640  5922 rpcz_store.cc:276] 0709 12:15:32.542486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.637928 (+1095442us) service_pool.cc:224] Handling call
0709 12:15:33.727988 (+ 90060us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:33.728112 (+   124us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.787030 (+ 58918us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.878264 (+ 91234us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:33.922950 (+ 44686us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:33.928272  6137 leader_election.cc:290] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:33.929276  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972a71bd13ef4022b6966d1287868dc4" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:33.929564  5860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972a71bd13ef4022b6966d1287868dc4" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
W20260709 12:15:33.931329  6047 leader_election.cc:343] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:33.932163  6049 leader_election.cc:343] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.932711  6049 leader_election.cc:304] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:33.934707  6137 raft_consensus.cc:2749] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:33.935793  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fdfcec3d9049a2a38158457d409feb" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:33.937355  6133 tablet_bootstrap.cc:492] T c9a66f01ced34c71b061ec163494f2b6 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:33.937978  6133 ts_tablet_manager.cc:1403] T c9a66f01ced34c71b061ec163494f2b6 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.622s	user 0.017s	sys 0.016s
I20260709 12:15:33.938747  6159 leader_election.cc:290] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:33.940569  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a66f01ced34c71b061ec163494f2b6" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
W20260709 12:15:33.949712  5745 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 63092.5us
I20260709 12:15:33.958557  5921 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 21) took 1512 ms. Trace:
I20260709 12:15:33.958856  6132 tablet_bootstrap.cc:654] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:33.959088  5921 rpcz_store.cc:276] 0709 12:15:32.447770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.974742 (+526972us) service_pool.cc:224] Handling call
0709 12:15:33.067397 (+ 92655us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:33.067555 (+   158us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.848890 (+781335us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.934920 (+ 86030us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:33.958487 (+ 23567us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:33.961705  5921 tablet_service.cc:1511] Processing CreateTablet for tablet a88edbe785c84f7fb5720879c30d6477 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:15:33.963151  5921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a88edbe785c84f7fb5720879c30d6477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.964430  5991 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40900 (request call id 32) took 1028 ms. Trace:
I20260709 12:15:33.964901  5991 rpcz_store.cc:276] 0709 12:15:32.935799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.376477 (+440678us) service_pool.cc:224] Handling call
0709 12:15:33.535978 (+159501us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:33.536080 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.784506 (+248426us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.963881 (+179375us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:33.964360 (+   479us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:33.967978  5920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d792c0dd53aa459399c3adf5d4f17f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.969026  5923 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 23) took 1520 ms. Trace:
I20260709 12:15:33.943532  6133 raft_consensus.cc:359] T c9a66f01ced34c71b061ec163494f2b6 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:33.947063  6156 raft_consensus.cc:515] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:33.971668  5916 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 24) took 1522 ms. Trace:
I20260709 12:15:33.979099  5916 rpcz_store.cc:276] 0709 12:15:32.448950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.254197 (+805247us) service_pool.cc:224] Handling call
0709 12:15:33.303289 (+ 49092us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:33.303407 (+   118us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.789495 (+486088us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.957984 (+168489us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:33.971594 (+ 13610us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:33.980553  6129 ts_tablet_manager.cc:1434] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.336s	user 0.012s	sys 0.002s
I20260709 12:15:33.985419  6129 tablet_bootstrap.cc:492] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:33.994117  6009 raft_consensus.cc:2393] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26615d25670745d38490e2d6da247d9e in current term 1: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
I20260709 12:15:33.998418  5899 leader_election.cc:304] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:33.998649  6069 tablet_service.cc:1511] Processing CreateTablet for tablet 859eab84f0fb443ba4bd2cccf81cbe3e (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:15:34.000010  6143 raft_consensus.cc:3060] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.000223  6069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 859eab84f0fb443ba4bd2cccf81cbe3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:33.982267  5916 tablet_service.cc:1511] Processing CreateTablet for tablet 6500f59123914ed198a39756117b4110 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:15:34.005144  5925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6e906733ca34216bf4664d81c7b19b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:34.004887  5860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fdfcec3d9049a2a38158457d409feb" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
W20260709 12:15:34.006716  5975 leader_election.cc:343] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:34.010493  6128 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.011s	sys 0.010s
W20260709 12:15:34.010985  6128 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.011s	sys 0.010s
I20260709 12:15:33.972470  5923 rpcz_store.cc:276] 0709 12:15:32.448589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.058616 (+610027us) service_pool.cc:224] Handling call
0709 12:15:33.060647 (+  2031us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:33.060771 (+   124us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.840996 (+780225us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.968421 (+127425us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:33.968946 (+   525us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:34.013963  6128 tablet_bootstrap.cc:492] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:34.014627  6128 ts_tablet_manager.cc:1403] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 1.064s	user 0.032s	sys 0.010s
I20260709 12:15:34.015255  5923 tablet_service.cc:1511] Processing CreateTablet for tablet 5cb1760bd0ba436eb7077c60542c0a45 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:15:34.025786  6156 leader_election.cc:290] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:34.026649  6128 raft_consensus.cc:359] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:33.975171  6133 raft_consensus.cc:385] T c9a66f01ced34c71b061ec163494f2b6 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.029876  6128 raft_consensus.cc:385] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.031080  6133 raft_consensus.cc:740] T c9a66f01ced34c71b061ec163494f2b6 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.031318  5918 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 25) took 1582 ms. Trace:
I20260709 12:15:34.031677  6128 raft_consensus.cc:740] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.032271  6133 consensus_queue.cc:260] T c9a66f01ced34c71b061ec163494f2b6 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:34.033597  5935 raft_consensus.cc:2468] T c9a66f01ced34c71b061ec163494f2b6 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:33.926126  5922 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec4d35ac70348cb95a01355320f5686 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:15:34.036674  5922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec4d35ac70348cb95a01355320f5686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:34.030566  6143 raft_consensus.cc:2749] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.061385  5917 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 26) took 1519 ms. Trace:
I20260709 12:15:34.075088  5917 rpcz_store.cc:276] 0709 12:15:32.541927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.544452 (+1002525us) service_pool.cc:224] Handling call
0709 12:15:33.546512 (+  2060us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:33.546626 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.850756 (+304130us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:34.033742 (+182986us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:34.059866 (+ 26124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:34.077446  5917 tablet_service.cc:1511] Processing CreateTablet for tablet 2c61591bbcaf43839af1cc8373f98c7e (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:15:34.040426  5974 leader_election.cc:304] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:34.079834  6156 raft_consensus.cc:2804] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:34.080307  6156 raft_consensus.cc:493] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.080525  5916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6500f59123914ed198a39756117b4110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:34.080722  6156 raft_consensus.cc:3060] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.031927  5918 rpcz_store.cc:276] 0709 12:15:32.449297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.474323 (+1025026us) service_pool.cc:224] Handling call
0709 12:15:33.476543 (+  2220us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:33.476671 (+   128us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.705713 (+229042us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:33.957636 (+251923us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:34.031245 (+ 73609us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13163}
I20260709 12:15:34.083084  5923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cb1760bd0ba436eb7077c60542c0a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:34.082970  5918 tablet_service.cc:1511] Processing CreateTablet for tablet 626f502ef9684f1b8a6c29e9010f9ed5 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:15:34.084331  5918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 626f502ef9684f1b8a6c29e9010f9ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:34.085013  6072 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43386 (request call id 31) took 1187 ms. Trace:
I20260709 12:15:34.085565  6072 rpcz_store.cc:276] 0709 12:15:32.897666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.044490 (+146824us) service_pool.cc:224] Handling call
0709 12:15:33.046616 (+  2126us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:33.046727 (+   111us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:33.856530 (+809803us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:34.084333 (+227803us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:34.084940 (+   607us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:34.036872  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fdfcec3d9049a2a38158457d409feb" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:34.096266  6129 tablet_bootstrap.cc:654] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.111027  6132 tablet_bootstrap.cc:492] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:34.111672  6132 ts_tablet_manager.cc:1403] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.325s	user 0.022s	sys 0.021s
I20260709 12:15:34.062453  5919 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 29) took 1308 ms. Trace:
I20260709 12:15:34.121510  5919 rpcz_store.cc:276] 0709 12:15:32.752017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.859961 (+1107944us) service_pool.cc:224] Handling call
0709 12:15:33.867679 (+  7718us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:33.886594 (+ 18915us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:34.009617 (+123023us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:34.042117 (+ 32500us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:34.060670 (+ 18553us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:34.123746  5919 tablet_service.cc:1511] Processing CreateTablet for tablet 6a300304455c4851b24de418128a28d0 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:15:34.055024  5843 tablet_service.cc:1511] Processing CreateTablet for tablet 859eab84f0fb443ba4bd2cccf81cbe3e (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:15:34.120814  5925 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 30) took 1351 ms. Trace:
I20260709 12:15:34.046335  5998 tablet_service.cc:1511] Processing CreateTablet for tablet 859eab84f0fb443ba4bd2cccf81cbe3e (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:15:34.115875  5917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c61591bbcaf43839af1cc8373f98c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:34.126150  5843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 859eab84f0fb443ba4bd2cccf81cbe3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:34.130375  6128 consensus_queue.cc:260] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.136051  6128 ts_tablet_manager.cc:1434] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.118s	user 0.007s	sys 0.000s
I20260709 12:15:34.137233  6128 tablet_bootstrap.cc:492] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:34.138747  5998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 859eab84f0fb443ba4bd2cccf81cbe3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:34.129137  6156 raft_consensus.cc:515] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
W20260709 12:15:34.139583  5806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:34.141927  6156 leader_election.cc:290] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:34.142596  5860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a66f01ced34c71b061ec163494f2b6" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:34.127550  5921 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 33) took 1111 ms. Trace:
W20260709 12:15:34.144817  5975 leader_election.cc:343] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.145190  5921 rpcz_store.cc:276] 0709 12:15:33.016268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.960592 (+944324us) service_pool.cc:224] Handling call
0709 12:15:33.962635 (+  2043us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:33.962739 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:34.096838 (+134099us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:34.112886 (+ 16048us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:34.127106 (+ 14220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:34.147864  5921 tablet_service.cc:1511] Processing CreateTablet for tablet 33adcece08484ff79fd8711ef5dfd78c (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:15:34.163110  5924 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 28) took 1452 ms. Trace:
I20260709 12:15:34.166373  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a66f01ced34c71b061ec163494f2b6" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:34.167114  5935 raft_consensus.cc:3060] T c9a66f01ced34c71b061ec163494f2b6 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.171800  5934 raft_consensus.cc:2468] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:34.126155  6132 raft_consensus.cc:359] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:34.187594  5919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a300304455c4851b24de418128a28d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:34.163580  5924 rpcz_store.cc:276] 0709 12:15:32.710947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.817319 (+1106372us) service_pool.cc:224] Handling call
0709 12:15:33.819794 (+  2475us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:33.865181 (+ 45387us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:34.099131 (+233950us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:34.162555 (+ 63424us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:34.163037 (+   482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:34.191416  5921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33adcece08484ff79fd8711ef5dfd78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:34.191682  6133 ts_tablet_manager.cc:1434] T c9a66f01ced34c71b061ec163494f2b6 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.253s	user 0.016s	sys 0.039s
I20260709 12:15:34.192902  6133 tablet_bootstrap.cc:492] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:34.188545  6132 raft_consensus.cc:385] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.194722  6132 raft_consensus.cc:740] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.196182  6129 tablet_bootstrap.cc:492] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:34.195794  5924 tablet_service.cc:1511] Processing CreateTablet for tablet 219ee6e67c3a4adf9dd72198036646bc (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:15:34.196768  6129 ts_tablet_manager.cc:1403] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.212s	user 0.032s	sys 0.015s
I20260709 12:15:34.195688  6132 consensus_queue.cc:260] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:34.184752  5935 raft_consensus.cc:2468] T c9a66f01ced34c71b061ec163494f2b6 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:34.128135  5925 rpcz_store.cc:276] 0709 12:15:32.769632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.906760 (+1137128us) service_pool.cc:224] Handling call
0709 12:15:33.958004 (+ 51244us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5e9c 00007f5072fb5a5b 00007f507bece8d9 00007f507b028ee0 00007f507b10e831 00007f507b0ebac3 00007f507b09a400 00007f507451faf4 00007f507451fa82 00007f507451f9b1
0709 12:15:33.973489 (+ 15485us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:33.977744 (+  4255us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:34.068793 (+ 91049us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:34.120169 (+ 51376us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:34.120736 (+   567us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3213568}
I20260709 12:15:34.200922  5974 leader_election.cc:304] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:34.203401  6156 raft_consensus.cc:2804] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:34.203476  5925 tablet_service.cc:1511] Processing CreateTablet for tablet 82ede3276c3746638e321c76e4794c86 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:15:34.204428  6156 raft_consensus.cc:697] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:34.205477  6129 raft_consensus.cc:359] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.206506  6129 raft_consensus.cc:385] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.206951  6129 raft_consensus.cc:740] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.207536  6132 ts_tablet_manager.cc:1434] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.003s
I20260709 12:15:34.208092  6129 consensus_queue.cc:260] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.208905  6132 tablet_bootstrap.cc:492] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:34.205477  6156 consensus_queue.cc:237] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:34.211570  6129 ts_tablet_manager.cc:1434] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:15:34.212926  6129 tablet_bootstrap.cc:492] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:34.219628  5974 leader_election.cc:304] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:34.220913  6160 raft_consensus.cc:2804] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:34.221160  6129 tablet_bootstrap.cc:654] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.221670  6160 raft_consensus.cc:697] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:34.222831  6160 consensus_queue.cc:237] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:34.227308  5924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 219ee6e67c3a4adf9dd72198036646bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:34.233134  5920 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 31) took 1359 ms. Trace:
I20260709 12:15:34.233664  5920 rpcz_store.cc:276] 0709 12:15:32.873687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.910485 (+1036798us) service_pool.cc:224] Handling call
0709 12:15:33.967451 (+ 56966us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:33.967569 (+   118us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:34.032685 (+ 65116us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:34.221483 (+188798us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:34.231985 (+ 10502us) spinlock_profiling.cc:243] Waited 8.41 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb61a2 00007f507bef7889 00007f507b028d88 00007f507b0ef973 00007f507b0eb70f 00007f507b0ebecd 00007f507b09a400 00007f507451faf4 00007f507451fa82
0709 12:15:34.233064 (+  1079us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19341696}
I20260709 12:15:34.242591  6128 tablet_bootstrap.cc:654] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.251886  5925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ede3276c3746638e321c76e4794c86. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:34.279567  5974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 60124.1us
W20260709 12:15:34.287786  5744 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 44248.1us
I20260709 12:15:34.302802  6133 tablet_bootstrap.cc:654] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.308454  5923 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 35) took 1128 ms. Trace:
I20260709 12:15:34.309006  5923 rpcz_store.cc:276] 0709 12:15:33.179987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:34.014068 (+834081us) service_pool.cc:224] Handling call
0709 12:15:34.047078 (+ 33010us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b10e831 00007f507b0ebac3 00007f507b09a400 00007f507451faf4 00007f507451fa82 00007f507451f9b1
0709 12:15:34.062667 (+ 15589us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:34.065250 (+  2583us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:34.224212 (+158962us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:34.307838 (+ 83626us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:34.308379 (+   541us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33374080}
I20260709 12:15:34.310488  6129 tablet_bootstrap.cc:492] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:34.314883  6129 ts_tablet_manager.cc:1403] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.102s	user 0.032s	sys 0.030s
I20260709 12:15:34.318630  5758 catalog_manager.cc:5697] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:34.320255  6132 tablet_bootstrap.cc:654] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.327407  5923 tablet_service.cc:1511] Processing CreateTablet for tablet f5d9e90868894fa78e9f94ca432dc703 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:15:34.327623  5920 tablet_service.cc:1511] Processing CreateTablet for tablet 713888d225a047099a38dc8257276146 (DEFAULT_TABLE table=test-workload [id=6c06743a7dcc41a486535877151b71ad]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:15:34.318676  6129 raft_consensus.cc:359] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.329241  5922 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 32) took 1400 ms. Trace:
I20260709 12:15:34.333851  6128 tablet_bootstrap.cc:492] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:34.334302  5918 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 37) took 1029 ms. Trace:
I20260709 12:15:34.335897  5918 rpcz_store.cc:276] 0709 12:15:33.302064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:34.081892 (+779828us) service_pool.cc:224] Handling call
0709 12:15:34.083846 (+  1954us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:34.083956 (+   110us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:34.280575 (+196619us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:34.326685 (+ 46110us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:34.331650 (+  4965us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:34.336962  5923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d9e90868894fa78e9f94ca432dc703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:34.337234  5917 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 36) took 1048 ms. Trace:
I20260709 12:15:34.335426  6128 ts_tablet_manager.cc:1403] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.198s	user 0.010s	sys 0.006s
I20260709 12:15:34.337720  5917 rpcz_store.cc:276] 0709 12:15:33.298117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:34.076366 (+778249us) service_pool.cc:224] Handling call
0709 12:15:34.078542 (+  2176us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:34.078655 (+   113us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:34.291691 (+213036us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:34.333097 (+ 41406us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:34.336823 (+  3726us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb61a2 00007f507bef7889 00007f507b028d88 00007f507b0ef973 00007f507b0eb70f 00007f507b0ebecd 00007f507b09a400 00007f507451faf4 00007f507451fa82
0709 12:15:34.337163 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3673856}
I20260709 12:15:34.340543  5916 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 34) took 1256 ms. Trace:
I20260709 12:15:34.331805  5922 rpcz_store.cc:276] 0709 12:15:32.928961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.925004 (+996043us) service_pool.cc:224] Handling call
0709 12:15:34.036051 (+111047us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:34.036213 (+   162us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:34.306426 (+270213us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:34.319977 (+ 13551us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:34.329158 (+  9181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:34.346946  6133 tablet_bootstrap.cc:492] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:34.347599  6133 ts_tablet_manager.cc:1403] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.155s	user 0.010s	sys 0.009s
I20260709 12:15:34.341064  5916 rpcz_store.cc:276] 0709 12:15:33.084486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.980762 (+896276us) service_pool.cc:224] Handling call
0709 12:15:34.038725 (+ 57963us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b58001e7898. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5a22 00007f507bece8d9 00007f507b028ee0 00007f507b10e831 00007f507b0ebac3 00007f507b09a400 00007f507451faf4 00007f507451fa82 00007f507451f9b1
0709 12:15:34.038890 (+   165us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:34.039005 (+   115us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:34.188961 (+149956us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:34.339839 (+150878us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:34.340471 (+   632us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71624064}
I20260709 12:15:34.343585  6136 raft_consensus.cc:493] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.331456  6129 raft_consensus.cc:385] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.350698  6136 raft_consensus.cc:515] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.350735  6129 raft_consensus.cc:740] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.352249  6129 consensus_queue.cc:260] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.354411  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df660011133455e8ede132d5d56c48f" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:34.344480  6128 raft_consensus.cc:359] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:34.343598  5920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713888d225a047099a38dc8257276146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:34.359494  6128 raft_consensus.cc:385] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.365201  6129 ts_tablet_manager.cc:1434] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.002s
I20260709 12:15:34.357376  6136 leader_election.cc:290] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:34.364833  6133 raft_consensus.cc:359] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.367259  6133 raft_consensus.cc:385] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.363830  6128 raft_consensus.cc:740] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.372303  6133 raft_consensus.cc:740] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.373232  6133 consensus_queue.cc:260] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.373270  6128 consensus_queue.cc:260] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:34.377209  6128 ts_tablet_manager.cc:1434] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 12:15:34.363996  6156 raft_consensus.cc:493] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.379431  6156 raft_consensus.cc:515] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.383879  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e5dfe30b74c94b9753cf4c647695f" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:34.385080  6133 ts_tablet_manager.cc:1434] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
W20260709 12:15:34.385743  5974 leader_election.cc:343] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.382200  6156 leader_election.cc:290] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:34.388036  6133 tablet_bootstrap.cc:492] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:34.395999  6162 raft_consensus.cc:493] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.402189  6162 raft_consensus.cc:515] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
W20260709 12:15:34.403430  5824 leader_election.cc:343] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.391206  6128 tablet_bootstrap.cc:492] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:34.390882  6129 tablet_bootstrap.cc:492] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:34.392828  6132 tablet_bootstrap.cc:492] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:34.409276  6162 leader_election.cc:290] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:34.410195  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:34.411144  6009 raft_consensus.cc:2468] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 0.
I20260709 12:15:34.412015  6132 ts_tablet_manager.cc:1403] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.203s	user 0.022s	sys 0.013s
I20260709 12:15:34.412954  6133 tablet_bootstrap.cc:654] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.412982  5899 leader_election.cc:304] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:34.416761  6132 raft_consensus.cc:359] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:34.414605  6162 raft_consensus.cc:2804] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:34.418511  6162 raft_consensus.cc:493] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.419101  6162 raft_consensus.cc:3060] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.417603  6132 raft_consensus.cc:385] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.419914  6132 raft_consensus.cc:740] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.420814  6132 consensus_queue.cc:260] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:34.423228  6132 ts_tablet_manager.cc:1434] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:15:34.424818  6132 tablet_bootstrap.cc:492] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:34.441464  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df660011133455e8ede132d5d56c48f" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:34.442293  6083 raft_consensus.cc:2468] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:34.443116  6162 raft_consensus.cc:515] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.443794  5824 leader_election.cc:304] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:34.445189  6136 raft_consensus.cc:2804] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:34.445596  6136 raft_consensus.cc:493] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.445904  6162 leader_election.cc:290] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:34.445940  6136 raft_consensus.cc:3060] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.447964  6137 raft_consensus.cc:493] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.449044  6132 tablet_bootstrap.cc:654] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.449335  6137 raft_consensus.cc:515] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:34.459095  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:34.460155  6009 raft_consensus.cc:3060] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.466581  6137 leader_election.cc:290] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:34.457711  6136 raft_consensus.cc:515] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.477349  5860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687e45fe6f3444c794271e801c21280d" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
W20260709 12:15:34.482956  6049 leader_election.cc:343] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.489764  6133 tablet_bootstrap.cc:492] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:34.495023  6133 ts_tablet_manager.cc:1403] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.013s
I20260709 12:15:34.506896  6128 tablet_bootstrap.cc:654] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.508534  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df660011133455e8ede132d5d56c48f" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:34.509124  6136 leader_election.cc:290] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:34.510592  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df660011133455e8ede132d5d56c48f" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:34.511291  6083 raft_consensus.cc:3060] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.512368  6133 raft_consensus.cc:359] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:34.513490  6133 raft_consensus.cc:385] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.513909  6133 raft_consensus.cc:740] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.472386  5921 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50244 (request call id 38) took 1023 ms. Trace:
I20260709 12:15:34.514628  5921 rpcz_store.cc:276] 0709 12:15:33.448570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:34.146682 (+698112us) service_pool.cc:224] Handling call
0709 12:15:34.148947 (+  2265us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:34.149072 (+   125us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:34.357183 (+208111us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:34.430229 (+ 73046us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:34.471739 (+ 41510us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3988}
W20260709 12:15:34.517032  5824 leader_election.cc:343] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.519399  6133 consensus_queue.cc:260] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:34.537271  6083 raft_consensus.cc:2468] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:34.522686  6009 raft_consensus.cc:2468] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:34.539280  5824 leader_election.cc:304] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:34.540179  6136 raft_consensus.cc:2804] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:34.546614  6132 tablet_bootstrap.cc:492] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:34.547336  6132 ts_tablet_manager.cc:1403] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.123s	user 0.009s	sys 0.015s
I20260709 12:15:34.551832  6132 raft_consensus.cc:359] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:34.552820  6132 raft_consensus.cc:385] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.553177  6132 raft_consensus.cc:740] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.564203  6129 tablet_bootstrap.cc:654] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.566561  6162 raft_consensus.cc:493] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.567211  6162 raft_consensus.cc:515] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:34.570955  5860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0484fe261cb3459cb6a2f532f88c0845" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:34.555394  5899 leader_election.cc:304] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:34.574501  6162 leader_election.cc:290] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:34.576949  6143 raft_consensus.cc:2804] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:34.566751  6133 ts_tablet_manager.cc:1434] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.071s	user 0.010s	sys 0.000s
I20260709 12:15:34.578809  6143 raft_consensus.cc:697] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:34.579551  6133 tablet_bootstrap.cc:492] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:34.580086  6143 consensus_queue.cc:237] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
W20260709 12:15:34.577829  5901 leader_election.cc:343] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.583917  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:34.584159  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:34.584342  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0484fe261cb3459cb6a2f532f88c0845" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
W20260709 12:15:34.586654  5899 leader_election.cc:343] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:34.588181  5899 leader_election.cc:343] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:34.590071  5899 leader_election.cc:343] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.593459  5758 catalog_manager.cc:5697] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:34.597707  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e5dfe30b74c94b9753cf4c647695f" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:34.606518  5899 leader_election.cc:304] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:34.608074  6162 raft_consensus.cc:2749] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:34.608783  5973 leader_election.cc:343] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.609369  5973 leader_election.cc:304] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:34.610747  6156 raft_consensus.cc:2749] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.612810  6133 tablet_bootstrap.cc:654] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.614526  6183 raft_consensus.cc:493] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.616161  6132 consensus_queue.cc:260] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:34.622014  6183 raft_consensus.cc:515] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:34.618999  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687e45fe6f3444c794271e801c21280d" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:34.623598  6132 ts_tablet_manager.cc:1434] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.076s	user 0.010s	sys 0.000s
I20260709 12:15:34.629638  6132 tablet_bootstrap.cc:492] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
W20260709 12:15:34.630106  6048 leader_election.cc:343] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.630721  6048 leader_election.cc:304] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:34.623932  6129 tablet_bootstrap.cc:492] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:34.632129  6137 raft_consensus.cc:2749] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.617846  6128 tablet_bootstrap.cc:492] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:34.632184  6129 ts_tablet_manager.cc:1403] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.264s	user 0.015s	sys 0.003s
I20260709 12:15:34.633460  6128 ts_tablet_manager.cc:1403] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.244s	user 0.042s	sys 0.028s
I20260709 12:15:34.633600  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972a71bd13ef4022b6966d1287868dc4" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
W20260709 12:15:34.635557  5824 leader_election.cc:343] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.637203  6129 raft_consensus.cc:359] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:34.637984  6132 tablet_bootstrap.cc:654] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.638077  6129 raft_consensus.cc:385] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.638609  6129 raft_consensus.cc:740] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.638973  6128 raft_consensus.cc:359] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:34.639861  6128 raft_consensus.cc:385] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.640200  6128 raft_consensus.cc:740] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.641065  6128 consensus_queue.cc:260] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:34.642712  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972a71bd13ef4022b6966d1287868dc4" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:34.643471  6081 raft_consensus.cc:2468] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:34.644757  6128 ts_tablet_manager.cc:1434] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:15:34.645229  5824 leader_election.cc:304] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:34.646646  6129 consensus_queue.cc:260] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:34.648741  6184 raft_consensus.cc:2804] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:34.646513  6183 leader_election.cc:290] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:34.647367  5758 catalog_manager.cc:5697] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 1 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:34.641372  6136 raft_consensus.cc:697] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:34.659409  6136 consensus_queue.cc:237] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.660581  6133 tablet_bootstrap.cc:492] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:34.661217  6133 ts_tablet_manager.cc:1403] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.082s	user 0.019s	sys 0.006s
I20260709 12:15:34.654567  6128 tablet_bootstrap.cc:492] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:34.666441  6132 tablet_bootstrap.cc:492] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:34.670605  6132 ts_tablet_manager.cc:1403] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.001s
I20260709 12:15:34.675534  6132 raft_consensus.cc:359] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:34.676654  6132 raft_consensus.cc:385] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.677104  6132 raft_consensus.cc:740] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.677994  6156 consensus_queue.cc:1048] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:34.678203  6132 consensus_queue.cc:260] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:34.681689  6132 ts_tablet_manager.cc:1434] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:15:34.662757  6184 raft_consensus.cc:493] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.685091  6184 raft_consensus.cc:3060] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.686621  6129 ts_tablet_manager.cc:1434] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.003s
W20260709 12:15:34.687247  5975 consensus_peers.cc:597] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:34.690289  6129 tablet_bootstrap.cc:492] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:34.694002  5757 catalog_manager.cc:5697] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:34.700264  6132 tablet_bootstrap.cc:492] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:34.704604  6129 tablet_bootstrap.cc:654] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.695895  6133 raft_consensus.cc:359] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.714643  6133 raft_consensus.cc:385] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.715050  6133 raft_consensus.cc:740] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.709436  6184 raft_consensus.cc:515] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:34.711236  6128 tablet_bootstrap.cc:654] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.715994  6133 consensus_queue.cc:260] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.719285  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972a71bd13ef4022b6966d1287868dc4" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
W20260709 12:15:34.720834  5824 leader_election.cc:343] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.726054  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972a71bd13ef4022b6966d1287868dc4" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:34.726845  6081 raft_consensus.cc:3060] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.738062  6160 consensus_queue.cc:1048] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:34.729615  6184 leader_election.cc:290] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:34.749629  6184 raft_consensus.cc:493] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:34.750689  5975 consensus_peers.cc:597] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:34.750439  6184 raft_consensus.cc:515] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:34.755398  6081 raft_consensus.cc:2468] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:34.756353  6129 tablet_bootstrap.cc:492] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:34.756958  6129 ts_tablet_manager.cc:1403] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.003s
I20260709 12:15:34.756956  5824 leader_election.cc:304] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:34.758455  6188 raft_consensus.cc:2804] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:34.759048  6188 raft_consensus.cc:697] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:34.759980  6188 consensus_queue.cc:237] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:34.760608  6129 raft_consensus.cc:359] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.761423  6129 raft_consensus.cc:385] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.761757  6129 raft_consensus.cc:740] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.751435  6133 ts_tablet_manager.cc:1434] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.090s	user 0.008s	sys 0.004s
I20260709 12:15:34.763607  6133 tablet_bootstrap.cc:492] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:34.770999  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d81a90a1a04c558e7d4b2e844d22ce" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:34.772907  6132 tablet_bootstrap.cc:654] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:34.773062  5824 leader_election.cc:343] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.773541  6184 leader_election.cc:290] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:34.766067  6156 raft_consensus.cc:493] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.787110  6156 raft_consensus.cc:515] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:34.789143  6137 raft_consensus.cc:493] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.778174  6129 consensus_queue.cc:260] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.789723  6137 raft_consensus.cc:515] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:34.791762  6129 ts_tablet_manager.cc:1434] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.006s
I20260709 12:15:34.793699  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35395bd69ad41f0b37fd3edca49777c" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:34.793704  5860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35395bd69ad41f0b37fd3edca49777c" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:34.797046  6133 tablet_bootstrap.cc:654] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:34.797133  6048 leader_election.cc:343] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:34.799803  5974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 57144us
I20260709 12:15:34.799700  6128 tablet_bootstrap.cc:492] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:34.799612  5755 catalog_manager.cc:5697] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:34.801105  6128 ts_tablet_manager.cc:1403] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.155s	user 0.020s	sys 0.003s
W20260709 12:15:34.802073  6049 leader_election.cc:343] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.804152  6156 leader_election.cc:290] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:34.805009  6049 leader_election.cc:304] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:34.806777  5860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a474468455492f992eb8dfefad0ca2" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
W20260709 12:15:34.809525  5975 leader_election.cc:343] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.804726  6137 leader_election.cc:290] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:34.810712  6137 raft_consensus.cc:2749] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.815202  6137 raft_consensus.cc:493] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.815714  6137 raft_consensus.cc:515] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:34.817900  6137 leader_election.cc:290] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:34.818917  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d81a90a1a04c558e7d4b2e844d22ce" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:34.819257  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ee607f5bb24b4bab4cd993a2327277" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:34.820150  6129 tablet_bootstrap.cc:492] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
W20260709 12:15:34.820752  6048 leader_election.cc:343] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.821357  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a474468455492f992eb8dfefad0ca2" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
W20260709 12:15:34.823030  5824 leader_election.cc:343] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.823523  5824 leader_election.cc:304] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:34.824721  6188 raft_consensus.cc:2749] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:34.825970  5974 leader_election.cc:343] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.826573  5974 leader_election.cc:304] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:34.830345  6156 raft_consensus.cc:2749] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.830955  5860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ee607f5bb24b4bab4cd993a2327277" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:34.828087  6128 raft_consensus.cc:359] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
W20260709 12:15:34.835700  6049 leader_election.cc:343] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.836387  6049 leader_election.cc:304] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:34.838009  6200 raft_consensus.cc:2749] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.833119  6128 raft_consensus.cc:385] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.839340  6128 raft_consensus.cc:740] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.845094  6128 consensus_queue.cc:260] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:34.848877  6128 ts_tablet_manager.cc:1434] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.002s
I20260709 12:15:34.852078  6128 tablet_bootstrap.cc:492] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:34.860217  6128 tablet_bootstrap.cc:654] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.865180  6133 tablet_bootstrap.cc:492] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:34.865885  6133 ts_tablet_manager.cc:1403] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.103s	user 0.019s	sys 0.000s
I20260709 12:15:34.867811  6132 tablet_bootstrap.cc:492] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:34.868383  6132 ts_tablet_manager.cc:1403] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.169s	user 0.018s	sys 0.017s
I20260709 12:15:34.871743  6132 raft_consensus.cc:359] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.872622  6132 raft_consensus.cc:385] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.872936  6132 raft_consensus.cc:740] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.874004  6133 raft_consensus.cc:359] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:34.874935  6133 raft_consensus.cc:385] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.875346  6133 raft_consensus.cc:740] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.876250  6133 consensus_queue.cc:260] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:34.877121  6129 tablet_bootstrap.cc:654] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.880535  6132 consensus_queue.cc:260] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.883096  6133 ts_tablet_manager.cc:1434] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:15:34.886776  6132 ts_tablet_manager.cc:1434] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.002s
I20260709 12:15:34.888142  6132 tablet_bootstrap.cc:492] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:34.890633  6133 tablet_bootstrap.cc:492] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:34.893254  6128 tablet_bootstrap.cc:492] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:34.893918  6128 ts_tablet_manager.cc:1403] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.016s
I20260709 12:15:34.897554  6128 raft_consensus.cc:359] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:34.898425  6128 raft_consensus.cc:385] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.898752  6128 raft_consensus.cc:740] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.899782  6128 consensus_queue.cc:260] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:34.905575  6128 ts_tablet_manager.cc:1434] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:15:34.906867  6128 tablet_bootstrap.cc:492] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:34.912019  6132 tablet_bootstrap.cc:654] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.914244  6129 tablet_bootstrap.cc:492] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:34.915263  6129 ts_tablet_manager.cc:1403] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.095s	user 0.013s	sys 0.002s
I20260709 12:15:34.920102  6129 raft_consensus.cc:359] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.922953  6129 raft_consensus.cc:385] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.923430  6129 raft_consensus.cc:740] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.922536  6133 tablet_bootstrap.cc:654] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.924170  6132 tablet_bootstrap.cc:492] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:34.924669  6128 tablet_bootstrap.cc:654] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.924731  6132 ts_tablet_manager.cc:1403] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.008s
I20260709 12:15:34.927066  6129 consensus_queue.cc:260] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.928342  6132 raft_consensus.cc:359] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:34.929736  6160 raft_consensus.cc:493] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.930356  6160 raft_consensus.cc:515] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.931736  6129 ts_tablet_manager.cc:1434] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 12:15:34.933203  6129 tablet_bootstrap.cc:492] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:34.940848  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c20504b20bf4686afff8a8417bdc035" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:34.941634  6128 tablet_bootstrap.cc:492] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:34.942361  6128 ts_tablet_manager.cc:1403] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.012s
I20260709 12:15:34.946154  6129 tablet_bootstrap.cc:654] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.946236  6128 raft_consensus.cc:359] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
W20260709 12:15:34.947448  5974 leader_election.cc:343] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.929649  6132 raft_consensus.cc:385] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.949333  6132 raft_consensus.cc:740] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.950348  6132 consensus_queue.cc:260] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:34.953315  6132 ts_tablet_manager.cc:1434] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:15:34.953790  6128 raft_consensus.cc:385] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.954188  6128 raft_consensus.cc:740] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.955842  6132 tablet_bootstrap.cc:492] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:34.963343  6132 tablet_bootstrap.cc:654] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.966789  6128 consensus_queue.cc:260] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:34.971468  6128 ts_tablet_manager.cc:1434] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260709 12:15:34.972805  6128 tablet_bootstrap.cc:492] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:34.979350  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c20504b20bf4686afff8a8417bdc035" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:34.981216  6128 tablet_bootstrap.cc:654] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:34.982766  5973 leader_election.cc:343] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.983484  5973 leader_election.cc:304] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:34.985033  6196 raft_consensus.cc:2749] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.985420  6132 tablet_bootstrap.cc:492] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:34.981140  6143 raft_consensus.cc:493] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.985982  6132 ts_tablet_manager.cc:1403] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.001s
I20260709 12:15:34.986192  6143 raft_consensus.cc:515] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.988618  6143 leader_election.cc:290] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:34.989181  6188 raft_consensus.cc:493] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.989073  6132 raft_consensus.cc:359] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.989964  6132 raft_consensus.cc:385] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.990320  6132 raft_consensus.cc:740] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.990015  6188 raft_consensus.cc:515] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:34.991086  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e5dfe30b74c94b9753cf4c647695f" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:34.991214  6132 consensus_queue.cc:260] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:34.991935  6009 raft_consensus.cc:2468] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 0.
I20260709 12:15:34.993644  6132 ts_tablet_manager.cc:1434] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:15:34.994019  5899 leader_election.cc:304] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:34.994853  6132 tablet_bootstrap.cc:492] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:34.995563  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fdfcec3d9049a2a38158457d409feb" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:34.996668  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e5dfe30b74c94b9753cf4c647695f" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:34.998136  6188 leader_election.cc:290] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
W20260709 12:15:34.998329  5899 leader_election.cc:343] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.999023  6143 raft_consensus.cc:2804] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:34.995827  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fdfcec3d9049a2a38158457d409feb" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:34.999558  6143 raft_consensus.cc:493] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.000026  6143 raft_consensus.cc:3060] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.001705  5825 leader_election.cc:304] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:35.002215  6132 tablet_bootstrap.cc:654] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.002656  6160 leader_election.cc:290] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:35.004170  6188 raft_consensus.cc:2749] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:35.014801  6132 tablet_bootstrap.cc:492] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:35.015462  6132 ts_tablet_manager.cc:1403] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.013s
I20260709 12:15:35.018865  6132 raft_consensus.cc:359] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:35.019670  6132 raft_consensus.cc:385] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.019973  6132 raft_consensus.cc:740] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.020849  6132 consensus_queue.cc:260] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:35.023313  6132 ts_tablet_manager.cc:1434] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:15:35.024367  6132 tablet_bootstrap.cc:492] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:35.027176  6200 raft_consensus.cc:493] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.027738  6200 raft_consensus.cc:515] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:35.030122  6200 leader_election.cc:290] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:35.032058  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:35.033069  6009 raft_consensus.cc:2393] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb in current term 1: Already voted for candidate 26615d25670745d38490e2d6da247d9e in this term.
I20260709 12:15:35.034948  6132 tablet_bootstrap.cc:654] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.035646  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:35.036284  6133 tablet_bootstrap.cc:492] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:35.036918  6133 ts_tablet_manager.cc:1403] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.147s	user 0.032s	sys 0.005s
I20260709 12:15:35.038161  6048 leader_election.cc:304] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:35.039151  6200 raft_consensus.cc:3060] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.040838  6133 raft_consensus.cc:359] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:35.041709  6133 raft_consensus.cc:385] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.042028  6133 raft_consensus.cc:740] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.048183  6200 raft_consensus.cc:2749] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:35.054183  6143 raft_consensus.cc:515] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:35.056818  6143 leader_election.cc:290] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:35.058260  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e5dfe30b74c94b9753cf4c647695f" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:35.058250  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e5dfe30b74c94b9753cf4c647695f" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:35.059279  6009 raft_consensus.cc:3060] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.059396  6081 raft_consensus.cc:3060] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.060819  6129 tablet_bootstrap.cc:492] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:35.061393  6129 ts_tablet_manager.cc:1403] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.128s	user 0.007s	sys 0.017s
I20260709 12:15:35.064718  6129 raft_consensus.cc:359] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:35.065497  6129 raft_consensus.cc:385] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.065788  6129 raft_consensus.cc:740] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.067199  6133 consensus_queue.cc:260] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:35.069134  6009 raft_consensus.cc:2468] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:35.070199  6133 ts_tablet_manager.cc:1434] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:15:35.071177  5899 leader_election.cc:304] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:35.072204  6162 raft_consensus.cc:2804] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:35.073535  6081 raft_consensus.cc:2468] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:35.079321  6133 tablet_bootstrap.cc:492] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:35.074507  6128 tablet_bootstrap.cc:492] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:35.086367  5860 raft_consensus.cc:3060] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.086874  6128 ts_tablet_manager.cc:1403] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.114s	user 0.035s	sys 0.034s
I20260709 12:15:35.090553  6132 tablet_bootstrap.cc:492] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:35.090335  6128 raft_consensus.cc:359] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.091117  6132 ts_tablet_manager.cc:1403] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.067s	user 0.008s	sys 0.009s
I20260709 12:15:35.091176  6128 raft_consensus.cc:385] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.091598  6128 raft_consensus.cc:740] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.092558  6128 consensus_queue.cc:260] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.096853  6200 raft_consensus.cc:493] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.097496  6200 raft_consensus.cc:515] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.099210  6128 ts_tablet_manager.cc:1434] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:15:35.099449  6162 raft_consensus.cc:697] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:35.099329  6133 tablet_bootstrap.cc:654] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.100581  6128 tablet_bootstrap.cc:492] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:35.101197  6200 leader_election.cc:290] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:35.101506  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32e2e4b0423a493e8f0d323065688bd1" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:35.094274  6132 raft_consensus.cc:359] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.102051  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32e2e4b0423a493e8f0d323065688bd1" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:35.102528  6132 raft_consensus.cc:385] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.102835  6132 raft_consensus.cc:740] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
W20260709 12:15:35.103246  6048 leader_election.cc:343] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:35.104552  6049 leader_election.cc:343] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:35.105038  6049 leader_election.cc:304] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:35.106416  6200 raft_consensus.cc:2749] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:35.107247  6162 consensus_queue.cc:237] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:35.110651  6132 consensus_queue.cc:260] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.111207  6128 tablet_bootstrap.cc:654] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.078078  6129 consensus_queue.cc:260] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:35.116276  6132 ts_tablet_manager.cc:1434] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:15:35.117422  6132 tablet_bootstrap.cc:492] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:35.123991  6132 tablet_bootstrap.cc:654] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.123977  6128 tablet_bootstrap.cc:492] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:35.124796  6128 ts_tablet_manager.cc:1403] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.004s
I20260709 12:15:35.128517  6128 raft_consensus.cc:359] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.129643  6128 raft_consensus.cc:385] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.130010  6128 raft_consensus.cc:740] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.131273  6128 consensus_queue.cc:260] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.134689  6128 ts_tablet_manager.cc:1434] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:15:35.135864  6128 tablet_bootstrap.cc:492] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:35.142258  6160 raft_consensus.cc:493] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.142926  6160 raft_consensus.cc:515] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
W20260709 12:15:35.143731  5806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:35.147893  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df660011133455e8ede132d5d56c48f" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:35.149335  6160 leader_election.cc:290] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:35.154297  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df660011133455e8ede132d5d56c48f" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:35.158018  6128 tablet_bootstrap.cc:654] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.170369  6083 raft_consensus.cc:2393] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 1: Already voted for candidate 58ed30c66c784e06ad64609f8d1b4c43 in this term.
I20260709 12:15:35.166105  6200 raft_consensus.cc:493] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.171262  6200 raft_consensus.cc:515] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.178416  6200 leader_election.cc:290] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:35.180202  6143 consensus_queue.cc:1048] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:35.182763  6188 consensus_queue.cc:1048] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:35.184751  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18f65fb1b1f4544b9e6a96399e38089" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
W20260709 12:15:35.186545  6047 leader_election.cc:343] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:35.186749  5973 leader_election.cc:304] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:35.188794  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18f65fb1b1f4544b9e6a96399e38089" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:35.190426  6160 raft_consensus.cc:3060] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:35.197425  6049 leader_election.cc:343] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:35.198177  6049 leader_election.cc:304] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:35.199380  6200 raft_consensus.cc:2749] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:35.191429  6129 ts_tablet_manager.cc:1434] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.130s	user 0.009s	sys 0.001s
I20260709 12:15:35.191670  6143 consensus_queue.cc:1048] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:15:35.212559  6129 tablet_bootstrap.cc:492] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:35.217278  6188 consensus_queue.cc:1048] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:35.225040  6132 tablet_bootstrap.cc:492] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:35.225858  6132 ts_tablet_manager.cc:1403] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.109s	user 0.026s	sys 0.016s
I20260709 12:15:35.225881  6133 tablet_bootstrap.cc:492] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:35.226752  6133 ts_tablet_manager.cc:1403] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.148s	user 0.047s	sys 0.048s
I20260709 12:15:35.231588  6162 raft_consensus.cc:493] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.232820  6162 raft_consensus.cc:515] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.235246  6162 leader_election.cc:290] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:35.237766  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ee607f5bb24b4bab4cd993a2327277" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:35.238687  6080 raft_consensus.cc:2468] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 0.
I20260709 12:15:35.238981  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ee607f5bb24b4bab4cd993a2327277" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:35.238114  6133 raft_consensus.cc:359] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:35.239979  5859 raft_consensus.cc:2468] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 0.
I20260709 12:15:35.240018  6133 raft_consensus.cc:385] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.240507  5899 leader_election.cc:304] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:35.241165  6133 raft_consensus.cc:740] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.242219  6162 raft_consensus.cc:2804] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:35.242720  6162 raft_consensus.cc:493] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.243134  6162 raft_consensus.cc:3060] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.246881  6133 consensus_queue.cc:260] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:35.250946  6129 tablet_bootstrap.cc:654] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.251631  6133 ts_tablet_manager.cc:1434] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:15:35.245365  5757 catalog_manager.cc:5697] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 1 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.255276  6132 raft_consensus.cc:359] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.269392  6132 raft_consensus.cc:385] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.270087  6132 raft_consensus.cc:740] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.268985  6133 tablet_bootstrap.cc:492] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:35.271263  6132 consensus_queue.cc:260] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.263103  6160 raft_consensus.cc:2749] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:35.276167  6128 tablet_bootstrap.cc:492] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:35.276752  6128 ts_tablet_manager.cc:1403] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.141s	user 0.008s	sys 0.008s
I20260709 12:15:35.278827  6132 ts_tablet_manager.cc:1434] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.044s	user 0.010s	sys 0.002s
I20260709 12:15:35.283012  6132 tablet_bootstrap.cc:492] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:35.283919  6133 tablet_bootstrap.cc:654] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.284112  6143 raft_consensus.cc:493] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.284709  6143 raft_consensus.cc:515] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:35.285615  6196 raft_consensus.cc:493] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.286195  6196 raft_consensus.cc:515] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:35.288218  6143 leader_election.cc:290] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:35.297109  6213 raft_consensus.cc:493] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.298867  6188 consensus_queue.cc:1048] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:35.301012  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:35.301823  6007 raft_consensus.cc:2468] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 0.
I20260709 12:15:35.291895  6162 raft_consensus.cc:515] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.304109  5899 leader_election.cc:304] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:35.298929  6213 raft_consensus.cc:515] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:35.304826  6162 leader_election.cc:290] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:35.305490  6162 raft_consensus.cc:2804] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:35.305889  6162 raft_consensus.cc:493] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.306354  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ee607f5bb24b4bab4cd993a2327277" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:35.306860  6213 leader_election.cc:290] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:35.306267  6162 raft_consensus.cc:3060] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.307029  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ee607f5bb24b4bab4cd993a2327277" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:35.307910  5859 raft_consensus.cc:3060] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.307071  6083 raft_consensus.cc:3060] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.317229  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c20504b20bf4686afff8a8417bdc035" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:35.318313  6081 raft_consensus.cc:2468] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 0.
I20260709 12:15:35.317606  6162 raft_consensus.cc:515] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:35.323532  5858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:35.339568  6129 tablet_bootstrap.cc:492] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:35.349037  6129 ts_tablet_manager.cc:1403] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.137s	user 0.019s	sys 0.001s
I20260709 12:15:35.347663  6132 tablet_bootstrap.cc:654] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.340045  6128 raft_consensus.cc:359] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.352725  6128 raft_consensus.cc:385] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.353132  6128 raft_consensus.cc:740] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.324497  5858 raft_consensus.cc:3060] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.354120  6128 consensus_queue.cc:260] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.341341  6196 leader_election.cc:290] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:35.343555  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:35.342173  5860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:35.364733  5934 raft_consensus.cc:2393] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 1: Already voted for candidate 26615d25670745d38490e2d6da247d9e in this term.
I20260709 12:15:35.343114  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:35.350950  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c20504b20bf4686afff8a8417bdc035" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:35.355237  6162 leader_election.cc:290] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:35.373428  6129 raft_consensus.cc:359] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.380303  5975 leader_election.cc:304] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:35.381470  6196 raft_consensus.cc:3060] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.350662  5899 leader_election.cc:304] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
W20260709 12:15:35.382968  5899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 47438.2us
I20260709 12:15:35.384920  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:35.386176  6008 raft_consensus.cc:2468] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 0.
I20260709 12:15:35.390635  6133 tablet_bootstrap.cc:492] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:35.391305  6133 ts_tablet_manager.cc:1403] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.123s	user 0.016s	sys 0.019s
I20260709 12:15:35.374341  6129 raft_consensus.cc:385] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.400279  6133 raft_consensus.cc:359] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.401386  6133 raft_consensus.cc:385] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.401778  6133 raft_consensus.cc:740] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.400271  6129 raft_consensus.cc:740] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.415026  6129 consensus_queue.cc:260] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.399312  6213 raft_consensus.cc:2804] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:35.420526  6213 raft_consensus.cc:493] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.421041  6213 raft_consensus.cc:3060] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.415099  6184 raft_consensus.cc:493] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.423044  6184 raft_consensus.cc:515] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.425295  6188 raft_consensus.cc:493] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.425817  6184 leader_election.cc:290] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:35.425889  6188 raft_consensus.cc:515] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.402987  6133 consensus_queue.cc:260] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.437316  6129 ts_tablet_manager.cc:1434] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.088s	user 0.009s	sys 0.000s
I20260709 12:15:35.442169  5858 raft_consensus.cc:2468] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:35.430015  6184 raft_consensus.cc:493] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.450335  5859 raft_consensus.cc:2468] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:35.450850  6184 raft_consensus.cc:515] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.456838  6188 leader_election.cc:290] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:35.457518  6196 raft_consensus.cc:2749] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:35.461525  6162 raft_consensus.cc:493] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.462136  6162 raft_consensus.cc:515] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.462221  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873d3215e6ba4214a3910fa16e0fd62a" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:35.463287  6008 raft_consensus.cc:2468] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:35.465288  6162 leader_election.cc:290] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:35.468325  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873d3215e6ba4214a3910fa16e0fd62a" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:35.469406  6079 raft_consensus.cc:2468] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:35.471313  6129 tablet_bootstrap.cc:492] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:35.479820  5901 leader_election.cc:304] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:35.483229  6083 raft_consensus.cc:2468] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:35.477660  6009 raft_consensus.cc:2468] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:35.484174  6184 leader_election.cc:290] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:35.495648  6133 ts_tablet_manager.cc:1434] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.104s	user 0.010s	sys 0.000s
W20260709 12:15:35.435755  5899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 44439.3us
I20260709 12:15:35.498433  5824 leader_election.cc:304] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:35.489465  6213 raft_consensus.cc:515] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:35.500873  6237 raft_consensus.cc:2804] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:35.501307  6128 ts_tablet_manager.cc:1434] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.224s	user 0.018s	sys 0.009s
I20260709 12:15:35.505506  6128 tablet_bootstrap.cc:492] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:35.507776  6132 tablet_bootstrap.cc:492] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:35.508244  6132 ts_tablet_manager.cc:1403] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.226s	user 0.011s	sys 0.009s
I20260709 12:15:35.502660  6143 raft_consensus.cc:2804] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:35.511523  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35395bd69ad41f0b37fd3edca49777c" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:35.512589  5859 raft_consensus.cc:2468] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 0.
I20260709 12:15:35.513643  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35395bd69ad41f0b37fd3edca49777c" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:35.514441  6080 raft_consensus.cc:2468] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:35.514955  5901 leader_election.cc:304] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:35.503266  6237 raft_consensus.cc:493] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.515764  6200 raft_consensus.cc:493] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.515707  6132 raft_consensus.cc:359] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.524104  6132 raft_consensus.cc:385] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.523998  6200 raft_consensus.cc:515] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.524500  6132 raft_consensus.cc:740] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.524574  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0484fe261cb3459cb6a2f532f88c0845" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:35.525274  6132 consensus_queue.cc:260] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.525643  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35395bd69ad41f0b37fd3edca49777c" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:35.525916  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c20504b20bf4686afff8a8417bdc035" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:35.526701  6006 raft_consensus.cc:3060] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.527799  5933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0484fe261cb3459cb6a2f532f88c0845" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:35.520185  6133 tablet_bootstrap.cc:492] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:35.535619  6129 tablet_bootstrap.cc:654] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.521749  6162 raft_consensus.cc:2804] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:35.539434  6162 raft_consensus.cc:697] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:35.540452  6162 consensus_queue.cc:237] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.526328  6200 leader_election.cc:290] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:35.516001  6237 raft_consensus.cc:3060] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.541559  6132 ts_tablet_manager.cc:1434] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.001s
I20260709 12:15:35.526355  5935 raft_consensus.cc:2468] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:35.543154  6132 tablet_bootstrap.cc:492] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:35.530217  5901 leader_election.cc:304] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:35.525286  5934 raft_consensus.cc:2468] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:35.544413  6236 raft_consensus.cc:2804] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:35.517722  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35395bd69ad41f0b37fd3edca49777c" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:35.545040  6236 raft_consensus.cc:493] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.545717  6236 raft_consensus.cc:3060] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.545733  6080 raft_consensus.cc:2468] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 0.
I20260709 12:15:35.510944  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0484fe261cb3459cb6a2f532f88c0845" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:35.518362  6213 leader_election.cc:290] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:35.558323  6128 tablet_bootstrap.cc:654] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.558969  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c20504b20bf4686afff8a8417bdc035" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:35.522435  6143 raft_consensus.cc:697] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:35.529424  5824 leader_election.cc:304] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:35.556924  6083 raft_consensus.cc:2468] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:35.562774  6080 raft_consensus.cc:3060] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.575292  6184 raft_consensus.cc:2804] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:35.575419  5825 leader_election.cc:304] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:35.575798  6184 raft_consensus.cc:493] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.576157  6184 raft_consensus.cc:3060] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.578816  6227 raft_consensus.cc:2804] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:35.579452  6227 raft_consensus.cc:493] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.579908  6227 raft_consensus.cc:3060] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.589907  6080 raft_consensus.cc:2468] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:35.592120  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0484fe261cb3459cb6a2f532f88c0845" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:35.593106  6238 raft_consensus.cc:493] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.589489  6237 raft_consensus.cc:515] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
W20260709 12:15:35.594519  5824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 65214us
I20260709 12:15:35.596704  6143 consensus_queue.cc:237] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:35.600828  6184 raft_consensus.cc:515] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.601886  6129 tablet_bootstrap.cc:492] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:35.602492  6129 ts_tablet_manager.cc:1403] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.164s	user 0.031s	sys 0.021s
I20260709 12:15:35.603399  6184 leader_election.cc:290] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
W20260709 12:15:35.604897  5824 consensus_peers.cc:597] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 -> Peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Couldn't send request to peer e29106aa83aa4eebb9b87d6745825a27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:35.605185  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35395bd69ad41f0b37fd3edca49777c" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:35.605929  6129 raft_consensus.cc:359] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.605968  6080 raft_consensus.cc:3060] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.606704  6129 raft_consensus.cc:385] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.607409  6129 raft_consensus.cc:740] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.608325  6129 consensus_queue.cc:260] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.609193  5899 leader_election.cc:304] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:35.610103  6213 raft_consensus.cc:2804] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:35.610622  6213 raft_consensus.cc:697] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:35.611043  6129 ts_tablet_manager.cc:1434] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:35.611486  6213 consensus_queue.cc:237] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:35.612159  6129 tablet_bootstrap.cc:492] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:35.612614  6238 raft_consensus.cc:515] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.615609  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35395bd69ad41f0b37fd3edca49777c" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:35.617919  6006 raft_consensus.cc:2468] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:35.621539  6129 tablet_bootstrap.cc:654] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.636970  6080 raft_consensus.cc:2468] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:35.639719  5824 leader_election.cc:304] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:35.640635  6184 raft_consensus.cc:2804] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:35.641258  6184 raft_consensus.cc:697] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:35.641396  6132 tablet_bootstrap.cc:654] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.640228  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687e45fe6f3444c794271e801c21280d" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:35.633415  6236 raft_consensus.cc:515] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.652550  6133 tablet_bootstrap.cc:654] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.642293  6184 consensus_queue.cc:237] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.656812  6080 raft_consensus.cc:2468] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:35.660233  5824 leader_election.cc:304] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:35.662321  6188 raft_consensus.cc:2804] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:35.662422  5934 raft_consensus.cc:2393] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ed30c66c784e06ad64609f8d1b4c43 in current term 1: Already voted for candidate 26615d25670745d38490e2d6da247d9e in this term.
I20260709 12:15:35.662151  6227 raft_consensus.cc:515] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.662858  6188 raft_consensus.cc:493] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.663811  6188 raft_consensus.cc:3060] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.666793  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873d3215e6ba4214a3910fa16e0fd62a" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:35.667601  6009 raft_consensus.cc:3060] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.668043  6237 leader_election.cc:290] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:35.670961  5859 raft_consensus.cc:2393] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb in current term 1: Already voted for candidate 58ed30c66c784e06ad64609f8d1b4c43 in this term.
I20260709 12:15:35.669910  6238 leader_election.cc:290] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:35.672811  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687e45fe6f3444c794271e801c21280d" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
W20260709 12:15:35.674767  5825 leader_election.cc:343] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:35.678709  6009 raft_consensus.cc:2468] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:35.679318  6128 tablet_bootstrap.cc:492] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:35.679911  6128 ts_tablet_manager.cc:1403] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.176s	user 0.005s	sys 0.016s
I20260709 12:15:35.680188  5824 leader_election.cc:304] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:35.681624  6238 raft_consensus.cc:2804] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:35.682418  6238 raft_consensus.cc:697] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:35.675087  6049 leader_election.cc:304] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:35.684477  6200 raft_consensus.cc:3060] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.687218  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0484fe261cb3459cb6a2f532f88c0845" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:35.690938  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35395bd69ad41f0b37fd3edca49777c" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:35.692149  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35395bd69ad41f0b37fd3edca49777c" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:35.693040  6082 raft_consensus.cc:2393] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 26615d25670745d38490e2d6da247d9e in current term 1: Already voted for candidate 58ed30c66c784e06ad64609f8d1b4c43 in this term.
I20260709 12:15:35.694686  5899 leader_election.cc:304] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:35.694763  5758 catalog_manager.cc:5697] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 1 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.699308  6213 raft_consensus.cc:2749] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:35.693533  6227 leader_election.cc:290] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:35.699965  5758 catalog_manager.cc:5697] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 1 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.701327  6238 consensus_queue.cc:237] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.701393  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0484fe261cb3459cb6a2f532f88c0845" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:35.704180  5935 raft_consensus.cc:3060] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.708091  6213 consensus_queue.cc:1048] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:35.712358  5758 catalog_manager.cc:5697] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 1 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:35.712160  6128 raft_consensus.cc:359] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:35.718152  6132 tablet_bootstrap.cc:492] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:35.719000  6128 raft_consensus.cc:385] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.719247  6132 ts_tablet_manager.cc:1403] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.176s	user 0.020s	sys 0.005s
I20260709 12:15:35.719594  6128 raft_consensus.cc:740] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.716406  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873d3215e6ba4214a3910fa16e0fd62a" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:35.702994  6236 leader_election.cc:290] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:35.723016  6080 raft_consensus.cc:3060] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.714284  6213 consensus_queue.cc:1048] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:15:35.737008  6128 consensus_queue.cc:260] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:35.717983  6200 raft_consensus.cc:2749] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:35.737293  6137 raft_consensus.cc:493] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.750643  6132 raft_consensus.cc:359] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.751820  6132 raft_consensus.cc:385] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.752236  6132 raft_consensus.cc:740] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.754283  6132 consensus_queue.cc:260] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.749122  6137 raft_consensus.cc:515] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.763507  6137 leader_election.cc:290] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:35.765576  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:35.766007  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
W20260709 12:15:35.767834  6049 leader_election.cc:343] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:35.768584  6047 leader_election.cc:343] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:35.769086  6047 leader_election.cc:304] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:35.745599  6188 raft_consensus.cc:515] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.773809  6188 leader_election.cc:290] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:35.771231  6128 ts_tablet_manager.cc:1434] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.003s
I20260709 12:15:35.775267  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687e45fe6f3444c794271e801c21280d" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:35.775564  6128 tablet_bootstrap.cc:492] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:35.780789  6129 tablet_bootstrap.cc:492] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:35.781584  6129 ts_tablet_manager.cc:1403] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.170s	user 0.015s	sys 0.035s
I20260709 12:15:35.782419  6137 raft_consensus.cc:2749] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:35.783842  6083 raft_consensus.cc:2468] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:35.784937  6129 raft_consensus.cc:359] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:35.780800  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687e45fe6f3444c794271e801c21280d" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
W20260709 12:15:35.786422  5825 leader_election.cc:343] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:35.786628  6079 raft_consensus.cc:3060] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.785719  6129 raft_consensus.cc:385] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.787411  6129 raft_consensus.cc:740] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.788095  5859 raft_consensus.cc:3060] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.788277  6129 consensus_queue.cc:260] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:35.790978  6129 ts_tablet_manager.cc:1434] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:15:35.785894  5824 leader_election.cc:304] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:35.793960  6184 raft_consensus.cc:2804] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:35.799152  6132 ts_tablet_manager.cc:1434] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.079s	user 0.010s	sys 0.000s
I20260709 12:15:35.803756  6132 tablet_bootstrap.cc:492] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:35.803858  6184 raft_consensus.cc:697] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:35.804926  6184 consensus_queue.cc:237] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.792042  6129 tablet_bootstrap.cc:492] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:35.797240  5757 catalog_manager.cc:5697] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:35.813428  6129 tablet_bootstrap.cc:654] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.815428  6133 tablet_bootstrap.cc:492] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:35.816169  6133 ts_tablet_manager.cc:1403] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.296s	user 0.017s	sys 0.004s
I20260709 12:15:35.821782  5935 raft_consensus.cc:2468] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:35.825114  6132 tablet_bootstrap.cc:654] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.810000  6079 raft_consensus.cc:2468] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:35.834949  5824 leader_election.cc:304] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:35.835908  6133 raft_consensus.cc:359] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:35.837548  6128 tablet_bootstrap.cc:654] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.837257  6133 raft_consensus.cc:385] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.838310  6133 raft_consensus.cc:740] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.839368  6188 raft_consensus.cc:2804] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:35.840058  6188 raft_consensus.cc:697] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:35.840035  6133 consensus_queue.cc:260] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:35.842176  6188 consensus_queue.cc:237] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.833060  6080 raft_consensus.cc:2468] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:35.843616  6133 ts_tablet_manager.cc:1434] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.003s
I20260709 12:15:35.856012  6133 tablet_bootstrap.cc:492] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:35.864952  6128 tablet_bootstrap.cc:492] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:35.866115  6128 ts_tablet_manager.cc:1403] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.004s
I20260709 12:15:35.870229  6129 tablet_bootstrap.cc:492] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:35.870862  6129 ts_tablet_manager.cc:1403] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.079s	user 0.033s	sys 0.010s
I20260709 12:15:35.872539  6128 raft_consensus.cc:359] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:35.873402  6128 raft_consensus.cc:385] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.873656  6129 raft_consensus.cc:359] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.873751  6128 raft_consensus.cc:740] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.876055  6128 consensus_queue.cc:260] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:35.882083  6133 tablet_bootstrap.cc:654] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.893296  6128 ts_tablet_manager.cc:1434] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:15:35.883226  6129 raft_consensus.cc:385] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.897262  6129 raft_consensus.cc:740] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.897502  5754 catalog_manager.cc:5697] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:35.898178  6129 consensus_queue.cc:260] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:35.900583  6129 ts_tablet_manager.cc:1434] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:15:35.899868  5754 catalog_manager.cc:5697] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.901901  6128 tablet_bootstrap.cc:492] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:35.883211  6132 tablet_bootstrap.cc:492] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:35.902755  6132 ts_tablet_manager.cc:1403] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.099s	user 0.021s	sys 0.006s
I20260709 12:15:35.906056  6132 raft_consensus.cc:359] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.906883  6132 raft_consensus.cc:385] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.907152  6132 raft_consensus.cc:740] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.907254  6129 tablet_bootstrap.cc:492] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:35.908077  6132 consensus_queue.cc:260] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.912266  6133 tablet_bootstrap.cc:492] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:35.912889  6133 ts_tablet_manager.cc:1403] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.000s
I20260709 12:15:35.916246  6129 tablet_bootstrap.cc:654] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.916077  6133 raft_consensus.cc:359] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.916836  6133 raft_consensus.cc:385] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.917157  6133 raft_consensus.cc:740] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.902022  5754 catalog_manager.cc:5697] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.921357  6132 ts_tablet_manager.cc:1434] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:15:35.922925  6132 tablet_bootstrap.cc:492] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:35.917949  6133 consensus_queue.cc:260] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.935876  6133 ts_tablet_manager.cc:1434] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:15:35.937731  6128 tablet_bootstrap.cc:654] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.934185  6006 raft_consensus.cc:3060] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.941609  6133 tablet_bootstrap.cc:492] T 45528a8d878d46d89244614343fc6e90 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:35.956326  6132 tablet_bootstrap.cc:654] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.961560  6133 tablet_bootstrap.cc:654] T 45528a8d878d46d89244614343fc6e90 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.974900  6188 raft_consensus.cc:493] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.975664  6188 raft_consensus.cc:515] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:35.977705  6129 tablet_bootstrap.cc:492] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:35.977860  6133 tablet_bootstrap.cc:492] T 45528a8d878d46d89244614343fc6e90 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:35.978314  6133 ts_tablet_manager.cc:1403] T 45528a8d878d46d89244614343fc6e90 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.008s
I20260709 12:15:35.979090  6128 tablet_bootstrap.cc:492] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:35.979398  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a474468455492f992eb8dfefad0ca2" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:35.978335  6129 ts_tablet_manager.cc:1403] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.071s	user 0.025s	sys 0.016s
I20260709 12:15:35.979908  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a474468455492f992eb8dfefad0ca2" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:35.980844  6188 leader_election.cc:290] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:35.980998  5935 raft_consensus.cc:2468] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:35.980197  6009 raft_consensus.cc:2468] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:35.981642  6133 raft_consensus.cc:359] T 45528a8d878d46d89244614343fc6e90 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.982511  6133 raft_consensus.cc:385] T 45528a8d878d46d89244614343fc6e90 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.982821  6133 raft_consensus.cc:740] T 45528a8d878d46d89244614343fc6e90 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.982833  5825 leader_election.cc:304] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:35.983716  6129 raft_consensus.cc:359] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:35.983626  6133 consensus_queue.cc:260] T 45528a8d878d46d89244614343fc6e90 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:35.984468  6129 raft_consensus.cc:385] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.984782  6129 raft_consensus.cc:740] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.985581  6188 raft_consensus.cc:2804] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:35.985549  6129 consensus_queue.cc:260] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:35.986119  6188 raft_consensus.cc:493] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.986807  6188 raft_consensus.cc:3060] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.987975  6129 ts_tablet_manager.cc:1434] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:15:35.979693  6128 ts_tablet_manager.cc:1403] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.002s
I20260709 12:15:35.990598  6132 tablet_bootstrap.cc:492] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:35.991154  6132 ts_tablet_manager.cc:1403] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.000s
I20260709 12:15:35.986099  6133 ts_tablet_manager.cc:1434] T 45528a8d878d46d89244614343fc6e90 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:15:35.993131  6128 raft_consensus.cc:359] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:35.993948  6128 raft_consensus.cc:385] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.994582  6129 tablet_bootstrap.cc:492] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:35.994168  6132 raft_consensus.cc:359] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:35.995042  6132 raft_consensus.cc:385] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.995373  6132 raft_consensus.cc:740] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.993623  6133 tablet_bootstrap.cc:492] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:35.996229  6132 consensus_queue.cc:260] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:36.000870  6129 tablet_bootstrap.cc:654] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.994246  6128 raft_consensus.cc:740] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.004556  6128 consensus_queue.cc:260] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:36.006445  6188 raft_consensus.cc:515] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:36.006929  6128 ts_tablet_manager.cc:1434] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 12:15:36.008504  6128 tablet_bootstrap.cc:492] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:36.003809  6133 tablet_bootstrap.cc:654] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.012490  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a474468455492f992eb8dfefad0ca2" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:36.013250  5935 raft_consensus.cc:3060] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.016508  6128 tablet_bootstrap.cc:654] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.031996  6188 leader_election.cc:290] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:36.032195  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a474468455492f992eb8dfefad0ca2" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:36.032833  6132 ts_tablet_manager.cc:1434] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:15:36.033156  6006 raft_consensus.cc:3060] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.035087  6132 tablet_bootstrap.cc:492] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:36.042779  6006 raft_consensus.cc:2468] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:36.044164  5824 leader_election.cc:304] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:36.045141  6238 raft_consensus.cc:2804] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:36.045130  6160 raft_consensus.cc:493] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.045828  6238 raft_consensus.cc:697] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:36.045706  6184 consensus_queue.cc:1048] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:15:36.055991  6255 raft_consensus.cc:493] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.056639  6255 raft_consensus.cc:515] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:36.046553  6160 raft_consensus.cc:515] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:36.060494  6160 leader_election.cc:290] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:36.062383  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba593a994ff44d7866a70004fd0a946" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:36.063130  5859 raft_consensus.cc:2468] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:36.070816  5933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45528a8d878d46d89244614343fc6e90" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:36.071609  5933 raft_consensus.cc:2468] T 45528a8d878d46d89244614343fc6e90 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 0.
I20260709 12:15:36.072793  6255 leader_election.cc:290] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:36.068392  5935 raft_consensus.cc:2468] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:36.074076  6048 leader_election.cc:304] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:36.067909  5975 leader_election.cc:304] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:36.075397  6255 raft_consensus.cc:2804] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:36.066139  6238 consensus_queue.cc:237] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:36.075779  6255 raft_consensus.cc:493] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.076138  6255 raft_consensus.cc:3060] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.077116  6160 raft_consensus.cc:2804] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:36.077526  6160 raft_consensus.cc:493] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.077880  6160 raft_consensus.cc:3060] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.082063  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45528a8d878d46d89244614343fc6e90" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
W20260709 12:15:36.087059  6049 leader_election.cc:343] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.101742  6200 raft_consensus.cc:493] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.103307  6200 raft_consensus.cc:515] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:36.106549  6132 tablet_bootstrap.cc:654] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.109395  6237 consensus_queue.cc:1048] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:36.113065  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48d13e87f1d4964bb74ba350c2e2df5" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:36.121348  6128 tablet_bootstrap.cc:492] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:36.121923  6128 ts_tablet_manager.cc:1403] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.114s	user 0.008s	sys 0.020s
I20260709 12:15:36.123431  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48d13e87f1d4964bb74ba350c2e2df5" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
W20260709 12:15:36.124127  6049 leader_election.cc:343] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.126053  6133 tablet_bootstrap.cc:492] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:36.126834  6133 ts_tablet_manager.cc:1403] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.133s	user 0.041s	sys 0.034s
I20260709 12:15:36.130681  6255 raft_consensus.cc:515] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:36.133385  6255 leader_election.cc:290] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:36.117722  6200 leader_election.cc:290] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
W20260709 12:15:36.125200  6048 leader_election.cc:343] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.136864  6128 raft_consensus.cc:359] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:36.137535  6128 raft_consensus.cc:385] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.137768  6128 raft_consensus.cc:740] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.141368  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba593a994ff44d7866a70004fd0a946" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:36.142123  6132 tablet_bootstrap.cc:492] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:36.136636  6048 leader_election.cc:304] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:36.142994  6132 ts_tablet_manager.cc:1403] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.005s
I20260709 12:15:36.145551  5858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45528a8d878d46d89244614343fc6e90" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:36.147148  6132 raft_consensus.cc:359] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
W20260709 12:15:36.147958  5974 leader_election.cc:343] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.148123  6132 raft_consensus.cc:385] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.148597  6132 raft_consensus.cc:740] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.149654  6132 consensus_queue.cc:260] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:36.150070  6213 consensus_queue.cc:1048] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:36.151070  6255 raft_consensus.cc:2749] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.151417  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45528a8d878d46d89244614343fc6e90" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:36.152176  5934 raft_consensus.cc:3060] T 45528a8d878d46d89244614343fc6e90 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.154335  6132 ts_tablet_manager.cc:1434] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
W20260709 12:15:36.154700  6049 leader_election.cc:343] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.156134  6132 tablet_bootstrap.cc:492] T 33d81a90a1a04c558e7d4b2e844d22ce P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:36.164187  6143 consensus_queue.cc:1048] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:36.165798  6143 consensus_queue.cc:1048] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:36.158020  6128 consensus_queue.cc:260] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:36.177860  6128 ts_tablet_manager.cc:1434] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.000s
I20260709 12:15:36.178895  6128 tablet_bootstrap.cc:492] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:36.160266  6160 raft_consensus.cc:515] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:36.181038  6129 tablet_bootstrap.cc:492] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:36.181839  6129 ts_tablet_manager.cc:1403] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.193s	user 0.046s	sys 0.075s
I20260709 12:15:36.180418  6236 raft_consensus.cc:493] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.182385  6276 raft_consensus.cc:493] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.176869  6143 consensus_queue.cc:1048] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:15:36.183017  6276 raft_consensus.cc:515] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:36.183390  5755 catalog_manager.cc:5697] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:36.192458  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba593a994ff44d7866a70004fd0a946" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:36.193195  5857 raft_consensus.cc:3060] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.182716  6236 raft_consensus.cc:515] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:36.185678  6276 leader_election.cc:290] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:36.187197  5860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d81a90a1a04c558e7d4b2e844d22ce" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:36.188601  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d81a90a1a04c558e7d4b2e844d22ce" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
W20260709 12:15:36.183874  5806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:36.188704  6133 raft_consensus.cc:359] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:36.210794  6133 raft_consensus.cc:385] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.211244  6133 raft_consensus.cc:740] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.189925  5934 raft_consensus.cc:2468] T 45528a8d878d46d89244614343fc6e90 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:36.191181  6160 leader_election.cc:290] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:36.199776  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba593a994ff44d7866a70004fd0a946" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:36.201742  6236 leader_election.cc:290] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:36.215313  5860 raft_consensus.cc:2468] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:36.203927  5856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687e45fe6f3444c794271e801c21280d" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:36.205868  6238 consensus_queue.cc:1048] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:36.206261  6129 raft_consensus.cc:359] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:36.216861  6129 raft_consensus.cc:385] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.213194  6133 consensus_queue.cc:260] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:36.217259  6129 raft_consensus.cc:740] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.223519  6129 consensus_queue.cc:260] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
W20260709 12:15:36.225287  5974 leader_election.cc:343] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.225899  5975 leader_election.cc:304] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
W20260709 12:15:36.231916  5973 leader_election.cc:343] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.235028  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687e45fe6f3444c794271e801c21280d" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:36.235487  6160 raft_consensus.cc:2804] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:36.235935  6160 raft_consensus.cc:493] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.236428  6160 raft_consensus.cc:3060] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.236084  6083 raft_consensus.cc:2393] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26615d25670745d38490e2d6da247d9e in current term 1: Already voted for candidate 58ed30c66c784e06ad64609f8d1b4c43 in this term.
I20260709 12:15:36.240854  5899 leader_election.cc:304] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:36.241130  6236 consensus_queue.cc:1048] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:36.241657  6048 leader_election.cc:304] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:36.242311  6143 consensus_queue.cc:1048] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:36.242763  6236 raft_consensus.cc:3060] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.243749  6200 raft_consensus.cc:2804] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:36.244503  6200 raft_consensus.cc:697] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:15:36.261637  6133 ts_tablet_manager.cc:1434] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.134s	user 0.007s	sys 0.002s
I20260709 12:15:36.245662  6200 consensus_queue.cc:237] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:36.267956  6237 consensus_queue.cc:1048] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:36.269647  6129 ts_tablet_manager.cc:1434] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260709 12:15:36.271319  6129 tablet_bootstrap.cc:492] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:36.273550  6133 tablet_bootstrap.cc:492] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:36.279340  6188 consensus_queue.cc:1048] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:15:36.290257  6132 tablet_bootstrap.cc:654] T 33d81a90a1a04c558e7d4b2e844d22ce P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.324541  6129 tablet_bootstrap.cc:654] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.307338  6162 raft_consensus.cc:493] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:36.347245  6279 log.cc:927] Time spent T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:15:36.303402  6160 raft_consensus.cc:515] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:36.352046  5857 raft_consensus.cc:2468] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:36.365494  6236 raft_consensus.cc:2749] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.368705  6133 tablet_bootstrap.cc:654] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.332803  6184 consensus_queue.cc:1048] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 12:15:36.341385  6162 raft_consensus.cc:515] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:36.391997  6128 tablet_bootstrap.cc:654] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.394819  5975 leader_election.cc:304] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:36.407650  6162 leader_election.cc:290] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:36.422235  6132 tablet_bootstrap.cc:492] T 33d81a90a1a04c558e7d4b2e844d22ce P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:36.422842  6132 ts_tablet_manager.cc:1403] T 33d81a90a1a04c558e7d4b2e844d22ce P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.267s	user 0.020s	sys 0.042s
I20260709 12:15:36.417325  6129 tablet_bootstrap.cc:492] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:36.424027  6129 ts_tablet_manager.cc:1403] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.153s	user 0.022s	sys 0.013s
W20260709 12:15:36.434163  5975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 44307.3us
I20260709 12:15:36.440001  6282 raft_consensus.cc:2804] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:36.448767  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d81a90a1a04c558e7d4b2e844d22ce" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:36.449779  6132 raft_consensus.cc:359] T 33d81a90a1a04c558e7d4b2e844d22ce P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:36.455492  6132 raft_consensus.cc:385] T 33d81a90a1a04c558e7d4b2e844d22ce P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.455803  6132 raft_consensus.cc:740] T 33d81a90a1a04c558e7d4b2e844d22ce P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.460023  6132 consensus_queue.cc:260] T 33d81a90a1a04c558e7d4b2e844d22ce P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:36.450241  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd00b832aafb491387eee88b954ff5df" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:36.463148  6081 raft_consensus.cc:3060] T 33d81a90a1a04c558e7d4b2e844d22ce P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.475459  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd00b832aafb491387eee88b954ff5df" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:36.478430  6132 ts_tablet_manager.cc:1434] T 33d81a90a1a04c558e7d4b2e844d22ce P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.002s
I20260709 12:15:36.476649  6080 raft_consensus.cc:2468] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 0.
I20260709 12:15:36.480073  6132 tablet_bootstrap.cc:492] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:36.467723  6160 leader_election.cc:290] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:36.491659  6128 tablet_bootstrap.cc:492] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:36.492245  6128 ts_tablet_manager.cc:1403] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.314s	user 0.020s	sys 0.001s
I20260709 12:15:36.486596  6200 raft_consensus.cc:493] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.493548  6200 raft_consensus.cc:515] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:36.495119  6184 consensus_queue.cc:1048] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:36.495900  6200 leader_election.cc:290] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:36.496520  5899 leader_election.cc:304] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:36.496928  6287 raft_consensus.cc:493] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.499181  6287 raft_consensus.cc:515] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:36.501562  6287 leader_election.cc:290] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:36.502357  6133 tablet_bootstrap.cc:492] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:36.502951  6133 ts_tablet_manager.cc:1403] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.230s	user 0.021s	sys 0.013s
I20260709 12:15:36.506454  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7299ddfb5eb4240b757da7c444170c9" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:36.505946  6133 raft_consensus.cc:359] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:36.507812  5933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dad9466c8e40558116511df4c6330e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:36.507958  6133 raft_consensus.cc:385] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.509233  6133 raft_consensus.cc:740] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.512081  6133 consensus_queue.cc:260] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:36.513319  6129 raft_consensus.cc:359] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:36.490116  6282 raft_consensus.cc:697] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:36.517729  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d81a90a1a04c558e7d4b2e844d22ce" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:36.518488  5857 raft_consensus.cc:3060] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.517195  6129 raft_consensus.cc:385] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.519450  6129 raft_consensus.cc:740] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.522588  6129 consensus_queue.cc:260] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:36.520932  6133 ts_tablet_manager.cc:1434] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
W20260709 12:15:36.509881  6048 leader_election.cc:343] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.525609  6133 tablet_bootstrap.cc:492] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:36.529671  6296 raft_consensus.cc:2804] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:36.530252  6296 raft_consensus.cc:493] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.530671  6296 raft_consensus.cc:3060] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.532848  6188 consensus_queue.cc:1048] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:15:36.534504  5974 leader_election.cc:343] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.542327  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7299ddfb5eb4240b757da7c444170c9" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:36.543355  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dad9466c8e40558116511df4c6330e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:36.548447  6129 ts_tablet_manager.cc:1434] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.124s	user 0.008s	sys 0.002s
I20260709 12:15:36.549706  6129 tablet_bootstrap.cc:492] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:36.520685  6282 consensus_queue.cc:237] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
W20260709 12:15:36.550275  6047 leader_election.cc:343] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.555878  6047 leader_election.cc:304] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:36.555989  6184 consensus_queue.cc:1048] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:36.557734  6255 raft_consensus.cc:2749] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.567916  6213 raft_consensus.cc:493] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.568527  6213 raft_consensus.cc:515] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:36.570752  6132 tablet_bootstrap.cc:654] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.570843  6213 leader_election.cc:290] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
W20260709 12:15:36.565603  5899 leader_election.cc:343] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.571825  6081 raft_consensus.cc:2468] T 33d81a90a1a04c558e7d4b2e844d22ce P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:36.574843  5973 leader_election.cc:304] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:36.576454  6160 raft_consensus.cc:2804] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:36.577163  6160 raft_consensus.cc:697] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:36.579581  6160 consensus_queue.cc:237] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:36.579945  6184 raft_consensus.cc:493] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:36.579903  5975 leader_election.cc:343] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.584021  5975 leader_election.cc:304] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:36.584501  6128 raft_consensus.cc:359] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:36.585142  6287 raft_consensus.cc:2749] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.585351  6128 raft_consensus.cc:385] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.582973  6184 raft_consensus.cc:515] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:36.585752  6128 raft_consensus.cc:740] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.587337  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba593a994ff44d7866a70004fd0a946" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:36.588279  5859 raft_consensus.cc:2393] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26615d25670745d38490e2d6da247d9e in current term 1: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
I20260709 12:15:36.589026  5757 catalog_manager.cc:5697] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 1 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:36.591226  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0199e88be05480094c047ed4a193589" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:36.580134  6296 raft_consensus.cc:515] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:36.592213  5857 raft_consensus.cc:2468] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
W20260709 12:15:36.593091  5824 leader_election.cc:343] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.593319  6184 leader_election.cc:290] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:36.594064  6296 leader_election.cc:290] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:36.600370  6128 consensus_queue.cc:260] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:36.604892  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba593a994ff44d7866a70004fd0a946" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:36.612596  6128 ts_tablet_manager.cc:1434] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.120s	user 0.004s	sys 0.005s
I20260709 12:15:36.613988  6128 tablet_bootstrap.cc:492] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:36.628032  6287 raft_consensus.cc:493] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.628727  6287 raft_consensus.cc:515] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:36.629864  6128 tablet_bootstrap.cc:654] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.632303  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd00b832aafb491387eee88b954ff5df" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:36.635035  6081 raft_consensus.cc:3060] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.640573  6129 tablet_bootstrap.cc:654] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.647894  5933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0199e88be05480094c047ed4a193589" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:36.650727  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27058558598c4834804424f2de3c1cea" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
W20260709 12:15:36.653529  5975 leader_election.cc:343] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.654593  6287 leader_election.cc:290] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:36.645440  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27058558598c4834804424f2de3c1cea" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
W20260709 12:15:36.657274  5973 leader_election.cc:343] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.657982  5973 leader_election.cc:304] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:36.644305  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd00b832aafb491387eee88b954ff5df" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:36.659049  6007 raft_consensus.cc:3060] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.660951  6128 tablet_bootstrap.cc:492] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:36.662619  6133 tablet_bootstrap.cc:654] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.663117  6128 ts_tablet_manager.cc:1403] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.000s
I20260709 12:15:36.663897  6160 raft_consensus.cc:2749] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.633740  5899 leader_election.cc:304] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:36.682386  6132 tablet_bootstrap.cc:492] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:36.697949  6132 ts_tablet_manager.cc:1403] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.218s	user 0.011s	sys 0.015s
I20260709 12:15:36.698032  6296 raft_consensus.cc:3060] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:36.698196  5899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 64569.5us
I20260709 12:15:36.701328  6132 raft_consensus.cc:359] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:36.702135  6132 raft_consensus.cc:385] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:15:36.702760  5825 leader_election.cc:343] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.703289  5825 leader_election.cc:304] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:36.703372  5755 catalog_manager.cc:5697] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:36.704993  6128 raft_consensus.cc:359] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:36.705312  6293 raft_consensus.cc:2749] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.705456  6238 consensus_queue.cc:1048] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:36.706327  6132 raft_consensus.cc:740] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.705775  6128 raft_consensus.cc:385] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.707439  6132 consensus_queue.cc:260] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:36.713012  6007 raft_consensus.cc:2468] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:36.713796  6132 ts_tablet_manager.cc:1434] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:15:36.714890  6132 tablet_bootstrap.cc:492] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:36.715030  5899 leader_election.cc:304] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:36.716014  6288 raft_consensus.cc:2804] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:36.711833  6081 raft_consensus.cc:2468] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:36.708580  6128 raft_consensus.cc:740] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.722791  6288 raft_consensus.cc:697] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:36.729882  6288 consensus_queue.cc:237] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:36.724268  6128 consensus_queue.cc:260] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:36.736776  6255 consensus_queue.cc:1048] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:36.750892  6128 ts_tablet_manager.cc:1434] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.087s	user 0.015s	sys 0.004s
I20260709 12:15:36.751827  6188 raft_consensus.cc:493] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.752501  6188 raft_consensus.cc:515] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:36.753718  6129 tablet_bootstrap.cc:492] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:36.754295  6129 ts_tablet_manager.cc:1403] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.205s	user 0.022s	sys 0.024s
I20260709 12:15:36.759078  6128 tablet_bootstrap.cc:492] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:36.705783  5755 catalog_manager.cc:5697] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:36.762128  6129 raft_consensus.cc:359] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:36.763083  6129 raft_consensus.cc:385] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.763389  6129 raft_consensus.cc:740] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.765118  6132 tablet_bootstrap.cc:654] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.767674  6129 consensus_queue.cc:260] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:36.772763  6129 ts_tablet_manager.cc:1434] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:15:36.776906  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32e2e4b0423a493e8f0d323065688bd1" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:36.777719  6081 raft_consensus.cc:2468] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:36.779347  5824 leader_election.cc:304] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:36.780251  6184 raft_consensus.cc:2804] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:36.780644  6184 raft_consensus.cc:493] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.780844  6129 tablet_bootstrap.cc:492] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:36.781026  6184 raft_consensus.cc:3060] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:36.785274  6049 consensus_peers.cc:597] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:36.793431  6129 tablet_bootstrap.cc:654] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.772064  6188 leader_election.cc:290] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:36.795889  5933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32e2e4b0423a493e8f0d323065688bd1" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
W20260709 12:15:36.803114  5825 leader_election.cc:343] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.820482  6133 tablet_bootstrap.cc:492] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:36.821111  6133 ts_tablet_manager.cc:1403] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.296s	user 0.025s	sys 0.020s
I20260709 12:15:36.820551  6184 raft_consensus.cc:515] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:36.822757  6129 tablet_bootstrap.cc:492] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:36.823298  6129 ts_tablet_manager.cc:1403] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.004s
I20260709 12:15:36.823597  6184 leader_election.cc:290] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:36.824215  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32e2e4b0423a493e8f0d323065688bd1" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:36.824215  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32e2e4b0423a493e8f0d323065688bd1" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:36.825542  6133 raft_consensus.cc:359] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
W20260709 12:15:36.825964  5825 leader_election.cc:343] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.826148  6081 raft_consensus.cc:3060] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.826254  6133 raft_consensus.cc:385] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.826728  6133 raft_consensus.cc:740] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.827433  6133 consensus_queue.cc:260] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:36.828737  6129 raft_consensus.cc:359] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:36.829452  6129 raft_consensus.cc:385] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.830787  6296 raft_consensus.cc:2749] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.830799  6188 raft_consensus.cc:493] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.831559  6188 raft_consensus.cc:515] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:36.833925  6188 leader_election.cc:290] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:36.836031  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18f65fb1b1f4544b9e6a96399e38089" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:36.836967  6079 raft_consensus.cc:2468] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:36.839115  6129 raft_consensus.cc:740] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.840513  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18f65fb1b1f4544b9e6a96399e38089" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:36.841280  6129 consensus_queue.cc:260] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:36.841327  6005 raft_consensus.cc:2468] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:36.843755  5824 leader_election.cc:304] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:36.842914  5758 catalog_manager.cc:5697] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 1 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:36.844733  6293 raft_consensus.cc:2804] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:36.845139  6293 raft_consensus.cc:493] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.845481  6293 raft_consensus.cc:3060] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.849352  6133 ts_tablet_manager.cc:1434] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:15:36.850579  6133 tablet_bootstrap.cc:492] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:36.851635  6132 tablet_bootstrap.cc:492] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:36.843760  6129 ts_tablet_manager.cc:1434] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:15:36.852206  6132 ts_tablet_manager.cc:1403] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.138s	user 0.020s	sys 0.004s
I20260709 12:15:36.853036  6129 tablet_bootstrap.cc:492] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:36.855280  6132 raft_consensus.cc:359] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:36.855991  6132 raft_consensus.cc:385] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.856254  6132 raft_consensus.cc:740] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.857085  6132 consensus_queue.cc:260] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:36.857405  6081 raft_consensus.cc:2468] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:36.859616  6132 ts_tablet_manager.cc:1434] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:15:36.859959  6129 tablet_bootstrap.cc:654] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.860682  6132 tablet_bootstrap.cc:492] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:36.860919  6293 raft_consensus.cc:515] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:36.864938  6128 tablet_bootstrap.cc:654] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.867570  6133 tablet_bootstrap.cc:654] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.868058  6132 tablet_bootstrap.cc:654] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.867794  5824 leader_election.cc:304] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:36.871732  6188 raft_consensus.cc:2804] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:36.872319  6188 raft_consensus.cc:697] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:36.873189  6188 consensus_queue.cc:237] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:36.880218  6293 leader_election.cc:290] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:36.886005  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18f65fb1b1f4544b9e6a96399e38089" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:36.886806  6005 raft_consensus.cc:3060] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.890610  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18f65fb1b1f4544b9e6a96399e38089" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:36.891366  6079 raft_consensus.cc:3060] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.899187  6005 raft_consensus.cc:2468] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:36.903380  5824 leader_election.cc:304] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:36.904510  6293 raft_consensus.cc:2804] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:36.905071  6293 raft_consensus.cc:697] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:36.905920  6293 consensus_queue.cc:237] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:36.907691  5758 catalog_manager.cc:5697] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:36.910183  6288 raft_consensus.cc:493] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.911031  6288 raft_consensus.cc:515] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:36.899593  6079 raft_consensus.cc:2468] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:36.918378  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dad9466c8e40558116511df4c6330e" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
W20260709 12:15:36.920871  5901 leader_election.cc:343] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.924049  6288 leader_election.cc:290] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:36.924515  6129 tablet_bootstrap.cc:492] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:36.926038  6129 ts_tablet_manager.cc:1403] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.004s
I20260709 12:15:36.926512  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dad9466c8e40558116511df4c6330e" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:36.931106  6132 tablet_bootstrap.cc:492] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:36.931538  6133 tablet_bootstrap.cc:492] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:36.932492  6132 ts_tablet_manager.cc:1403] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.072s	user 0.018s	sys 0.026s
I20260709 12:15:36.932492  6133 ts_tablet_manager.cc:1403] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.082s	user 0.015s	sys 0.001s
I20260709 12:15:36.932834  6005 raft_consensus.cc:2468] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 0.
I20260709 12:15:36.934099  6129 raft_consensus.cc:359] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:36.934531  5899 leader_election.cc:304] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:36.934904  6129 raft_consensus.cc:385] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.935259  6129 raft_consensus.cc:740] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.935890  6288 raft_consensus.cc:2804] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:36.936012  6132 raft_consensus.cc:359] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:36.936466  6288 raft_consensus.cc:493] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.936115  6129 consensus_queue.cc:260] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:36.936940  6132 raft_consensus.cc:385] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.937011  6288 raft_consensus.cc:3060] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.937352  6132 raft_consensus.cc:740] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.938688  6129 ts_tablet_manager.cc:1434] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:15:36.938366  6132 consensus_queue.cc:260] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:36.940618  6129 tablet_bootstrap.cc:492] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:36.940734  6132 ts_tablet_manager.cc:1434] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:15:36.941850  6132 tablet_bootstrap.cc:492] T 41f23027ce3e4c149ba8309105929682 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:36.950328  6288 raft_consensus.cc:515] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:36.950946  5758 catalog_manager.cc:5697] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:36.948405  6133 raft_consensus.cc:359] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:36.953047  6133 raft_consensus.cc:385] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.953382  6133 raft_consensus.cc:740] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.945622  6128 tablet_bootstrap.cc:492] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:36.948340  6129 tablet_bootstrap.cc:654] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.957468  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dad9466c8e40558116511df4c6330e" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
W20260709 12:15:36.963848  5901 leader_election.cc:343] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.965196  6200 raft_consensus.cc:493] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.965952  6200 raft_consensus.cc:515] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:36.966789  6128 ts_tablet_manager.cc:1403] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.208s	user 0.010s	sys 0.007s
I20260709 12:15:36.968629  6200 leader_election.cc:290] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:36.970804  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27058558598c4834804424f2de3c1cea" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:36.971859  6005 raft_consensus.cc:2468] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 0.
I20260709 12:15:36.973834  6047 leader_election.cc:304] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:36.975261  6200 raft_consensus.cc:2804] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:36.975888  6200 raft_consensus.cc:493] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.976440  6200 raft_consensus.cc:3060] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.991588  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27058558598c4834804424f2de3c1cea" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
W20260709 12:15:36.993476  6049 leader_election.cc:343] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.997520  6287 consensus_queue.cc:1048] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:37.000128  6129 tablet_bootstrap.cc:492] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:37.000906  6129 ts_tablet_manager.cc:1403] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.061s	user 0.003s	sys 0.014s
I20260709 12:15:36.993433  6132 tablet_bootstrap.cc:654] T 41f23027ce3e4c149ba8309105929682 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.003119  6287 raft_consensus.cc:493] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.003741  6287 raft_consensus.cc:515] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:37.004480  6129 raft_consensus.cc:359] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:37.005245  6129 raft_consensus.cc:385] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.005499  6129 raft_consensus.cc:740] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.006194  6129 consensus_queue.cc:260] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:37.006232  6128 raft_consensus.cc:359] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:37.008852  6129 ts_tablet_manager.cc:1434] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:15:37.009922  6129 tablet_bootstrap.cc:492] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:37.007323  6128 raft_consensus.cc:385] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.010881  6128 raft_consensus.cc:740] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.011173  6200 raft_consensus.cc:515] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:37.012140  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8800c8a47a0449783d57a6275b2f677" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:37.012427  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8800c8a47a0449783d57a6275b2f677" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:37.013254  6081 raft_consensus.cc:2468] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:37.014496  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27058558598c4834804424f2de3c1cea" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
W20260709 12:15:37.014679  5974 leader_election.cc:343] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.015208  6005 raft_consensus.cc:3060] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.015627  5973 leader_election.cc:304] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:37.016574  6160 raft_consensus.cc:2804] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.012151  6287 leader_election.cc:290] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:37.017089  6160 raft_consensus.cc:493] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.017540  6160 raft_consensus.cc:3060] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.017993  6128 consensus_queue.cc:260] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:37.021513  6128 ts_tablet_manager.cc:1434] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.006s
I20260709 12:15:37.023202  6128 tablet_bootstrap.cc:492] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:37.023741  6005 raft_consensus.cc:2468] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:37.024514  6288 leader_election.cc:290] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:37.025103  6047 leader_election.cc:304] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:37.026082  6255 raft_consensus.cc:2804] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:37.026384  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dad9466c8e40558116511df4c6330e" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:37.027136  6007 raft_consensus.cc:3060] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.034070  6184 raft_consensus.cc:493] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.034626  6200 leader_election.cc:290] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:37.034751  6184 raft_consensus.cc:515] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:37.037231  6184 leader_election.cc:290] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:37.038726  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31c56e0c1b4701bc388c4d3edf535a" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:37.039631  6009 raft_consensus.cc:2468] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:37.041795  5824 leader_election.cc:304] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:37.044415  6128 tablet_bootstrap.cc:654] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.044059  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31c56e0c1b4701bc388c4d3edf535a" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:37.045146  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27058558598c4834804424f2de3c1cea" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:37.046468  6293 raft_consensus.cc:2804] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.047804  6293 raft_consensus.cc:493] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:37.048105  6049 leader_election.cc:343] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.048218  6293 raft_consensus.cc:3060] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.043314  6133 consensus_queue.cc:260] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
W20260709 12:15:37.049970  5825 leader_election.cc:343] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.050890  6160 raft_consensus.cc:515] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:37.053007  6255 raft_consensus.cc:697] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:15:37.053575  6133 ts_tablet_manager.cc:1434] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.120s	user 0.005s	sys 0.002s
I20260709 12:15:37.054670  6133 tablet_bootstrap.cc:492] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:37.054147  6255 consensus_queue.cc:237] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:37.057139  6129 tablet_bootstrap.cc:654] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.061157  6160 leader_election.cc:290] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:37.065156  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8800c8a47a0449783d57a6275b2f677" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:37.065887  6079 raft_consensus.cc:3060] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.069873  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8800c8a47a0449783d57a6275b2f677" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
W20260709 12:15:37.072355  5974 leader_election.cc:343] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.072469  6007 raft_consensus.cc:2468] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:37.074666  5899 leader_election.cc:304] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:37.074266  6079 raft_consensus.cc:2468] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:37.077694  6288 raft_consensus.cc:2804] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:37.077853  5973 leader_election.cc:304] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:37.078308  6288 raft_consensus.cc:697] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:37.079718  6160 raft_consensus.cc:2804] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:37.079875  6288 consensus_queue.cc:237] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:37.080799  6160 raft_consensus.cc:697] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:37.082099  6160 consensus_queue.cc:237] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:37.111032  6293 raft_consensus.cc:515] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:37.113336  6287 consensus_queue.cc:1048] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:37.113935  6293 leader_election.cc:290] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:37.116138  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31c56e0c1b4701bc388c4d3edf535a" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
W20260709 12:15:37.118420  5825 leader_election.cc:343] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.119867  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31c56e0c1b4701bc388c4d3edf535a" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:37.120565  6007 raft_consensus.cc:3060] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.132102  6132 tablet_bootstrap.cc:492] T 41f23027ce3e4c149ba8309105929682 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:37.132706  6132 ts_tablet_manager.cc:1403] T 41f23027ce3e4c149ba8309105929682 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.191s	user 0.008s	sys 0.026s
I20260709 12:15:37.136597  6132 raft_consensus.cc:359] T 41f23027ce3e4c149ba8309105929682 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:37.137360  6132 raft_consensus.cc:385] T 41f23027ce3e4c149ba8309105929682 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.137693  6132 raft_consensus.cc:740] T 41f23027ce3e4c149ba8309105929682 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.137399  5757 catalog_manager.cc:5697] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 1 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:37.138638  6132 consensus_queue.cc:260] T 41f23027ce3e4c149ba8309105929682 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:37.141021  6132 ts_tablet_manager.cc:1434] T 41f23027ce3e4c149ba8309105929682 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:37.142061  6132 tablet_bootstrap.cc:492] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:37.143788  6133 tablet_bootstrap.cc:654] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.152098  5755 catalog_manager.cc:5697] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 1 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:37.155589  6128 tablet_bootstrap.cc:492] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:37.156380  6128 ts_tablet_manager.cc:1403] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.133s	user 0.027s	sys 0.014s
I20260709 12:15:37.164371  6007 raft_consensus.cc:2468] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:37.165859  5824 leader_election.cc:304] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:37.167364  6293 raft_consensus.cc:2804] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:37.167869  6293 raft_consensus.cc:697] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:37.168700  6293 consensus_queue.cc:237] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:37.172241  6132 tablet_bootstrap.cc:654] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.172838  6129 tablet_bootstrap.cc:492] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:37.173442  6129 ts_tablet_manager.cc:1403] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.164s	user 0.013s	sys 0.005s
I20260709 12:15:37.169883  6128 raft_consensus.cc:359] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:37.175705  6128 raft_consensus.cc:385] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.176131  6128 raft_consensus.cc:740] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.177086  6128 consensus_queue.cc:260] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:37.180171  6128 ts_tablet_manager.cc:1434] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 12:15:37.182936  6282 consensus_queue.cc:1048] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:37.186012  6129 raft_consensus.cc:359] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:37.189801  6129 raft_consensus.cc:385] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.190224  6129 raft_consensus.cc:740] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.192615  6129 consensus_queue.cc:260] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:37.193585  6128 tablet_bootstrap.cc:492] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:37.202021  6129 ts_tablet_manager.cc:1434] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:15:37.203459  6129 tablet_bootstrap.cc:492] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:37.201947  5757 catalog_manager.cc:5697] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:37.214811  6160 consensus_queue.cc:1048] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:37.234789  6129 tablet_bootstrap.cc:654] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.239852  5755 catalog_manager.cc:5697] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:37.244045  6255 raft_consensus.cc:493] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.244661  6255 raft_consensus.cc:515] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:37.245291  6288 consensus_queue.cc:1048] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:37.246876  6160 raft_consensus.cc:493] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.246902  6288 raft_consensus.cc:493] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.247458  6160 raft_consensus.cc:515] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:37.248087  6288 raft_consensus.cc:515] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:37.250056  6160 leader_election.cc:290] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:37.250335  6288 leader_election.cc:290] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:37.266144  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f23027ce3e4c149ba8309105929682" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:37.279101  6079 raft_consensus.cc:2468] T 41f23027ce3e4c149ba8309105929682 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:37.280812  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7299ddfb5eb4240b757da7c444170c9" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:37.281621  6081 raft_consensus.cc:2468] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 0.
I20260709 12:15:37.283258  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f23027ce3e4c149ba8309105929682" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:37.283874  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7299ddfb5eb4240b757da7c444170c9" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:37.284602  6009 raft_consensus.cc:2468] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 0.
W20260709 12:15:37.287508  5974 leader_election.cc:343] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.289376  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:37.290676  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:37.264108  6255 leader_election.cc:290] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
W20260709 12:15:37.293310  6049 leader_election.cc:343] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:37.293932  6048 leader_election.cc:343] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.294418  6048 leader_election.cc:304] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:37.300221  6133 tablet_bootstrap.cc:492] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:37.300835  6133 ts_tablet_manager.cc:1403] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.246s	user 0.021s	sys 0.008s
I20260709 12:15:37.302733  5973 leader_election.cc:304] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:37.304136  6282 raft_consensus.cc:2804] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.304551  6282 raft_consensus.cc:493] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.304910  6282 raft_consensus.cc:3060] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.307741  5899 leader_election.cc:304] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:37.297958  6255 raft_consensus.cc:2749] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:37.308990  6296 raft_consensus.cc:2804] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.309465  6296 raft_consensus.cc:493] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.309832  6296 raft_consensus.cc:3060] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.313705  6288 consensus_queue.cc:1048] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:37.317368  6282 raft_consensus.cc:515] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:37.318423  6129 tablet_bootstrap.cc:492] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:37.319005  6129 ts_tablet_manager.cc:1403] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.116s	user 0.014s	sys 0.018s
I20260709 12:15:37.322860  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f23027ce3e4c149ba8309105929682" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:37.323060  6132 tablet_bootstrap.cc:492] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
W20260709 12:15:37.324491  5974 leader_election.cc:343] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.324925  6133 raft_consensus.cc:359] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:37.325249  6129 raft_consensus.cc:359] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:37.325757  6133 raft_consensus.cc:385] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.325541  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f23027ce3e4c149ba8309105929682" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:37.326046  6129 raft_consensus.cc:385] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.326105  6133 raft_consensus.cc:740] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.326470  6129 raft_consensus.cc:740] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.326506  6082 raft_consensus.cc:3060] T 41f23027ce3e4c149ba8309105929682 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.327020  6133 consensus_queue.cc:260] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:37.329396  6133 ts_tablet_manager.cc:1434] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:15:37.330760  6129 consensus_queue.cc:260] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:37.323853  6132 ts_tablet_manager.cc:1403] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.182s	user 0.021s	sys 0.023s
I20260709 12:15:37.335497  6129 ts_tablet_manager.cc:1434] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 12:15:37.336920  6133 tablet_bootstrap.cc:492] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:37.321758  6282 leader_election.cc:290] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:37.345592  6128 tablet_bootstrap.cc:654] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.339605  6129 tablet_bootstrap.cc:492] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:37.352700  6129 tablet_bootstrap.cc:654] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:37.355195  5806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:37.358502  6132 raft_consensus.cc:359] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:37.359331  6132 raft_consensus.cc:385] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.359616  6132 raft_consensus.cc:740] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.360354  6132 consensus_queue.cc:260] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:37.365674  6296 raft_consensus.cc:515] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:37.369426  6296 leader_election.cc:290] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:37.369663  6082 raft_consensus.cc:2468] T 41f23027ce3e4c149ba8309105929682 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:37.370024  6132 ts_tablet_manager.cc:1434] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:15:37.371162  6132 tablet_bootstrap.cc:492] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:37.362694  6293 raft_consensus.cc:493] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.377008  6293 raft_consensus.cc:515] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:37.379504  6293 leader_election.cc:290] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:37.380360  6133 tablet_bootstrap.cc:654] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.382933  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7299ddfb5eb4240b757da7c444170c9" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:37.383831  6079 raft_consensus.cc:3060] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.386333  6132 tablet_bootstrap.cc:654] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.394191  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:37.395046  6009 raft_consensus.cc:2468] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:37.396736  5824 leader_election.cc:304] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:37.397811  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:37.398219  6184 raft_consensus.cc:2804] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.398597  6080 raft_consensus.cc:2468] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:37.398777  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7299ddfb5eb4240b757da7c444170c9" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:37.398730  6184 raft_consensus.cc:493] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.399775  6184 raft_consensus.cc:3060] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.419253  6007 raft_consensus.cc:3060] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.434172  6129 tablet_bootstrap.cc:492] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:37.434827  6129 ts_tablet_manager.cc:1403] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.099s	user 0.008s	sys 0.013s
I20260709 12:15:37.428867  5973 leader_election.cc:304] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:37.426751  6288 raft_consensus.cc:493] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.437786  6129 raft_consensus.cc:359] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:37.439292  6129 raft_consensus.cc:385] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.439608  6129 raft_consensus.cc:740] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.438843  6288 raft_consensus.cc:515] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:37.443065  6288 leader_election.cc:290] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:37.444751  6129 consensus_queue.cc:260] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:37.451507  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32e2e4b0423a493e8f0d323065688bd1" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:37.443960  6227 consensus_queue.cc:1048] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:15:37.444754  6287 raft_consensus.cc:2804] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:37.457631  6083 raft_consensus.cc:2393] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26615d25670745d38490e2d6da247d9e in current term 1: Already voted for candidate 58ed30c66c784e06ad64609f8d1b4c43 in this term.
I20260709 12:15:37.466550  6188 consensus_queue.cc:1048] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:37.473368  6079 raft_consensus.cc:2468] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:37.460376  6129 ts_tablet_manager.cc:1434] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 12:15:37.476790  6128 tablet_bootstrap.cc:492] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:37.481176  6128 ts_tablet_manager.cc:1403] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.288s	user 0.019s	sys 0.020s
I20260709 12:15:37.481863  6129 tablet_bootstrap.cc:492] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:37.472262  6184 raft_consensus.cc:515] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:37.491186  6184 leader_election.cc:290] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:37.462160  6287 raft_consensus.cc:697] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:37.484265  6128 raft_consensus.cc:359] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:37.477249  5899 leader_election.cc:304] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:37.509749  6129 tablet_bootstrap.cc:654] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:37.529425  5899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 52332.4us
W20260709 12:15:37.478543  6342 log.cc:927] Time spent T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:15:37.531160  6287 consensus_queue.cc:237] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:37.492086  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32e2e4b0423a493e8f0d323065688bd1" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:37.495219  6293 consensus_queue.cc:1048] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:37.497200  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:37.533561  6079 raft_consensus.cc:3060] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.535444  6128 raft_consensus.cc:385] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.535792  6128 raft_consensus.cc:740] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.498004  6007 raft_consensus.cc:2468] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:37.536533  6128 consensus_queue.cc:260] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:37.497454  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:37.537925  6005 raft_consensus.cc:3060] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.538798  6133 tablet_bootstrap.cc:492] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:37.538935  6128 ts_tablet_manager.cc:1434] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.057s	user 0.009s	sys 0.001s
I20260709 12:15:37.539418  6133 ts_tablet_manager.cc:1403] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.203s	user 0.018s	sys 0.037s
I20260709 12:15:37.540194  6128 tablet_bootstrap.cc:492] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:37.542343  6133 raft_consensus.cc:359] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:37.543227  6133 raft_consensus.cc:385] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.544118  6133 raft_consensus.cc:740] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.532940  6296 raft_consensus.cc:2804] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:37.545003  6133 consensus_queue.cc:260] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:37.550315  5932 raft_consensus.cc:3060] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.550652  5901 leader_election.cc:304] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:37.551100  6133 ts_tablet_manager.cc:1434] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
W20260709 12:15:37.543519  5824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 50029us
I20260709 12:15:37.558827  6133 tablet_bootstrap.cc:492] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:37.562995  6255 consensus_queue.cc:1048] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:37.566550  6296 raft_consensus.cc:697] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:37.568349  6132 tablet_bootstrap.cc:492] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:37.574098  6132 ts_tablet_manager.cc:1403] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.203s	user 0.044s	sys 0.044s
I20260709 12:15:37.581439  6288 consensus_queue.cc:1048] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:37.586944  5757 catalog_manager.cc:5697] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:37.585382  6132 raft_consensus.cc:359] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:37.591781  6132 raft_consensus.cc:385] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.592293  6132 raft_consensus.cc:740] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.604882  6132 consensus_queue.cc:260] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:37.593772  6005 raft_consensus.cc:2468] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:37.609668  6143 raft_consensus.cc:2749] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:37.613382  6128 tablet_bootstrap.cc:654] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.622794  6132 ts_tablet_manager.cc:1434] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 12:15:37.621099  6079 raft_consensus.cc:2468] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:37.626996  6296 consensus_queue.cc:237] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:37.626197  5824 leader_election.cc:304] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:37.629457  6132 tablet_bootstrap.cc:492] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:37.634078  6350 raft_consensus.cc:2804] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:37.634881  6350 raft_consensus.cc:697] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
W20260709 12:15:37.622694  5901 consensus_peers.cc:597] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:37.641963  6133 tablet_bootstrap.cc:654] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.642994  6184 consensus_queue.cc:1048] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:37.638954  6255 raft_consensus.cc:493] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.645221  6255 raft_consensus.cc:515] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:37.647617  6255 leader_election.cc:290] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:37.648809  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75d901511f94357a67c07612cf07d1a" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:37.649360  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75d901511f94357a67c07612cf07d1a" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
W20260709 12:15:37.652037  6047 leader_election.cc:343] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.653924  6129 tablet_bootstrap.cc:492] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:37.654757  6129 ts_tablet_manager.cc:1403] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.173s	user 0.028s	sys 0.057s
W20260709 12:15:37.653715  6048 leader_election.cc:343] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.657194  6132 tablet_bootstrap.cc:654] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.657291  6048 leader_election.cc:304] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:37.659263  6200 raft_consensus.cc:2749] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:37.660753  5825 consensus_peers.cc:597] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:37.660568  6350 consensus_queue.cc:237] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
W20260709 12:15:37.663816  6049 consensus_peers.cc:597] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:37.667421  6287 consensus_queue.cc:1048] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:15:37.671408  5974 consensus_peers.cc:597] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:37.679032  6129 raft_consensus.cc:359] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:37.683187  6129 raft_consensus.cc:385] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.683609  6129 raft_consensus.cc:740] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.694594  6129 consensus_queue.cc:260] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:37.697335  6129 ts_tablet_manager.cc:1434] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:15:37.698907  6129 tablet_bootstrap.cc:492] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:37.711095  6132 tablet_bootstrap.cc:492] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:37.711915  6132 ts_tablet_manager.cc:1403] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.019s
I20260709 12:15:37.723671  6350 consensus_queue.cc:1048] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:15:37.742455  6132 raft_consensus.cc:359] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:37.743379  6132 raft_consensus.cc:385] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.743811  6132 raft_consensus.cc:740] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.747478  6132 consensus_queue.cc:260] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:37.748968  6132 ts_tablet_manager.cc:1434] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:15:37.749809  6132 tablet_bootstrap.cc:492] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:37.780182  5757 catalog_manager.cc:5697] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:37.789906  5754 catalog_manager.cc:5697] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 1 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:37.802294  6133 tablet_bootstrap.cc:492] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:37.802953  6133 ts_tablet_manager.cc:1403] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.244s	user 0.018s	sys 0.004s
I20260709 12:15:37.813086  6133 raft_consensus.cc:359] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:37.813874  6133 raft_consensus.cc:385] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.815936  6133 raft_consensus.cc:740] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.819523  6133 consensus_queue.cc:260] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:37.821795  6132 tablet_bootstrap.cc:654] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.825037  6133 ts_tablet_manager.cc:1434] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260709 12:15:37.826156  6133 tablet_bootstrap.cc:492] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:37.829517  6128 tablet_bootstrap.cc:492] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:37.830087  6128 ts_tablet_manager.cc:1403] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.290s	user 0.034s	sys 0.050s
I20260709 12:15:37.832944  6326 raft_consensus.cc:493] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.833539  6326 raft_consensus.cc:515] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:37.837528  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d71c733514ec9bc7ddb9d3b7cd80d" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:37.839814  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d71c733514ec9bc7ddb9d3b7cd80d" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:37.840569  5859 raft_consensus.cc:2468] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 0.
I20260709 12:15:37.842016  6049 leader_election.cc:304] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:37.843199  6200 raft_consensus.cc:2804] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.843650  6200 raft_consensus.cc:493] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.844075  6200 raft_consensus.cc:3060] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.845816  6128 raft_consensus.cc:359] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:37.846637  6128 raft_consensus.cc:385] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.846906  6128 raft_consensus.cc:740] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.847692  6128 consensus_queue.cc:260] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
W20260709 12:15:37.848250  6047 leader_election.cc:343] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.849853  6128 ts_tablet_manager.cc:1434] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 12:15:37.850939  6128 tablet_bootstrap.cc:492] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:37.855933  6143 raft_consensus.cc:493] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.856567  6143 raft_consensus.cc:515] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:37.857187  6128 tablet_bootstrap.cc:654] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.858637  6133 tablet_bootstrap.cc:654] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.859110  6143 leader_election.cc:290] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:37.836042  6326 leader_election.cc:290] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:37.861685  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31c56e0c1b4701bc388c4d3edf535a" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:37.864272  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31c56e0c1b4701bc388c4d3edf535a" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:37.866142  5901 leader_election.cc:304] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:37.867106  6296 raft_consensus.cc:2749] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:37.874132  6133 tablet_bootstrap.cc:492] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:37.874780  6133 ts_tablet_manager.cc:1403] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.003s
I20260709 12:15:37.876269  6200 raft_consensus.cc:515] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:37.878588  6133 raft_consensus.cc:359] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:37.888003  6133 raft_consensus.cc:385] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.888362  6133 raft_consensus.cc:740] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.889058  6133 consensus_queue.cc:260] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:37.881481  6326 raft_consensus.cc:493] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.887174  6129 tablet_bootstrap.cc:654] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.890064  6326 raft_consensus.cc:515] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:37.892000  5858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d71c733514ec9bc7ddb9d3b7cd80d" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:37.892472  6326 leader_election.cc:290] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:37.892964  5858 raft_consensus.cc:3060] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.894999  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353bf2c0ce2c412e9ca171f2bb150f91" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
W20260709 12:15:37.897267  6048 leader_election.cc:343] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.889467  6200 leader_election.cc:290] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:37.881574  6128 tablet_bootstrap.cc:492] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:37.898787  6128 ts_tablet_manager.cc:1403] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.000s
I20260709 12:15:37.900166  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353bf2c0ce2c412e9ca171f2bb150f91" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:37.903246  6128 raft_consensus.cc:359] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:37.904455  6128 raft_consensus.cc:385] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.904910  6128 raft_consensus.cc:740] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.906038  6128 consensus_queue.cc:260] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
W20260709 12:15:37.906900  6049 leader_election.cc:343] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.909636  6128 ts_tablet_manager.cc:1434] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:15:37.910511  6143 raft_consensus.cc:493] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.914110  6143 raft_consensus.cc:515] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:37.915360  6132 tablet_bootstrap.cc:492] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:37.915992  6132 ts_tablet_manager.cc:1403] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.166s	user 0.039s	sys 0.036s
I20260709 12:15:37.911728  6133 ts_tablet_manager.cc:1434] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.037s	user 0.002s	sys 0.004s
I20260709 12:15:37.918993  6132 raft_consensus.cc:359] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:37.919718  6132 raft_consensus.cc:385] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.919795  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8800c8a47a0449783d57a6275b2f677" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:37.920037  6132 raft_consensus.cc:740] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.920521  6133 tablet_bootstrap.cc:492] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:37.920908  6132 consensus_queue.cc:260] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:37.922534  6143 leader_election.cc:290] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:37.926827  6128 tablet_bootstrap.cc:492] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:37.930245  6132 ts_tablet_manager.cc:1434] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:15:37.931478  6132 tablet_bootstrap.cc:492] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:37.933465  6287 raft_consensus.cc:493] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.934057  6287 raft_consensus.cc:515] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:37.935146  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d71c733514ec9bc7ddb9d3b7cd80d" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:37.928692  6049 leader_election.cc:304] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:37.937366  6200 raft_consensus.cc:2749] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:37.938148  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0199e88be05480094c047ed4a193589" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:37.938781  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8800c8a47a0449783d57a6275b2f677" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
W20260709 12:15:37.939889  5974 leader_election.cc:343] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.940064  5858 raft_consensus.cc:2468] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:37.940653  5899 leader_election.cc:304] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27
W20260709 12:15:37.941800  6047 leader_election.cc:343] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.941985  6132 tablet_bootstrap.cc:654] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.943418  6287 leader_election.cc:290] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:37.953265  6288 raft_consensus.cc:2749] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:37.953471  6049 leader_election.cc:304] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:37.953552  6343 raft_consensus.cc:493] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.954360  6200 raft_consensus.cc:2804] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:37.954264  6343 raft_consensus.cc:515] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:37.955018  6200 raft_consensus.cc:697] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:15:37.955960  6200 consensus_queue.cc:237] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:37.956964  6343 leader_election.cc:290] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:37.958763  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48d13e87f1d4964bb74ba350c2e2df5" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:37.959522  5859 raft_consensus.cc:2468] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 0.
I20260709 12:15:37.961319  5901 leader_election.cc:304] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:37.962894  6353 raft_consensus.cc:2804] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.962878  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48d13e87f1d4964bb74ba350c2e2df5" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:37.963579  6353 raft_consensus.cc:493] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.963320  5858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0199e88be05480094c047ed4a193589" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:37.963817  6083 raft_consensus.cc:2468] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 0.
I20260709 12:15:37.964043  6353 raft_consensus.cc:3060] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.964435  5858 raft_consensus.cc:2468] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:37.968869  5975 leader_election.cc:304] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:37.979487  6160 raft_consensus.cc:2804] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.980019  6160 raft_consensus.cc:493] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.980415  6160 raft_consensus.cc:3060] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.987942  6353 raft_consensus.cc:515] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:37.988651  6282 consensus_queue.cc:1048] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:37.991473  6353 leader_election.cc:290] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:37.991695  5858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48d13e87f1d4964bb74ba350c2e2df5" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:37.992540  5858 raft_consensus.cc:3060] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.992152  5758 catalog_manager.cc:5697] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 1 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:37.997164  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48d13e87f1d4964bb74ba350c2e2df5" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:37.997942  6083 raft_consensus.cc:3060] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.998963  6129 tablet_bootstrap.cc:492] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:37.999526  6129 ts_tablet_manager.cc:1403] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.301s	user 0.031s	sys 0.037s
I20260709 12:15:38.007691  5858 raft_consensus.cc:2468] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:38.010259  6133 tablet_bootstrap.cc:654] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.010998  5901 leader_election.cc:304] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:38.012089  6353 raft_consensus.cc:2804] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:38.012619  6353 raft_consensus.cc:697] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:38.013502  6353 consensus_queue.cc:237] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:38.031891  6083 raft_consensus.cc:2468] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:38.032632  6128 tablet_bootstrap.cc:654] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.032249  6129 raft_consensus.cc:359] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.036029  6129 raft_consensus.cc:385] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.036353  6129 raft_consensus.cc:740] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.037794  6160 raft_consensus.cc:515] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.040978  6160 leader_election.cc:290] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:38.039000  6129 consensus_queue.cc:260] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.041669  6287 raft_consensus.cc:493] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.042218  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0199e88be05480094c047ed4a193589" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
W20260709 12:15:38.046674  5974 leader_election.cc:343] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.048069  5859 raft_consensus.cc:3060] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.053791  6132 tablet_bootstrap.cc:492] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:38.057689  6133 tablet_bootstrap.cc:492] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:38.058334  6133 ts_tablet_manager.cc:1403] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.138s	user 0.017s	sys 0.001s
I20260709 12:15:38.061836  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0199e88be05480094c047ed4a193589" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:38.062623  5857 raft_consensus.cc:3060] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.042187  6287 raft_consensus.cc:515] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.055490  6132 ts_tablet_manager.cc:1403] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.124s	user 0.017s	sys 0.015s
I20260709 12:15:38.071671  6133 raft_consensus.cc:359] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:38.072788  6133 raft_consensus.cc:385] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.082806  6296 consensus_queue.cc:1048] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.073167  6133 raft_consensus.cc:740] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.092255  6133 consensus_queue.cc:260] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:38.097847  6132 raft_consensus.cc:359] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:38.098665  6132 raft_consensus.cc:385] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.098999  6132 raft_consensus.cc:740] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.105530  6132 consensus_queue.cc:260] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:38.108450  6133 ts_tablet_manager.cc:1434] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.001s
I20260709 12:15:38.113404  6129 ts_tablet_manager.cc:1434] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.114s	user 0.008s	sys 0.016s
I20260709 12:15:38.114830  6129 tablet_bootstrap.cc:492] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:38.123342  6133 tablet_bootstrap.cc:492] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:38.127610  6132 ts_tablet_manager.cc:1434] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 12:15:38.128587  6132 tablet_bootstrap.cc:492] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
W20260709 12:15:38.124363  5973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 49237us
I20260709 12:15:38.139897  6293 raft_consensus.cc:493] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:38.140605  6293 raft_consensus.cc:515] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.143529  6287 leader_election.cc:290] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:38.144716  6129 tablet_bootstrap.cc:654] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.149991  5758 catalog_manager.cc:5697] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 1 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:38.150775  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dad9466c8e40558116511df4c6330e" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:38.152326  5934 raft_consensus.cc:3060] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.154659  5933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75d901511f94357a67c07612cf07d1a" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:38.157472  6133 tablet_bootstrap.cc:654] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.160081  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75d901511f94357a67c07612cf07d1a" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:38.131393  5857 raft_consensus.cc:2468] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:38.174335  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dad9466c8e40558116511df4c6330e" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:38.178295  6132 tablet_bootstrap.cc:654] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.180075  6296 consensus_queue.cc:1048] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.144673  6293 leader_election.cc:290] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
W20260709 12:15:38.192176  5975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 93819.6us
I20260709 12:15:38.194657  6083 raft_consensus.cc:2468] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:38.197325  6128 tablet_bootstrap.cc:492] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:38.197429  5973 leader_election.cc:304] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:38.198056  6128 ts_tablet_manager.cc:1403] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.272s	user 0.026s	sys 0.020s
I20260709 12:15:38.201409  6378 raft_consensus.cc:2804] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:15:38.217451  5974 consensus_peers.cc:597] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:38.219539  6128 raft_consensus.cc:359] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:38.223804  6128 raft_consensus.cc:385] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.224753  6128 raft_consensus.cc:740] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.220713  5825 leader_election.cc:304] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:38.226558  6184 raft_consensus.cc:2749] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:38.224246  5974 leader_election.cc:343] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.222441  6378 raft_consensus.cc:493] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.228726  6128 consensus_queue.cc:260] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:38.232642  6378 raft_consensus.cc:3060] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.232594  5975 leader_election.cc:304] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:38.240535  6133 tablet_bootstrap.cc:492] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:38.241173  6133 ts_tablet_manager.cc:1403] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.118s	user 0.009s	sys 0.006s
I20260709 12:15:38.243099  6376 raft_consensus.cc:2804] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:38.243700  6376 raft_consensus.cc:697] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:38.244318  6133 raft_consensus.cc:359] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.247043  6227 consensus_queue.cc:1048] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.258103  6133 raft_consensus.cc:385] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.258651  6133 raft_consensus.cc:740] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.265304  6133 consensus_queue.cc:260] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.270282  6128 ts_tablet_manager.cc:1434] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.001s
I20260709 12:15:38.272547  6128 tablet_bootstrap.cc:492] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:38.276134  6132 tablet_bootstrap.cc:492] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:38.276749  6132 ts_tablet_manager.cc:1403] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.148s	user 0.013s	sys 0.000s
I20260709 12:15:38.278517  6143 raft_consensus.cc:493] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.279088  6143 raft_consensus.cc:515] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:38.281455  6143 leader_election.cc:290] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:38.253307  6376 consensus_queue.cc:237] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.286090  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353bf2c0ce2c412e9ca171f2bb150f91" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:38.287254  6379 raft_consensus.cc:493] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.287910  6379 raft_consensus.cc:515] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:38.291492  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214f52126a2c4bc59473ee7461e4a044" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
W20260709 12:15:38.293555  5973 leader_election.cc:343] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.298449  6133 ts_tablet_manager.cc:1434] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.001s
I20260709 12:15:38.299652  6133 tablet_bootstrap.cc:492] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:38.308257  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214f52126a2c4bc59473ee7461e4a044" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
W20260709 12:15:38.310446  5901 leader_election.cc:343] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:38.316164  5975 leader_election.cc:343] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.316702  5975 leader_election.cc:304] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:38.316856  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353bf2c0ce2c412e9ca171f2bb150f91" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:38.317654  6083 raft_consensus.cc:2468] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 0.
I20260709 12:15:38.317711  6287 raft_consensus.cc:2749] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:38.317735  6227 consensus_queue.cc:1048] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.320058  5932 raft_consensus.cc:3060] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.320812  5899 leader_election.cc:304] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:38.322295  6296 raft_consensus.cc:2804] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:38.322748  6296 raft_consensus.cc:493] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.323107  6296 raft_consensus.cc:3060] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.323674  6129 tablet_bootstrap.cc:492] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:38.324281  6129 ts_tablet_manager.cc:1403] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.210s	user 0.017s	sys 0.014s
I20260709 12:15:38.303071  6379 leader_election.cc:290] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:38.326149  6200 raft_consensus.cc:493] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.326866  6200 raft_consensus.cc:515] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
W20260709 12:15:38.360677  6047 consensus_peers.cc:597] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb -> Peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Couldn't send request to peer e29106aa83aa4eebb9b87d6745825a27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.409164  6047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 48641.2us
I20260709 12:15:38.363950  6255 raft_consensus.cc:493] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.410678  6255 raft_consensus.cc:515] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:38.420547  6129 raft_consensus.cc:359] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:38.421865  6255 leader_election.cc:290] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:38.328680  6132 raft_consensus.cc:359] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:38.424013  6132 raft_consensus.cc:385] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.424378  6132 raft_consensus.cc:740] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.424927  5933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12649b3d49a4a309d961106ba152892" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:38.424991  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12649b3d49a4a309d961106ba152892" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:38.426743  6132 consensus_queue.cc:260] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:38.422138  6129 raft_consensus.cc:385] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.427834  6129 raft_consensus.cc:740] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
W20260709 12:15:38.428262  6048 leader_election.cc:343] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.428659  6129 consensus_queue.cc:260] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:38.400521  6128 tablet_bootstrap.cc:654] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:38.431015  6049 leader_election.cc:343] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.431562  6049 leader_election.cc:304] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:38.432626  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43bf33a33b443ba5cf0cdcb741f5fa" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:38.432883  6200 leader_election.cc:290] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:38.433439  6200 raft_consensus.cc:2749] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:38.434376  6047 leader_election.cc:343] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.434695  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43bf33a33b443ba5cf0cdcb741f5fa" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:38.437530  6133 tablet_bootstrap.cc:654] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.438578  6227 raft_consensus.cc:493] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.439175  6227 raft_consensus.cc:515] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
W20260709 12:15:38.439694  6049 leader_election.cc:343] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.440243  6049 leader_election.cc:304] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:38.441480  6326 raft_consensus.cc:2749] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:38.444131  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27058558598c4834804424f2de3c1cea" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:38.441522  6227 leader_election.cc:290] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:38.445381  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27058558598c4834804424f2de3c1cea" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:38.447312  5824 leader_election.cc:304] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:38.448232  6227 raft_consensus.cc:2749] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:38.454584  6129 ts_tablet_manager.cc:1434] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.130s	user 0.010s	sys 0.000s
I20260709 12:15:38.457693  6129 tablet_bootstrap.cc:492] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:38.455195  6132 ts_tablet_manager.cc:1434] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.178s	user 0.005s	sys 0.026s
I20260709 12:15:38.463472  6132 tablet_bootstrap.cc:492] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:38.441991  6378 raft_consensus.cc:515] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.470211  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75d901511f94357a67c07612cf07d1a" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
W20260709 12:15:38.471729  5974 leader_election.cc:343] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.471484  6296 raft_consensus.cc:515] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:38.479406  6296 leader_election.cc:290] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:38.480491  6129 tablet_bootstrap.cc:654] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.483912  6132 tablet_bootstrap.cc:654] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.487632  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353bf2c0ce2c412e9ca171f2bb150f91" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:38.488462  6079 raft_consensus.cc:3060] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.491091  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353bf2c0ce2c412e9ca171f2bb150f91" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
W20260709 12:15:38.492822  5901 leader_election.cc:343] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.497025  6079 raft_consensus.cc:2468] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:38.501430  6128 tablet_bootstrap.cc:492] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:38.505854  6128 ts_tablet_manager.cc:1403] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.234s	user 0.011s	sys 0.011s
I20260709 12:15:38.512130  6128 raft_consensus.cc:359] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:38.512892  6200 consensus_queue.cc:1048] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.512897  6128 raft_consensus.cc:385] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.515232  6128 raft_consensus.cc:740] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.515084  6143 consensus_queue.cc:1048] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:38.516036  6128 consensus_queue.cc:260] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:38.503389  6132 tablet_bootstrap.cc:492] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:38.504838  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75d901511f94357a67c07612cf07d1a" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:38.517282  6132 ts_tablet_manager.cc:1403] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.000s
I20260709 12:15:38.517305  6083 raft_consensus.cc:3060] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.520231  6133 tablet_bootstrap.cc:492] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:38.520820  6133 ts_tablet_manager.cc:1403] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.221s	user 0.005s	sys 0.006s
I20260709 12:15:38.523106  5899 leader_election.cc:304] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:38.524068  6143 raft_consensus.cc:2804] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:38.524614  6143 raft_consensus.cc:697] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:38.524446  6132 raft_consensus.cc:359] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.525321  6132 raft_consensus.cc:385] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.525610  6132 raft_consensus.cc:740] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.525660  6143 consensus_queue.cc:237] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:38.527707  5858 raft_consensus.cc:3060] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.528221  6083 raft_consensus.cc:2468] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:38.528008  6132 consensus_queue.cc:260] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.521690  6128 ts_tablet_manager.cc:1434] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:15:38.529764  6378 leader_election.cc:290] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:38.530902  6128 tablet_bootstrap.cc:492] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:38.531026  5973 leader_election.cc:304] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:38.532147  6132 ts_tablet_manager.cc:1434] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:15:38.532382  6378 raft_consensus.cc:2804] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:38.533265  6378 raft_consensus.cc:697] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:38.533259  6132 tablet_bootstrap.cc:492] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:38.540671  6129 tablet_bootstrap.cc:492] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:38.534166  6378 consensus_queue.cc:237] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.540881  6133 raft_consensus.cc:359] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.541293  6129 ts_tablet_manager.cc:1403] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.002s
I20260709 12:15:38.541611  6133 raft_consensus.cc:385] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.541973  6133 raft_consensus.cc:740] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.544333  6129 raft_consensus.cc:359] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.545151  6129 raft_consensus.cc:385] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.545500  6129 raft_consensus.cc:740] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.551559  6132 tablet_bootstrap.cc:654] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.553287  6343 consensus_queue.cc:1048] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:38.555502  6128 tablet_bootstrap.cc:654] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:38.556738  5806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:38.559058  6133 consensus_queue.cc:260] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.561187  6129 consensus_queue.cc:260] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.562608  6133 ts_tablet_manager.cc:1434] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.002s
I20260709 12:15:38.563642  6129 ts_tablet_manager.cc:1434] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:15:38.563829  6133 tablet_bootstrap.cc:492] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:38.564828  6129 tablet_bootstrap.cc:492] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:38.571781  6129 tablet_bootstrap.cc:654] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.572840  6378 raft_consensus.cc:493] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.573518  6378 raft_consensus.cc:515] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.577551  6378 leader_election.cc:290] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:38.578642  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16996642a1b4752b788da1836791f3c" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:38.579525  5934 raft_consensus.cc:2468] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:38.581264  5974 leader_election.cc:304] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:38.582666  6378 raft_consensus.cc:2804] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:38.583222  6378 raft_consensus.cc:493] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.586666  6378 raft_consensus.cc:3060] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.592262  6296 raft_consensus.cc:493] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.593108  6296 raft_consensus.cc:515] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.594789  6128 tablet_bootstrap.cc:492] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:38.594956  5856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16996642a1b4752b788da1836791f3c" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:38.595418  6128 ts_tablet_manager.cc:1403] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.065s	user 0.007s	sys 0.005s
I20260709 12:15:38.596419  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f23027ce3e4c149ba8309105929682" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:38.601105  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f23027ce3e4c149ba8309105929682" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
W20260709 12:15:38.602180  5975 leader_election.cc:343] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.602698  6296 leader_election.cc:290] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:38.603670  5899 leader_election.cc:304] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:38.607206  6133 tablet_bootstrap.cc:654] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.605283  6343 raft_consensus.cc:2749] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:38.609095  6128 raft_consensus.cc:359] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:38.609908  6128 raft_consensus.cc:385] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.610222  6128 raft_consensus.cc:740] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.618304  6378 raft_consensus.cc:515] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.618700  6128 consensus_queue.cc:260] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:38.622787  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16996642a1b4752b788da1836791f3c" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:38.623538  6128 ts_tablet_manager.cc:1434] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:15:38.623560  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16996642a1b4752b788da1836791f3c" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:38.624503  5932 raft_consensus.cc:3060] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:38.624974  5975 leader_election.cc:343] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.626070  6378 leader_election.cc:290] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:38.626873  6133 tablet_bootstrap.cc:492] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:38.627501  6133 ts_tablet_manager.cc:1403] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.002s
I20260709 12:15:38.623212  6129 tablet_bootstrap.cc:492] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:38.630924  6129 ts_tablet_manager.cc:1403] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.005s
I20260709 12:15:38.630163  6128 tablet_bootstrap.cc:492] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:38.632432  6133 raft_consensus.cc:359] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.633926  6133 raft_consensus.cc:385] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.634289  6133 raft_consensus.cc:740] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.634941  5932 raft_consensus.cc:2468] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:38.636407  5974 leader_election.cc:304] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:38.636583  6133 consensus_queue.cc:260] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.637774  6378 raft_consensus.cc:2804] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:38.638666  6378 raft_consensus.cc:697] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:38.639513  6128 tablet_bootstrap.cc:654] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.639688  6378 consensus_queue.cc:237] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.638942  6129 raft_consensus.cc:359] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.645241  6133 ts_tablet_manager.cc:1434] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:15:38.646170  6133 tablet_bootstrap.cc:492] T b75d901511f94357a67c07612cf07d1a P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:38.644491  6129 raft_consensus.cc:385] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.649782  6129 raft_consensus.cc:740] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.650852  6129 consensus_queue.cc:260] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.653689  6129 ts_tablet_manager.cc:1434] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:15:38.654855  6129 tablet_bootstrap.cc:492] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:38.660956  6133 tablet_bootstrap.cc:654] T b75d901511f94357a67c07612cf07d1a P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.653183  5758 catalog_manager.cc:5697] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:38.677002  6129 tablet_bootstrap.cc:654] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.684893  5758 catalog_manager.cc:5697] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:38.732523  5934 raft_consensus.cc:3060] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.732671  6132 tablet_bootstrap.cc:492] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:38.733325  6132 ts_tablet_manager.cc:1403] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.200s	user 0.024s	sys 0.009s
I20260709 12:15:38.736359  6132 raft_consensus.cc:359] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.737107  6132 raft_consensus.cc:385] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.737411  6132 raft_consensus.cc:740] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.741719  6132 consensus_queue.cc:260] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.746752  6133 tablet_bootstrap.cc:492] T b75d901511f94357a67c07612cf07d1a P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:38.747364  6133 ts_tablet_manager.cc:1403] T b75d901511f94357a67c07612cf07d1a P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.101s	user 0.026s	sys 0.007s
I20260709 12:15:38.747514  6132 ts_tablet_manager.cc:1434] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 12:15:38.748911  6132 tablet_bootstrap.cc:492] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:38.752938  6133 raft_consensus.cc:359] T b75d901511f94357a67c07612cf07d1a P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.753638  6133 raft_consensus.cc:385] T b75d901511f94357a67c07612cf07d1a P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.753911  6133 raft_consensus.cc:740] T b75d901511f94357a67c07612cf07d1a P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.754756  6133 consensus_queue.cc:260] T b75d901511f94357a67c07612cf07d1a P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.756665  6128 tablet_bootstrap.cc:492] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:38.757186  6133 ts_tablet_manager.cc:1434] T b75d901511f94357a67c07612cf07d1a P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:15:38.758327  6133 tablet_bootstrap.cc:492] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:38.757230  6128 ts_tablet_manager.cc:1403] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.127s	user 0.026s	sys 0.020s
I20260709 12:15:38.773999  6128 raft_consensus.cc:359] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:38.774922  6128 raft_consensus.cc:385] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.775202  6128 raft_consensus.cc:740] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.781323  6128 consensus_queue.cc:260] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:38.782407  6350 raft_consensus.cc:493] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.782974  6350 raft_consensus.cc:515] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:38.783519  6133 tablet_bootstrap.cc:654] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.784005  6353 raft_consensus.cc:493] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.784559  6353 raft_consensus.cc:515] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.785353  6350 leader_election.cc:290] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:38.787401  6353 leader_election.cc:290] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:38.788322  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214f52126a2c4bc59473ee7461e4a044" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:38.788580  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214f52126a2c4bc59473ee7461e4a044" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:38.789229  6009 raft_consensus.cc:2468] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:38.789923  6132 tablet_bootstrap.cc:654] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:38.790163  5824 leader_election.cc:343] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.791169  6128 ts_tablet_manager.cc:1434] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:15:38.791353  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0199e88be05480094c047ed4a193589" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:38.791489  5824 leader_election.cc:304] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:38.792325  6128 tablet_bootstrap.cc:492] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:38.792440  5857 raft_consensus.cc:2393] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26615d25670745d38490e2d6da247d9e in current term 1: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
I20260709 12:15:38.792917  6350 raft_consensus.cc:2804] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:38.793355  6350 raft_consensus.cc:493] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.793702  6350 raft_consensus.cc:3060] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.795688  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0199e88be05480094c047ed4a193589" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:38.798290  5899 leader_election.cc:304] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:38.803218  6129 tablet_bootstrap.cc:492] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:38.803944  6129 ts_tablet_manager.cc:1403] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.149s	user 0.017s	sys 0.003s
I20260709 12:15:38.804100  6353 raft_consensus.cc:3060] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.806350  6128 tablet_bootstrap.cc:654] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.808859  6129 raft_consensus.cc:359] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.810969  6129 raft_consensus.cc:385] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.810915  6326 raft_consensus.cc:493] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.811522  6129 raft_consensus.cc:740] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.814548  6129 consensus_queue.cc:260] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.811965  6326 raft_consensus.cc:515] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:38.818832  6129 ts_tablet_manager.cc:1434] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:15:38.819083  6326 leader_election.cc:290] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:38.820189  6143 raft_consensus.cc:493] T b75d901511f94357a67c07612cf07d1a P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.821058  6132 tablet_bootstrap.cc:492] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:38.821638  6132 ts_tablet_manager.cc:1403] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.002s
I20260709 12:15:38.823135  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d792c0dd53aa459399c3adf5d4f17f58" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
W20260709 12:15:38.824762  6049 leader_election.cc:343] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.824609  6132 raft_consensus.cc:359] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.820739  6143 raft_consensus.cc:515] T b75d901511f94357a67c07612cf07d1a P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.825354  6132 raft_consensus.cc:385] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.825691  6132 raft_consensus.cc:740] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.826613  6132 consensus_queue.cc:260] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.827215  6143 leader_election.cc:290] T b75d901511f94357a67c07612cf07d1a P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:38.829347  6132 ts_tablet_manager.cc:1434] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:15:38.830193  6129 tablet_bootstrap.cc:492] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:38.830657  6188 raft_consensus.cc:493] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.831147  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d792c0dd53aa459399c3adf5d4f17f58" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:38.832010  6188 raft_consensus.cc:515] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
W20260709 12:15:38.833015  6048 leader_election.cc:343] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.833514  6048 leader_election.cc:304] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:38.831267  6132 tablet_bootstrap.cc:492] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:38.835383  6326 raft_consensus.cc:2749] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:38.825464  6350 raft_consensus.cc:515] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:38.837422  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45528a8d878d46d89244614343fc6e90" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:38.837646  6188 leader_election.cc:290] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:38.838006  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75d901511f94357a67c07612cf07d1a" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:38.843206  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214f52126a2c4bc59473ee7461e4a044" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:38.843945  6128 tablet_bootstrap.cc:492] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:38.844568  6128 ts_tablet_manager.cc:1403] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.005s
W20260709 12:15:38.844879  5824 leader_election.cc:343] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.845036  6379 consensus_queue.cc:1048] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:15:38.850064  6128 raft_consensus.cc:359] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.850961  6128 raft_consensus.cc:385] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.851276  6128 raft_consensus.cc:740] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.840533  6350 leader_election.cc:290] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:38.854033  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75d901511f94357a67c07612cf07d1a" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:38.853818  5756 catalog_manager.cc:5697] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 1 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:38.854902  6083 raft_consensus.cc:2393] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26615d25670745d38490e2d6da247d9e in current term 1: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
I20260709 12:15:38.845677  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214f52126a2c4bc59473ee7461e4a044" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:38.857546  6129 tablet_bootstrap.cc:654] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.857039  6009 raft_consensus.cc:3060] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.852432  6128 consensus_queue.cc:260] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.861101  6128 ts_tablet_manager.cc:1434] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:15:38.865329  6353 raft_consensus.cc:2749] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:38.869001  6132 tablet_bootstrap.cc:654] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.871043  6326 raft_consensus.cc:493] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.871640  6326 raft_consensus.cc:515] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.873910  6326 leader_election.cc:290] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:38.874755  5899 leader_election.cc:304] T b75d901511f94357a67c07612cf07d1a P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:38.875108  6133 tablet_bootstrap.cc:492] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:38.875628  6133 ts_tablet_manager.cc:1403] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.118s	user 0.015s	sys 0.015s
I20260709 12:15:38.876652  6378 raft_consensus.cc:493] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.877198  6378 raft_consensus.cc:515] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:38.881029  6128 tablet_bootstrap.cc:492] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:38.883505  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45528a8d878d46d89244614343fc6e90" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:38.879748  6381 consensus_queue.cc:1048] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:15:38.886842  6143 raft_consensus.cc:3060] T b75d901511f94357a67c07612cf07d1a P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.895445  5758 catalog_manager.cc:5697] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:38.885530  5825 leader_election.cc:304] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:38.902033  6350 raft_consensus.cc:2749] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:38.906606  6378 leader_election.cc:290] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:38.907944  6143 raft_consensus.cc:2749] T b75d901511f94357a67c07612cf07d1a P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:38.911180  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec4d35ac70348cb95a01355320f5686" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:38.911569  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b081fa5436f34e5e9e477b502f689461" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:38.912604  6255 raft_consensus.cc:493] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.912744  6133 raft_consensus.cc:359] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
W20260709 12:15:38.913272  5973 leader_election.cc:343] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.913532  6133 raft_consensus.cc:385] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.913903  6133 raft_consensus.cc:740] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
W20260709 12:15:38.913980  6047 leader_election.cc:343] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.913347  6255 raft_consensus.cc:515] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.914834  6133 consensus_queue.cc:260] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.915153  5858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b081fa5436f34e5e9e477b502f689461" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:38.920859  6255 leader_election.cc:290] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:38.923452  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec4d35ac70348cb95a01355320f5686" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:38.926692  5858 raft_consensus.cc:3060] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.931689  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d852dc979f7843dcbf8477fc409c2c68" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:38.935166  6133 ts_tablet_manager.cc:1434] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.000s
I20260709 12:15:38.939877  6133 tablet_bootstrap.cc:492] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
W20260709 12:15:38.930034  5975 leader_election.cc:343] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.941371  5975 leader_election.cc:304] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
W20260709 12:15:38.943595  6047 leader_election.cc:343] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.944878  6129 tablet_bootstrap.cc:492] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:38.945338  6350 raft_consensus.cc:493] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.945851  6128 tablet_bootstrap.cc:654] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.946017  6350 raft_consensus.cc:515] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.945425  6129 ts_tablet_manager.cc:1403] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.115s	user 0.024s	sys 0.000s
I20260709 12:15:38.887499  6009 raft_consensus.cc:2468] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:38.948342  6378 raft_consensus.cc:2749] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:38.954442  6381 raft_consensus.cc:493] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.949873  6350 leader_election.cc:290] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:38.955274  5933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a260b81828b4baab927a2d3f2253be4" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:38.960587  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a260b81828b4baab927a2d3f2253be4" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:38.966571  5933 raft_consensus.cc:2468] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:38.966895  5824 leader_election.cc:304] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:38.967901  6350 raft_consensus.cc:2804] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:38.955305  6379 consensus_queue.cc:1048] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:15:38.968459  6350 raft_consensus.cc:697] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:38.968148  5825 leader_election.cc:304] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:38.956763  6381 raft_consensus.cc:515] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.970754  6188 raft_consensus.cc:2804] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:38.970597  6350 consensus_queue.cc:237] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:38.971238  6188 raft_consensus.cc:493] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.971683  6188 raft_consensus.cc:3060] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.972512  6381 leader_election.cc:290] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:38.973685  6326 raft_consensus.cc:493] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.973810  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc7520eb74c4882b7e36fda0f66ca0e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:38.974306  6326 raft_consensus.cc:515] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:38.975214  6129 raft_consensus.cc:359] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.975932  6129 raft_consensus.cc:385] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.976190  6129 raft_consensus.cc:740] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.976975  6129 consensus_queue.cc:260] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:38.986769  6133 tablet_bootstrap.cc:654] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.984823  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc7520eb74c4882b7e36fda0f66ca0e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:38.979357  6005 raft_consensus.cc:2468] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:38.989529  6083 raft_consensus.cc:2468] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
W20260709 12:15:38.985985  5974 leader_election.cc:343] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.994923  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d852dc979f7843dcbf8477fc409c2c68" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:38.999063  6129 ts_tablet_manager.cc:1434] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 12:15:39.000341  6129 tablet_bootstrap.cc:492] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
W20260709 12:15:38.983654  6048 leader_election.cc:343] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.991813  6188 raft_consensus.cc:515] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:39.001354  6048 leader_election.cc:304] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:38.998701  6326 leader_election.cc:290] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:39.005920  6200 raft_consensus.cc:2749] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:39.006582  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc7520eb74c4882b7e36fda0f66ca0e" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
W20260709 12:15:39.007395  6048 leader_election.cc:343] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.007477  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a260b81828b4baab927a2d3f2253be4" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:39.008119  6048 leader_election.cc:304] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:39.008157  6005 raft_consensus.cc:2468] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 0.
I20260709 12:15:39.008349  6007 raft_consensus.cc:3060] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.009761  6047 leader_election.cc:304] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:39.010170  5973 leader_election.cc:304] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:39.010795  6200 raft_consensus.cc:2749] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:39.011518  6255 raft_consensus.cc:2804] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:39.003816  6188 leader_election.cc:290] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:39.011991  6255 raft_consensus.cc:493] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.014955  6381 raft_consensus.cc:2804] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:39.018146  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a260b81828b4baab927a2d3f2253be4" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:39.021552  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc7520eb74c4882b7e36fda0f66ca0e" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:39.025661  5932 raft_consensus.cc:3060] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.018899  6381 raft_consensus.cc:493] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.036737  6381 raft_consensus.cc:3060] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.018857  6255 raft_consensus.cc:3060] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:39.060679  6048 leader_election.cc:343] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.065877  5757 catalog_manager.cc:5697] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:39.087224  6376 consensus_queue.cc:1048] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:39.090255  6378 raft_consensus.cc:493] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.090945  6378 raft_consensus.cc:515] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:39.093573  6378 leader_election.cc:290] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:39.097903  5856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e906733ca34216bf4664d81c7b19b2" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:39.098150  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e906733ca34216bf4664d81c7b19b2" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
W20260709 12:15:39.110697  5974 leader_election.cc:343] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.115906  6188 raft_consensus.cc:493] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.118645  6188 raft_consensus.cc:515] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:39.121371  6421 consensus_queue.cc:1048] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:15:39.122686  5975 leader_election.cc:343] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.123286  5975 leader_election.cc:304] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
W20260709 12:15:39.123423  5901 consensus_peers.cc:597] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:39.125447  6376 raft_consensus.cc:2749] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:39.129119  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:39.133478  6129 tablet_bootstrap.cc:654] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.132544  6188 leader_election.cc:290] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:39.141232  6007 raft_consensus.cc:2468] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:39.145124  6083 raft_consensus.cc:2468] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:39.173702  5932 raft_consensus.cc:2468] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:39.178491  6255 raft_consensus.cc:515] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:39.181811  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc7520eb74c4882b7e36fda0f66ca0e" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:39.182677  6381 raft_consensus.cc:515] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:39.185832  5931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc7520eb74c4882b7e36fda0f66ca0e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:39.187116  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc7520eb74c4882b7e36fda0f66ca0e" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:39.188097  6007 raft_consensus.cc:2393] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb in current term 1: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
I20260709 12:15:39.189321  5824 leader_election.cc:304] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:39.190745  5930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:39.211040  6350 raft_consensus.cc:2804] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:39.211760  6350 raft_consensus.cc:697] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:39.202646  6255 leader_election.cc:290] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:39.215085  6350 consensus_queue.cc:237] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
W20260709 12:15:39.209151  6048 leader_election.cc:343] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:39.219975  5974 leader_election.cc:343] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.220623  6128 tablet_bootstrap.cc:492] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:39.221262  6128 ts_tablet_manager.cc:1403] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.359s	user 0.012s	sys 0.028s
I20260709 12:15:39.222003  6381 leader_election.cc:290] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:39.224359  6047 leader_election.cc:304] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
W20260709 12:15:39.227521  5975 consensus_peers.cc:597] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:39.228885  6255 raft_consensus.cc:2749] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:39.229322  6378 consensus_queue.cc:1048] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:39.230855  5824 leader_election.cc:304] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:39.232096  6227 raft_consensus.cc:2804] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:39.232512  6227 raft_consensus.cc:493] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.232851  6227 raft_consensus.cc:3060] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.244561  6129 tablet_bootstrap.cc:492] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:39.245471  6129 ts_tablet_manager.cc:1403] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.245s	user 0.021s	sys 0.000s
I20260709 12:15:39.248965  6128 raft_consensus.cc:359] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
W20260709 12:15:39.251395  5825 leader_election.cc:343] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.260674  6132 tablet_bootstrap.cc:492] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:39.260674  6133 tablet_bootstrap.cc:492] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:39.261368  6132 ts_tablet_manager.cc:1403] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.430s	user 0.014s	sys 0.022s
I20260709 12:15:39.261778  6133 ts_tablet_manager.cc:1403] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.325s	user 0.005s	sys 0.017s
I20260709 12:15:39.267894  6133 raft_consensus.cc:359] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:39.262880  6129 raft_consensus.cc:359] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:39.268808  6133 raft_consensus.cc:385] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.268970  6129 raft_consensus.cc:385] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.269484  6129 raft_consensus.cc:740] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.250133  6128 raft_consensus.cc:385] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.269161  6133 raft_consensus.cc:740] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.270915  6128 raft_consensus.cc:740] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.271507  6129 consensus_queue.cc:260] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:39.273850  6132 raft_consensus.cc:359] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:39.275260  6132 raft_consensus.cc:385] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.273800  6133 consensus_queue.cc:260] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:39.276054  6132 raft_consensus.cc:740] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.275219  6128 consensus_queue.cc:260] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:39.277431  6132 consensus_queue.cc:260] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:39.283494  6129 ts_tablet_manager.cc:1434] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.005s
I20260709 12:15:39.284710  6129 tablet_bootstrap.cc:492] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:39.286262  6132 ts_tablet_manager.cc:1434] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.004s
I20260709 12:15:39.287170  6132 tablet_bootstrap.cc:492] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:39.289914  6133 ts_tablet_manager.cc:1434] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 12:15:39.291999  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc7520eb74c4882b7e36fda0f66ca0e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:39.292357  6133 tablet_bootstrap.cc:492] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:39.293095  6079 raft_consensus.cc:2393] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 1: Already voted for candidate 36dfe581d09b46f6a9bfe678170e71cb in this term.
I20260709 12:15:39.300105  6128 ts_tablet_manager.cc:1434] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.001s
I20260709 12:15:39.301252  6128 tablet_bootstrap.cc:492] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:39.304327  6133 tablet_bootstrap.cc:654] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.331275  5973 leader_election.cc:304] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:39.332795  6129 tablet_bootstrap.cc:654] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.355901  6227 raft_consensus.cc:515] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:39.358459  6227 leader_election.cc:290] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:39.360004  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:39.349390  6350 raft_consensus.cc:493] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.368222  6132 tablet_bootstrap.cc:654] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.368397  6128 tablet_bootstrap.cc:654] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.369223  5932 raft_consensus.cc:3060] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.374174  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:39.374974  6080 raft_consensus.cc:3060] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.370668  6350 raft_consensus.cc:515] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:39.381449  6436 raft_consensus.cc:2749] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:39.387486  5756 catalog_manager.cc:5697] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:39.405543  6350 leader_election.cc:290] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:39.406584  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353bf2c0ce2c412e9ca171f2bb150f91" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:39.410159  6133 tablet_bootstrap.cc:492] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:39.410859  6133 ts_tablet_manager.cc:1403] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.120s	user 0.024s	sys 0.014s
I20260709 12:15:39.417599  6133 raft_consensus.cc:359] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:39.418526  6133 raft_consensus.cc:385] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.418910  6133 raft_consensus.cc:740] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.419682  6133 consensus_queue.cc:260] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:39.422010  6133 ts_tablet_manager.cc:1434] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:15:39.423344  6133 tablet_bootstrap.cc:492] T d852dc979f7843dcbf8477fc409c2c68 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:39.427862  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353bf2c0ce2c412e9ca171f2bb150f91" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:39.430174  5825 leader_election.cc:304] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:39.431876  6184 raft_consensus.cc:2749] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:39.444428  6133 tablet_bootstrap.cc:654] T d852dc979f7843dcbf8477fc409c2c68 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.416409  6080 raft_consensus.cc:2468] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:39.468196  5824 leader_election.cc:304] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:39.484242  6128 tablet_bootstrap.cc:492] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:39.484933  6128 ts_tablet_manager.cc:1403] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.184s	user 0.010s	sys 0.009s
I20260709 12:15:39.484810  5932 raft_consensus.cc:2468] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:39.488327  6128 raft_consensus.cc:359] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:39.489197  6128 raft_consensus.cc:385] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.489835  6128 raft_consensus.cc:740] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.490584  6128 consensus_queue.cc:260] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:39.493006  6128 ts_tablet_manager.cc:1434] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:39.494104  6128 tablet_bootstrap.cc:492] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:39.500581  6350 raft_consensus.cc:2804] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:39.501504  6350 raft_consensus.cc:697] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:39.505378  6128 tablet_bootstrap.cc:654] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.489404  6080 raft_consensus.cc:3060] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.519708  6343 raft_consensus.cc:493] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.520632  6343 raft_consensus.cc:515] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:39.524294  6343 leader_election.cc:290] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:39.533027  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc7520eb74c4882b7e36fda0f66ca0e" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:39.534332  6005 raft_consensus.cc:2393] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26615d25670745d38490e2d6da247d9e in current term 1: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
I20260709 12:15:39.541694  6439 raft_consensus.cc:493] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.542306  6439 raft_consensus.cc:515] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:39.534360  6227 raft_consensus.cc:493] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.545892  6227 raft_consensus.cc:515] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:39.549887  6227 leader_election.cc:290] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:39.551851  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d792c0dd53aa459399c3adf5d4f17f58" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:39.552655  6083 raft_consensus.cc:2468] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:39.502857  6350 consensus_queue.cc:237] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:39.553442  6326 raft_consensus.cc:493] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.554134  6326 raft_consensus.cc:515] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:39.556301  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d792c0dd53aa459399c3adf5d4f17f58" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:39.556782  6439 leader_election.cc:290] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:39.555347  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc7520eb74c4882b7e36fda0f66ca0e" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:39.559304  6081 raft_consensus.cc:2393] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26615d25670745d38490e2d6da247d9e in current term 1: Already voted for candidate 36dfe581d09b46f6a9bfe678170e71cb in this term.
I20260709 12:15:39.561311  5930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d852dc979f7843dcbf8477fc409c2c68" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
W20260709 12:15:39.563418  5974 leader_election.cc:343] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.564688  5824 leader_election.cc:304] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:39.565723  6188 consensus_queue.cc:1048] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:39.566646  6227 raft_consensus.cc:2804] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:39.567122  6227 raft_consensus.cc:493] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.567487  6227 raft_consensus.cc:3060] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.569213  6129 tablet_bootstrap.cc:492] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:39.569738  6129 ts_tablet_manager.cc:1403] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.285s	user 0.021s	sys 0.027s
I20260709 12:15:39.584461  5899 leader_election.cc:304] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:39.585786  6421 raft_consensus.cc:3060] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.586560  6132 tablet_bootstrap.cc:492] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:39.587317  6132 ts_tablet_manager.cc:1403] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.300s	user 0.045s	sys 0.028s
W20260709 12:15:39.575388  5825 leader_election.cc:343] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.601148  6133 tablet_bootstrap.cc:492] T d852dc979f7843dcbf8477fc409c2c68 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:39.601956  6133 ts_tablet_manager.cc:1403] T d852dc979f7843dcbf8477fc409c2c68 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.179s	user 0.044s	sys 0.023s
I20260709 12:15:39.604966  6133 raft_consensus.cc:359] T d852dc979f7843dcbf8477fc409c2c68 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:39.605667  6133 raft_consensus.cc:385] T d852dc979f7843dcbf8477fc409c2c68 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.607172  6132 raft_consensus.cc:359] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:39.607975  6132 raft_consensus.cc:385] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.608246  6132 raft_consensus.cc:740] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.608966  6132 consensus_queue.cc:260] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:39.609583  6326 leader_election.cc:290] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:39.605964  6188 consensus_queue.cc:1048] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:15:39.611994  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214f52126a2c4bc59473ee7461e4a044" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:39.612732  6007 raft_consensus.cc:2468] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:39.614220  6047 leader_election.cc:304] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:39.618845  6132 ts_tablet_manager.cc:1434] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:15:39.620023  6132 tablet_bootstrap.cc:492] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:39.623466  6421 raft_consensus.cc:2749] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:39.625806  6128 tablet_bootstrap.cc:492] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:39.626428  6128 ts_tablet_manager.cc:1403] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.133s	user 0.006s	sys 0.028s
I20260709 12:15:39.605962  6133 raft_consensus.cc:740] T d852dc979f7843dcbf8477fc409c2c68 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.629362  6128 raft_consensus.cc:359] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:39.627779  6133 consensus_queue.cc:260] T d852dc979f7843dcbf8477fc409c2c68 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:39.630247  6128 raft_consensus.cc:385] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.631242  6128 raft_consensus.cc:740] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.634979  6128 consensus_queue.cc:260] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:39.639146  6128 ts_tablet_manager.cc:1434] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:15:39.640547  6128 tablet_bootstrap.cc:492] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:39.641036  6132 tablet_bootstrap.cc:654] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.646251  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d852dc979f7843dcbf8477fc409c2c68" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:39.647082  6083 raft_consensus.cc:2468] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:39.647682  6227 raft_consensus.cc:515] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:39.671877  6129 raft_consensus.cc:359] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:39.672395  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d792c0dd53aa459399c3adf5d4f17f58" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:39.668596  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214f52126a2c4bc59473ee7461e4a044" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:39.673624  5973 leader_election.cc:304] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
W20260709 12:15:39.674225  5825 leader_election.cc:343] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.674873  6227 leader_election.cc:290] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:39.662911  6132 tablet_bootstrap.cc:492] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:39.662885  6326 raft_consensus.cc:2804] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:39.676607  6432 raft_consensus.cc:2804] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:39.677130  6432 raft_consensus.cc:493] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.677500  6432 raft_consensus.cc:3060] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.668545  5856 raft_consensus.cc:3060] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.681988  6326 raft_consensus.cc:493] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:39.682672  6326 raft_consensus.cc:3060] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:39.686050  6128 tablet_bootstrap.cc:654] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.676607  6132 ts_tablet_manager.cc:1403] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.005s
I20260709 12:15:39.672739  6129 raft_consensus.cc:385] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.690713  6129 raft_consensus.cc:740] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.693377  6132 raft_consensus.cc:359] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:39.694170  6132 raft_consensus.cc:385] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.694495  6132 raft_consensus.cc:740] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.695247  6132 consensus_queue.cc:260] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:39.696013  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d792c0dd53aa459399c3adf5d4f17f58" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:39.696696  6083 raft_consensus.cc:3060] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.697016  6132 ts_tablet_manager.cc:1434] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:15:39.698087  6132 tablet_bootstrap.cc:492] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:39.710202  6129 consensus_queue.cc:260] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:39.716882  6432 raft_consensus.cc:515] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:39.650592  6133 ts_tablet_manager.cc:1434] T d852dc979f7843dcbf8477fc409c2c68 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.001s
I20260709 12:15:39.714152  6083 raft_consensus.cc:2468] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:39.725548  6129 ts_tablet_manager.cc:1434] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.156s	user 0.007s	sys 0.001s
I20260709 12:15:39.719295  5756 catalog_manager.cc:5697] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:39.790166  6129 tablet_bootstrap.cc:492] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:39.785368  6453 consensus_queue.cc:1048] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:15:39.792140  6133 tablet_bootstrap.cc:492] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:39.793325  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d852dc979f7843dcbf8477fc409c2c68" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:39.795691  5932 raft_consensus.cc:3060] T d852dc979f7843dcbf8477fc409c2c68 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.794634  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d852dc979f7843dcbf8477fc409c2c68" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:39.797924  6079 raft_consensus.cc:3060] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.725672  6132 tablet_bootstrap.cc:654] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.799753  6200 raft_consensus.cc:493] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:39.758406  5806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:39.800356  6200 raft_consensus.cc:515] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:39.802701  6129 tablet_bootstrap.cc:654] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.773856  6128 tablet_bootstrap.cc:492] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:39.806308  6128 ts_tablet_manager.cc:1403] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.166s	user 0.011s	sys 0.006s
I20260709 12:15:39.794817  5824 leader_election.cc:304] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:39.808826  6200 leader_election.cc:290] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:39.810653  6128 raft_consensus.cc:359] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:39.811587  6128 raft_consensus.cc:385] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.812006  6128 raft_consensus.cc:740] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.812916  6128 consensus_queue.cc:260] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:39.813552  6200 raft_consensus.cc:493] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.814146  6200 raft_consensus.cc:515] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:39.816722  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb1760bd0ba436eb7077c60542c0a45" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:39.818431  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb1760bd0ba436eb7077c60542c0a45" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
W20260709 12:15:39.818817  6047 leader_election.cc:343] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.820549  6200 leader_election.cc:290] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
W20260709 12:15:39.821442  6048 leader_election.cc:343] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.821970  6048 leader_election.cc:304] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:39.824122  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500f59123914ed198a39756117b4110" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
W20260709 12:15:39.825979  6048 leader_election.cc:343] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.826862  6200 raft_consensus.cc:2749] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:39.828073  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500f59123914ed198a39756117b4110" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:39.828359  6453 consensus_queue.cc:1048] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:39.837363  6128 ts_tablet_manager.cc:1434] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:15:39.838824  6128 tablet_bootstrap.cc:492] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
W20260709 12:15:39.841914  6049 leader_election.cc:343] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.844132  6049 leader_election.cc:304] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
W20260709 12:15:39.849238  5824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 54512.3us
I20260709 12:15:39.860677  6133 tablet_bootstrap.cc:654] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.864144  6079 raft_consensus.cc:2468] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:39.849659  6432 leader_election.cc:290] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:39.759912  6326 raft_consensus.cc:515] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:39.851982  6200 raft_consensus.cc:2749] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:39.851742  6453 raft_consensus.cc:2804] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:39.871686  6081 raft_consensus.cc:1240] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Rejecting Update request from peer 58ed30c66c784e06ad64609f8d1b4c43 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:39.869166  5973 leader_election.cc:304] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:39.891485  6129 tablet_bootstrap.cc:492] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:39.892369  6129 ts_tablet_manager.cc:1403] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.103s	user 0.004s	sys 0.015s
I20260709 12:15:39.884064  6453 raft_consensus.cc:697] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:39.903383  6453 consensus_queue.cc:237] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:39.905453  5932 raft_consensus.cc:2468] T d852dc979f7843dcbf8477fc409c2c68 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:39.908783  6326 leader_election.cc:290] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:39.911284  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214f52126a2c4bc59473ee7461e4a044" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:39.897145  6432 raft_consensus.cc:2804] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:39.933605  6432 raft_consensus.cc:697] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:39.934932  6432 consensus_queue.cc:237] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:39.964418  6132 tablet_bootstrap.cc:492] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:39.965143  6132 ts_tablet_manager.cc:1403] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.267s	user 0.023s	sys 0.012s
I20260709 12:15:39.981091  6129 raft_consensus.cc:359] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:39.990111  6129 raft_consensus.cc:385] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.996680  6129 raft_consensus.cc:740] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.994789  6128 tablet_bootstrap.cc:654] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.992885  6132 raft_consensus.cc:359] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:39.997959  6132 raft_consensus.cc:385] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.998433  6132 raft_consensus.cc:740] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:40.000098  6129 consensus_queue.cc:260] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:40.005403  6132 consensus_queue.cc:260] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:40.016660  6129 ts_tablet_manager.cc:1434] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.124s	user 0.008s	sys 0.003s
I20260709 12:15:40.019277  6129 tablet_bootstrap.cc:492] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:40.038134  6132 ts_tablet_manager.cc:1434] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.073s	user 0.010s	sys 0.000s
I20260709 12:15:40.039968  6132 tablet_bootstrap.cc:492] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
W20260709 12:15:40.129976  6457 log.cc:927] Time spent T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:15:40.075152  6452 log.cc:927] Time spent T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:15:40.134677  6133 tablet_bootstrap.cc:492] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:40.136842  6133 ts_tablet_manager.cc:1403] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.345s	user 0.023s	sys 0.019s
I20260709 12:15:40.141597  6132 tablet_bootstrap.cc:654] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:40.147547  6381 raft_consensus.cc:493] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.155314  6381 raft_consensus.cc:515] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:40.172730  6381 leader_election.cc:290] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:40.172957  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43bf33a33b443ba5cf0cdcb741f5fa" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:40.184578  6128 tablet_bootstrap.cc:492] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:40.185288  6128 ts_tablet_manager.cc:1403] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.347s	user 0.017s	sys 0.012s
I20260709 12:15:40.188532  6128 raft_consensus.cc:359] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:40.189421  6128 raft_consensus.cc:385] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:40.189880  6128 raft_consensus.cc:740] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:40.190774  6128 consensus_queue.cc:260] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:40.193840  6128 ts_tablet_manager.cc:1434] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:15:40.194685  6079 raft_consensus.cc:2468] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:40.195206  6128 tablet_bootstrap.cc:492] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:40.197073  5973 leader_election.cc:304] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:40.204809  6381 raft_consensus.cc:2804] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:40.204975  6128 tablet_bootstrap.cc:654] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:40.205299  6381 raft_consensus.cc:493] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:40.205674  6381 raft_consensus.cc:3060] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:40.207522  6133 raft_consensus.cc:359] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:40.208611  6133 raft_consensus.cc:385] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:40.208961  6133 raft_consensus.cc:740] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:40.209903  6133 consensus_queue.cc:260] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:40.223784  6129 tablet_bootstrap.cc:654] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:40.231156  6133 ts_tablet_manager.cc:1434] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.094s	user 0.010s	sys 0.000s
I20260709 12:15:40.232925  6128 tablet_bootstrap.cc:492] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:40.233089  6133 tablet_bootstrap.cc:492] T a6e906733ca34216bf4664d81c7b19b2 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:40.233572  6128 ts_tablet_manager.cc:1403] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.016s
I20260709 12:15:40.265777  6128 raft_consensus.cc:359] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:40.266757  6128 raft_consensus.cc:385] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:40.267102  6128 raft_consensus.cc:740] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:40.267894  6128 consensus_queue.cc:260] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:40.327185  6184 raft_consensus.cc:493] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.334654  6128 ts_tablet_manager.cc:1434] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.101s	user 0.010s	sys 0.000s
I20260709 12:15:40.340112  6128 tablet_bootstrap.cc:492] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:40.327996  6184 raft_consensus.cc:515] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:40.363950  6132 tablet_bootstrap.cc:492] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:40.375480  5854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214f52126a2c4bc59473ee7461e4a044" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:40.441883  6468 raft_consensus.cc:493] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.442663  6468 raft_consensus.cc:515] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:40.445938  6468 leader_election.cc:290] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:40.924243  5860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43bf33a33b443ba5cf0cdcb741f5fa" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
W20260709 12:15:40.926369  5975 leader_election.cc:343] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.010910  6470 raft_consensus.cc:493] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.011732  6470 raft_consensus.cc:515] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:41.015061  6470 leader_election.cc:290] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:41.021476  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e906733ca34216bf4664d81c7b19b2" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.022466  5859 raft_consensus.cc:2468] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:41.047992  6470 raft_consensus.cc:493] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.048842  6470 raft_consensus.cc:515] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:41.051499  6470 leader_election.cc:290] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
W20260709 12:15:41.052361  5900 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.000s	sys 0.011s
I20260709 12:15:41.052903  5975 leader_election.cc:304] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:41.054454  6471 raft_consensus.cc:493] T c9a66f01ced34c71b061ec163494f2b6 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e29106aa83aa4eebb9b87d6745825a27)
I20260709 12:15:41.055166  6471 raft_consensus.cc:515] T c9a66f01ced34c71b061ec163494f2b6 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:41.056825  6476 raft_consensus.cc:493] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36dfe581d09b46f6a9bfe678170e71cb)
I20260709 12:15:41.057580  6471 leader_election.cc:290] T c9a66f01ced34c71b061ec163494f2b6 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:41.057433  6476 raft_consensus.cc:515] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
W20260709 12:15:41.052918  5900 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.000s	sys 0.012s
I20260709 12:15:41.058761  6470 raft_consensus.cc:2804] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:41.059165  6470 raft_consensus.cc:493] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.059500  6470 raft_consensus.cc:3060] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:41.062258  6478 raft_consensus.cc:493] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:41.063113  6478 raft_consensus.cc:515] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:40.364843  6132 ts_tablet_manager.cc:1403] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.325s	user 0.015s	sys 0.003s
I20260709 12:15:41.070976  6470 raft_consensus.cc:515] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:41.074559  6470 leader_election.cc:290] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:41.074069  6132 raft_consensus.cc:359] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:41.075894  6132 raft_consensus.cc:385] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.076429  6132 raft_consensus.cc:740] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.077567  6470 raft_consensus.cc:493] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.078301  6470 raft_consensus.cc:515] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:41.077877  6132 consensus_queue.cc:260] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:41.080408  6479 raft_consensus.cc:493] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.081350  6132 ts_tablet_manager.cc:1434] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:15:41.081090  6479 raft_consensus.cc:515] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
W20260709 12:15:41.076426  6381 consensus_meta.cc:287] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27: Time spent flushing consensus metadata: real 0.870s	user 0.019s	sys 0.005s
I20260709 12:15:41.082616  6132 tablet_bootstrap.cc:492] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:41.082960  6381 raft_consensus.cc:515] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:41.085608  6381 leader_election.cc:290] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:41.086031  6470 leader_election.cc:290] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:41.086472  6381 raft_consensus.cc:493] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.087034  6381 raft_consensus.cc:515] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:41.088163  6479 leader_election.cc:290] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:41.090631  6381 leader_election.cc:290] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:41.091943  6450 raft_consensus.cc:493] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.092756  6132 tablet_bootstrap.cc:654] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.092523  6450 raft_consensus.cc:515] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:41.103061  6132 tablet_bootstrap.cc:492] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:41.103825  6132 ts_tablet_manager.cc:1403] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.005s
I20260709 12:15:41.107467  6132 raft_consensus.cc:359] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:41.108261  6132 raft_consensus.cc:385] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.108556  6132 raft_consensus.cc:740] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.109264  6132 consensus_queue.cc:260] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:41.109787  6133 tablet_bootstrap.cc:654] T a6e906733ca34216bf4664d81c7b19b2 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.113229  6478 leader_election.cc:290] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:41.113529  6129 tablet_bootstrap.cc:492] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
W20260709 12:15:41.160533  5899 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.005s	sys 0.006s
W20260709 12:15:41.161690  5899 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.006s	sys 0.006s
I20260709 12:15:41.177544  6439 raft_consensus.cc:493] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.178278  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e906733ca34216bf4664d81c7b19b2" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:41.180024  5859 raft_consensus.cc:3060] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:41.180042  6432 raft_consensus.cc:493] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:41.180667  6471 raft_consensus.cc:493] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e29106aa83aa4eebb9b87d6745825a27)
I20260709 12:15:41.179692  6439 raft_consensus.cc:515] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:41.187275  5856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37678 (request call id 47) took 1519 ms. Trace:
I20260709 12:15:41.114069  6129 ts_tablet_manager.cc:1403] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 1.096s	user 0.018s	sys 0.008s
I20260709 12:15:41.185947  6472 raft_consensus.cc:493] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e29106aa83aa4eebb9b87d6745825a27)
I20260709 12:15:41.193620  6472 raft_consensus.cc:515] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:41.187264  6477 raft_consensus.cc:493] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:41.196383  6477 raft_consensus.cc:515] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:41.188073  5856 rpcz_store.cc:276] 0709 12:15:39.667657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:39.667838 (+   181us) service_pool.cc:224] Handling call
0709 12:15:39.668354 (+   516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:39.691664 (+ 23310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:39.691704 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:39.692189 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 12:15:39.890174 (+197985us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:41.045856 (+1155682us) log.cc:844] Serialized 14 byte log entry
0709 12:15:41.170120 (+124264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:41.172490 (+  2370us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:41.176905 (+  4415us) raft_consensus.cc:1685] finished
0709 12:15:41.176937 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:41.186982 (+ 10045us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3534,"prepare.queue_time_us":4993,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":4833,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":108,"spinlock_wait_cycles":100736,"thread_start_us":312961,"threads_started":3,"wal-append.queue_time_us":311760}
I20260709 12:15:41.198069  6472 leader_election.cc:290] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:41.182382  6471 raft_consensus.cc:515] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:41.208593  6471 leader_election.cc:290] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:41.181432  6432 raft_consensus.cc:515] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:41.213160  6432 leader_election.cc:290] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:41.213621  6004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e906733ca34216bf4664d81c7b19b2" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:41.218681  6481 raft_consensus.cc:493] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.199326  6477 leader_election.cc:290] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:41.223342  6004 raft_consensus.cc:2393] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ed30c66c784e06ad64609f8d1b4c43 in current term 1: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
I20260709 12:15:41.223886  5858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b081fa5436f34e5e9e477b502f689461" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.224514  6381 raft_consensus.cc:493] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.225703  5855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43bf33a33b443ba5cf0cdcb741f5fa" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:41.227039  5856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df660011133455e8ede132d5d56c48f" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.233839  6353 raft_consensus.cc:493] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:41.247469  6353 raft_consensus.cc:515] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:41.250501  6479 raft_consensus.cc:493] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:41.250957  6481 raft_consensus.cc:515] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:41.251818  6479 raft_consensus.cc:515] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:41.256726  6478 raft_consensus.cc:493] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:41.258205  6478 raft_consensus.cc:515] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:41.247736  6381 raft_consensus.cc:515] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:41.268791  6132 ts_tablet_manager.cc:1434] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.165s	user 0.009s	sys 0.000s
I20260709 12:15:41.269616  6439 leader_election.cc:290] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:41.270792  6477 raft_consensus.cc:493] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e29106aa83aa4eebb9b87d6745825a27)
I20260709 12:15:41.271893  6477 raft_consensus.cc:515] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:41.272550  6481 leader_election.cc:290] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:41.272718  6472 raft_consensus.cc:493] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:41.273332  6481 raft_consensus.cc:493] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.273540  6133 tablet_bootstrap.cc:492] T a6e906733ca34216bf4664d81c7b19b2 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:41.274335  6481 raft_consensus.cc:515] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:41.276396  6477 leader_election.cc:290] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:41.277899  6132 tablet_bootstrap.cc:492] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:41.278625  5858 raft_consensus.cc:2468] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:41.285751  6381 leader_election.cc:290] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:41.289371  6487 raft_consensus.cc:493] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.273725  6472 raft_consensus.cc:515] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:41.302095  6484 raft_consensus.cc:493] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.303246  6484 raft_consensus.cc:515] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
W20260709 12:15:41.320632  5975 leader_election.cc:343] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.327582  6381 raft_consensus.cc:493] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.329039  6381 raft_consensus.cc:515] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:41.331631  6485 raft_consensus.cc:493] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:41.332056  6132 tablet_bootstrap.cc:654] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.333633  6133 ts_tablet_manager.cc:1403] T a6e906733ca34216bf4664d81c7b19b2 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 1.101s	user 0.029s	sys 0.004s
I20260709 12:15:41.333062  6485 raft_consensus.cc:515] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:41.335289  6479 leader_election.cc:290] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:41.336623  6485 leader_election.cc:290] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:41.337622  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7299ddfb5eb4240b757da7c444170c9" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
W20260709 12:15:41.313768  5824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 74048.4us
I20260709 12:15:41.344820  5931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e906733ca34216bf4664d81c7b19b2" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:41.345924  6470 raft_consensus.cc:493] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:41.339056  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd00b832aafb491387eee88b954ff5df" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:41.346293  5975 leader_election.cc:304] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:41.349687  6485 raft_consensus.cc:493] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:41.352430  6488 raft_consensus.cc:493] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.352906  6129 raft_consensus.cc:359] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:41.349785  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e906733ca34216bf4664d81c7b19b2" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:41.347194  5859 raft_consensus.cc:2468] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:41.348022  6353 leader_election.cc:290] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:41.357684  6486 raft_consensus.cc:493] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:41.359198  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e5dfe30b74c94b9753cf4c647695f" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:41.358979  6133 raft_consensus.cc:359] T a6e906733ca34216bf4664d81c7b19b2 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:41.367827  6486 raft_consensus.cc:515] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:41.368459  6133 raft_consensus.cc:385] T a6e906733ca34216bf4664d81c7b19b2 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.368790  6133 raft_consensus.cc:740] T a6e906733ca34216bf4664d81c7b19b2 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.369257  5928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dad9466c8e40558116511df4c6330e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:41.369661  6133 consensus_queue.cc:260] T a6e906733ca34216bf4664d81c7b19b2 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:41.360085  6128 tablet_bootstrap.cc:654] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.371903  6486 leader_election.cc:290] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:41.372783  6470 raft_consensus.cc:515] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:41.374650  5932 raft_consensus.cc:2468] T a6e906733ca34216bf4664d81c7b19b2 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:41.338071  6481 leader_election.cc:290] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:41.361963  6129 raft_consensus.cc:385] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.364509  6488 raft_consensus.cc:515] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:41.376284  6481 raft_consensus.cc:493] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:41.376379  6129 raft_consensus.cc:740] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.377266  6481 raft_consensus.cc:515] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:41.377674  6129 consensus_queue.cc:260] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:41.380300  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:41.385795  6493 raft_consensus.cc:493] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
W20260709 12:15:41.367234  5956 debug-util.cc:398] Leaking SignalData structure 0x7b08002e9e00 after lost signal to thread 25296
I20260709 12:15:41.387212  6133 ts_tablet_manager.cc:1434] T a6e906733ca34216bf4664d81c7b19b2 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.006s
I20260709 12:15:41.398502  6491 raft_consensus.cc:493] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.399778  6491 raft_consensus.cc:515] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:41.403554  6491 leader_election.cc:290] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:41.404407  6491 raft_consensus.cc:493] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.405267  6491 raft_consensus.cc:515] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:41.364485  6485 raft_consensus.cc:515] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:41.295805  6487 raft_consensus.cc:515] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:41.411960  6471 raft_consensus.cc:493] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.386960  6488 leader_election.cc:290] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:41.418356  6479 raft_consensus.cc:2804] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:41.426084  5930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c20504b20bf4686afff8a8417bdc035" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:41.426826  6133 tablet_bootstrap.cc:492] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:41.426162  5928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc7520eb74c4882b7e36fda0f66ca0e" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:41.419262  6439 raft_consensus.cc:493] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.434016  5928 raft_consensus.cc:2468] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:41.434551  6439 raft_consensus.cc:515] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:41.435452  6381 leader_election.cc:290] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:41.427326  6453 raft_consensus.cc:493] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.436740  6453 raft_consensus.cc:515] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:41.437388  6439 leader_election.cc:290] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:41.438479  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43bf33a33b443ba5cf0cdcb741f5fa" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:41.439044  6476 leader_election.cc:290] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:41.439392  6081 raft_consensus.cc:3060] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:41.425455  6491 leader_election.cc:290] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:41.431509  6129 ts_tablet_manager.cc:1434] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.174s	user 0.005s	sys 0.009s
I20260709 12:15:41.440455  6484 leader_election.cc:290] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:41.441350  6470 leader_election.cc:290] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:41.442113  6129 tablet_bootstrap.cc:492] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:41.444847  6450 leader_election.cc:290] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:41.446175  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7299ddfb5eb4240b757da7c444170c9" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.446869  6485 leader_election.cc:290] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:41.447206  6079 raft_consensus.cc:2468] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:41.447876  6471 raft_consensus.cc:515] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:41.433054  6353 raft_consensus.cc:493] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.451633  6488 raft_consensus.cc:493] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.451418  6353 raft_consensus.cc:515] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:41.452447  6488 raft_consensus.cc:515] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:41.453038  6472 leader_election.cc:290] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:41.444748  6481 leader_election.cc:290] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:41.432552  6350 raft_consensus.cc:493] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
W20260709 12:15:41.454604  5956 debug-util.cc:398] Leaking SignalData structure 0x7b08002ea060 after lost signal to thread 5756
W20260709 12:15:41.455204  5956 debug-util.cc:398] Leaking SignalData structure 0x7b08002ea0a0 after lost signal to thread 5758
I20260709 12:15:41.455009  6350 raft_consensus.cc:515] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:41.456032  6078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c20504b20bf4686afff8a8417bdc035" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.457026  6078 raft_consensus.cc:2468] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:41.457952  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a66f01ced34c71b061ec163494f2b6" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.458346  5858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687e45fe6f3444c794271e801c21280d" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.459072  5856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dad9466c8e40558116511df4c6330e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.459722  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b081fa5436f34e5e9e477b502f689461" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.461005  5975 leader_election.cc:304] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:41.459753  5856 raft_consensus.cc:2468] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:41.461738  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df660011133455e8ede132d5d56c48f" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.462800  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd00b832aafb491387eee88b954ff5df" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.463804  6079 raft_consensus.cc:2468] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:41.466480  6184 leader_election.cc:290] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:41.467044  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873d3215e6ba4214a3910fa16e0fd62a" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.467404  6353 leader_election.cc:290] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:41.454818  6481 raft_consensus.cc:493] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.469497  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972a71bd13ef4022b6966d1287868dc4" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.471462  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.468530  6481 raft_consensus.cc:515] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
W20260709 12:15:41.456306  5956 debug-util.cc:398] Leaking SignalData structure 0x7b08002ea4e0 after lost signal to thread 5792
I20260709 12:15:41.476009  6078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873d3215e6ba4214a3910fa16e0fd62a" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.476600  6487 leader_election.cc:290] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:41.477465  6471 leader_election.cc:290] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:41.477674  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e5dfe30b74c94b9753cf4c647695f" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.478451  6481 leader_election.cc:290] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:41.479154  6488 leader_election.cc:290] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:41.479311  6481 raft_consensus.cc:493] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.430930  6479 raft_consensus.cc:493] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.480898  6479 raft_consensus.cc:3060] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:41.480360  6481 raft_consensus.cc:515] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:41.483181  6481 leader_election.cc:290] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:41.479955  6488 raft_consensus.cc:493] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.486536  6081 raft_consensus.cc:2468] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:41.487023  6488 raft_consensus.cc:515] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:41.489609  6488 leader_election.cc:290] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:41.489856  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687e45fe6f3444c794271e801c21280d" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
W20260709 12:15:41.491400  5956 debug-util.cc:398] Leaking SignalData structure 0x7b0800193200 after lost signal to thread 5884
I20260709 12:15:41.491573  6476 raft_consensus.cc:493] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:41.491911  5956 debug-util.cc:398] Leaking SignalData structure 0x7b08001fe020 after lost signal to thread 5885
I20260709 12:15:41.492417  6476 raft_consensus.cc:515] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:41.493942  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f23027ce3e4c149ba8309105929682" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.495572  6476 leader_election.cc:290] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:41.496686  6049 leader_election.cc:304] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:41.498041  5854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972a71bd13ef4022b6966d1287868dc4" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.502496  5973 leader_election.cc:304] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:41.503187  6481 raft_consensus.cc:2749] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.503554  5854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12649b3d49a4a309d961106ba152892" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.504545  5854 raft_consensus.cc:2468] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 0.
I20260709 12:15:41.506630  5858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32e2e4b0423a493e8f0d323065688bd1" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.509191  5854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48d13e87f1d4964bb74ba350c2e2df5" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.516595  6381 raft_consensus.cc:493] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.457823  6350 leader_election.cc:290] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:41.522922  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a474468455492f992eb8dfefad0ca2" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.525089  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0484fe261cb3459cb6a2f532f88c0845" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.526829  6432 raft_consensus.cc:2804] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:41.527275  6478 leader_election.cc:290] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:41.527704  6381 raft_consensus.cc:515] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:41.528262  5856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35395bd69ad41f0b37fd3edca49777c" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.439476  6453 leader_election.cc:290] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:41.518234  5930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:41.511507  6489 raft_consensus.cc:493] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:41.527329  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a260b81828b4baab927a2d3f2253be4" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.536340  5860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba593a994ff44d7866a70004fd0a946" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.417798  6493 raft_consensus.cc:515] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:41.538434  5754 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36596 (request call id 58) took 1772 ms. Trace:
I20260709 12:15:41.538617  6079 raft_consensus.cc:2468] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:41.539307  6470 raft_consensus.cc:2804] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.538924  6489 raft_consensus.cc:515] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:41.539790  6470 raft_consensus.cc:493] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.540045  6493 leader_election.cc:290] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:41.540274  6470 raft_consensus.cc:3060] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.540529  6083 raft_consensus.cc:2468] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:41.541270  6133 tablet_bootstrap.cc:654] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.542349  6489 leader_election.cc:290] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
W20260709 12:15:41.546563  5974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 62831.2us
I20260709 12:15:41.546953  5854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.550042  6048 leader_election.cc:304] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:41.550668  6432 raft_consensus.cc:697] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:41.555912  5854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ee607f5bb24b4bab4cd993a2327277" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.535310  5858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31c56e0c1b4701bc388c4d3edf535a" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.559872  5973 leader_election.cc:304] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:41.560022  5860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3cdb9438c4a44489be534e4c1c147b5" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.560288  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.538971  5754 rpcz_store.cc:276] 0709 12:15:39.766298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:39.777079 (+ 10781us) service_pool.cc:224] Handling call
0709 12:15:41.538105 (+1761026us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7099,"reported_tablets":2}
I20260709 12:15:41.561795  6496 raft_consensus.cc:493] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.562549  6496 raft_consensus.cc:515] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:41.563511  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12649b3d49a4a309d961106ba152892" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:41.564133  6432 consensus_queue.cc:237] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
W20260709 12:15:41.519702  5975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 58937.6us
I20260709 12:15:41.569100  5856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88edbe785c84f7fb5720879c30d6477" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.569905  5856 raft_consensus.cc:2468] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 0.
I20260709 12:15:41.569756  5853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353bf2c0ce2c412e9ca171f2bb150f91" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.571010  5853 raft_consensus.cc:2468] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:41.575127  5853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.577026  5853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88edbe785c84f7fb5720879c30d6477" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.577826  5853 raft_consensus.cc:2468] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:41.578565  6381 leader_election.cc:290] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:41.579419  5853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.581722  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0199e88be05480094c047ed4a193589" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.584054  5853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c61591bbcaf43839af1cc8373f98c7e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.567730  6486 consensus_queue.cc:1048] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:15:41.586534  5758 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36590 (request call id 60) took 1789 ms. Trace:
I20260709 12:15:41.587177  5758 rpcz_store.cc:276] 0709 12:15:39.797125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:39.797519 (+   394us) service_pool.cc:224] Handling call
0709 12:15:41.586304 (+1788785us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1705253,"reported_tablets":1}
I20260709 12:15:41.592447  6496 leader_election.cc:290] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:41.567361  6489 raft_consensus.cc:2804] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.609647  6381 raft_consensus.cc:493] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36dfe581d09b46f6a9bfe678170e71cb)
I20260709 12:15:41.628322  6489 raft_consensus.cc:493] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.628578  6381 raft_consensus.cc:515] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:41.629521  6489 raft_consensus.cc:3060] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.610319  5853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.610782  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353bf2c0ce2c412e9ca171f2bb150f91" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.611159  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48d13e87f1d4964bb74ba350c2e2df5" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:41.615670  6439 raft_consensus.cc:493] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.618911  5856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32e2e4b0423a493e8f0d323065688bd1" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.619611  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45528a8d878d46d89244614343fc6e90" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.607645  5931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88edbe785c84f7fb5720879c30d6477" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:41.622315  6486 raft_consensus.cc:2804] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.624396  6049 leader_election.cc:304] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:41.619522  5755 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36612 (request call id 67) took 1476 ms. Trace:
W20260709 12:15:41.600034  5956 debug-util.cc:398] Leaking SignalData structure 0x7b08001573c0 after lost signal to thread 5959
I20260709 12:15:41.645421  5755 rpcz_store.cc:276] 0709 12:15:40.143119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:40.143307 (+   188us) service_pool.cc:224] Handling call
0709 12:15:41.619312 (+1476005us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1387772,"reported_tablets":1}
I20260709 12:15:41.634380  6381 leader_election.cc:290] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:41.650532  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ee607f5bb24b4bab4cd993a2327277" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.650660  6439 raft_consensus.cc:515] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:41.649052  5931 raft_consensus.cc:2468] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:41.653191  6439 leader_election.cc:290] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:41.655300  6128 tablet_bootstrap.cc:492] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
W20260709 12:15:41.656890  5956 debug-util.cc:398] Leaking SignalData structure 0x7b0800042da0 after lost signal to thread 6033
W20260709 12:15:41.657349  5956 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5980 after lost signal to thread 6034
W20260709 12:15:41.658809  6049 leader_election.cc:343] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.646886  6486 raft_consensus.cc:493] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.660485  6486 raft_consensus.cc:3060] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.661435  6495 raft_consensus.cc:2804] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:15:41.661985  5956 debug-util.cc:398] Leaking SignalData structure 0x7b0800314740 after lost signal to thread 6107
W20260709 12:15:41.662492  5956 debug-util.cc:398] Leaking SignalData structure 0x7b080037c040 after lost signal to thread 6108
I20260709 12:15:41.662246  6495 raft_consensus.cc:493] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.663012  6495 raft_consensus.cc:3060] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:41.664449  5931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec4d35ac70348cb95a01355320f5686" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:41.666886  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12649b3d49a4a309d961106ba152892" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.660328  6049 leader_election.cc:304] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:41.673638  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48d13e87f1d4964bb74ba350c2e2df5" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
W20260709 12:15:41.639853  5974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 49630us
W20260709 12:15:41.648068  5973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 91264.9us
I20260709 12:15:41.684871  6493 raft_consensus.cc:2804] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.711354  6493 raft_consensus.cc:493] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.711890  6493 raft_consensus.cc:3060] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.711654  6498 consensus_queue.cc:1059] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:41.696815  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0484fe261cb3459cb6a2f532f88c0845" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.697216  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32e2e4b0423a493e8f0d323065688bd1" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.713323  6498 raft_consensus.cc:3055] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:41.711756  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:41.697762  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.714782  6008 raft_consensus.cc:2468] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:41.715111  6081 raft_consensus.cc:2468] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:41.717742  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dad9466c8e40558116511df4c6330e" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:41.698042  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35395bd69ad41f0b37fd3edca49777c" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.718125  6492 consensus_queue.cc:1048] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:41.718649  6008 raft_consensus.cc:2468] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:41.698870  5931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32e2e4b0423a493e8f0d323065688bd1" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:41.719720  5931 raft_consensus.cc:2468] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:41.699123  6479 raft_consensus.cc:515] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:41.721585  6495 raft_consensus.cc:515] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
W20260709 12:15:41.699601  6048 leader_election.cc:343] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.700871  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ee607f5bb24b4bab4cd993a2327277" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:41.701442  6489 raft_consensus.cc:515] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:41.702244  5930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:41.723035  6079 raft_consensus.cc:2393] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ed30c66c784e06ad64609f8d1b4c43 in current term 1: Already voted for candidate 36dfe581d09b46f6a9bfe678170e71cb in this term.
I20260709 12:15:41.723182  5930 raft_consensus.cc:2468] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:41.703490  5928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353bf2c0ce2c412e9ca171f2bb150f91" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:41.704941  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e5dfe30b74c94b9753cf4c647695f" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:41.705451  6132 tablet_bootstrap.cc:492] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:41.654874  5899 leader_election.cc:304] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:41.725368  6048 leader_election.cc:304] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
W20260709 12:15:41.727205  5899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 91568.1us
I20260709 12:15:41.727850  6494 raft_consensus.cc:2749] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.706575  6128 ts_tablet_manager.cc:1403] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 1.370s	user 0.015s	sys 0.041s
I20260709 12:15:41.725380  6132 ts_tablet_manager.cc:1403] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.448s	user 0.033s	sys 0.044s
W20260709 12:15:41.730091  6048 leader_election.cc:343] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.726346  6478 raft_consensus.cc:2749] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.726632  6129 tablet_bootstrap.cc:654] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.727223  6479 leader_election.cc:290] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:41.676968  5901 leader_election.cc:304] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:41.714468  6498 raft_consensus.cc:740] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:41.734654  6489 leader_election.cc:290] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:41.735400  6493 raft_consensus.cc:515] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:41.732081  6132 raft_consensus.cc:359] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:41.740269  6048 leader_election.cc:304] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:41.717752  6133 tablet_bootstrap.cc:492] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:41.748945  6133 ts_tablet_manager.cc:1403] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.323s	user 0.017s	sys 0.022s
I20260709 12:15:41.740625  6128 raft_consensus.cc:359] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:41.749403  6128 raft_consensus.cc:385] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.747735  6132 raft_consensus.cc:385] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.750001  6132 raft_consensus.cc:740] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.749639  6128 raft_consensus.cc:740] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
W20260709 12:15:41.754225  5901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 77462.4us
I20260709 12:15:41.754472  5899 leader_election.cc:304] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:41.755858  5899 leader_election.cc:304] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:41.757298  5899 leader_election.cc:304] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:41.758843  6132 consensus_queue.cc:260] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:41.761576  6132 ts_tablet_manager.cc:1434] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:15:41.762523  6477 raft_consensus.cc:2804] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:41.763062  6477 raft_consensus.cc:493] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.763463  6477 raft_consensus.cc:3060] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:41.763298  6128 consensus_queue.cc:260] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:41.766645  6473 raft_consensus.cc:2749] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.767545  6473 raft_consensus.cc:2749] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.768405  6495 leader_election.cc:290] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:41.769359  6495 raft_consensus.cc:2804] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.761744  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc7520eb74c4882b7e36fda0f66ca0e" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:41.770749  6008 raft_consensus.cc:2468] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
W20260709 12:15:41.750347  5973 leader_election.cc:343] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.772667  6470 raft_consensus.cc:515] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:41.774777  5973 leader_election.cc:304] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:41.776741  6478 raft_consensus.cc:493] T d852dc979f7843dcbf8477fc409c2c68 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.776887  5973 leader_election.cc:304] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:41.777459  6478 raft_consensus.cc:515] T d852dc979f7843dcbf8477fc409c2c68 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:41.777041  6004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec4d35ac70348cb95a01355320f5686" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:41.775014  5853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12649b3d49a4a309d961106ba152892" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:41.779390  5853 raft_consensus.cc:3060] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:41.780015  6004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3cdb9438c4a44489be534e4c1c147b5" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:41.780126  6479 raft_consensus.cc:2749] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.777730  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:41.798198  6008 raft_consensus.cc:2468] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:41.781273  6502 raft_consensus.cc:2804] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.799266  6502 raft_consensus.cc:493] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.799932  6502 raft_consensus.cc:3060] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.800242  6498 consensus_queue.cc:260] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:41.803334  6485 raft_consensus.cc:2804] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.803990  6485 raft_consensus.cc:493] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.804489  6485 raft_consensus.cc:3060] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.782886  6132 tablet_bootstrap.cc:492] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:41.767383  6048 leader_election.cc:304] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:41.793707  6255 raft_consensus.cc:493] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.808161  6489 raft_consensus.cc:2749] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:41.808676  6505 log.cc:927] Time spent T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:15:41.808355  6255 raft_consensus.cc:515] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:41.769874  6495 raft_consensus.cc:493] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:41.798682  6478 leader_election.cc:290] T d852dc979f7843dcbf8477fc409c2c68 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:41.811560  6495 raft_consensus.cc:3060] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.779464  6128 ts_tablet_manager.cc:1434] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.003s
I20260709 12:15:41.815876  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc7520eb74c4882b7e36fda0f66ca0e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:41.816844  5934 raft_consensus.cc:2468] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:41.819072  5928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c61591bbcaf43839af1cc8373f98c7e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:41.819561  5930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:41.819020  5975 leader_election.cc:304] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:41.844169  6470 leader_election.cc:290] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:41.850842  6255 leader_election.cc:290] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:41.872393  6128 tablet_bootstrap.cc:492] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:41.873067  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f502ef9684f1b8a6c29e9010f9ed5" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:41.875635  6486 raft_consensus.cc:515] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:41.877449  6464 raft_consensus.cc:493] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36dfe581d09b46f6a9bfe678170e71cb)
I20260709 12:15:41.878135  6464 raft_consensus.cc:515] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
W20260709 12:15:41.884135  5824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 132020us
I20260709 12:15:41.886070  6479 raft_consensus.cc:2804] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:15:41.886296  5973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 53725.6us
I20260709 12:15:41.887006  6479 raft_consensus.cc:493] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.887508  6479 raft_consensus.cc:3060] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.888516  5973 leader_election.cc:304] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:41.891001  6503 consensus_queue.cc:1048] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:41.870810  6133 raft_consensus.cc:359] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:41.899223  6133 raft_consensus.cc:385] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:15:41.899266  5899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 142091us
I20260709 12:15:41.899641  6133 raft_consensus.cc:740] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
W20260709 12:15:41.892338  6049 leader_election.cc:343] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.895053  6498 raft_consensus.cc:3060] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.878190  6486 leader_election.cc:290] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
W20260709 12:15:41.902832  5975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 83928.6us
I20260709 12:15:41.900635  6504 raft_consensus.cc:2804] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:41.909019  5973 leader_election.cc:304] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:41.901263  6493 leader_election.cc:290] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:41.918201  6133 consensus_queue.cc:260] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:41.922286  6504 raft_consensus.cc:697] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:41.922889  5975 leader_election.cc:304] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:41.923414  6504 consensus_queue.cc:237] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:41.925825  6129 tablet_bootstrap.cc:492] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:41.926469  6129 ts_tablet_manager.cc:1403] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.485s	user 0.063s	sys 0.074s
W20260709 12:15:41.901165  6048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 133905us
I20260709 12:15:41.910825  5856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353bf2c0ce2c412e9ca171f2bb150f91" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:41.929492  6470 raft_consensus.cc:2749] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.931814  5973 leader_election.cc:304] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:41.932678  6470 raft_consensus.cc:2804] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.933097  6470 raft_consensus.cc:493] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:41.933473  6470 raft_consensus.cc:3060] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.933760  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc7520eb74c4882b7e36fda0f66ca0e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.934684  6079 raft_consensus.cc:2393] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 2: Already voted for candidate 36dfe581d09b46f6a9bfe678170e71cb in this term.
I20260709 12:15:41.934552  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27058558598c4834804424f2de3c1cea" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.935719  5975 leader_election.cc:304] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:41.937122  6128 tablet_bootstrap.cc:654] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.937294  5974 leader_election.cc:304] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:41.937379  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:41.910226  6464 leader_election.cc:290] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:41.971952  5974 leader_election.cc:304] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:41.972570  6432 raft_consensus.cc:2749] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.973204  6381 raft_consensus.cc:2804] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:15:41.973345  5974 leader_election.cc:343] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.973696  6381 raft_consensus.cc:493] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.974141  6381 raft_consensus.cc:3060] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:41.974282  6432 raft_consensus.cc:2804] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.974995  6432 raft_consensus.cc:493] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.975441  6432 raft_consensus.cc:3060] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.976815  5930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7299ddfb5eb4240b757da7c444170c9" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:41.941694  6486 raft_consensus.cc:2804] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.978828  6486 raft_consensus.cc:493] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:41.962246  6492 consensus_queue.cc:1048] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:15:41.979524  6486 raft_consensus.cc:3060] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.979635  5930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c20504b20bf4686afff8a8417bdc035" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:41.984045  6502 raft_consensus.cc:515] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:41.985559  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c20504b20bf4686afff8a8417bdc035" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:41.934660  6495 raft_consensus.cc:515] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:41.962661  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7299ddfb5eb4240b757da7c444170c9" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:41.963331  6048 leader_election.cc:304] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:41.958897  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b081fa5436f34e5e9e477b502f689461" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:41.940490  6129 raft_consensus.cc:359] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:41.998418  6129 raft_consensus.cc:385] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.998809  6129 raft_consensus.cc:740] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.998917  6133 ts_tablet_manager.cc:1434] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.250s	user 0.009s	sys 0.004s
I20260709 12:15:41.996201  6132 tablet_bootstrap.cc:654] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.986016  6006 raft_consensus.cc:1240] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Rejecting Update request from peer 26615d25670745d38490e2d6da247d9e for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:41.997869  6493 raft_consensus.cc:493] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:42.002504  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31c56e0c1b4701bc388c4d3edf535a" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:42.003993  6495 leader_election.cc:290] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:42.006669  6129 consensus_queue.cc:260] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:41.984035  5853 raft_consensus.cc:2468] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
W20260709 12:15:42.008122  6048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 66471.7us
I20260709 12:15:42.004041  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f23027ce3e4c149ba8309105929682" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:42.015580  6079 raft_consensus.cc:3060] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.002130  6493 raft_consensus.cc:515] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:42.023308  5824 leader_election.cc:304] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:42.035841  5824 leader_election.cc:304] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
W20260709 12:15:42.000073  5975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 64452.2us
I20260709 12:15:42.032792  6049 leader_election.cc:304] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
W20260709 12:15:42.033494  5826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.043318  6477 raft_consensus.cc:515] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:42.044515  5973 leader_election.cc:304] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:42.045306  6453 raft_consensus.cc:2804] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.045794  6453 raft_consensus.cc:493] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:42.046161  6436 raft_consensus.cc:2749] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.043838  6003 raft_consensus.cc:1240] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Rejecting Update request from peer 26615d25670745d38490e2d6da247d9e for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:42.046221  6453 raft_consensus.cc:3060] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.053216  6129 ts_tablet_manager.cc:1434] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.126s	user 0.007s	sys 0.001s
I20260709 12:15:42.014917  6485 raft_consensus.cc:515] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:42.018868  6479 raft_consensus.cc:515] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:42.046979  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc7520eb74c4882b7e36fda0f66ca0e" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:42.058248  5932 raft_consensus.cc:3060] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.059350  6494 raft_consensus.cc:493] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.059541  6489 raft_consensus.cc:493] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.060031  6494 raft_consensus.cc:515] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:42.060201  6489 raft_consensus.cc:515] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:42.063417  6493 leader_election.cc:290] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:42.064397  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500f59123914ed198a39756117b4110" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:42.065599  6485 leader_election.cc:290] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:42.047916  6476 raft_consensus.cc:2804] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.050006  6491 raft_consensus.cc:2804] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:42.065982  5855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219ee6e67c3a4adf9dd72198036646bc" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:42.067003  6491 raft_consensus.cc:697] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:15:42.068204  6491 consensus_queue.cc:237] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:42.068531  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353bf2c0ce2c412e9ca171f2bb150f91" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:42.068985  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32e2e4b0423a493e8f0d323065688bd1" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:42.069314  5928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12649b3d49a4a309d961106ba152892" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:42.069672  5935 raft_consensus.cc:3060] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.070046  5928 raft_consensus.cc:3060] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.070570  6494 leader_election.cc:290] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
W20260709 12:15:42.071563  6049 leader_election.cc:343] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:42.074743  6049 leader_election.cc:343] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.047482  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d71c733514ec9bc7ddb9d3b7cd80d" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:42.050956  5856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32e2e4b0423a493e8f0d323065688bd1" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:42.077354  5853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88edbe785c84f7fb5720879c30d6477" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:42.066241  6476 raft_consensus.cc:493] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:42.085203  6133 tablet_bootstrap.cc:492] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:42.086572  5933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f502ef9684f1b8a6c29e9010f9ed5" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:42.087531  6476 raft_consensus.cc:3060] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.086591  5853 raft_consensus.cc:3060] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.079229  5854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972a71bd13ef4022b6966d1287868dc4" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:42.046365  5973 leader_election.cc:304] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:42.104756  5933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd00b832aafb491387eee88b954ff5df" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:42.080480  5975 leader_election.cc:304] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:42.095273  6489 leader_election.cc:290] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:42.113970  6048 leader_election.cc:304] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:42.096530  6477 leader_election.cc:290] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:42.101593  6502 leader_election.cc:290] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:42.139757  6493 raft_consensus.cc:2749] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.106112  6381 raft_consensus.cc:515] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:42.146601  6479 leader_election.cc:290] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:42.111137  6496 raft_consensus.cc:2749] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.900234  5899 leader_election.cc:304] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
W20260709 12:15:42.187625  6049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 52295.2us
I20260709 12:15:42.106384  6470 raft_consensus.cc:515] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
W20260709 12:15:42.197516  5899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 297336us
W20260709 12:15:42.126277  5973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 80009.6us
I20260709 12:15:42.166220  6504 raft_consensus.cc:2749] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.117043  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a474468455492f992eb8dfefad0ca2" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:42.201116  6128 tablet_bootstrap.cc:492] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
W20260709 12:15:42.203799  5824 leader_election.cc:343] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:42.187533  6048 leader_election.cc:343] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.279174  6128 ts_tablet_manager.cc:1403] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.407s	user 0.020s	sys 0.050s
W20260709 12:15:42.188886  5975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 94691.3us
I20260709 12:15:42.215390  6129 tablet_bootstrap.cc:492] T 5cb1760bd0ba436eb7077c60542c0a45 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:42.289529  6133 tablet_bootstrap.cc:654] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:42.346066  5824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 142309us
I20260709 12:15:42.198151  6477 raft_consensus.cc:2749] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.197939  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500f59123914ed198a39756117b4110" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:42.220971  6489 raft_consensus.cc:493] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.204943  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e5dfe30b74c94b9753cf4c647695f" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
W20260709 12:15:42.263312  6511 log.cc:927] Time spent T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:15:42.226239  5935 raft_consensus.cc:2468] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 2.
I20260709 12:15:42.268066  6496 raft_consensus.cc:493] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.219091  6381 leader_election.cc:290] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:42.212172  6492 raft_consensus.cc:493] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.219942  6009 raft_consensus.cc:1240] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Rejecting Update request from peer 26615d25670745d38490e2d6da247d9e for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:42.218464  6004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:42.253511  5932 raft_consensus.cc:2468] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 2.
I20260709 12:15:42.223291  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a260b81828b4baab927a2d3f2253be4" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:42.219022  6001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a66f01ced34c71b061ec163494f2b6" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:42.211095  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0199e88be05480094c047ed4a193589" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:42.227761  5855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:42.225479  5853 raft_consensus.cc:2468] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:42.403086  6003 raft_consensus.cc:2468] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:42.403710  5926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45528a8d878d46d89244614343fc6e90" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:42.220726  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d71c733514ec9bc7ddb9d3b7cd80d" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:42.405218  5926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88edbe785c84f7fb5720879c30d6477" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:42.405306  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dad9466c8e40558116511df4c6330e" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:42.408735  6004 raft_consensus.cc:1240] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Rejecting Update request from peer 26615d25670745d38490e2d6da247d9e for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:42.408813  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12649b3d49a4a309d961106ba152892" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:42.410346  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48d13e87f1d4964bb74ba350c2e2df5" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:42.411698  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353bf2c0ce2c412e9ca171f2bb150f91" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:42.227068  6002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88edbe785c84f7fb5720879c30d6477" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:42.238286  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88edbe785c84f7fb5720879c30d6477" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:42.231565  6486 raft_consensus.cc:515] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:42.350905  6048 leader_election.cc:304] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:42.231488  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc7520eb74c4882b7e36fda0f66ca0e" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:42.398232  6132 tablet_bootstrap.cc:492] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:42.401535  5931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e906733ca34216bf4664d81c7b19b2" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:42.436921  6132 ts_tablet_manager.cc:1403] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.654s	user 0.059s	sys 0.059s
I20260709 12:15:42.401626  5933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:42.440270  6493 raft_consensus.cc:2749] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:42.402307  5806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:42.443068  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d852dc979f7843dcbf8477fc409c2c68" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:42.443825  6132 raft_consensus.cc:359] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:42.444231  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d852dc979f7843dcbf8477fc409c2c68" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:42.440230  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ee607f5bb24b4bab4cd993a2327277" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:42.220916  6476 raft_consensus.cc:515] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:42.447804  6476 leader_election.cc:290] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:42.405728  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba593a994ff44d7866a70004fd0a946" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:42.447891  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:42.220742  5928 raft_consensus.cc:2468] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:42.406104  5926 raft_consensus.cc:2393] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ed30c66c784e06ad64609f8d1b4c43 in current term 1: Already voted for candidate 26615d25670745d38490e2d6da247d9e in this term.
I20260709 12:15:42.450140  5933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dad9466c8e40558116511df4c6330e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:42.387260  6495 raft_consensus.cc:2804] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.403052  5927 raft_consensus.cc:1240] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Rejecting Update request from peer 58ed30c66c784e06ad64609f8d1b4c43 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:42.453065  6129 tablet_bootstrap.cc:654] T 5cb1760bd0ba436eb7077c60542c0a45 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.418004  6489 raft_consensus.cc:515] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
W20260709 12:15:42.424151  6498 consensus_meta.cc:287] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
I20260709 12:15:42.424046  5758 catalog_manager.cc:5697] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:42.425168  6128 raft_consensus.cc:359] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:42.426864  6432 raft_consensus.cc:515] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:42.460824  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88edbe785c84f7fb5720879c30d6477" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:42.461815  5929 raft_consensus.cc:2393] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 1: Already voted for candidate 26615d25670745d38490e2d6da247d9e in this term.
I20260709 12:15:42.395058  6492 raft_consensus.cc:515] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:42.463902  6007 raft_consensus.cc:2393] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb in current term 2: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
I20260709 12:15:42.465293  6492 leader_election.cc:290] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:42.430694  6002 raft_consensus.cc:2393] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ed30c66c784e06ad64609f8d1b4c43 in current term 1: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
W20260709 12:15:42.431977  5975 leader_election.cc:343] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.464624  5758 catalog_manager.cc:5697] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:42.466118  5975 leader_election.cc:304] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:42.466789  6485 consensus_queue.cc:1059] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:42.467350  5825 leader_election.cc:304] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:42.468062  6471 raft_consensus.cc:3055] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:42.468437  6471 raft_consensus.cc:740] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:42.469386  5825 leader_election.cc:304] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:42.469854  5899 leader_election.cc:304] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:42.432588  6486 leader_election.cc:290] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:42.470701  6477 raft_consensus.cc:2749] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.470827  6486 raft_consensus.cc:2749] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:42.434896  6000 raft_consensus.cc:1240] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Rejecting Update request from peer 26615d25670745d38490e2d6da247d9e for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:42.420024  6079 raft_consensus.cc:2468] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:42.436146  5930 raft_consensus.cc:1240] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Rejecting Update request from peer 58ed30c66c784e06ad64609f8d1b4c43 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:42.436899  5931 raft_consensus.cc:2468] T a6e906733ca34216bf4664d81c7b19b2 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:42.274067  6453 raft_consensus.cc:515] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:42.471616  6476 raft_consensus.cc:2749] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.402132  6470 leader_election.cc:290] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:42.236663  5756 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36582 (request call id 67) took 2556 ms. Trace:
I20260709 12:15:42.469398  6471 consensus_queue.cc:260] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:42.270917  5973 leader_election.cc:304] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:42.458202  6128 raft_consensus.cc:385] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.463027  6432 leader_election.cc:290] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
W20260709 12:15:42.428531  6048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 289039us
I20260709 12:15:42.462899  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88edbe785c84f7fb5720879c30d6477" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:42.472101  5899 leader_election.cc:304] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:42.444638  6132 raft_consensus.cc:385] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.505617  6132 raft_consensus.cc:740] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.494015  6471 raft_consensus.cc:3060] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.490195  6350 raft_consensus.cc:2749] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:42.501171  6128 raft_consensus.cc:740] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.506477  6132 consensus_queue.cc:260] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:42.509723  6477 raft_consensus.cc:2749] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.509822  6470 raft_consensus.cc:2749] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.394088  6496 raft_consensus.cc:515] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
W20260709 12:15:42.511059  5824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 100896us
I20260709 12:15:42.507062  6489 leader_election.cc:290] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:42.526278  6132 ts_tablet_manager.cc:1434] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.000s
I20260709 12:15:42.525324  6128 consensus_queue.cc:260] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:42.529733  5930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219ee6e67c3a4adf9dd72198036646bc" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:42.529980  5858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dad9466c8e40558116511df4c6330e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:42.530628  5854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27058558598c4834804424f2de3c1cea" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:42.532256  5931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e5dfe30b74c94b9753cf4c647695f" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:42.532747  5901 leader_election.cc:304] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:42.533203  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc7520eb74c4882b7e36fda0f66ca0e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:42.533660  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3cdb9438c4a44489be534e4c1c147b5" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:42.534437  6009 raft_consensus.cc:2468] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:42.536459  6002 raft_consensus.cc:1240] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Rejecting Update request from peer 58ed30c66c784e06ad64609f8d1b4c43 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:42.492807  5756 rpcz_store.cc:276] 0709 12:15:39.680097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:39.696573 (+ 16476us) service_pool.cc:224] Handling call
0709 12:15:42.236402 (+2539829us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:41.668654 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:41.669426 (+   772us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:41.669496 (+    70us) write_op.cc:435] Acquired schema lock
0709 12:15:41.669529 (+    33us) tablet.cc:662] Decoding operations
0709 12:15:41.670062 (+   533us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:41.670146 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:41.670173 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:15:41.670546 (+   373us) tablet.cc:701] Row locks acquired
0709 12:15:41.670599 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:15:41.670783 (+   184us) write_op.cc:270] Start()
0709 12:15:41.670947 (+   164us) write_op.cc:276] Timestamp: P: 1783599341670715 usec, L: 0
0709 12:15:41.670993 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 12:15:41.671931 (+   938us) log.cc:844] Serialized 540 byte log entry
0709 12:15:41.737547 (+ 65616us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b18002e64e0. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f507beb5ab1 00007f507bec2281 00007f5072fed3f3 00007f5072fef7c1 00007f5072fef779 00007f5072fef709 00007f5072fef6d1 00007f5072fee9cd 0000000000388634 0000000000388479 00007f5072fd083a
0709 12:15:41.917454 (+179907us) op_driver.cc:464] REPLICATION: finished
0709 12:15:42.019572 (+102118us) write_op.cc:301] APPLY: starting
0709 12:15:42.019675 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:42.019814 (+   139us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:42.019850 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:42.020204 (+   354us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:42.020462 (+   258us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:15:42.020520 (+    58us) write_op.cc:312] APPLY: finished
0709 12:15:42.020816 (+   296us) log.cc:844] Serialized 22 byte log entry
0709 12:15:42.021035 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:42.021123 (+    88us) write_op.cc:454] Released schema lock
0709 12:15:42.021181 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:42.075669 (+ 54488us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:42.075702 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1713861,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":101744,"apply.run_cpu_time_us":2412,"apply.run_wall_time_us":56040,"num_ops":1,"prepare.queue_time_us":133610,"prepare.run_cpu_time_us":7967,"prepare.run_wall_time_us":18916,"raft.queue_time_us":101690,"raft.run_cpu_time_us":18647,"raft.run_wall_time_us":84242,"replication_time_us":240952,"spinlock_wait_cycles":34597632,"thread_start_us":242323,"threads_started":4,"wal-append.queue_time_us":48409}]]}
I20260709 12:15:42.536312  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
W20260709 12:15:42.537142  6047 leader_election.cc:343] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.524634  6003 raft_consensus.cc:2393] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 26615d25670745d38490e2d6da247d9e in current term 1: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
W20260709 12:15:42.518044  5973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 247237us
I20260709 12:15:42.519157  5825 leader_election.cc:304] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:42.543527  5852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88edbe785c84f7fb5720879c30d6477" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:42.544821  6495 raft_consensus.cc:493] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:42.546150  6076 raft_consensus.cc:1240] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Rejecting Update request from peer 26615d25670745d38490e2d6da247d9e for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:42.555274  6495 raft_consensus.cc:3060] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.555488  6453 leader_election.cc:290] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:42.556396  5856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:42.556986  6518 raft_consensus.cc:2749] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.557415  6485 raft_consensus.cc:2804] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:42.557979  6485 raft_consensus.cc:697] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:42.558732  5825 leader_election.cc:304] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:42.558965  6485 consensus_queue.cc:237] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:42.559497  6048 leader_election.cc:304] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:42.560192  6518 raft_consensus.cc:2749] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.560729  6496 leader_election.cc:290] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:42.560931  6048 leader_election.cc:304] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:42.561435  6493 raft_consensus.cc:2804] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.538947  6477 consensus_queue.cc:1059] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:15:42.562003  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b081fa5436f34e5e9e477b502f689461" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:42.562819  5857 raft_consensus.cc:3060] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.563123  6489 raft_consensus.cc:2804] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.563539  6476 raft_consensus.cc:493] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.563661  6489 raft_consensus.cc:697] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:15:42.561975  6493 raft_consensus.cc:697] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:15:42.564141  6476 raft_consensus.cc:515] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:42.564749  6489 consensus_queue.cc:237] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:42.566902  6476 leader_election.cc:290] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
W20260709 12:15:42.567003  6048 leader_election.cc:343] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.567662  6048 leader_election.cc:304] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:42.572891  6132 tablet_bootstrap.cc:492] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:42.574226  5852 raft_consensus.cc:2393] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 1: Already voted for candidate 26615d25670745d38490e2d6da247d9e in this term.
I20260709 12:15:42.553560  5929 raft_consensus.cc:2393] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 2: Already voted for candidate 36dfe581d09b46f6a9bfe678170e71cb in this term.
I20260709 12:15:42.577589  5858 raft_consensus.cc:1240] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Rejecting Update request from peer 26615d25670745d38490e2d6da247d9e for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:42.577905  5931 raft_consensus.cc:3060] T a6e906733ca34216bf4664d81c7b19b2 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.561929  5930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb1760bd0ba436eb7077c60542c0a45" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:42.580960  6494 raft_consensus.cc:2749] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:42.564898  6493 consensus_queue.cc:237] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
W20260709 12:15:42.583251  5900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.588949  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc7520eb74c4882b7e36fda0f66ca0e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:42.589875  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:42.588953  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd00b832aafb491387eee88b954ff5df" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:42.593730  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e5dfe30b74c94b9753cf4c647695f" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
W20260709 12:15:42.602654  5899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 88104.9us
I20260709 12:15:42.596827  5824 leader_election.cc:304] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:42.603824  5899 leader_election.cc:304] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:42.607501  6128 ts_tablet_manager.cc:1434] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.262s	user 0.009s	sys 0.000s
I20260709 12:15:42.548311  6047 leader_election.cc:304] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:42.609508  6350 raft_consensus.cc:2749] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.603752  5973 leader_election.cc:304] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:42.635237  6128 tablet_bootstrap.cc:492] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:42.634104  6255 raft_consensus.cc:2749] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:42.643963  5853 raft_consensus.cc:1240] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Rejecting Update request from peer 26615d25670745d38490e2d6da247d9e for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:42.719314  5857 raft_consensus.cc:2468] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
W20260709 12:15:42.721145  5824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 109969us
I20260709 12:15:42.650810  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972a71bd13ef4022b6966d1287868dc4" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:42.650815  6432 raft_consensus.cc:2804] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:15:42.644137  6048 leader_election.cc:343] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.701081  6477 raft_consensus.cc:3055] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:15:42.648801  5973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 48833.2us
I20260709 12:15:42.707345  6494 raft_consensus.cc:493] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:42.689848  5901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 70188us
I20260709 12:15:42.722918  5824 leader_election.cc:304] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:42.735911  6477 raft_consensus.cc:740] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:42.743376  6528 raft_consensus.cc:2749] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.743674  6432 raft_consensus.cc:697] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:42.743258  6048 leader_election.cc:304] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
W20260709 12:15:42.776053  6048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 141532us
W20260709 12:15:42.777161  6048 leader_election.cc:343] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.777285  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3cdb9438c4a44489be534e4c1c147b5" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:42.778136  6077 raft_consensus.cc:2468] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:42.780392  6477 consensus_queue.cc:260] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:42.781823  6477 raft_consensus.cc:3060] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:42.757431  6047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 220434us
I20260709 12:15:42.821066  5852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3cdb9438c4a44489be534e4c1c147b5" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:42.745486  6485 consensus_queue.cc:1059] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:15:42.813174  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16996642a1b4752b788da1836791f3c" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:42.754038  6494 raft_consensus.cc:515] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:42.770006  6476 raft_consensus.cc:2804] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:42.782599  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dad9466c8e40558116511df4c6330e" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:42.823427  6132 tablet_bootstrap.cc:654] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.813612  6517 raft_consensus.cc:493] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e29106aa83aa4eebb9b87d6745825a27)
I20260709 12:15:42.813293  6524 consensus_queue.cc:1059] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:42.838968  6517 raft_consensus.cc:515] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:42.839444  6494 leader_election.cc:290] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:42.841346  6517 leader_election.cc:290] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:42.773969  6518 consensus_queue.cc:1059] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:15:42.830175  6476 raft_consensus.cc:493] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.833532  6006 raft_consensus.cc:2393] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ed30c66c784e06ad64609f8d1b4c43 in current term 2: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
I20260709 12:15:42.833370  6493 raft_consensus.cc:493] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:42.834980  6129 tablet_bootstrap.cc:492] T 5cb1760bd0ba436eb7077c60542c0a45 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:42.848708  6129 ts_tablet_manager.cc:1403] T 5cb1760bd0ba436eb7077c60542c0a45 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.634s	user 0.022s	sys 0.018s
I20260709 12:15:42.835362  5975 leader_election.cc:304] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
W20260709 12:15:42.836706  6047 leader_election.cc:343] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.837265  6491 consensus_queue.cc:1048] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:43.014113  6128 tablet_bootstrap.cc:700] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43: Time spent opening tablet: real 0.161s	user 0.006s	sys 0.011s
I20260709 12:15:42.824321  6255 raft_consensus.cc:2749] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:42.844688  6476 raft_consensus.cc:3060] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.018467  6471 raft_consensus.cc:3055] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:43.018978  6471 raft_consensus.cc:740] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:43.019587  6493 raft_consensus.cc:515] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:43.019941  6471 consensus_queue.cc:260] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:43.021373  6471 raft_consensus.cc:3060] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.025839  6495 raft_consensus.cc:515] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
W20260709 12:15:43.027202  5900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.025992  6476 raft_consensus.cc:515] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:43.028972  6495 leader_election.cc:290] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:43.029503  5852 raft_consensus.cc:2393] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 1: Already voted for candidate 58ed30c66c784e06ad64609f8d1b4c43 in this term.
I20260709 12:15:43.032735  6133 tablet_bootstrap.cc:492] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:43.033337  6133 ts_tablet_manager.cc:1403] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.957s	user 0.027s	sys 0.041s
I20260709 12:15:43.035600  6476 leader_election.cc:290] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
W20260709 12:15:43.046857  5824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 234355us
I20260709 12:15:43.047246  6502 consensus_queue.cc:1048] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:43.036008  6496 raft_consensus.cc:2749] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:15:43.036595  6505 log.cc:927] Time spent T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060: Append to log took a long time: real 0.185s	user 0.010s	sys 0.003s
I20260709 12:15:43.037772  6129 raft_consensus.cc:359] T 5cb1760bd0ba436eb7077c60542c0a45 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:43.038812  6530 raft_consensus.cc:3055] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:43.027184  6047 leader_election.cc:304] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.058274  6530 raft_consensus.cc:740] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
W20260709 12:15:43.058897  6047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 222234us
I20260709 12:15:43.059407  6530 consensus_queue.cc:260] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:43.060763  6530 raft_consensus.cc:3060] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.060532  5856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873d3215e6ba4214a3910fa16e0fd62a" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:43.061437  6255 raft_consensus.cc:2749] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:43.012259  5858 raft_consensus.cc:3060] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.040617  5930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:43.041477  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33adcece08484ff79fd8711ef5dfd78c" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
W20260709 12:15:43.043951  5975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 208699us
W20260709 12:15:42.999583  5899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 395812us
I20260709 12:15:43.076766  5899 leader_election.cc:304] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.077700  6485 raft_consensus.cc:2749] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.078289  5899 leader_election.cc:304] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:43.079243  6485 raft_consensus.cc:2804] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:43.079650  6485 raft_consensus.cc:493] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:43.043187  5973 leader_election.cc:304] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:43.080080  6485 raft_consensus.cc:3060] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.051523  6000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0199e88be05480094c047ed4a193589" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:43.059772  6047 leader_election.cc:304] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:43.084475  6491 raft_consensus.cc:2804] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:43.045152  6128 tablet_bootstrap.cc:654] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.084928  6491 raft_consensus.cc:493] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:43.085373  6491 raft_consensus.cc:3060] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.080323  6003 raft_consensus.cc:1240] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Rejecting Update request from peer 58ed30c66c784e06ad64609f8d1b4c43 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:43.087422  6519 consensus_queue.cc:1059] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:43.088337  6502 raft_consensus.cc:2749] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:15:43.088528  5973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 45442.4us
I20260709 12:15:43.089447  5973 leader_election.cc:304] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:43.090221  6502 raft_consensus.cc:2749] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:15:43.074793  6048 leader_election.cc:343] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:43.093608  5973 leader_election.cc:304] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:43.074864  5975 leader_election.cc:304] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:43.076895  6518 raft_consensus.cc:3055] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:43.093933  5856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:43.094272  6047 leader_election.cc:304] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.050756  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3cdb9438c4a44489be534e4c1c147b5" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:43.094636  6518 raft_consensus.cc:740] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:43.095369  6005 raft_consensus.cc:3060] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.904546  6432 consensus_queue.cc:237] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:43.022090  6493 leader_election.cc:290] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:43.075948  5930 raft_consensus.cc:2393] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb in current term 2: Already voted for candidate 26615d25670745d38490e2d6da247d9e in this term.
I20260709 12:15:43.096351  6129 raft_consensus.cc:385] T 5cb1760bd0ba436eb7077c60542c0a45 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.057350  6132 tablet_bootstrap.cc:492] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:43.120565  5899 leader_election.cc:304] T c9a66f01ced34c71b061ec163494f2b6 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.121351  6132 ts_tablet_manager.cc:1403] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.549s	user 0.017s	sys 0.009s
I20260709 12:15:43.095806  6518 consensus_queue.cc:260] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:43.122567  6129 raft_consensus.cc:740] T 5cb1760bd0ba436eb7077c60542c0a45 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.130602  6471 raft_consensus.cc:2749] T c9a66f01ced34c71b061ec163494f2b6 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:43.132483  6047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 48445.5us
I20260709 12:15:43.133324  6047 leader_election.cc:304] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.133875  5899 leader_election.cc:304] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.119896  6496 raft_consensus.cc:2749] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.140902  6129 consensus_queue.cc:260] T 5cb1760bd0ba436eb7077c60542c0a45 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:43.126983  6502 raft_consensus.cc:2749] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.147637  6547 raft_consensus.cc:2749] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.128039  6531 raft_consensus.cc:2749] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:43.150698  5825 consensus_peers.cc:597] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:43.151036  5935 raft_consensus.cc:1275] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:43.151263  5856 raft_consensus.cc:3055] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:43.169138  6133 raft_consensus.cc:359] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:43.169943  6133 raft_consensus.cc:385] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.170224  6133 raft_consensus.cc:740] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.137986  6493 raft_consensus.cc:2749] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.154578  6491 raft_consensus.cc:515] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:43.154881  6048 leader_election.cc:304] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:43.157945  6132 raft_consensus.cc:359] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:43.175880  6132 raft_consensus.cc:385] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.161505  5973 leader_election.cc:304] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:43.146246  6471 consensus_queue.cc:1059] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
W20260709 12:15:43.134572  5975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 59947.5us
I20260709 12:15:43.161293  6005 raft_consensus.cc:2468] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:43.163936  6525 consensus_queue.cc:1048] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:43.130605  6498 raft_consensus.cc:493] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e29106aa83aa4eebb9b87d6745825a27)
I20260709 12:15:43.168201  5899 leader_election.cc:304] T d852dc979f7843dcbf8477fc409c2c68 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.169530  5856 raft_consensus.cc:740] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:43.144469  6486 consensus_queue.cc:1048] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:15:43.176306  6132 raft_consensus.cc:740] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.188740  5899 leader_election.cc:304] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:43.165458  6518 raft_consensus.cc:3060] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.136389  6534 consensus_queue.cc:1059] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:15:43.184810  5975 leader_election.cc:304] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:43.193881  6534 raft_consensus.cc:3055] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:43.194257  6534 raft_consensus.cc:740] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:43.195003  6502 raft_consensus.cc:2749] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.195125  6534 consensus_queue.cc:260] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:43.195995  6495 consensus_queue.cc:1048] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:43.176409  6133 consensus_queue.cc:260] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:43.188419  6129 ts_tablet_manager.cc:1434] T 5cb1760bd0ba436eb7077c60542c0a45 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.339s	user 0.018s	sys 0.002s
I20260709 12:15:43.187230  5824 leader_election.cc:304] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:43.190467  6132 consensus_queue.cc:260] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
W20260709 12:15:43.190552  5973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 43617.5us
I20260709 12:15:43.190627  6525 raft_consensus.cc:2749] T d852dc979f7843dcbf8477fc409c2c68 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.192859  6524 raft_consensus.cc:3055] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:43.192487  5856 consensus_queue.cc:260] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:43.204651  6476 raft_consensus.cc:2804] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:43.206787  5825 leader_election.cc:304] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.196470  6534 raft_consensus.cc:3060] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.190542  6531 raft_consensus.cc:2749] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.197224  6471 raft_consensus.cc:2749] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.201980  6432 raft_consensus.cc:2764] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:15:43.185249  6498 raft_consensus.cc:515] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:43.204952  6524 raft_consensus.cc:740] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:43.227449  6129 tablet_bootstrap.cc:492] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:43.196852  5975 leader_election.cc:304] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:43.196913  6496 consensus_queue.cc:1048] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:15:43.233805  6132 ts_tablet_manager.cc:1434] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.112s	user 0.009s	sys 0.000s
I20260709 12:15:43.222692  5856 raft_consensus.cc:3060] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.222304  6476 raft_consensus.cc:697] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:43.237116  6476 consensus_queue.cc:237] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:43.228178  5935 raft_consensus.cc:1275] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:43.197026  6530 consensus_queue.cc:1175] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "36dfe581d09b46f6a9bfe678170e71cb" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:15:43.250699  6491 leader_election.cc:290] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:43.251387  6133 ts_tablet_manager.cc:1434] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.218s	user 0.009s	sys 0.000s
I20260709 12:15:43.252758  6133 tablet_bootstrap.cc:492] T 5cb1760bd0ba436eb7077c60542c0a45 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:43.254494  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3cdb9438c4a44489be534e4c1c147b5" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:43.255316  6079 raft_consensus.cc:2468] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:43.267117  5825 leader_election.cc:304] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:43.266990  6532 consensus_queue.cc:1059] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:43.268126  6532 raft_consensus.cc:3055] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:43.268515  6532 raft_consensus.cc:740] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:43.268628  5825 leader_election.cc:304] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: e29106aa83aa4eebb9b87d6745825a27
W20260709 12:15:43.268965  5975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 74689.6us
I20260709 12:15:43.269338  6486 raft_consensus.cc:2749] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:43.269956  6492 raft_consensus.cc:2749] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.269536  6532 consensus_queue.cc:260] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:43.270674  6350 raft_consensus.cc:2764] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:15:43.272055  6132 tablet_bootstrap.cc:492] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:43.271107  6532 raft_consensus.cc:3060] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.271618  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:43.225973  6525 consensus_queue.cc:1059] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:15:43.284864  6128 tablet_bootstrap.cc:492] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:43.285425  6128 ts_tablet_manager.cc:1403] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.662s	user 0.031s	sys 0.020s
W20260709 12:15:43.286651  5899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 82261.9us
I20260709 12:15:43.286721  6485 raft_consensus.cc:515] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:43.291296  6485 leader_election.cc:290] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:43.298542  6524 consensus_queue.cc:260] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:43.299197  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a260b81828b4baab927a2d3f2253be4" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:43.301697  6077 raft_consensus.cc:1240] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Rejecting Update request from peer 58ed30c66c784e06ad64609f8d1b4c43 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:43.305469  6517 raft_consensus.cc:2749] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:43.314190  6491 consensus_queue.cc:1048] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:43.329421  6563 raft_consensus.cc:3055] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:43.329939  6563 raft_consensus.cc:740] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:43.325150  5933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16996642a1b4752b788da1836791f3c" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:43.332327  5933 raft_consensus.cc:2393] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ed30c66c784e06ad64609f8d1b4c43 in current term 1: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
I20260709 12:15:43.320151  6524 raft_consensus.cc:3060] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.347620  6128 raft_consensus.cc:359] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:43.348737  6128 raft_consensus.cc:385] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.349110  6128 raft_consensus.cc:740] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
W20260709 12:15:43.356734  5824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.338614  6485 consensus_queue.cc:1048] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:15:43.357137  6128 consensus_queue.cc:260] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:43.351572  6525 raft_consensus.cc:493] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e29106aa83aa4eebb9b87d6745825a27)
I20260709 12:15:43.362277  5758 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36596 (request call id 59) took 1094 ms. Trace:
I20260709 12:15:43.427330  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a66f01ced34c71b061ec163494f2b6" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:43.434813  6128 ts_tablet_manager.cc:1434] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.149s	user 0.010s	sys 0.000s
I20260709 12:15:43.438585  6133 tablet_bootstrap.cc:654] T 5cb1760bd0ba436eb7077c60542c0a45 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.396781  5758 rpcz_store.cc:276] 0709 12:15:42.268168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:42.268376 (+   208us) service_pool.cc:224] Handling call
0709 12:15:43.362205 (+1093829us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:42.728134 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:42.842149 (+114015us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:42.842188 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:15:42.842206 (+    18us) tablet.cc:662] Decoding operations
0709 12:15:42.842672 (+   466us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:42.842747 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:42.842775 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:15:42.843117 (+   342us) tablet.cc:701] Row locks acquired
0709 12:15:42.843135 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:15:42.843293 (+   158us) write_op.cc:270] Start()
0709 12:15:42.843413 (+   120us) write_op.cc:276] Timestamp: P: 1783599342843248 usec, L: 0
0709 12:15:42.843433 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:15:42.844260 (+   827us) log.cc:844] Serialized 928 byte log entry
0709 12:15:43.148179 (+303919us) op_driver.cc:464] REPLICATION: finished
0709 12:15:43.278072 (+129893us) write_op.cc:301] APPLY: starting
0709 12:15:43.278197 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:43.278380 (+   183us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:43.278606 (+   226us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:43.279098 (+   492us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:43.279368 (+   270us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:15:43.279438 (+    70us) write_op.cc:312] APPLY: finished
0709 12:15:43.279745 (+   307us) log.cc:844] Serialized 28 byte log entry
0709 12:15:43.279950 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:43.280047 (+    97us) write_op.cc:454] Released schema lock
0709 12:15:43.280086 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:43.280464 (+   378us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:43.280497 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":129565,"apply.run_cpu_time_us":2381,"apply.run_wall_time_us":2382,"num_ops":2,"prepare.queue_time_us":192051,"prepare.run_cpu_time_us":3763,"prepare.run_wall_time_us":139145,"replication_time_us":304578,"thread_start_us":178128,"threads_started":2}]]}
I20260709 12:15:43.447106  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33adcece08484ff79fd8711ef5dfd78c" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:43.449013  6132 tablet_bootstrap.cc:654] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.449059  6080 raft_consensus.cc:1240] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Rejecting Update request from peer 58ed30c66c784e06ad64609f8d1b4c43 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:43.431344  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb1760bd0ba436eb7077c60542c0a45" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:43.422610  6563 consensus_queue.cc:260] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:43.451296  6005 raft_consensus.cc:2468] T 5cb1760bd0ba436eb7077c60542c0a45 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 0.
I20260709 12:15:43.452419  6563 raft_consensus.cc:3060] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.458235  6128 tablet_bootstrap.cc:492] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:43.411232  6525 raft_consensus.cc:515] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:43.451331  6129 tablet_bootstrap.cc:654] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.467283  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873d3215e6ba4214a3910fa16e0fd62a" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:43.472707  6491 raft_consensus.cc:493] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.473518  6491 raft_consensus.cc:515] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:43.461606  5858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a260b81828b4baab927a2d3f2253be4" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
W20260709 12:15:43.483036  5975 consensus_peers.cc:597] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:43.495817  6491 leader_election.cc:290] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:43.497850  6525 leader_election.cc:290] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:43.436262  5825 leader_election.cc:304] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.508687  5858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214f52126a2c4bc59473ee7461e4a044" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:43.512522  5858 raft_consensus.cc:2468] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 2.
I20260709 12:15:43.513931  6049 leader_election.cc:304] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:43.515023  6495 raft_consensus.cc:2804] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:43.515435  6495 raft_consensus.cc:493] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.515774  6495 raft_consensus.cc:3060] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:43.519950  6476 raft_consensus.cc:2749] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:43.520362  6525 raft_consensus.cc:493] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.505254  6491 raft_consensus.cc:493] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:43.521175  6560 log.cc:927] Time spent T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:15:43.521081  6525 raft_consensus.cc:515] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:43.521374  6491 raft_consensus.cc:515] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:43.477838  5756 catalog_manager.cc:5697] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 1 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.523932  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16996642a1b4752b788da1836791f3c" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:43.524484  6525 leader_election.cc:290] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:43.528891  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3cdb9438c4a44489be534e4c1c147b5" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:43.529675  6075 raft_consensus.cc:3060] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.533051  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:43.544600  6077 raft_consensus.cc:1240] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Rejecting Update request from peer 26615d25670745d38490e2d6da247d9e for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:43.545462  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d792c0dd53aa459399c3adf5d4f17f58" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
W20260709 12:15:43.520254  5825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 96294.1us
W20260709 12:15:43.548182  5825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.548045  5928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:43.549753  6517 raft_consensus.cc:493] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.550277  6517 raft_consensus.cc:515] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:43.526273  5756 catalog_manager.cc:5697] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } }
I20260709 12:15:43.556165  6498 leader_election.cc:290] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:43.557528  5933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0199e88be05480094c047ed4a193589" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:43.557542  6005 raft_consensus.cc:1275] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:43.560000  6128 tablet_bootstrap.cc:654] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.550952  5927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dad9466c8e40558116511df4c6330e" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:43.564169  6491 leader_election.cc:290] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:43.572357  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16996642a1b4752b788da1836791f3c" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:43.573393  6047 leader_election.cc:304] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.573980  5855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d792c0dd53aa459399c3adf5d4f17f58" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:43.575412  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ace1a67c98413c886c1ce2cfcd66af" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:43.577006  6000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214f52126a2c4bc59473ee7461e4a044" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:43.578814  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a66f01ced34c71b061ec163494f2b6" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:43.580670  6495 raft_consensus.cc:515] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:43.580996  5901 leader_election.cc:304] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.587857  5901 leader_election.cc:304] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.587975  6531 raft_consensus.cc:2749] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.589326  6563 raft_consensus.cc:2749] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.589452  5856 raft_consensus.cc:1275] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.591763  6485 raft_consensus.cc:2749] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.592934  5852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ace1a67c98413c886c1ce2cfcd66af" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:43.594767  5756 catalog_manager.cc:5697] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 1 to 2, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 2 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.615161  5754 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36590 (request call id 61) took 1217 ms. Trace:
I20260709 12:15:43.615756  5754 rpcz_store.cc:276] 0709 12:15:42.397973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:42.398181 (+   208us) service_pool.cc:224] Handling call
0709 12:15:43.615060 (+1216879us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10685,"reported_tablets":7}
W20260709 12:15:43.618291  5806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:43.623466  5899 leader_election.cc:304] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:43.635659  5824 leader_election.cc:304] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.630446  6524 raft_consensus.cc:2749] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:43.624236  6047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 50946.4us
W20260709 12:15:43.650707  6047 leader_election.cc:343] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:43.651387  6047 leader_election.cc:304] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.652305  6491 raft_consensus.cc:2749] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:43.652820  6047 leader_election.cc:304] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
W20260709 12:15:43.653970  6049 leader_election.cc:343] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:43.654167  6496 consensus_queue.cc:1048] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:43.643626  6350 raft_consensus.cc:2749] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.657186  5927 raft_consensus.cc:2468] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 2.
I20260709 12:15:43.658216  6075 raft_consensus.cc:2468] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:43.658228  6531 raft_consensus.cc:2804] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:43.643468  5935 raft_consensus.cc:1240] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Rejecting Update request from peer 58ed30c66c784e06ad64609f8d1b4c43 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:43.659268  6531 raft_consensus.cc:493] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.658898  5756 catalog_manager.cc:5697] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 0 to 2, leader changed from <none> to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 2 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:43.659992  6531 raft_consensus.cc:3060] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.659198  6255 consensus_queue.cc:1048] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:15:43.662972  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43bf33a33b443ba5cf0cdcb741f5fa" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:43.667466  6495 leader_election.cc:290] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:43.667778  5825 leader_election.cc:304] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.630640  6534 consensus_queue.cc:1059] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:15:43.671271  6476 raft_consensus.cc:2749] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.671478  6517 leader_election.cc:290] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:43.671669  6534 raft_consensus.cc:3055] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:43.672118  6534 raft_consensus.cc:740] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:43.670593  5926 raft_consensus.cc:3060] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.672367  6563 raft_consensus.cc:493] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.672983  6563 raft_consensus.cc:515] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:43.673079  6534 consensus_queue.cc:260] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:43.679563  6132 tablet_bootstrap.cc:492] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:43.679731  6534 raft_consensus.cc:3060] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.680297  6132 ts_tablet_manager.cc:1403] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.409s	user 0.027s	sys 0.002s
I20260709 12:15:43.683393  6563 leader_election.cc:290] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:43.670215  5928 raft_consensus.cc:2468] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 2.
I20260709 12:15:43.705853  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c20504b20bf4686afff8a8417bdc035" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:43.694584  6255 raft_consensus.cc:493] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.707007  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c20504b20bf4686afff8a8417bdc035" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:43.706938  6255 raft_consensus.cc:515] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:43.707767  6005 raft_consensus.cc:2468] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 2.
I20260709 12:15:43.709419  6255 leader_election.cc:290] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:43.709043  5825 leader_election.cc:304] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.711732  6531 raft_consensus.cc:515] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:43.712589  5858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214f52126a2c4bc59473ee7461e4a044" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:43.711776  5928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353bf2c0ce2c412e9ca171f2bb150f91" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:43.720621  5928 raft_consensus.cc:2468] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 2.
I20260709 12:15:43.720531  6132 raft_consensus.cc:359] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:43.721487  6132 raft_consensus.cc:385] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.721628  5899 leader_election.cc:304] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:43.721907  6132 raft_consensus.cc:740] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.722467  6048 leader_election.cc:304] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:43.723387  6255 raft_consensus.cc:2804] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:43.723894  6255 raft_consensus.cc:493] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.714632  6531 leader_election.cc:290] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:43.716192  6532 raft_consensus.cc:2804] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:43.724869  6532 raft_consensus.cc:697] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:43.725893  6532 consensus_queue.cc:237] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:43.716001  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb1760bd0ba436eb7077c60542c0a45" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
W20260709 12:15:43.654295  6047 consensus_peers.cc:597] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb -> Peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Couldn't send request to peer e29106aa83aa4eebb9b87d6745825a27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:43.719522  5825 leader_election.cc:304] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.723688  6381 consensus_queue.cc:1048] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:43.724292  6129 tablet_bootstrap.cc:492] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:43.739100  6129 ts_tablet_manager.cc:1403] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.515s	user 0.023s	sys 0.009s
I20260709 12:15:43.719363  6498 consensus_queue.cc:1059] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:43.720461  5858 raft_consensus.cc:3060] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:43.724385  6255 raft_consensus.cc:3060] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:43.756870  6132 consensus_queue.cc:260] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:43.762300  5854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353bf2c0ce2c412e9ca171f2bb150f91" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:43.763582  6132 ts_tablet_manager.cc:1434] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.083s	user 0.009s	sys 0.000s
I20260709 12:15:43.764325  5855 raft_consensus.cc:3060] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.764842  6132 tablet_bootstrap.cc:492] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:43.783725  6128 tablet_bootstrap.cc:492] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:43.784394  6128 ts_tablet_manager.cc:1403] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.326s	user 0.027s	sys 0.002s
W20260709 12:15:43.733676  6047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 79502.4us
I20260709 12:15:43.789099  6047 leader_election.cc:304] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.790565  6047 leader_election.cc:304] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.792140  6491 raft_consensus.cc:2749] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:43.792253  6047 leader_election.cc:343] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:43.792876  6047 leader_election.cc:304] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.792887  6491 raft_consensus.cc:2749] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.794317  6491 consensus_queue.cc:1048] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:43.794579  6493 raft_consensus.cc:2749] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:43.795979  5825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 76556.3us
I20260709 12:15:43.738304  6536 raft_consensus.cc:2804] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:43.759404  6517 raft_consensus.cc:2804] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:43.812222  6128 raft_consensus.cc:359] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:43.799366  6536 raft_consensus.cc:493] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.816890  6128 raft_consensus.cc:385] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.818550  6128 raft_consensus.cc:740] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.814031  6129 raft_consensus.cc:359] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:43.821452  6129 raft_consensus.cc:385] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.822628  6129 raft_consensus.cc:740] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.820673  6536 raft_consensus.cc:3060] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:43.821425  6517 raft_consensus.cc:697] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:43.843261  6133 tablet_bootstrap.cc:492] T 5cb1760bd0ba436eb7077c60542c0a45 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:43.843950  6133 ts_tablet_manager.cc:1403] T 5cb1760bd0ba436eb7077c60542c0a45 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.591s	user 0.011s	sys 0.019s
I20260709 12:15:43.844972  6129 consensus_queue.cc:260] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
W20260709 12:15:43.828022  6048 leader_election.cc:343] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:43.835606  6350 raft_consensus.cc:3055] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:43.856719  6128 consensus_queue.cc:260] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:43.858230  6129 ts_tablet_manager.cc:1434] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.118s	user 0.011s	sys 0.000s
I20260709 12:15:43.863654  6133 raft_consensus.cc:359] T 5cb1760bd0ba436eb7077c60542c0a45 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:43.864661  6133 raft_consensus.cc:385] T 5cb1760bd0ba436eb7077c60542c0a45 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.864972  6133 raft_consensus.cc:740] T 5cb1760bd0ba436eb7077c60542c0a45 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.865450  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214f52126a2c4bc59473ee7461e4a044" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:43.874243  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb1760bd0ba436eb7077c60542c0a45" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:43.875070  6003 raft_consensus.cc:3060] T 5cb1760bd0ba436eb7077c60542c0a45 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.876551  5858 raft_consensus.cc:2468] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 3.
I20260709 12:15:43.878904  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa43bf33a33b443ba5cf0cdcb741f5fa" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:43.879616  6517 consensus_queue.cc:237] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:43.878301  6133 consensus_queue.cc:260] T 5cb1760bd0ba436eb7077c60542c0a45 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:43.902913  6133 ts_tablet_manager.cc:1434] T 5cb1760bd0ba436eb7077c60542c0a45 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.002s
I20260709 12:15:43.904163  6133 tablet_bootstrap.cc:492] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:43.904706  6132 tablet_bootstrap.cc:654] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.909330  6006 raft_consensus.cc:3060] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:43.909812  6128 ts_tablet_manager.cc:1434] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.125s	user 0.009s	sys 0.000s
I20260709 12:15:43.910888  6255 raft_consensus.cc:515] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:43.913304  6255 leader_election.cc:290] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:43.858752  6350 raft_consensus.cc:740] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:43.919656  5824 leader_election.cc:304] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:43.938573  6128 tablet_bootstrap.cc:492] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:43.939757  6049 leader_election.cc:304] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:43.945387  6129 tablet_bootstrap.cc:492] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:43.951040  6381 raft_consensus.cc:493] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:43.951756  6381 raft_consensus.cc:515] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:43.954051  6133 tablet_bootstrap.cc:654] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.939033  6496 raft_consensus.cc:493] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:43.942736  6255 raft_consensus.cc:2804] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:43.971364  6255 raft_consensus.cc:697] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:15:43.972462  6255 consensus_queue.cc:237] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:43.976140  6517 consensus_queue.cc:1048] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:15:43.954051  6381 leader_election.cc:290] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:43.956133  5930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:43.954811  5931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353bf2c0ce2c412e9ca171f2bb150f91" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:43.940938  6502 raft_consensus.cc:493] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:43.954288  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353bf2c0ce2c412e9ca171f2bb150f91" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:43.981699  5930 raft_consensus.cc:2393] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 2: Already voted for candidate 58ed30c66c784e06ad64609f8d1b4c43 in this term.
I20260709 12:15:43.991362  6132 tablet_bootstrap.cc:492] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:43.991937  6132 ts_tablet_manager.cc:1403] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.227s	user 0.020s	sys 0.005s
I20260709 12:15:43.986858  5931 raft_consensus.cc:3060] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:43.995396  6491 raft_consensus.cc:493] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.989573  6502 raft_consensus.cc:515] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:43.989367  6476 raft_consensus.cc:2749] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:43.979941  6003 raft_consensus.cc:2468] T 5cb1760bd0ba436eb7077c60542c0a45 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:43.980628  6496 raft_consensus.cc:515] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:44.002370  6502 leader_election.cc:290] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:44.023957  6536 raft_consensus.cc:515] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:44.001807  6491 raft_consensus.cc:515] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:44.028738  5930 raft_consensus.cc:1240] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Rejecting Update request from peer 58ed30c66c784e06ad64609f8d1b4c43 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:44.040864  6132 raft_consensus.cc:359] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:44.041756  6132 raft_consensus.cc:385] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.042037  6132 raft_consensus.cc:740] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.044224  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c20504b20bf4686afff8a8417bdc035" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:44.044919  6076 raft_consensus.cc:3060] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.030983  6350 consensus_queue.cc:260] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:44.046757  6350 raft_consensus.cc:3060] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:44.049865  6128 tablet_bootstrap.cc:654] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.043356  6132 consensus_queue.cc:260] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
W20260709 12:15:44.025926  5973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 47887.5us
I20260709 12:15:44.043973  6536 leader_election.cc:290] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:44.075424  6129 tablet_bootstrap.cc:654] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.075030  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c20504b20bf4686afff8a8417bdc035" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:44.077613  6496 leader_election.cc:290] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:44.078933  5928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:44.079694  5928 raft_consensus.cc:2468] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 2.
I20260709 12:15:44.078946  6495 raft_consensus.cc:493] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:44.082374  6495 raft_consensus.cc:515] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:44.085508  6132 ts_tablet_manager.cc:1434] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.093s	user 0.010s	sys 0.000s
I20260709 12:15:44.078155  6003 raft_consensus.cc:3060] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.087198  6132 tablet_bootstrap.cc:492] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:44.087720  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:44.088591  5928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7299ddfb5eb4240b757da7c444170c9" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:44.089018  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214f52126a2c4bc59473ee7461e4a044" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:44.089320  6495 leader_election.cc:290] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:44.088644  6082 raft_consensus.cc:2393] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 2: Already voted for candidate 36dfe581d09b46f6a9bfe678170e71cb in this term.
I20260709 12:15:44.093472  5928 raft_consensus.cc:2468] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 2.
I20260709 12:15:44.095472  6048 leader_election.cc:304] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:44.096743  6495 raft_consensus.cc:2804] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:44.097209  6495 raft_consensus.cc:493] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:44.097646  6495 raft_consensus.cc:3060] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:44.101038  5974 leader_election.cc:304] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb
W20260709 12:15:44.101444  5975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 135259us
I20260709 12:15:44.113968  5858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214f52126a2c4bc59473ee7461e4a044" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:44.114895  5858 raft_consensus.cc:2368] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 for earlier term 2. Current term is 3.
I20260709 12:15:44.117410  6000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7299ddfb5eb4240b757da7c444170c9" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:44.118366  6000 raft_consensus.cc:2393] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb in current term 2: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
I20260709 12:15:44.119392  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4c5dd41465429eab21af474b88bc05" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:44.120898  6491 leader_election.cc:290] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:44.121727  6076 raft_consensus.cc:2468] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 3.
I20260709 12:15:44.123720  5899 leader_election.cc:304] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:44.124601  6536 raft_consensus.cc:2804] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:44.125161  6536 raft_consensus.cc:697] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 3 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:44.126010  6536 consensus_queue.cc:237] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:44.125789  5754 catalog_manager.cc:5697] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:44.126796  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:44.131817  6559 raft_consensus.cc:2804] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:44.132373  5756 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36612 (request call id 69) took 1079 ms. Trace:
I20260709 12:15:44.132498  6559 raft_consensus.cc:493] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:44.133145  6559 raft_consensus.cc:3060] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:44.132884  5756 rpcz_store.cc:276] 0709 12:15:43.053228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:43.053404 (+   176us) service_pool.cc:224] Handling call
0709 12:15:44.132300 (+1078896us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:43.827579 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:43.877124 (+ 49545us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:43.877166 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:15:43.877183 (+    17us) tablet.cc:662] Decoding operations
0709 12:15:43.877861 (+   678us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:43.877930 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:43.877959 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:15:43.878351 (+   392us) tablet.cc:701] Row locks acquired
0709 12:15:43.878375 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:15:43.878551 (+   176us) write_op.cc:270] Start()
0709 12:15:43.878675 (+   124us) write_op.cc:276] Timestamp: P: 1783599343878507 usec, L: 0
0709 12:15:43.878696 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:15:43.879414 (+   718us) log.cc:844] Serialized 1705 byte log entry
0709 12:15:43.928162 (+ 48748us) op_driver.cc:464] REPLICATION: finished
0709 12:15:44.012421 (+ 84259us) write_op.cc:301] APPLY: starting
0709 12:15:44.012543 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:44.012704 (+   161us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:44.014715 (+  2011us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:44.040806 (+ 26091us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:44.041085 (+   279us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:15:44.041162 (+    77us) write_op.cc:312] APPLY: finished
0709 12:15:44.041463 (+   301us) log.cc:844] Serialized 40 byte log entry
0709 12:15:44.041696 (+   233us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:44.041868 (+   172us) write_op.cc:454] Released schema lock
0709 12:15:44.041935 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:44.042492 (+   557us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:44.042540 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":85972,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":83907,"apply.run_cpu_time_us":3398,"apply.run_wall_time_us":30023,"num_ops":4,"prepare.queue_time_us":131167,"prepare.run_cpu_time_us":3896,"prepare.run_wall_time_us":61638,"replication_time_us":49246,"thread_start_us":141760,"threads_started":2}]]}
I20260709 12:15:44.128841  5754 catalog_manager.cc:5697] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:44.144152  5931 raft_consensus.cc:2468] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 3.
I20260709 12:15:44.153525  6132 tablet_bootstrap.cc:654] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.195955  5975 leader_election.cc:400] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243) with higher term. Message: Invalid argument: T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 for earlier term 2. Current term is 3.
I20260709 12:15:44.196671  5975 leader_election.cc:403] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:44.198504  6047 leader_election.cc:304] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
W20260709 12:15:44.206585  5824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 248678us
I20260709 12:15:44.189905  6563 raft_consensus.cc:493] T 5cb1760bd0ba436eb7077c60542c0a45 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:44.209657  5975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 62627.3us
I20260709 12:15:44.216245  5975 leader_election.cc:304] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:44.203284  6531 raft_consensus.cc:2804] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:15:44.222455  6047 leader_election.cc:343] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.213039  6470 raft_consensus.cc:3060] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.225190  6519 raft_consensus.cc:493] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.235307  6519 raft_consensus.cc:515] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:44.237203  6129 tablet_bootstrap.cc:492] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:44.237493  5855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4c5dd41465429eab21af474b88bc05" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:44.237787  6519 leader_election.cc:290] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:44.239984  6133 tablet_bootstrap.cc:492] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:44.240234  6531 raft_consensus.cc:697] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:15:44.240569  6133 ts_tablet_manager.cc:1403] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.337s	user 0.010s	sys 0.007s
I20260709 12:15:44.213168  6563 raft_consensus.cc:515] T 5cb1760bd0ba436eb7077c60542c0a45 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:44.201664  6048 leader_election.cc:304] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:44.218457  6595 raft_consensus.cc:3060] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:44.211509  6350 consensus_queue.cc:1048] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:15:44.237844  6129 ts_tablet_manager.cc:1403] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.293s	user 0.045s	sys 0.025s
I20260709 12:15:44.241508  6531 consensus_queue.cc:237] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:44.256546  5928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c61591bbcaf43839af1cc8373f98c7e" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:44.257827  5755 catalog_manager.cc:5697] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 1 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:44.259644  6563 leader_election.cc:290] T 5cb1760bd0ba436eb7077c60542c0a45 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:44.262626  6128 tablet_bootstrap.cc:492] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:44.242230  6003 raft_consensus.cc:2468] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 3.
I20260709 12:15:44.263218  6128 ts_tablet_manager.cc:1403] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.348s	user 0.022s	sys 0.002s
I20260709 12:15:44.268302  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb1760bd0ba436eb7077c60542c0a45" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:44.271407  6007 raft_consensus.cc:2393] T 5cb1760bd0ba436eb7077c60542c0a45 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26615d25670745d38490e2d6da247d9e in current term 1: Already voted for candidate 36dfe581d09b46f6a9bfe678170e71cb in this term.
I20260709 12:15:44.275554  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c61591bbcaf43839af1cc8373f98c7e" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:44.276372  6007 raft_consensus.cc:2468] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:44.282624  6003 raft_consensus.cc:1275] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:44.284355  6048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 91550.9us
I20260709 12:15:44.284996  6494 raft_consensus.cc:2804] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:44.284433  6255 raft_consensus.cc:493] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
W20260709 12:15:44.294597  5825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 49427.4us
I20260709 12:15:44.300500  5824 leader_election.cc:304] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:44.330873  6255 raft_consensus.cc:515] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:44.333017  6128 raft_consensus.cc:359] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:44.333894  6128 raft_consensus.cc:385] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.334188  6128 raft_consensus.cc:740] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.334463  6517 raft_consensus.cc:2804] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:44.335134  6255 leader_election.cc:290] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:44.334949  6128 consensus_queue.cc:260] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:44.335543  6592 raft_consensus.cc:493] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.329861  5758 catalog_manager.cc:5697] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:44.327744  6049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 43716.4us
I20260709 12:15:44.339917  6133 raft_consensus.cc:359] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:44.343271  6133 raft_consensus.cc:385] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.343871  6133 raft_consensus.cc:740] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.345778  6128 ts_tablet_manager.cc:1434] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.001s
I20260709 12:15:44.336483  6494 raft_consensus.cc:697] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:15:44.347431  6494 consensus_queue.cc:237] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:44.349247  6132 tablet_bootstrap.cc:492] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:44.349854  6132 ts_tablet_manager.cc:1403] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.263s	user 0.020s	sys 0.022s
I20260709 12:15:44.331385  6470 raft_consensus.cc:2749] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243) with higher term. Message: Invalid argument: T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 for earlier term 2. Current term is 3.
W20260709 12:15:44.341137  6049 leader_election.cc:343] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.354310  6049 leader_election.cc:304] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:44.334918  6517 raft_consensus.cc:493] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.336064  6592 raft_consensus.cc:515] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:44.366110  6599 consensus_queue.cc:1048] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 12:15:44.371991  5825 leader_election.cc:343] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.363379  6517 raft_consensus.cc:3060] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.368378  6132 raft_consensus.cc:359] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:44.375313  6132 raft_consensus.cc:385] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.375773  6132 raft_consensus.cc:740] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.376732  6595 raft_consensus.cc:2749] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:44.379794  6133 consensus_queue.cc:260] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:44.382697  5930 raft_consensus.cc:1275] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:44.382927  6129 raft_consensus.cc:359] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:44.384034  6129 raft_consensus.cc:385] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.384434  6129 raft_consensus.cc:740] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.384630  6495 raft_consensus.cc:515] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:44.385427  6129 consensus_queue.cc:260] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:44.388367  6495 leader_election.cc:290] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:44.376709  6132 consensus_queue.cc:260] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:44.361886  6491 raft_consensus.cc:2749] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:44.396019  6519 raft_consensus.cc:493] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.403196  6519 raft_consensus.cc:515] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:44.403901  6133 ts_tablet_manager.cc:1434] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.163s	user 0.010s	sys 0.001s
I20260709 12:15:44.404592  6000 raft_consensus.cc:1275] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:44.405887  6519 leader_election.cc:290] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:44.394207  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb1760bd0ba436eb7077c60542c0a45" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:44.410658  6002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd00b832aafb491387eee88b954ff5df" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:44.411662  6002 raft_consensus.cc:2393] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb in current term 2: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
I20260709 12:15:44.412724  6495 raft_consensus.cc:493] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.413596  6495 raft_consensus.cc:515] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:44.406684  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7299ddfb5eb4240b757da7c444170c9" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:44.400493  6255 raft_consensus.cc:493] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.424510  6006 raft_consensus.cc:2393] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb in current term 2: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
I20260709 12:15:44.427444  5928 raft_consensus.cc:1275] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:44.429332  6592 leader_election.cc:290] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:44.429651  6532 consensus_queue.cc:1048] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:44.430349  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219ee6e67c3a4adf9dd72198036646bc" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:44.431118  6080 raft_consensus.cc:2468] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:44.432175  6128 tablet_bootstrap.cc:492] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:44.432216  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7299ddfb5eb4240b757da7c444170c9" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:44.432987  5824 leader_election.cc:304] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:44.433151  5929 raft_consensus.cc:2468] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 2.
I20260709 12:15:44.434558  6255 raft_consensus.cc:515] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:44.437347  6255 leader_election.cc:290] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:44.438100  6599 raft_consensus.cc:2804] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:44.438599  6599 raft_consensus.cc:493] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.438964  6599 raft_consensus.cc:3060] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.445160  6132 ts_tablet_manager.cc:1434] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.095s	user 0.009s	sys 0.002s
I20260709 12:15:44.442703  5974 leader_election.cc:304] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:44.396610  6476 consensus_queue.cc:1048] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:15:44.445914  6350 consensus_queue.cc:1048] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:15:44.454301  6593 raft_consensus.cc:2804] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:44.454829  6593 raft_consensus.cc:493] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.455224  6593 raft_consensus.cc:3060] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.459910  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ede3276c3746638e321c76e4794c86" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:44.461364  6133 tablet_bootstrap.cc:492] T 4ec4d35ac70348cb95a01355320f5686 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:44.464046  6129 ts_tablet_manager.cc:1434] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.208s	user 0.007s	sys 0.003s
I20260709 12:15:44.412372  6559 raft_consensus.cc:515] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:44.486452  6128 tablet_bootstrap.cc:654] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.491643  6129 tablet_bootstrap.cc:492] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:44.505390  6593 raft_consensus.cc:515] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:44.508488  6593 leader_election.cc:290] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:44.513870  5930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219ee6e67c3a4adf9dd72198036646bc" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:44.515139  6559 leader_election.cc:290] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:44.520946  6495 leader_election.cc:290] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:44.526944  6517 raft_consensus.cc:515] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:44.528595  6563 raft_consensus.cc:493] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.529466  6517 leader_election.cc:290] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:44.529234  6563 raft_consensus.cc:515] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:44.531709  6563 leader_election.cc:290] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
W20260709 12:15:44.535315  6047 leader_election.cc:343] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:44.535475  5825 leader_election.cc:343] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.536860  6532 raft_consensus.cc:493] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.537638  6532 raft_consensus.cc:515] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:44.541810  5931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c61591bbcaf43839af1cc8373f98c7e" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:44.542186  5930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:44.543320  5930 raft_consensus.cc:2468] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 2.
W20260709 12:15:44.543915  5825 leader_election.cc:343] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.544880  5825 leader_election.cc:304] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:44.545215  6133 tablet_bootstrap.cc:654] T 4ec4d35ac70348cb95a01355320f5686 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.545050  6532 leader_election.cc:290] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:44.546098  6540 raft_consensus.cc:2804] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:44.546660  6540 raft_consensus.cc:493] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.547098  6540 raft_consensus.cc:3060] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.551172  5926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7299ddfb5eb4240b757da7c444170c9" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:44.551977  5926 raft_consensus.cc:3060] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.552372  5931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7299ddfb5eb4240b757da7c444170c9" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:44.553041  5927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ede3276c3746638e321c76e4794c86" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:44.554858  5930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd00b832aafb491387eee88b954ff5df" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:44.555886  5930 raft_consensus.cc:2468] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 2.
I20260709 12:15:44.559497  6350 raft_consensus.cc:493] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.560173  6350 raft_consensus.cc:515] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:44.564178  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e5dfe30b74c94b9753cf4c647695f" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:44.560302  6540 raft_consensus.cc:515] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:44.565079  6006 raft_consensus.cc:2468] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 2.
I20260709 12:15:44.566504  5899 leader_election.cc:304] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:44.567695  6563 raft_consensus.cc:2804] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:44.568224  6563 raft_consensus.cc:493] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.568614  6563 raft_consensus.cc:3060] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.575834  6048 leader_election.cc:304] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:44.577034  6495 raft_consensus.cc:2749] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:44.579909  6350 leader_election.cc:290] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:44.595898  6132 tablet_bootstrap.cc:492] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb: Bootstrap starting.
I20260709 12:15:44.604350  6129 tablet_bootstrap.cc:654] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.618490  5899 leader_election.cc:304] T 5cb1760bd0ba436eb7077c60542c0a45 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:44.561362  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:44.595588  6540 leader_election.cc:290] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 3 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:44.661382  5926 raft_consensus.cc:2468] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 3.
I20260709 12:15:44.627220  5930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:44.663057  5930 raft_consensus.cc:3060] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.625209  6536 raft_consensus.cc:3060] T 5cb1760bd0ba436eb7077c60542c0a45 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.672196  6004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:44.673101  6004 raft_consensus.cc:2468] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 2.
I20260709 12:15:44.674547  6005 raft_consensus.cc:1275] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:44.676256  5855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d9e90868894fa78e9f94ca432dc703" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:44.677138  5856 raft_consensus.cc:1275] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:44.677867  6495 consensus_queue.cc:1048] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:15:44.678484  6049 leader_election.cc:343] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.682575  6495 consensus_queue.cc:1048] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:44.686933  6476 raft_consensus.cc:493] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:44.687603  6476 raft_consensus.cc:515] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:44.582311  6599 raft_consensus.cc:515] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:44.672708  6563 raft_consensus.cc:515] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:44.649178  5756 catalog_manager.cc:5697] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 1 to 3, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 3 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:44.622623  6048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 47409.4us
I20260709 12:15:44.707576  6078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353bf2c0ce2c412e9ca171f2bb150f91" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:44.708397  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7299ddfb5eb4240b757da7c444170c9" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:44.708901  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:44.701859  5974 leader_election.cc:304] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:44.709790  5926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353bf2c0ce2c412e9ca171f2bb150f91" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:44.712682  6132 tablet_bootstrap.cc:654] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.717198  5824 leader_election.cc:304] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:44.721390  6470 raft_consensus.cc:2804] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:44.724488  6078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219ee6e67c3a4adf9dd72198036646bc" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:44.725339  6470 raft_consensus.cc:697] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 3 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:44.725453  6078 raft_consensus.cc:3060] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.726519  6470 consensus_queue.cc:237] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:44.732383  6563 leader_election.cc:290] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:44.707641  6599 leader_election.cc:290] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:44.702621  6476 leader_election.cc:290] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:44.768038  5858 raft_consensus.cc:3060] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.768812  5930 raft_consensus.cc:2468] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 3.
I20260709 12:15:44.769544  6078 raft_consensus.cc:2468] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:44.772078  6129 tablet_bootstrap.cc:492] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:44.772656  6129 ts_tablet_manager.cc:1403] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.281s	user 0.025s	sys 0.019s
I20260709 12:15:44.772770  6077 raft_consensus.cc:1275] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:44.721688  6079 raft_consensus.cc:3060] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.734741  6080 raft_consensus.cc:3060] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.741343  6498 raft_consensus.cc:2804] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:44.779505  6498 raft_consensus.cc:493] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.779913  6498 raft_consensus.cc:3060] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.758297  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7299ddfb5eb4240b757da7c444170c9" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:44.758950  5926 raft_consensus.cc:2368] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ed30c66c784e06ad64609f8d1b4c43 for earlier term 2. Current term is 3.
I20260709 12:15:44.759637  6074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
W20260709 12:15:44.738547  6048 leader_election.cc:343] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.763731  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e5dfe30b74c94b9753cf4c647695f" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:44.764714  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:44.765673  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:44.803202  6074 raft_consensus.cc:2393] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 2: Already voted for candidate 36dfe581d09b46f6a9bfe678170e71cb in this term.
I20260709 12:15:44.806303  6079 raft_consensus.cc:2468] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 3.
W20260709 12:15:44.809453  6612 log.cc:927] Time spent T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:15:44.815918  5824 leader_election.cc:304] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:44.818796  6048 leader_election.cc:304] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:44.856077  6532 raft_consensus.cc:2804] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:44.856782  6532 raft_consensus.cc:697] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:44.819341  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c61591bbcaf43839af1cc8373f98c7e" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:44.863430  6009 raft_consensus.cc:3060] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.813886  6129 raft_consensus.cc:359] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
W20260709 12:15:44.851918  5899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 141936us
I20260709 12:15:44.869694  6129 raft_consensus.cc:385] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.870085  6129 raft_consensus.cc:740] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.870822  6129 consensus_queue.cc:260] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:44.873678  6129 ts_tablet_manager.cc:1434] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.101s	user 0.008s	sys 0.000s
I20260709 12:15:44.785009  5935 raft_consensus.cc:2468] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 2.
I20260709 12:15:44.879473  6129 tablet_bootstrap.cc:492] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:44.857736  6532 consensus_queue.cc:237] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:44.883741  5974 leader_election.cc:304] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:44.854200  6534 raft_consensus.cc:493] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.844108  6083 raft_consensus.cc:2468] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:44.891464  6610 raft_consensus.cc:2749] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:44.897437  6432 raft_consensus.cc:2804] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:15:44.925138  6613 log.cc:927] Time spent T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e: Append to log took a long time: real 0.201s	user 0.003s	sys 0.000s
I20260709 12:15:44.949924  5930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219ee6e67c3a4adf9dd72198036646bc" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
W20260709 12:15:44.906751  6048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 171556us
I20260709 12:15:44.899987  6534 raft_consensus.cc:515] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
W20260709 12:15:44.962987  5806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:44.968497  6536 raft_consensus.cc:2749] T 5cb1760bd0ba436eb7077c60542c0a45 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:44.961526  6432 raft_consensus.cc:697] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 2 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:44.971266  6496 raft_consensus.cc:493] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.971326  6132 tablet_bootstrap.cc:492] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb: No bootstrap required, opened a new log
I20260709 12:15:44.918720  5825 leader_election.cc:304] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:44.989749  6128 tablet_bootstrap.cc:492] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
W20260709 12:15:44.997653  5899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 124059us
I20260709 12:15:44.998440  6128 ts_tablet_manager.cc:1403] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.583s	user 0.029s	sys 0.015s
I20260709 12:15:44.935015  6598 raft_consensus.cc:493] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.995956  6132 ts_tablet_manager.cc:1403] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb: Time spent bootstrapping tablet: real 0.531s	user 0.016s	sys 0.006s
I20260709 12:15:44.974156  6133 tablet_bootstrap.cc:492] T 4ec4d35ac70348cb95a01355320f5686 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:44.999766  6133 ts_tablet_manager.cc:1403] T 4ec4d35ac70348cb95a01355320f5686 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.550s	user 0.031s	sys 0.022s
I20260709 12:15:44.956884  6563 consensus_queue.cc:1048] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:15:44.974291  6009 raft_consensus.cc:2468] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:44.997605  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e5dfe30b74c94b9753cf4c647695f" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:45.010167  6350 raft_consensus.cc:2804] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:15:45.009392  5825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 105049us
I20260709 12:15:45.012284  6080 raft_consensus.cc:2468] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 3.
I20260709 12:15:45.001025  6496 raft_consensus.cc:515] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:45.021780  6076 raft_consensus.cc:3060] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.005404  6598 raft_consensus.cc:515] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:45.035996  6350 raft_consensus.cc:697] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:45.020752  6048 leader_election.cc:304] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:45.050923  6133 raft_consensus.cc:359] T 4ec4d35ac70348cb95a01355320f5686 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:45.073000  6133 raft_consensus.cc:385] T 4ec4d35ac70348cb95a01355320f5686 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.073438  6133 raft_consensus.cc:740] T 4ec4d35ac70348cb95a01355320f5686 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.077085  5824 leader_election.cc:304] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:45.082943  6132 raft_consensus.cc:359] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:45.084057  6132 raft_consensus.cc:385] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.084411  6132 raft_consensus.cc:740] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.085880  6132 consensus_queue.cc:260] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:45.037856  6610 raft_consensus.cc:493] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:45.050379  6003 raft_consensus.cc:1275] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:45.062686  6615 raft_consensus.cc:2804] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:45.097590  6128 raft_consensus.cc:359] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:45.101487  6598 leader_election.cc:290] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:45.053391  6534 leader_election.cc:290] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:45.057374  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e5dfe30b74c94b9753cf4c647695f" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:45.051591  5825 leader_election.cc:400] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793) with higher term. Message: Invalid argument: T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ed30c66c784e06ad64609f8d1b4c43 for earlier term 2. Current term is 3.
I20260709 12:15:45.060142  5853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a300304455c4851b24de418128a28d0" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:45.102301  6129 tablet_bootstrap.cc:654] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.110545  6128 raft_consensus.cc:385] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.118535  6128 raft_consensus.cc:740] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.119761  6128 consensus_queue.cc:260] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:45.111608  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a300304455c4851b24de418128a28d0" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:45.095887  6604 raft_consensus.cc:2804] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:45.112697  6629 consensus_queue.cc:1048] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:45.102866  6133 consensus_queue.cc:260] T 4ec4d35ac70348cb95a01355320f5686 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
W20260709 12:15:45.059214  6048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 49102.5us
I20260709 12:15:45.036671  6432 consensus_queue.cc:237] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:45.123471  5930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec4d35ac70348cb95a01355320f5686" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:45.126041  5930 raft_consensus.cc:2468] T 4ec4d35ac70348cb95a01355320f5686 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:45.051395  6350 consensus_queue.cc:237] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
W20260709 12:15:45.127956  5901 leader_election.cc:343] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.121484  6008 raft_consensus.cc:2468] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 0.
I20260709 12:15:45.131007  6128 ts_tablet_manager.cc:1434] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.132s	user 0.009s	sys 0.000s
I20260709 12:15:45.132069  6531 consensus_queue.cc:1048] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:45.141289  5899 leader_election.cc:304] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:45.134675  6604 raft_consensus.cc:697] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:45.143702  6604 consensus_queue.cc:237] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:45.145660  6133 ts_tablet_manager.cc:1434] T 4ec4d35ac70348cb95a01355320f5686 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.146s	user 0.009s	sys 0.002s
I20260709 12:15:45.135181  6005 raft_consensus.cc:3060] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.148393  6495 raft_consensus.cc:493] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.148954  6495 raft_consensus.cc:515] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:45.149524  5929 raft_consensus.cc:1275] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:45.151310  6495 leader_election.cc:290] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:45.152894  6498 raft_consensus.cc:515] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:45.153493  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d9e90868894fa78e9f94ca432dc703" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:45.155305  6498 leader_election.cc:290] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 3 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:45.156314  5855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f502ef9684f1b8a6c29e9010f9ed5" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:45.156903  6563 raft_consensus.cc:2804] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:45.157388  6563 raft_consensus.cc:493] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.157738  6563 raft_consensus.cc:3060] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.161098  5858 raft_consensus.cc:1275] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:45.161306  5974 leader_election.cc:304] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:45.163498  6562 raft_consensus.cc:2804] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:45.163946  6562 raft_consensus.cc:493] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.164292  6562 raft_consensus.cc:3060] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.122514  5825 leader_election.cc:403] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:45.116969  6610 raft_consensus.cc:515] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
W20260709 12:15:45.167163  5825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 128014us
W20260709 12:15:45.168872  5825 leader_election.cc:343] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.169443  6610 leader_election.cc:290] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
W20260709 12:15:45.170637  6048 leader_election.cc:343] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.170204  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f502ef9684f1b8a6c29e9010f9ed5" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:45.171365  6048 leader_election.cc:304] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:45.173115  6531 consensus_queue.cc:1048] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:45.174613  6133 tablet_bootstrap.cc:492] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:45.110062  6615 raft_consensus.cc:493] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26615d25670745d38490e2d6da247d9e)
I20260709 12:15:45.179028  6615 raft_consensus.cc:3060] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.179286  6594 raft_consensus.cc:493] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.179931  6594 raft_consensus.cc:515] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:45.183100  5853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:45.184029  5853 raft_consensus.cc:2368] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb for earlier term 2. Current term is 3.
I20260709 12:15:45.186980  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd00b832aafb491387eee88b954ff5df" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:45.189983  5932 raft_consensus.cc:2468] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 2.
I20260709 12:15:45.193641  5974 leader_election.cc:304] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:45.193827  6610 consensus_queue.cc:1048] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:45.194808  6591 raft_consensus.cc:2804] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:45.195240  6591 raft_consensus.cc:493] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.195591  6591 raft_consensus.cc:3060] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.197008  6594 leader_election.cc:290] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:45.215433  6128 tablet_bootstrap.cc:492] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
W20260709 12:15:45.214512  5824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 131638us
I20260709 12:15:45.184104  6531 raft_consensus.cc:2749] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:45.234550  6074 raft_consensus.cc:1275] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Refusing update from remote peer e29106aa83aa4eebb9b87d6745825a27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:45.239604  6496 leader_election.cc:290] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:45.242043  6582 raft_consensus.cc:2749] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793) with higher term. Message: Invalid argument: T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ed30c66c784e06ad64609f8d1b4c43 for earlier term 2. Current term is 3.
W20260709 12:15:45.246261  6049 leader_election.cc:343] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.214736  6595 raft_consensus.cc:493] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:45.251297  6132 ts_tablet_manager.cc:1434] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb: Time spent starting tablet: real 0.252s	user 0.016s	sys 0.008s
I20260709 12:15:45.253010  6049 leader_election.cc:400] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Vote denied by peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243) with higher term. Message: Invalid argument: T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb for earlier term 2. Current term is 3.
I20260709 12:15:45.253559  6049 leader_election.cc:403] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:45.224017  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:45.279304  6493 consensus_queue.cc:1048] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:15:45.285099  6002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:45.257618  6494 raft_consensus.cc:3060] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:15:45.300422  6049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 45569.4us
W20260709 12:15:45.269111  6048 leader_election.cc:343] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.282698  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd00b832aafb491387eee88b954ff5df" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:45.315634  6006 raft_consensus.cc:2393] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb in current term 2: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
I20260709 12:15:45.260536  6595 raft_consensus.cc:515] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:45.268803  6563 raft_consensus.cc:515] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:45.334831  6133 tablet_bootstrap.cc:654] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:45.340862  6639 log.cc:927] Time spent T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:15:45.342093  6636 raft_consensus.cc:493] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.342738  6636 raft_consensus.cc:515] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:45.345206  6636 leader_election.cc:290] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:45.326224  6048 leader_election.cc:304] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:45.347859  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:45.349587  6563 leader_election.cc:290] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:45.349858  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a300304455c4851b24de418128a28d0" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:45.350715  5932 raft_consensus.cc:2393] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 1: Already voted for candidate 26615d25670745d38490e2d6da247d9e in this term.
I20260709 12:15:45.351792  6595 leader_election.cc:290] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:45.354225  6129 tablet_bootstrap.cc:492] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:45.354846  6129 ts_tablet_manager.cc:1403] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.480s	user 0.021s	sys 0.009s
I20260709 12:15:45.356913  6645 raft_consensus.cc:493] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.357523  6645 raft_consensus.cc:515] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:45.359946  6645 leader_election.cc:290] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:45.361064  6615 raft_consensus.cc:515] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:45.363247  6083 raft_consensus.cc:2468] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 2.
I20260709 12:15:45.364876  6076 raft_consensus.cc:2468] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 3.
I20260709 12:15:45.336418  6381 consensus_queue.cc:1048] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:15:45.368765  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a300304455c4851b24de418128a28d0" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:45.370476  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec4d35ac70348cb95a01355320f5686" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:45.371268  6077 raft_consensus.cc:2468] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:45.378013  6531 raft_consensus.cc:493] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.378677  6531 raft_consensus.cc:515] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:45.381233  6531 leader_election.cc:290] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:45.382791  6002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859eab84f0fb443ba4bd2cccf81cbe3e" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
W20260709 12:15:45.383020  6048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 122887us
I20260709 12:15:45.383527  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a300304455c4851b24de418128a28d0" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:45.384320  6008 raft_consensus.cc:3060] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.385284  6493 raft_consensus.cc:2749] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:45.392976  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33adcece08484ff79fd8711ef5dfd78c" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
W20260709 12:15:45.401883  6047 leader_election.cc:343] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:45.403543  6047 leader_election.cc:343] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:45.404917  5824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 103836us
I20260709 12:15:45.405977  5899 leader_election.cc:304] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:45.406658  5754 catalog_manager.cc:5697] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.417037  6128 tablet_bootstrap.cc:654] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.421451  5930 raft_consensus.cc:1275] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Refusing update from remote peer e29106aa83aa4eebb9b87d6745825a27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:45.342151  6005 raft_consensus.cc:2468] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 3.
I20260709 12:15:45.400485  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500f59123914ed198a39756117b4110" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:45.440017  6129 raft_consensus.cc:359] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:45.450489  6129 raft_consensus.cc:385] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.450889  6129 raft_consensus.cc:740] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
W20260709 12:15:45.450941  5975 leader_election.cc:343] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.451741  5975 leader_election.cc:304] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:45.415310  6534 raft_consensus.cc:2804] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:45.453361  6129 consensus_queue.cc:260] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
W20260709 12:15:45.517628  5975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 58437.9us
I20260709 12:15:45.436823  5927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a260b81828b4baab927a2d3f2253be4" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:45.448357  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a300304455c4851b24de418128a28d0" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:45.539702  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500f59123914ed198a39756117b4110" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
W20260709 12:15:45.546782  6049 leader_election.cc:343] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.519057  6518 raft_consensus.cc:493] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.518499  6534 raft_consensus.cc:697] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 3 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:45.551753  6129 ts_tablet_manager.cc:1434] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.197s	user 0.008s	sys 0.001s
I20260709 12:15:45.455209  6598 consensus_queue.cc:1048] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 12:15:45.459808  6591 raft_consensus.cc:515] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
W20260709 12:15:45.532169  6048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 74088.4us
W20260709 12:15:45.601315  6048 leader_election.cc:343] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.601961  6048 leader_election.cc:304] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:45.594496  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd00b832aafb491387eee88b954ff5df" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:45.596341  5928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33adcece08484ff79fd8711ef5dfd78c" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:45.614431  6531 raft_consensus.cc:2749] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:45.590792  5927 raft_consensus.cc:2393] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 2: Already voted for candidate 26615d25670745d38490e2d6da247d9e in this term.
I20260709 12:15:45.615464  6008 raft_consensus.cc:2468] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:45.616647  6496 raft_consensus.cc:2749] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:45.619346  6534 consensus_queue.cc:237] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:45.620857  5854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859eab84f0fb443ba4bd2cccf81cbe3e" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:45.550858  6615 leader_election.cc:290] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:45.536552  6562 raft_consensus.cc:515] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:45.625730  6076 raft_consensus.cc:1275] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:45.626281  6562 leader_election.cc:290] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:45.558035  6518 raft_consensus.cc:515] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
W20260709 12:15:45.627470  5901 leader_election.cc:343] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.625821  6133 tablet_bootstrap.cc:492] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
W20260709 12:15:45.535288  5973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 84384us
I20260709 12:15:45.631744  6133 ts_tablet_manager.cc:1403] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.457s	user 0.020s	sys 0.033s
I20260709 12:15:45.633661  6591 leader_election.cc:290] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:45.634980  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ace1a67c98413c886c1ce2cfcd66af" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:45.629021  6518 leader_election.cc:290] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:45.643365  6129 tablet_bootstrap.cc:492] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:45.652741  5899 leader_election.cc:304] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:45.631681  5858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a260b81828b4baab927a2d3f2253be4" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
W20260709 12:15:45.690791  6049 leader_election.cc:343] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.648789  6081 raft_consensus.cc:2468] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:45.691854  6049 leader_election.cc:304] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:45.683535  6005 raft_consensus.cc:2368] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb for earlier term 2. Current term is 3.
I20260709 12:15:45.648625  6350 consensus_queue.cc:1048] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.049s
I20260709 12:15:45.717191  6133 raft_consensus.cc:359] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:45.718416  6133 raft_consensus.cc:385] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.718819  6133 raft_consensus.cc:740] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.722360  5932 raft_consensus.cc:1275] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:45.696873  6002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ace1a67c98413c886c1ce2cfcd66af" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:45.729607  5933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd00b832aafb491387eee88b954ff5df" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:45.730383  5933 raft_consensus.cc:3060] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:45.736650  5824 leader_election.cc:343] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:45.698825  6636 raft_consensus.cc:2749] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:45.701165  6627 raft_consensus.cc:2804] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:45.701996  5858 raft_consensus.cc:2468] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 2.
W20260709 12:15:45.755656  6646 log.cc:927] Time spent T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 12:15:45.774295  5901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 85673.4us
I20260709 12:15:45.781221  6129 tablet_bootstrap.cc:654] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.744611  6350 consensus_queue.cc:1048] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 12:15:45.786990  5975 leader_election.cc:304] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:45.800280  5824 leader_election.cc:304] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:45.801266  6663 raft_consensus.cc:493] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.801574  6350 raft_consensus.cc:2804] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:45.802032  6350 raft_consensus.cc:493] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.802488  6350 raft_consensus.cc:3060] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:45.760344  6048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 159066us
I20260709 12:15:45.771356  6627 raft_consensus.cc:697] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:45.743171  6604 consensus_queue.cc:1048] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.051s
I20260709 12:15:45.820380  6593 raft_consensus.cc:2804] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:45.820935  6593 raft_consensus.cc:493] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:45.801854  6663 raft_consensus.cc:515] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:45.802580  6498 consensus_queue.cc:1048] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
W20260709 12:15:45.825138  6494 consensus_meta.cc:287] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.004s
I20260709 12:15:45.823415  6381 raft_consensus.cc:493] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.821324  6593 raft_consensus.cc:3060] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.857302  6627 consensus_queue.cc:237] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:45.862653  6381 raft_consensus.cc:515] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:45.865222  6381 leader_election.cc:290] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:45.866360  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd00b832aafb491387eee88b954ff5df" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:45.868458  6128 tablet_bootstrap.cc:492] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:45.869081  6128 ts_tablet_manager.cc:1403] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.671s	user 0.021s	sys 0.011s
I20260709 12:15:45.841059  5933 raft_consensus.cc:2468] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 3.
I20260709 12:15:45.853451  6494 raft_consensus.cc:2749] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243) with higher term. Message: Invalid argument: T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb for earlier term 2. Current term is 3.
I20260709 12:15:46.079121  6534 raft_consensus.cc:493] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36dfe581d09b46f6a9bfe678170e71cb)
I20260709 12:15:46.021385  5926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33adcece08484ff79fd8711ef5dfd78c" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:46.106066  6047 leader_election.cc:400] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Vote denied by peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139) with higher term. Message: Invalid argument: T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb for earlier term 2. Current term is 3.
I20260709 12:15:46.106676  6047 leader_election.cc:403] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:15:46.117484  5974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 116956us
I20260709 12:15:46.118415  5974 leader_election.cc:304] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:46.126538  6673 raft_consensus.cc:2804] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:46.127318  6673 raft_consensus.cc:697] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 3 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:46.128556  6673 consensus_queue.cc:237] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
W20260709 12:15:46.148597  5974 leader_election.cc:343] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.103711  6534 raft_consensus.cc:515] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:46.165154  6133 consensus_queue.cc:260] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:46.173717  5859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a260b81828b4baab927a2d3f2253be4" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:46.174546  5859 raft_consensus.cc:2468] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 2.
W20260709 12:15:46.185674  6656 log.cc:927] Time spent T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb: Append to log took a long time: real 0.335s	user 0.000s	sys 0.001s
I20260709 12:15:46.186862  5931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec4d35ac70348cb95a01355320f5686" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
W20260709 12:15:46.196517  6048 leader_election.cc:343] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.193781  5931 raft_consensus.cc:3060] T 4ec4d35ac70348cb95a01355320f5686 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:46.198165  6661 log.cc:927] Time spent T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:15:46.209853  6622 raft_consensus.cc:493] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.206485  6665 raft_consensus.cc:493] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:46.217288  6133 ts_tablet_manager.cc:1434] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.583s	user 0.023s	sys 0.005s
W20260709 12:15:46.302385  6669 log.cc:927] Time spent T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:15:46.201639  6048 leader_election.cc:304] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:46.304834  6531 raft_consensus.cc:2749] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:46.305032  6048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 108609us
W20260709 12:15:46.219208  6133 ts_tablet_manager.cc:1467] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e: Tablet startup took 585ms
I20260709 12:15:46.210490  6622 raft_consensus.cc:515] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
W20260709 12:15:46.314098  6667 log.cc:927] Time spent T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:15:46.236482  6665 raft_consensus.cc:515] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:46.315680  6534 leader_election.cc:290] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
W20260709 12:15:46.306038  6133 ts_tablet_manager.cc:1469] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e: Trace:
0709 12:15:33.302064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:34.081892 (+779828us) service_pool.cc:224] Handling call
0709 12:15:34.083846 (+  1954us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:34.083956 (+   110us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:34.280575 (+196619us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:34.326685 (+ 46110us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:34.331650 (+  4965us) inbound_call.cc:177] Queueing success response
0709 12:15:45.174081 (+10842431us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:15:45.633828 (+459747us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:15:45.634698 (+   870us) tablet_replica.cc:261] Starting instrumentation
0709 12:15:45.635441 (+   743us) tablet_replica.cc:280] Starting consensus
0709 12:15:46.162505 (+527064us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b4c005bc780. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f50743a6a20 00007f50743b7a29 00007f507437d644 00007f50743a4f2d 00007f50743a4b93 00007f50760d518b 00007f50760d5cb5 00007f50760d0f30 00007f50760cfc40 00007f5079accb2e 00007f507b0eed8a
Metrics: {"mutex_wait_us":15909,"raft.queue_time_us":14525,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":8134,"spinlock_wait_cycles":3771776,"tablet-open.queue_time_us":10816552,"thread_start_us":32593,"threads_started":1}
I20260709 12:15:46.237056  6647 raft_consensus.cc:3060] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:46.323241  6128 raft_consensus.cc:359] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:46.324057  6128 raft_consensus.cc:385] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.324312  6128 raft_consensus.cc:740] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.333331  6128 consensus_queue.cc:260] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:46.337468  6075 raft_consensus.cc:2468] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 3.
I20260709 12:15:46.339521  6128 ts_tablet_manager.cc:1434] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.470s	user 0.007s	sys 0.002s
I20260709 12:15:46.308429  6663 leader_election.cc:290] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:46.352989  6665 leader_election.cc:290] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:46.363813  6129 tablet_bootstrap.cc:492] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:46.364763  6129 ts_tablet_manager.cc:1403] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.722s	user 0.045s	sys 0.062s
I20260709 12:15:46.369108  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:46.366632  6002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a260b81828b4baab927a2d3f2253be4" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
W20260709 12:15:46.377878  6662 log.cc:927] Time spent T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e: Append to log took a long time: real 0.214s	user 0.003s	sys 0.000s
I20260709 12:15:46.400600  6663 consensus_queue.cc:1048] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:46.401031  5901 leader_election.cc:304] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
W20260709 12:15:46.401785  5901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 225881us
I20260709 12:15:46.402372  6663 raft_consensus.cc:2804] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:46.402899  6663 raft_consensus.cc:493] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.403272  6663 raft_consensus.cc:3060] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:46.407500  5929 raft_consensus.cc:1275] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Refusing update from remote peer e29106aa83aa4eebb9b87d6745825a27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:46.410606  6594 raft_consensus.cc:493] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:46.422981  6680 log.cc:927] Time spent T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:15:46.424290  6517 raft_consensus.cc:493] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36dfe581d09b46f6a9bfe678170e71cb)
I20260709 12:15:46.455134  6665 raft_consensus.cc:493] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:46.456296  6350 consensus_meta.cc:287] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.005s
I20260709 12:15:46.469142  6129 raft_consensus.cc:359] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:46.472860  6129 raft_consensus.cc:385] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.473371  6129 raft_consensus.cc:740] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.474906  6129 consensus_queue.cc:260] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:46.465656  6665 raft_consensus.cc:515] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:46.488157  6629 raft_consensus.cc:493] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e29106aa83aa4eebb9b87d6745825a27)
I20260709 12:15:46.488885  6629 raft_consensus.cc:515] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:46.451354  6594 raft_consensus.cc:515] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:46.497412  6663 raft_consensus.cc:515] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:46.464705  6517 raft_consensus.cc:515] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:46.512626  6629 leader_election.cc:290] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:46.517709  6663 leader_election.cc:290] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:46.497510  6594 leader_election.cc:290] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:46.471621  6350 raft_consensus.cc:515] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:46.522552  6009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8800c8a47a0449783d57a6275b2f677" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:46.522914  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a260b81828b4baab927a2d3f2253be4" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:46.531795  5931 raft_consensus.cc:2468] T 4ec4d35ac70348cb95a01355320f5686 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:46.532325  6350 leader_election.cc:290] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:46.534508  6517 leader_election.cc:290] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:46.524371  5852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:46.537457  5852 raft_consensus.cc:2393] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 3: Already voted for candidate 58ed30c66c784e06ad64609f8d1b4c43 in this term.
I20260709 12:15:46.539166  6643 raft_consensus.cc:493] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 36dfe581d09b46f6a9bfe678170e71cb)
I20260709 12:15:46.540091  6643 raft_consensus.cc:515] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:46.526345  6129 ts_tablet_manager.cc:1434] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.161s	user 0.010s	sys 0.000s
W20260709 12:15:46.547406  6593 consensus_meta.cc:287] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27: Time spent flushing consensus metadata: real 0.691s	user 0.014s	sys 0.000s
I20260709 12:15:46.548089  6593 raft_consensus.cc:515] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:46.531839  6647 raft_consensus.cc:2749] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139) with higher term. Message: Invalid argument: T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb for earlier term 2. Current term is 3.
W20260709 12:15:46.551698  6684 log.cc:927] Time spent T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:15:46.552732  6622 leader_election.cc:290] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:46.552863  6593 leader_election.cc:290] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:46.553184  5931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a260b81828b4baab927a2d3f2253be4" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:46.555938  6002 raft_consensus.cc:2468] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 2.
I20260709 12:15:46.558784  5854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a260b81828b4baab927a2d3f2253be4" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
W20260709 12:15:46.559060  5825 consensus_peers.cc:597] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:46.559430  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:46.559897  5756 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36612 (request call id 70) took 2334 ms. Trace:
I20260709 12:15:46.564219  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45528a8d878d46d89244614343fc6e90" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
W20260709 12:15:46.566505  5825 consensus_peers.cc:597] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:46.560297  5756 rpcz_store.cc:276] 0709 12:15:44.227214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.227441 (+   227us) service_pool.cc:224] Handling call
0709 12:15:46.558288 (+2330847us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:44.798637 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:44.799280 (+   643us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:44.799325 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:15:44.799344 (+    19us) tablet.cc:662] Decoding operations
0709 12:15:44.799765 (+   421us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:44.799830 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:44.799859 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:15:44.800060 (+   201us) tablet.cc:701] Row locks acquired
0709 12:15:44.800080 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:15:44.800267 (+   187us) write_op.cc:270] Start()
0709 12:15:44.800399 (+   132us) write_op.cc:276] Timestamp: P: 1783599344800212 usec, L: 0
0709 12:15:44.800421 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:15:44.877306 (+ 76885us) log.cc:844] Serialized 540 byte log entry
0709 12:15:45.125973 (+248667us) op_driver.cc:464] REPLICATION: finished
0709 12:15:45.227166 (+101193us) write_op.cc:301] APPLY: starting
0709 12:15:45.232955 (+  5789us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:45.233081 (+   126us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:45.233229 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:45.233497 (+   268us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:45.259913 (+ 26416us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:15:45.269009 (+  9096us) write_op.cc:312] APPLY: finished
0709 12:15:45.296578 (+ 27569us) log.cc:844] Serialized 22 byte log entry
0709 12:15:45.325972 (+ 29394us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:45.331561 (+  5589us) write_op.cc:454] Released schema lock
0709 12:15:45.333691 (+  2130us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:45.375420 (+ 41729us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:45.375450 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5868,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":93678,"apply.run_cpu_time_us":2860,"apply.run_wall_time_us":155465,"num_ops":1,"prepare.queue_time_us":225,"prepare.run_cpu_time_us":3471,"prepare.run_wall_time_us":100594,"replication_time_us":325407,"thread_start_us":93208,"threads_started":1}]]}
I20260709 12:15:46.567692  6665 leader_election.cc:290] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:46.556129  5931 raft_consensus.cc:2368] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 for earlier term 2. Current term is 3.
I20260709 12:15:46.578109  6643 leader_election.cc:290] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:46.579737  6128 tablet_bootstrap.cc:492] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
W20260709 12:15:46.589901  5806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:46.621073  5854 raft_consensus.cc:2468] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 2.
I20260709 12:15:46.636847  5975 leader_election.cc:304] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:46.642335  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8800c8a47a0449783d57a6275b2f677" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:46.644220  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12649b3d49a4a309d961106ba152892" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:46.644698  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f502ef9684f1b8a6c29e9010f9ed5" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:46.645462  6076 raft_consensus.cc:2468] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 0.
I20260709 12:15:46.646450  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:46.642943  6594 raft_consensus.cc:2804] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:46.649686  6594 raft_consensus.cc:697] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 2 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:46.650678  6594 consensus_queue.cc:237] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:46.651566  6133 tablet_bootstrap.cc:492] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:46.642977  6645 raft_consensus.cc:493] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.654739  6645 raft_consensus.cc:515] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:46.665961  6078 raft_consensus.cc:1275] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:46.670468  6128 tablet_bootstrap.cc:654] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:46.671022  5853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12649b3d49a4a309d961106ba152892" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:46.643361  6647 raft_consensus.cc:493] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.672114  6647 raft_consensus.cc:515] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:46.677266  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214f52126a2c4bc59473ee7461e4a044" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:46.677438  6082 raft_consensus.cc:2468] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 2.
I20260709 12:15:46.680764  6647 leader_election.cc:290] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:46.680584  5853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:46.684063  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:46.684861  5935 raft_consensus.cc:2468] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 2.
I20260709 12:15:46.662540  6645 leader_election.cc:290] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:46.686179  6048 leader_election.cc:304] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:46.687074  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd00b832aafb491387eee88b954ff5df" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:46.687525  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ace1a67c98413c886c1ce2cfcd66af" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:46.688771  6645 raft_consensus.cc:2804] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:46.689517  6645 raft_consensus.cc:493] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.686188  6078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec4d35ac70348cb95a01355320f5686" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:46.710988  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ace1a67c98413c886c1ce2cfcd66af" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:46.711692  6079 raft_consensus.cc:3060] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:46.694811  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33adcece08484ff79fd8711ef5dfd78c" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:46.695181  5853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a260b81828b4baab927a2d3f2253be4" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:46.696468  6636 raft_consensus.cc:493] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e29106aa83aa4eebb9b87d6745825a27)
I20260709 12:15:46.696640  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f502ef9684f1b8a6c29e9010f9ed5" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:46.697028  6494 raft_consensus.cc:493] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e29106aa83aa4eebb9b87d6745825a27)
I20260709 12:15:46.703888  5901 leader_election.cc:304] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
W20260709 12:15:46.727774  5901 consensus_peers.cc:597] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:46.710131  5974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 47850.5us
I20260709 12:15:46.714602  5754 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36590 (request call id 63) took 2245 ms. Trace:
I20260709 12:15:46.720830  6079 raft_consensus.cc:2468] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:46.732635  6133 tablet_bootstrap.cc:654] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:46.736178  5824 leader_election.cc:304] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:46.727418  6078 raft_consensus.cc:3060] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:46.715327  6645 raft_consensus.cc:3060] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:46.726547  6598 raft_consensus.cc:493] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36dfe581d09b46f6a9bfe678170e71cb)
I20260709 12:15:46.729566  5853 raft_consensus.cc:3060] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:46.728258  6081 raft_consensus.cc:2468] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:46.740198  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45528a8d878d46d89244614343fc6e90" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:46.764086  6074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:46.729701  6636 raft_consensus.cc:515] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:46.767068  6075 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43396 (request call id 179) took 1535 ms. Trace:
I20260709 12:15:46.739817  6610 raft_consensus.cc:493] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e29106aa83aa4eebb9b87d6745825a27)
I20260709 12:15:46.767577  6075 rpcz_store.cc:276] 0709 12:15:45.231766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.243460 (+ 11694us) service_pool.cc:224] Handling call
0709 12:15:45.347700 (+104240us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b580019d798. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5072e75db1 00007f5072fb5b71 00007f5072fb5eee 000000000036eb39 00007f507b0291e0 00007f507b0f20c4 00007f507b0f2131 00007f507b0a00a0 00007f507b09f984 00007f507461a6d4 00007f507461a662
0709 12:15:46.766861 (+1419161us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54006ffc54. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076043571 00007f50760de2fa 00007f507b09fb17 00007f507461a6d4 00007f507461a662 00007f507461a591 00007f507461a50c 00007f50746197c2 00007f507441548c 00007f50744148c6 00007f507441426f
0709 12:15:46.766977 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1478082816}
I20260709 12:15:46.768564  6610 raft_consensus.cc:515] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:46.769609  6657 raft_consensus.cc:2749] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:46.769779  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:46.771497  6671 consensus_queue.cc:1048] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:15:46.773672  6006 raft_consensus.cc:1275] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:46.774188  6129 tablet_bootstrap.cc:492] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:46.746296  6594 raft_consensus.cc:493] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.776453  6594 raft_consensus.cc:515] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:46.778718  6594 leader_election.cc:290] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:46.731182  6494 raft_consensus.cc:515] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:46.781559  6677 consensus_queue.cc:1048] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:15:46.785462  5901 leader_election.cc:343] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.748978  6582 raft_consensus.cc:2804] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:46.786522  6582 raft_consensus.cc:697] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:46.787472  6582 consensus_queue.cc:237] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:46.788539  6129 tablet_bootstrap.cc:654] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:46.728619  5754 rpcz_store.cc:276] 0709 12:15:44.469532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.470111 (+   579us) service_pool.cc:224] Handling call
0709 12:15:46.714511 (+2244400us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:45.798793 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:45.994638 (+195845us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:46.005579 (+ 10941us) write_op.cc:435] Acquired schema lock
0709 12:15:46.015122 (+  9543us) tablet.cc:662] Decoding operations
0709 12:15:46.111354 (+ 96232us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:46.118106 (+  6752us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:46.133905 (+ 15799us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:15:46.153508 (+ 19603us) tablet.cc:701] Row locks acquired
0709 12:15:46.155444 (+  1936us) write_op.cc:260] PREPARE: finished
0709 12:15:46.162875 (+  7431us) write_op.cc:270] Start()
0709 12:15:46.171799 (+  8924us) write_op.cc:276] Timestamp: P: 1783599346162830 usec, L: 0
0709 12:15:46.173326 (+  1527us) op_driver.cc:348] REPLICATION: starting
0709 12:15:46.313400 (+140074us) log.cc:844] Serialized 540 byte log entry
0709 12:15:46.499767 (+186367us) op_driver.cc:464] REPLICATION: finished
0709 12:15:46.520289 (+ 20522us) write_op.cc:301] APPLY: starting
0709 12:15:46.543482 (+ 23193us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:46.553553 (+ 10071us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:46.553685 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:46.601075 (+ 47390us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:46.601254 (+   179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:15:46.601305 (+    51us) write_op.cc:312] APPLY: finished
0709 12:15:46.601538 (+   233us) log.cc:844] Serialized 22 byte log entry
0709 12:15:46.602450 (+   912us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:46.602552 (+   102us) write_op.cc:454] Released schema lock
0709 12:15:46.602594 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:46.603078 (+   484us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:46.603112 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":71257,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":20187,"apply.run_cpu_time_us":2396,"apply.run_wall_time_us":82812,"num_ops":1,"prepare.queue_time_us":341771,"prepare.run_cpu_time_us":5546,"prepare.run_wall_time_us":558533,"replication_time_us":326230,"thread_start_us":266328,"threads_started":2}]]}
I20260709 12:15:46.761379  6002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4c5dd41465429eab21af474b88bc05" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:46.791237  6002 raft_consensus.cc:2468] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 0.
I20260709 12:15:46.794950  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "214f52126a2c4bc59473ee7461e4a044" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:46.803251  5926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75d901511f94357a67c07612cf07d1a" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:46.803413  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4c5dd41465429eab21af474b88bc05" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:46.804689  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8800c8a47a0449783d57a6275b2f677" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:46.807022  6610 leader_election.cc:290] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:46.811743  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4c5dd41465429eab21af474b88bc05" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:46.812544  6080 raft_consensus.cc:2468] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:46.802096  6494 leader_election.cc:290] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
W20260709 12:15:46.816448  5975 leader_election.cc:343] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.808712  5853 raft_consensus.cc:2468] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 3.
W20260709 12:15:46.826924  5974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 85718us
I20260709 12:15:46.829957  5974 leader_election.cc:304] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:46.833868  5824 leader_election.cc:304] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:46.837534  6047 leader_election.cc:304] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:46.759490  6598 raft_consensus.cc:515] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:46.845963  5901 leader_election.cc:304] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:46.841075  5824 leader_election.cc:304] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:46.848520  5974 leader_election.cc:400] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Vote denied by peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793) with higher term. Message: Invalid argument: T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 for earlier term 2. Current term is 3.
I20260709 12:15:46.855939  5824 leader_election.cc:304] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:46.857652  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b081fa5436f34e5e9e477b502f689461" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:46.858594  6076 raft_consensus.cc:2468] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 3.
I20260709 12:15:46.861361  6350 raft_consensus.cc:2749] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:46.864776  5824 leader_election.cc:343] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:46.844969  6498 raft_consensus.cc:2749] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:46.844125  6593 raft_consensus.cc:2804] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:15:46.871645  6049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 51488.4us
I20260709 12:15:46.876140  5932 raft_consensus.cc:1275] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Refusing update from remote peer e29106aa83aa4eebb9b87d6745825a27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:46.876329  6082 raft_consensus.cc:1275] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Refusing update from remote peer e29106aa83aa4eebb9b87d6745825a27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:46.859582  6677 raft_consensus.cc:2804] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:46.890744  5899 leader_election.cc:304] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:46.862701  6610 raft_consensus.cc:2804] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:46.861785  6517 raft_consensus.cc:2804] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:46.859149  6598 leader_election.cc:290] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:46.905864  5899 leader_election.cc:304] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:46.913306  5899 leader_election.cc:304] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:46.913614  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d71c733514ec9bc7ddb9d3b7cd80d" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:46.909809  6677 raft_consensus.cc:697] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 3 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:46.912101  5855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b081fa5436f34e5e9e477b502f689461" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
W20260709 12:15:46.920413  6048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 85797.9us
I20260709 12:15:46.918277  6677 consensus_queue.cc:237] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:46.897318  6610 raft_consensus.cc:493] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.927569  6128 tablet_bootstrap.cc:492] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:46.928406  6128 ts_tablet_manager.cc:1403] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.349s	user 0.017s	sys 0.007s
I20260709 12:15:46.937139  5899 leader_election.cc:304] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:46.911602  6657 raft_consensus.cc:2749] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:46.911191  6517 raft_consensus.cc:697] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:46.923626  6663 raft_consensus.cc:2749] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:46.924427  6643 raft_consensus.cc:493] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.939010  6622 raft_consensus.cc:2804] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:46.930987  6610 raft_consensus.cc:3060] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:46.949831  6700 log.cc:927] Time spent T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:15:46.953083  6701 log.cc:927] Time spent T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:15:46.939553  6707 raft_consensus.cc:493] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.954145  6707 raft_consensus.cc:515] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:46.956770  6643 raft_consensus.cc:515] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:46.959365  6643 leader_election.cc:290] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:46.947983  6622 raft_consensus.cc:493] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.961107  6622 raft_consensus.cc:3060] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:46.965281  6517 consensus_queue.cc:237] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:46.970006  6128 raft_consensus.cc:359] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:46.972151  6128 raft_consensus.cc:385] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.972584  6128 raft_consensus.cc:740] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.971436  6133 tablet_bootstrap.cc:492] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:46.975383  6133 ts_tablet_manager.cc:1403] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.324s	user 0.020s	sys 0.011s
I20260709 12:15:46.974957  6128 consensus_queue.cc:260] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:46.978833  6622 raft_consensus.cc:515] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:46.980257  5853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d71c733514ec9bc7ddb9d3b7cd80d" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:46.982084  6078 raft_consensus.cc:2468] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:46.971648  6707 leader_election.cc:290] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:46.981027  6128 ts_tablet_manager.cc:1434] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 12:15:46.988435  6622 leader_election.cc:290] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:46.988444  6636 leader_election.cc:290] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:46.993470  6133 raft_consensus.cc:359] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:46.995613  6133 raft_consensus.cc:385] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.996054  6133 raft_consensus.cc:740] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.996991  6133 consensus_queue.cc:260] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:47.001976  6133 ts_tablet_manager.cc:1434] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:15:47.000064  6610 raft_consensus.cc:515] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:47.002372  5755 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36596 (request call id 61) took 2567 ms. Trace:
I20260709 12:15:47.016770  5755 rpcz_store.cc:276] 0709 12:15:44.434964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.446522 (+ 11558us) service_pool.cc:224] Handling call
0709 12:15:47.002300 (+2555778us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63569,"reported_tablets":6}
W20260709 12:15:47.003850  6047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 166412us
I20260709 12:15:47.003189  6133 tablet_bootstrap.cc:492] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:47.027432  6047 leader_election.cc:304] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:47.016184  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4c5dd41465429eab21af474b88bc05" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:47.030326  5857 raft_consensus.cc:2468] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 0.
I20260709 12:15:47.030722  6128 tablet_bootstrap.cc:492] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:46.939795  6629 consensus_queue.cc:1048] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 12:15:47.033035  6494 raft_consensus.cc:2749] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:46.971472  6002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75d901511f94357a67c07612cf07d1a" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:47.047276  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f502ef9684f1b8a6c29e9010f9ed5" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:47.048019  6083 raft_consensus.cc:3060] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:46.980363  6645 raft_consensus.cc:515] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:47.055856  6077 raft_consensus.cc:1240] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Rejecting Update request from peer e29106aa83aa4eebb9b87d6745825a27 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:47.058957  5927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:47.053889  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f502ef9684f1b8a6c29e9010f9ed5" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:47.061995  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500f59123914ed198a39756117b4110" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:47.062747  6076 raft_consensus.cc:2468] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:47.063828  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8800c8a47a0449783d57a6275b2f677" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:47.065798  6610 leader_election.cc:290] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:47.066812  6645 leader_election.cc:290] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
W20260709 12:15:47.068535  5974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 181831us
I20260709 12:15:47.070072  6593 raft_consensus.cc:697] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:47.070879  6703 consensus_queue.cc:1048] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:47.045897  5933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ede3276c3746638e321c76e4794c86" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:47.071944  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500f59123914ed198a39756117b4110" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:47.072798  6129 tablet_bootstrap.cc:492] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:47.101814  6129 ts_tablet_manager.cc:1403] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.328s	user 0.022s	sys 0.025s
I20260709 12:15:47.074237  5973 leader_election.cc:304] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:47.077306  5758 catalog_manager.cc:5697] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 1 to 2, leader changed from 26615d25670745d38490e2d6da247d9e (127.24.179.66) to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:47.058079  6128 tablet_bootstrap.cc:654] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:47.082118  5901 leader_election.cc:343] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.082984  6002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ede3276c3746638e321c76e4794c86" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:47.092072  6047 leader_election.cc:304] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:47.089979  6083 raft_consensus.cc:2468] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:47.090448  5824 leader_election.cc:304] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:47.109098  5758 catalog_manager.cc:5697] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 1 to 2, leader changed from 26615d25670745d38490e2d6da247d9e (127.24.179.66) to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:47.121577  6047 leader_election.cc:304] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
W20260709 12:15:47.126132  6048 leader_election.cc:343] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.116931  6534 raft_consensus.cc:2804] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:47.121531  6470 raft_consensus.cc:3060] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:47.120018  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:47.125893  6604 raft_consensus.cc:2804] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:47.149349  6604 raft_consensus.cc:493] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.149819  6604 raft_consensus.cc:3060] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.151453  5858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4c5dd41465429eab21af474b88bc05" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:47.152266  5858 raft_consensus.cc:3060] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.153468  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4c5dd41465429eab21af474b88bc05" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:47.154165  6005 raft_consensus.cc:3060] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:47.133683  5973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 59547.8us
I20260709 12:15:47.156042  5973 leader_election.cc:304] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:47.156965  6671 raft_consensus.cc:2804] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:47.157347  6671 raft_consensus.cc:493] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.157378  5973 leader_election.cc:304] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:47.157823  6671 raft_consensus.cc:3060] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.158278  6593 consensus_queue.cc:237] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:47.160076  6534 raft_consensus.cc:493] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e29106aa83aa4eebb9b87d6745825a27)
I20260709 12:15:47.160669  6534 raft_consensus.cc:3060] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:47.164309  5973 leader_election.cc:304] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:47.165869  6592 raft_consensus.cc:2749] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:47.125041  6610 raft_consensus.cc:2749] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:47.142779  6710 raft_consensus.cc:2749] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:47.173504  6671 raft_consensus.cc:515] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:47.177035  5929 raft_consensus.cc:1240] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 3 LEADER]: Rejecting Update request from peer e29106aa83aa4eebb9b87d6745825a27 for earlier term 2. Current term is 3. Ops: []
W20260709 12:15:47.177263  6047 leader_election.cc:343] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:47.177794  5825 leader_election.cc:343] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.178088  6047 leader_election.cc:304] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:47.185647  6047 leader_election.cc:304] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:47.147879  6129 raft_consensus.cc:359] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:47.187675  6129 raft_consensus.cc:385] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.188038  6129 raft_consensus.cc:740] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.189899  5899 leader_election.cc:304] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:47.198287  6005 raft_consensus.cc:2468] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:47.185804  6710 raft_consensus.cc:2749] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:47.200985  6591 raft_consensus.cc:2764] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:15:47.205597  6665 raft_consensus.cc:2804] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:47.199965  6129 consensus_queue.cc:260] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
W20260709 12:15:47.211385  5824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 69021.6us
I20260709 12:15:47.201417  6562 consensus_queue.cc:1048] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:15:47.195946  6494 raft_consensus.cc:2749] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:47.229408  6665 raft_consensus.cc:697] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:47.230644  6665 consensus_queue.cc:237] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
W20260709 12:15:47.232656  6714 log.cc:927] Time spent T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:15:47.181963  5858 raft_consensus.cc:2468] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:47.186044  6534 raft_consensus.cc:515] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:47.246454  6047 leader_election.cc:304] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:47.251507  6707 raft_consensus.cc:2804] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:47.253443  6707 raft_consensus.cc:697] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:15:47.253191  6432 consensus_queue.cc:1059] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:47.264815  6128 tablet_bootstrap.cc:492] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:47.265654  6128 ts_tablet_manager.cc:1403] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.235s	user 0.018s	sys 0.005s
I20260709 12:15:47.271498  6129 ts_tablet_manager.cc:1434] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.169s	user 0.009s	sys 0.000s
I20260709 12:15:47.247895  5927 raft_consensus.cc:3060] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.272775  6129 tablet_bootstrap.cc:492] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:47.272639  6128 raft_consensus.cc:359] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:47.290647  6128 raft_consensus.cc:385] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.291096  6128 raft_consensus.cc:740] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.291071  6350 consensus_queue.cc:1048] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:47.303387  6128 consensus_queue.cc:260] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:47.306849  6671 leader_election.cc:290] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:47.307034  5928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33adcece08484ff79fd8711ef5dfd78c" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
W20260709 12:15:47.309126  5974 leader_election.cc:343] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:47.309988  5824 consensus_peers.cc:597] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 -> Peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Couldn't send request to peer e29106aa83aa4eebb9b87d6745825a27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:47.317325  6133 tablet_bootstrap.cc:654] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.336721  6074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33adcece08484ff79fd8711ef5dfd78c" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:47.337558  6074 raft_consensus.cc:3060] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.338950  6534 leader_election.cc:290] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:47.281860  6432 consensus_queue.cc:1243] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Peer 26615d25670745d38490e2d6da247d9e log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:15:47.331524  6599 raft_consensus.cc:493] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36dfe581d09b46f6a9bfe678170e71cb)
I20260709 12:15:47.348021  6599 raft_consensus.cc:515] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:47.262107  6707 consensus_queue.cc:237] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:47.362849  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:47.368963  6604 raft_consensus.cc:515] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:47.384202  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:47.385848  6083 raft_consensus.cc:2393] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 26615d25670745d38490e2d6da247d9e in current term 3: Already voted for candidate 36dfe581d09b46f6a9bfe678170e71cb in this term.
I20260709 12:15:47.422940  6128 ts_tablet_manager.cc:1434] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.157s	user 0.011s	sys 0.000s
I20260709 12:15:47.428442  5899 leader_election.cc:304] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:47.420718  6595 raft_consensus.cc:493] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.430167  6599 leader_election.cc:290] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:47.431671  6594 raft_consensus.cc:3055] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:47.433611  6610 raft_consensus.cc:493] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.461570  6128 tablet_bootstrap.cc:492] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:47.445318  6470 raft_consensus.cc:2749] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:47.456061  6594 raft_consensus.cc:740] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:47.481232  6658 raft_consensus.cc:2749] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:15:47.484577  6712 log.cc:927] Time spent T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e: Append to log took a long time: real 0.241s	user 0.000s	sys 0.004s
I20260709 12:15:47.479710  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d71c733514ec9bc7ddb9d3b7cd80d" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:47.475481  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d71c733514ec9bc7ddb9d3b7cd80d" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:47.494761  6604 leader_election.cc:290] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:47.451120  6595 raft_consensus.cc:515] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:47.518153  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500f59123914ed198a39756117b4110" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
W20260709 12:15:47.519773  5825 leader_election.cc:343] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.504644  6599 raft_consensus.cc:493] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.523209  6599 raft_consensus.cc:515] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:47.523913  6075 raft_consensus.cc:1275] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:47.467734  6610 raft_consensus.cc:515] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:47.528884  5824 leader_election.cc:304] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:47.531164  6350 raft_consensus.cc:2749] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:47.532650  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500f59123914ed198a39756117b4110" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:47.537812  6002 raft_consensus.cc:1275] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:47.547627  6129 tablet_bootstrap.cc:654] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.548893  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f502ef9684f1b8a6c29e9010f9ed5" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:47.549580  6080 raft_consensus.cc:3060] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.533532  6476 consensus_queue.cc:1048] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:15:47.539819  6074 raft_consensus.cc:2468] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:47.553947  6595 leader_election.cc:290] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:47.546834  6078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626f502ef9684f1b8a6c29e9010f9ed5" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:47.546875  6599 leader_election.cc:290] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:47.555088  6078 raft_consensus.cc:2393] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ed30c66c784e06ad64609f8d1b4c43 in current term 1: Already voted for candidate 26615d25670745d38490e2d6da247d9e in this term.
I20260709 12:15:47.533486  6630 consensus_queue.cc:1059] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:15:47.556993  5973 leader_election.cc:304] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
W20260709 12:15:47.552983  6720 log.cc:927] Time spent T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:15:47.607555  6709 raft_consensus.cc:493] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.608121  6350 consensus_queue.cc:1048] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:47.608238  6709 raft_consensus.cc:515] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:47.612990  6080 raft_consensus.cc:2468] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:47.614843  6594 consensus_queue.cc:260] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:47.616827  6594 raft_consensus.cc:3060] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:47.619329  5853 raft_consensus.cc:1240] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Rejecting Update request from peer e29106aa83aa4eebb9b87d6745825a27 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:47.624549  6610 leader_election.cc:290] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:47.626698  6128 tablet_bootstrap.cc:654] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.633985  6129 tablet_bootstrap.cc:492] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:47.634294  5928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713888d225a047099a38dc8257276146" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:47.634963  6129 ts_tablet_manager.cc:1403] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.362s	user 0.015s	sys 0.000s
I20260709 12:15:47.635649  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d9e90868894fa78e9f94ca432dc703" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:47.638384  6129 raft_consensus.cc:359] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:47.639245  6129 raft_consensus.cc:385] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:15:47.639361  6048 leader_election.cc:343] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.618204  5858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713888d225a047099a38dc8257276146" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:47.642385  6133 tablet_bootstrap.cc:492] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:47.642573  6673 raft_consensus.cc:2804] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:47.643078  6133 ts_tablet_manager.cc:1403] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.640s	user 0.018s	sys 0.002s
I20260709 12:15:47.643222  6673 raft_consensus.cc:697] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:47.644228  6673 consensus_queue.cc:237] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:47.639611  6129 raft_consensus.cc:740] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.617784  6709 leader_election.cc:290] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
W20260709 12:15:47.646934  5973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 90033.2us
I20260709 12:15:47.650884  6133 raft_consensus.cc:359] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:47.672900  6133 raft_consensus.cc:385] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.673234  6133 raft_consensus.cc:740] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.674014  6133 consensus_queue.cc:260] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:47.676156  6001 raft_consensus.cc:1275] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:15:47.676610  6001 pending_rounds.cc:85] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27: Aborting all ops after (but not including) 1
I20260709 12:15:47.676872  6001 pending_rounds.cc:107] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:15:47.677198  6001 raft_consensus.cc:2889] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:47.660719  5853 raft_consensus.cc:1275] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:15:47.655205  5975 leader_election.cc:343] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.655193  6129 consensus_queue.cc:260] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:47.676631  6133 ts_tablet_manager.cc:1434] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:15:47.683398  6622 consensus_queue.cc:1048] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:47.684692  6129 ts_tablet_manager.cc:1434] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.001s
I20260709 12:15:47.685907  6129 tablet_bootstrap.cc:492] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:47.658210  5929 raft_consensus.cc:1240] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Rejecting Update request from peer e29106aa83aa4eebb9b87d6745825a27 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:47.683748  6133 tablet_bootstrap.cc:492] T 82ede3276c3746638e321c76e4794c86 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
W20260709 12:15:47.692800  5974 leader_election.cc:343] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:47.607811  5824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 44267.4us
I20260709 12:15:47.703804  5854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859eab84f0fb443ba4bd2cccf81cbe3e" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:47.705861  5854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d9e90868894fa78e9f94ca432dc703" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
W20260709 12:15:47.714363  6049 leader_election.cc:343] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.718226  5974 leader_election.cc:304] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
W20260709 12:15:47.721431  6049 leader_election.cc:343] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.722012  6049 leader_election.cc:304] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:47.723363  5824 leader_election.cc:304] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:47.724485  5824 leader_election.cc:304] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:47.662665  5858 raft_consensus.cc:3060] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:47.736119  5974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 62651.3us
I20260709 12:15:47.667599  6002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859eab84f0fb443ba4bd2cccf81cbe3e" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:47.735755  6604 raft_consensus.cc:2804] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:47.737039  6647 raft_consensus.cc:2749] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:47.721015  6677 consensus_queue.cc:1048] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:15:47.737670  6658 raft_consensus.cc:493] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.740361  6595 raft_consensus.cc:2749] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:47.790154  6047 leader_election.cc:343] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.793963  6047 leader_election.cc:304] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
W20260709 12:15:47.791548  6731 log.cc:927] Time spent T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:15:47.789954  6534 raft_consensus.cc:493] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:47.798758  6534 raft_consensus.cc:515] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:47.801896  6129 tablet_bootstrap.cc:654] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.807305  6534 leader_election.cc:290] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:47.810070  6133 tablet_bootstrap.cc:654] T 82ede3276c3746638e321c76e4794c86 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.790302  6658 raft_consensus.cc:515] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:47.815671  6710 raft_consensus.cc:2749] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:47.818073  6498 raft_consensus.cc:2749] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:47.750463  6432 consensus_queue.cc:1059] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:15:47.788210  6604 raft_consensus.cc:697] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:47.857380  6658 leader_election.cc:290] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:47.860463  6604 consensus_queue.cc:237] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:47.860823  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500f59123914ed198a39756117b4110" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:47.862136  6077 raft_consensus.cc:2393] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26615d25670745d38490e2d6da247d9e in current term 1: Already voted for candidate 58ed30c66c784e06ad64609f8d1b4c43 in this term.
I20260709 12:15:47.872347  5855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500f59123914ed198a39756117b4110" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:47.877842  6128 tablet_bootstrap.cc:492] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:47.905233  5901 leader_election.cc:304] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:47.906322  6128 ts_tablet_manager.cc:1403] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.460s	user 0.036s	sys 0.038s
I20260709 12:15:47.885224  6432 consensus_queue.cc:1048] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:15:47.907251  6622 raft_consensus.cc:3060] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.849654  6562 raft_consensus.cc:493] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.912405  6128 raft_consensus.cc:359] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:47.913419  6128 raft_consensus.cc:385] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.913177  6562 raft_consensus.cc:515] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:47.913699  6128 raft_consensus.cc:740] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.914042  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c61591bbcaf43839af1cc8373f98c7e" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:47.914461  6128 consensus_queue.cc:260] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:47.915541  6562 leader_election.cc:290] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:47.875973  6658 consensus_queue.cc:1048] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 12:15:47.916549  6128 ts_tablet_manager.cc:1434] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:15:47.918413  6665 consensus_queue.cc:1048] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:47.919221  6128 tablet_bootstrap.cc:492] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:47.923905  6493 consensus_queue.cc:1048] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:47.931398  6128 tablet_bootstrap.cc:654] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.933172  6622 raft_consensus.cc:2749] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:47.984625  5857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ace1a67c98413c886c1ce2cfcd66af" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
W20260709 12:15:47.988545  6740 log.cc:927] Time spent T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 12:15:48.019122  6741 log.cc:927] Time spent T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:15:48.029667  6593 raft_consensus.cc:3055] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:48.030189  6593 raft_consensus.cc:740] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:48.031185  6593 consensus_queue.cc:260] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:48.050379  6673 consensus_queue.cc:1048] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:48.024328  6709 consensus_queue.cc:1048] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 12:15:48.055620  6083 raft_consensus.cc:1240] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Rejecting Update request from peer e29106aa83aa4eebb9b87d6745825a27 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:15:48.066278  6129 tablet_bootstrap.cc:492] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:48.085574  6129 ts_tablet_manager.cc:1403] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.400s	user 0.041s	sys 0.028s
I20260709 12:15:48.060529  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ace1a67c98413c886c1ce2cfcd66af" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:48.058152  6593 raft_consensus.cc:3060] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:48.097489  5758 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36582 (request call id 69) took 3227 ms. Trace:
I20260709 12:15:48.092540  5973 leader_election.cc:304] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
W20260709 12:15:48.107363  5806 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:48.098538  5758 rpcz_store.cc:276] 0709 12:15:44.869849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.872407 (+  2558us) service_pool.cc:224] Handling call
0709 12:15:44.915647 (+ 43240us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b54008601d4. stack: 00007f5072fbb343 00007f5072fbb240 00007f507294a1d4 00007f507c688304 00007f507c688299 00007f5076044090 00007f50760e2f3a 00007f507be98e9c 00007f507bf9704e 00007f507a4582a4 00007f507a458232 00007f507a458161 00007f507a4580dc 00007f507a457392 00007f507441548c 00007f50744148c6
0709 12:15:48.097419 (+3181772us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:47.315091 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:47.315907 (+   816us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:47.315962 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:15:47.315992 (+    30us) tablet.cc:662] Decoding operations
0709 12:15:47.316601 (+   609us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:47.316722 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:47.316776 (+    54us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:15:47.317217 (+   441us) tablet.cc:701] Row locks acquired
0709 12:15:47.317243 (+    26us) write_op.cc:260] PREPARE: finished
0709 12:15:47.317422 (+   179us) write_op.cc:270] Start()
0709 12:15:47.317586 (+   164us) write_op.cc:276] Timestamp: P: 1783599347317358 usec, L: 0
0709 12:15:47.317620 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:15:47.391728 (+ 74108us) log.cc:844] Serialized 928 byte log entry
0709 12:15:47.607133 (+215405us) op_driver.cc:464] REPLICATION: finished
0709 12:15:47.693835 (+ 86702us) write_op.cc:301] APPLY: starting
0709 12:15:47.693968 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:47.694143 (+   175us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:47.694318 (+   175us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:47.699557 (+  5239us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:47.699858 (+   301us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:15:47.699930 (+    72us) write_op.cc:312] APPLY: finished
0709 12:15:47.731138 (+ 31208us) log.cc:844] Serialized 28 byte log entry
0709 12:15:47.743821 (+ 12683us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:47.753182 (+  9361us) write_op.cc:454] Released schema lock
0709 12:15:47.754775 (+  1593us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:47.789344 (+ 34569us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:47.791468 (+  2124us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":15,"spinlock_wait_cycles":40699136,"child_traces":[["op",{"apply.queue_time_us":86359,"apply.run_cpu_time_us":2897,"apply.run_wall_time_us":89562,"num_ops":2,"prepare.queue_time_us":177496,"prepare.run_cpu_time_us":4381,"prepare.run_wall_time_us":115599,"replication_time_us":289349,"thread_start_us":188438,"threads_started":2}]]}
I20260709 12:15:48.068651  6002 raft_consensus.cc:3060] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.122668  6133 tablet_bootstrap.cc:492] T 82ede3276c3746638e321c76e4794c86 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:48.123301  6133 ts_tablet_manager.cc:1403] T 82ede3276c3746638e321c76e4794c86 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.440s	user 0.037s	sys 0.026s
I20260709 12:15:48.136353  6129 raft_consensus.cc:359] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:48.137187  6129 raft_consensus.cc:385] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.137485  6129 raft_consensus.cc:740] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.138573  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c61591bbcaf43839af1cc8373f98c7e" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:48.142715  6129 consensus_queue.cc:260] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:48.144462  6133 raft_consensus.cc:359] T 82ede3276c3746638e321c76e4794c86 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:48.145323  6129 ts_tablet_manager.cc:1434] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.003s
I20260709 12:15:48.152388  6129 tablet_bootstrap.cc:492] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27: Bootstrap starting.
I20260709 12:15:48.152887  6128 tablet_bootstrap.cc:492] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:48.153599  6128 ts_tablet_manager.cc:1403] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.236s	user 0.028s	sys 0.032s
I20260709 12:15:48.150902  6133 raft_consensus.cc:385] T 82ede3276c3746638e321c76e4794c86 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.156610  6133 raft_consensus.cc:740] T 82ede3276c3746638e321c76e4794c86 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.162499  5899 leader_election.cc:304] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:48.168797  5755 catalog_manager.cc:5697] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:48.177280  6677 raft_consensus.cc:2749] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:48.177143  6133 consensus_queue.cc:260] T 82ede3276c3746638e321c76e4794c86 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:48.170778  6128 raft_consensus.cc:359] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:48.178220  6128 raft_consensus.cc:385] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.178563  6128 raft_consensus.cc:740] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.175828  5755 catalog_manager.cc:5697] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 1 to 3, leader changed from 26615d25670745d38490e2d6da247d9e (127.24.179.66) to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 3 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } }
I20260709 12:15:48.181296  5755 catalog_manager.cc:5697] T 5cb1760bd0ba436eb7077c60542c0a45 P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 1 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } }
I20260709 12:15:48.189065  5755 catalog_manager.cc:5697] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 1 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:48.182777  6128 consensus_queue.cc:260] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:48.193961  6133 ts_tablet_manager.cc:1434] T 82ede3276c3746638e321c76e4794c86 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 12:15:48.204725  5755 catalog_manager.cc:5697] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } }
I20260709 12:15:48.207502  5755 catalog_manager.cc:5697] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 1 to 3, leader changed from 26615d25670745d38490e2d6da247d9e (127.24.179.66) to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 3 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } }
I20260709 12:15:48.210873  6133 tablet_bootstrap.cc:492] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:48.223398  6128 ts_tablet_manager.cc:1434] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.003s
I20260709 12:15:48.241410  6591 consensus_queue.cc:1048] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:15:48.246006  5974 consensus_peers.cc:597] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:48.257901  6133 tablet_bootstrap.cc:654] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.272567  6650 consensus_queue.cc:1048] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:48.279950  6128 tablet_bootstrap.cc:492] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
W20260709 12:15:48.311940  6749 log.cc:927] Time spent T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:15:48.323347  6498 raft_consensus.cc:493] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.323915  6498 raft_consensus.cc:515] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:48.348122  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a300304455c4851b24de418128a28d0" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:48.356752  6498 leader_election.cc:290] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:48.358261  6129 tablet_bootstrap.cc:654] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.361529  6004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a300304455c4851b24de418128a28d0" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
W20260709 12:15:48.367033  6753 log.cc:927] Time spent T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:15:48.377029  5824 leader_election.cc:304] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:48.378875  6498 raft_consensus.cc:2749] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:48.386788  6630 raft_consensus.cc:2749] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:48.394492  6128 tablet_bootstrap.cc:654] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.409714  6532 consensus_queue.cc:1048] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:15:48.421550  6129 tablet_bootstrap.cc:492] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27: No bootstrap required, opened a new log
I20260709 12:15:48.422156  6129 ts_tablet_manager.cc:1403] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27: Time spent bootstrapping tablet: real 0.270s	user 0.023s	sys 0.007s
I20260709 12:15:48.424257  6133 tablet_bootstrap.cc:492] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:48.424794  6133 ts_tablet_manager.cc:1403] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.214s	user 0.022s	sys 0.009s
I20260709 12:15:48.429350  6133 raft_consensus.cc:359] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:48.430135  6129 raft_consensus.cc:359] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:48.431025  6129 raft_consensus.cc:385] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.431349  6129 raft_consensus.cc:740] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.434573  6129 consensus_queue.cc:260] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:48.430612  6133 raft_consensus.cc:385] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.438380  6133 raft_consensus.cc:740] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.440696  6133 consensus_queue.cc:260] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:48.442067  6129 ts_tablet_manager.cc:1434] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:15:48.446787  6133 ts_tablet_manager.cc:1434] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.005s
I20260709 12:15:48.461308  6133 tablet_bootstrap.cc:492] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:48.457518  5754 catalog_manager.cc:5697] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } }
I20260709 12:15:48.456667  5755 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36590 (request call id 64) took 1331 ms. Trace:
I20260709 12:15:48.467370  6128 tablet_bootstrap.cc:492] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:48.476562  6133 tablet_bootstrap.cc:654] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.476966  6128 ts_tablet_manager.cc:1403] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.201s	user 0.012s	sys 0.011s
I20260709 12:15:48.480160  6128 raft_consensus.cc:359] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:48.481003  6128 raft_consensus.cc:385] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.481326  6128 raft_consensus.cc:740] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.475804  5755 rpcz_store.cc:276] 0709 12:15:47.136428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.143772 (+  7344us) service_pool.cc:224] Handling call
0709 12:15:48.456584 (+1312812us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:48.346755 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:48.347610 (+   855us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:48.347667 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:15:48.347696 (+    29us) tablet.cc:662] Decoding operations
0709 12:15:48.348869 (+  1173us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:48.348985 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:48.349031 (+    46us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:15:48.349827 (+   796us) tablet.cc:701] Row locks acquired
0709 12:15:48.349860 (+    33us) write_op.cc:260] PREPARE: finished
0709 12:15:48.350074 (+   214us) write_op.cc:270] Start()
0709 12:15:48.350247 (+   173us) write_op.cc:276] Timestamp: P: 1783599348350005 usec, L: 0
0709 12:15:48.350277 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:15:48.385335 (+ 35058us) log.cc:844] Serialized 2481 byte log entry
0709 12:15:48.419689 (+ 34354us) op_driver.cc:464] REPLICATION: finished
0709 12:15:48.426886 (+  7197us) write_op.cc:301] APPLY: starting
0709 12:15:48.426983 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:48.427174 (+   191us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:48.427303 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:48.428268 (+   965us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:48.428472 (+   204us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:15:48.428515 (+    43us) write_op.cc:312] APPLY: finished
0709 12:15:48.428770 (+   255us) log.cc:844] Serialized 52 byte log entry
0709 12:15:48.432388 (+  3618us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:48.432647 (+   259us) write_op.cc:454] Released schema lock
0709 12:15:48.432845 (+   198us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:48.433364 (+   519us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:48.433395 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":6923,"apply.run_cpu_time_us":2788,"apply.run_wall_time_us":6483,"num_ops":6,"prepare.queue_time_us":132923,"prepare.run_cpu_time_us":5250,"prepare.run_wall_time_us":41929,"replication_time_us":69279,"thread_start_us":23564,"threads_started":2}]]}
I20260709 12:15:48.522524  5757 catalog_manager.cc:5697] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 1 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } }
I20260709 12:15:48.525398  5757 catalog_manager.cc:5697] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:48.529130  5857 raft_consensus.cc:3060] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.543511  6532 raft_consensus.cc:493] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.544431  6532 raft_consensus.cc:515] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:48.532009  6630 raft_consensus.cc:493] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.551541  6630 raft_consensus.cc:515] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:48.555850  6128 consensus_queue.cc:260] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:48.557983  5754 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36612 (request call id 71) took 1671 ms. Trace:
I20260709 12:15:48.559146  5757 catalog_manager.cc:5697] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 1 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } }
I20260709 12:15:48.564436  6532 leader_election.cc:290] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:48.565919  6630 leader_election.cc:290] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:48.565670  5757 catalog_manager.cc:5697] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:48.567113  6078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ede3276c3746638e321c76e4794c86" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:48.567880  6078 raft_consensus.cc:2468] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:48.567608  5757 catalog_manager.cc:5697] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:48.569443  6004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713888d225a047099a38dc8257276146" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:48.569645  5757 catalog_manager.cc:5697] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:48.570257  6004 raft_consensus.cc:2468] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:48.570960  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ede3276c3746638e321c76e4794c86" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:48.571733  5934 raft_consensus.cc:2468] T 82ede3276c3746638e321c76e4794c86 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:48.572001  5973 leader_election.cc:304] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:48.563004  6128 ts_tablet_manager.cc:1434] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.001s
I20260709 12:15:48.579384  5928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713888d225a047099a38dc8257276146" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:48.578631  6630 raft_consensus.cc:2804] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:48.588224  6630 raft_consensus.cc:493] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.588778  6630 raft_consensus.cc:3060] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.563433  5754 rpcz_store.cc:276] 0709 12:15:46.886218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.886435 (+   217us) service_pool.cc:224] Handling call
0709 12:15:48.557914 (+1671479us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:48.475787 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:48.476388 (+   601us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:48.476427 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:15:48.476445 (+    18us) tablet.cc:662] Decoding operations
0709 12:15:48.476828 (+   383us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:48.476885 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:48.476910 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:15:48.477120 (+   210us) tablet.cc:701] Row locks acquired
0709 12:15:48.477139 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:15:48.477297 (+   158us) write_op.cc:270] Start()
0709 12:15:48.477404 (+   107us) write_op.cc:276] Timestamp: P: 1783599348477251 usec, L: 0
0709 12:15:48.477423 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:15:48.478094 (+   671us) log.cc:844] Serialized 540 byte log entry
0709 12:15:48.479914 (+  1820us) op_driver.cc:464] REPLICATION: finished
0709 12:15:48.480274 (+   360us) write_op.cc:301] APPLY: starting
0709 12:15:48.480357 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:48.480462 (+   105us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:48.480557 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:48.480792 (+   235us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:48.480963 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:15:48.481009 (+    46us) write_op.cc:312] APPLY: finished
0709 12:15:48.481207 (+   198us) log.cc:844] Serialized 22 byte log entry
0709 12:15:48.481377 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:48.481468 (+    91us) write_op.cc:454] Released schema lock
0709 12:15:48.481520 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:48.481903 (+   383us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:48.481933 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":111512,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":115,"apply.run_cpu_time_us":1600,"apply.run_wall_time_us":1600,"num_ops":1,"prepare.queue_time_us":123,"prepare.run_cpu_time_us":2617,"prepare.run_wall_time_us":2617,"replication_time_us":2366}]]}
I20260709 12:15:48.583351  6133 tablet_bootstrap.cc:492] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:48.595800  6133 ts_tablet_manager.cc:1403] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.135s	user 0.034s	sys 0.053s
I20260709 12:15:48.583156  5757 catalog_manager.cc:5697] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 1 to 3, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 3 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } }
I20260709 12:15:48.575026  5824 leader_election.cc:304] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
W20260709 12:15:48.598891  5825 leader_election.cc:343] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.599385  6133 raft_consensus.cc:359] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:48.600340  6133 raft_consensus.cc:385] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.600708  6133 raft_consensus.cc:740] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.601521  6133 consensus_queue.cc:260] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:48.601806  6532 raft_consensus.cc:2804] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:48.602985  6532 raft_consensus.cc:493] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.603374  6532 raft_consensus.cc:3060] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.601903  6630 raft_consensus.cc:515] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:48.607975  6630 leader_election.cc:290] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:48.609311  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ede3276c3746638e321c76e4794c86" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:48.610051  6082 raft_consensus.cc:3060] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.613094  5928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ede3276c3746638e321c76e4794c86" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:48.613839  5928 raft_consensus.cc:3060] T 82ede3276c3746638e321c76e4794c86 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.619725  6133 ts_tablet_manager.cc:1434] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:15:48.620812  6133 tablet_bootstrap.cc:492] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:48.623418  6128 tablet_bootstrap.cc:492] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:48.617770  6532 raft_consensus.cc:515] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:48.632875  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713888d225a047099a38dc8257276146" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
W20260709 12:15:48.640735  5825 leader_election.cc:343] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.633451  6532 leader_election.cc:290] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:48.630064  6128 tablet_bootstrap.cc:654] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.645992  6604 raft_consensus.cc:493] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.657199  6604 raft_consensus.cc:515] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:48.660743  6078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d9e90868894fa78e9f94ca432dc703" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:48.661550  6078 raft_consensus.cc:2468] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 0.
I20260709 12:15:48.663281  5824 leader_election.cc:304] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:48.664554  6532 raft_consensus.cc:2804] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:48.665058  6532 raft_consensus.cc:493] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.665505  6532 raft_consensus.cc:3060] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.683049  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d9e90868894fa78e9f94ca432dc703" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:48.634858  6004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713888d225a047099a38dc8257276146" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:48.636605  6082 raft_consensus.cc:2468] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:48.638835  6133 tablet_bootstrap.cc:654] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.638239  5756 catalog_manager.cc:5697] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 1 to 2, leader changed from 26615d25670745d38490e2d6da247d9e (127.24.179.66) to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:48.633889  5928 raft_consensus.cc:2468] T 82ede3276c3746638e321c76e4794c86 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
W20260709 12:15:48.724288  5825 leader_election.cc:343] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.726271  6004 raft_consensus.cc:3060] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.727118  5756 catalog_manager.cc:5697] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:48.730296  5756 catalog_manager.cc:5697] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 1 to 3, leader changed from 26615d25670745d38490e2d6da247d9e (127.24.179.66) to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 3 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:48.734760  6133 tablet_bootstrap.cc:492] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:48.735412  6133 ts_tablet_manager.cc:1403] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.115s	user 0.024s	sys 0.001s
I20260709 12:15:48.736148  5973 leader_election.cc:304] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:48.737109  6591 raft_consensus.cc:2804] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:48.738008  6591 raft_consensus.cc:697] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:48.740477  6470 raft_consensus.cc:493] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.741114  6470 raft_consensus.cc:515] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:48.741442  6004 raft_consensus.cc:2468] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:48.738991  6591 consensus_queue.cc:237] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:48.743777  6470 leader_election.cc:290] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
W20260709 12:15:48.745729  6048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 61547.8us
I20260709 12:15:48.750735  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859eab84f0fb443ba4bd2cccf81cbe3e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:48.751525  6082 raft_consensus.cc:2468] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 0.
I20260709 12:15:48.753328  5973 leader_election.cc:304] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:48.754690  6470 raft_consensus.cc:2804] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:48.755095  6470 raft_consensus.cc:493] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.755427  6470 raft_consensus.cc:3060] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.756973  5824 leader_election.cc:304] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e
I20260709 12:15:48.760999  6582 raft_consensus.cc:2804] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:48.761535  6582 raft_consensus.cc:697] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:48.762569  6582 consensus_queue.cc:237] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:48.772143  6604 leader_election.cc:290] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:48.772442  6665 raft_consensus.cc:493] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.773202  6665 raft_consensus.cc:515] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:48.774633  6133 raft_consensus.cc:359] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:48.775440  6133 raft_consensus.cc:385] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.775718  6133 raft_consensus.cc:740] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.776407  6133 consensus_queue.cc:260] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:48.778657  6665 leader_election.cc:290] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:48.779168  6133 ts_tablet_manager.cc:1434] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 12:15:48.780978  6004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33adcece08484ff79fd8711ef5dfd78c" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:48.781489  6133 tablet_bootstrap.cc:492] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e: Bootstrap starting.
I20260709 12:15:48.787182  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33adcece08484ff79fd8711ef5dfd78c" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:48.789803  6133 tablet_bootstrap.cc:654] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.790804  5899 leader_election.cc:304] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:48.792003  6665 raft_consensus.cc:2749] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:48.801230  6470 raft_consensus.cc:515] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:48.803728  5855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859eab84f0fb443ba4bd2cccf81cbe3e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:48.835604  6767 raft_consensus.cc:493] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.841384  5934 raft_consensus.cc:3060] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.876488  6767 raft_consensus.cc:515] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:48.902657  5929 raft_consensus.cc:3060] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:48.903759  5975 leader_election.cc:343] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.908226  6767 leader_election.cc:290] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:48.910295  5852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859eab84f0fb443ba4bd2cccf81cbe3e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:48.885536  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859eab84f0fb443ba4bd2cccf81cbe3e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:48.916332  6082 raft_consensus.cc:3060] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.850461  6532 raft_consensus.cc:515] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:48.915647  6078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219ee6e67c3a4adf9dd72198036646bc" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:48.892710  5754 catalog_manager.cc:5697] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 0 to 1, leader changed from <none> to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } }
I20260709 12:15:48.898733  6128 tablet_bootstrap.cc:492] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43: No bootstrap required, opened a new log
I20260709 12:15:48.900041  5756 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36596 (request call id 62) took 1201 ms. Trace:
W20260709 12:15:48.916015  5975 leader_election.cc:343] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.920954  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d9e90868894fa78e9f94ca432dc703" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:48.921624  5934 raft_consensus.cc:3060] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.922865  5852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219ee6e67c3a4adf9dd72198036646bc" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:48.884583  6470 leader_election.cc:290] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:48.919128  5756 rpcz_store.cc:276] 0709 12:15:47.698326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.698546 (+   220us) service_pool.cc:224] Handling call
0709 12:15:48.899970 (+1201424us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:48.734383 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:48.735026 (+   643us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:48.735082 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:15:48.735109 (+    27us) tablet.cc:662] Decoding operations
0709 12:15:48.735852 (+   743us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:48.735930 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:48.735973 (+    43us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:15:48.736412 (+   439us) tablet.cc:701] Row locks acquired
0709 12:15:48.736440 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:15:48.736628 (+   188us) write_op.cc:270] Start()
0709 12:15:48.736784 (+   156us) write_op.cc:276] Timestamp: P: 1783599348736571 usec, L: 0
0709 12:15:48.736815 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:15:48.737648 (+   833us) log.cc:844] Serialized 1316 byte log entry
0709 12:15:48.739658 (+  2010us) op_driver.cc:464] REPLICATION: finished
0709 12:15:48.740177 (+   519us) write_op.cc:301] APPLY: starting
0709 12:15:48.740270 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:48.740413 (+   143us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:48.740507 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:48.740944 (+   437us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:48.741124 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:15:48.741171 (+    47us) write_op.cc:312] APPLY: finished
0709 12:15:48.741394 (+   223us) log.cc:844] Serialized 34 byte log entry
0709 12:15:48.741557 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:48.741663 (+   106us) write_op.cc:454] Released schema lock
0709 12:15:48.741707 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:48.742100 (+   393us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:48.742130 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":293139,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":280,"apply.run_cpu_time_us":1870,"apply.run_wall_time_us":1870,"num_ops":3,"prepare.queue_time_us":116,"prepare.run_cpu_time_us":3582,"prepare.run_wall_time_us":3582,"replication_time_us":2724}]]}
I20260709 12:15:48.925815  5901 leader_election.cc:304] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:48.928136  6532 leader_election.cc:290] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:48.919091  6128 ts_tablet_manager.cc:1403] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.296s	user 0.054s	sys 0.052s
I20260709 12:15:48.933023  6128 raft_consensus.cc:359] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:48.933732  6128 raft_consensus.cc:385] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.933997  6128 raft_consensus.cc:740] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.937318  6133 tablet_bootstrap.cc:492] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e: No bootstrap required, opened a new log
I20260709 12:15:48.938429  6133 ts_tablet_manager.cc:1403] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e: Time spent bootstrapping tablet: real 0.157s	user 0.007s	sys 0.009s
I20260709 12:15:48.941551  6133 raft_consensus.cc:359] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:48.942327  6133 raft_consensus.cc:385] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.942646  6133 raft_consensus.cc:740] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.942102  5757 catalog_manager.cc:5697] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:48.943347  6133 consensus_queue.cc:260] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:48.943490  6078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d9e90868894fa78e9f94ca432dc703" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:48.944278  6078 raft_consensus.cc:3060] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.950713  6128 consensus_queue.cc:260] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:48.953343  6082 raft_consensus.cc:2468] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:48.956517  5934 raft_consensus.cc:2468] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:48.958735  6128 ts_tablet_manager.cc:1434] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:15:48.961138  5825 leader_election.cc:304] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:15:48.962070  5973 leader_election.cc:304] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:48.963009  6470 raft_consensus.cc:2804] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:48.963676  6470 raft_consensus.cc:697] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:48.963783  6767 raft_consensus.cc:2749] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:48.964789  6470 consensus_queue.cc:237] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:48.962116  6350 raft_consensus.cc:2804] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:48.966536  6350 raft_consensus.cc:697] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:15:48.967406  6350 consensus_queue.cc:237] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:48.971401  6532 raft_consensus.cc:493] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.972107  6532 raft_consensus.cc:515] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:48.974539  6532 leader_election.cc:290] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:48.975443  6004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859eab84f0fb443ba4bd2cccf81cbe3e" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:48.956349  6078 raft_consensus.cc:2468] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 1.
I20260709 12:15:48.986182  6133 ts_tablet_manager.cc:1434] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:15:48.991685  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859eab84f0fb443ba4bd2cccf81cbe3e" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:48.992733  6076 raft_consensus.cc:2393] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ed30c66c784e06ad64609f8d1b4c43 in current term 1: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
I20260709 12:15:49.006084  5824 leader_election.cc:304] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:49.008502  6532 raft_consensus.cc:3060] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.036688  6532 raft_consensus.cc:2749] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:49.049857  5756 catalog_manager.cc:5697] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:49.054179  5756 catalog_manager.cc:5697] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:49.067513  5757 catalog_manager.cc:5697] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:49.106267  6709 raft_consensus.cc:493] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.106877  6709 raft_consensus.cc:515] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:49.109076  6709 leader_election.cc:290] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:49.110045  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:49.111127  5929 raft_consensus.cc:2410] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:15:49.118953  6665 raft_consensus.cc:493] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.119601  6665 raft_consensus.cc:515] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:49.120597  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:49.121668  6003 raft_consensus.cc:2410] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:15:49.122117  6665 leader_election.cc:290] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:49.124425  6047 leader_election.cc:304] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:49.127086  6707 raft_consensus.cc:2749] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:49.127200  6078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:49.128090  6078 raft_consensus.cc:2468] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 3.
I20260709 12:15:49.129249  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:49.130051  6003 raft_consensus.cc:2468] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 3.
I20260709 12:15:49.131445  5899 leader_election.cc:304] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:49.132308  6767 raft_consensus.cc:2804] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:49.132689  6767 raft_consensus.cc:493] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.133010  6767 raft_consensus.cc:3060] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:49.145964  6767 raft_consensus.cc:515] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:49.159132  6004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:49.159852  6004 raft_consensus.cc:3060] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:49.160169  6432 consensus_queue.cc:1048] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:49.172910  6767 leader_election.cc:290] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 4 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:49.176031  6004 raft_consensus.cc:2468] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 4.
I20260709 12:15:49.181344  6078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bde6283aae54cca934953a54d9f7483" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:49.183967  5899 leader_election.cc:304] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:49.188370  6078 raft_consensus.cc:3060] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:49.188952  6665 raft_consensus.cc:2804] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:49.193742  6665 raft_consensus.cc:697] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 4 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:49.194738  6665 consensus_queue.cc:237] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:49.200639  6534 raft_consensus.cc:493] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.201238  6534 raft_consensus.cc:515] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:49.203509  6534 leader_election.cc:290] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:49.204583  5934 raft_consensus.cc:3060] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:49.206060  5852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713888d225a047099a38dc8257276146" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:49.209179  6002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713888d225a047099a38dc8257276146" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:49.210074  6002 raft_consensus.cc:2393] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26615d25670745d38490e2d6da247d9e in current term 1: Already voted for candidate 58ed30c66c784e06ad64609f8d1b4c43 in this term.
I20260709 12:15:49.195362  6432 consensus_queue.cc:1048] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:15:49.211520  5899 leader_election.cc:304] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:49.234231  6078 raft_consensus.cc:2468] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 4.
I20260709 12:15:49.263361  6622 raft_consensus.cc:2749] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:49.265002  6532 consensus_queue.cc:1048] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:15:49.269671  5757 catalog_manager.cc:5697] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 2 to 4, leader changed from e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67) to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 4 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:49.428475  6498 consensus_queue.cc:1048] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:15:49.510000  6532 consensus_queue.cc:1048] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:15:49.500346  6784 consensus_queue.cc:1048] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:15:49.529482  6781 consensus_queue.cc:1048] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:49.603493  6785 consensus_queue.cc:1048] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:15:49.607841  5824 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 106752us
I20260709 12:15:49.733631  6082 raft_consensus.cc:1275] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:49.735055  6534 consensus_queue.cc:1048] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:49.742035  6003 raft_consensus.cc:1275] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:49.745501  6534 consensus_queue.cc:1048] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:50.175755 25293 tablet_server.cc:179] TabletServer@127.24.179.65:0 shutting down...
W20260709 12:15:50.185441  5901 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 12:15:50.210606  6049 consensus_peers.cc:597] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:50.221458  6049 consensus_peers.cc:597] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:50.223050  5901 consensus_peers.cc:597] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:50.223825  5901 consensus_peers.cc:597] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:50.249262  5975 consensus_peers.cc:597] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:50.252498  5975 consensus_peers.cc:597] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:50.256680  6049 consensus_peers.cc:597] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:50.290701 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:50.292042 25293 tablet_replica.cc:333] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.293105 25293 raft_consensus.cc:2243] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.294052 25293 raft_consensus.cc:2272] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:50.297912  5901 consensus_peers.cc:597] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:50.300196 25293 tablet_replica.cc:333] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.301362 25293 raft_consensus.cc:2243] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.302103 25293 raft_consensus.cc:2272] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.304952 25293 tablet_replica.cc:333] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.305963 25293 raft_consensus.cc:2243] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:50.307076 25293 raft_consensus.cc:2272] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:50.308571  5975 consensus_peers.cc:597] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:50.309890 25293 tablet_replica.cc:333] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.310990 25293 raft_consensus.cc:2243] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:50.312119 25293 raft_consensus.cc:2272] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.315671 25293 tablet_replica.cc:333] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.316636 25293 raft_consensus.cc:2243] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.317260 25293 raft_consensus.cc:2272] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.320730 25293 tablet_replica.cc:333] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.322338 25293 raft_consensus.cc:2243] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.323019 25293 raft_consensus.cc:2272] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.326555 25293 tablet_replica.cc:333] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.327569 25293 raft_consensus.cc:2243] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.328958 25293 raft_consensus.cc:2272] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.333009 25293 tablet_replica.cc:333] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.334144 25293 raft_consensus.cc:2243] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:15:50.337081  6049 consensus_peers.cc:597] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:50.337702 25293 raft_consensus.cc:2272] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:50.338964  5975 consensus_peers.cc:597] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:50.341454 25293 tablet_replica.cc:333] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.349275 25293 raft_consensus.cc:2243] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:15:50.352931  5975 consensus_peers.cc:597] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:50.353868 25293 raft_consensus.cc:2272] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.357281 25293 tablet_replica.cc:333] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
W20260709 12:15:50.357321  6049 consensus_peers.cc:597] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:50.359699 25293 raft_consensus.cc:2243] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.360747 25293 raft_consensus.cc:2272] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.363544 25293 tablet_replica.cc:333] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.364490 25293 raft_consensus.cc:2243] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:50.365505 25293 raft_consensus.cc:2272] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.368168 25293 tablet_replica.cc:333] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.368934 25293 raft_consensus.cc:2243] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.369468 25293 raft_consensus.cc:2272] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.371874 25293 tablet_replica.cc:333] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.372570 25293 raft_consensus.cc:2243] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.373126 25293 raft_consensus.cc:2272] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.375340 25293 tablet_replica.cc:333] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.375944 25293 raft_consensus.cc:2243] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:50.376854 25293 raft_consensus.cc:2272] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.379824 25293 tablet_replica.cc:333] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.380708 25293 raft_consensus.cc:2243] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.381269 25293 raft_consensus.cc:2272] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.384779 25293 tablet_replica.cc:333] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.385764 25293 raft_consensus.cc:2243] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.386365 25293 raft_consensus.cc:2272] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:50.386744  5901 consensus_peers.cc:597] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:50.389530 25293 tablet_replica.cc:333] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.390635 25293 raft_consensus.cc:2243] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.392242 25293 raft_consensus.cc:2272] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.394796 25293 tablet_replica.cc:333] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.395483 25293 raft_consensus.cc:2243] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.395957 25293 raft_consensus.cc:2272] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.398147 25293 tablet_replica.cc:333] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.398802 25293 raft_consensus.cc:2243] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:50.399667 25293 raft_consensus.cc:2272] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.401891 25293 tablet_replica.cc:333] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.402668 25293 raft_consensus.cc:2243] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:50.403666 25293 raft_consensus.cc:2272] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.406502 25293 tablet_replica.cc:333] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.407197 25293 raft_consensus.cc:2243] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.407755 25293 raft_consensus.cc:2272] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.410588 25293 tablet_replica.cc:333] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.411423 25293 raft_consensus.cc:2243] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:50.412532 25293 raft_consensus.cc:2272] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.415403 25293 tablet_replica.cc:333] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.416291 25293 raft_consensus.cc:2243] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.416934 25293 raft_consensus.cc:2272] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:50.417454  5975 consensus_peers.cc:597] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:50.419834 25293 tablet_replica.cc:333] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.420885 25293 raft_consensus.cc:2243] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.421506 25293 raft_consensus.cc:2272] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.424419 25293 tablet_replica.cc:333] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.425359 25293 raft_consensus.cc:2243] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.426018 25293 raft_consensus.cc:2272] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.429116 25293 tablet_replica.cc:333] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
W20260709 12:15:50.429584  5975 consensus_peers.cc:597] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:50.430174 25293 raft_consensus.cc:2243] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.430920 25293 raft_consensus.cc:2272] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.433473 25293 tablet_replica.cc:333] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.434288 25293 raft_consensus.cc:2243] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:50.435278 25293 raft_consensus.cc:2272] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.437695 25293 tablet_replica.cc:333] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.438381 25293 raft_consensus.cc:2243] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:50.439404 25293 raft_consensus.cc:2272] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.441825 25293 tablet_replica.cc:333] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.442680 25293 raft_consensus.cc:2243] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.443243 25293 raft_consensus.cc:2272] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.445569 25293 tablet_replica.cc:333] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.446221 25293 raft_consensus.cc:2243] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:50.447202 25293 raft_consensus.cc:2272] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.449913 25293 tablet_replica.cc:333] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.450771 25293 raft_consensus.cc:2243] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:50.451884 25293 raft_consensus.cc:2272] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.454877 25293 tablet_replica.cc:333] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.455720 25293 raft_consensus.cc:2243] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:50.456844 25293 raft_consensus.cc:2272] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.459848 25293 tablet_replica.cc:333] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.460649 25293 raft_consensus.cc:2243] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:50.461766 25293 raft_consensus.cc:2272] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.464877 25293 tablet_replica.cc:333] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
W20260709 12:15:50.464960  5901 consensus_peers.cc:597] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:50.465698 25293 raft_consensus.cc:2243] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.466352 25293 raft_consensus.cc:2272] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.469231 25293 tablet_replica.cc:333] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.470058 25293 raft_consensus.cc:2243] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:50.471184 25293 raft_consensus.cc:2272] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.474102 25293 tablet_replica.cc:333] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.474924 25293 raft_consensus.cc:2243] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:50.476017 25293 raft_consensus.cc:2272] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.478996 25293 tablet_replica.cc:333] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.479799 25293 raft_consensus.cc:2243] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.480345 25293 raft_consensus.cc:2272] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.484254 25293 tablet_replica.cc:333] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.485088 25293 raft_consensus.cc:2243] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.485688 25293 raft_consensus.cc:2272] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.488134 25293 tablet_replica.cc:333] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.488942 25293 raft_consensus.cc:2243] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.489560 25293 raft_consensus.cc:2272] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.492448 25293 tablet_replica.cc:333] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.493206 25293 raft_consensus.cc:2243] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:50.494236 25293 raft_consensus.cc:2272] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.496803 25293 tablet_replica.cc:333] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.497550 25293 raft_consensus.cc:2243] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:50.498682 25293 raft_consensus.cc:2272] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.501834 25293 tablet_replica.cc:333] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.502607 25293 raft_consensus.cc:2243] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:50.503638 25293 raft_consensus.cc:2272] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.506554 25293 tablet_replica.cc:333] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.507285 25293 raft_consensus.cc:2243] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.507869 25293 raft_consensus.cc:2272] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:50.508327  6049 consensus_peers.cc:597] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:50.510269 25293 tablet_replica.cc:333] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.511134 25293 raft_consensus.cc:2243] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:50.511994 25293 raft_consensus.cc:2272] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:50.514468 25293 tablet_replica.cc:333] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43: stopping tablet replica
I20260709 12:15:50.515138 25293 raft_consensus.cc:2243] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:50.515658 25293 raft_consensus.cc:2272] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:50.547562  5975 consensus_peers.cc:597] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:50.601181 25293 tablet_server.cc:196] TabletServer@127.24.179.65:0 shutdown complete.
W20260709 12:15:50.640347  5975 consensus_peers.cc:597] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:50.665683  6049 consensus_peers.cc:597] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:50.672346  5975 consensus_peers.cc:597] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:50.726329  6049 consensus_peers.cc:597] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:50.738286 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:50.747334  6803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:50.753485  6804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:50.756964  5901 consensus_peers.cc:597] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:50.770644  6806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:50.775580 25293 server_base.cc:1061] running on GCE node
I20260709 12:15:50.782498 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:50.782896 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:50.783164 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599350783139 us; error 0 us; skew 500 ppm
I20260709 12:15:50.784035 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:50.791581 25293 webserver.cc:533] Webserver started at http://127.24.179.65:45873/ using document root <none> and password file <none>
I20260709 12:15:50.792367 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:50.792632 25293 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:15:50.797971 25293 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:15:50.831723  6814 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:50.833520 25293 fs_manager.cc:730] Time spent opening block manager: real 0.014s	user 0.001s	sys 0.000s
I20260709 12:15:50.833985 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-0-root
uuid: "58ed30c66c784e06ad64609f8d1b4c43"
format_stamp: "Formatted at 2026-07-09 12:15:31 on dist-test-slave-tjfs"
I20260709 12:15:50.834585 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894834136-25293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:50.858259 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:50.860152 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:50.862427 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:50.882822  6821 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:15:51.275790  6534 raft_consensus.cc:493] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.277797  6534 raft_consensus.cc:515] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:51.283573  6534 leader_election.cc:290] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
W20260709 12:15:51.309499  5901 leader_election.cc:336] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:51.320930  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d792c0dd53aa459399c3adf5d4f17f58" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:51.329908  6802 raft_consensus.cc:493] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.331089  6802 raft_consensus.cc:515] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:51.337770  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d792c0dd53aa459399c3adf5d4f17f58" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:51.338768  5929 raft_consensus.cc:2468] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:51.341352  5899 leader_election.cc:304] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:51.343117  6812 raft_consensus.cc:2749] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:51.343139  6048 leader_election.cc:304] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:51.346956  6709 raft_consensus.cc:2804] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:51.347549  6709 raft_consensus.cc:493] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.348039  6709 raft_consensus.cc:3060] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:51.350539  6802 leader_election.cc:290] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
W20260709 12:15:51.353874  6049 leader_election.cc:336] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:51.355103  6812 raft_consensus.cc:493] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.355926  6812 raft_consensus.cc:515] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:51.359862  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219ee6e67c3a4adf9dd72198036646bc" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:51.360049  6812 leader_election.cc:290] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.362531  6470 raft_consensus.cc:493] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.363380  6470 raft_consensus.cc:515] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:51.366781  6470 leader_election.cc:290] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.368136  6709 raft_consensus.cc:515] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
W20260709 12:15:51.374464  5975 leader_election.cc:336] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:51.384364  6049 leader_election.cc:336] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:51.386782  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:51.391923  5974 leader_election.cc:304] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:51.393429  6470 raft_consensus.cc:2749] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:15:51.394567  5901 leader_election.cc:336] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:51.395108  5901 leader_election.cc:304] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:51.396629  6812 raft_consensus.cc:2749] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:51.399859  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d792c0dd53aa459399c3adf5d4f17f58" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:51.400661  5934 raft_consensus.cc:3060] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:51.402956 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:15:51.403571 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.530s	user 0.016s	sys 0.004s
I20260709 12:15:51.404191 25293 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:15:51.406529  6709 leader_election.cc:290] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:51.410194  6778 raft_consensus.cc:493] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.411053  6778 raft_consensus.cc:515] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:51.415035  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3cdb9438c4a44489be534e4c1c147b5" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:51.417161  6778 leader_election.cc:290] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.420857  6821 tablet_bootstrap.cc:492] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:51.421636  6767 raft_consensus.cc:493] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.423009  6802 raft_consensus.cc:493] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.422658  6767 raft_consensus.cc:515] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:51.423825  6802 raft_consensus.cc:515] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:51.426445  6802 leader_election.cc:290] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:51.428236  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713888d225a047099a38dc8257276146" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
W20260709 12:15:51.430425  5901 leader_election.cc:336] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:51.431545  5899 leader_election.cc:304] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:51.431841  5928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219ee6e67c3a4adf9dd72198036646bc" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:51.432682  5928 raft_consensus.cc:2468] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:51.432832  6534 raft_consensus.cc:2749] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:51.433636  6534 raft_consensus.cc:493] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.434504  6767 leader_election.cc:290] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:51.434370  6534 raft_consensus.cc:515] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:51.442814  6783 raft_consensus.cc:493] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.443238  6048 leader_election.cc:304] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:51.443789  6783 raft_consensus.cc:515] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:51.444473  6778 raft_consensus.cc:2804] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:51.444995  6778 raft_consensus.cc:493] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.445410  6778 raft_consensus.cc:3060] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:51.448114  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31c56e0c1b4701bc388c4d3edf535a" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:51.450423  6534 leader_election.cc:290] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:51.451681  6783 leader_election.cc:290] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
W20260709 12:15:51.457223  5975 leader_election.cc:336] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:51.459043  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c61591bbcaf43839af1cc8373f98c7e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
W20260709 12:15:51.462662  5901 leader_election.cc:336] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:51.463457  5901 leader_election.cc:304] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:51.464666  6534 raft_consensus.cc:2749] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:51.467105  5974 leader_election.cc:304] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:51.468062  6783 raft_consensus.cc:2749] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:51.468621  5934 raft_consensus.cc:2468] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 2.
I20260709 12:15:51.493016  6812 raft_consensus.cc:493] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.496783  6812 raft_consensus.cc:515] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:51.501041  6812 leader_election.cc:290] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.507368  6048 leader_election.cc:304] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43
W20260709 12:15:51.511849  6049 leader_election.cc:336] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:51.512634  6049 leader_election.cc:304] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
W20260709 12:15:51.519683  6049 leader_election.cc:336] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:51.513300  6709 raft_consensus.cc:493] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.522168  6802 raft_consensus.cc:2804] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:51.521267  6783 raft_consensus.cc:493] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.542939  6825 raft_consensus.cc:2749] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:51.530576  6802 raft_consensus.cc:697] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:15:51.545868  6802 consensus_queue.cc:237] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
W20260709 12:15:51.543332  5901 leader_election.cc:336] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:51.556725  6783 raft_consensus.cc:515] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:51.559526  6825 raft_consensus.cc:493] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.560384  6709 raft_consensus.cc:515] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:51.568807  6825 raft_consensus.cc:515] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
W20260709 12:15:51.583173  6049 leader_election.cc:336] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:51.590467  6709 leader_election.cc:290] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:51.573244  6825 leader_election.cc:290] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.597966  6783 leader_election.cc:290] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:51.606940  6821 tablet_bootstrap.cc:492] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:51.608443  6821 tablet_bootstrap.cc:492] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:51.611171  6821 ts_tablet_manager.cc:1403] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.191s	user 0.019s	sys 0.011s
I20260709 12:15:51.616657  6778 raft_consensus.cc:515] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:51.617601  6812 raft_consensus.cc:493] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.618747  6812 raft_consensus.cc:515] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:51.621001  6821 raft_consensus.cc:359] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:51.621994  6821 raft_consensus.cc:740] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.622679  6812 leader_election.cc:290] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.631538  6778 leader_election.cc:290] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:51.632452  6821 consensus_queue.cc:260] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:51.638221  6821 ts_tablet_manager.cc:1434] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.001s
W20260709 12:15:51.652031  5975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 94818.8us
I20260709 12:15:51.652902  6821 tablet_bootstrap.cc:492] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:51.660440  6002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:51.686168  6813 raft_consensus.cc:493] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.687157  6813 raft_consensus.cc:515] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:51.690755  6813 leader_election.cc:290] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:51.691449  6813 raft_consensus.cc:493] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.692119  6813 raft_consensus.cc:515] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:51.696015  6813 leader_election.cc:290] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.715186  6813 raft_consensus.cc:493] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.715865  6813 raft_consensus.cc:515] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:51.718762  6813 leader_election.cc:290] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.736238  6813 raft_consensus.cc:493] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.737068  6813 raft_consensus.cc:515] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:51.742031  6825 raft_consensus.cc:493] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.742888  6825 raft_consensus.cc:515] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:51.745199  6825 leader_election.cc:290] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.745726  6825 raft_consensus.cc:493] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.746279  6825 raft_consensus.cc:515] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:51.747327  6827 raft_consensus.cc:493] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.748677  6825 leader_election.cc:290] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.751262  6813 leader_election.cc:290] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.752019  6813 raft_consensus.cc:493] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.753736  6813 raft_consensus.cc:515] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:51.759449  6813 leader_election.cc:290] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.748317  6827 raft_consensus.cc:515] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:51.765407  6827 leader_election.cc:290] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.770908  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0484fe261cb3459cb6a2f532f88c0845" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:51.771199  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:51.771792  6082 raft_consensus.cc:2468] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:51.772145  6077 raft_consensus.cc:2468] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 3.
I20260709 12:15:51.773854  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500f59123914ed198a39756117b4110" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:51.776075  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687e45fe6f3444c794271e801c21280d" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:51.776988  6077 raft_consensus.cc:2468] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:51.777650  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35395bd69ad41f0b37fd3edca49777c" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:51.778308  5899 leader_election.cc:304] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:51.778450  6827 raft_consensus.cc:493] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.779918  6827 raft_consensus.cc:515] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:51.782330  6827 leader_election.cc:290] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.785418  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219ee6e67c3a4adf9dd72198036646bc" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:51.786139  5932 raft_consensus.cc:3060] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:51.786576  6076 raft_consensus.cc:2468] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:51.787350  5928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0484fe261cb3459cb6a2f532f88c0845" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:51.746783  6829 raft_consensus.cc:493] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.788163  5928 raft_consensus.cc:2468] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:51.788558  6829 raft_consensus.cc:515] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:51.789513  5927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35395bd69ad41f0b37fd3edca49777c" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:51.771045  6074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d9e90868894fa78e9f94ca432dc703" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:51.790340  5927 raft_consensus.cc:2468] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:51.790894  6074 raft_consensus.cc:2468] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:51.792404  6829 leader_election.cc:290] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:51.792491  5899 leader_election.cc:304] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:51.793735  5899 leader_election.cc:304] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:51.796247  5932 raft_consensus.cc:2468] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 2.
I20260709 12:15:51.799960  6534 raft_consensus.cc:2804] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:51.804783  6534 raft_consensus.cc:493] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.805377  6534 raft_consensus.cc:3060] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:51.800186  6813 raft_consensus.cc:2804] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:51.808980  6813 raft_consensus.cc:493] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.810674  6813 raft_consensus.cc:3060] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:51.833104  6470 raft_consensus.cc:493] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.833921  6470 raft_consensus.cc:515] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:51.836349  6470 leader_election.cc:290] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.836867  6470 raft_consensus.cc:493] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.837399  6470 raft_consensus.cc:515] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:51.842492  6825 raft_consensus.cc:493] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.843511  6825 raft_consensus.cc:515] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:51.800709  6824 raft_consensus.cc:493] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.811141  6767 raft_consensus.cc:2804] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:51.846908  6767 raft_consensus.cc:493] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.847488  6767 raft_consensus.cc:3060] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:51.846931  6824 raft_consensus.cc:515] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:51.852414  6813 raft_consensus.cc:515] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:51.854167  6825 leader_election.cc:290] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.856640  6813 leader_election.cc:290] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 4 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.803999  6048 leader_election.cc:304] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
W20260709 12:15:51.859380  6049 leader_election.cc:336] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:51.859512  6048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 55594.5us
I20260709 12:15:51.860250  6827 raft_consensus.cc:2804] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:51.853652  6824 leader_election.cc:290] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.860579  6048 leader_election.cc:304] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:51.860773  6827 raft_consensus.cc:493] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.862691  6827 raft_consensus.cc:3060] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:51.864954  6825 raft_consensus.cc:2804] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:51.864305  5757 catalog_manager.cc:5697] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 1 to 2, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 2 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:51.865428  6825 raft_consensus.cc:493] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.875226  6829 raft_consensus.cc:493] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.874003  6047 leader_election.cc:304] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:51.877028  6783 raft_consensus.cc:493] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
W20260709 12:15:51.883539  5899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 89865.6us
I20260709 12:15:51.895548  5899 leader_election.cc:304] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:51.879307  6838 raft_consensus.cc:493] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.893476  6048 leader_election.cc:304] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
W20260709 12:15:51.903455  5901 leader_election.cc:336] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:51.904162  5901 leader_election.cc:336] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:51.904968  5901 leader_election.cc:336] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:51.901151  6829 raft_consensus.cc:515] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:51.906309  6835 raft_consensus.cc:493] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.907192  6836 raft_consensus.cc:493] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.907084  6835 raft_consensus.cc:515] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:51.908073  6829 leader_election.cc:290] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:51.907919  6836 raft_consensus.cc:515] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:51.909518  6835 leader_election.cc:290] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
W20260709 12:15:51.905704  5901 leader_election.cc:336] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:51.910175  6835 raft_consensus.cc:2804] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:51.894829  6825 raft_consensus.cc:3060] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:51.913648  5901 leader_election.cc:304] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:51.917945  5899 leader_election.cc:304] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:51.922492  6470 leader_election.cc:290] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
W20260709 12:15:51.920689  5901 leader_election.cc:336] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:51.924119  6834 raft_consensus.cc:2749] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:51.911886  6802 raft_consensus.cc:2804] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:15:51.926203  5901 leader_election.cc:336] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:51.926847  6049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 79444.2us
I20260709 12:15:51.912102  6778 raft_consensus.cc:2749] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:51.931866  6470 raft_consensus.cc:493] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.932579  6470 raft_consensus.cc:515] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:51.933369  6812 raft_consensus.cc:2804] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:51.933843  6812 raft_consensus.cc:493] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.926239  6767 raft_consensus.cc:515] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:51.934226  6812 raft_consensus.cc:3060] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:51.911635  6783 raft_consensus.cc:515] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:51.936347  6767 leader_election.cc:290] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.910323  6836 leader_election.cc:290] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
W20260709 12:15:51.938342  5901 leader_election.cc:336] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:51.939483  6470 leader_election.cc:290] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:51.940748  6802 raft_consensus.cc:697] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:15:51.942046  6802 consensus_queue.cc:237] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:51.945353  6834 raft_consensus.cc:493] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.946019  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500f59123914ed198a39756117b4110" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:51.946903  5929 raft_consensus.cc:2468] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:51.920706  6835 raft_consensus.cc:493] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.955583  6470 raft_consensus.cc:493] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.946235  6834 raft_consensus.cc:515] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:51.959852  6048 leader_election.cc:304] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:51.961359  6470 raft_consensus.cc:515] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:51.898628  6838 raft_consensus.cc:515] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:51.963970  6837 raft_consensus.cc:493] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.964738  6838 leader_election.cc:290] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:51.968537  6470 leader_election.cc:290] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.968793  6834 leader_election.cc:290] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:51.955329  6824 raft_consensus.cc:493] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.969802  6824 raft_consensus.cc:515] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:51.970808  6534 raft_consensus.cc:515] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:51.958333  6835 raft_consensus.cc:3060] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:51.972352  6824 leader_election.cc:290] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.964756  6837 raft_consensus.cc:515] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:51.982169  6821 tablet_bootstrap.cc:492] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:51.979033  6534 leader_election.cc:290] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.984740  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dad9466c8e40558116511df4c6330e" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:51.993863  6007 raft_consensus.cc:2468] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 2.
I20260709 12:15:51.985250  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:51.995169  6785 raft_consensus.cc:493] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:51.995286  6008 raft_consensus.cc:2468] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 2.
I20260709 12:15:51.995918  6785 raft_consensus.cc:515] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:51.985751  6004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c61591bbcaf43839af1cc8373f98c7e" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:51.997435  6004 raft_consensus.cc:2468] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:51.983757  6837 leader_election.cc:290] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:51.981410  6783 leader_election.cc:290] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:51.999917  6802 raft_consensus.cc:2804] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.002676  6785 leader_election.cc:290] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:52.002957  6802 raft_consensus.cc:493] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:52.003748  6802 raft_consensus.cc:3060] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:51.978379  6827 raft_consensus.cc:515] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:52.002914  6002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a474468455492f992eb8dfefad0ca2" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:52.007202  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0484fe261cb3459cb6a2f532f88c0845" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:52.007894  6821 tablet_bootstrap.cc:492] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:52.008076  5929 raft_consensus.cc:2393] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb in current term 2: Already voted for candidate 26615d25670745d38490e2d6da247d9e in this term.
I20260709 12:15:52.008769  6821 ts_tablet_manager.cc:1403] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.356s	user 0.021s	sys 0.029s
W20260709 12:15:52.010504  6049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 82798.9us
W20260709 12:15:52.011139  6049 leader_election.cc:336] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:52.011859  6049 leader_election.cc:336] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.012060  6825 raft_consensus.cc:515] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
W20260709 12:15:52.012562  6049 leader_election.cc:336] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:52.013196  6049 leader_election.cc:336] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:52.013652  6049 leader_election.cc:336] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:52.014045  6049 leader_election.cc:336] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.014351  6825 leader_election.cc:290] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:52.010521  5899 leader_election.cc:304] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:52.022300  6767 raft_consensus.cc:2804] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:52.022368  5899 leader_election.cc:304] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:52.022876  6767 raft_consensus.cc:493] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:52.023340  6767 raft_consensus.cc:3060] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:52.023821  6834 raft_consensus.cc:2804] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:52.024260  6834 raft_consensus.cc:493] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:52.024645  6834 raft_consensus.cc:3060] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:52.026808  5899 leader_election.cc:304] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:52.027884  6840 raft_consensus.cc:2804] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.028326  6840 raft_consensus.cc:493] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:52.028651  6840 raft_consensus.cc:3060] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.031054  6835 raft_consensus.cc:515] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:52.033664  6835 leader_election.cc:290] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:52.036902  6767 raft_consensus.cc:515] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:52.039803  6821 raft_consensus.cc:359] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:52.040670  6821 raft_consensus.cc:740] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.041514  6821 consensus_queue.cc:260] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:52.007308  6002 raft_consensus.cc:2468] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 1.
I20260709 12:15:52.044168  5899 leader_election.cc:304] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:52.050868  6074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:52.051657  6074 raft_consensus.cc:3060] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:52.052875  6767 leader_election.cc:290] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:52.054886  6802 raft_consensus.cc:515] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:52.055929  6002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dad9466c8e40558116511df4c6330e" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:52.056607  6002 raft_consensus.cc:3060] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:52.057452  6802 leader_election.cc:290] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:52.015187  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35395bd69ad41f0b37fd3edca49777c" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:52.059259  5929 raft_consensus.cc:2393] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb in current term 2: Already voted for candidate 26615d25670745d38490e2d6da247d9e in this term.
I20260709 12:15:52.059434  6821 ts_tablet_manager.cc:1434] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
W20260709 12:15:52.018286  5901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 77591us
I20260709 12:15:52.060899  5927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500f59123914ed198a39756117b4110" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:52.062009  5927 raft_consensus.cc:3060] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.053635  6767 raft_consensus.cc:2804] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.062541  6767 raft_consensus.cc:493] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:52.062952  6767 raft_consensus.cc:3060] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.064378  6821 tablet_bootstrap.cc:492] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:52.068574  6812 raft_consensus.cc:515] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:52.006498  6827 leader_election.cc:290] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
W20260709 12:15:52.075111  5901 leader_election.cc:336] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.077675  6074 raft_consensus.cc:2468] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 4.
I20260709 12:15:52.078017  5927 raft_consensus.cc:2468] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 2.
I20260709 12:15:52.079620  6840 raft_consensus.cc:515] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:52.080016  6048 leader_election.cc:304] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:52.081256  6802 raft_consensus.cc:2804] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:52.081251  6834 raft_consensus.cc:515] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:52.082149  6802 raft_consensus.cc:697] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:15:52.083550  6802 consensus_queue.cc:237] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:52.084705  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687e45fe6f3444c794271e801c21280d" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:52.085423  6079 raft_consensus.cc:3060] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:52.090939  5901 leader_election.cc:336] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.098357  5927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2dad9466c8e40558116511df4c6330e" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:52.099291  5927 raft_consensus.cc:2393] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 3: Already voted for candidate 26615d25670745d38490e2d6da247d9e in this term.
I20260709 12:15:52.099092  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df660011133455e8ede132d5d56c48f" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:52.098044  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873d3215e6ba4214a3910fa16e0fd62a" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:52.099987  6005 raft_consensus.cc:2468] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:52.100234  6008 raft_consensus.cc:2468] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:52.098037  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972a71bd13ef4022b6966d1287868dc4" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:52.101572  6003 raft_consensus.cc:2468] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:52.100391  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ace1a67c98413c886c1ce2cfcd66af" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:52.104269  6007 raft_consensus.cc:2468] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:52.106070  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0484fe261cb3459cb6a2f532f88c0845" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:52.106258  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18f65fb1b1f4544b9e6a96399e38089" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:52.106966  6082 raft_consensus.cc:2393] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 26615d25670745d38490e2d6da247d9e in current term 2: Already voted for candidate 36dfe581d09b46f6a9bfe678170e71cb in this term.
I20260709 12:15:52.107136  6005 raft_consensus.cc:2468] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:52.107779  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d9e90868894fa78e9f94ca432dc703" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:52.108459  6076 raft_consensus.cc:3060] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.128053  6812 leader_election.cc:290] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:52.129005  6840 leader_election.cc:290] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:52.128160  5927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713888d225a047099a38dc8257276146" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:52.130913  5927 raft_consensus.cc:2468] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:52.134294  6002 raft_consensus.cc:2468] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 3.
I20260709 12:15:52.135679  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873d3215e6ba4214a3910fa16e0fd62a" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:52.160811  6077 raft_consensus.cc:2468] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:52.136976  6078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3cdb9438c4a44489be534e4c1c147b5" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:52.161983  6078 raft_consensus.cc:2468] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:52.138764  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972a71bd13ef4022b6966d1287868dc4" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:52.139724  5927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a474468455492f992eb8dfefad0ca2" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:52.141088  6080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:52.163007  6081 raft_consensus.cc:2468] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:52.163582  6080 raft_consensus.cc:2468] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 3.
I20260709 12:15:52.145897  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c61591bbcaf43839af1cc8373f98c7e" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
W20260709 12:15:52.148945  5975 leader_election.cc:336] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.164328  6078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ace1a67c98413c886c1ce2cfcd66af" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:52.164949  6005 raft_consensus.cc:3060] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.165102  6078 raft_consensus.cc:2468] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:52.166424  6081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18f65fb1b1f4544b9e6a96399e38089" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:52.167147  6081 raft_consensus.cc:2468] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:52.170181  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df660011133455e8ede132d5d56c48f" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:52.171269  6082 raft_consensus.cc:2468] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:52.173641  5974 leader_election.cc:304] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:52.173902  5899 leader_election.cc:304] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:52.175134  6835 raft_consensus.cc:2804] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:52.159600  6767 raft_consensus.cc:515] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:52.177350  6785 raft_consensus.cc:2749] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:52.177561  5927 raft_consensus.cc:2393] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 2: Already voted for candidate 26615d25670745d38490e2d6da247d9e in this term.
I20260709 12:15:52.149780  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31c56e0c1b4701bc388c4d3edf535a" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:52.178344  5932 raft_consensus.cc:2468] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 1.
I20260709 12:15:52.144709  6079 raft_consensus.cc:2468] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 2.
I20260709 12:15:52.181480  5974 leader_election.cc:304] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:52.182955  6785 raft_consensus.cc:2804] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.183380  6785 raft_consensus.cc:493] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:52.183749  6785 raft_consensus.cc:3060] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.176465  6835 raft_consensus.cc:697] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 3 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:52.187532  6835 consensus_queue.cc:237] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:52.190615  6002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a474468455492f992eb8dfefad0ca2" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:52.205094  6005 raft_consensus.cc:2468] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 2.
I20260709 12:15:52.197477  6785 raft_consensus.cc:515] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:52.199097  6047 leader_election.cc:304] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:52.207073  6047 leader_election.cc:304] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
W20260709 12:15:52.207347  5975 leader_election.cc:336] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:52.207895  5975 leader_election.cc:336] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.208236  6047 leader_election.cc:304] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:52.206918  5899 leader_election.cc:304] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
W20260709 12:15:52.202149  5901 leader_election.cc:336] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.209880  6047 leader_election.cc:304] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
W20260709 12:15:52.209983  5901 leader_election.cc:336] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.203227  6076 raft_consensus.cc:2468] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 2.
W20260709 12:15:52.208356  5975 leader_election.cc:336] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:52.211395  5901 leader_election.cc:336] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:52.212411  5901 leader_election.cc:336] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.211627  6827 raft_consensus.cc:2804] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.216154  6827 raft_consensus.cc:493] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:52.216715  6827 raft_consensus.cc:3060] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.211661  6778 raft_consensus.cc:2804] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.217599  6785 leader_election.cc:290] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:52.217806  6778 raft_consensus.cc:493] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:52.218247  6778 raft_consensus.cc:3060] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.214282  6840 raft_consensus.cc:2804] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:52.219607  6840 raft_consensus.cc:697] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 2 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:52.220837  6840 consensus_queue.cc:237] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:52.213408  6709 raft_consensus.cc:2804] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.222898  6709 raft_consensus.cc:493] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:52.223263  6709 raft_consensus.cc:3060] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.204077  6767 leader_election.cc:290] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
W20260709 12:15:52.212899  5901 leader_election.cc:336] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.213167  6825 raft_consensus.cc:2804] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.226996  6825 raft_consensus.cc:493] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:52.227403  6825 raft_consensus.cc:3060] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.227936  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713888d225a047099a38dc8257276146" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:52.228592  5932 raft_consensus.cc:3060] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.238339  5932 raft_consensus.cc:2468] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 2.
I20260709 12:15:52.205912  6002 raft_consensus.cc:3060] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.241955  5974 leader_election.cc:304] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:52.210114  6074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35395bd69ad41f0b37fd3edca49777c" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:52.246609  6847 raft_consensus.cc:2804] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.252447  6074 raft_consensus.cc:2393] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 26615d25670745d38490e2d6da247d9e in current term 2: Already voted for candidate 36dfe581d09b46f6a9bfe678170e71cb in this term.
I20260709 12:15:52.255923  6778 raft_consensus.cc:515] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:52.257977  6002 raft_consensus.cc:2468] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 2.
I20260709 12:15:52.257797  6709 raft_consensus.cc:515] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:52.258209  6778 leader_election.cc:290] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:52.259083  6047 leader_election.cc:304] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:52.261051  5974 leader_election.cc:304] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
W20260709 12:15:52.270332  5901 leader_election.cc:336] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.250996  6847 raft_consensus.cc:493] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:52.272208  6847 raft_consensus.cc:3060] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.272848  5899 leader_election.cc:304] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:52.275990  6709 leader_election.cc:290] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:52.276450  6821 tablet_bootstrap.cc:492] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:52.276732  6785 raft_consensus.cc:2804] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:52.277372  6785 raft_consensus.cc:697] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [term 2 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:52.278921  6829 raft_consensus.cc:2804] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.278472  6534 raft_consensus.cc:2804] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:52.279944  6534 raft_consensus.cc:697] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 2 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:52.280800  6534 consensus_queue.cc:237] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:52.282073  6847 raft_consensus.cc:515] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:52.279394  6829 raft_consensus.cc:493] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:52.283082  6829 raft_consensus.cc:3060] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:52.271492  5901 leader_election.cc:336] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.283043  5899 leader_election.cc:304] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:52.287784  6842 raft_consensus.cc:2804] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:52.288350  6842 raft_consensus.cc:697] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 4 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:52.289294  6842 consensus_queue.cc:237] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:52.278357  6785 consensus_queue.cc:237] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:52.292514  5973 leader_election.cc:304] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:52.293852  6843 raft_consensus.cc:2804] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.294273  6843 raft_consensus.cc:493] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:52.294677  6843 raft_consensus.cc:3060] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.277513  6821 tablet_bootstrap.cc:492] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:52.295790  5973 leader_election.cc:304] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:52.296578  6821 ts_tablet_manager.cc:1403] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.236s	user 0.037s	sys 0.023s
I20260709 12:15:52.295749  5899 leader_election.cc:304] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:52.299237  5973 leader_election.cc:304] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
W20260709 12:15:52.300727  5901 leader_election.cc:336] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.301725  5973 leader_election.cc:304] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:52.300823  6783 raft_consensus.cc:2804] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.304394  6836 raft_consensus.cc:2749] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:15:52.303160  6049 leader_election.cc:336] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.295126  6834 leader_election.cc:290] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
W20260709 12:15:52.307108  6049 leader_election.cc:336] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:52.308243  6049 leader_election.cc:336] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.308303  6832 raft_consensus.cc:2804] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:52.305958  6837 raft_consensus.cc:2804] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.308753  6049 leader_election.cc:304] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:52.308849  6832 raft_consensus.cc:493] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:52.309158  6837 raft_consensus.cc:493] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:52.309432  6832 raft_consensus.cc:3060] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:52.309412  6821 raft_consensus.cc:359] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
W20260709 12:15:52.309811  6049 leader_election.cc:336] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.310222  6821 raft_consensus.cc:740] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.304852  6783 raft_consensus.cc:493] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:52.307214  5973 leader_election.cc:304] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:52.304694  6825 raft_consensus.cc:515] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:52.310336  6049 leader_election.cc:304] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
W20260709 12:15:52.333189  5901 leader_election.cc:336] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:52.340278  5899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 44610.5us
I20260709 12:15:52.342379  6002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:52.311364  6821 consensus_queue.cc:260] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:52.324563  5973 leader_election.cc:304] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:52.343215  6002 raft_consensus.cc:3060] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:52.310920  6783 raft_consensus.cc:3060] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.309613  6837 raft_consensus.cc:3060] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.354984  5899 leader_election.cc:304] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:52.353780  6785 raft_consensus.cc:2804] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.330309  6778 raft_consensus.cc:2749] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:52.355125  5973 leader_election.cc:304] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:52.331748  6831 raft_consensus.cc:2804] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.360239  6821 ts_tablet_manager.cc:1434] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 12:15:52.345256  6709 raft_consensus.cc:2749] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:52.363927  5899 leader_election.cc:304] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:52.368867  6470 raft_consensus.cc:2804] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:52.369432  6470 raft_consensus.cc:493] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:52.369748  6470 raft_consensus.cc:3060] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.318558  6827 raft_consensus.cc:515] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:52.315529  6829 raft_consensus.cc:515] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:52.376108  6534 raft_consensus.cc:2804] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:52.375649  5899 leader_election.cc:304] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26615d25670745d38490e2d6da247d9e; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:52.380831  6821 tablet_bootstrap.cc:492] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:52.318845  6832 raft_consensus.cc:515] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:52.362831  6785 raft_consensus.cc:493] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:52.401535  6785 raft_consensus.cc:3060] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.403935  6829 leader_election.cc:290] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:52.403445  6470 raft_consensus.cc:515] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:52.406608  6470 leader_election.cc:290] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:52.383914  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873d3215e6ba4214a3910fa16e0fd62a" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:52.370795  6825 leader_election.cc:290] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:52.317808  6843 raft_consensus.cc:515] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:52.417943  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31c56e0c1b4701bc388c4d3edf535a" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:52.389950  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972a71bd13ef4022b6966d1287868dc4" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:52.392252  6847 leader_election.cc:290] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:52.392241  6835 raft_consensus.cc:2749] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:52.393477  6832 leader_election.cc:290] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 4 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:52.396682  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ace1a67c98413c886c1ce2cfcd66af" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:52.400624  6827 leader_election.cc:290] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:52.369503  6813 raft_consensus.cc:2804] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:52.430886  6005 raft_consensus.cc:2393] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb in current term 2: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
I20260709 12:15:52.431371  6813 raft_consensus.cc:697] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [term 2 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:52.367895  6831 raft_consensus.cc:493] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:15:52.432279  6831 raft_consensus.cc:3060] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.435081  6813 consensus_queue.cc:237] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:52.435737  6002 raft_consensus.cc:2468] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 3.
I20260709 12:15:52.437785  5931 raft_consensus.cc:1275] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:52.387415  6534 raft_consensus.cc:697] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [term 2 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:52.428314  6843 leader_election.cc:290] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:52.424664  5932 raft_consensus.cc:3060] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.444028  5899 leader_election.cc:304] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
W20260709 12:15:52.441583  5975 leader_election.cc:336] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.445736  5975 leader_election.cc:304] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:52.454149 25293 ts_tablet_manager.cc:600] Registering tablets (34/45 complete)
I20260709 12:15:52.455668  6835 raft_consensus.cc:2804] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:52.444415  6785 raft_consensus.cc:515] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:52.470669  6841 consensus_queue.cc:1048] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:52.470744  5756 catalog_manager.cc:5697] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 1 to 2, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:52.454843  5973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 74673us
W20260709 12:15:52.455178  5975 leader_election.cc:336] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.473196  6534 consensus_queue.cc:237] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:52.449970  6783 raft_consensus.cc:515] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
W20260709 12:15:52.476127  5975 leader_election.cc:336] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:52.486001  5975 leader_election.cc:336] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:52.486914  5975 leader_election.cc:336] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:52.487695  5975 leader_election.cc:336] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.482013  6837 raft_consensus.cc:515] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:52.491160  6007 raft_consensus.cc:2393] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb in current term 2: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
I20260709 12:15:52.493732  6783 leader_election.cc:290] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:52.496861  6837 leader_election.cc:290] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:52.483816  6831 raft_consensus.cc:515] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:52.487450  5932 raft_consensus.cc:2468] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 2.
I20260709 12:15:52.456492  6843 raft_consensus.cc:2749] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:52.488827  5975 leader_election.cc:336] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:52.503175  6049 leader_election.cc:336] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:52.504124  6049 consensus_peers.cc:597] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:52.471606  6835 raft_consensus.cc:697] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 3 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:15:52.502745  5974 leader_election.cc:304] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:52.507122  6847 raft_consensus.cc:2804] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:52.507714  6847 raft_consensus.cc:697] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 2 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:52.508844  6847 consensus_queue.cc:237] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
W20260709 12:15:52.517184  5975 leader_election.cc:336] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.519179  6008 raft_consensus.cc:2393] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb in current term 2: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
I20260709 12:15:52.519743  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18f65fb1b1f4544b9e6a96399e38089" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:52.520308  6835 consensus_queue.cc:237] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:52.523159  6002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df660011133455e8ede132d5d56c48f" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
W20260709 12:15:52.533663  6049 leader_election.cc:336] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.541517  6049 leader_election.cc:304] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
W20260709 12:15:52.530939  5975 leader_election.cc:336] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.532720  6005 raft_consensus.cc:2393] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb in current term 2: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
I20260709 12:15:52.548507  6002 raft_consensus.cc:2393] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb in current term 2: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
W20260709 12:15:52.551622  5975 leader_election.cc:336] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:52.557631  6049 leader_election.cc:336] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.561228  6778 raft_consensus.cc:2749] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:52.580442  6047 leader_election.cc:304] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:52.580825  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873d3215e6ba4214a3910fa16e0fd62a" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:52.581822  6082 raft_consensus.cc:2393] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 2: Already voted for candidate 36dfe581d09b46f6a9bfe678170e71cb in this term.
I20260709 12:15:52.584587  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df660011133455e8ede132d5d56c48f" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:52.585444  6076 raft_consensus.cc:2393] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 2: Already voted for candidate 36dfe581d09b46f6a9bfe678170e71cb in this term.
I20260709 12:15:52.586242  6823 raft_consensus.cc:2749] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:52.587534  6079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:52.588250  6079 raft_consensus.cc:3060] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:52.590842  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3cdb9438c4a44489be534e4c1c147b5" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:52.591678  6082 raft_consensus.cc:3060] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.593158  5932 raft_consensus.cc:1275] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:52.599287  6860 consensus_queue.cc:1048] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:15:52.615417  5975 leader_election.cc:336] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:52.616451  5975 leader_election.cc:336] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.613868  6079 raft_consensus.cc:2468] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 4.
W20260709 12:15:52.618561  5975 leader_election.cc:336] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:52.619515  5975 leader_election.cc:336] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.601943  6785 leader_election.cc:290] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
W20260709 12:15:52.622903  5974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 67614.7us
I20260709 12:15:52.622463  6821 tablet_bootstrap.cc:492] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:52.624635  5973 leader_election.cc:304] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:52.628391  6821 tablet_bootstrap.cc:492] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:52.629179  6821 ts_tablet_manager.cc:1403] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.261s	user 0.031s	sys 0.024s
I20260709 12:15:52.625908  6074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972a71bd13ef4022b6966d1287868dc4" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:52.631728  5973 leader_election.cc:304] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:52.632047  6074 raft_consensus.cc:2393] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 2: Already voted for candidate 36dfe581d09b46f6a9bfe678170e71cb in this term.
W20260709 12:15:52.633981  6049 leader_election.cc:336] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.634850  6049 leader_election.cc:304] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:52.635053  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ace1a67c98413c886c1ce2cfcd66af" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
W20260709 12:15:52.635839  6049 leader_election.cc:336] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.636018  6083 raft_consensus.cc:2393] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 2: Already voted for candidate 36dfe581d09b46f6a9bfe678170e71cb in this term.
I20260709 12:15:52.636292  6049 leader_election.cc:304] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
W20260709 12:15:52.637247  6049 leader_election.cc:336] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.637516  6823 raft_consensus.cc:2749] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:52.637993  6860 raft_consensus.cc:2749] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:52.637709  6049 leader_election.cc:304] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:52.639212  6841 raft_consensus.cc:2749] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:52.654634  6082 raft_consensus.cc:2468] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 2.
I20260709 12:15:52.630028  6843 raft_consensus.cc:2749] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:52.667519  5973 leader_election.cc:304] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
W20260709 12:15:52.674801  6104 debug-util.cc:398] Leaking SignalData structure 0x7b0800163fc0 after lost signal to thread 25296
W20260709 12:15:52.676101  6104 debug-util.cc:398] Leaking SignalData structure 0x7b08001646a0 after lost signal to thread 5792
W20260709 12:15:52.677616  6104 debug-util.cc:398] Leaking SignalData structure 0x7b0800104d00 after lost signal to thread 5959
I20260709 12:15:52.678532  6865 raft_consensus.cc:2749] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:52.679394  6865 raft_consensus.cc:2804] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:52.679936  6865 raft_consensus.cc:697] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 4 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:52.680182  5973 leader_election.cc:304] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:52.680967  6865 consensus_queue.cc:237] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:52.687253  6847 raft_consensus.cc:2749] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:15:52.691817  5975 leader_election.cc:336] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.695763  5973 leader_election.cc:304] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:52.695623  6821 raft_consensus.cc:359] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:52.708189  6821 raft_consensus.cc:740] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
W20260709 12:15:52.697106  6049 consensus_peers.cc:597] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:52.702548  6002 raft_consensus.cc:1275] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:52.709359  6821 consensus_queue.cc:260] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:52.711001  6785 raft_consensus.cc:2804] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:52.713754  6813 consensus_queue.cc:1048] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:15:52.714335  6868 log.cc:927] Time spent T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e: Append to log took a long time: real 0.090s	user 0.004s	sys 0.000s
W20260709 12:15:52.716184  6104 debug-util.cc:398] Leaking SignalData structure 0x7b08000a48e0 after lost signal to thread 6033
W20260709 12:15:52.718897  6104 debug-util.cc:398] Leaking SignalData structure 0x7b08002536e0 after lost signal to thread 6107
W20260709 12:15:52.722023  5975 consensus_peers.cc:597] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:52.727327  6785 raft_consensus.cc:697] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 2 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:52.728884  6821 ts_tablet_manager.cc:1434] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.001s
I20260709 12:15:52.729903  6821 tablet_bootstrap.cc:492] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
W20260709 12:15:52.735126  5901 consensus_peers.cc:597] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:52.736320  5757 catalog_manager.cc:5697] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 1 to 2, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 2 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:52.745275  6785 consensus_queue.cc:237] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:52.749086  6075 raft_consensus.cc:1275] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:52.734949  6078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18f65fb1b1f4544b9e6a96399e38089" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:52.753795  5757 catalog_manager.cc:5697] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 1 to 2, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 2 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:52.751222  6078 raft_consensus.cc:2393] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e29106aa83aa4eebb9b87d6745825a27 in current term 2: Already voted for candidate 36dfe581d09b46f6a9bfe678170e71cb in this term.
W20260709 12:15:52.763700  6049 consensus_peers.cc:597] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:52.771230  5973 leader_election.cc:304] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:52.776103  6853 consensus_queue.cc:1048] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:15:52.774214  6837 raft_consensus.cc:2749] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:52.780121  6831 leader_election.cc:290] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:52.788964  6005 raft_consensus.cc:1275] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:52.790153  5975 leader_election.cc:336] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:52.790751  5975 leader_election.cc:304] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:52.791213  6813 consensus_queue.cc:1048] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:52.791916  5929 raft_consensus.cc:1275] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:52.814976  5901 consensus_peers.cc:597] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:52.794056  6825 consensus_queue.cc:1048] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:15:52.799023  6831 raft_consensus.cc:2749] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:15:52.831459  6049 consensus_peers.cc:597] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:52.881955  5975 consensus_peers.cc:597] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:52.898063  6873 log.cc:927] Time spent T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27: Append to log took a long time: real 0.091s	user 0.001s	sys 0.003s
W20260709 12:15:52.900091  5901 consensus_peers.cc:597] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:52.900709  5901 consensus_peers.cc:597] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:52.901158  5901 consensus_peers.cc:597] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:52.901567  5901 consensus_peers.cc:597] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:52.901964  5901 consensus_peers.cc:597] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:52.902494  5901 consensus_peers.cc:597] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:52.902912  5901 consensus_peers.cc:597] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:52.918480  5757 catalog_manager.cc:5697] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 1 to 2, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:52.920531  5757 catalog_manager.cc:5697] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 3 to 4, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 4 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:52.927317  5929 raft_consensus.cc:1275] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Refusing update from remote peer e29106aa83aa4eebb9b87d6745825a27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:52.931578  6847 consensus_queue.cc:1048] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:52.934188  5755 catalog_manager.cc:5697] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 3 to 4, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 4 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } }
I20260709 12:15:52.935137  6002 raft_consensus.cc:1275] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:52.939723  6812 consensus_queue.cc:1048] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:52.908555 25293 ts_tablet_manager.cc:616] Registered 45 tablets
W20260709 12:15:52.941800  5901 consensus_peers.cc:597] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:52.949493 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 1.545s	user 0.354s	sys 0.036s
W20260709 12:15:52.943564  5975 consensus_peers.cc:597] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:52.962622  5975 consensus_peers.cc:597] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:52.971338  5901 consensus_peers.cc:597] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:52.970773  5932 raft_consensus.cc:1275] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Refusing update from remote peer e29106aa83aa4eebb9b87d6745825a27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:52.994282  6831 consensus_queue.cc:1048] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:52.995752  6005 raft_consensus.cc:1275] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:15:52.996934  5975 consensus_peers.cc:597] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:52.997905  6835 consensus_queue.cc:1048] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
W20260709 12:15:53.011904  6049 consensus_peers.cc:597] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:53.011411  5756 catalog_manager.cc:5697] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 1 to 2, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 2 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:53.029016  5756 catalog_manager.cc:5697] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 1 to 2, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 2 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:53.041541  6821 tablet_bootstrap.cc:492] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:53.042793  6821 tablet_bootstrap.cc:492] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:53.043536  6821 ts_tablet_manager.cc:1403] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.314s	user 0.028s	sys 0.025s
W20260709 12:15:53.043605  5975 consensus_peers.cc:597] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:53.045250  5756 catalog_manager.cc:5697] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 2 to 3, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 3 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:53.047245  5756 catalog_manager.cc:5697] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 1 to 2, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 2 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:53.057281  6078 raft_consensus.cc:1275] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:53.061133  6049 consensus_peers.cc:597] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:53.063957  5901 consensus_peers.cc:597] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:53.068215  6821 raft_consensus.cc:359] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:53.049568  5756 catalog_manager.cc:5697] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 2 to 3, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 3 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:53.073194  5975 consensus_peers.cc:597] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:53.075361  6842 consensus_queue.cc:1048] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:53.072461  6821 raft_consensus.cc:740] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:53.079141  6821 consensus_queue.cc:260] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:53.081418  6821 ts_tablet_manager.cc:1434] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.000s
I20260709 12:15:53.081164  5756 catalog_manager.cc:5697] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 1 to 2, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 2 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:53.082376  6821 tablet_bootstrap.cc:492] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
W20260709 12:15:53.110261  5975 consensus_peers.cc:597] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:53.114770  6082 raft_consensus.cc:1275] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:53.132022  6812 consensus_queue.cc:1048] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:53.147217  5755 catalog_manager.cc:5697] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 1 to 2, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:53.149302  5901 consensus_peers.cc:597] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:53.159402  5975 consensus_peers.cc:597] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:53.173678  6830 raft_consensus.cc:493] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.174424  6830 raft_consensus.cc:515] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:53.181216  6830 leader_election.cc:290] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
W20260709 12:15:53.187700  6049 consensus_peers.cc:597] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:53.230265  6049 consensus_peers.cc:597] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:53.237231  6049 consensus_peers.cc:597] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:53.238013  5975 consensus_peers.cc:597] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:53.279672  6082 raft_consensus.cc:1275] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Refusing update from remote peer e29106aa83aa4eebb9b87d6745825a27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:53.282562  6785 consensus_queue.cc:1048] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:53.285734  6821 tablet_bootstrap.cc:492] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:15:53.291560  6049 consensus_peers.cc:597] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:53.301188  6821 tablet_bootstrap.cc:492] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
W20260709 12:15:53.302934  6049 consensus_peers.cc:597] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:53.306347  6083 raft_consensus.cc:1275] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Refusing update from remote peer e29106aa83aa4eebb9b87d6745825a27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:53.307853  6785 consensus_queue.cc:1048] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:53.313426  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a300304455c4851b24de418128a28d0" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:53.320366  6821 ts_tablet_manager.cc:1403] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.238s	user 0.024s	sys 0.008s
I20260709 12:15:53.323649  6821 raft_consensus.cc:359] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:53.324447  6821 raft_consensus.cc:740] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
W20260709 12:15:53.335722  5975 consensus_peers.cc:597] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:53.336462  6821 consensus_queue.cc:260] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:53.340212  6821 ts_tablet_manager.cc:1434] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:15:53.341217  6821 tablet_bootstrap.cc:492] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:53.354214  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a300304455c4851b24de418128a28d0" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:53.358096  6817 leader_election.cc:304] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:53.359567  6830 raft_consensus.cc:2749] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:53.415055  6821 tablet_bootstrap.cc:492] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:53.416607  6821 tablet_bootstrap.cc:492] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:53.417549  6821 ts_tablet_manager.cc:1403] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.077s	user 0.015s	sys 0.005s
I20260709 12:15:53.431926  6821 raft_consensus.cc:359] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:53.432791  6821 raft_consensus.cc:740] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:53.433985  6821 consensus_queue.cc:260] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:53.439263  6821 ts_tablet_manager.cc:1434] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.021s	user 0.011s	sys 0.000s
I20260709 12:15:53.456826  6821 tablet_bootstrap.cc:492] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:53.528040  6830 raft_consensus.cc:493] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.528765  6830 raft_consensus.cc:515] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:53.532838  6830 leader_election.cc:290] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:53.534742  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a474468455492f992eb8dfefad0ca2" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:53.538673  6821 tablet_bootstrap.cc:492] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:53.538512  5927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a474468455492f992eb8dfefad0ca2" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:53.539937  6821 tablet_bootstrap.cc:492] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:53.540835  6821 ts_tablet_manager.cc:1403] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.086s	user 0.032s	sys 0.006s
I20260709 12:15:53.542888  6817 leader_election.cc:304] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:53.544260  6830 raft_consensus.cc:2749] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:53.544866  6821 raft_consensus.cc:359] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:53.545727  6821 raft_consensus.cc:740] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:53.546713  6821 consensus_queue.cc:260] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:53.549058  6821 ts_tablet_manager.cc:1434] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:15:53.550047  6821 tablet_bootstrap.cc:492] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
W20260709 12:15:53.622917  5975 consensus_peers.cc:597] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:53.676615  5975 consensus_peers.cc:597] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:53.682865  6821 tablet_bootstrap.cc:492] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:53.684085  6821 tablet_bootstrap.cc:492] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:53.684844  6821 ts_tablet_manager.cc:1403] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.135s	user 0.028s	sys 0.028s
I20260709 12:15:53.688949  6821 raft_consensus.cc:359] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:53.689741  6821 raft_consensus.cc:740] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:53.702158  6821 consensus_queue.cc:260] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:53.704698  6821 ts_tablet_manager.cc:1434] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:15:53.705703  6821 tablet_bootstrap.cc:492] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:53.754724  6821 tablet_bootstrap.cc:492] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:53.755856  6821 tablet_bootstrap.cc:492] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:53.756666  6821 ts_tablet_manager.cc:1403] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.051s	user 0.018s	sys 0.000s
I20260709 12:15:53.784528  6821 raft_consensus.cc:359] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:53.785530  6821 raft_consensus.cc:740] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:53.786643  6821 consensus_queue.cc:260] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:53.793301  6821 ts_tablet_manager.cc:1434] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:15:53.802709  6821 tablet_bootstrap.cc:492] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:53.844524  6821 tablet_bootstrap.cc:492] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:53.845726  6821 tablet_bootstrap.cc:492] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:53.846647  6821 ts_tablet_manager.cc:1403] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.003s
I20260709 12:15:53.849756  6821 raft_consensus.cc:359] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:53.850553  6821 raft_consensus.cc:740] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:53.851637  6821 consensus_queue.cc:260] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:53.854123  6821 ts_tablet_manager.cc:1434] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:15:53.855175  6821 tablet_bootstrap.cc:492] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:53.883781  6821 tablet_bootstrap.cc:492] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:53.884837  6821 tablet_bootstrap.cc:492] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:53.885537  6821 ts_tablet_manager.cc:1403] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.008s
I20260709 12:15:53.889513  6821 raft_consensus.cc:359] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:53.890120  6821 raft_consensus.cc:740] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:53.890888  6821 consensus_queue.cc:260] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:53.898733  6821 ts_tablet_manager.cc:1434] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:15:53.899637  6821 tablet_bootstrap.cc:492] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:53.916275  6830 raft_consensus.cc:493] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.916904  6830 raft_consensus.cc:515] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:53.920379  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16996642a1b4752b788da1836791f3c" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:53.922930  6830 leader_election.cc:290] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:53.924198  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16996642a1b4752b788da1836791f3c" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:53.926638  6816 leader_election.cc:304] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:53.932107  6830 raft_consensus.cc:2749] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:53.976399  6821 tablet_bootstrap.cc:492] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:53.977555  6821 tablet_bootstrap.cc:492] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:53.978365  6821 ts_tablet_manager.cc:1403] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.079s	user 0.020s	sys 0.000s
I20260709 12:15:53.981774  6821 raft_consensus.cc:359] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:53.986642  6821 raft_consensus.cc:740] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:53.987722  6821 consensus_queue.cc:260] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:53.990996  6821 ts_tablet_manager.cc:1434] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:15:53.992218  6821 tablet_bootstrap.cc:492] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
W20260709 12:15:54.001538  5975 consensus_peers.cc:597] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:54.039299  6821 tablet_bootstrap.cc:492] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:54.041857  6821 tablet_bootstrap.cc:492] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:54.042708  6821 ts_tablet_manager.cc:1403] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.051s	user 0.022s	sys 0.006s
I20260709 12:15:54.045823  6821 raft_consensus.cc:359] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:54.046684  6821 raft_consensus.cc:740] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:54.047529  6821 consensus_queue.cc:260] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:54.051304  6821 ts_tablet_manager.cc:1434] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:15:54.052384  6821 tablet_bootstrap.cc:492] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:54.117061  6802 raft_consensus.cc:493] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.117774  6802 raft_consensus.cc:515] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
W20260709 12:15:54.125619  6049 leader_election.cc:336] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:54.127686  6802 leader_election.cc:290] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:54.130239  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0484fe261cb3459cb6a2f532f88c0845" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:54.131130  5929 raft_consensus.cc:2468] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 2.
I20260709 12:15:54.132637  6048 leader_election.cc:304] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:54.136343  6825 raft_consensus.cc:2804] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:54.136830  6825 raft_consensus.cc:493] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.138039  6821 tablet_bootstrap.cc:492] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:54.142051  6821 tablet_bootstrap.cc:492] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:54.143020  6821 ts_tablet_manager.cc:1403] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.091s	user 0.020s	sys 0.004s
I20260709 12:15:54.137220  6825 raft_consensus.cc:3060] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:54.149785  6830 raft_consensus.cc:493] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.157037  6830 raft_consensus.cc:515] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:54.160224  6825 raft_consensus.cc:515] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:54.163993  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500f59123914ed198a39756117b4110" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:54.166612  6830 leader_election.cc:290] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
W20260709 12:15:54.178124  6049 leader_election.cc:336] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:54.180092  6825 leader_election.cc:290] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:54.190287  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0484fe261cb3459cb6a2f532f88c0845" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:54.191083  5929 raft_consensus.cc:3060] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:54.146380  6821 raft_consensus.cc:359] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:54.192047  6821 raft_consensus.cc:740] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:54.193300  6821 consensus_queue.cc:260] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:54.195905  6821 ts_tablet_manager.cc:1434] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 12:15:54.196925  6821 tablet_bootstrap.cc:492] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:54.206782  5929 raft_consensus.cc:2468] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 3.
I20260709 12:15:54.209311  6830 raft_consensus.cc:493] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.209920  6830 raft_consensus.cc:515] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:54.214505  6048 leader_election.cc:304] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:54.218186  6947 raft_consensus.cc:493] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.219172  6947 raft_consensus.cc:515] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:54.224668  6002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972a71bd13ef4022b6966d1287868dc4" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:54.225894  6002 raft_consensus.cc:2468] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 2.
I20260709 12:15:54.223920  6825 raft_consensus.cc:2804] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:54.228745  6047 leader_election.cc:304] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:54.230374  6802 raft_consensus.cc:2804] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:54.231025  6802 raft_consensus.cc:493] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.231561  6802 raft_consensus.cc:3060] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:54.235666  6002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d81a90a1a04c558e7d4b2e844d22ce" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:54.236938  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6500f59123914ed198a39756117b4110" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:54.240885  6816 leader_election.cc:304] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:54.253296  6830 leader_election.cc:290] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:54.254287  6830 raft_consensus.cc:2749] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:54.266139  6947 leader_election.cc:290] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:54.266456  6825 raft_consensus.cc:697] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:15:54.286513  6958 raft_consensus.cc:493] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.308475  6825 consensus_queue.cc:237] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:54.304041  6958 raft_consensus.cc:515] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
W20260709 12:15:54.314801  6049 leader_election.cc:336] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:54.326449  6960 raft_consensus.cc:493] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.328819  6960 raft_consensus.cc:515] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:54.332829  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35395bd69ad41f0b37fd3edca49777c" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:54.333432  5929 raft_consensus.cc:2468] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 2.
I20260709 12:15:54.334602  6048 leader_election.cc:304] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
W20260709 12:15:54.340181  5973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 45525.1us
I20260709 12:15:54.344493  6958 leader_election.cc:290] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
W20260709 12:15:54.339668  6816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 98895.9us
I20260709 12:15:54.346654  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873d3215e6ba4214a3910fa16e0fd62a" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:54.351240  6008 raft_consensus.cc:2468] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 2.
I20260709 12:15:54.357151  6047 leader_election.cc:304] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
W20260709 12:15:54.362501  5974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 58686.7us
I20260709 12:15:54.340598  6959 raft_consensus.cc:2804] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:54.370764  6821 tablet_bootstrap.cc:492] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:54.353065  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d81a90a1a04c558e7d4b2e844d22ce" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:54.366676  6958 raft_consensus.cc:2804] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:54.360222  6960 leader_election.cc:290] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:54.392805  6959 raft_consensus.cc:493] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.401675  6821 tablet_bootstrap.cc:492] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:54.402622  6821 ts_tablet_manager.cc:1403] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.206s	user 0.045s	sys 0.023s
I20260709 12:15:54.405927  6821 raft_consensus.cc:359] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:54.406750  6821 raft_consensus.cc:740] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:54.396840  6958 raft_consensus.cc:493] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.407887  6958 raft_consensus.cc:3060] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:54.411370  6959 raft_consensus.cc:3060] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:54.414610  6821 consensus_queue.cc:260] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:54.420946  6821 ts_tablet_manager.cc:1434] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:15:54.422631  6816 leader_election.cc:304] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:54.425572  6964 raft_consensus.cc:2749] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:54.427676  6821 tablet_bootstrap.cc:492] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:54.437633  6802 raft_consensus.cc:515] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:54.467904  6958 raft_consensus.cc:515] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:54.474104  6802 leader_election.cc:290] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:54.497505  6002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972a71bd13ef4022b6966d1287868dc4" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:54.498533  6002 raft_consensus.cc:3060] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:54.517836  6049 leader_election.cc:336] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:15:54.518828  6049 leader_election.cc:336] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:54.518489  6959 raft_consensus.cc:515] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:54.532778  6958 leader_election.cc:290] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:54.556100  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35395bd69ad41f0b37fd3edca49777c" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:15:54.562709  5929 raft_consensus.cc:3060] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:54.558820  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873d3215e6ba4214a3910fa16e0fd62a" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:54.569717  6008 raft_consensus.cc:3060] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:54.587852  5756 catalog_manager.cc:5697] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 1 to 3, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 3 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:54.588757  6959 leader_election.cc:290] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:54.596977  5929 raft_consensus.cc:2468] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 3.
I20260709 12:15:54.594233  6802 raft_consensus.cc:493] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.614542  6048 leader_election.cc:304] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:15:54.619148  6947 raft_consensus.cc:2804] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:54.624884 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.65:38243
I20260709 12:15:54.611807  6008 raft_consensus.cc:2468] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 3.
I20260709 12:15:54.632082  6821 tablet_bootstrap.cc:492] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:54.637809  6821 tablet_bootstrap.cc:492] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:54.638724  6821 ts_tablet_manager.cc:1403] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.211s	user 0.014s	sys 0.010s
I20260709 12:15:54.613759  6802 raft_consensus.cc:515] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:54.645925  6975 raft_consensus.cc:493] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.650072  6947 raft_consensus.cc:697] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 3 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:15:54.624925  6987 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.65:38243 every 8 connection(s)
I20260709 12:15:54.651623  6975 raft_consensus.cc:515] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:54.661688  6821 raft_consensus.cc:359] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:54.667833  6821 raft_consensus.cc:740] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:54.668253  6975 leader_election.cc:290] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:54.663287  6802 leader_election.cc:290] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:54.666961  6947 consensus_queue.cc:237] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
W20260709 12:15:54.670979  6049 leader_election.cc:336] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:15:54.673403  6821 consensus_queue.cc:260] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:54.684916  6821 ts_tablet_manager.cc:1434] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 12:15:54.686244  6821 tablet_bootstrap.cc:492] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:54.695761  6047 leader_election.cc:304] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:54.701886  6785 raft_consensus.cc:493] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.691609  6985 raft_consensus.cc:493] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.702679  6785 raft_consensus.cc:515] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:54.702872  6985 raft_consensus.cc:515] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:54.705061  6785 leader_election.cc:290] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:54.705741  6985 leader_election.cc:290] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:54.710381  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ace1a67c98413c886c1ce2cfcd66af" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:54.711234  6075 raft_consensus.cc:2468] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 2.
I20260709 12:15:54.712625  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df660011133455e8ede132d5d56c48f" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:54.713232  5973 leader_election.cc:304] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:54.713564  6082 raft_consensus.cc:2468] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 2.
I20260709 12:15:54.714787  6785 raft_consensus.cc:2804] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:54.714859  5973 leader_election.cc:304] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:54.718662  6831 raft_consensus.cc:2804] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:54.719120  6831 raft_consensus.cc:493] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.719465  6831 raft_consensus.cc:3060] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:54.715251  6802 raft_consensus.cc:2804] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:54.715312  6785 raft_consensus.cc:493] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.721520  6785 raft_consensus.cc:3060] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:54.720986  6802 raft_consensus.cc:697] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 3 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:15:54.728929  6802 consensus_queue.cc:237] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:54.751042  6785 raft_consensus.cc:515] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:54.773015  6007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df660011133455e8ede132d5d56c48f" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:54.774370  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ace1a67c98413c886c1ce2cfcd66af" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:54.776623  6082 raft_consensus.cc:3060] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:54.775636  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18f65fb1b1f4544b9e6a96399e38089" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:54.780375  6005 raft_consensus.cc:2468] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 2.
I20260709 12:15:54.780512  6785 leader_election.cc:290] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:54.785832  6047 leader_election.cc:304] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:54.800563  6082 raft_consensus.cc:2468] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 3.
I20260709 12:15:54.789412  6825 raft_consensus.cc:2804] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:54.914433  6821 tablet_bootstrap.cc:700] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43: Time spent opening tablet: real 0.101s	user 0.009s	sys 0.004s
I20260709 12:15:54.805332  6964 raft_consensus.cc:493] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:54.919060  5899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 105152us
I20260709 12:15:54.914005  5973 leader_election.cc:304] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:54.921142  6785 raft_consensus.cc:2804] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:54.921736  6785 raft_consensus.cc:697] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 3 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
W20260709 12:15:54.923103  5973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 116934us
I20260709 12:15:54.920145  6825 raft_consensus.cc:493] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.935199  6785 consensus_queue.cc:237] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:54.934279  6825 raft_consensus.cc:3060] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:54.949150  6002 raft_consensus.cc:2468] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 3.
I20260709 12:15:54.930878  6831 raft_consensus.cc:515] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:54.925772  6964 raft_consensus.cc:515] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:54.999284  6007 raft_consensus.cc:2393] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36dfe581d09b46f6a9bfe678170e71cb in current term 3: Already voted for candidate e29106aa83aa4eebb9b87d6745825a27 in this term.
I20260709 12:15:55.006223  7004 raft_consensus.cc:493] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.066138  6047 leader_election.cc:304] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:15:55.066329  7004 raft_consensus.cc:515] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:55.081120  7004 leader_election.cc:290] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:55.072988  7002 raft_consensus.cc:2804] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:55.087970  7002 raft_consensus.cc:697] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:15:55.089128  6005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4c5dd41465429eab21af474b88bc05" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:55.089007  7002 consensus_queue.cc:237] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:55.091871  6964 leader_election.cc:290] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:55.093817  5927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45528a8d878d46d89244614343fc6e90" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:55.099694  5928 raft_consensus.cc:1275] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:15:55.115454  6048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 99813.1us
I20260709 12:15:55.131830  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e4c5dd41465429eab21af474b88bc05" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:55.137030  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df660011133455e8ede132d5d56c48f" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:55.114118  6964 raft_consensus.cc:493] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.139446  6926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ace1a67c98413c886c1ce2cfcd66af" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:55.140144  6964 raft_consensus.cc:515] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:55.142961  6964 leader_election.cc:290] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:55.148118  6831 leader_election.cc:290] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 election: Requested vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
W20260709 12:15:55.150820  5901 consensus_peers.cc:597] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:55.152626  6825 raft_consensus.cc:515] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:55.158205  6926 raft_consensus.cc:3060] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:55.161221  6990 heartbeater.cc:344] Connected to a master server at 127.24.179.126:35651
I20260709 12:15:55.161844  6990 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:55.161597  6929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ace1a67c98413c886c1ce2cfcd66af" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:55.163132  7004 raft_consensus.cc:493] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.163811  7004 raft_consensus.cc:515] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:55.166869  7004 leader_election.cc:290] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:15:55.168481  5756 catalog_manager.cc:5697] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 1 to 3, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 3 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:55.171309  6922 raft_consensus.cc:3060] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.176055  6821 tablet_bootstrap.cc:492] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:55.175730  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18f65fb1b1f4544b9e6a96399e38089" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:55.176854  6928 raft_consensus.cc:3060] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.177155  6821 tablet_bootstrap.cc:492] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:55.177969  6821 ts_tablet_manager.cc:1403] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.492s	user 0.030s	sys 0.016s
I20260709 12:15:55.179077  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35395bd69ad41f0b37fd3edca49777c" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:55.179625  6078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df660011133455e8ede132d5d56c48f" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:15:55.180406  6078 raft_consensus.cc:3060] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:55.182919  6825 leader_election.cc:290] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:15:55.184932  6927 raft_consensus.cc:3060] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.163163  6990 heartbeater.cc:507] Master 127.24.179.126:35651 requested a full tablet report, sending...
I20260709 12:15:55.189788  6078 raft_consensus.cc:2468] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e29106aa83aa4eebb9b87d6745825a27 in term 3.
I20260709 12:15:55.191502  6929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df660011133455e8ede132d5d56c48f" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43" is_pre_election: true
I20260709 12:15:55.191879  6816 leader_election.cc:304] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:55.193225  6960 consensus_queue.cc:1048] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:55.194265  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219ee6e67c3a4adf9dd72198036646bc" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:55.194556  6078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45528a8d878d46d89244614343fc6e90" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:55.195173  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d792c0dd53aa459399c3adf5d4f17f58" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
W20260709 12:15:55.196396  5901 consensus_peers.cc:597] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:55.196259  6008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18f65fb1b1f4544b9e6a96399e38089" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:15:55.197036  7004 raft_consensus.cc:2749] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:55.197299  5901 consensus_peers.cc:597] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:55.176880  6933 raft_consensus.cc:2468] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 1.
I20260709 12:15:55.197147  6008 raft_consensus.cc:3060] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:55.210536  5973 leader_election.cc:304] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
W20260709 12:15:55.223275  5974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 201855us
I20260709 12:15:55.216003  6833 raft_consensus.cc:2804] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:55.224961  6816 leader_election.cc:304] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:55.240607  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d792c0dd53aa459399c3adf5d4f17f58" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
I20260709 12:15:55.241488  5932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219ee6e67c3a4adf9dd72198036646bc" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
W20260709 12:15:55.239840  5975 leader_election.cc:343] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:55.237792  6924 raft_consensus.cc:3060] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:55.274863  5975 leader_election.cc:343] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:55.276648  5975 leader_election.cc:343] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:55.247623  6920 raft_consensus.cc:3060] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.281358  5933 raft_consensus.cc:1275] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:55.244131  6833 raft_consensus.cc:697] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 3 LEADER]: Becoming Leader. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:15:55.269358  6008 raft_consensus.cc:2468] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 3.
I20260709 12:15:55.283289  6833 consensus_queue.cc:237] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:55.283548  6821 raft_consensus.cc:359] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:55.284286  6821 raft_consensus.cc:740] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:55.285046  6821 consensus_queue.cc:260] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:55.235941  6930 raft_consensus.cc:3060] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:55.242149  6929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18f65fb1b1f4544b9e6a96399e38089" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:55.287366  6929 raft_consensus.cc:3060] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:55.247852  7004 raft_consensus.cc:2749] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:55.293917  6049 leader_election.cc:343] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:55.311200  6049 leader_election.cc:343] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:55.311746  6049 leader_election.cc:304] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:55.308580  6960 consensus_queue.cc:1048] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:15:55.312794  6047 leader_election.cc:304] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:15:55.319399  6821 ts_tablet_manager.cc:1434] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.141s	user 0.010s	sys 0.000s
I20260709 12:15:55.320335  6821 tablet_bootstrap.cc:492] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:55.235400  6933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873d3215e6ba4214a3910fa16e0fd62a" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
I20260709 12:15:55.327791  6817 leader_election.cc:304] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:55.340006  6817 leader_election.cc:304] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:15:55.319073  6975 raft_consensus.cc:2749] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:55.346504  6959 raft_consensus.cc:2804] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:55.347213  6959 raft_consensus.cc:697] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:15:55.348201  6959 consensus_queue.cc:237] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:55.356357  6929 raft_consensus.cc:2468] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 3.
W20260709 12:15:55.366910  6049 leader_election.cc:343] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:55.368388  6049 consensus_peers.cc:597] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:55.370414  6049 consensus_peers.cc:597] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:55.395825  5756 catalog_manager.cc:5697] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 1 to 3, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 3 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:55.403692  5756 catalog_manager.cc:5697] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 1 to 3, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 3 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:55.434950  5975 consensus_peers.cc:597] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:55.401700  6931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df660011133455e8ede132d5d56c48f" candidate_uuid: "e29106aa83aa4eebb9b87d6745825a27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
W20260709 12:15:55.477345  5975 leader_election.cc:343] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:55.538699  6049 consensus_peers.cc:597] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:55.569061  5975 consensus_peers.cc:597] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:55.575918  6080 raft_consensus.cc:1275] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Refusing update from remote peer e29106aa83aa4eebb9b87d6745825a27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:15:55.576431  5975 consensus_peers.cc:597] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:55.590757  6931 raft_consensus.cc:3060] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:55.579355  6965 consensus_queue.cc:1048] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:15:55.624153  6931 raft_consensus.cc:1275] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:55.626935  6003 raft_consensus.cc:1275] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:15:55.627682  5901 consensus_peers.cc:597] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.628456  5901 consensus_peers.cc:597] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:55.629607  5901 consensus_peers.cc:597] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.642370  5901 consensus_peers.cc:597] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.691543  5975 consensus_peers.cc:597] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:55.648563  6959 consensus_queue.cc:1048] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 12:15:55.736599  7021 log.cc:927] Time spent T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:15:55.755157  5899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 81880.2us
W20260709 12:15:55.759532  6047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 99035.4us
I20260709 12:15:55.766381  5755 catalog_manager.cc:5697] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 1 to 3, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 3 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:55.785997  5755 catalog_manager.cc:5697] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 1 to 3, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 3 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:55.793080  5974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 70337us
I20260709 12:15:55.820945  7003 consensus_queue.cc:1048] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
W20260709 12:15:55.848500  5899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 69527.2us
I20260709 12:15:55.903090  7004 raft_consensus.cc:2749] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:55.909204  6048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 45295.5us
I20260709 12:15:55.932691  6007 raft_consensus.cc:1275] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:55.935140  6080 raft_consensus.cc:1275] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Refusing update from remote peer e29106aa83aa4eebb9b87d6745825a27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:15:55.976490  7039 log.cc:927] Time spent T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:15:55.978519  7009 raft_consensus.cc:2749] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:55.980973  7047 consensus_queue.cc:1048] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:56.000525  7007 raft_consensus.cc:493] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e29106aa83aa4eebb9b87d6745825a27)
I20260709 12:15:56.001259  7007 raft_consensus.cc:515] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:56.013441  6964 raft_consensus.cc:493] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e29106aa83aa4eebb9b87d6745825a27)
I20260709 12:15:56.014171  6964 raft_consensus.cc:515] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:56.028218  7007 leader_election.cc:290] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:15:56.030236  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713888d225a047099a38dc8257276146" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
I20260709 12:15:56.039031  5927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713888d225a047099a38dc8257276146" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26615d25670745d38490e2d6da247d9e" is_pre_election: true
W20260709 12:15:56.045531  5901 consensus_peers.cc:597] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:56.049662  6821 tablet_bootstrap.cc:492] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:56.063896  7011 consensus_queue.cc:1048] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:15:56.071110  6049 consensus_peers.cc:597] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:56.071370  6926 raft_consensus.cc:1275] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:56.071269  6817 leader_election.cc:304] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:56.087033  6964 leader_election.cc:290] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:15:56.089058  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e29106aa83aa4eebb9b87d6745825a27" is_pre_election: true
W20260709 12:15:56.093413  5975 consensus_peers.cc:597] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:56.098177  7009 raft_consensus.cc:2749] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:56.109932  6975 consensus_queue.cc:1048] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:15:56.158074  6083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb" is_pre_election: true
I20260709 12:15:56.159804  6821 tablet_bootstrap.cc:492] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:56.165304  6821 ts_tablet_manager.cc:1403] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.845s	user 0.038s	sys 0.030s
W20260709 12:15:56.160122  5974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:33793, user_credentials={real_user=slave}} blocked reactor thread for 50382.6us
W20260709 12:15:56.180770  5899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 328481us
I20260709 12:15:56.190325  6816 leader_election.cc:304] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43; no voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:15:56.202708  7009 raft_consensus.cc:2749] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:15:56.205065  5975 consensus_peers.cc:597] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:56.211760  6049 consensus_peers.cc:597] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:56.215905  6049 consensus_peers.cc:597] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:56.195259  6821 raft_consensus.cc:359] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:56.218521  6821 raft_consensus.cc:740] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
W20260709 12:15:56.236639  7059 log.cc:927] Time spent T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27: Append to log took a long time: real 0.061s	user 0.003s	sys 0.000s
I20260709 12:15:56.222039  6821 consensus_queue.cc:260] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
W20260709 12:15:56.244213  5901 consensus_peers.cc:597] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:56.241677  5757 catalog_manager.cc:5697] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 reported cstate change: term changed from 1 to 3, leader changed from 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65) to e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67). New cstate: current_term: 3 leader_uuid: "e29106aa83aa4eebb9b87d6745825a27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:56.275750  6821 ts_tablet_manager.cc:1434] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.110s	user 0.008s	sys 0.000s
I20260709 12:15:56.280359  6821 tablet_bootstrap.cc:492] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:56.305984  5756 ts_manager.cc:194] Re-registered known tserver with Master: 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
W20260709 12:15:56.307812  6049 consensus_peers.cc:597] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:56.349650  6049 consensus_peers.cc:597] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:56.376089  6821 tablet_bootstrap.cc:492] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:56.377295  6821 tablet_bootstrap.cc:492] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:56.378057  6821 ts_tablet_manager.cc:1403] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.098s	user 0.017s	sys 0.000s
I20260709 12:15:56.380973  6821 raft_consensus.cc:359] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:56.381731  6821 raft_consensus.cc:740] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:56.382543  6821 consensus_queue.cc:260] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:56.388159  6821 ts_tablet_manager.cc:1434] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:15:56.389004  6821 tablet_bootstrap.cc:492] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:56.407413  6821 tablet_bootstrap.cc:492] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:56.409309  6821 tablet_bootstrap.cc:492] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:56.410560  6821 ts_tablet_manager.cc:1403] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 12:15:56.418630  6821 raft_consensus.cc:359] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:56.419586  6821 raft_consensus.cc:740] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:56.421170  6821 consensus_queue.cc:260] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:56.426049  6821 ts_tablet_manager.cc:1434] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:15:56.427203  6821 tablet_bootstrap.cc:492] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
W20260709 12:15:56.437747  5975 consensus_peers.cc:597] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:56.438781  5975 consensus_peers.cc:597] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:56.486244  6821 tablet_bootstrap.cc:492] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:56.487712  6821 tablet_bootstrap.cc:492] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:56.488696  6821 ts_tablet_manager.cc:1403] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.062s	user 0.027s	sys 0.002s
I20260709 12:15:56.492141  6821 raft_consensus.cc:359] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:56.493069  6821 raft_consensus.cc:740] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:56.494125  6821 consensus_queue.cc:260] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:56.496888  6821 ts_tablet_manager.cc:1434] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:15:56.498041  6821 tablet_bootstrap.cc:492] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
W20260709 12:15:56.586738  5973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.68:44517, user_credentials={real_user=slave}} blocked reactor thread for 56281.7us
I20260709 12:15:56.639124  6821 tablet_bootstrap.cc:492] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:56.640309  6821 tablet_bootstrap.cc:492] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:56.641045  6821 ts_tablet_manager.cc:1403] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.143s	user 0.026s	sys 0.007s
I20260709 12:15:56.632335  5756 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49576
I20260709 12:15:56.644126  6821 raft_consensus.cc:359] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:56.644909  6821 raft_consensus.cc:740] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:56.649255  6990 heartbeater.cc:499] Master 127.24.179.126:35651 was elected leader, sending a full tablet report...
I20260709 12:15:56.645646  6821 consensus_queue.cc:260] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:56.662827  6821 ts_tablet_manager.cc:1434] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:15:56.663815  6821 tablet_bootstrap.cc:492] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:56.739997  6821 tablet_bootstrap.cc:492] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:56.741068  6821 tablet_bootstrap.cc:492] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:56.743429  6821 ts_tablet_manager.cc:1403] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.080s	user 0.023s	sys 0.015s
I20260709 12:15:56.746762  6821 raft_consensus.cc:359] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:56.747594  6821 raft_consensus.cc:740] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:56.748605  6821 consensus_queue.cc:260] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:56.751715  6821 ts_tablet_manager.cc:1434] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:15:56.752720  6821 tablet_bootstrap.cc:492] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:56.835368  6821 tablet_bootstrap.cc:492] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:56.836493  6821 tablet_bootstrap.cc:492] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:56.837219  6821 ts_tablet_manager.cc:1403] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.085s	user 0.030s	sys 0.011s
I20260709 12:15:56.840224  6821 raft_consensus.cc:359] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:56.841023  6821 raft_consensus.cc:740] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:56.841813  6821 consensus_queue.cc:260] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:56.844310  6821 ts_tablet_manager.cc:1434] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:15:56.848579  6821 tablet_bootstrap.cc:492] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:56.917001  6821 tablet_bootstrap.cc:492] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:56.938848  6821 tablet_bootstrap.cc:492] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:56.939697  6821 ts_tablet_manager.cc:1403] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.091s	user 0.018s	sys 0.000s
I20260709 12:15:56.943879  6821 raft_consensus.cc:359] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:56.944665  6821 raft_consensus.cc:740] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:56.945403  6821 consensus_queue.cc:260] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:56.948167  6821 ts_tablet_manager.cc:1434] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:56.949154  6821 tablet_bootstrap.cc:492] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:56.975304  6821 tablet_bootstrap.cc:492] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:56.976526  6821 tablet_bootstrap.cc:492] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:56.977371  6821 ts_tablet_manager.cc:1403] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.008s
I20260709 12:15:56.980556  6821 raft_consensus.cc:359] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:56.981365  6821 raft_consensus.cc:740] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:56.982143  6821 consensus_queue.cc:260] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:56.986927  6821 ts_tablet_manager.cc:1434] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:15:56.988844  6821 tablet_bootstrap.cc:492] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:57.031064  6821 tablet_bootstrap.cc:492] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:57.032176  6821 tablet_bootstrap.cc:492] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:57.032975  6821 ts_tablet_manager.cc:1403] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.011s
I20260709 12:15:57.036139  6821 raft_consensus.cc:359] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:57.036883  6821 raft_consensus.cc:740] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.037719  6821 consensus_queue.cc:260] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:57.044950  6821 ts_tablet_manager.cc:1434] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:15:57.046013  6821 tablet_bootstrap.cc:492] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:57.086043  6821 tablet_bootstrap.cc:492] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:57.087085  6821 tablet_bootstrap.cc:492] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:57.087831  6821 ts_tablet_manager.cc:1403] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.042s	user 0.023s	sys 0.016s
I20260709 12:15:57.091871  6821 raft_consensus.cc:359] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:57.092633  6821 raft_consensus.cc:740] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.093341  6821 consensus_queue.cc:260] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:57.095686  6821 ts_tablet_manager.cc:1434] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:57.096530  6821 tablet_bootstrap.cc:492] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:57.126045  6821 tablet_bootstrap.cc:492] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:57.127157  6821 tablet_bootstrap.cc:492] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:57.128383  6821 ts_tablet_manager.cc:1403] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.000s
I20260709 12:15:57.131477  6821 raft_consensus.cc:359] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:57.132256  6821 raft_consensus.cc:740] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.133045  6821 consensus_queue.cc:260] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:57.135612  6821 ts_tablet_manager.cc:1434] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:15:57.136559  6821 tablet_bootstrap.cc:492] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:57.189122  6821 tablet_bootstrap.cc:492] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:57.190181  6821 tablet_bootstrap.cc:492] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:57.190933  6821 ts_tablet_manager.cc:1403] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.055s	user 0.037s	sys 0.012s
I20260709 12:15:57.193861  6821 raft_consensus.cc:359] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:57.204537  6821 raft_consensus.cc:740] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.214998  6821 consensus_queue.cc:260] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:57.225947  6821 ts_tablet_manager.cc:1434] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:15:57.227000  6821 tablet_bootstrap.cc:492] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
W20260709 12:15:57.238507  5975 consensus_peers.cc:597] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:57.241634  6922 raft_consensus.cc:3060] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:57.346561  6821 tablet_bootstrap.cc:492] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:57.347677  6821 tablet_bootstrap.cc:492] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:57.348462  6821 ts_tablet_manager.cc:1403] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.122s	user 0.024s	sys 0.018s
I20260709 12:15:57.363999  6821 raft_consensus.cc:359] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:57.366034  6821 raft_consensus.cc:740] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.375185  6821 consensus_queue.cc:260] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:57.382297  6821 ts_tablet_manager.cc:1434] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.001s
I20260709 12:15:57.383400  6821 tablet_bootstrap.cc:492] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
W20260709 12:15:57.408869  6049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 69568.4us
I20260709 12:15:57.459460  6821 tablet_bootstrap.cc:492] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:57.460664  6821 tablet_bootstrap.cc:492] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:57.462316  6821 ts_tablet_manager.cc:1403] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.005s
I20260709 12:15:57.465353  6821 raft_consensus.cc:359] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:57.466118  6821 raft_consensus.cc:740] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.467082  6821 consensus_queue.cc:260] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:57.469197  6821 ts_tablet_manager.cc:1434] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:15:57.470465  6821 tablet_bootstrap.cc:492] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
W20260709 12:15:57.553288  5901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 52850.4us
I20260709 12:15:57.567610  6927 raft_consensus.cc:3060] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:15:57.682073  5975 consensus_peers.cc:597] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:57.701563  5901 consensus_peers.cc:597] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:57.782176  6927 raft_consensus.cc:3060] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:57.782883  6821 tablet_bootstrap.cc:492] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:57.788667  6821 tablet_bootstrap.cc:492] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:57.789453  6821 ts_tablet_manager.cc:1403] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.319s	user 0.078s	sys 0.086s
I20260709 12:15:57.792419  6821 raft_consensus.cc:359] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:57.793197  6821 raft_consensus.cc:740] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.794224  6821 consensus_queue.cc:260] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:57.796806  6821 ts_tablet_manager.cc:1434] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:15:57.797818  6821 tablet_bootstrap.cc:492] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:57.827885  6922 raft_consensus.cc:3060] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:57.840595  5975 consensus_peers.cc:597] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:57.852689  6821 tablet_bootstrap.cc:492] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:57.862426  6821 tablet_bootstrap.cc:492] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:57.863265  6821 ts_tablet_manager.cc:1403] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.000s
I20260709 12:15:57.870868  6821 raft_consensus.cc:359] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:57.871762  6821 raft_consensus.cc:740] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:57.872745  6821 consensus_queue.cc:260] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:57.880311  6821 ts_tablet_manager.cc:1434] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:15:57.881325  6821 tablet_bootstrap.cc:492] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:57.923596  6920 raft_consensus.cc:3060] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:58.037773  6821 tablet_bootstrap.cc:492] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:58.038923  6821 tablet_bootstrap.cc:492] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:58.039706  6821 ts_tablet_manager.cc:1403] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.159s	user 0.054s	sys 0.026s
I20260709 12:15:58.044024  6821 raft_consensus.cc:359] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:58.044873  6821 raft_consensus.cc:740] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:58.045794  6821 consensus_queue.cc:260] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:58.048239  6821 ts_tablet_manager.cc:1434] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 12:15:58.049158  6821 tablet_bootstrap.cc:492] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
W20260709 12:15:58.068054  5901 consensus_peers.cc:597] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:58.073030  6821 tablet_bootstrap.cc:492] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:58.074265  6821 tablet_bootstrap.cc:492] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:58.075183  6821 ts_tablet_manager.cc:1403] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.004s
I20260709 12:15:58.078153  6821 raft_consensus.cc:359] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:58.079000  6821 raft_consensus.cc:740] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:58.084740  6821 consensus_queue.cc:260] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
W20260709 12:15:58.086351  5975 consensus_peers.cc:597] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:58.087594  6821 ts_tablet_manager.cc:1434] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:15:58.088657  6821 tablet_bootstrap.cc:492] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
W20260709 12:15:58.176393  6049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 43806.7us
W20260709 12:15:58.236027  6049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 58628.9us
W20260709 12:15:58.252612  6047 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:34139, user_credentials={real_user=slave}} blocked reactor thread for 85439.8us
I20260709 12:15:58.438997  6821 tablet_bootstrap.cc:492] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:58.441840  6821 tablet_bootstrap.cc:492] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:58.442620  6821 ts_tablet_manager.cc:1403] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.354s	user 0.092s	sys 0.151s
I20260709 12:15:58.444813  6821 raft_consensus.cc:359] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:58.445575  6821 raft_consensus.cc:740] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:58.446339  6821 consensus_queue.cc:260] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:58.455386  6821 ts_tablet_manager.cc:1434] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:15:58.485435  6821 tablet_bootstrap.cc:492] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:58.469285  6927 raft_consensus.cc:3060] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:15:58.489634  5901 consensus_peers.cc:597] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:58.508710  6922 raft_consensus.cc:3060] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:58.509584  5975 consensus_peers.cc:597] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:58.575748  6821 tablet_bootstrap.cc:492] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:58.576984  6821 tablet_bootstrap.cc:492] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:58.577816  6821 ts_tablet_manager.cc:1403] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.093s	user 0.019s	sys 0.009s
I20260709 12:15:58.585842  6821 raft_consensus.cc:359] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:58.586799  6821 raft_consensus.cc:740] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:58.597615  6821 consensus_queue.cc:260] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:15:58.599977  6821 ts_tablet_manager.cc:1434] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:15:58.601608  6821 tablet_bootstrap.cc:492] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:58.653144  6821 tablet_bootstrap.cc:492] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:58.654246  6821 tablet_bootstrap.cc:492] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:58.655092  6821 ts_tablet_manager.cc:1403] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.054s	user 0.031s	sys 0.001s
I20260709 12:15:58.658133  6821 raft_consensus.cc:359] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:58.659025  6821 raft_consensus.cc:740] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:58.660001  6821 consensus_queue.cc:260] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:58.666280  6821 ts_tablet_manager.cc:1434] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:15:58.667490  6821 tablet_bootstrap.cc:492] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:58.723191  6821 tablet_bootstrap.cc:492] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:58.724466  6821 tablet_bootstrap.cc:492] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:58.725589  6821 ts_tablet_manager.cc:1403] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.058s	user 0.026s	sys 0.001s
I20260709 12:15:58.729959  6821 raft_consensus.cc:359] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:58.730885  6821 raft_consensus.cc:740] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:58.731882  6821 consensus_queue.cc:260] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:58.734546  6821 ts_tablet_manager.cc:1434] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:15:58.740569  6821 tablet_bootstrap.cc:492] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:58.779855  6821 tablet_bootstrap.cc:492] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:58.780972  6821 tablet_bootstrap.cc:492] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:58.781761  6821 ts_tablet_manager.cc:1403] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.004s
I20260709 12:15:58.785018  6821 raft_consensus.cc:359] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:58.785835  6821 raft_consensus.cc:740] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:58.786705  6821 consensus_queue.cc:260] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:58.789320  6821 ts_tablet_manager.cc:1434] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:15:58.791356  6821 tablet_bootstrap.cc:492] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:58.790436  6922 raft_consensus.cc:3060] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:58.821527  6821 tablet_bootstrap.cc:492] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:58.822677  6821 tablet_bootstrap.cc:492] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:58.823439  6821 ts_tablet_manager.cc:1403] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.019s
I20260709 12:15:58.826473  6821 raft_consensus.cc:359] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:58.827271  6821 raft_consensus.cc:740] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:58.828032  6821 consensus_queue.cc:260] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:15:58.848058  6821 ts_tablet_manager.cc:1434] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:15:58.849164  6821 tablet_bootstrap.cc:492] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:58.890012  6821 tablet_bootstrap.cc:492] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:58.891299  6821 tablet_bootstrap.cc:492] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:58.892167  6821 ts_tablet_manager.cc:1403] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.009s
I20260709 12:15:58.895025  6821 raft_consensus.cc:359] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:58.895855  6821 raft_consensus.cc:740] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:58.896658  6821 consensus_queue.cc:260] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:15:58.898326  6821 ts_tablet_manager.cc:1434] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:15:58.899268  6821 tablet_bootstrap.cc:492] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap starting.
I20260709 12:15:58.947419  6821 tablet_bootstrap.cc:492] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:58.948470  6821 tablet_bootstrap.cc:492] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43: Bootstrap complete.
I20260709 12:15:58.949210  6821 ts_tablet_manager.cc:1403] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.007s
I20260709 12:15:58.955574  6821 raft_consensus.cc:359] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:58.956338  6821 raft_consensus.cc:740] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Initialized, Role: FOLLOWER
I20260709 12:15:58.957121  6821 consensus_queue.cc:260] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:15:58.960217  6821 ts_tablet_manager.cc:1434] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:15:58.999120  6920 raft_consensus.cc:3060] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:59.014097  6927 raft_consensus.cc:3060] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:59.027554  6926 raft_consensus.cc:3060] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:59.164876  6927 raft_consensus.cc:3060] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:16:02.255498  6049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:38243, user_credentials={real_user=slave}} blocked reactor thread for 70751.1us
I20260709 12:16:04.783454 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:04.860247  6082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27058558598c4834804424f2de3c1cea"
dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
mode: GRACEFUL
new_leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:40514
I20260709 12:16:04.861434  6082 raft_consensus.cc:606] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Received request to transfer leadership to TS 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:16:04.878691  5935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c61591bbcaf43839af1cc8373f98c7e"
dest_uuid: "26615d25670745d38490e2d6da247d9e"
mode: GRACEFUL
new_leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:45824
I20260709 12:16:04.879271  5935 raft_consensus.cc:606] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 2 LEADER]: Received request to transfer leadership to TS 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:16:04.893375  6008 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "859eab84f0fb443ba4bd2cccf81cbe3e"
dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
mode: GRACEFUL
new_leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:46476
I20260709 12:16:04.893976  6008 raft_consensus.cc:606] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Received request to transfer leadership to TS 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:16:04.896853  6082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b14d71c733514ec9bc7ddb9d3b7cd80d"
dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
mode: GRACEFUL
new_leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:40514
I20260709 12:16:04.897511  6082 raft_consensus.cc:606] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Received request to transfer leadership to TS 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:16:04.900876  6082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d792c0dd53aa459399c3adf5d4f17f58"
dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
mode: GRACEFUL
new_leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:40514
I20260709 12:16:04.901504  6082 raft_consensus.cc:606] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Received request to transfer leadership to TS 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:16:04.902822 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:04.904784 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:04.909286 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:05.015401  7126 raft_consensus.cc:993] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb: : Instructing follower 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:05.016136  7126 raft_consensus.cc:1081] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Signalling peer 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:05.018144  6922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27058558598c4834804424f2de3c1cea"
dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:34322
I20260709 12:16:05.018913  6922 raft_consensus.cc:493] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:05.019346  6922 raft_consensus.cc:3060] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.033293  6922 raft_consensus.cc:515] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:05.035948  6922 leader_election.cc:290] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:16:05.037488  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27058558598c4834804424f2de3c1cea" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:16:05.038422  6006 raft_consensus.cc:3060] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.038682  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27058558598c4834804424f2de3c1cea" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:16:05.039377  6082 raft_consensus.cc:3055] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:05.039695  6082 raft_consensus.cc:740] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:16:05.040531  6082 consensus_queue.cc:260] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:05.042035  6082 raft_consensus.cc:3060] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.046988  6006 raft_consensus.cc:2468] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 2.
I20260709 12:16:05.052273  6816 leader_election.cc:304] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:16:05.058939  6082 raft_consensus.cc:2468] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 2.
I20260709 12:16:05.062000  7135 raft_consensus.cc:2804] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:05.065414  7135 raft_consensus.cc:697] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:16:05.066697  7135 consensus_queue.cc:237] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:05.084726  5757 catalog_manager.cc:5697] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 1 to 2, leader changed from 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68) to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:05.256927  7095 raft_consensus.cc:993] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27: : Instructing follower 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:05.257504  7118 raft_consensus.cc:1081] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Signalling peer 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:05.259137  6922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "859eab84f0fb443ba4bd2cccf81cbe3e"
dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:34338
I20260709 12:16:05.259681  6922 raft_consensus.cc:493] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:05.259989  6922 raft_consensus.cc:3060] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.266126  6922 raft_consensus.cc:515] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:05.267771  6922 leader_election.cc:290] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:16:05.268675  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859eab84f0fb443ba4bd2cccf81cbe3e" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:16:05.268998  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859eab84f0fb443ba4bd2cccf81cbe3e" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:16:05.269416  6006 raft_consensus.cc:3055] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:05.269570  6082 raft_consensus.cc:3060] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.269775  6006 raft_consensus.cc:740] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:16:05.270721  6006 consensus_queue.cc:260] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:05.272256  6006 raft_consensus.cc:3060] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.278119  6082 raft_consensus.cc:2468] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 2.
I20260709 12:16:05.279485  6816 leader_election.cc:304] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:16:05.280517  7135 raft_consensus.cc:2804] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:05.281028  7135 raft_consensus.cc:697] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:16:05.281664  6006 raft_consensus.cc:2468] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 2.
I20260709 12:16:05.282014  7135 consensus_queue.cc:237] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:05.302664  5757 catalog_manager.cc:5697] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 1 to 2, leader changed from e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67) to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:05.306064  7130 raft_consensus.cc:993] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e: : Instructing follower 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:05.306867  7128 raft_consensus.cc:1081] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 2 LEADER]: Signalling peer 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:05.308589  6922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c61591bbcaf43839af1cc8373f98c7e"
dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:34320
I20260709 12:16:05.309232  6922 raft_consensus.cc:493] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:05.309649  6922 raft_consensus.cc:3060] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.322818  6922 raft_consensus.cc:515] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:16:05.325065  6922 leader_election.cc:290] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 3 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:16:05.325796  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c61591bbcaf43839af1cc8373f98c7e" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:16:05.326187  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c61591bbcaf43839af1cc8373f98c7e" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:16:05.326782  6006 raft_consensus.cc:3060] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.326691  5935 raft_consensus.cc:3055] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:05.327457  5935 raft_consensus.cc:740] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:16:05.328516  5935 consensus_queue.cc:260] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:16:05.330487  5935 raft_consensus.cc:3060] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.336553  6006 raft_consensus.cc:2468] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 3.
I20260709 12:16:05.337937  6816 leader_election.cc:304] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:16:05.339025  7135 raft_consensus.cc:2804] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:05.339174  7126 raft_consensus.cc:993] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb: : Instructing follower 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:05.339664  7135 raft_consensus.cc:697] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:16:05.339860  7126 raft_consensus.cc:1081] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Signalling peer 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:05.340766  7135 consensus_queue.cc:237] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:16:05.342574  6922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d792c0dd53aa459399c3adf5d4f17f58"
dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:34322
I20260709 12:16:05.342700  5935 raft_consensus.cc:2468] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 3.
I20260709 12:16:05.344591  6922 raft_consensus.cc:493] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:05.345026  6922 raft_consensus.cc:3060] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.352450  6922 raft_consensus.cc:515] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:16:05.354374  6922 leader_election.cc:290] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 3 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:16:05.355365  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d792c0dd53aa459399c3adf5d4f17f58" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:16:05.355829  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d792c0dd53aa459399c3adf5d4f17f58" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:16:05.356192  6075 raft_consensus.cc:3055] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:05.356581  6075 raft_consensus.cc:740] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:16:05.356628  5935 raft_consensus.cc:3060] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.357512  6075 consensus_queue.cc:260] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:16:05.357573  5757 catalog_manager.cc:5697] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 2 to 3, leader changed from 26615d25670745d38490e2d6da247d9e (127.24.179.66) to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 3 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:05.359182  6075 raft_consensus.cc:3060] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.373598  5935 raft_consensus.cc:2468] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 3.
I20260709 12:16:05.375098  6817 leader_election.cc:304] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:16:05.375851  7135 raft_consensus.cc:2804] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:05.376535  7135 raft_consensus.cc:697] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:16:05.377483  7135 consensus_queue.cc:237] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:16:05.378437  6075 raft_consensus.cc:2468] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 3.
I20260709 12:16:05.387884  5757 catalog_manager.cc:5697] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 2 to 3, leader changed from 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68) to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 3 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:05.488660  7129 raft_consensus.cc:993] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb: : Instructing follower 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:05.489275  7129 raft_consensus.cc:1081] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Signalling peer 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:05.491118  6920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b14d71c733514ec9bc7ddb9d3b7cd80d"
dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:34322
I20260709 12:16:05.491658  6920 raft_consensus.cc:493] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:05.492105  6920 raft_consensus.cc:3060] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.498150  6920 raft_consensus.cc:515] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:05.500036  6920 leader_election.cc:290] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:16:05.501163  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d71c733514ec9bc7ddb9d3b7cd80d" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:16:05.502060  6003 raft_consensus.cc:3060] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.502035  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b14d71c733514ec9bc7ddb9d3b7cd80d" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:16:05.503000  6075 raft_consensus.cc:3055] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:05.503334  6075 raft_consensus.cc:740] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:16:05.504258  6075 consensus_queue.cc:260] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:05.505674  6075 raft_consensus.cc:3060] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.511183  6003 raft_consensus.cc:2468] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 2.
I20260709 12:16:05.512825  6816 leader_election.cc:304] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:16:05.513756  7135 raft_consensus.cc:2804] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:05.514243  7135 raft_consensus.cc:697] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:16:05.515290  7135 consensus_queue.cc:237] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:05.515530  6075 raft_consensus.cc:2468] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 2.
I20260709 12:16:05.526383  5757 catalog_manager.cc:5697] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 1 to 2, leader changed from 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68) to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:05.622150  6075 raft_consensus.cc:1275] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:05.623618  7135 consensus_queue.cc:1048] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:05.650795  6003 raft_consensus.cc:1275] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:05.654153  7135 consensus_queue.cc:1048] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:05.683622  6006 raft_consensus.cc:1275] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:05.688501  7148 consensus_queue.cc:1048] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:05.716434  6075 raft_consensus.cc:1275] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:05.718611  7149 consensus_queue.cc:1048] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:05.765020  5929 raft_consensus.cc:1275] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:05.766513  7136 consensus_queue.cc:1048] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:05.778497  6006 raft_consensus.cc:1275] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:05.782725  7148 consensus_queue.cc:1048] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:05.796504  5929 raft_consensus.cc:1275] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:05.799852  7148 consensus_queue.cc:1048] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:05.811172  6075 raft_consensus.cc:1275] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:05.813102  7149 consensus_queue.cc:1048] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:05.955004  6006 raft_consensus.cc:1275] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:05.956370  7149 consensus_queue.cc:1048] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:05.972460 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:05.976624  6075 raft_consensus.cc:1275] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:05.979080  7148 consensus_queue.cc:1048] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:06.062906  6006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41f23027ce3e4c149ba8309105929682"
dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
mode: GRACEFUL
new_leader_uuid: "26615d25670745d38490e2d6da247d9e"
 from {username='slave'} at 127.0.0.1:46476
I20260709 12:16:06.063740  6006 raft_consensus.cc:606] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Received request to transfer leadership to TS 26615d25670745d38490e2d6da247d9e
I20260709 12:16:06.066843  6006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ec4d35ac70348cb95a01355320f5686"
dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
mode: GRACEFUL
new_leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
 from {username='slave'} at 127.0.0.1:46476
I20260709 12:16:06.067452  6006 raft_consensus.cc:606] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Received request to transfer leadership to TS 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:16:06.070286  6006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb"
dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
mode: GRACEFUL
new_leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:46476
I20260709 12:16:06.070920  6006 raft_consensus.cc:606] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 4 LEADER]: Received request to transfer leadership to TS 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:16:06.074800  6006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd00b832aafb491387eee88b954ff5df"
dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
mode: GRACEFUL
new_leader_uuid: "26615d25670745d38490e2d6da247d9e"
 from {username='slave'} at 127.0.0.1:46476
I20260709 12:16:06.075522  6006 raft_consensus.cc:606] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 3 LEADER]: Received request to transfer leadership to TS 26615d25670745d38490e2d6da247d9e
I20260709 12:16:06.078626  6006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8800c8a47a0449783d57a6275b2f677"
dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
mode: GRACEFUL
new_leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
 from {username='slave'} at 127.0.0.1:46476
I20260709 12:16:06.079231  6006 raft_consensus.cc:606] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Received request to transfer leadership to TS 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:16:06.080618 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:06.082734 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:06.083608 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:06.088534  7116 raft_consensus.cc:993] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27: : Instructing follower 26615d25670745d38490e2d6da247d9e to start an election
I20260709 12:16:06.089076  7116 raft_consensus.cc:1081] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 3 LEADER]: Signalling peer 26615d25670745d38490e2d6da247d9e to start an election
I20260709 12:16:06.091029  5935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd00b832aafb491387eee88b954ff5df"
dest_uuid: "26615d25670745d38490e2d6da247d9e"
 from {username='slave'} at 127.0.0.1:50260
I20260709 12:16:06.091624  5935 raft_consensus.cc:493] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:06.092049  5935 raft_consensus.cc:3060] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:06.112696  5935 raft_consensus.cc:515] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:06.115227  5935 leader_election.cc:290] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 4 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:16:06.117606  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd00b832aafb491387eee88b954ff5df" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:16:06.118250  6075 raft_consensus.cc:3060] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:06.126247  6075 raft_consensus.cc:2468] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 4.
I20260709 12:16:06.128000  5899 leader_election.cc:304] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:16:06.122056  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd00b832aafb491387eee88b954ff5df" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:16:06.129156  6006 raft_consensus.cc:3055] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:06.129534  6006 raft_consensus.cc:740] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:16:06.130496  6006 consensus_queue.cc:260] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:06.131088  7130 raft_consensus.cc:2804] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:06.131779  7130 raft_consensus.cc:697] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 4 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:16:06.131995  6006 raft_consensus.cc:3060] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:06.132740  7130 consensus_queue.cc:237] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:06.139948  6006 raft_consensus.cc:2468] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 4.
I20260709 12:16:06.147755  5756 catalog_manager.cc:5697] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 3 to 4, leader changed from e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67) to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 4 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:06.162878  7118 raft_consensus.cc:993] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27: : Instructing follower 26615d25670745d38490e2d6da247d9e to start an election
I20260709 12:16:06.163894  7095 raft_consensus.cc:1081] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Signalling peer 26615d25670745d38490e2d6da247d9e to start an election
I20260709 12:16:06.165532  5935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41f23027ce3e4c149ba8309105929682"
dest_uuid: "26615d25670745d38490e2d6da247d9e"
 from {username='slave'} at 127.0.0.1:50260
I20260709 12:16:06.166065  5935 raft_consensus.cc:493] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:06.166435  5935 raft_consensus.cc:3060] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.173398  5935 raft_consensus.cc:515] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:06.175498  5935 leader_election.cc:290] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:16:06.176473  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f23027ce3e4c149ba8309105929682" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:16:06.177155  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f23027ce3e4c149ba8309105929682" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:16:06.177806  6003 raft_consensus.cc:3055] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:06.178104  6003 raft_consensus.cc:740] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:16:06.177162  6075 raft_consensus.cc:3060] T 41f23027ce3e4c149ba8309105929682 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.178973  6003 consensus_queue.cc:260] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:06.180424  6003 raft_consensus.cc:3060] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.187667  6075 raft_consensus.cc:2468] T 41f23027ce3e4c149ba8309105929682 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 2.
I20260709 12:16:06.189066  5899 leader_election.cc:304] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:16:06.189965  7151 raft_consensus.cc:2804] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:06.190516  6003 raft_consensus.cc:2468] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 2.
I20260709 12:16:06.190532  7151 raft_consensus.cc:697] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [term 2 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:16:06.191825  7151 consensus_queue.cc:237] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:06.206362  5756 catalog_manager.cc:5697] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 1 to 2, leader changed from e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67) to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 2 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:06.212471  7118 raft_consensus.cc:993] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27: : Instructing follower 36dfe581d09b46f6a9bfe678170e71cb to start an election
I20260709 12:16:06.213104  7095 raft_consensus.cc:1081] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Signalling peer 36dfe581d09b46f6a9bfe678170e71cb to start an election
I20260709 12:16:06.214708  6075 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ec4d35ac70348cb95a01355320f5686"
dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
 from {username='slave'} at 127.0.0.1:43406
I20260709 12:16:06.215286  6075 raft_consensus.cc:493] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:06.215556  6075 raft_consensus.cc:3060] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.225657  6075 raft_consensus.cc:515] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:06.227919  6075 leader_election.cc:290] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:16:06.228572  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec4d35ac70348cb95a01355320f5686" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:16:06.229372  5935 raft_consensus.cc:3060] T 4ec4d35ac70348cb95a01355320f5686 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.229619  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec4d35ac70348cb95a01355320f5686" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:16:06.230214  6003 raft_consensus.cc:3055] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:06.230581  6003 raft_consensus.cc:740] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:16:06.231335  6003 consensus_queue.cc:260] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:06.232579  6003 raft_consensus.cc:3060] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.236756  5935 raft_consensus.cc:2468] T 4ec4d35ac70348cb95a01355320f5686 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 2.
I20260709 12:16:06.238469  6048 leader_election.cc:304] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 36dfe581d09b46f6a9bfe678170e71cb; no voters: 
I20260709 12:16:06.238726  6003 raft_consensus.cc:2468] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 2.
I20260709 12:16:06.239482  7126 raft_consensus.cc:2804] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:06.240000  7126 raft_consensus.cc:697] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:16:06.240780  7126 consensus_queue.cc:237] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:06.251849  5755 catalog_manager.cc:5697] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 1 to 2, leader changed from e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67) to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 2 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:06.366641  7118 raft_consensus.cc:993] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27: : Instructing follower 36dfe581d09b46f6a9bfe678170e71cb to start an election
I20260709 12:16:06.367296  7095 raft_consensus.cc:1081] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Signalling peer 36dfe581d09b46f6a9bfe678170e71cb to start an election
I20260709 12:16:06.369350  6075 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8800c8a47a0449783d57a6275b2f677"
dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
 from {username='slave'} at 127.0.0.1:43406
I20260709 12:16:06.370185  6075 raft_consensus.cc:493] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:06.370649  6075 raft_consensus.cc:3060] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.379315  6075 raft_consensus.cc:515] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:06.381385  6075 leader_election.cc:290] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:16:06.382273  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8800c8a47a0449783d57a6275b2f677" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:16:06.383424  5935 raft_consensus.cc:3060] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.383327  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8800c8a47a0449783d57a6275b2f677" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:16:06.384106  6006 raft_consensus.cc:3055] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:06.384428  6006 raft_consensus.cc:740] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:16:06.385253  6006 consensus_queue.cc:260] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:06.386659  6006 raft_consensus.cc:3060] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.394062  6006 raft_consensus.cc:2468] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 2.
I20260709 12:16:06.395213  6047 leader_election.cc:304] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:16:06.395215  5935 raft_consensus.cc:2468] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 2.
I20260709 12:16:06.396044  7126 raft_consensus.cc:2804] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:06.397328  7126 raft_consensus.cc:697] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:16:06.398259  7126 consensus_queue.cc:237] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:06.415117  5755 catalog_manager.cc:5697] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 1 to 2, leader changed from e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67) to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 2 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:06.436937  7095 raft_consensus.cc:993] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27: : Instructing follower 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:06.437414  7118 raft_consensus.cc:1081] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 4 LEADER]: Signalling peer 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:06.439308  6927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb"
dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:34338
I20260709 12:16:06.439837  6927 raft_consensus.cc:493] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:06.440147  6927 raft_consensus.cc:3060] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:06.446172  6927 raft_consensus.cc:515] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:06.447901  6927 leader_election.cc:290] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 5 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:16:06.448817  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:16:06.449105  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525a431d53e142a8b9afb97f02fa94bb" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:16:06.449571  6006 raft_consensus.cc:3055] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:06.449648  6075 raft_consensus.cc:3060] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:06.450006  6006 raft_consensus.cc:740] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:16:06.450907  6006 consensus_queue.cc:260] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:06.452248  6006 raft_consensus.cc:3060] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:06.458182  6075 raft_consensus.cc:2468] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 5.
I20260709 12:16:06.459544  6816 leader_election.cc:304] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:16:06.460047  6006 raft_consensus.cc:2468] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 5.
I20260709 12:16:06.460383  7135 raft_consensus.cc:2804] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:06.461022  7135 raft_consensus.cc:697] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 5 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:16:06.461937  7135 consensus_queue.cc:237] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:06.473224  5755 catalog_manager.cc:5697] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 4 to 5, leader changed from e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67) to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 5 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:06.604112  6082 raft_consensus.cc:1275] T 41f23027ce3e4c149ba8309105929682 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:06.605424  7151 consensus_queue.cc:1048] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:06.626830  6006 raft_consensus.cc:1275] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:06.629693  7151 consensus_queue.cc:1048] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:06.754566  6006 raft_consensus.cc:1275] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:06.756247  7128 consensus_queue.cc:1048] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:06.762879  6082 raft_consensus.cc:1275] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:06.764854  7151 consensus_queue.cc:1048] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:06.771881  6003 raft_consensus.cc:1275] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:06.774443  7126 consensus_queue.cc:1048] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:16:06.828620  5935 raft_consensus.cc:1275] T 4ec4d35ac70348cb95a01355320f5686 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:06.830904  7129 consensus_queue.cc:1048] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:06.878976  5935 raft_consensus.cc:1275] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:06.880235  7129 consensus_queue.cc:1048] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:06.886569  6003 raft_consensus.cc:1275] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:06.888316  7129 consensus_queue.cc:1048] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:16:07.015620  6082 raft_consensus.cc:1275] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 5 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:07.017156  7136 consensus_queue.cc:1048] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:07.028940  6006 raft_consensus.cc:1275] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 5 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:07.030884  7135 consensus_queue.cc:1048] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:07.139209 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:07.203056  5929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf"
dest_uuid: "26615d25670745d38490e2d6da247d9e"
mode: GRACEFUL
new_leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:45824
I20260709 12:16:07.203677  5929 raft_consensus.cc:606] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 3 LEADER]: Received request to transfer leadership to TS 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:16:07.206549  5929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c"
dest_uuid: "26615d25670745d38490e2d6da247d9e"
mode: GRACEFUL
new_leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:45824
I20260709 12:16:07.207072  5929 raft_consensus.cc:606] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 4 LEADER]: Received request to transfer leadership to TS 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:16:07.209704  6082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a12649b3d49a4a309d961106ba152892"
dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
mode: GRACEFUL
new_leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:40514
I20260709 12:16:07.210245  6082 raft_consensus.cc:606] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Received request to transfer leadership to TS 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:16:07.212985  6006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3cdb9438c4a44489be534e4c1c147b5"
dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
mode: GRACEFUL
new_leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:46476
I20260709 12:16:07.213613  6006 raft_consensus.cc:606] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 2 LEADER]: Received request to transfer leadership to TS 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:16:07.216126  6082 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8800c8a47a0449783d57a6275b2f677"
dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
mode: GRACEFUL
new_leader_uuid: "26615d25670745d38490e2d6da247d9e"
 from {username='slave'} at 127.0.0.1:40514
I20260709 12:16:07.216652  6082 raft_consensus.cc:606] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Received request to transfer leadership to TS 26615d25670745d38490e2d6da247d9e
I20260709 12:16:07.217871 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:07.219877 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:07.220588 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:07.334067  7151 raft_consensus.cc:993] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e: : Instructing follower 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:07.334729  7151 raft_consensus.cc:1081] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 3 LEADER]: Signalling peer 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:07.336434  6927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf"
dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:34320
I20260709 12:16:07.337039  6927 raft_consensus.cc:493] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:07.337458  6927 raft_consensus.cc:3060] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:07.344326  6927 raft_consensus.cc:515] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:16:07.344771  7126 raft_consensus.cc:993] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb: : Instructing follower 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:07.345489  7115 raft_consensus.cc:1081] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Signalling peer 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:07.347198  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:16:07.347335  6927 leader_election.cc:290] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 4 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:16:07.347522  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e05435b58ec4a7ca6d7ea02368e5dcf" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:16:07.347419  6926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a12649b3d49a4a309d961106ba152892"
dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:34322
I20260709 12:16:07.348125  5929 raft_consensus.cc:3055] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:07.348310  6006 raft_consensus.cc:3060] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:07.348461  6926 raft_consensus.cc:493] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:07.348632  5929 raft_consensus.cc:740] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:16:07.349177  6926 raft_consensus.cc:3060] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:07.349759  5929 consensus_queue.cc:260] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:16:07.350903  5929 raft_consensus.cc:3060] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:07.361255  5929 raft_consensus.cc:2468] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 4.
I20260709 12:16:07.362407  6817 leader_election.cc:304] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:16:07.363425  7135 raft_consensus.cc:2804] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:07.363950  7135 raft_consensus.cc:697] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 4 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:16:07.364967  7135 consensus_queue.cc:237] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:16:07.373579  6926 raft_consensus.cc:515] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:16:07.376013  6006 raft_consensus.cc:2468] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 4.
I20260709 12:16:07.377055  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12649b3d49a4a309d961106ba152892" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:16:07.377810  6082 raft_consensus.cc:3055] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:07.378158  6082 raft_consensus.cc:740] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:16:07.379001  6926 leader_election.cc:290] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:16:07.379022  6082 consensus_queue.cc:260] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:16:07.380427  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12649b3d49a4a309d961106ba152892" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:16:07.381165  5929 raft_consensus.cc:3060] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:07.381392  6082 raft_consensus.cc:3060] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:07.388969  5929 raft_consensus.cc:2468] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 2.
I20260709 12:16:07.390208  6817 leader_election.cc:304] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:16:07.392369  7135 raft_consensus.cc:2804] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:07.392906  7135 raft_consensus.cc:697] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:16:07.393740  7135 consensus_queue.cc:237] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:16:07.388651  5755 catalog_manager.cc:5697] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 3 to 4, leader changed from 26615d25670745d38490e2d6da247d9e (127.24.179.66) to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 4 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:07.405376  6082 raft_consensus.cc:2468] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 2.
I20260709 12:16:07.432951  5756 catalog_manager.cc:5697] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 1 to 2, leader changed from 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68) to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:07.459663  7129 raft_consensus.cc:993] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb: : Instructing follower 26615d25670745d38490e2d6da247d9e to start an election
I20260709 12:16:07.460191  7115 raft_consensus.cc:1081] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Signalling peer 26615d25670745d38490e2d6da247d9e to start an election
I20260709 12:16:07.461831  5935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8800c8a47a0449783d57a6275b2f677"
dest_uuid: "26615d25670745d38490e2d6da247d9e"
 from {username='slave'} at 127.0.0.1:50274
I20260709 12:16:07.462368  5935 raft_consensus.cc:493] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:07.462766  5935 raft_consensus.cc:3060] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:07.468526  5935 raft_consensus.cc:515] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:07.470855  5935 leader_election.cc:290] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:16:07.471907  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8800c8a47a0449783d57a6275b2f677" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:16:07.472024  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8800c8a47a0449783d57a6275b2f677" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:16:07.472617  6006 raft_consensus.cc:3060] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:07.472733  6082 raft_consensus.cc:3055] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:07.473145  6082 raft_consensus.cc:740] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:16:07.473773  6082 consensus_queue.cc:260] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:07.474745  6082 raft_consensus.cc:3060] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:07.479456  6006 raft_consensus.cc:2468] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 3.
I20260709 12:16:07.480736  5899 leader_election.cc:304] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:16:07.481454  7151 raft_consensus.cc:2804] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:07.481978  7151 raft_consensus.cc:697] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [term 3 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:16:07.482911  7151 consensus_queue.cc:237] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:07.484831  6082 raft_consensus.cc:2468] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 3.
I20260709 12:16:07.492202  5756 catalog_manager.cc:5697] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 2 to 3, leader changed from 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68) to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 3 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:07.702879  7130 raft_consensus.cc:993] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e: : Instructing follower 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:07.703466  7151 raft_consensus.cc:1081] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 4 LEADER]: Signalling peer 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:07.705515  6927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c"
dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:34320
I20260709 12:16:07.706184  6927 raft_consensus.cc:493] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:07.706619  6927 raft_consensus.cc:3060] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:07.713573  6927 raft_consensus.cc:515] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:16:07.716638  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:16:07.717146  6927 leader_election.cc:290] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 5 election: Requested vote from peers 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:16:07.717331  5929 raft_consensus.cc:3055] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:07.717780  5929 raft_consensus.cc:740] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:16:07.716468  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a9878f315d4541b1bcbec3556ad32c" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:16:07.718451  6082 raft_consensus.cc:3060] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:07.724208  5929 consensus_queue.cc:260] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:16:07.731353  5929 raft_consensus.cc:3060] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:07.742035  7192 raft_consensus.cc:993] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27: : Instructing follower 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:07.742719  7118 raft_consensus.cc:1081] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 2 LEADER]: Signalling peer 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:07.747481  6082 raft_consensus.cc:2468] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 5.
I20260709 12:16:07.750109  6816 leader_election.cc:304] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:16:07.751538  7191 raft_consensus.cc:2804] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:07.752061  7191 raft_consensus.cc:697] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 5 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:16:07.753002  7191 consensus_queue.cc:237] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:16:07.785076  5929 raft_consensus.cc:2468] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 5.
I20260709 12:16:07.787735  6926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3cdb9438c4a44489be534e4c1c147b5"
dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:34338
I20260709 12:16:07.788489  6926 raft_consensus.cc:493] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:07.788992  6926 raft_consensus.cc:3060] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:07.793375  5756 catalog_manager.cc:5697] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 4 to 5, leader changed from 26615d25670745d38490e2d6da247d9e (127.24.179.66) to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 5 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:07.811146  6926 raft_consensus.cc:515] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:07.814321  6926 leader_election.cc:290] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 3 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:16:07.814399  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3cdb9438c4a44489be534e4c1c147b5" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:16:07.815145  6003 raft_consensus.cc:3055] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:07.815471  6003 raft_consensus.cc:740] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:16:07.815760  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3cdb9438c4a44489be534e4c1c147b5" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:16:07.816391  6075 raft_consensus.cc:3060] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:07.816282  6003 consensus_queue.cc:260] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:07.817747  6003 raft_consensus.cc:3060] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:07.824954  6075 raft_consensus.cc:2468] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 3.
I20260709 12:16:07.825191  6003 raft_consensus.cc:2468] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 3.
I20260709 12:16:07.826282  6816 leader_election.cc:304] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:16:07.827231  7191 raft_consensus.cc:2804] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:07.827876  7191 raft_consensus.cc:697] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:16:07.828814  7191 consensus_queue.cc:237] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:07.839895  5756 catalog_manager.cc:5697] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 2 to 3, leader changed from e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67) to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 3 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:07.934370  5929 raft_consensus.cc:1275] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 4 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:07.935521  6006 raft_consensus.cc:1275] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:07.936077  7191 consensus_queue.cc:1048] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:07.937316  7151 consensus_queue.cc:1048] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:07.980692  6003 raft_consensus.cc:1275] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:07.982986  6082 raft_consensus.cc:1275] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:07.985857  7200 consensus_queue.cc:1048] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:07.986882  7136 consensus_queue.cc:1048] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:08.000059  5935 raft_consensus.cc:1275] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:08.004518  7191 consensus_queue.cc:1048] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:08.018500  6075 raft_consensus.cc:1275] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:08.024421  7191 consensus_queue.cc:1048] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:08.141144  5935 raft_consensus.cc:1275] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 5 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:08.142477  7135 consensus_queue.cc:1048] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:08.154263  6075 raft_consensus.cc:1275] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 5 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:08.155973  7136 consensus_queue.cc:1048] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:08.231132  6075 raft_consensus.cc:1275] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:08.232705  7191 consensus_queue.cc:1048] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:08.247808  6003 raft_consensus.cc:1275] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:08.249516  7191 consensus_queue.cc:1048] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:08.266918 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:08.311928  6003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33adcece08484ff79fd8711ef5dfd78c"
dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
mode: GRACEFUL
new_leader_uuid: "26615d25670745d38490e2d6da247d9e"
 from {username='slave'} at 127.0.0.1:46476
I20260709 12:16:08.313006  6003 raft_consensus.cc:606] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Received request to transfer leadership to TS 26615d25670745d38490e2d6da247d9e
I20260709 12:16:08.317148  5935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62a474468455492f992eb8dfefad0ca2"
dest_uuid: "26615d25670745d38490e2d6da247d9e"
mode: GRACEFUL
new_leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:45824
I20260709 12:16:08.317736  5935 raft_consensus.cc:606] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 2 LEADER]: Received request to transfer leadership to TS 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:16:08.321444  6003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b081fa5436f34e5e9e477b502f689461"
dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
mode: GRACEFUL
new_leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:46476
I20260709 12:16:08.322849  6003 raft_consensus.cc:606] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Received request to transfer leadership to TS 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:16:08.326550  6003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db31c56e0c1b4701bc388c4d3edf535a"
dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
mode: GRACEFUL
new_leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:46476
I20260709 12:16:08.327157  6003 raft_consensus.cc:606] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 2 LEADER]: Received request to transfer leadership to TS 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:16:08.328971 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:16:08.330945 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:08.334128 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:08.425979  7193 raft_consensus.cc:993] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27: : Instructing follower 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:08.426679  7194 raft_consensus.cc:1081] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 2 LEADER]: Signalling peer 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:08.428297  6927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db31c56e0c1b4701bc388c4d3edf535a"
dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:34338
I20260709 12:16:08.428912  6927 raft_consensus.cc:493] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:08.429265  6927 raft_consensus.cc:3060] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:08.437211  6927 raft_consensus.cc:515] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:16:08.439920  6927 leader_election.cc:290] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 3 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:16:08.440908  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31c56e0c1b4701bc388c4d3edf535a" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:16:08.441584  5935 raft_consensus.cc:3060] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:08.442700  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31c56e0c1b4701bc388c4d3edf535a" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:16:08.443652  6003 raft_consensus.cc:3055] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:08.444049  6003 raft_consensus.cc:740] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:16:08.444921  6003 consensus_queue.cc:260] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:16:08.446201  6003 raft_consensus.cc:3060] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:08.449532  5935 raft_consensus.cc:2468] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 3.
I20260709 12:16:08.450876  6817 leader_election.cc:304] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:16:08.451640  7191 raft_consensus.cc:2804] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:08.452172  7191 raft_consensus.cc:697] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:16:08.453071  7191 consensus_queue.cc:237] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:16:08.453800  6003 raft_consensus.cc:2468] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 3.
I20260709 12:16:08.461475  7194 raft_consensus.cc:993] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27: : Instructing follower 26615d25670745d38490e2d6da247d9e to start an election
I20260709 12:16:08.462042  7193 raft_consensus.cc:1081] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Signalling peer 26615d25670745d38490e2d6da247d9e to start an election
I20260709 12:16:08.463943  5929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33adcece08484ff79fd8711ef5dfd78c"
dest_uuid: "26615d25670745d38490e2d6da247d9e"
 from {username='slave'} at 127.0.0.1:50260
I20260709 12:16:08.464530  5929 raft_consensus.cc:493] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:08.464922  5929 raft_consensus.cc:3060] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:08.468060  5757 catalog_manager.cc:5697] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 2 to 3, leader changed from e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67) to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 3 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:08.471165  5929 raft_consensus.cc:515] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:08.473434  5929 leader_election.cc:290] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:16:08.475117  6082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33adcece08484ff79fd8711ef5dfd78c" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:16:08.475772  6082 raft_consensus.cc:3060] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:08.474817  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33adcece08484ff79fd8711ef5dfd78c" candidate_uuid: "26615d25670745d38490e2d6da247d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:16:08.481262  6003 raft_consensus.cc:3055] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:08.481714  6003 raft_consensus.cc:740] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:16:08.482611  6003 consensus_queue.cc:260] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:08.484257  6003 raft_consensus.cc:3060] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:08.492071  6003 raft_consensus.cc:2468] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 2.
I20260709 12:16:08.493247  5899 leader_election.cc:304] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26615d25670745d38490e2d6da247d9e, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:16:08.494206  7198 raft_consensus.cc:2804] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:08.494797  7198 raft_consensus.cc:697] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [term 2 LEADER]: Becoming Leader. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:16:08.495708  7198 consensus_queue.cc:237] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:08.505539  6082 raft_consensus.cc:2468] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26615d25670745d38490e2d6da247d9e in term 2.
I20260709 12:16:08.519801  5757 catalog_manager.cc:5697] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e reported cstate change: term changed from 1 to 2, leader changed from e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67) to 26615d25670745d38490e2d6da247d9e (127.24.179.66). New cstate: current_term: 2 leader_uuid: "26615d25670745d38490e2d6da247d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:08.763499  7198 raft_consensus.cc:993] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e: : Instructing follower 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:08.764127  7151 raft_consensus.cc:1081] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 2 LEADER]: Signalling peer 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:08.765794  6926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62a474468455492f992eb8dfefad0ca2"
dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:34320
I20260709 12:16:08.766345  6926 raft_consensus.cc:493] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:08.766743  6926 raft_consensus.cc:3060] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:08.772573  6926 raft_consensus.cc:515] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:16:08.774824  6926 leader_election.cc:290] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 3 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:16:08.775432  5929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a474468455492f992eb8dfefad0ca2" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:16:08.775430  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a474468455492f992eb8dfefad0ca2" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:16:08.776352  6003 raft_consensus.cc:3060] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:08.776803  5929 raft_consensus.cc:3055] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:08.777113  5929 raft_consensus.cc:740] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:16:08.777807  5929 consensus_queue.cc:260] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:16:08.778831  5929 raft_consensus.cc:3060] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:08.784639  6003 raft_consensus.cc:2468] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 3.
I20260709 12:16:08.785995  5929 raft_consensus.cc:2468] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 3.
I20260709 12:16:08.786053  6816 leader_election.cc:304] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:16:08.787563  7148 raft_consensus.cc:2804] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:08.788142  7148 raft_consensus.cc:697] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:16:08.789202  7148 consensus_queue.cc:237] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:16:08.799904  5757 catalog_manager.cc:5697] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 2 to 3, leader changed from 26615d25670745d38490e2d6da247d9e (127.24.179.66) to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 3 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:08.874096  5929 raft_consensus.cc:1275] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:08.875907  7148 consensus_queue.cc:1048] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:08.877746  7193 raft_consensus.cc:993] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27: : Instructing follower 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:08.878435  7194 raft_consensus.cc:1081] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Signalling peer 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:08.880756  6926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b081fa5436f34e5e9e477b502f689461"
dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:34338
I20260709 12:16:08.881392  6926 raft_consensus.cc:493] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:08.881772  6926 raft_consensus.cc:3060] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:08.893175  6003 raft_consensus.cc:1275] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:08.894995  7191 consensus_queue.cc:1048] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:08.890170  6926 raft_consensus.cc:515] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:08.907884  6926 leader_election.cc:290] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:16:08.909312  6003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b081fa5436f34e5e9e477b502f689461" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:16:08.911782  6003 raft_consensus.cc:3055] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:08.912153  6003 raft_consensus.cc:740] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e29106aa83aa4eebb9b87d6745825a27, State: Running, Role: LEADER
I20260709 12:16:08.912936  6003 consensus_queue.cc:260] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:08.910699  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b081fa5436f34e5e9e477b502f689461" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:16:08.913956  6075 raft_consensus.cc:3060] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:08.914264  6003 raft_consensus.cc:3060] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:08.921312  6075 raft_consensus.cc:2468] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 2.
I20260709 12:16:08.922513  6816 leader_election.cc:304] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, 58ed30c66c784e06ad64609f8d1b4c43; no voters: 
I20260709 12:16:08.923496  7136 raft_consensus.cc:2804] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:08.923481  6003 raft_consensus.cc:2468] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 2.
I20260709 12:16:08.924357  7136 raft_consensus.cc:697] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:16:08.925390  7136 consensus_queue.cc:237] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:08.943702  5757 catalog_manager.cc:5697] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 1 to 2, leader changed from e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67) to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:09.029142  6003 raft_consensus.cc:1275] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:09.030488  7198 consensus_queue.cc:1048] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:09.056253  6082 raft_consensus.cc:1275] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Refusing update from remote peer 26615d25670745d38490e2d6da247d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:09.057981  7198 consensus_queue.cc:1048] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:09.183660  5929 raft_consensus.cc:1275] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:09.185166  7135 consensus_queue.cc:1048] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:09.202551  6003 raft_consensus.cc:1275] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:09.204043  7135 consensus_queue.cc:1048] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:09.372453 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:09.417606  5935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c20504b20bf4686afff8a8417bdc035"
dest_uuid: "26615d25670745d38490e2d6da247d9e"
mode: GRACEFUL
new_leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
 from {username='slave'} at 127.0.0.1:45824
I20260709 12:16:09.418166  5935 raft_consensus.cc:606] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 3 LEADER]: Received request to transfer leadership to TS 36dfe581d09b46f6a9bfe678170e71cb
I20260709 12:16:09.419669 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:16:09.421058 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:09.421793 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:09.440690  6003 raft_consensus.cc:1275] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:09.442458  7135 consensus_queue.cc:1048] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:09.466250  6082 raft_consensus.cc:1275] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:09.472219  7135 consensus_queue.cc:1048] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:09.669647  7218 raft_consensus.cc:993] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e: : Instructing follower 36dfe581d09b46f6a9bfe678170e71cb to start an election
I20260709 12:16:09.670195  7235 raft_consensus.cc:1081] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 3 LEADER]: Signalling peer 36dfe581d09b46f6a9bfe678170e71cb to start an election
I20260709 12:16:09.672093  6075 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c20504b20bf4686afff8a8417bdc035"
dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
 from {username='slave'} at 127.0.0.1:43412
I20260709 12:16:09.672773  6075 raft_consensus.cc:493] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:09.673097  6075 raft_consensus.cc:3060] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:09.679875  6075 raft_consensus.cc:515] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:09.683137  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c20504b20bf4686afff8a8417bdc035" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:16:09.683143  5935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c20504b20bf4686afff8a8417bdc035" candidate_uuid: "36dfe581d09b46f6a9bfe678170e71cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "26615d25670745d38490e2d6da247d9e"
I20260709 12:16:09.683962  6006 raft_consensus.cc:3060] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:09.682787  6075 leader_election.cc:290] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 4 election: Requested vote from peers 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793), e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139)
I20260709 12:16:09.683990  5935 raft_consensus.cc:3055] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:09.685700  5935 raft_consensus.cc:740] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 26615d25670745d38490e2d6da247d9e, State: Running, Role: LEADER
I20260709 12:16:09.686576  5935 consensus_queue.cc:260] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:09.687865  5935 raft_consensus.cc:3060] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:09.692240  6006 raft_consensus.cc:2468] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 4.
I20260709 12:16:09.693961  6047 leader_election.cc:304] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:16:09.694806  7129 raft_consensus.cc:2804] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:09.695331  7129 raft_consensus.cc:697] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [term 4 LEADER]: Becoming Leader. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:16:09.696550  5935 raft_consensus.cc:2468] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36dfe581d09b46f6a9bfe678170e71cb in term 4.
I20260709 12:16:09.696228  7129 consensus_queue.cc:237] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } }
I20260709 12:16:09.707638  5755 catalog_manager.cc:5697] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb reported cstate change: term changed from 3 to 4, leader changed from 26615d25670745d38490e2d6da247d9e (127.24.179.66) to 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68). New cstate: current_term: 4 leader_uuid: "36dfe581d09b46f6a9bfe678170e71cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:10.299968  5935 raft_consensus.cc:1275] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 4 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:10.301535  7115 consensus_queue.cc:1048] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:10.319058  6006 raft_consensus.cc:1275] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Refusing update from remote peer 36dfe581d09b46f6a9bfe678170e71cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:10.321398  7129 consensus_queue.cc:1048] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:10.472779 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:10.522073  6075 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e18f65fb1b1f4544b9e6a96399e38089"
dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
mode: GRACEFUL
new_leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:40514
I20260709 12:16:10.522694  6075 raft_consensus.cc:606] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 LEADER]: Received request to transfer leadership to TS 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:16:10.524154 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:16:10.525887 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:10.526588 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:10.695216  7245 raft_consensus.cc:993] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb: : Instructing follower 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:10.695933  7242 raft_consensus.cc:1081] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 LEADER]: Signalling peer 58ed30c66c784e06ad64609f8d1b4c43 to start an election
I20260709 12:16:10.697777  6926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e18f65fb1b1f4544b9e6a96399e38089"
dest_uuid: "58ed30c66c784e06ad64609f8d1b4c43"
 from {username='slave'} at 127.0.0.1:34322
I20260709 12:16:10.698280  6926 raft_consensus.cc:493] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:10.698632  6926 raft_consensus.cc:3060] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.706727  6926 raft_consensus.cc:515] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:10.708925  6926 leader_election.cc:290] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 4 election: Requested vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68:44517)
I20260709 12:16:10.711923  6078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18f65fb1b1f4544b9e6a96399e38089" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "36dfe581d09b46f6a9bfe678170e71cb"
I20260709 12:16:10.713184  6078 raft_consensus.cc:3055] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:10.713502  6078 raft_consensus.cc:740] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36dfe581d09b46f6a9bfe678170e71cb, State: Running, Role: LEADER
I20260709 12:16:10.714480  6078 consensus_queue.cc:260] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:10.715648  6006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18f65fb1b1f4544b9e6a96399e38089" candidate_uuid: "58ed30c66c784e06ad64609f8d1b4c43" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e29106aa83aa4eebb9b87d6745825a27"
I20260709 12:16:10.716385  6006 raft_consensus.cc:3060] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.715579  6078 raft_consensus.cc:3060] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:10.724768  6006 raft_consensus.cc:2468] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 4.
I20260709 12:16:10.726521  6816 leader_election.cc:304] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27; no voters: 
I20260709 12:16:10.727907  7191 raft_consensus.cc:2804] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:10.728420  7191 raft_consensus.cc:697] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 4 LEADER]: Becoming Leader. State: Replica: 58ed30c66c784e06ad64609f8d1b4c43, State: Running, Role: LEADER
I20260709 12:16:10.726943  6078 raft_consensus.cc:2468] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ed30c66c784e06ad64609f8d1b4c43 in term 4.
I20260709 12:16:10.729368  7191 consensus_queue.cc:237] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:10.761834  5757 catalog_manager.cc:5697] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 reported cstate change: term changed from 3 to 4, leader changed from 36dfe581d09b46f6a9bfe678170e71cb (127.24.179.68) to 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65). New cstate: current_term: 4 leader_uuid: "58ed30c66c784e06ad64609f8d1b4c43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:11.130779  6078 raft_consensus.cc:1275] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:11.131976  7191 consensus_queue.cc:1048] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:11.152387  6006 raft_consensus.cc:1275] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Refusing update from remote peer 58ed30c66c784e06ad64609f8d1b4c43: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:11.154047  7191 consensus_queue.cc:1048] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:11.568110 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:11.681609 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:11.683575 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:11.685565 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:11.728070 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:11.780203 25293 tablet_server.cc:179] TabletServer@127.24.179.65:38243 shutting down...
W20260709 12:16:11.795485  5975 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 340 similar messages]
W20260709 12:16:11.815160  5975 consensus_peers.cc:597] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:11.819329  5975 consensus_peers.cc:597] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:11.821076  5975 consensus_peers.cc:597] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:11.823395  5975 consensus_peers.cc:597] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:11.842499  6049 consensus_peers.cc:597] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:11.848852 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:11.851598 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.853855 25293 raft_consensus.cc:2243] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 5 LEADER]: Raft consensus shutting down.
W20260709 12:16:11.854491  6049 consensus_peers.cc:597] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:11.855679 25293 raft_consensus.cc:2272] T 45a9878f315d4541b1bcbec3556ad32c P 58ed30c66c784e06ad64609f8d1b4c43 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.860257 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.861428 25293 raft_consensus.cc:2243] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:11.862241 25293 raft_consensus.cc:2272] T 42fdfcec3d9049a2a38158457d409feb P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.866468 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.867857 25293 raft_consensus.cc:2243] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:11.868664 25293 raft_consensus.cc:2272] T e2dad9466c8e40558116511df4c6330e P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.871688 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.872639 25293 raft_consensus.cc:2243] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:11.873332 25293 raft_consensus.cc:2272] T 1df660011133455e8ede132d5d56c48f P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.876597 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.877538 25293 raft_consensus.cc:2243] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:11.878106 25293 raft_consensus.cc:2272] T 687e45fe6f3444c794271e801c21280d P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:11.879794  6049 consensus_peers.cc:597] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:11.880920 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.881711 25293 raft_consensus.cc:2243] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:11.882519 25293 raft_consensus.cc:2272] T 0484fe261cb3459cb6a2f532f88c0845 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.886135 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.886957 25293 raft_consensus.cc:2243] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:11.888227 25293 raft_consensus.cc:2272] T 27058558598c4834804424f2de3c1cea P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.891517 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.892290 25293 raft_consensus.cc:2243] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:11.893431 25293 raft_consensus.cc:2272] T c3cdb9438c4a44489be534e4c1c147b5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.896134 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.896786 25293 raft_consensus.cc:2243] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:11.897264 25293 raft_consensus.cc:2272] T aa43bf33a33b443ba5cf0cdcb741f5fa P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.900197 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.901288 25293 raft_consensus.cc:2243] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:11.901890 25293 raft_consensus.cc:2272] T d48d13e87f1d4964bb74ba350c2e2df5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.905242 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.905871 25293 raft_consensus.cc:2243] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:11.906441 25293 raft_consensus.cc:2272] T f0199e88be05480094c047ed4a193589 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.908943 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.909613 25293 raft_consensus.cc:2243] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:11.910230 25293 raft_consensus.cc:2272] T b0ace1a67c98413c886c1ce2cfcd66af P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.913825 25293 tablet_replica.cc:333] stopping tablet replica
W20260709 12:16:11.914228  5975 consensus_peers.cc:597] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:11.914810 25293 raft_consensus.cc:2243] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:11.915512 25293 raft_consensus.cc:2272] T c9a66f01ced34c71b061ec163494f2b6 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:11.916309  6049 consensus_peers.cc:597] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:11.919121 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.920176 25293 raft_consensus.cc:2243] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:11.921262 25293 raft_consensus.cc:2272] T db31c56e0c1b4701bc388c4d3edf535a P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.923758 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.924352 25293 raft_consensus.cc:2243] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:11.925328 25293 raft_consensus.cc:2272] T b14d71c733514ec9bc7ddb9d3b7cd80d P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.928815 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.929867 25293 raft_consensus.cc:2243] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:11.930646 25293 raft_consensus.cc:2272] T 713888d225a047099a38dc8257276146 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:11.931020  6049 consensus_peers.cc:597] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:11.934062 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.935266 25293 raft_consensus.cc:2243] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:11.935909 25293 raft_consensus.cc:2272] T 353bf2c0ce2c412e9ca171f2bb150f91 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.939766 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.940659 25293 raft_consensus.cc:2243] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:11.941221 25293 raft_consensus.cc:2272] T f5d9e90868894fa78e9f94ca432dc703 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.944525 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.945519 25293 raft_consensus.cc:2243] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:11.946163 25293 raft_consensus.cc:2272] T 3a260b81828b4baab927a2d3f2253be4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:11.948984  6049 consensus_peers.cc:597] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:11.949307  5901 consensus_peers.cc:597] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:11.949894 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.950603 25293 raft_consensus.cc:2243] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:11.951002 25293 raft_consensus.cc:2272] T a88edbe785c84f7fb5720879c30d6477 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.953536 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.954139 25293 raft_consensus.cc:2243] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:11.954596 25293 raft_consensus.cc:2272] T 7ba593a994ff44d7866a70004fd0a946 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.957329 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.958523 25293 raft_consensus.cc:2243] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:11.960007 25293 raft_consensus.cc:2272] T a12649b3d49a4a309d961106ba152892 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:11.962067  5901 consensus_peers.cc:597] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:11.963791 25293 tablet_replica.cc:333] stopping tablet replica
W20260709 12:16:11.963879  5901 consensus_peers.cc:597] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:11.964685 25293 raft_consensus.cc:2243] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:11.965653 25293 raft_consensus.cc:2272] T b081fa5436f34e5e9e477b502f689461 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.968107 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.968729 25293 raft_consensus.cc:2243] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:11.969178 25293 raft_consensus.cc:2272] T 214f52126a2c4bc59473ee7461e4a044 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.971953 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.972766 25293 raft_consensus.cc:2243] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:11.973760 25293 raft_consensus.cc:2272] T 859eab84f0fb443ba4bd2cccf81cbe3e P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.976195 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.976843 25293 raft_consensus.cc:2243] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:11.977739 25293 raft_consensus.cc:2272] T 2c61591bbcaf43839af1cc8373f98c7e P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.980156 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.980859 25293 raft_consensus.cc:2243] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:11.981446 25293 raft_consensus.cc:2272] T 972a71bd13ef4022b6966d1287868dc4 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.984066 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.984793 25293 raft_consensus.cc:2243] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:16:11.985980 25293 raft_consensus.cc:2272] T 525a431d53e142a8b9afb97f02fa94bb P 58ed30c66c784e06ad64609f8d1b4c43 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.989874 25293 tablet_replica.cc:333] stopping tablet replica
W20260709 12:16:11.990759  5975 consensus_peers.cc:597] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:11.990836 25293 raft_consensus.cc:2243] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:11.991652 25293 raft_consensus.cc:2272] T 219ee6e67c3a4adf9dd72198036646bc P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:11.994988 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:11.995873 25293 raft_consensus.cc:2243] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:11.997238 25293 raft_consensus.cc:2272] T e18f65fb1b1f4544b9e6a96399e38089 P 58ed30c66c784e06ad64609f8d1b4c43 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:12.000041  5975 consensus_peers.cc:597] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.001468 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:12.002727 25293 raft_consensus.cc:2243] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.003365 25293 raft_consensus.cc:2272] T 29ee607f5bb24b4bab4cd993a2327277 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:12.006752  5901 consensus_peers.cc:597] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.007232 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:12.007992 25293 raft_consensus.cc:2243] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.008500 25293 raft_consensus.cc:2272] T a16996642a1b4752b788da1836791f3c P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:12.010322  6049 consensus_peers.cc:597] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.011337 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:12.012256 25293 raft_consensus.cc:2243] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.012825 25293 raft_consensus.cc:2272] T 873d3215e6ba4214a3910fa16e0fd62a P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.015615 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:12.016305 25293 raft_consensus.cc:2243] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.016804 25293 raft_consensus.cc:2272] T a6e906733ca34216bf4664d81c7b19b2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.020139 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:12.020952 25293 raft_consensus.cc:2243] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.021574 25293 raft_consensus.cc:2272] T f35395bd69ad41f0b37fd3edca49777c P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.025082 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:12.025966 25293 raft_consensus.cc:2243] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.027238 25293 raft_consensus.cc:2272] T 62a474468455492f992eb8dfefad0ca2 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.031250 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:12.032092 25293 raft_consensus.cc:2243] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.032774 25293 raft_consensus.cc:2272] T 33d81a90a1a04c558e7d4b2e844d22ce P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.035730 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:12.036298 25293 raft_consensus.cc:2243] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.036751 25293 raft_consensus.cc:2272] T 45528a8d878d46d89244614343fc6e90 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.039280 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:12.040055 25293 raft_consensus.cc:2243] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.040680 25293 raft_consensus.cc:2272] T 626f502ef9684f1b8a6c29e9010f9ed5 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.044028 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:12.044608 25293 raft_consensus.cc:2243] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.045516 25293 raft_consensus.cc:2272] T d792c0dd53aa459399c3adf5d4f17f58 P 58ed30c66c784e06ad64609f8d1b4c43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.048027 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:12.048635 25293 raft_consensus.cc:2243] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.049096 25293 raft_consensus.cc:2272] T 32e2e4b0423a493e8f0d323065688bd1 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.051445 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:12.052047 25293 raft_consensus.cc:2243] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.052565 25293 raft_consensus.cc:2272] T 6500f59123914ed198a39756117b4110 P 58ed30c66c784e06ad64609f8d1b4c43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.054962 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:12.055850 25293 raft_consensus.cc:2243] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.057126 25293 raft_consensus.cc:2272] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 58ed30c66c784e06ad64609f8d1b4c43 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.059815 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:12.060422 25293 raft_consensus.cc:2243] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.060994 25293 raft_consensus.cc:2272] T 2e4c5dd41465429eab21af474b88bc05 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.063526 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:12.064054 25293 raft_consensus.cc:2243] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.064532 25293 raft_consensus.cc:2272] T 6a300304455c4851b24de418128a28d0 P 58ed30c66c784e06ad64609f8d1b4c43 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:12.086059  6049 consensus_peers.cc:597] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:12.090237  5901 consensus_peers.cc:597] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:12.098860  6049 consensus_peers.cc:597] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:12.117666  6049 consensus_peers.cc:597] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:12.142300  5901 consensus_peers.cc:597] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.163560 25293 tablet_server.cc:196] TabletServer@127.24.179.65:38243 shutdown complete.
W20260709 12:16:12.171259  5901 consensus_peers.cc:597] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:12.181557  5901 consensus_peers.cc:597] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:12.182094  5901 consensus_peers.cc:597] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:12.187443  5975 consensus_peers.cc:597] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:12.243299  5975 consensus_peers.cc:597] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:12.259169  5975 consensus_peers.cc:597] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:12.271587  6049 consensus_peers.cc:597] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.295852 25293 tablet_server.cc:179] TabletServer@127.24.179.66:0 shutting down...
W20260709 12:16:12.331856  5974 consensus_peers.cc:597] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:12.336604  6048 consensus_peers.cc:597] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:12.340425  6048 consensus_peers.cc:597] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.358357 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:12.359398 25293 tablet_replica.cc:333] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.360278 25293 raft_consensus.cc:2243] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.361253 25293 raft_consensus.cc:2272] T 33adcece08484ff79fd8711ef5dfd78c P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.363708 25293 tablet_replica.cc:333] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.364550 25293 raft_consensus.cc:2243] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.365214 25293 raft_consensus.cc:2272] T 219ee6e67c3a4adf9dd72198036646bc P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.368804 25293 tablet_replica.cc:333] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.369792 25293 raft_consensus.cc:2243] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.370509 25293 raft_consensus.cc:2272] T 2c61591bbcaf43839af1cc8373f98c7e P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:12.372609  5975 consensus_peers.cc:597] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Couldn't send request to peer 58ed30c66c784e06ad64609f8d1b4c43. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:12.373088  5974 consensus_peers.cc:597] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.373862 25293 tablet_replica.cc:333] T 4ec4d35ac70348cb95a01355320f5686 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.374996 25293 raft_consensus.cc:2243] T 4ec4d35ac70348cb95a01355320f5686 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.375687 25293 raft_consensus.cc:2272] T 4ec4d35ac70348cb95a01355320f5686 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.378810 25293 tablet_replica.cc:333] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.379781 25293 raft_consensus.cc:2243] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.381004 25293 raft_consensus.cc:2272] T 6a300304455c4851b24de418128a28d0 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.384156 25293 tablet_replica.cc:333] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.385212 25293 raft_consensus.cc:2243] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.386546 25293 raft_consensus.cc:2272] T 626f502ef9684f1b8a6c29e9010f9ed5 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:12.388025  6048 consensus_peers.cc:597] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.389806 25293 tablet_replica.cc:333] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.390952 25293 raft_consensus.cc:2243] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.391846 25293 raft_consensus.cc:2272] T d792c0dd53aa459399c3adf5d4f17f58 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:12.392696  5974 consensus_peers.cc:597] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.395339 25293 tablet_replica.cc:333] T a6e906733ca34216bf4664d81c7b19b2 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
W20260709 12:16:12.395543  5974 consensus_peers.cc:597] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.396528 25293 raft_consensus.cc:2243] T a6e906733ca34216bf4664d81c7b19b2 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.397186 25293 raft_consensus.cc:2272] T a6e906733ca34216bf4664d81c7b19b2 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.400584 25293 tablet_replica.cc:333] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.401490 25293 raft_consensus.cc:2243] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.402237 25293 raft_consensus.cc:2272] T a12649b3d49a4a309d961106ba152892 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:12.404934  5974 consensus_peers.cc:597] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.405618 25293 tablet_replica.cc:333] T d852dc979f7843dcbf8477fc409c2c68 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.406330 25293 raft_consensus.cc:2243] T d852dc979f7843dcbf8477fc409c2c68 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.406903 25293 raft_consensus.cc:2272] T d852dc979f7843dcbf8477fc409c2c68 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.409353 25293 tablet_replica.cc:333] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.410099 25293 raft_consensus.cc:2243] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.410750 25293 raft_consensus.cc:2272] T 6cc7520eb74c4882b7e36fda0f66ca0e P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:12.413080  5974 consensus_peers.cc:597] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.413163 25293 tablet_replica.cc:333] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.414022 25293 raft_consensus.cc:2243] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.414613 25293 raft_consensus.cc:2272] T 45a9878f315d4541b1bcbec3556ad32c P 26615d25670745d38490e2d6da247d9e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.417052 25293 tablet_replica.cc:333] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.417868 25293 raft_consensus.cc:2243] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.418897 25293 raft_consensus.cc:2272] T f5d9e90868894fa78e9f94ca432dc703 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.421263 25293 tablet_replica.cc:333] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.421927 25293 raft_consensus.cc:2243] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.423003 25293 raft_consensus.cc:2272] T a88edbe785c84f7fb5720879c30d6477 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.425495 25293 tablet_replica.cc:333] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
W20260709 12:16:12.425705  5974 consensus_peers.cc:597] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.426271 25293 raft_consensus.cc:2243] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.427477 25293 raft_consensus.cc:2272] T 3a260b81828b4baab927a2d3f2253be4 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.430174 25293 tablet_replica.cc:333] T 82ede3276c3746638e321c76e4794c86 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.431206 25293 raft_consensus.cc:2243] T 82ede3276c3746638e321c76e4794c86 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.431866 25293 raft_consensus.cc:2272] T 82ede3276c3746638e321c76e4794c86 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.435009 25293 tablet_replica.cc:333] T b75d901511f94357a67c07612cf07d1a P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.436094 25293 raft_consensus.cc:2243] T b75d901511f94357a67c07612cf07d1a P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.436801 25293 raft_consensus.cc:2272] T b75d901511f94357a67c07612cf07d1a P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:12.437975  6048 consensus_peers.cc:597] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.440618 25293 tablet_replica.cc:333] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.441825 25293 raft_consensus.cc:2243] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.442517 25293 raft_consensus.cc:2272] T f0199e88be05480094c047ed4a193589 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.446921 25293 tablet_replica.cc:333] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.448243 25293 raft_consensus.cc:2243] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.449134 25293 raft_consensus.cc:2272] T 713888d225a047099a38dc8257276146 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:12.449203  6048 consensus_peers.cc:597] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.452754 25293 tablet_replica.cc:333] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.453558 25293 raft_consensus.cc:2243] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.454218 25293 raft_consensus.cc:2272] T 353bf2c0ce2c412e9ca171f2bb150f91 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.456708 25293 tablet_replica.cc:333] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.457528 25293 raft_consensus.cc:2243] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.458745 25293 raft_consensus.cc:2272] T d48d13e87f1d4964bb74ba350c2e2df5 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:12.464313  5974 consensus_peers.cc:597] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.465087 25293 tablet_replica.cc:333] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.466293 25293 raft_consensus.cc:2243] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.467587 25293 raft_consensus.cc:2272] T 29ee607f5bb24b4bab4cd993a2327277 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.470939 25293 tablet_replica.cc:333] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.471781 25293 raft_consensus.cc:2243] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.474977 25293 raft_consensus.cc:2272] T a16996642a1b4752b788da1836791f3c P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.479322 25293 tablet_replica.cc:333] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.480291 25293 raft_consensus.cc:2243] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:16:12.481086  6048 consensus_peers.cc:597] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.481123 25293 raft_consensus.cc:2272] T db31c56e0c1b4701bc388c4d3edf535a P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.484747 25293 tablet_replica.cc:333] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.485462 25293 raft_consensus.cc:2243] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.485926 25293 raft_consensus.cc:2272] T a7299ddfb5eb4240b757da7c444170c9 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.488457 25293 tablet_replica.cc:333] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.489104 25293 raft_consensus.cc:2243] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.490137 25293 raft_consensus.cc:2272] T e2dad9466c8e40558116511df4c6330e P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.492849 25293 tablet_replica.cc:333] T 5cb1760bd0ba436eb7077c60542c0a45 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.493486 25293 raft_consensus.cc:2243] T 5cb1760bd0ba436eb7077c60542c0a45 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.493995 25293 raft_consensus.cc:2272] T 5cb1760bd0ba436eb7077c60542c0a45 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:12.495602  6048 consensus_peers.cc:597] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.496763 25293 tablet_replica.cc:333] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.497398 25293 raft_consensus.cc:2243] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.497851 25293 raft_consensus.cc:2272] T 7ba593a994ff44d7866a70004fd0a946 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.500069 25293 tablet_replica.cc:333] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.500617 25293 raft_consensus.cc:2243] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.501458 25293 raft_consensus.cc:2272] T cd00b832aafb491387eee88b954ff5df P 26615d25670745d38490e2d6da247d9e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.503685 25293 tablet_replica.cc:333] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.504268 25293 raft_consensus.cc:2243] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.505095 25293 raft_consensus.cc:2272] T 687e45fe6f3444c794271e801c21280d P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.507300 25293 tablet_replica.cc:333] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.507820 25293 raft_consensus.cc:2243] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.508270 25293 raft_consensus.cc:2272] T 62a474468455492f992eb8dfefad0ca2 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.510474 25293 tablet_replica.cc:333] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.511096 25293 raft_consensus.cc:2243] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.511617 25293 raft_consensus.cc:2272] T f35395bd69ad41f0b37fd3edca49777c P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.513827 25293 tablet_replica.cc:333] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.514531 25293 raft_consensus.cc:2243] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.515056 25293 raft_consensus.cc:2272] T 2c20504b20bf4686afff8a8417bdc035 P 26615d25670745d38490e2d6da247d9e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.517308 25293 tablet_replica.cc:333] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.517900 25293 raft_consensus.cc:2243] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.518435 25293 raft_consensus.cc:2272] T 32e2e4b0423a493e8f0d323065688bd1 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.520539 25293 tablet_replica.cc:333] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.521205 25293 raft_consensus.cc:2243] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.521705 25293 raft_consensus.cc:2272] T 6500f59123914ed198a39756117b4110 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.523885 25293 tablet_replica.cc:333] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.524482 25293 raft_consensus.cc:2243] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.524976 25293 raft_consensus.cc:2272] T 1e05435b58ec4a7ca6d7ea02368e5dcf P 26615d25670745d38490e2d6da247d9e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.527227 25293 tablet_replica.cc:333] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.527840 25293 raft_consensus.cc:2243] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.528342 25293 raft_consensus.cc:2272] T 0484fe261cb3459cb6a2f532f88c0845 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.530673 25293 tablet_replica.cc:333] T 45528a8d878d46d89244614343fc6e90 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.531219 25293 raft_consensus.cc:2243] T 45528a8d878d46d89244614343fc6e90 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.531673 25293 raft_consensus.cc:2272] T 45528a8d878d46d89244614343fc6e90 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.533660 25293 tablet_replica.cc:333] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.534247 25293 raft_consensus.cc:2243] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.535153 25293 raft_consensus.cc:2272] T 171e5dfe30b74c94b9753cf4c647695f P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.538116 25293 tablet_replica.cc:333] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.540238 25293 raft_consensus.cc:2243] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.541574 25293 raft_consensus.cc:2272] T 8bde6283aae54cca934953a54d9f7483 P 26615d25670745d38490e2d6da247d9e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.544332 25293 tablet_replica.cc:333] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.544968 25293 raft_consensus.cc:2243] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.545902 25293 raft_consensus.cc:2272] T 41f23027ce3e4c149ba8309105929682 P 26615d25670745d38490e2d6da247d9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.548590 25293 tablet_replica.cc:333] T c9a66f01ced34c71b061ec163494f2b6 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.549254 25293 raft_consensus.cc:2243] T c9a66f01ced34c71b061ec163494f2b6 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.549817 25293 raft_consensus.cc:2272] T c9a66f01ced34c71b061ec163494f2b6 P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.552135 25293 tablet_replica.cc:333] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.552688 25293 raft_consensus.cc:2243] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.553630 25293 raft_consensus.cc:2272] T f8800c8a47a0449783d57a6275b2f677 P 26615d25670745d38490e2d6da247d9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.556120 25293 tablet_replica.cc:333] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e: stopping tablet replica
I20260709 12:16:12.556721 25293 raft_consensus.cc:2243] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.557240 25293 raft_consensus.cc:2272] T 42fdfcec3d9049a2a38158457d409feb P 26615d25670745d38490e2d6da247d9e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:12.589591  5974 consensus_peers.cc:597] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:12.611241  5974 consensus_peers.cc:597] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.705871 25293 tablet_server.cc:196] TabletServer@127.24.179.66:0 shutdown complete.
W20260709 12:16:12.740579  6048 consensus_peers.cc:597] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:33793: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:12.757138  5974 consensus_peers.cc:597] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:33793: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:12.762135  6048 consensus_peers.cc:597] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:33793: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.813839 25293 tablet_server.cc:179] TabletServer@127.24.179.67:0 shutting down...
W20260709 12:16:12.828315  6048 consensus_peers.cc:597] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:33793: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:12.835279  6048 consensus_peers.cc:597] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb -> Peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Couldn't send request to peer 26615d25670745d38490e2d6da247d9e. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:33793: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:12.843722  6047 consensus_peers.cc:597] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb -> Peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Couldn't send request to peer e29106aa83aa4eebb9b87d6745825a27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:12.866983  6047 consensus_peers.cc:597] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Couldn't send request to peer e29106aa83aa4eebb9b87d6745825a27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.882125 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:12.884052 25293 tablet_replica.cc:333] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.885118 25293 raft_consensus.cc:2243] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.886134 25293 raft_consensus.cc:2272] T 713888d225a047099a38dc8257276146 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.888852 25293 tablet_replica.cc:333] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.889765 25293 raft_consensus.cc:2243] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.890249 25293 raft_consensus.cc:2272] T 2e4c5dd41465429eab21af474b88bc05 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.892480 25293 tablet_replica.cc:333] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.893194 25293 raft_consensus.cc:2243] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.893739 25293 raft_consensus.cc:2272] T 33adcece08484ff79fd8711ef5dfd78c P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.895949 25293 tablet_replica.cc:333] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.896575 25293 raft_consensus.cc:2243] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.897037 25293 raft_consensus.cc:2272] T 6a300304455c4851b24de418128a28d0 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.899138 25293 tablet_replica.cc:333] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.899739 25293 raft_consensus.cc:2243] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.900211 25293 raft_consensus.cc:2272] T 4ec4d35ac70348cb95a01355320f5686 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.902469 25293 tablet_replica.cc:333] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.903113 25293 raft_consensus.cc:2243] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.903661 25293 raft_consensus.cc:2272] T c3cdb9438c4a44489be534e4c1c147b5 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.905922 25293 tablet_replica.cc:333] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.906611 25293 raft_consensus.cc:2243] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.907449 25293 raft_consensus.cc:2272] T aa43bf33a33b443ba5cf0cdcb741f5fa P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.909560 25293 tablet_replica.cc:333] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.910156 25293 raft_consensus.cc:2243] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.910662 25293 raft_consensus.cc:2272] T a88edbe785c84f7fb5720879c30d6477 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.912678 25293 tablet_replica.cc:333] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.913246 25293 raft_consensus.cc:2243] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.913712 25293 raft_consensus.cc:2272] T 3a260b81828b4baab927a2d3f2253be4 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.915800 25293 tablet_replica.cc:333] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.916430 25293 raft_consensus.cc:2243] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.917968 25293 raft_consensus.cc:2272] T a16996642a1b4752b788da1836791f3c P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.920284 25293 tablet_replica.cc:333] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.921108 25293 raft_consensus.cc:2243] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.922287 25293 raft_consensus.cc:2272] T d852dc979f7843dcbf8477fc409c2c68 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.925172 25293 tablet_replica.cc:333] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.925980 25293 raft_consensus.cc:2243] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.926604 25293 raft_consensus.cc:2272] T b081fa5436f34e5e9e477b502f689461 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.929591 25293 tablet_replica.cc:333] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.930438 25293 raft_consensus.cc:2243] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.931524 25293 raft_consensus.cc:2272] T 82ede3276c3746638e321c76e4794c86 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.933983 25293 tablet_replica.cc:333] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.934669 25293 raft_consensus.cc:2243] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.935559 25293 raft_consensus.cc:2272] T b75d901511f94357a67c07612cf07d1a P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.937858 25293 tablet_replica.cc:333] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.938855 25293 raft_consensus.cc:2243] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.939458 25293 raft_consensus.cc:2272] T 41f23027ce3e4c149ba8309105929682 P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.941923 25293 tablet_replica.cc:333] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.942653 25293 raft_consensus.cc:2243] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.943173 25293 raft_consensus.cc:2272] T 525a431d53e142a8b9afb97f02fa94bb P e29106aa83aa4eebb9b87d6745825a27 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.945509 25293 tablet_replica.cc:333] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.946353 25293 raft_consensus.cc:2243] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.947391 25293 raft_consensus.cc:2272] T a7299ddfb5eb4240b757da7c444170c9 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.950315 25293 tablet_replica.cc:333] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.951188 25293 raft_consensus.cc:2243] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.951774 25293 raft_consensus.cc:2272] T b14d71c733514ec9bc7ddb9d3b7cd80d P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.954517 25293 tablet_replica.cc:333] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.955112 25293 raft_consensus.cc:2243] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.955679 25293 raft_consensus.cc:2272] T db31c56e0c1b4701bc388c4d3edf535a P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.957954 25293 tablet_replica.cc:333] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.958830 25293 raft_consensus.cc:2243] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.959295 25293 raft_consensus.cc:2272] T e18f65fb1b1f4544b9e6a96399e38089 P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.961761 25293 tablet_replica.cc:333] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.962530 25293 raft_consensus.cc:2243] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.963042 25293 raft_consensus.cc:2272] T e2dad9466c8e40558116511df4c6330e P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.965372 25293 tablet_replica.cc:333] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.966068 25293 raft_consensus.cc:2243] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.966667 25293 raft_consensus.cc:2272] T 859eab84f0fb443ba4bd2cccf81cbe3e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.969024  7243 raft_consensus.cc:493] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:16:12.969841 25293 tablet_replica.cc:333] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.969790  7243 raft_consensus.cc:515] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:12.971000 25293 raft_consensus.cc:2243] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.971653 25293 raft_consensus.cc:2272] T 214f52126a2c4bc59473ee7461e4a044 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.973403  7243 leader_election.cc:290] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:16:12.975101 25293 tablet_replica.cc:333] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.976056 25293 raft_consensus.cc:2243] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.976689 25293 raft_consensus.cc:2272] T cd00b832aafb491387eee88b954ff5df P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.977519  7279 raft_consensus.cc:493] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:16:12.978060  7279 raft_consensus.cc:515] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } } peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } }
I20260709 12:16:12.979909 25293 tablet_replica.cc:333] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
W20260709 12:16:12.979805  6049 leader_election.cc:336] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:16:12.980888  7279 leader_election.cc:290] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:16:12.980973 25293 raft_consensus.cc:2243] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.983027 25293 raft_consensus.cc:2272] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:12.983949  6047 leader_election.cc:336] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:16:12.984433  6047 leader_election.cc:304] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:16:12.985100  7243 raft_consensus.cc:2749] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:16:12.985534  5974 leader_election.cc:336] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Network error: Client connection negotiation failed: client connection to 127.24.179.66:33793: connect: Connection refused (error 111)
I20260709 12:16:12.986196 25293 tablet_replica.cc:333] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.987044 25293 raft_consensus.cc:2243] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:12.987711 25293 raft_consensus.cc:2272] T 972a71bd13ef4022b6966d1287868dc4 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:12.988039  5975 leader_election.cc:336] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:16:12.988610  5975 leader_election.cc:304] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e29106aa83aa4eebb9b87d6745825a27; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
W20260709 12:16:12.989277  5975 raft_consensus.cc:2686] T 2c61591bbcaf43839af1cc8373f98c7e P e29106aa83aa4eebb9b87d6745825a27: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:16:12.990737 25293 tablet_replica.cc:333] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
W20260709 12:16:12.990939  6047 consensus_peers.cc:597] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Couldn't send request to peer e29106aa83aa4eebb9b87d6745825a27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:12.991780 25293 raft_consensus.cc:2243] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.992861 25293 raft_consensus.cc:2272] T 1df660011133455e8ede132d5d56c48f P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.995536 25293 tablet_replica.cc:333] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.996124 25293 raft_consensus.cc:2243] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:12.996961 25293 raft_consensus.cc:2272] T a6e906733ca34216bf4664d81c7b19b2 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:12.999107 25293 tablet_replica.cc:333] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:12.999660 25293 raft_consensus.cc:2243] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.000087 25293 raft_consensus.cc:2272] T 873d3215e6ba4214a3910fa16e0fd62a P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.002195 25293 tablet_replica.cc:333] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:13.002816 25293 raft_consensus.cc:2243] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.003719 25293 raft_consensus.cc:2272] T f0199e88be05480094c047ed4a193589 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.006503 25293 tablet_replica.cc:333] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:13.007280 25293 raft_consensus.cc:2243] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.007843 25293 raft_consensus.cc:2272] T 2c20504b20bf4686afff8a8417bdc035 P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.010511 25293 tablet_replica.cc:333] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:13.011282 25293 raft_consensus.cc:2243] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.011830 25293 raft_consensus.cc:2272] T 6cc7520eb74c4882b7e36fda0f66ca0e P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.014695 25293 tablet_replica.cc:333] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:13.015556 25293 raft_consensus.cc:2243] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.016189 25293 raft_consensus.cc:2272] T 27058558598c4834804424f2de3c1cea P e29106aa83aa4eebb9b87d6745825a27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.018950 25293 tablet_replica.cc:333] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:13.019734 25293 raft_consensus.cc:2243] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.020555  7243 raft_consensus.cc:493] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:16:13.020838 25293 raft_consensus.cc:2272] T 33d81a90a1a04c558e7d4b2e844d22ce P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.021183  7243 raft_consensus.cc:515] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:13.024122 25293 tablet_replica.cc:333] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:13.024736  7243 leader_election.cc:290] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:16:13.025094 25293 raft_consensus.cc:2243] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:16:13.024207  6047 consensus_peers.cc:597] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb -> Peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Couldn't send request to peer e29106aa83aa4eebb9b87d6745825a27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:13.025930 25293 raft_consensus.cc:2272] T 62a474468455492f992eb8dfefad0ca2 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.029253 25293 tablet_replica.cc:333] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
W20260709 12:16:13.029402  6047 leader_election.cc:336] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:16:13.030095  6049 leader_election.cc:336] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:16:13.030141 25293 raft_consensus.cc:2243] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.030685  6049 leader_election.cc:304] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:16:13.031081 25293 raft_consensus.cc:2272] T 8bde6283aae54cca934953a54d9f7483 P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.031358  7243 raft_consensus.cc:2749] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:13.033803 25293 tablet_replica.cc:333] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:13.034511 25293 raft_consensus.cc:2243] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.034976 25293 raft_consensus.cc:2272] T 171e5dfe30b74c94b9753cf4c647695f P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.037186 25293 tablet_replica.cc:333] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:13.037729 25293 raft_consensus.cc:2243] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.038164 25293 raft_consensus.cc:2272] T 1e05435b58ec4a7ca6d7ea02368e5dcf P e29106aa83aa4eebb9b87d6745825a27 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.040308 25293 tablet_replica.cc:333] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:13.040839 25293 raft_consensus.cc:2243] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.041671 25293 raft_consensus.cc:2272] T b0ace1a67c98413c886c1ce2cfcd66af P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.042096  7243 raft_consensus.cc:493] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:16:13.042750  7243 raft_consensus.cc:515] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:16:13.044312 25293 tablet_replica.cc:333] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:13.044770  7243 leader_election.cc:290] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:16:13.045194 25293 raft_consensus.cc:2243] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.046381 25293 raft_consensus.cc:2272] T c9a66f01ced34c71b061ec163494f2b6 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:13.048830  6049 leader_election.cc:336] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:16:13.049510  6048 leader_election.cc:336] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Network error: Client connection negotiation failed: client connection to 127.24.179.66:33793: connect: Connection refused (error 111)
I20260709 12:16:13.049659 25293 tablet_replica.cc:333] T 5cb1760bd0ba436eb7077c60542c0a45 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:13.049898  6048 leader_election.cc:304] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:16:13.050459 25293 raft_consensus.cc:2243] T 5cb1760bd0ba436eb7077c60542c0a45 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.050623  7243 raft_consensus.cc:2749] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:13.051098 25293 raft_consensus.cc:2272] T 5cb1760bd0ba436eb7077c60542c0a45 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.053453 25293 tablet_replica.cc:333] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:13.054051 25293 raft_consensus.cc:2243] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.054967 25293 raft_consensus.cc:2272] T 7ba593a994ff44d7866a70004fd0a946 P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.056998 25293 tablet_replica.cc:333] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:13.057541 25293 raft_consensus.cc:2243] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.058032 25293 raft_consensus.cc:2272] T f8800c8a47a0449783d57a6275b2f677 P e29106aa83aa4eebb9b87d6745825a27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.060214 25293 tablet_replica.cc:333] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27: stopping tablet replica
I20260709 12:16:13.060827 25293 raft_consensus.cc:2243] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.061601 25293 raft_consensus.cc:2272] T 42fdfcec3d9049a2a38158457d409feb P e29106aa83aa4eebb9b87d6745825a27 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:13.076916  6047 consensus_peers.cc:597] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Couldn't send request to peer e29106aa83aa4eebb9b87d6745825a27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:13.079648  7281 raft_consensus.cc:493] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:16:13.080351  7281 raft_consensus.cc:515] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:13.083642  7281 leader_election.cc:290] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
W20260709 12:16:13.085493  6047 leader_election.cc:336] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:16:13.087116  6049 leader_election.cc:336] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:16:13.087577  6049 leader_election.cc:304] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:16:13.088327  7281 raft_consensus.cc:2749] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:16:13.121115  6047 consensus_peers.cc:597] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Couldn't send request to peer e29106aa83aa4eebb9b87d6745825a27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:13.127426  7281 raft_consensus.cc:493] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:16:13.128443  7281 raft_consensus.cc:515] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
W20260709 12:16:13.130949  6047 connection.cc:573] client connection to 127.24.179.67:34139 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 12:16:13.131320  7281 leader_election.cc:290] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
W20260709 12:16:13.135237  6047 leader_election.cc:336] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Network error: Client connection negotiation failed: client connection to 127.24.179.67:34139: connect: Connection refused (error 111)
W20260709 12:16:13.138808  6049 leader_election.cc:336] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:16:13.139212  6049 leader_election.cc:304] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:16:13.139441 25293 tablet_server.cc:196] TabletServer@127.24.179.67:0 shutdown complete.
I20260709 12:16:13.139839  7281 raft_consensus.cc:2749] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:16:13.152474  6047 consensus_peers.cc:597] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb -> Peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Couldn't send request to peer e29106aa83aa4eebb9b87d6745825a27. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.67:34139: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:13.189596  7281 raft_consensus.cc:493] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:16:13.190243  7281 raft_consensus.cc:515] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:13.196125  7283 raft_consensus.cc:493] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:16:13.196754  7283 raft_consensus.cc:515] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
W20260709 12:16:13.199155  6049 leader_election.cc:336] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:16:13.199405  7283 leader_election.cc:290] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
I20260709 12:16:13.199553  7281 leader_election.cc:290] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
W20260709 12:16:13.203402  6047 leader_election.cc:336] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Network error: Client connection negotiation failed: client connection to 127.24.179.67:34139: connect: Connection refused (error 111)
I20260709 12:16:13.203997  6047 leader_election.cc:304] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:16:13.205027  7281 raft_consensus.cc:2749] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:16:13.206331  6049 leader_election.cc:336] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:16:13.208303  6048 leader_election.cc:336] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Network error: Client connection negotiation failed: client connection to 127.24.179.66:33793: connect: Connection refused (error 111)
I20260709 12:16:13.208792  6048 leader_election.cc:304] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:16:13.209682  7281 raft_consensus.cc:2749] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:13.223804 25293 tablet_server.cc:179] TabletServer@127.24.179.68:0 shutting down...
I20260709 12:16:13.254875  7283 raft_consensus.cc:493] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:16:13.255676  7283 raft_consensus.cc:515] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } } peers { permanent_uuid: "26615d25670745d38490e2d6da247d9e" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 33793 } }
I20260709 12:16:13.257893  7283 leader_election.cc:290] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243), 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793)
W20260709 12:16:13.262722  6049 leader_election.cc:336] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
W20260709 12:16:13.263182  6048 leader_election.cc:336] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 26615d25670745d38490e2d6da247d9e (127.24.179.66:33793): Network error: Client connection negotiation failed: client connection to 127.24.179.66:33793: connect: Connection refused (error 111)
I20260709 12:16:13.263644  6048 leader_election.cc:304] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 26615d25670745d38490e2d6da247d9e, 58ed30c66c784e06ad64609f8d1b4c43
I20260709 12:16:13.264926  7283 raft_consensus.cc:2749] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:13.274757 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:13.275669 25293 tablet_replica.cc:333] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.276391 25293 raft_consensus.cc:2243] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.277333 25293 raft_consensus.cc:2272] T 2e4c5dd41465429eab21af474b88bc05 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.279668 25293 tablet_replica.cc:333] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.280356 25293 raft_consensus.cc:2243] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.280859 25293 raft_consensus.cc:2272] T f5d9e90868894fa78e9f94ca432dc703 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.283080 25293 tablet_replica.cc:333] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.283715 25293 raft_consensus.cc:2243] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.284171 25293 raft_consensus.cc:2272] T b0ace1a67c98413c886c1ce2cfcd66af P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.286240 25293 tablet_replica.cc:333] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.286898 25293 raft_consensus.cc:2243] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.287352 25293 raft_consensus.cc:2272] T 33adcece08484ff79fd8711ef5dfd78c P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.289326 25293 tablet_replica.cc:333] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.289913 25293 raft_consensus.cc:2243] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.290843 25293 raft_consensus.cc:2272] T 219ee6e67c3a4adf9dd72198036646bc P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.293874 25293 tablet_replica.cc:333] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.294656 25293 raft_consensus.cc:2243] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.295385 25293 raft_consensus.cc:2272] T c3cdb9438c4a44489be534e4c1c147b5 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.297873 25293 tablet_replica.cc:333] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.298795 25293 raft_consensus.cc:2243] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.299799 25293 raft_consensus.cc:2272] T 5cb1760bd0ba436eb7077c60542c0a45 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.302788 25293 tablet_replica.cc:333] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.303437 25293 raft_consensus.cc:2243] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.304262 25293 raft_consensus.cc:2272] T 6500f59123914ed198a39756117b4110 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.306496 25293 tablet_replica.cc:333] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.307102 25293 raft_consensus.cc:2243] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.307982 25293 raft_consensus.cc:2272] T 4ec4d35ac70348cb95a01355320f5686 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.310184 25293 tablet_replica.cc:333] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.310905 25293 raft_consensus.cc:2243] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.311403 25293 raft_consensus.cc:2272] T 626f502ef9684f1b8a6c29e9010f9ed5 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.313555 25293 tablet_replica.cc:333] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.314141 25293 raft_consensus.cc:2243] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.314702 25293 raft_consensus.cc:2272] T d792c0dd53aa459399c3adf5d4f17f58 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.317095 25293 tablet_replica.cc:333] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.317763 25293 raft_consensus.cc:2243] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.318236 25293 raft_consensus.cc:2272] T b081fa5436f34e5e9e477b502f689461 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.319646  7283 raft_consensus.cc:493] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ed30c66c784e06ad64609f8d1b4c43)
I20260709 12:16:13.320106  7283 raft_consensus.cc:515] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e29106aa83aa4eebb9b87d6745825a27" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 34139 } } peers { permanent_uuid: "36dfe581d09b46f6a9bfe678170e71cb" member_type: VOTER last_known_addr { host: "127.24.179.68" port: 44517 } } peers { permanent_uuid: "58ed30c66c784e06ad64609f8d1b4c43" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 38243 } }
I20260709 12:16:13.320634 25293 tablet_replica.cc:333] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.321352 25293 raft_consensus.cc:2243] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.321874 25293 raft_consensus.cc:2272] T d852dc979f7843dcbf8477fc409c2c68 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.322091  7283 leader_election.cc:290] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139), 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243)
I20260709 12:16:13.325038 25293 tablet_replica.cc:333] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.326356 25293 raft_consensus.cc:2243] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:16:13.326417  6047 leader_election.cc:336] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e29106aa83aa4eebb9b87d6745825a27 (127.24.179.67:34139): Network error: Client connection negotiation failed: client connection to 127.24.179.67:34139: connect: Connection refused (error 111)
I20260709 12:16:13.327111 25293 raft_consensus.cc:2272] T a12649b3d49a4a309d961106ba152892 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:13.327172  6049 leader_election.cc:336] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 58ed30c66c784e06ad64609f8d1b4c43 (127.24.179.65:38243): Network error: Client connection negotiation failed: client connection to 127.24.179.65:38243: connect: Connection refused (error 111)
I20260709 12:16:13.327670  6049 leader_election.cc:304] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36dfe581d09b46f6a9bfe678170e71cb; no voters: 58ed30c66c784e06ad64609f8d1b4c43, e29106aa83aa4eebb9b87d6745825a27
I20260709 12:16:13.328306  7283 raft_consensus.cc:2749] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:13.329985 25293 tablet_replica.cc:333] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.330905 25293 raft_consensus.cc:2243] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.331836 25293 raft_consensus.cc:2272] T 353bf2c0ce2c412e9ca171f2bb150f91 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.334787 25293 tablet_replica.cc:333] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.335459 25293 raft_consensus.cc:2243] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.336066 25293 raft_consensus.cc:2272] T b14d71c733514ec9bc7ddb9d3b7cd80d P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.339215 25293 tablet_replica.cc:333] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.340123 25293 raft_consensus.cc:2243] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.340580 25293 raft_consensus.cc:2272] T 525a431d53e142a8b9afb97f02fa94bb P 36dfe581d09b46f6a9bfe678170e71cb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.342841 25293 tablet_replica.cc:333] T 41f23027ce3e4c149ba8309105929682 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.343384 25293 raft_consensus.cc:2243] T 41f23027ce3e4c149ba8309105929682 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.343904 25293 raft_consensus.cc:2272] T 41f23027ce3e4c149ba8309105929682 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.346957 25293 tablet_replica.cc:333] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.347858 25293 raft_consensus.cc:2243] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.348456 25293 raft_consensus.cc:2272] T f8800c8a47a0449783d57a6275b2f677 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.350783 25293 tablet_replica.cc:333] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.351423 25293 raft_consensus.cc:2243] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.352308 25293 raft_consensus.cc:2272] T 6cc7520eb74c4882b7e36fda0f66ca0e P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.354547 25293 tablet_replica.cc:333] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.355157 25293 raft_consensus.cc:2243] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.355643 25293 raft_consensus.cc:2272] T 27058558598c4834804424f2de3c1cea P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.357869 25293 tablet_replica.cc:333] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.358518 25293 raft_consensus.cc:2243] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.359103 25293 raft_consensus.cc:2272] T a7299ddfb5eb4240b757da7c444170c9 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.362053 25293 tablet_replica.cc:333] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.362932 25293 raft_consensus.cc:2243] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.363555 25293 raft_consensus.cc:2272] T aa43bf33a33b443ba5cf0cdcb741f5fa P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.366135 25293 tablet_replica.cc:333] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.366802 25293 raft_consensus.cc:2243] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.367286 25293 raft_consensus.cc:2272] T d48d13e87f1d4964bb74ba350c2e2df5 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.369346 25293 tablet_replica.cc:333] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.369961 25293 raft_consensus.cc:2243] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.370483 25293 raft_consensus.cc:2272] T 82ede3276c3746638e321c76e4794c86 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.372540 25293 tablet_replica.cc:333] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.373116 25293 raft_consensus.cc:2243] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.373579 25293 raft_consensus.cc:2272] T b75d901511f94357a67c07612cf07d1a P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.375831 25293 tablet_replica.cc:333] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.376418 25293 raft_consensus.cc:2243] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.377269 25293 raft_consensus.cc:2272] T 32e2e4b0423a493e8f0d323065688bd1 P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.379392 25293 tablet_replica.cc:333] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.379981 25293 raft_consensus.cc:2243] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.380846 25293 raft_consensus.cc:2272] T 0484fe261cb3459cb6a2f532f88c0845 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.383275 25293 tablet_replica.cc:333] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.383888 25293 raft_consensus.cc:2243] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.384709 25293 raft_consensus.cc:2272] T f35395bd69ad41f0b37fd3edca49777c P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.387035 25293 tablet_replica.cc:333] T 33d81a90a1a04c558e7d4b2e844d22ce P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.387665 25293 raft_consensus.cc:2243] T 33d81a90a1a04c558e7d4b2e844d22ce P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.388150 25293 raft_consensus.cc:2272] T 33d81a90a1a04c558e7d4b2e844d22ce P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.390304 25293 tablet_replica.cc:333] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.390946 25293 raft_consensus.cc:2243] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.391840 25293 raft_consensus.cc:2272] T 45528a8d878d46d89244614343fc6e90 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.394307 25293 tablet_replica.cc:333] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.394963 25293 raft_consensus.cc:2243] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.395458 25293 raft_consensus.cc:2272] T 171e5dfe30b74c94b9753cf4c647695f P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.397572 25293 tablet_replica.cc:333] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.398167 25293 raft_consensus.cc:2243] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.399080 25293 raft_consensus.cc:2272] T 2c20504b20bf4686afff8a8417bdc035 P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.401072 25293 tablet_replica.cc:333] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.401661 25293 raft_consensus.cc:2243] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.402218 25293 raft_consensus.cc:2272] T 8bde6283aae54cca934953a54d9f7483 P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.404469 25293 tablet_replica.cc:333] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.405062 25293 raft_consensus.cc:2243] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.405520 25293 raft_consensus.cc:2272] T 45a9878f315d4541b1bcbec3556ad32c P 36dfe581d09b46f6a9bfe678170e71cb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.407539 25293 tablet_replica.cc:333] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.408114 25293 raft_consensus.cc:2243] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.408960 25293 raft_consensus.cc:2272] T 873d3215e6ba4214a3910fa16e0fd62a P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.411192 25293 tablet_replica.cc:333] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.411774 25293 raft_consensus.cc:2243] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.412220 25293 raft_consensus.cc:2272] T 1df660011133455e8ede132d5d56c48f P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.414288 25293 tablet_replica.cc:333] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.414889 25293 raft_consensus.cc:2243] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.415338 25293 raft_consensus.cc:2272] T 859eab84f0fb443ba4bd2cccf81cbe3e P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.417407 25293 tablet_replica.cc:333] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.417979 25293 raft_consensus.cc:2243] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.418816 25293 raft_consensus.cc:2272] T 214f52126a2c4bc59473ee7461e4a044 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.420956 25293 tablet_replica.cc:333] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.421509 25293 raft_consensus.cc:2243] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.421993 25293 raft_consensus.cc:2272] T cd00b832aafb491387eee88b954ff5df P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.424045 25293 tablet_replica.cc:333] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.424615 25293 raft_consensus.cc:2243] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.425415 25293 raft_consensus.cc:2272] T 972a71bd13ef4022b6966d1287868dc4 P 36dfe581d09b46f6a9bfe678170e71cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.427485 25293 tablet_replica.cc:333] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.428036 25293 raft_consensus.cc:2243] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.428490 25293 raft_consensus.cc:2272] T 687e45fe6f3444c794271e801c21280d P 36dfe581d09b46f6a9bfe678170e71cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.430609 25293 tablet_replica.cc:333] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.431141 25293 raft_consensus.cc:2243] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.431540 25293 raft_consensus.cc:2272] T e18f65fb1b1f4544b9e6a96399e38089 P 36dfe581d09b46f6a9bfe678170e71cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.433531 25293 tablet_replica.cc:333] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb: stopping tablet replica
I20260709 12:16:13.433983 25293 raft_consensus.cc:2243] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:13.434350 25293 raft_consensus.cc:2272] T 29ee607f5bb24b4bab4cd993a2327277 P 36dfe581d09b46f6a9bfe678170e71cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.533782 25293 tablet_server.cc:196] TabletServer@127.24.179.68:0 shutdown complete.
I20260709 12:16:13.606693 25293 master.cc:562] Master@127.24.179.126:35651 shutting down...
I20260709 12:16:13.635442 25293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:13.636088 25293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:13.636384 25293 tablet_replica.cc:333] T 00000000000000000000000000000000 P 535313c9291745aeb35e608528f80060: stopping tablet replica
I20260709 12:16:13.659461 25293 master.cc:584] Master@127.24.179.126:35651 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (42796 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:16:13.760848 25293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.179.126:37135
I20260709 12:16:13.762168 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:13.768662  7285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:13.769582  7286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:13.770320  7288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:13.771190 25293 server_base.cc:1061] running on GCE node
I20260709 12:16:13.772541 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:13.772744 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:13.772853 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599373772842 us; error 0 us; skew 500 ppm
I20260709 12:16:13.773379 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:13.776180 25293 webserver.cc:533] Webserver started at http://127.24.179.126:40451/ using document root <none> and password file <none>
I20260709 12:16:13.776691 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:13.776856 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:13.777107 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:13.778369 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/master-0-root/instance:
uuid: "fffa0e02d57f46e58713a0e7e331ffa6"
format_stamp: "Formatted at 2026-07-09 12:16:13 on dist-test-slave-tjfs"
I20260709 12:16:13.784082 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:16:13.788376  7293 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:13.789252 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:16:13.789669 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/master-0-root
uuid: "fffa0e02d57f46e58713a0e7e331ffa6"
format_stamp: "Formatted at 2026-07-09 12:16:13 on dist-test-slave-tjfs"
I20260709 12:16:13.790000 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:13.802065 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:13.803629 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:13.847852 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.126:37135
I20260709 12:16:13.847996  7344 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.126:37135 every 8 connection(s)
I20260709 12:16:13.852700  7345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:13.865238  7345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6: Bootstrap starting.
I20260709 12:16:13.870920  7345 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:13.875905  7345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6: No bootstrap required, opened a new log
I20260709 12:16:13.878535  7345 raft_consensus.cc:359] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fffa0e02d57f46e58713a0e7e331ffa6" member_type: VOTER }
I20260709 12:16:13.878963  7345 raft_consensus.cc:385] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:13.879253  7345 raft_consensus.cc:740] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fffa0e02d57f46e58713a0e7e331ffa6, State: Initialized, Role: FOLLOWER
I20260709 12:16:13.879990  7345 consensus_queue.cc:260] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fffa0e02d57f46e58713a0e7e331ffa6" member_type: VOTER }
I20260709 12:16:13.880491  7345 raft_consensus.cc:399] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:13.880710  7345 raft_consensus.cc:493] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:13.881014  7345 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:13.886346  7345 raft_consensus.cc:515] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fffa0e02d57f46e58713a0e7e331ffa6" member_type: VOTER }
I20260709 12:16:13.887002  7345 leader_election.cc:304] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fffa0e02d57f46e58713a0e7e331ffa6; no voters: 
I20260709 12:16:13.888334  7345 leader_election.cc:290] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:13.888835  7348 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:13.890427  7348 raft_consensus.cc:697] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6 [term 1 LEADER]: Becoming Leader. State: Replica: fffa0e02d57f46e58713a0e7e331ffa6, State: Running, Role: LEADER
I20260709 12:16:13.891279  7348 consensus_queue.cc:237] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fffa0e02d57f46e58713a0e7e331ffa6" member_type: VOTER }
I20260709 12:16:13.891651  7345 sys_catalog.cc:565] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:13.899075  7349 sys_catalog.cc:455] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fffa0e02d57f46e58713a0e7e331ffa6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fffa0e02d57f46e58713a0e7e331ffa6" member_type: VOTER } }
I20260709 12:16:13.897426  7350 sys_catalog.cc:455] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fffa0e02d57f46e58713a0e7e331ffa6. Latest consensus state: current_term: 1 leader_uuid: "fffa0e02d57f46e58713a0e7e331ffa6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fffa0e02d57f46e58713a0e7e331ffa6" member_type: VOTER } }
I20260709 12:16:13.899714  7349 sys_catalog.cc:458] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:13.899931  7350 sys_catalog.cc:458] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:13.902041  7355 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:13.907747  7355 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:13.911974 25293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:13.917285  7355 catalog_manager.cc:1383] Generated new cluster ID: 6232ccdb9b574e2fae56ce67e80e346e
I20260709 12:16:13.917583  7355 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:13.938516  7355 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:13.939929  7355 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:13.963002  7355 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6: Generated new TSK 0
I20260709 12:16:13.963649  7355 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:13.978725 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:13.985567  7366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:13.986707  7367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:13.988662 25293 server_base.cc:1061] running on GCE node
W20260709 12:16:13.988636  7369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:13.990207 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:13.990485 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:13.990633 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599373990620 us; error 0 us; skew 500 ppm
I20260709 12:16:13.991181 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:13.994100 25293 webserver.cc:533] Webserver started at http://127.24.179.65:42113/ using document root <none> and password file <none>
I20260709 12:16:13.994730 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:13.994946 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:13.995254 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:13.996564 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/ts-0-root/instance:
uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
format_stamp: "Formatted at 2026-07-09 12:16:13 on dist-test-slave-tjfs"
I20260709 12:16:14.001641 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:16:14.005852  7374 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:14.006937 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:16:14.007305 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/ts-0-root
uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
format_stamp: "Formatted at 2026-07-09 12:16:13 on dist-test-slave-tjfs"
I20260709 12:16:14.007630 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:14.021903 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:14.023307 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:14.024895 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:14.027462 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:14.027702 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:14.027953 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:14.028148 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:14.072275 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.65:41773
I20260709 12:16:14.072383  7436 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.65:41773 every 8 connection(s)
I20260709 12:16:14.077929 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:14.085729  7441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:14.089435  7442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:14.091153 25293 server_base.cc:1061] running on GCE node
W20260709 12:16:14.091499  7444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:14.093375 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:14.093822 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:14.094147 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599374094125 us; error 0 us; skew 500 ppm
I20260709 12:16:14.094967 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:14.095530  7437 heartbeater.cc:344] Connected to a master server at 127.24.179.126:37135
I20260709 12:16:14.096093  7437 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:14.097088  7437 heartbeater.cc:507] Master 127.24.179.126:37135 requested a full tablet report, sending...
I20260709 12:16:14.097934 25293 webserver.cc:533] Webserver started at http://127.24.179.66:38073/ using document root <none> and password file <none>
I20260709 12:16:14.098713 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:14.098927 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:14.099258 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:14.099826  7310 ts_manager.cc:194] Registered new tserver with Master: ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773)
I20260709 12:16:14.101035 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/ts-1-root/instance:
uuid: "86d91c5ff0bd4582bf410ce99edeb328"
format_stamp: "Formatted at 2026-07-09 12:16:14 on dist-test-slave-tjfs"
I20260709 12:16:14.102631  7310 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60536
I20260709 12:16:14.107268 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:16:14.111377  7449 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:14.112258 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:16:14.112560 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/ts-1-root
uuid: "86d91c5ff0bd4582bf410ce99edeb328"
format_stamp: "Formatted at 2026-07-09 12:16:14 on dist-test-slave-tjfs"
I20260709 12:16:14.112841 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:14.131259 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:14.132556 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:14.134083 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:14.136536 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:14.136761 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:14.137046 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:14.137214 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:14.180117 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.66:42345
I20260709 12:16:14.180227  7511 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.66:42345 every 8 connection(s)
I20260709 12:16:14.185434 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:14.193010  7515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:14.193298  7516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:14.197584  7518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:14.197623 25293 server_base.cc:1061] running on GCE node
I20260709 12:16:14.199270 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:14.199600 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:14.199821 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599374199803 us; error 0 us; skew 500 ppm
I20260709 12:16:14.200189  7512 heartbeater.cc:344] Connected to a master server at 127.24.179.126:37135
I20260709 12:16:14.200534 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:14.200645  7512 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:14.201532  7512 heartbeater.cc:507] Master 127.24.179.126:37135 requested a full tablet report, sending...
I20260709 12:16:14.203681 25293 webserver.cc:533] Webserver started at http://127.24.179.67:44393/ using document root <none> and password file <none>
I20260709 12:16:14.204242  7310 ts_manager.cc:194] Registered new tserver with Master: 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:14.204478 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:14.204770 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:14.205096 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:14.206368  7310 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60548
I20260709 12:16:14.206837 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/ts-2-root/instance:
uuid: "1cf436d0350e46ebaebd98718017cc0a"
format_stamp: "Formatted at 2026-07-09 12:16:14 on dist-test-slave-tjfs"
I20260709 12:16:14.212535 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.001s
I20260709 12:16:14.216362  7523 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:14.217523 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:16:14.217875 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/ts-2-root
uuid: "1cf436d0350e46ebaebd98718017cc0a"
format_stamp: "Formatted at 2026-07-09 12:16:14 on dist-test-slave-tjfs"
I20260709 12:16:14.218182 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:14.245114 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:14.246515 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:14.248106 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:14.250634 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:14.250844 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:14.251150 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:14.251317 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:14.296669 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.67:33233
I20260709 12:16:14.296795  7585 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.67:33233 every 8 connection(s)
I20260709 12:16:14.312498  7586 heartbeater.cc:344] Connected to a master server at 127.24.179.126:37135
I20260709 12:16:14.313020  7586 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:14.313829  7586 heartbeater.cc:507] Master 127.24.179.126:37135 requested a full tablet report, sending...
I20260709 12:16:14.316438  7310 ts_manager.cc:194] Registered new tserver with Master: 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:14.317533 25293 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017380096s
I20260709 12:16:14.318256  7310 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60562
I20260709 12:16:14.346944  7310 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60576:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:14.350023  7310 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:14.428368  7402 tablet_service.cc:1511] Processing CreateTablet for tablet e09606ff486a4308b404dea23791c522 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:16:14.430094  7402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e09606ff486a4308b404dea23791c522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.435640  7401 tablet_service.cc:1511] Processing CreateTablet for tablet 3a347ffd6e71445a8c01ccc22b42f064 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:16:14.436178  7399 tablet_service.cc:1511] Processing CreateTablet for tablet cf369cc1618a438b9ef3a38a5ba252e9 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:16:14.437340  7401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a347ffd6e71445a8c01ccc22b42f064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.438246  7399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf369cc1618a438b9ef3a38a5ba252e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.439555  7400 tablet_service.cc:1511] Processing CreateTablet for tablet ce96956ac94f4b18bc33fd50153efab8 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:16:14.441097  7400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce96956ac94f4b18bc33fd50153efab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.444640  7398 tablet_service.cc:1511] Processing CreateTablet for tablet 410149d03e2e411b9ad55a216ccee270 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:16:14.446337  7398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 410149d03e2e411b9ad55a216ccee270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.452425  7477 tablet_service.cc:1511] Processing CreateTablet for tablet e09606ff486a4308b404dea23791c522 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:16:14.454099  7477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e09606ff486a4308b404dea23791c522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.455588  7476 tablet_service.cc:1511] Processing CreateTablet for tablet 3a347ffd6e71445a8c01ccc22b42f064 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:16:14.460604  7474 tablet_service.cc:1511] Processing CreateTablet for tablet cf369cc1618a438b9ef3a38a5ba252e9 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:16:14.463923  7473 tablet_service.cc:1511] Processing CreateTablet for tablet 410149d03e2e411b9ad55a216ccee270 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:16:14.466702  7472 tablet_service.cc:1511] Processing CreateTablet for tablet 2f0cee7f7f014985974db72216d12e7a (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:16:14.458112  7475 tablet_service.cc:1511] Processing CreateTablet for tablet ce96956ac94f4b18bc33fd50153efab8 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:16:14.472437  7471 tablet_service.cc:1511] Processing CreateTablet for tablet 7e6b8b5e1a9a4100bfe8f0de30969e2d (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:16:14.476517  7470 tablet_service.cc:1511] Processing CreateTablet for tablet 0a329b17879e429e95bc6d32be006afb (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:16:14.481622  7470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a329b17879e429e95bc6d32be006afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.483593  7472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f0cee7f7f014985974db72216d12e7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.485544  7469 tablet_service.cc:1511] Processing CreateTablet for tablet 22b38bab9c6a4955a97108c436ff1bb6 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:16:14.487247  7469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b38bab9c6a4955a97108c436ff1bb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.488737  7476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a347ffd6e71445a8c01ccc22b42f064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.490291  7468 tablet_service.cc:1511] Processing CreateTablet for tablet f4d6e2ea81954f098f276b0ee1628d50 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:16:14.490985  7475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce96956ac94f4b18bc33fd50153efab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.491954  7468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d6e2ea81954f098f276b0ee1628d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.494133  7473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 410149d03e2e411b9ad55a216ccee270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.495222  7474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf369cc1618a438b9ef3a38a5ba252e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.498807  7471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e6b8b5e1a9a4100bfe8f0de30969e2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.511492  7400 tablet_service.cc:1511] Processing CreateTablet for tablet 2f0cee7f7f014985974db72216d12e7a (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:16:14.513130  7400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f0cee7f7f014985974db72216d12e7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.525791  7402 tablet_service.cc:1511] Processing CreateTablet for tablet 7e6b8b5e1a9a4100bfe8f0de30969e2d (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:16:14.526530  7397 tablet_service.cc:1511] Processing CreateTablet for tablet 0a329b17879e429e95bc6d32be006afb (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:16:14.527598  7402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e6b8b5e1a9a4100bfe8f0de30969e2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.528294  7397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a329b17879e429e95bc6d32be006afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.536813  7396 tablet_service.cc:1511] Processing CreateTablet for tablet 22b38bab9c6a4955a97108c436ff1bb6 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:16:14.538582  7396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b38bab9c6a4955a97108c436ff1bb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.564471  7551 tablet_service.cc:1511] Processing CreateTablet for tablet e09606ff486a4308b404dea23791c522 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:16:14.567023  7551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e09606ff486a4308b404dea23791c522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.571322  7601 tablet_bootstrap.cc:492] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap starting.
I20260709 12:16:14.575857  7550 tablet_service.cc:1511] Processing CreateTablet for tablet 3a347ffd6e71445a8c01ccc22b42f064 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:16:14.577468  7550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a347ffd6e71445a8c01ccc22b42f064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.583861  7549 tablet_service.cc:1511] Processing CreateTablet for tablet ce96956ac94f4b18bc33fd50153efab8 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:16:14.585461  7549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce96956ac94f4b18bc33fd50153efab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.591910  7548 tablet_service.cc:1511] Processing CreateTablet for tablet cf369cc1618a438b9ef3a38a5ba252e9 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:16:14.608023  7547 tablet_service.cc:1511] Processing CreateTablet for tablet 410149d03e2e411b9ad55a216ccee270 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:16:14.593652  7548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf369cc1618a438b9ef3a38a5ba252e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.610322  7546 tablet_service.cc:1511] Processing CreateTablet for tablet 2f0cee7f7f014985974db72216d12e7a (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:16:14.616109  7545 tablet_service.cc:1511] Processing CreateTablet for tablet 7e6b8b5e1a9a4100bfe8f0de30969e2d (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:16:14.619957  7543 tablet_service.cc:1511] Processing CreateTablet for tablet 22b38bab9c6a4955a97108c436ff1bb6 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:16:14.619829  7544 tablet_service.cc:1511] Processing CreateTablet for tablet 0a329b17879e429e95bc6d32be006afb (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:16:14.620410  7542 tablet_service.cc:1511] Processing CreateTablet for tablet f4d6e2ea81954f098f276b0ee1628d50 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:16:14.622225  7546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f0cee7f7f014985974db72216d12e7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.623612  7544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a329b17879e429e95bc6d32be006afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.624320  7602 tablet_bootstrap.cc:492] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328: Bootstrap starting.
I20260709 12:16:14.626616  7542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d6e2ea81954f098f276b0ee1628d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.642912  7543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b38bab9c6a4955a97108c436ff1bb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.647038  7547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 410149d03e2e411b9ad55a216ccee270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.650928  7545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e6b8b5e1a9a4100bfe8f0de30969e2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.656139  7601 tablet_bootstrap.cc:654] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:14.667598  7401 tablet_service.cc:1511] Processing CreateTablet for tablet f4d6e2ea81954f098f276b0ee1628d50 (DEFAULT_TABLE table=test-workload [id=7ef6396328dd490daab689a76b7822b6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:16:14.669270  7401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d6e2ea81954f098f276b0ee1628d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:14.675791  7603 tablet_bootstrap.cc:492] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a: Bootstrap starting.
I20260709 12:16:14.677945  7602 tablet_bootstrap.cc:654] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:14.730686  7296 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.24.179.65:41773, user_credentials={real_user=slave}} blocked reactor thread for 63969.8us
I20260709 12:16:14.743453  7601 tablet_bootstrap.cc:492] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1: No bootstrap required, opened a new log
I20260709 12:16:14.744189  7601 ts_tablet_manager.cc:1403] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent bootstrapping tablet: real 0.173s	user 0.016s	sys 0.001s
I20260709 12:16:14.749047  7602 tablet_bootstrap.cc:492] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328: No bootstrap required, opened a new log
I20260709 12:16:14.749742  7602 ts_tablet_manager.cc:1403] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328: Time spent bootstrapping tablet: real 0.132s	user 0.010s	sys 0.009s
I20260709 12:16:14.761561  7601 raft_consensus.cc:359] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:14.762527  7601 raft_consensus.cc:385] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:14.762892  7601 raft_consensus.cc:740] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Initialized, Role: FOLLOWER
I20260709 12:16:14.763748  7601 consensus_queue.cc:260] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:14.766304  7437 heartbeater.cc:499] Master 127.24.179.126:37135 was elected leader, sending a full tablet report...
I20260709 12:16:14.780869  7603 tablet_bootstrap.cc:654] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:14.781790  7601 ts_tablet_manager.cc:1434] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.003s
I20260709 12:16:14.783062  7601 tablet_bootstrap.cc:492] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap starting.
I20260709 12:16:14.782581  7602 raft_consensus.cc:359] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } }
I20260709 12:16:14.783535  7602 raft_consensus.cc:385] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:14.783871  7602 raft_consensus.cc:740] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Initialized, Role: FOLLOWER
I20260709 12:16:14.784716  7602 consensus_queue.cc:260] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } }
I20260709 12:16:14.790325  7601 tablet_bootstrap.cc:654] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:14.800096  7602 ts_tablet_manager.cc:1434] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.004s
I20260709 12:16:14.801573  7512 heartbeater.cc:499] Master 127.24.179.126:37135 was elected leader, sending a full tablet report...
I20260709 12:16:14.811488  7602 tablet_bootstrap.cc:492] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328: Bootstrap starting.
I20260709 12:16:14.822875  7602 tablet_bootstrap.cc:654] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:14.827131  7438 tablet.cc:2406] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:16:14.829341  7601 tablet_bootstrap.cc:492] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1: No bootstrap required, opened a new log
I20260709 12:16:14.829994  7601 ts_tablet_manager.cc:1403] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.020s
I20260709 12:16:14.833243  7601 raft_consensus.cc:359] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } }
I20260709 12:16:14.834039  7601 raft_consensus.cc:385] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:14.836858  7602 tablet_bootstrap.cc:492] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328: No bootstrap required, opened a new log
I20260709 12:16:14.838457  7602 ts_tablet_manager.cc:1403] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.000s
I20260709 12:16:14.834362  7601 raft_consensus.cc:740] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Initialized, Role: FOLLOWER
I20260709 12:16:14.842684  7603 tablet_bootstrap.cc:492] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a: No bootstrap required, opened a new log
I20260709 12:16:14.847131  7603 ts_tablet_manager.cc:1403] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a: Time spent bootstrapping tablet: real 0.172s	user 0.014s	sys 0.004s
I20260709 12:16:14.847043  7601 consensus_queue.cc:260] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } }
I20260709 12:16:14.849149  7601 ts_tablet_manager.cc:1434] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:16:14.843782  7602 raft_consensus.cc:359] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:14.849912  7603 raft_consensus.cc:359] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } }
I20260709 12:16:14.850229  7601 tablet_bootstrap.cc:492] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap starting.
I20260709 12:16:14.850685  7602 raft_consensus.cc:385] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:14.850746  7603 raft_consensus.cc:385] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:14.851189  7602 raft_consensus.cc:740] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Initialized, Role: FOLLOWER
I20260709 12:16:14.851267  7603 raft_consensus.cc:740] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Initialized, Role: FOLLOWER
I20260709 12:16:14.852167  7603 consensus_queue.cc:260] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } }
I20260709 12:16:14.852255  7602 consensus_queue.cc:260] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:14.858631  7601 tablet_bootstrap.cc:654] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:14.863775  7601 tablet_bootstrap.cc:492] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1: No bootstrap required, opened a new log
I20260709 12:16:14.864358  7601 ts_tablet_manager.cc:1403] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.008s
I20260709 12:16:14.864290  7602 ts_tablet_manager.cc:1434] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:16:14.865796  7602 tablet_bootstrap.cc:492] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328: Bootstrap starting.
I20260709 12:16:14.865963  7586 heartbeater.cc:499] Master 127.24.179.126:37135 was elected leader, sending a full tablet report...
I20260709 12:16:14.866608  7603 ts_tablet_manager.cc:1434] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.009s
I20260709 12:16:14.867760  7603 tablet_bootstrap.cc:492] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a: Bootstrap starting.
I20260709 12:16:14.871541  7602 tablet_bootstrap.cc:654] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:14.875022  7603 tablet_bootstrap.cc:654] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:14.880741  7601 raft_consensus.cc:359] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:14.882033  7601 raft_consensus.cc:385] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:14.882539  7601 raft_consensus.cc:740] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Initialized, Role: FOLLOWER
I20260709 12:16:14.883898  7601 consensus_queue.cc:260] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:14.887390  7601 ts_tablet_manager.cc:1434] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 12:16:14.889153  7601 tablet_bootstrap.cc:492] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap starting.
I20260709 12:16:14.900154  7601 tablet_bootstrap.cc:654] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:14.906360  7358 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:14.914945  7601 tablet_bootstrap.cc:492] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1: No bootstrap required, opened a new log
I20260709 12:16:14.915670  7601 ts_tablet_manager.cc:1403] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.003s
I20260709 12:16:14.918282  7602 tablet_bootstrap.cc:492] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328: No bootstrap required, opened a new log
I20260709 12:16:14.919032  7602 ts_tablet_manager.cc:1403] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328: Time spent bootstrapping tablet: real 0.054s	user 0.031s	sys 0.017s
I20260709 12:16:14.919220  7601 raft_consensus.cc:359] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:14.920069  7601 raft_consensus.cc:385] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:14.920397  7603 tablet_bootstrap.cc:492] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a: No bootstrap required, opened a new log
I20260709 12:16:14.920380  7601 raft_consensus.cc:740] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Initialized, Role: FOLLOWER
I20260709 12:16:14.921100  7603 ts_tablet_manager.cc:1403] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.024s
I20260709 12:16:14.921587  7601 consensus_queue.cc:260] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:14.923259  7602 raft_consensus.cc:359] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:14.924175  7602 raft_consensus.cc:385] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:14.924540  7602 raft_consensus.cc:740] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Initialized, Role: FOLLOWER
I20260709 12:16:14.924804  7603 raft_consensus.cc:359] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:14.925704  7603 raft_consensus.cc:385] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:14.926211  7603 raft_consensus.cc:740] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Initialized, Role: FOLLOWER
I20260709 12:16:14.925657  7602 consensus_queue.cc:260] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:14.927037  7601 ts_tablet_manager.cc:1434] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:16:14.927233  7603 consensus_queue.cc:260] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:14.928243  7601 tablet_bootstrap.cc:492] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap starting.
I20260709 12:16:14.928915  7602 ts_tablet_manager.cc:1434] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:16:14.929649  7603 ts_tablet_manager.cc:1434] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:14.930208  7602 tablet_bootstrap.cc:492] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328: Bootstrap starting.
I20260709 12:16:14.930832  7603 tablet_bootstrap.cc:492] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a: Bootstrap starting.
I20260709 12:16:14.936054  7601 tablet_bootstrap.cc:654] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:14.938458  7602 tablet_bootstrap.cc:654] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:14.938519  7603 tablet_bootstrap.cc:654] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:14.948451  7601 tablet_bootstrap.cc:492] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1: No bootstrap required, opened a new log
I20260709 12:16:14.948451  7602 tablet_bootstrap.cc:492] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328: No bootstrap required, opened a new log
I20260709 12:16:14.949187  7601 ts_tablet_manager.cc:1403] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 12:16:14.952430  7603 tablet_bootstrap.cc:492] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a: No bootstrap required, opened a new log
I20260709 12:16:14.949339  7602 ts_tablet_manager.cc:1403] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 12:16:14.952764  7601 raft_consensus.cc:359] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:14.953728  7601 raft_consensus.cc:385] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:14.954066  7601 raft_consensus.cc:740] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Initialized, Role: FOLLOWER
I20260709 12:16:14.955220  7601 consensus_queue.cc:260] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:14.956597  7602 raft_consensus.cc:359] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:14.957999  7601 ts_tablet_manager.cc:1434] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:16:14.957763  7603 ts_tablet_manager.cc:1403] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.006s
I20260709 12:16:14.959323  7601 tablet_bootstrap.cc:492] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap starting.
I20260709 12:16:14.958143  7602 raft_consensus.cc:385] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:14.959932  7602 raft_consensus.cc:740] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Initialized, Role: FOLLOWER
I20260709 12:16:14.962771  7602 consensus_queue.cc:260] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:14.963719  7603 raft_consensus.cc:359] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:14.964699  7603 raft_consensus.cc:385] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:14.965126  7603 raft_consensus.cc:740] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Initialized, Role: FOLLOWER
I20260709 12:16:14.965274  7602 ts_tablet_manager.cc:1434] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.001s
I20260709 12:16:14.966593  7602 tablet_bootstrap.cc:492] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328: Bootstrap starting.
I20260709 12:16:14.966296  7603 consensus_queue.cc:260] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:14.967088  7601 tablet_bootstrap.cc:654] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:14.969498  7603 ts_tablet_manager.cc:1434] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:16:14.970992  7603 tablet_bootstrap.cc:492] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a: Bootstrap starting.
I20260709 12:16:14.974530  7602 tablet_bootstrap.cc:654] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:14.981514  7603 tablet_bootstrap.cc:654] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:15.000525  7601 tablet_bootstrap.cc:492] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1: No bootstrap required, opened a new log
I20260709 12:16:15.001165  7601 ts_tablet_manager.cc:1403] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.020s
I20260709 12:16:15.001423  7602 tablet_bootstrap.cc:492] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328: No bootstrap required, opened a new log
I20260709 12:16:15.001837  7603 tablet_bootstrap.cc:492] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a: No bootstrap required, opened a new log
I20260709 12:16:15.002040  7602 ts_tablet_manager.cc:1403] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.017s
I20260709 12:16:15.002529  7603 ts_tablet_manager.cc:1403] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a: Time spent bootstrapping tablet: real 0.032s	user 0.027s	sys 0.004s
I20260709 12:16:15.005008  7602 raft_consensus.cc:359] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.004807  7601 raft_consensus.cc:359] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.005857  7602 raft_consensus.cc:385] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.005966  7601 raft_consensus.cc:385] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.006310  7602 raft_consensus.cc:740] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Initialized, Role: FOLLOWER
I20260709 12:16:15.006641  7601 raft_consensus.cc:740] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Initialized, Role: FOLLOWER
I20260709 12:16:15.006119  7603 raft_consensus.cc:359] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.007210  7603 raft_consensus.cc:385] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.007560  7603 raft_consensus.cc:740] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Initialized, Role: FOLLOWER
I20260709 12:16:15.007459  7602 consensus_queue.cc:260] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.007951  7601 consensus_queue.cc:260] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.008630  7603 consensus_queue.cc:260] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.010705  7602 ts_tablet_manager.cc:1434] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:16:15.011559  7603 ts_tablet_manager.cc:1434] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:16:15.011966  7602 tablet_bootstrap.cc:492] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328: Bootstrap starting.
I20260709 12:16:15.012732  7603 tablet_bootstrap.cc:492] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a: Bootstrap starting.
I20260709 12:16:15.013019  7601 ts_tablet_manager.cc:1434] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:16:15.012795  7607 raft_consensus.cc:493] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.014146  7601 tablet_bootstrap.cc:492] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap starting.
I20260709 12:16:15.019065  7606 raft_consensus.cc:493] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.019919  7602 tablet_bootstrap.cc:654] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:15.019758  7606 raft_consensus.cc:515] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } }
I20260709 12:16:15.020812  7603 tablet_bootstrap.cc:654] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:15.013852  7607 raft_consensus.cc:515] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } }
I20260709 12:16:15.030675  7607 leader_election.cc:290] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.033728  7606 leader_election.cc:290] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:15.066920  7601 tablet_bootstrap.cc:654] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:15.088819  7607 raft_consensus.cc:493] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.089844  7607 raft_consensus.cc:515] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.093516  7607 leader_election.cc:290] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.102921  7611 raft_consensus.cc:493] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.103776  7611 raft_consensus.cc:515] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.109498  7606 raft_consensus.cc:493] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.114965  7611 leader_election.cc:290] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:15.113760  7606 raft_consensus.cc:515] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.116631  7611 raft_consensus.cc:493] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.129217  7611 raft_consensus.cc:515] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.146483  7601 tablet_bootstrap.cc:492] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1: No bootstrap required, opened a new log
I20260709 12:16:15.147329  7601 ts_tablet_manager.cc:1403] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent bootstrapping tablet: real 0.133s	user 0.021s	sys 0.000s
I20260709 12:16:15.138144  7611 leader_election.cc:290] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:15.132620  7606 leader_election.cc:290] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.153155  7606 raft_consensus.cc:493] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.154453  7606 raft_consensus.cc:515] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.154770  7633 raft_consensus.cc:493] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.160243  7603 tablet_bootstrap.cc:492] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a: No bootstrap required, opened a new log
I20260709 12:16:15.161015  7603 ts_tablet_manager.cc:1403] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a: Time spent bootstrapping tablet: real 0.148s	user 0.070s	sys 0.042s
I20260709 12:16:15.158859  7633 raft_consensus.cc:515] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.164839  7633 leader_election.cc:290] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.164674  7603 raft_consensus.cc:359] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.165671  7603 raft_consensus.cc:385] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.166018  7603 raft_consensus.cc:740] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Initialized, Role: FOLLOWER
I20260709 12:16:15.166613  7606 leader_election.cc:290] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.166888  7603 consensus_queue.cc:260] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.175315  7603 ts_tablet_manager.cc:1434] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:16:15.176492  7603 tablet_bootstrap.cc:492] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a: Bootstrap starting.
I20260709 12:16:15.176631  7602 tablet_bootstrap.cc:492] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328: No bootstrap required, opened a new log
I20260709 12:16:15.177425  7602 ts_tablet_manager.cc:1403] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328: Time spent bootstrapping tablet: real 0.166s	user 0.054s	sys 0.050s
I20260709 12:16:15.177294  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09606ff486a4308b404dea23791c522" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
I20260709 12:16:15.172298  7607 raft_consensus.cc:493] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.178140  7487 raft_consensus.cc:2468] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 0.
I20260709 12:16:15.178807  7607 raft_consensus.cc:515] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.181736  7607 leader_election.cc:290] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.183481  7603 tablet_bootstrap.cc:654] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:15.184940  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
I20260709 12:16:15.169541  7601 raft_consensus.cc:359] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.187047  7601 raft_consensus.cc:385] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.191880  7601 raft_consensus.cc:740] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Initialized, Role: FOLLOWER
I20260709 12:16:15.192399  7486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce96956ac94f4b18bc33fd50153efab8" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
I20260709 12:16:15.193305  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
I20260709 12:16:15.192885  7601 consensus_queue.cc:260] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.194092  7378 leader_election.cc:304] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:15.194108  7487 raft_consensus.cc:2468] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 0.
I20260709 12:16:15.195312  7637 raft_consensus.cc:2804] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:16:15.195359  7378 leader_election.cc:343] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:15.195837  7637 raft_consensus.cc:493] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:15.196359  7637 raft_consensus.cc:3060] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.196502  7606 raft_consensus.cc:493] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.197095  7606 raft_consensus.cc:515] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.203795  7412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09606ff486a4308b404dea23791c522" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" is_pre_election: true
I20260709 12:16:15.205037  7411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d6e2ea81954f098f276b0ee1628d50" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" is_pre_election: true
I20260709 12:16:15.206823  7410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" is_pre_election: true
I20260709 12:16:15.207551  7601 ts_tablet_manager.cc:1434] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent starting tablet: real 0.060s	user 0.011s	sys 0.000s
I20260709 12:16:15.207752  7410 raft_consensus.cc:2468] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 0.
I20260709 12:16:15.208794  7601 tablet_bootstrap.cc:492] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap starting.
I20260709 12:16:15.186313  7602 raft_consensus.cc:359] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.222265  7602 raft_consensus.cc:385] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.222594  7561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09606ff486a4308b404dea23791c522" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:15.199602  7606 leader_election.cc:290] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.224674  7560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:15.225728  7603 tablet_bootstrap.cc:492] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a: No bootstrap required, opened a new log
I20260709 12:16:15.225929  7606 raft_consensus.cc:493] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.226500  7603 ts_tablet_manager.cc:1403] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.011s
I20260709 12:16:15.226567  7606 raft_consensus.cc:515] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.222676  7602 raft_consensus.cc:740] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Initialized, Role: FOLLOWER
I20260709 12:16:15.230049  7603 raft_consensus.cc:359] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.231004  7603 raft_consensus.cc:385] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.231383  7603 raft_consensus.cc:740] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Initialized, Role: FOLLOWER
W20260709 12:16:15.210602  7452 leader_election.cc:343] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:15.211263  7637 raft_consensus.cc:515] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } }
I20260709 12:16:15.217447  7636 raft_consensus.cc:493] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.219184  7485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce96956ac94f4b18bc33fd50153efab8" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
I20260709 12:16:15.232631  7636 raft_consensus.cc:515] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } }
I20260709 12:16:15.220072  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
I20260709 12:16:15.231803  7559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:15.234030  7561 raft_consensus.cc:2468] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 0.
I20260709 12:16:15.234321  7559 raft_consensus.cc:2468] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 0.
I20260709 12:16:15.235356  7487 raft_consensus.cc:2468] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 0.
I20260709 12:16:15.233613  7603 consensus_queue.cc:260] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.236568  7611 raft_consensus.cc:493] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.236812  7527 leader_election.cc:304] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, 86d91c5ff0bd4582bf410ce99edeb328; no voters: 
I20260709 12:16:15.237076  7611 raft_consensus.cc:515] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.237267  7637 leader_election.cc:290] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 election: Requested vote from peers 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:15.238938  7636 leader_election.cc:290] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:15.196373  7378 leader_election.cc:304] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:15.233088  7412 raft_consensus.cc:2393] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86d91c5ff0bd4582bf410ce99edeb328 in current term 1: Already voted for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in this term.
I20260709 12:16:15.240067  7636 raft_consensus.cc:2804] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:15.240502  7636 raft_consensus.cc:493] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:15.240586  7378 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:42345, user_credentials={real_user=slave}} blocked reactor thread for 44312.9us
I20260709 12:16:15.240948  7636 raft_consensus.cc:3060] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.230439  7560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce96956ac94f4b18bc33fd50153efab8" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:15.242538  7637 raft_consensus.cc:2804] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:15.242729  7560 raft_consensus.cc:2468] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 0.
I20260709 12:16:15.242995  7637 raft_consensus.cc:493] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:15.243381  7637 raft_consensus.cc:3060] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.243848  7611 leader_election.cc:290] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:15.231411  7602 consensus_queue.cc:260] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.247715  7486 raft_consensus.cc:2468] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 0.
I20260709 12:16:15.249437  7484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09606ff486a4308b404dea23791c522" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:15.246971  7485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6b8b5e1a9a4100bfe8f0de30969e2d" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
I20260709 12:16:15.250182  7484 raft_consensus.cc:3060] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.251363  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a347ffd6e71445a8c01ccc22b42f064" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
I20260709 12:16:15.252082  7487 raft_consensus.cc:2468] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 0.
I20260709 12:16:15.252756  7378 leader_election.cc:304] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:15.253670  7560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a347ffd6e71445a8c01ccc22b42f064" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
W20260709 12:16:15.253861  7378 leader_election.cc:343] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:15.254380  7560 raft_consensus.cc:2468] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 0.
I20260709 12:16:15.254640  7378 leader_election.cc:304] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:15.253715  7633 raft_consensus.cc:2804] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:15.255540  7633 raft_consensus.cc:493] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:15.256033  7633 raft_consensus.cc:3060] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.263659  7560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6b8b5e1a9a4100bfe8f0de30969e2d" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:15.264657  7560 raft_consensus.cc:2468] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 0.
I20260709 12:16:15.265373  7642 raft_consensus.cc:2804] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:15.265856  7642 raft_consensus.cc:493] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:15.266209  7642 raft_consensus.cc:3060] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.266837  7560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09606ff486a4308b404dea23791c522" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:15.267549  7560 raft_consensus.cc:3060] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.267700  7484 raft_consensus.cc:2468] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 1.
W20260709 12:16:15.270973  7377 leader_election.cc:343] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:15.271628  7377 leader_election.cc:304] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 1cf436d0350e46ebaebd98718017cc0a, 86d91c5ff0bd4582bf410ce99edeb328
I20260709 12:16:15.270897  7378 leader_election.cc:304] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:15.273082  7633 raft_consensus.cc:515] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.274793  7601 tablet_bootstrap.cc:654] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:15.278436  7452 leader_election.cc:304] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:15.279824  7607 raft_consensus.cc:2804] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:15.280522  7607 raft_consensus.cc:493] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:15.281018  7607 raft_consensus.cc:3060] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.279876  7644 raft_consensus.cc:2749] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:15.283057  7644 raft_consensus.cc:2804] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:15.283560  7644 raft_consensus.cc:697] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 LEADER]: Becoming Leader. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Running, Role: LEADER
I20260709 12:16:15.284464  7644 consensus_queue.cc:237] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } }
I20260709 12:16:15.287233  7637 raft_consensus.cc:515] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
W20260709 12:16:15.290632  7452 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:41773, user_credentials={real_user=slave}} blocked reactor thread for 58364.5us
I20260709 12:16:15.293318  7606 leader_election.cc:290] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.298043  7601 tablet_bootstrap.cc:492] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1: No bootstrap required, opened a new log
I20260709 12:16:15.308818  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:15.309434  7601 ts_tablet_manager.cc:1403] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.002s
I20260709 12:16:15.309844  7561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09606ff486a4308b404dea23791c522" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:15.250181  7602 ts_tablet_manager.cc:1434] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328: Time spent starting tablet: real 0.072s	user 0.012s	sys 0.000s
I20260709 12:16:15.298707  7558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:15.299549  7559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d6e2ea81954f098f276b0ee1628d50" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:15.301213  7484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce96956ac94f4b18bc33fd50153efab8" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
W20260709 12:16:15.307145  7527 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.66:42345, user_credentials={real_user=slave}} blocked reactor thread for 70540.2us
I20260709 12:16:15.303822  7607 raft_consensus.cc:515] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.318145  7601 raft_consensus.cc:359] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.319034  7601 raft_consensus.cc:385] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.319290  7601 raft_consensus.cc:740] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Initialized, Role: FOLLOWER
I20260709 12:16:15.311196  7633 leader_election.cc:290] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 election: Requested vote from peers 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.315071  7484 raft_consensus.cc:3060] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.321041  7602 tablet_bootstrap.cc:492] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328: Bootstrap starting.
I20260709 12:16:15.323053  7637 leader_election.cc:290] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 election: Requested vote from peers 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.323701  7487 raft_consensus.cc:2393] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ea5edb9dbe9743e580031bfe1d2d50b1 in current term 1: Already voted for candidate 86d91c5ff0bd4582bf410ce99edeb328 in this term.
I20260709 12:16:15.325003  7485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09606ff486a4308b404dea23791c522" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
I20260709 12:16:15.324892  7636 raft_consensus.cc:515] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.328456  7601 consensus_queue.cc:260] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.330183  7485 raft_consensus.cc:2393] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1cf436d0350e46ebaebd98718017cc0a in current term 1: Already voted for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in this term.
I20260709 12:16:15.332682  7486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b38bab9c6a4955a97108c436ff1bb6" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
I20260709 12:16:15.334758  7603 ts_tablet_manager.cc:1434] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a: Time spent starting tablet: real 0.108s	user 0.028s	sys 0.055s
I20260709 12:16:15.337134  7603 tablet_bootstrap.cc:492] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a: Bootstrap starting.
I20260709 12:16:15.334928  7642 raft_consensus.cc:515] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
W20260709 12:16:15.338348  7527 leader_election.cc:343] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:15.339170  7607 leader_election.cc:290] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.339850  7607 raft_consensus.cc:493] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.340332  7607 raft_consensus.cc:515] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.341282  7636 leader_election.cc:290] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 1 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:15.341531  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a347ffd6e71445a8c01ccc22b42f064" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:15.342355  7487 raft_consensus.cc:3060] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.343104  7486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:15.343660  7558 raft_consensus.cc:2393] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86d91c5ff0bd4582bf410ce99edeb328 in current term 1: Already voted for candidate 1cf436d0350e46ebaebd98718017cc0a in this term.
I20260709 12:16:15.344100  7486 raft_consensus.cc:2393] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1cf436d0350e46ebaebd98718017cc0a in current term 1: Already voted for candidate 86d91c5ff0bd4582bf410ce99edeb328 in this term.
I20260709 12:16:15.344334  7601 ts_tablet_manager.cc:1434] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 12:16:15.345525  7601 tablet_bootstrap.cc:492] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap starting.
I20260709 12:16:15.344444  7642 leader_election.cc:290] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 election: Requested vote from peers 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.347564  7560 raft_consensus.cc:2468] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 1.
W20260709 12:16:15.351091  7377 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:33233, user_credentials={real_user=slave}} blocked reactor thread for 80234.7us
I20260709 12:16:15.354372  7558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:15.355325  7558 raft_consensus.cc:2393] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ea5edb9dbe9743e580031bfe1d2d50b1 in current term 1: Already voted for candidate 1cf436d0350e46ebaebd98718017cc0a in this term.
I20260709 12:16:15.356637  7484 raft_consensus.cc:2468] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 1.
I20260709 12:16:15.357285  7560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce96956ac94f4b18bc33fd50153efab8" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:15.357599  7558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a347ffd6e71445a8c01ccc22b42f064" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:15.358286  7558 raft_consensus.cc:3060] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.358152  7560 raft_consensus.cc:3060] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.360227  7603 tablet_bootstrap.cc:654] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:15.358142  7378 leader_election.cc:304] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:15.362129  7644 raft_consensus.cc:2804] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:15.362723  7644 raft_consensus.cc:697] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 LEADER]: Becoming Leader. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Running, Role: LEADER
I20260709 12:16:15.364066  7412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
W20260709 12:16:15.364305  7452 leader_election.cc:343] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:15.364964  7412 raft_consensus.cc:2393] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 86d91c5ff0bd4582bf410ce99edeb328 in current term 1: Already voted for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in this term.
I20260709 12:16:15.365418  7607 leader_election.cc:290] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.365968  7487 raft_consensus.cc:2468] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 1.
I20260709 12:16:15.366737  7561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:15.366806  7412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0cee7f7f014985974db72216d12e7a" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" is_pre_election: true
I20260709 12:16:15.367326  7378 leader_election.cc:304] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:15.367676  7561 raft_consensus.cc:2393] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 86d91c5ff0bd4582bf410ce99edeb328 in current term 1: Already voted for candidate 1cf436d0350e46ebaebd98718017cc0a in this term.
I20260709 12:16:15.364804  7452 leader_election.cc:304] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328; no voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:15.368338  7602 tablet_bootstrap.cc:654] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:15.368525  7642 raft_consensus.cc:2804] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:15.369081  7642 raft_consensus.cc:697] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 LEADER]: Becoming Leader. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Running, Role: LEADER
I20260709 12:16:15.369171  7452 leader_election.cc:304] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328; no voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:15.370373  7642 consensus_queue.cc:237] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.371904  7601 tablet_bootstrap.cc:654] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:15.372340  7452 leader_election.cc:304] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328; no voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:15.373828  7644 consensus_queue.cc:237] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.376883  7607 raft_consensus.cc:2749] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:15.377660  7561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0cee7f7f014985974db72216d12e7a" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:15.378115  7607 raft_consensus.cc:2749] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:15.379160  7607 raft_consensus.cc:2749] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:15.380673  7412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" is_pre_election: true
I20260709 12:16:15.381882  7412 raft_consensus.cc:2393] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1cf436d0350e46ebaebd98718017cc0a in current term 1: Already voted for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in this term.
I20260709 12:16:15.385986  7603 tablet_bootstrap.cc:492] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a: No bootstrap required, opened a new log
I20260709 12:16:15.388289  7603 ts_tablet_manager.cc:1403] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.000s
I20260709 12:16:15.390244  7412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce96956ac94f4b18bc33fd50153efab8" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" is_pre_election: true
I20260709 12:16:15.391079  7560 raft_consensus.cc:2468] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 1.
I20260709 12:16:15.393936  7412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09606ff486a4308b404dea23791c522" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" is_pre_election: true
I20260709 12:16:15.396040  7410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b38bab9c6a4955a97108c436ff1bb6" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" is_pre_election: true
I20260709 12:16:15.397183  7410 raft_consensus.cc:2468] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 0.
I20260709 12:16:15.396047  7601 tablet_bootstrap.cc:492] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1: No bootstrap required, opened a new log
I20260709 12:16:15.398730  7412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
I20260709 12:16:15.399183  7601 ts_tablet_manager.cc:1403] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.000s
I20260709 12:16:15.399928  7412 raft_consensus.cc:2393] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1cf436d0350e46ebaebd98718017cc0a in current term 1: Already voted for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in this term.
I20260709 12:16:15.396103  7603 raft_consensus.cc:359] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.401981  7603 raft_consensus.cc:385] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.402432  7603 raft_consensus.cc:740] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Initialized, Role: FOLLOWER
W20260709 12:16:15.403679  7452 leader_election.cc:343] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:15.403873  7603 consensus_queue.cc:260] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
W20260709 12:16:15.404985  7452 leader_election.cc:343] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:15.405472  7452 leader_election.cc:304] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328; no voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:15.406581  7650 raft_consensus.cc:2749] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:15.405474  7558 raft_consensus.cc:2468] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 1.
I20260709 12:16:15.409525  7603 ts_tablet_manager.cc:1434] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:16:15.409649  7377 leader_election.cc:304] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 86d91c5ff0bd4582bf410ce99edeb328
I20260709 12:16:15.410866  7603 tablet_bootstrap.cc:492] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a: Bootstrap starting.
I20260709 12:16:15.412531  7377 leader_election.cc:304] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 1cf436d0350e46ebaebd98718017cc0a, 86d91c5ff0bd4582bf410ce99edeb328
I20260709 12:16:15.412922  7602 tablet_bootstrap.cc:492] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328: No bootstrap required, opened a new log
I20260709 12:16:15.413553  7602 ts_tablet_manager.cc:1403] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.004s
I20260709 12:16:15.413985  7601 raft_consensus.cc:359] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.414903  7601 raft_consensus.cc:385] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.415185  7601 raft_consensus.cc:740] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Initialized, Role: FOLLOWER
I20260709 12:16:15.415861  7601 consensus_queue.cc:260] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.417079  7602 raft_consensus.cc:359] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.417784  7602 raft_consensus.cc:385] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.418035  7602 raft_consensus.cc:740] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Initialized, Role: FOLLOWER
I20260709 12:16:15.418697  7644 raft_consensus.cc:2804] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:15.419199  7644 raft_consensus.cc:493] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:15.419667  7644 raft_consensus.cc:3060] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.419813  7643 raft_consensus.cc:2749] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:15.422289  7601 ts_tablet_manager.cc:1434] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:16:15.423473  7601 tablet_bootstrap.cc:492] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap starting.
I20260709 12:16:15.424582  7526 leader_election.cc:304] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a; no voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:15.426330  7636 raft_consensus.cc:2749] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:15.426208  7307 catalog_manager.cc:5697] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:15.428169  7603 tablet_bootstrap.cc:654] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:15.428601  7644 raft_consensus.cc:515] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.429647  7601 tablet_bootstrap.cc:654] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:15.418862  7602 consensus_queue.cc:260] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.431675  7526 leader_election.cc:304] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a; no voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:15.432592  7636 raft_consensus.cc:2749] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:15.433348  7602 ts_tablet_manager.cc:1434] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 12:16:15.434456  7526 leader_election.cc:304] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 86d91c5ff0bd4582bf410ce99edeb328
I20260709 12:16:15.434903  7602 tablet_bootstrap.cc:492] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328: Bootstrap starting.
I20260709 12:16:15.435380  7636 raft_consensus.cc:2804] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:15.435835  7636 raft_consensus.cc:493] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:15.436215  7636 raft_consensus.cc:3060] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.443174  7644 leader_election.cc:290] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 election: Requested vote from peers 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.447109  7526 leader_election.cc:304] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a; no voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:15.448227  7640 raft_consensus.cc:2749] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:15.445837  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6b8b5e1a9a4100bfe8f0de30969e2d" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:15.445782  7636 raft_consensus.cc:515] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.449604  7644 raft_consensus.cc:493] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:15.450145  7378 leader_election.cc:343] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:15.450198  7644 raft_consensus.cc:515] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.452381  7558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6b8b5e1a9a4100bfe8f0de30969e2d" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:15.452746  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b38bab9c6a4955a97108c436ff1bb6" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:15.452767  7644 leader_election.cc:290] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
W20260709 12:16:15.454499  7527 leader_election.cc:343] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:15.454726  7558 raft_consensus.cc:3060] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.454485  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d6e2ea81954f098f276b0ee1628d50" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
I20260709 12:16:15.455938  7487 raft_consensus.cc:2468] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 0.
I20260709 12:16:15.456207  7603 tablet_bootstrap.cc:492] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a: No bootstrap required, opened a new log
I20260709 12:16:15.456741  7603 ts_tablet_manager.cc:1403] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.000s
I20260709 12:16:15.457298  7378 leader_election.cc:304] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:15.445837  7602 tablet_bootstrap.cc:654] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:15.458441  7644 raft_consensus.cc:2804] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:15.459239  7644 raft_consensus.cc:493] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:15.459851  7644 raft_consensus.cc:3060] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.460866  7636 leader_election.cc:290] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 1 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:15.463892  7603 raft_consensus.cc:359] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.464681  7603 raft_consensus.cc:385] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.464969  7603 raft_consensus.cc:740] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Initialized, Role: FOLLOWER
I20260709 12:16:15.466058  7603 consensus_queue.cc:260] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.467796  7602 tablet_bootstrap.cc:492] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328: No bootstrap required, opened a new log
I20260709 12:16:15.468386  7602 ts_tablet_manager.cc:1403] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.000s
I20260709 12:16:15.469108  7644 raft_consensus.cc:515] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.472438  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d6e2ea81954f098f276b0ee1628d50" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:15.473150  7487 raft_consensus.cc:3060] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.472677  7602 raft_consensus.cc:359] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.473659  7602 raft_consensus.cc:385] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.473954  7602 raft_consensus.cc:740] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Initialized, Role: FOLLOWER
I20260709 12:16:15.474855  7602 consensus_queue.cc:260] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.475032  7560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d6e2ea81954f098f276b0ee1628d50" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:15.468350  7601 tablet_bootstrap.cc:492] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1: No bootstrap required, opened a new log
I20260709 12:16:15.477644  7601 ts_tablet_manager.cc:1403] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.006s
I20260709 12:16:15.481786  7602 ts_tablet_manager.cc:1434] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:16:15.482481  7412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b38bab9c6a4955a97108c436ff1bb6" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
I20260709 12:16:15.472666  7603 ts_tablet_manager.cc:1434] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:16:15.483278  7602 tablet_bootstrap.cc:492] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328: Bootstrap starting.
I20260709 12:16:15.483526  7412 raft_consensus.cc:3060] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.484313  7603 tablet_bootstrap.cc:492] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a: Bootstrap starting.
I20260709 12:16:15.490202  7602 tablet_bootstrap.cc:654] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:15.484789  7487 raft_consensus.cc:2468] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 1.
I20260709 12:16:15.491950  7378 leader_election.cc:304] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:15.493110  7642 raft_consensus.cc:2804] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:15.493645  7642 raft_consensus.cc:697] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 LEADER]: Becoming Leader. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Running, Role: LEADER
W20260709 12:16:15.495167  7377 leader_election.cc:343] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:15.494899  7642 consensus_queue.cc:237] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.498119  7560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d6e2ea81954f098f276b0ee1628d50" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:15.482924  7644 leader_election.cc:290] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 election: Requested vote from peers 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.501333  7558 raft_consensus.cc:2468] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 1.
W20260709 12:16:15.504788  7377 leader_election.cc:343] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:15.504843  7602 tablet_bootstrap.cc:492] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328: No bootstrap required, opened a new log
I20260709 12:16:15.505770  7602 ts_tablet_manager.cc:1403] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.006s
I20260709 12:16:15.507387  7603 tablet_bootstrap.cc:654] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:15.481814  7601 raft_consensus.cc:359] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.506088  7377 leader_election.cc:304] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 86d91c5ff0bd4582bf410ce99edeb328
I20260709 12:16:15.510667  7644 raft_consensus.cc:2804] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:15.511427  7644 raft_consensus.cc:697] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 LEADER]: Becoming Leader. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Running, Role: LEADER
I20260709 12:16:15.512429  7644 consensus_queue.cc:237] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.512606  7602 raft_consensus.cc:359] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.513469  7602 raft_consensus.cc:385] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.513839  7602 raft_consensus.cc:740] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Initialized, Role: FOLLOWER
I20260709 12:16:15.509953  7601 raft_consensus.cc:385] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.515336  7601 raft_consensus.cc:740] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Initialized, Role: FOLLOWER
I20260709 12:16:15.515420  7602 consensus_queue.cc:260] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.516188  7601 consensus_queue.cc:260] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.520730  7602 ts_tablet_manager.cc:1434] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:16:15.522133  7602 tablet_bootstrap.cc:492] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328: Bootstrap starting.
I20260709 12:16:15.522688  7601 ts_tablet_manager.cc:1434] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.001s
I20260709 12:16:15.526873  7412 raft_consensus.cc:2468] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 1.
I20260709 12:16:15.529114  7526 leader_election.cc:304] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 86d91c5ff0bd4582bf410ce99edeb328
I20260709 12:16:15.529974  7650 raft_consensus.cc:493] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.530165  7636 raft_consensus.cc:2804] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:15.530648  7650 raft_consensus.cc:515] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.533365  7650 leader_election.cc:290] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.535494  7558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b38bab9c6a4955a97108c436ff1bb6" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:15.530858  7636 raft_consensus.cc:697] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 1 LEADER]: Becoming Leader. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Running, Role: LEADER
I20260709 12:16:15.544274  7636 consensus_queue.cc:237] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.562469  7412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b38bab9c6a4955a97108c436ff1bb6" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" is_pre_election: true
I20260709 12:16:15.564143  7412 raft_consensus.cc:2393] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86d91c5ff0bd4582bf410ce99edeb328 in current term 1: Already voted for candidate 1cf436d0350e46ebaebd98718017cc0a in this term.
I20260709 12:16:15.564767  7602 tablet_bootstrap.cc:654] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:15.569140  7603 tablet_bootstrap.cc:492] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a: No bootstrap required, opened a new log
I20260709 12:16:15.569871  7603 ts_tablet_manager.cc:1403] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a: Time spent bootstrapping tablet: real 0.086s	user 0.016s	sys 0.006s
I20260709 12:16:15.572986  7603 raft_consensus.cc:359] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.573355  7602 tablet_bootstrap.cc:492] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328: No bootstrap required, opened a new log
I20260709 12:16:15.573732  7603 raft_consensus.cc:385] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.574061  7603 raft_consensus.cc:740] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Initialized, Role: FOLLOWER
I20260709 12:16:15.574086  7602 ts_tablet_manager.cc:1403] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.003s
I20260709 12:16:15.575003  7603 consensus_queue.cc:260] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.577255  7603 ts_tablet_manager.cc:1434] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:16:15.577368  7602 raft_consensus.cc:359] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.578214  7602 raft_consensus.cc:385] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.578558  7602 raft_consensus.cc:740] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Initialized, Role: FOLLOWER
I20260709 12:16:15.578320  7603 tablet_bootstrap.cc:492] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a: Bootstrap starting.
I20260709 12:16:15.579353  7602 consensus_queue.cc:260] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.581630  7602 ts_tablet_manager.cc:1434] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:16:15.581188  7307 catalog_manager.cc:5697] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67). New cstate: current_term: 1 leader_uuid: "1cf436d0350e46ebaebd98718017cc0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:15.584860  7452 leader_election.cc:304] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328; no voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:15.586048  7650 raft_consensus.cc:3060] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.585027  7308 catalog_manager.cc:5697] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:15.591629  7308 catalog_manager.cc:5697] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:15.593294  7603 tablet_bootstrap.cc:654] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:15.595163  7650 raft_consensus.cc:2749] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:15.595095  7308 catalog_manager.cc:5697] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:15.597337  7308 catalog_manager.cc:5697] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:15.600075  7603 tablet_bootstrap.cc:492] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a: No bootstrap required, opened a new log
I20260709 12:16:15.600684  7603 ts_tablet_manager.cc:1403] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.000s
I20260709 12:16:15.603435  7603 raft_consensus.cc:359] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.604158  7603 raft_consensus.cc:385] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.604451  7603 raft_consensus.cc:740] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Initialized, Role: FOLLOWER
I20260709 12:16:15.605293  7603 consensus_queue.cc:260] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.607347  7603 ts_tablet_manager.cc:1434] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:16:15.671638  7650 raft_consensus.cc:493] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.672814  7650 raft_consensus.cc:515] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.674933  7650 leader_election.cc:290] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.675920  7412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" is_pre_election: true
I20260709 12:16:15.676205  7558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:15.676591  7412 raft_consensus.cc:2468] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 0.
I20260709 12:16:15.676910  7558 raft_consensus.cc:2468] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 0.
I20260709 12:16:15.677695  7452 leader_election.cc:304] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:15.678532  7650 raft_consensus.cc:2804] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:15.678910  7650 raft_consensus.cc:493] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:15.679226  7650 raft_consensus.cc:3060] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.684693  7650 raft_consensus.cc:515] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.686604  7650 leader_election.cc:290] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.687480  7412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
I20260709 12:16:15.687727  7558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:15.688258  7412 raft_consensus.cc:3060] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.688274  7558 raft_consensus.cc:3060] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.696485  7412 raft_consensus.cc:2468] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 1.
I20260709 12:16:15.696485  7558 raft_consensus.cc:2468] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 1.
I20260709 12:16:15.698031  7452 leader_election.cc:304] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, 86d91c5ff0bd4582bf410ce99edeb328; no voters: 
I20260709 12:16:15.698848  7650 raft_consensus.cc:2804] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:15.699384  7650 raft_consensus.cc:697] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 LEADER]: Becoming Leader. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Running, Role: LEADER
I20260709 12:16:15.700295  7650 consensus_queue.cc:237] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.703859  7650 raft_consensus.cc:493] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.704473  7650 raft_consensus.cc:515] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.707464  7650 leader_election.cc:290] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.707584  7412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6b8b5e1a9a4100bfe8f0de30969e2d" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" is_pre_election: true
I20260709 12:16:15.708688  7558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6b8b5e1a9a4100bfe8f0de30969e2d" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:15.709547  7558 raft_consensus.cc:2393] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86d91c5ff0bd4582bf410ce99edeb328 in current term 1: Already voted for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in this term.
I20260709 12:16:15.709317  7308 catalog_manager.cc:5697] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66). New cstate: current_term: 1 leader_uuid: "86d91c5ff0bd4582bf410ce99edeb328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:15.710589  7452 leader_election.cc:304] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328; no voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:15.711509  7650 raft_consensus.cc:3060] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.718326  7650 raft_consensus.cc:2749] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:15.755496  7644 raft_consensus.cc:493] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.756065  7644 raft_consensus.cc:515] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.758174  7644 leader_election.cc:290] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.759059  7484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410149d03e2e411b9ad55a216ccee270" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
I20260709 12:16:15.759393  7558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410149d03e2e411b9ad55a216ccee270" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:15.759766  7484 raft_consensus.cc:2468] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 0.
I20260709 12:16:15.760172  7558 raft_consensus.cc:2468] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 0.
I20260709 12:16:15.760147  7644 consensus_queue.cc:1048] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:15.760957  7378 leader_election.cc:304] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:15.761870  7642 raft_consensus.cc:2804] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:15.762198  7642 raft_consensus.cc:493] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:15.762566  7642 raft_consensus.cc:3060] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.775756  7642 raft_consensus.cc:515] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.779599  7642 leader_election.cc:290] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 election: Requested vote from peers 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.780282  7558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410149d03e2e411b9ad55a216ccee270" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:15.781205  7558 raft_consensus.cc:3060] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.781455  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410149d03e2e411b9ad55a216ccee270" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:15.782140  7487 raft_consensus.cc:3060] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.787649  7642 consensus_queue.cc:1048] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:15.790539  7487 raft_consensus.cc:2468] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 1.
I20260709 12:16:15.791887  7378 leader_election.cc:304] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:15.792879  7644 raft_consensus.cc:2804] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:15.793426  7644 raft_consensus.cc:697] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 LEADER]: Becoming Leader. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Running, Role: LEADER
I20260709 12:16:15.794366  7644 consensus_queue.cc:237] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.792897  7558 raft_consensus.cc:2468] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 1.
I20260709 12:16:15.803821  7642 consensus_queue.cc:1048] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:15.804075  7644 consensus_queue.cc:1048] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:15.812564  7308 catalog_manager.cc:5697] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:15.826104  7643 consensus_queue.cc:1048] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:15.839704  7633 consensus_queue.cc:1048] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:15.845430  7633 raft_consensus.cc:493] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:15.846014  7633 raft_consensus.cc:515] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.848341  7633 leader_election.cc:290] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.850692  7560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0cee7f7f014985974db72216d12e7a" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:15.851733  7560 raft_consensus.cc:2468] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 0.
I20260709 12:16:15.853670  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0cee7f7f014985974db72216d12e7a" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
I20260709 12:16:15.854509  7487 raft_consensus.cc:2468] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 0.
I20260709 12:16:15.855844  7378 leader_election.cc:304] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:15.856701  7633 raft_consensus.cc:2804] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:15.857121  7633 raft_consensus.cc:493] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:15.857491  7633 raft_consensus.cc:3060] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.865727  7633 raft_consensus.cc:515] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.867652  7633 leader_election.cc:290] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 election: Requested vote from peers 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:15.868489  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0cee7f7f014985974db72216d12e7a" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:15.869197  7487 raft_consensus.cc:3060] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.869186  7561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0cee7f7f014985974db72216d12e7a" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:15.870012  7561 raft_consensus.cc:3060] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.878266  7487 raft_consensus.cc:2468] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 1.
I20260709 12:16:15.878718  7561 raft_consensus.cc:2468] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 1.
I20260709 12:16:15.879699  7378 leader_election.cc:304] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:15.880477  7633 raft_consensus.cc:2804] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:15.881062  7633 raft_consensus.cc:697] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 LEADER]: Becoming Leader. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Running, Role: LEADER
I20260709 12:16:15.881839  7633 consensus_queue.cc:237] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:15.889858  7310 catalog_manager.cc:5697] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:15.906734  7633 consensus_queue.cc:1048] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:15.912050  7358 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:15.920080  7637 consensus_queue.cc:1048] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:15.984546  7561 raft_consensus.cc:3060] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.985481  7637 consensus_queue.cc:1048] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:15.993286  7637 consensus_queue.cc:1048] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:16.089562  7636 consensus_queue.cc:1048] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:16.090258  7640 consensus_queue.cc:1048] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:16.163791  7650 consensus_queue.cc:1048] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:16.175580  7689 consensus_queue.cc:1048] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:16.273078  7637 consensus_queue.cc:1048] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:16.286588  7633 consensus_queue.cc:1048] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:16.479511  7633 consensus_queue.cc:1048] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:16.481305  7633 consensus_queue.cc:1048] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:16.915999  7358 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:16.933331  7643 raft_consensus.cc:493] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.933943  7643 raft_consensus.cc:515] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:16.935941  7643 leader_election.cc:290] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:16.936781  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
I20260709 12:16:16.937095  7561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:16.937444  7487 raft_consensus.cc:2468] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 1.
I20260709 12:16:16.937850  7561 raft_consensus.cc:2468] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 1.
I20260709 12:16:16.938695  7378 leader_election.cc:304] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:16.939563  7643 raft_consensus.cc:2804] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:16.939942  7643 raft_consensus.cc:493] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:16.940227  7643 raft_consensus.cc:3060] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:16.946908  7643 raft_consensus.cc:515] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:16.948964  7643 leader_election.cc:290] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 2 election: Requested vote from peers 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:16.949703  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:16.950316  7487 raft_consensus.cc:3060] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:16.950523  7561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:16.951205  7561 raft_consensus.cc:3060] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:16.958732  7487 raft_consensus.cc:2468] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 2.
I20260709 12:16:16.958959  7561 raft_consensus.cc:2468] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea5edb9dbe9743e580031bfe1d2d50b1 in term 2.
I20260709 12:16:16.960270  7378 leader_election.cc:304] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:16.961143  7643 raft_consensus.cc:2804] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:16.961611  7643 raft_consensus.cc:697] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 LEADER]: Becoming Leader. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Running, Role: LEADER
I20260709 12:16:16.962489  7643 consensus_queue.cc:237] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:16.969959  7310 catalog_manager.cc:5697] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 reported cstate change: term changed from 0 to 2, leader changed from <none> to ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:17.151667 25293 ts_manager.cc:295] Set tserver state for ea5edb9dbe9743e580031bfe1d2d50b1 to MAINTENANCE_MODE
I20260709 12:16:17.152601 25293 tablet_server.cc:179] TabletServer@127.24.179.65:0 shutting down...
I20260709 12:16:17.173539 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:17.174320 25293 tablet_replica.cc:333] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1: stopping tablet replica
I20260709 12:16:17.175369 25293 raft_consensus.cc:2243] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:17.176355 25293 raft_consensus.cc:2272] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.178736 25293 tablet_replica.cc:333] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1: stopping tablet replica
I20260709 12:16:17.179347 25293 raft_consensus.cc:2243] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:17.180189 25293 raft_consensus.cc:2272] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.182632 25293 tablet_replica.cc:333] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1: stopping tablet replica
I20260709 12:16:17.183315 25293 raft_consensus.cc:2243] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:17.184477 25293 raft_consensus.cc:2272] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.186615 25293 tablet_replica.cc:333] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1: stopping tablet replica
I20260709 12:16:17.187240 25293 raft_consensus.cc:2243] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.187711 25293 raft_consensus.cc:2272] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.189706 25293 tablet_replica.cc:333] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1: stopping tablet replica
I20260709 12:16:17.190299 25293 raft_consensus.cc:2243] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:17.191197 25293 raft_consensus.cc:2272] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.193470 25293 tablet_replica.cc:333] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1: stopping tablet replica
I20260709 12:16:17.194087 25293 raft_consensus.cc:2243] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:17.195014 25293 raft_consensus.cc:2272] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.197058 25293 tablet_replica.cc:333] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1: stopping tablet replica
I20260709 12:16:17.197636 25293 raft_consensus.cc:2243] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:17.198297 25293 pending_rounds.cc:70] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1: Trying to abort 1 pending ops.
I20260709 12:16:17.198554 25293 pending_rounds.cc:77] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1: Aborting op as it isn't in flight: id { term: 2 index: 1 } timestamp: 7305623048046686208 op_type: NO_OP noop_request { }
I20260709 12:16:17.198880 25293 raft_consensus.cc:2889] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:16:17.199213 25293 raft_consensus.cc:2272] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.201994 25293 tablet_replica.cc:333] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1: stopping tablet replica
I20260709 12:16:17.202780 25293 raft_consensus.cc:2243] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:17.203663 25293 raft_consensus.cc:2272] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.206118 25293 tablet_replica.cc:333] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1: stopping tablet replica
I20260709 12:16:17.206768 25293 raft_consensus.cc:2243] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:17.207247 25293 raft_consensus.cc:2272] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.209311 25293 tablet_replica.cc:333] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1: stopping tablet replica
I20260709 12:16:17.209890 25293 raft_consensus.cc:2243] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:17.210810 25293 raft_consensus.cc:2272] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:17.242656 25293 tablet_server.cc:196] TabletServer@127.24.179.65:0 shutdown complete.
W20260709 12:16:17.251569  7452 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111) [suppressed 140 similar messages]
W20260709 12:16:17.256573  7452 consensus_peers.cc:597] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:17.574070  7526 consensus_peers.cc:597] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:17.917019  7358 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:16:18.211006  7711 raft_consensus.cc:493] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.211618  7711 raft_consensus.cc:515] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.213349  7711 leader_election.cc:290] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:18.214636  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a347ffd6e71445a8c01ccc22b42f064" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
W20260709 12:16:18.217490  7526 leader_election.cc:336] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.217957  7526 leader_election.cc:304] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a; no voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:18.218853  7711 raft_consensus.cc:2749] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:18.286324  7707 raft_consensus.cc:493] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.286938  7707 raft_consensus.cc:515] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.288723  7707 leader_election.cc:290] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:18.290465  7561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce96956ac94f4b18bc33fd50153efab8" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
W20260709 12:16:18.292769  7452 leader_election.cc:336] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.293224  7452 leader_election.cc:304] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328; no voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:18.293900  7707 raft_consensus.cc:2749] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:18.328058  7707 raft_consensus.cc:493] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.328635  7707 raft_consensus.cc:515] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.329264  7711 raft_consensus.cc:493] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.329861  7711 raft_consensus.cc:515] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } }
I20260709 12:16:18.330960  7707 leader_election.cc:290] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:18.332710  7561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410149d03e2e411b9ad55a216ccee270" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:18.332927  7711 leader_election.cc:290] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:18.334280  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09606ff486a4308b404dea23791c522" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
W20260709 12:16:18.336874  7526 leader_election.cc:336] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.337308  7526 leader_election.cc:304] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a; no voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1
W20260709 12:16:18.337448  7452 leader_election.cc:336] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.337997  7711 raft_consensus.cc:2749] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:18.337985  7452 leader_election.cc:304] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328; no voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:18.338938  7707 raft_consensus.cc:2749] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:18.363998  7707 raft_consensus.cc:493] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.364524  7707 raft_consensus.cc:515] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.366276  7707 leader_election.cc:290] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:18.368119  7561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a347ffd6e71445a8c01ccc22b42f064" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:18.368774  7561 raft_consensus.cc:2468] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 1.
I20260709 12:16:18.369915  7452 leader_election.cc:304] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, 86d91c5ff0bd4582bf410ce99edeb328; no voters: 
I20260709 12:16:18.370801  7707 raft_consensus.cc:2804] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:16:18.370823  7452 leader_election.cc:336] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.371199  7707 raft_consensus.cc:493] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.371628  7707 raft_consensus.cc:3060] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:18.377544  7707 raft_consensus.cc:515] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.379294  7707 leader_election.cc:290] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:18.381104  7561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a347ffd6e71445a8c01ccc22b42f064" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:18.381322  7707 raft_consensus.cc:493] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.381807  7561 raft_consensus.cc:3060] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:18.381883  7707 raft_consensus.cc:515] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
W20260709 12:16:18.383244  7452 leader_election.cc:336] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.384166  7707 leader_election.cc:290] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:18.385869  7560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0cee7f7f014985974db72216d12e7a" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
W20260709 12:16:18.387988  7452 leader_election.cc:336] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.388419  7452 leader_election.cc:304] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328; no voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:18.389134  7707 raft_consensus.cc:2749] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:18.389961  7561 raft_consensus.cc:2468] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 2.
I20260709 12:16:18.391191  7452 leader_election.cc:304] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, 86d91c5ff0bd4582bf410ce99edeb328; no voters: ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:18.392076  7707 raft_consensus.cc:2804] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:18.393042  7707 raft_consensus.cc:697] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 LEADER]: Becoming Leader. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Running, Role: LEADER
I20260709 12:16:18.394421  7707 consensus_queue.cc:237] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.394901  7711 raft_consensus.cc:493] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.395627  7711 raft_consensus.cc:515] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.397459  7711 leader_election.cc:290] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:18.398818  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6b8b5e1a9a4100bfe8f0de30969e2d" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
W20260709 12:16:18.402225  7526 leader_election.cc:336] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.402813  7526 leader_election.cc:304] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a; no voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:18.403558  7711 raft_consensus.cc:2749] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:18.404589  7310 catalog_manager.cc:5697] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 reported cstate change: term changed from 1 to 2, leader changed from ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65) to 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66). New cstate: current_term: 2 leader_uuid: "86d91c5ff0bd4582bf410ce99edeb328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:18.445072  7711 raft_consensus.cc:493] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.445658  7711 raft_consensus.cc:515] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.447592  7711 leader_election.cc:290] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:18.448906  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce96956ac94f4b18bc33fd50153efab8" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
I20260709 12:16:18.449689  7487 raft_consensus.cc:2468] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 1.
I20260709 12:16:18.450865  7527 leader_election.cc:304] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, 86d91c5ff0bd4582bf410ce99edeb328; no voters: 
W20260709 12:16:18.451519  7526 leader_election.cc:336] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.451612  7711 raft_consensus.cc:2804] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:18.452070  7711 raft_consensus.cc:493] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.452378  7711 raft_consensus.cc:3060] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:18.458127  7711 raft_consensus.cc:515] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.459884  7711 leader_election.cc:290] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:18.461109  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce96956ac94f4b18bc33fd50153efab8" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:18.461885  7487 raft_consensus.cc:3060] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:18.464334  7526 leader_election.cc:336] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.468323  7487 raft_consensus.cc:2468] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 2.
I20260709 12:16:18.469520  7527 leader_election.cc:304] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, 86d91c5ff0bd4582bf410ce99edeb328; no voters: ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:18.470254  7711 raft_consensus.cc:2804] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:18.470729  7711 raft_consensus.cc:697] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Becoming Leader. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Running, Role: LEADER
I20260709 12:16:18.471583  7711 consensus_queue.cc:237] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.479197  7310 catalog_manager.cc:5697] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a reported cstate change: term changed from 1 to 2, leader changed from ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65) to 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67). New cstate: current_term: 2 leader_uuid: "1cf436d0350e46ebaebd98718017cc0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:18.491822  7707 raft_consensus.cc:493] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.492420  7707 raft_consensus.cc:515] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.494233  7707 leader_election.cc:290] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:18.495934  7561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:18.496598  7561 raft_consensus.cc:2468] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 2.
I20260709 12:16:18.497608  7452 leader_election.cc:304] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, 86d91c5ff0bd4582bf410ce99edeb328; no voters: 
I20260709 12:16:18.498304  7707 raft_consensus.cc:2804] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:16:18.498334  7452 leader_election.cc:336] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.498769  7707 raft_consensus.cc:493] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.499121  7707 raft_consensus.cc:3060] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:18.502761  7712 raft_consensus.cc:493] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.503358  7712 raft_consensus.cc:515] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.505046  7707 raft_consensus.cc:515] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.505443  7712 leader_election.cc:290] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:18.507128  7561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6b8b5e1a9a4100bfe8f0de30969e2d" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:18.507620  7707 leader_election.cc:290] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 3 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:18.507851  7561 raft_consensus.cc:2468] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 1.
I20260709 12:16:18.509548  7561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:18.509617  7452 leader_election.cc:304] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, 86d91c5ff0bd4582bf410ce99edeb328; no voters: 
I20260709 12:16:18.510167  7561 raft_consensus.cc:3060] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:18.510494  7707 raft_consensus.cc:2804] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:16:18.510582  7452 leader_election.cc:336] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.511126  7707 raft_consensus.cc:493] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.511543  7707 raft_consensus.cc:3060] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:18.514593  7452 leader_election.cc:336] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.517634  7561 raft_consensus.cc:2468] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 3.
I20260709 12:16:18.518352  7712 raft_consensus.cc:493] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.518711  7707 raft_consensus.cc:515] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.519052  7452 leader_election.cc:304] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, 86d91c5ff0bd4582bf410ce99edeb328; no voters: ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:18.519050  7712 raft_consensus.cc:515] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.521426  7719 raft_consensus.cc:2804] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:18.521431  7707 leader_election.cc:290] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:18.521611  7712 leader_election.cc:290] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:18.524251  7560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d6e2ea81954f098f276b0ee1628d50" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:18.524408  7561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6b8b5e1a9a4100bfe8f0de30969e2d" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:18.524945  7719 raft_consensus.cc:697] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 LEADER]: Becoming Leader. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Running, Role: LEADER
I20260709 12:16:18.525243  7561 raft_consensus.cc:3060] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:18.526161  7719 consensus_queue.cc:237] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
W20260709 12:16:18.529155  7452 leader_election.cc:336] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
W20260709 12:16:18.529729  7452 leader_election.cc:336] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.530067  7452 leader_election.cc:304] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328; no voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:18.530788  7720 raft_consensus.cc:2749] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:18.533919  7711 raft_consensus.cc:493] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.534649  7711 raft_consensus.cc:515] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.535228  7561 raft_consensus.cc:2468] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 2.
I20260709 12:16:18.536496  7452 leader_election.cc:304] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, 86d91c5ff0bd4582bf410ce99edeb328; no voters: ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:18.537742  7719 raft_consensus.cc:2804] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:18.538132  7711 leader_election.cc:290] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:18.538161  7719 raft_consensus.cc:697] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 LEADER]: Becoming Leader. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Running, Role: LEADER
I20260709 12:16:18.538458  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d6e2ea81954f098f276b0ee1628d50" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
I20260709 12:16:18.539229  7487 raft_consensus.cc:2468] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 1.
I20260709 12:16:18.539407  7719 consensus_queue.cc:237] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.541033  7527 leader_election.cc:304] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, 86d91c5ff0bd4582bf410ce99edeb328; no voters: 
I20260709 12:16:18.542018  7711 raft_consensus.cc:2804] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:18.542354  7310 catalog_manager.cc:5697] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 reported cstate change: term changed from 2 to 3, leader changed from ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65) to 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66). New cstate: current_term: 3 leader_uuid: "86d91c5ff0bd4582bf410ce99edeb328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:18.543802  7526 leader_election.cc:336] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.542426  7711 raft_consensus.cc:493] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.545396  7711 raft_consensus.cc:3060] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:18.552981  7711 raft_consensus.cc:515] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.555435  7711 leader_election.cc:290] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:18.556083  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d6e2ea81954f098f276b0ee1628d50" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:18.556804  7487 raft_consensus.cc:3060] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:18.557307  7310 catalog_manager.cc:5697] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 reported cstate change: term changed from 1 to 2, leader changed from ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65) to 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66). New cstate: current_term: 2 leader_uuid: "86d91c5ff0bd4582bf410ce99edeb328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:18.559129  7526 leader_election.cc:336] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.560060  7711 raft_consensus.cc:493] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.560679  7711 raft_consensus.cc:515] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.565042  7711 leader_election.cc:290] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:18.565639  7487 raft_consensus.cc:2468] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 2.
I20260709 12:16:18.565735  7484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410149d03e2e411b9ad55a216ccee270" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
I20260709 12:16:18.566569  7484 raft_consensus.cc:2468] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 1.
I20260709 12:16:18.567414  7527 leader_election.cc:304] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, 86d91c5ff0bd4582bf410ce99edeb328; no voters: ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:18.568804  7527 leader_election.cc:304] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, 86d91c5ff0bd4582bf410ce99edeb328; no voters: 
I20260709 12:16:18.569197  7711 raft_consensus.cc:2804] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:18.569770  7710 raft_consensus.cc:2804] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:16:18.569932  7526 leader_election.cc:336] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.570266  7710 raft_consensus.cc:493] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.570760  7711 raft_consensus.cc:697] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Becoming Leader. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Running, Role: LEADER
I20260709 12:16:18.570926  7710 raft_consensus.cc:3060] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:18.571786  7711 consensus_queue.cc:237] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.579136  7710 raft_consensus.cc:515] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.579819  7711 raft_consensus.cc:493] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.580088  7310 catalog_manager.cc:5697] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a reported cstate change: term changed from 1 to 2, leader changed from ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65) to 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67). New cstate: current_term: 2 leader_uuid: "1cf436d0350e46ebaebd98718017cc0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:18.580443  7711 raft_consensus.cc:515] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.582726  7711 leader_election.cc:290] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:18.583297  7710 leader_election.cc:290] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:18.584033  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410149d03e2e411b9ad55a216ccee270" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:18.584033  7484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0cee7f7f014985974db72216d12e7a" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328" is_pre_election: true
I20260709 12:16:18.584916  7487 raft_consensus.cc:3060] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:18.584990  7484 raft_consensus.cc:2468] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 1.
I20260709 12:16:18.586568  7527 leader_election.cc:304] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, 86d91c5ff0bd4582bf410ce99edeb328; no voters: 
I20260709 12:16:18.587489  7710 raft_consensus.cc:2804] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:18.587860  7710 raft_consensus.cc:493] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.588228  7710 raft_consensus.cc:3060] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:18.588799  7526 leader_election.cc:336] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
W20260709 12:16:18.589449  7526 leader_election.cc:336] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.594329  7487 raft_consensus.cc:2468] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 2.
I20260709 12:16:18.595706  7527 leader_election.cc:304] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, 86d91c5ff0bd4582bf410ce99edeb328; no voters: ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:18.596593  7711 raft_consensus.cc:2804] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:18.597077  7711 raft_consensus.cc:697] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Becoming Leader. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Running, Role: LEADER
I20260709 12:16:18.596863  7710 raft_consensus.cc:515] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.597930  7711 consensus_queue.cc:237] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.598948  7710 leader_election.cc:290] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:18.600117  7487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0cee7f7f014985974db72216d12e7a" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:18.600768  7487 raft_consensus.cc:3060] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:18.603636  7526 leader_election.cc:336] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.607589  7310 catalog_manager.cc:5697] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a reported cstate change: term changed from 1 to 2, leader changed from ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65) to 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67). New cstate: current_term: 2 leader_uuid: "1cf436d0350e46ebaebd98718017cc0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:18.608691  7487 raft_consensus.cc:2468] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 2.
I20260709 12:16:18.609948  7527 leader_election.cc:304] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, 86d91c5ff0bd4582bf410ce99edeb328; no voters: ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:18.612826  7711 raft_consensus.cc:2804] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:18.613385  7711 raft_consensus.cc:697] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Becoming Leader. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Running, Role: LEADER
I20260709 12:16:18.614192  7711 consensus_queue.cc:237] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:18.621965  7310 catalog_manager.cc:5697] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a reported cstate change: term changed from 1 to 2, leader changed from ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65) to 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67). New cstate: current_term: 2 leader_uuid: "1cf436d0350e46ebaebd98718017cc0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:18.677726  7719 raft_consensus.cc:493] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.678344  7719 raft_consensus.cc:515] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } }
I20260709 12:16:18.680115  7719 leader_election.cc:290] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:18.681840  7561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09606ff486a4308b404dea23791c522" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a" is_pre_election: true
I20260709 12:16:18.682555  7561 raft_consensus.cc:2468] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 1.
I20260709 12:16:18.683600  7452 leader_election.cc:304] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, 86d91c5ff0bd4582bf410ce99edeb328; no voters: 
I20260709 12:16:18.684389  7719 raft_consensus.cc:2804] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:16:18.684413  7452 leader_election.cc:336] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.684785  7719 raft_consensus.cc:493] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea5edb9dbe9743e580031bfe1d2d50b1)
I20260709 12:16:18.685168  7719 raft_consensus.cc:3060] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:18.690738  7719 raft_consensus.cc:515] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } }
I20260709 12:16:18.692891  7719 leader_election.cc:290] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:18.694582  7561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09606ff486a4308b404dea23791c522" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:18.695187  7561 raft_consensus.cc:3060] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:18.696867  7452 leader_election.cc:336] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111)
I20260709 12:16:18.700927  7561 raft_consensus.cc:2468] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 2.
I20260709 12:16:18.702133  7452 leader_election.cc:304] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, 86d91c5ff0bd4582bf410ce99edeb328; no voters: ea5edb9dbe9743e580031bfe1d2d50b1
I20260709 12:16:18.703022  7719 raft_consensus.cc:2804] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:18.703413  7719 raft_consensus.cc:697] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 LEADER]: Becoming Leader. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Running, Role: LEADER
I20260709 12:16:18.704121  7719 consensus_queue.cc:237] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } }
I20260709 12:16:18.712245  7310 catalog_manager.cc:5697] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 reported cstate change: term changed from 1 to 2, leader changed from ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65) to 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66). New cstate: current_term: 2 leader_uuid: "86d91c5ff0bd4582bf410ce99edeb328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:19.236341  7358 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:16:19.376773  7526 consensus_peers.cc:597] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:19.377324  7526 consensus_peers.cc:597] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:19.396257  7526 consensus_peers.cc:597] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:19.396884  7526 consensus_peers.cc:597] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:19.408164  7561 raft_consensus.cc:1275] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Refusing update from remote peer 86d91c5ff0bd4582bf410ce99edeb328: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 1. (index mismatch)
I20260709 12:16:19.409205  7486 raft_consensus.cc:1275] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Refusing update from remote peer 1cf436d0350e46ebaebd98718017cc0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:19.410089  7484 raft_consensus.cc:1275] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Refusing update from remote peer 1cf436d0350e46ebaebd98718017cc0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:19.410979  7485 raft_consensus.cc:1275] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Refusing update from remote peer 1cf436d0350e46ebaebd98718017cc0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:19.411749  7732 consensus_queue.cc:1048] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:19.412801  7486 raft_consensus.cc:1275] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Refusing update from remote peer 1cf436d0350e46ebaebd98718017cc0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:19.413370  7732 consensus_queue.cc:1048] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:19.414740  7728 consensus_queue.cc:1048] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:19.415549  7731 consensus_queue.cc:1048] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:19.446962  7561 raft_consensus.cc:1275] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Refusing update from remote peer 86d91c5ff0bd4582bf410ce99edeb328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:19.452095  7561 raft_consensus.cc:1275] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Refusing update from remote peer 86d91c5ff0bd4582bf410ce99edeb328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:19.456418  7736 consensus_queue.cc:1048] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:19.458470  7736 consensus_queue.cc:1048] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:19.460276  7736 consensus_queue.cc:1048] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:19.486580  7559 raft_consensus.cc:1275] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Refusing update from remote peer 86d91c5ff0bd4582bf410ce99edeb328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:19.485743  7452 consensus_peers.cc:597] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:19.490119  7452 consensus_peers.cc:597] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:19.490833  7452 consensus_peers.cc:597] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:19.494484  7452 consensus_peers.cc:597] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:19.496819  7734 consensus_queue.cc:1048] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:19.842299  7452 consensus_peers.cc:597] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:20.237921  7358 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:16:20.251646  7526 consensus_peers.cc:597] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:20.385696  7582 debug-util.cc:398] Leaking SignalData structure 0x7b0800249d80 after lost signal to thread 25296
W20260709 12:16:20.387241  7582 debug-util.cc:398] Leaking SignalData structure 0x7b08001d2180 after lost signal to thread 7344
W20260709 12:16:20.389003  7582 debug-util.cc:398] Leaking SignalData structure 0x7b0800086860 after lost signal to thread 7511
W20260709 12:16:20.390638  7582 debug-util.cc:398] Leaking SignalData structure 0x7b08001df3e0 after lost signal to thread 7585
W20260709 12:16:21.239099  7358 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:16:21.687031  7526 consensus_peers.cc:597] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:21.738176  7526 consensus_peers.cc:597] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:21.755733  7526 consensus_peers.cc:597] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:21.812129  7526 consensus_peers.cc:597] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:22.021638  7452 consensus_peers.cc:597] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:22.022091  7452 consensus_peers.cc:597] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:22.049072  7452 consensus_peers.cc:597] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:22.092335  7452 consensus_peers.cc:597] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:22.240540  7358 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:16:22.253647  7526 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111) [suppressed 91 similar messages]
W20260709 12:16:22.606631  7452 consensus_peers.cc:597] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:22.756238 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:22.766856  7763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:22.774235  7764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:22.780997  7766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:22.781651 25293 server_base.cc:1061] running on GCE node
I20260709 12:16:22.784461 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:22.784730 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:22.784951 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599382784928 us; error 0 us; skew 500 ppm
I20260709 12:16:22.785655 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:22.789528 25293 webserver.cc:533] Webserver started at http://127.24.179.65:42113/ using document root <none> and password file <none>
I20260709 12:16:22.791354 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:22.791772 25293 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 12:16:22.797945  7526 consensus_peers.cc:597] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:22.799381 25293 fs_manager.cc:714] Time spent opening directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:16:22.805081  7771 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:22.806207 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:16:22.806602 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/ts-0-root
uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
format_stamp: "Formatted at 2026-07-09 12:16:13 on dist-test-slave-tjfs"
I20260709 12:16:22.807103 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894834136-25293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:22.834286 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:22.836427 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:22.838850 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:22.845322  7778 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:16:22.912523 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:16:22.912863 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.069s	user 0.003s	sys 0.001s
I20260709 12:16:22.913241 25293 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:16:22.919945  7778 tablet_bootstrap.cc:492] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap starting.
I20260709 12:16:22.941768  7778 tablet_bootstrap.cc:492] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:22.943177  7778 tablet_bootstrap.cc:492] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap complete.
I20260709 12:16:22.944211  7778 ts_tablet_manager.cc:1403] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.005s
I20260709 12:16:22.948529  7778 raft_consensus.cc:359] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:22.950028  7778 raft_consensus.cc:740] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.951349  7778 consensus_queue.cc:260] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:22.958916  7778 ts_tablet_manager.cc:1434] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:16:22.959972  7778 tablet_bootstrap.cc:492] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap starting.
I20260709 12:16:22.979503  7778 tablet_bootstrap.cc:492] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:22.980645  7778 tablet_bootstrap.cc:492] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap complete.
I20260709 12:16:22.981453  7778 ts_tablet_manager.cc:1403] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 12:16:22.984652  7778 raft_consensus.cc:359] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:22.985441  7778 raft_consensus.cc:740] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.986572 25293 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:16:22.986214  7778 consensus_queue.cc:260] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:22.987005 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.074s	user 0.073s	sys 0.000s
I20260709 12:16:22.988929  7778 ts_tablet_manager.cc:1434] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent starting tablet: real 0.007s	user 0.010s	sys 0.000s
I20260709 12:16:22.990170  7778 tablet_bootstrap.cc:492] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap starting.
I20260709 12:16:23.016963  7778 tablet_bootstrap.cc:492] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:16:23.018573  7778 tablet_bootstrap.cc:492] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap complete.
I20260709 12:16:23.019743  7778 ts_tablet_manager.cc:1403] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.008s
I20260709 12:16:23.023813  7778 raft_consensus.cc:359] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:23.025274  7778 raft_consensus.cc:740] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.026690  7778 consensus_queue.cc:260] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:23.030951  7778 ts_tablet_manager.cc:1434] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:16:23.032250  7778 tablet_bootstrap.cc:492] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap starting.
I20260709 12:16:23.054273  7778 tablet_bootstrap.cc:492] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:23.055670  7778 tablet_bootstrap.cc:492] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap complete.
I20260709 12:16:23.056625  7778 ts_tablet_manager.cc:1403] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.004s
I20260709 12:16:23.060029  7778 raft_consensus.cc:359] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:23.061121  7778 raft_consensus.cc:740] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.062270  7778 consensus_queue.cc:260] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:23.065245  7778 ts_tablet_manager.cc:1434] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:16:23.066524  7778 tablet_bootstrap.cc:492] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap starting.
I20260709 12:16:23.087520 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.65:41773
I20260709 12:16:23.087846  7841 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.65:41773 every 8 connection(s)
I20260709 12:16:23.089048  7778 tablet_bootstrap.cc:492] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:23.090036  7778 tablet_bootstrap.cc:492] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap complete.
I20260709 12:16:23.090780  7778 ts_tablet_manager.cc:1403] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.007s
I20260709 12:16:23.093788  7778 raft_consensus.cc:359] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:23.094758  7778 raft_consensus.cc:740] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.095793  7778 consensus_queue.cc:260] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:23.098748  7778 ts_tablet_manager.cc:1434] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:23.099841  7778 tablet_bootstrap.cc:492] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap starting.
I20260709 12:16:23.111327 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:23.145291  7778 tablet_bootstrap.cc:492] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:23.146664  7778 tablet_bootstrap.cc:492] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap complete.
I20260709 12:16:23.147619  7778 ts_tablet_manager.cc:1403] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.004s
I20260709 12:16:23.151166  7778 raft_consensus.cc:359] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:23.152132  7778 raft_consensus.cc:740] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.153163  7778 consensus_queue.cc:260] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:23.156169  7778 ts_tablet_manager.cc:1434] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:16:23.157120  7778 tablet_bootstrap.cc:492] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap starting.
I20260709 12:16:23.180987  7484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb"
dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
mode: GRACEFUL
new_leader_uuid: "1cf436d0350e46ebaebd98718017cc0a"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:16:23.182688  7484 raft_consensus.cc:606] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 LEADER]: Received request to transfer leadership to TS 1cf436d0350e46ebaebd98718017cc0a
I20260709 12:16:23.185110  7816 raft_consensus.cc:3060] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:23.194078  7842 heartbeater.cc:344] Connected to a master server at 127.24.179.126:37135
I20260709 12:16:23.194811  7842 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:23.196144  7842 heartbeater.cc:507] Master 127.24.179.126:37135 requested a full tablet report, sending...
I20260709 12:16:23.199501  7484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e09606ff486a4308b404dea23791c522"
dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
mode: GRACEFUL
new_leader_uuid: "1cf436d0350e46ebaebd98718017cc0a"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:16:23.200510  7484 raft_consensus.cc:606] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 LEADER]: Received request to transfer leadership to TS 1cf436d0350e46ebaebd98718017cc0a
I20260709 12:16:23.201259  7778 tablet_bootstrap.cc:492] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:23.205871  7778 tablet_bootstrap.cc:492] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap complete.
I20260709 12:16:23.206674  7778 ts_tablet_manager.cc:1403] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.011s
I20260709 12:16:23.210749  7778 raft_consensus.cc:359] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:23.211863  7778 raft_consensus.cc:740] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.213263  7778 consensus_queue.cc:260] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:23.217084  7778 ts_tablet_manager.cc:1434] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:16:23.218575  7778 tablet_bootstrap.cc:492] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap starting.
I20260709 12:16:23.234790  7560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4d6e2ea81954f098f276b0ee1628d50"
dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
mode: GRACEFUL
new_leader_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
 from {username='slave'} at 127.0.0.1:57878
I20260709 12:16:23.235673  7560 raft_consensus.cc:606] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Received request to transfer leadership to TS 86d91c5ff0bd4582bf410ce99edeb328
I20260709 12:16:23.238191 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:16:23.239051 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:23.240123 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:16:23.241847  7358 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:16:23.243700  7815 raft_consensus.cc:3060] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:23.250957  7814 raft_consensus.cc:3060] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:23.279316  7778 tablet_bootstrap.cc:492] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:23.291929  7778 tablet_bootstrap.cc:492] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap complete.
I20260709 12:16:23.293223  7778 ts_tablet_manager.cc:1403] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent bootstrapping tablet: real 0.075s	user 0.025s	sys 0.008s
I20260709 12:16:23.297000  7778 raft_consensus.cc:359] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:23.297948  7778 raft_consensus.cc:740] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.299041  7778 consensus_queue.cc:260] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:23.302688  7308 ts_manager.cc:194] Re-registered known tserver with Master: ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773)
I20260709 12:16:23.305899  7778 ts_tablet_manager.cc:1434] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:16:23.307237  7778 tablet_bootstrap.cc:492] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap starting.
I20260709 12:16:23.316591  7308 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43576
I20260709 12:16:23.321774  7842 heartbeater.cc:499] Master 127.24.179.126:37135 was elected leader, sending a full tablet report...
I20260709 12:16:23.325659  7778 tablet_bootstrap.cc:492] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:23.326911  7778 tablet_bootstrap.cc:492] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap complete.
I20260709 12:16:23.327696  7778 ts_tablet_manager.cc:1403] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 12:16:23.330687  7778 raft_consensus.cc:359] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:23.331561  7778 raft_consensus.cc:740] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.332476  7778 consensus_queue.cc:260] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:23.334941  7778 ts_tablet_manager.cc:1434] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:23.335991  7778 tablet_bootstrap.cc:492] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap starting.
I20260709 12:16:23.353286  7778 tablet_bootstrap.cc:492] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:23.354137  7778 tablet_bootstrap.cc:492] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1: Bootstrap complete.
I20260709 12:16:23.354836  7778 ts_tablet_manager.cc:1403] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 12:16:23.356921  7778 raft_consensus.cc:359] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } }
I20260709 12:16:23.357493  7778 raft_consensus.cc:740] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5edb9dbe9743e580031bfe1d2d50b1, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.358120  7778 consensus_queue.cc:260] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } }
I20260709 12:16:23.360121  7778 ts_tablet_manager.cc:1434] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 12:16:23.374526  7814 raft_consensus.cc:3060] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:23.380903  7814 pending_rounds.cc:85] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1: Aborting all ops after (but not including) 0
I20260709 12:16:23.381194  7814 pending_rounds.cc:107] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1: Aborting uncommitted NO_OP operation due to leader change: 2.1
I20260709 12:16:23.381498  7814 raft_consensus.cc:2889] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:23.383322  7815 raft_consensus.cc:3060] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:23.432114  7783 raft_consensus.cc:993] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328: : Instructing follower 1cf436d0350e46ebaebd98718017cc0a to start an election
I20260709 12:16:23.432895  7761 raft_consensus.cc:1081] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 LEADER]: Signalling peer 1cf436d0350e46ebaebd98718017cc0a to start an election
I20260709 12:16:23.432976  7815 raft_consensus.cc:3060] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:23.434978  7560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb"
dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
 from {username='slave'} at 127.0.0.1:51030
I20260709 12:16:23.435806  7560 raft_consensus.cc:493] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:23.436282  7560 raft_consensus.cc:3060] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:23.447166  7560 raft_consensus.cc:515] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:23.450063  7560 leader_election.cc:290] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:23.450804  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
I20260709 12:16:23.451417  7484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:23.451771  7815 raft_consensus.cc:3060] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:23.452174  7484 raft_consensus.cc:3055] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:23.452548  7484 raft_consensus.cc:740] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Running, Role: LEADER
I20260709 12:16:23.453626  7484 consensus_queue.cc:260] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:23.455227  7484 raft_consensus.cc:3060] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:23.461272  7815 raft_consensus.cc:2468] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 2.
I20260709 12:16:23.462831  7526 leader_election.cc:304] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:23.463845  7856 raft_consensus.cc:2804] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:23.464376  7856 raft_consensus.cc:697] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Becoming Leader. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Running, Role: LEADER
I20260709 12:16:23.464931  7484 raft_consensus.cc:2468] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 2.
I20260709 12:16:23.465543  7856 consensus_queue.cc:237] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:23.474574  7308 catalog_manager.cc:5697] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a reported cstate change: term changed from 1 to 2, leader changed from 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66) to 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67). New cstate: current_term: 2 leader_uuid: "1cf436d0350e46ebaebd98718017cc0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:23.487872  7815 raft_consensus.cc:3060] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:23.548349  7783 raft_consensus.cc:993] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328: : Instructing follower 1cf436d0350e46ebaebd98718017cc0a to start an election
I20260709 12:16:23.548983  7872 raft_consensus.cc:1081] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 LEADER]: Signalling peer 1cf436d0350e46ebaebd98718017cc0a to start an election
I20260709 12:16:23.550876  7560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e09606ff486a4308b404dea23791c522"
dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
 from {username='slave'} at 127.0.0.1:51030
I20260709 12:16:23.551426  7560 raft_consensus.cc:493] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:23.551759  7560 raft_consensus.cc:3060] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:23.558499  7560 raft_consensus.cc:515] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } }
I20260709 12:16:23.560518  7560 leader_election.cc:290] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 3 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:23.561420  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09606ff486a4308b404dea23791c522" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
I20260709 12:16:23.561764  7484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e09606ff486a4308b404dea23791c522" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:23.562095  7815 raft_consensus.cc:3060] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:23.562503  7484 raft_consensus.cc:3055] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:23.562849  7484 raft_consensus.cc:740] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Running, Role: LEADER
I20260709 12:16:23.563829  7484 consensus_queue.cc:260] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } }
I20260709 12:16:23.564949  7484 raft_consensus.cc:3060] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:23.568892  7815 raft_consensus.cc:2468] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 3.
I20260709 12:16:23.570274  7526 leader_election.cc:304] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:23.571218  7856 raft_consensus.cc:2804] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:23.571672  7856 raft_consensus.cc:697] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 3 LEADER]: Becoming Leader. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Running, Role: LEADER
I20260709 12:16:23.571740  7484 raft_consensus.cc:2468] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 3.
I20260709 12:16:23.572592  7856 consensus_queue.cc:237] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } }
I20260709 12:16:23.581272  7308 catalog_manager.cc:5697] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a reported cstate change: term changed from 2 to 3, leader changed from 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66) to 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67). New cstate: current_term: 3 leader_uuid: "1cf436d0350e46ebaebd98718017cc0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:23.639516  7760 raft_consensus.cc:993] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a: : Instructing follower 86d91c5ff0bd4582bf410ce99edeb328 to start an election
I20260709 12:16:23.640091  7874 raft_consensus.cc:1081] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Signalling peer 86d91c5ff0bd4582bf410ce99edeb328 to start an election
I20260709 12:16:23.641922  7484 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4d6e2ea81954f098f276b0ee1628d50"
dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
 from {username='slave'} at 127.0.0.1:52506
I20260709 12:16:23.642532  7484 raft_consensus.cc:493] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:23.642877  7484 raft_consensus.cc:3060] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:23.649081  7484 raft_consensus.cc:515] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:23.651237  7484 leader_election.cc:290] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 3 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:23.651929  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d6e2ea81954f098f276b0ee1628d50" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
I20260709 12:16:23.652722  7815 raft_consensus.cc:3060] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:23.652901  7560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d6e2ea81954f098f276b0ee1628d50" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:23.653533  7560 raft_consensus.cc:3055] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:23.653764  7560 raft_consensus.cc:740] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Running, Role: LEADER
I20260709 12:16:23.654695  7560 consensus_queue.cc:260] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:23.655813  7560 raft_consensus.cc:3060] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:23.660262  7815 raft_consensus.cc:2468] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 3.
I20260709 12:16:23.661489  7452 leader_election.cc:304] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:23.662286  7872 raft_consensus.cc:2804] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:23.662846  7872 raft_consensus.cc:697] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 LEADER]: Becoming Leader. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Running, Role: LEADER
I20260709 12:16:23.663277  7560 raft_consensus.cc:2468] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 3.
I20260709 12:16:23.664031  7872 consensus_queue.cc:237] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:23.673692  7307 catalog_manager.cc:5697] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 reported cstate change: term changed from 2 to 3, leader changed from 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67) to 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66). New cstate: current_term: 3 leader_uuid: "86d91c5ff0bd4582bf410ce99edeb328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:23.833467  7815 raft_consensus.cc:3060] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:23.978250  7815 raft_consensus.cc:1275] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 FOLLOWER]: Refusing update from remote peer 1cf436d0350e46ebaebd98718017cc0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:23.979457  7874 consensus_queue.cc:1048] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:23.996447  7484 raft_consensus.cc:1275] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Refusing update from remote peer 1cf436d0350e46ebaebd98718017cc0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:23.998112  7760 consensus_queue.cc:1048] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:24.144549  7484 raft_consensus.cc:1275] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Refusing update from remote peer 1cf436d0350e46ebaebd98718017cc0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:24.145890  7760 consensus_queue.cc:1048] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:24.156414  7814 raft_consensus.cc:1275] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Refusing update from remote peer 1cf436d0350e46ebaebd98718017cc0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:24.158605  7874 consensus_queue.cc:1048] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:24.167492  7560 raft_consensus.cc:1275] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Refusing update from remote peer 86d91c5ff0bd4582bf410ce99edeb328: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:24.169021  7761 consensus_queue.cc:1048] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:24.181056  7815 raft_consensus.cc:1275] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Refusing update from remote peer 86d91c5ff0bd4582bf410ce99edeb328: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:24.186465  7783 consensus_queue.cc:1048] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:16:24.243054  7358 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:16:24.287310 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:24.295414  7560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb"
dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
mode: GRACEFUL
new_leader_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
 from {username='slave'} at 127.0.0.1:57878
I20260709 12:16:24.296077  7560 raft_consensus.cc:606] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Received request to transfer leadership to TS 86d91c5ff0bd4582bf410ce99edeb328
I20260709 12:16:24.299063  7484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e6b8b5e1a9a4100bfe8f0de30969e2d"
dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
mode: GRACEFUL
new_leader_uuid: "1cf436d0350e46ebaebd98718017cc0a"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:16:24.299743  7484 raft_consensus.cc:606] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 LEADER]: Received request to transfer leadership to TS 1cf436d0350e46ebaebd98718017cc0a
I20260709 12:16:24.303031  7560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce96956ac94f4b18bc33fd50153efab8"
dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
mode: GRACEFUL
new_leader_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
 from {username='slave'} at 127.0.0.1:57878
I20260709 12:16:24.303668  7560 raft_consensus.cc:606] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Received request to transfer leadership to TS 86d91c5ff0bd4582bf410ce99edeb328
I20260709 12:16:24.304811 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:16:24.305289 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:24.305872 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:24.513676  7872 raft_consensus.cc:993] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328: : Instructing follower 1cf436d0350e46ebaebd98718017cc0a to start an election
I20260709 12:16:24.514174  7783 raft_consensus.cc:1081] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 LEADER]: Signalling peer 1cf436d0350e46ebaebd98718017cc0a to start an election
I20260709 12:16:24.516013  7560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e6b8b5e1a9a4100bfe8f0de30969e2d"
dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
 from {username='slave'} at 127.0.0.1:51030
I20260709 12:16:24.516628  7560 raft_consensus.cc:493] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:24.516997  7560 raft_consensus.cc:3060] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:24.523912  7560 raft_consensus.cc:515] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:24.525743  7560 leader_election.cc:290] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 3 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:24.526810  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6b8b5e1a9a4100bfe8f0de30969e2d" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
I20260709 12:16:24.527025  7484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6b8b5e1a9a4100bfe8f0de30969e2d" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:24.527551  7815 raft_consensus.cc:3060] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:24.527762  7484 raft_consensus.cc:3055] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:24.528182  7484 raft_consensus.cc:740] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Running, Role: LEADER
I20260709 12:16:24.528937  7484 consensus_queue.cc:260] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:24.530144  7484 raft_consensus.cc:3060] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:24.534152  7815 raft_consensus.cc:2468] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 3.
I20260709 12:16:24.535502  7526 leader_election.cc:304] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:24.536298  7874 raft_consensus.cc:2804] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:24.536809  7874 raft_consensus.cc:697] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 3 LEADER]: Becoming Leader. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Running, Role: LEADER
I20260709 12:16:24.537240  7484 raft_consensus.cc:2468] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 3.
I20260709 12:16:24.537931  7874 consensus_queue.cc:237] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:24.546638  7307 catalog_manager.cc:5697] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a reported cstate change: term changed from 2 to 3, leader changed from 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66) to 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67). New cstate: current_term: 3 leader_uuid: "1cf436d0350e46ebaebd98718017cc0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:24.593508  7856 raft_consensus.cc:993] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a: : Instructing follower 86d91c5ff0bd4582bf410ce99edeb328 to start an election
I20260709 12:16:24.593986  7874 raft_consensus.cc:1081] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Signalling peer 86d91c5ff0bd4582bf410ce99edeb328 to start an election
I20260709 12:16:24.595587  7484 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce96956ac94f4b18bc33fd50153efab8"
dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
 from {username='slave'} at 127.0.0.1:52506
I20260709 12:16:24.596084  7484 raft_consensus.cc:493] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:24.596345  7484 raft_consensus.cc:3060] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:24.602329  7484 raft_consensus.cc:515] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:24.604127  7484 leader_election.cc:290] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 3 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:24.605152  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce96956ac94f4b18bc33fd50153efab8" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
I20260709 12:16:24.605362  7560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce96956ac94f4b18bc33fd50153efab8" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:24.605777  7815 raft_consensus.cc:3060] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:24.605986  7560 raft_consensus.cc:3055] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:24.606393  7560 raft_consensus.cc:740] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Running, Role: LEADER
I20260709 12:16:24.607298  7560 consensus_queue.cc:260] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:24.608361  7560 raft_consensus.cc:3060] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:24.612331  7815 raft_consensus.cc:2468] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 3.
I20260709 12:16:24.613704  7452 leader_election.cc:304] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:24.614507  7783 raft_consensus.cc:2804] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:24.614684  7560 raft_consensus.cc:2468] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 3.
I20260709 12:16:24.615047  7783 raft_consensus.cc:697] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 LEADER]: Becoming Leader. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Running, Role: LEADER
I20260709 12:16:24.616178  7783 consensus_queue.cc:237] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:24.619558  7760 raft_consensus.cc:993] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a: : Instructing follower 86d91c5ff0bd4582bf410ce99edeb328 to start an election
I20260709 12:16:24.620317  7874 raft_consensus.cc:1081] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Signalling peer 86d91c5ff0bd4582bf410ce99edeb328 to start an election
I20260709 12:16:24.623039  7484 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb"
dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
 from {username='slave'} at 127.0.0.1:52506
I20260709 12:16:24.623764  7484 raft_consensus.cc:493] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:24.624277  7484 raft_consensus.cc:3060] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:24.630151  7484 raft_consensus.cc:515] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:24.631842  7484 leader_election.cc:290] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 3 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:24.633368  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
I20260709 12:16:24.633298  7560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:24.634147  7815 raft_consensus.cc:3060] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:24.634207  7560 raft_consensus.cc:3055] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:24.634680  7560 raft_consensus.cc:740] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Running, Role: LEADER
I20260709 12:16:24.635607  7560 consensus_queue.cc:260] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:24.636982  7560 raft_consensus.cc:3060] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:24.637125  7307 catalog_manager.cc:5697] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 reported cstate change: term changed from 2 to 3, leader changed from 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67) to 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66). New cstate: current_term: 3 leader_uuid: "86d91c5ff0bd4582bf410ce99edeb328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.643151  7815 raft_consensus.cc:2468] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 3.
I20260709 12:16:24.645560  7452 leader_election.cc:304] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:24.646494  7783 raft_consensus.cc:2804] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:24.647282  7783 raft_consensus.cc:697] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 LEADER]: Becoming Leader. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Running, Role: LEADER
I20260709 12:16:24.648129  7560 raft_consensus.cc:2468] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 3.
I20260709 12:16:24.648213  7783 consensus_queue.cc:237] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:24.656180  7307 catalog_manager.cc:5697] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 reported cstate change: term changed from 2 to 3, leader changed from 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67) to 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66). New cstate: current_term: 3 leader_uuid: "86d91c5ff0bd4582bf410ce99edeb328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.033077  7815 raft_consensus.cc:1275] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Refusing update from remote peer 86d91c5ff0bd4582bf410ce99edeb328: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:25.034485  7888 consensus_queue.cc:1048] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:25.034720  7560 raft_consensus.cc:1275] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Refusing update from remote peer 86d91c5ff0bd4582bf410ce99edeb328: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:25.036554  7888 consensus_queue.cc:1048] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:25.050868  7815 raft_consensus.cc:1275] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Refusing update from remote peer 86d91c5ff0bd4582bf410ce99edeb328: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:25.053884  7783 consensus_queue.cc:1048] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:16:25.057724  7560 raft_consensus.cc:1275] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Refusing update from remote peer 86d91c5ff0bd4582bf410ce99edeb328: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:25.063853  7872 consensus_queue.cc:1048] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:25.097239  7484 raft_consensus.cc:1275] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Refusing update from remote peer 1cf436d0350e46ebaebd98718017cc0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:25.098532  7874 consensus_queue.cc:1048] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:25.108804  7814 raft_consensus.cc:1275] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Refusing update from remote peer 1cf436d0350e46ebaebd98718017cc0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:25.111074  7856 consensus_queue.cc:1048] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:16:25.244123  7358 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:16:25.312971 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:25.320910  7484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb"
dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
mode: GRACEFUL
new_leader_uuid: "1cf436d0350e46ebaebd98718017cc0a"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:16:25.321648  7484 raft_consensus.cc:606] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 LEADER]: Received request to transfer leadership to TS 1cf436d0350e46ebaebd98718017cc0a
I20260709 12:16:25.324663  7560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22b38bab9c6a4955a97108c436ff1bb6"
dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
mode: GRACEFUL
new_leader_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
 from {username='slave'} at 127.0.0.1:57878
I20260709 12:16:25.325215  7560 raft_consensus.cc:606] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 1 LEADER]: Received request to transfer leadership to TS 86d91c5ff0bd4582bf410ce99edeb328
I20260709 12:16:25.328042  7484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9"
dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
mode: GRACEFUL
new_leader_uuid: "1cf436d0350e46ebaebd98718017cc0a"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:16:25.328619  7484 raft_consensus.cc:606] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 LEADER]: Received request to transfer leadership to TS 1cf436d0350e46ebaebd98718017cc0a
I20260709 12:16:25.330034 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:16:25.330699 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:25.331488 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:25.538707  7888 raft_consensus.cc:993] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328: : Instructing follower 1cf436d0350e46ebaebd98718017cc0a to start an election
I20260709 12:16:25.539324  7872 raft_consensus.cc:1081] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 LEADER]: Signalling peer 1cf436d0350e46ebaebd98718017cc0a to start an election
I20260709 12:16:25.541041  7560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb"
dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
 from {username='slave'} at 127.0.0.1:51030
I20260709 12:16:25.541671  7560 raft_consensus.cc:493] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:25.542053  7560 raft_consensus.cc:3060] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:25.548534  7560 raft_consensus.cc:515] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:25.550356  7560 leader_election.cc:290] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 4 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:25.551395  7814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
I20260709 12:16:25.551577  7484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:25.552258  7814 raft_consensus.cc:3060] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:25.552327  7484 raft_consensus.cc:3055] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:25.552836  7484 raft_consensus.cc:740] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Running, Role: LEADER
I20260709 12:16:25.553655  7484 consensus_queue.cc:260] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:25.554754  7484 raft_consensus.cc:3060] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:25.558935  7814 raft_consensus.cc:2468] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 4.
I20260709 12:16:25.560288  7526 leader_election.cc:304] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:25.560525  7484 raft_consensus.cc:2468] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 4.
I20260709 12:16:25.561251  7856 raft_consensus.cc:2804] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:25.561761  7856 raft_consensus.cc:697] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 4 LEADER]: Becoming Leader. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Running, Role: LEADER
I20260709 12:16:25.562628  7856 consensus_queue.cc:237] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:25.569514  7307 catalog_manager.cc:5697] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a reported cstate change: term changed from 3 to 4, leader changed from 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66) to 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67). New cstate: current_term: 4 leader_uuid: "1cf436d0350e46ebaebd98718017cc0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:25.606864  7872 raft_consensus.cc:993] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328: : Instructing follower 1cf436d0350e46ebaebd98718017cc0a to start an election
I20260709 12:16:25.607364  7888 raft_consensus.cc:1081] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 LEADER]: Signalling peer 1cf436d0350e46ebaebd98718017cc0a to start an election
I20260709 12:16:25.609194  7560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9"
dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
 from {username='slave'} at 127.0.0.1:51030
I20260709 12:16:25.609710  7560 raft_consensus.cc:493] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:25.610002  7560 raft_consensus.cc:3060] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:25.615346  7560 raft_consensus.cc:515] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:25.616962  7560 leader_election.cc:290] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 4 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:25.618005  7814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 1 } } ignore_live_leader: true dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
I20260709 12:16:25.618151  7484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 1 } } ignore_live_leader: true dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:25.618852  7814 raft_consensus.cc:3060] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:25.618963  7484 raft_consensus.cc:3055] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:25.619462  7484 raft_consensus.cc:740] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Running, Role: LEADER
I20260709 12:16:25.620092  7484 consensus_queue.cc:260] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.1, Last appended by leader: 1, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:25.621320  7484 raft_consensus.cc:3060] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:25.625910  7814 raft_consensus.cc:2468] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 4.
I20260709 12:16:25.627370  7526 leader_election.cc:304] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:25.627907  7484 raft_consensus.cc:2468] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 4.
I20260709 12:16:25.628165  7856 raft_consensus.cc:2804] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:25.628705  7856 raft_consensus.cc:697] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 4 LEADER]: Becoming Leader. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Running, Role: LEADER
I20260709 12:16:25.629721  7856 consensus_queue.cc:237] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:25.637276  7307 catalog_manager.cc:5697] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a reported cstate change: term changed from 3 to 4, leader changed from 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66) to 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67). New cstate: current_term: 4 leader_uuid: "1cf436d0350e46ebaebd98718017cc0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:25.826566  7906 raft_consensus.cc:993] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a: : Instructing follower 86d91c5ff0bd4582bf410ce99edeb328 to start an election
I20260709 12:16:25.827179  7760 raft_consensus.cc:1081] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 1 LEADER]: Signalling peer 86d91c5ff0bd4582bf410ce99edeb328 to start an election
I20260709 12:16:25.828971  7484 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22b38bab9c6a4955a97108c436ff1bb6"
dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
 from {username='slave'} at 127.0.0.1:52506
I20260709 12:16:25.829442  7484 raft_consensus.cc:493] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:25.829692  7484 raft_consensus.cc:3060] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.835471  7484 raft_consensus.cc:515] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:25.837010  7484 leader_election.cc:290] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:25.838100  7814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b38bab9c6a4955a97108c436ff1bb6" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
I20260709 12:16:25.838341  7560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b38bab9c6a4955a97108c436ff1bb6" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:25.838912  7814 raft_consensus.cc:3060] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.838918  7560 raft_consensus.cc:3055] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:25.839527  7560 raft_consensus.cc:740] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Running, Role: LEADER
I20260709 12:16:25.840456  7560 consensus_queue.cc:260] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:25.841785  7560 raft_consensus.cc:3060] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.847429  7814 raft_consensus.cc:2468] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 2.
I20260709 12:16:25.848981  7452 leader_election.cc:304] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:25.849371  7560 raft_consensus.cc:2468] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 2.
I20260709 12:16:25.849948  7888 raft_consensus.cc:2804] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:25.850669  7888 raft_consensus.cc:697] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 LEADER]: Becoming Leader. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Running, Role: LEADER
I20260709 12:16:25.851567  7888 consensus_queue.cc:237] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:25.858887  7307 catalog_manager.cc:5697] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 reported cstate change: term changed from 1 to 2, leader changed from 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67) to 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66). New cstate: current_term: 2 leader_uuid: "86d91c5ff0bd4582bf410ce99edeb328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.053928  7815 raft_consensus.cc:1275] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 4 FOLLOWER]: Refusing update from remote peer 1cf436d0350e46ebaebd98718017cc0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:16:26.055529  7760 consensus_queue.cc:1048] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:26.073694  7484 raft_consensus.cc:1275] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 4 FOLLOWER]: Refusing update from remote peer 1cf436d0350e46ebaebd98718017cc0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:16:26.075663  7760 consensus_queue.cc:1048] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:26.118332  7815 raft_consensus.cc:1275] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 4 FOLLOWER]: Refusing update from remote peer 1cf436d0350e46ebaebd98718017cc0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:26.119882  7760 consensus_queue.cc:1048] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:26.126914  7484 raft_consensus.cc:1275] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 4 FOLLOWER]: Refusing update from remote peer 1cf436d0350e46ebaebd98718017cc0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:26.131448  7912 consensus_queue.cc:1048] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:16:26.245152  7358 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:16:26.339287 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:26.347101  7560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f0cee7f7f014985974db72216d12e7a"
dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
mode: GRACEFUL
new_leader_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
 from {username='slave'} at 127.0.0.1:57878
I20260709 12:16:26.347604  7560 raft_consensus.cc:606] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Received request to transfer leadership to TS 86d91c5ff0bd4582bf410ce99edeb328
I20260709 12:16:26.350379  7484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a347ffd6e71445a8c01ccc22b42f064"
dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
mode: GRACEFUL
new_leader_uuid: "1cf436d0350e46ebaebd98718017cc0a"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:16:26.351061  7484 raft_consensus.cc:606] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 LEADER]: Received request to transfer leadership to TS 1cf436d0350e46ebaebd98718017cc0a
I20260709 12:16:26.354089  7560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9"
dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
mode: GRACEFUL
new_leader_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
 from {username='slave'} at 127.0.0.1:57878
I20260709 12:16:26.354689  7560 raft_consensus.cc:606] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 4 LEADER]: Received request to transfer leadership to TS 86d91c5ff0bd4582bf410ce99edeb328
I20260709 12:16:26.355976 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:16:26.356787 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:26.357345  7815 raft_consensus.cc:1275] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 FOLLOWER]: Refusing update from remote peer 86d91c5ff0bd4582bf410ce99edeb328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:26.357666 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:26.359077  7872 consensus_queue.cc:1048] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:26.371107  7560 raft_consensus.cc:1275] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Refusing update from remote peer 86d91c5ff0bd4582bf410ce99edeb328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:26.372632  7888 consensus_queue.cc:1048] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:26.495940  7918 raft_consensus.cc:993] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328: : Instructing follower 1cf436d0350e46ebaebd98718017cc0a to start an election
I20260709 12:16:26.496466  7918 raft_consensus.cc:1081] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 LEADER]: Signalling peer 1cf436d0350e46ebaebd98718017cc0a to start an election
I20260709 12:16:26.498139  7560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a347ffd6e71445a8c01ccc22b42f064"
dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
 from {username='slave'} at 127.0.0.1:51030
I20260709 12:16:26.498730  7560 raft_consensus.cc:493] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:26.499063  7560 raft_consensus.cc:3060] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:26.504431  7560 raft_consensus.cc:515] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:26.506196  7560 leader_election.cc:290] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 3 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:26.507268  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a347ffd6e71445a8c01ccc22b42f064" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
I20260709 12:16:26.507422  7484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a347ffd6e71445a8c01ccc22b42f064" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:26.507910  7815 raft_consensus.cc:3060] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:26.508064  7484 raft_consensus.cc:3055] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:26.508448  7484 raft_consensus.cc:740] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Running, Role: LEADER
I20260709 12:16:26.509243  7484 consensus_queue.cc:260] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:26.510308  7484 raft_consensus.cc:3060] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:26.515195  7815 raft_consensus.cc:2468] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 3.
I20260709 12:16:26.516306  7526 leader_election.cc:304] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:26.517073  7906 raft_consensus.cc:2804] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:26.517529  7906 raft_consensus.cc:697] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [term 3 LEADER]: Becoming Leader. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Running, Role: LEADER
I20260709 12:16:26.517820  7484 raft_consensus.cc:2468] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 3.
I20260709 12:16:26.518477  7906 consensus_queue.cc:237] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:26.527125  7307 catalog_manager.cc:5697] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a reported cstate change: term changed from 2 to 3, leader changed from 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66) to 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67). New cstate: current_term: 3 leader_uuid: "1cf436d0350e46ebaebd98718017cc0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:26.678725  7856 raft_consensus.cc:993] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a: : Instructing follower 86d91c5ff0bd4582bf410ce99edeb328 to start an election
I20260709 12:16:26.679299  7912 raft_consensus.cc:1081] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 4 LEADER]: Signalling peer 86d91c5ff0bd4582bf410ce99edeb328 to start an election
I20260709 12:16:26.681102  7484 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9"
dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
 from {username='slave'} at 127.0.0.1:52506
I20260709 12:16:26.681648  7484 raft_consensus.cc:493] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:26.681998  7484 raft_consensus.cc:3060] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:26.687599  7484 raft_consensus.cc:515] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:26.689234  7484 leader_election.cc:290] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 5 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:26.690299  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
I20260709 12:16:26.690677  7560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf369cc1618a438b9ef3a38a5ba252e9" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:26.691036  7815 raft_consensus.cc:3060] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:26.691283  7560 raft_consensus.cc:3055] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:26.691627  7560 raft_consensus.cc:740] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Running, Role: LEADER
I20260709 12:16:26.692503  7560 consensus_queue.cc:260] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:26.694080  7560 raft_consensus.cc:3060] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:26.700398  7815 raft_consensus.cc:2468] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 5.
I20260709 12:16:26.701961  7452 leader_election.cc:304] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:26.702438  7560 raft_consensus.cc:2468] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 5.
I20260709 12:16:26.702984  7918 raft_consensus.cc:2804] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:26.703667  7918 raft_consensus.cc:697] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 5 LEADER]: Becoming Leader. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Running, Role: LEADER
I20260709 12:16:26.704551  7918 consensus_queue.cc:237] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:26.711841  7307 catalog_manager.cc:5697] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 reported cstate change: term changed from 4 to 5, leader changed from 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67) to 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66). New cstate: current_term: 5 leader_uuid: "86d91c5ff0bd4582bf410ce99edeb328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.731740  7856 raft_consensus.cc:993] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a: : Instructing follower 86d91c5ff0bd4582bf410ce99edeb328 to start an election
I20260709 12:16:26.732270  7912 raft_consensus.cc:1081] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Signalling peer 86d91c5ff0bd4582bf410ce99edeb328 to start an election
I20260709 12:16:26.733968  7484 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f0cee7f7f014985974db72216d12e7a"
dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
 from {username='slave'} at 127.0.0.1:52506
I20260709 12:16:26.734578  7484 raft_consensus.cc:493] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:26.734871  7484 raft_consensus.cc:3060] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:26.741110  7484 raft_consensus.cc:515] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:26.742779  7484 leader_election.cc:290] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 3 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:26.743965  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0cee7f7f014985974db72216d12e7a" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
I20260709 12:16:26.744086  7560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0cee7f7f014985974db72216d12e7a" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:26.744668  7815 raft_consensus.cc:3060] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:26.744724  7560 raft_consensus.cc:3055] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:26.745164  7560 raft_consensus.cc:740] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Running, Role: LEADER
I20260709 12:16:26.746101  7560 consensus_queue.cc:260] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:26.747519  7560 raft_consensus.cc:3060] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:26.752839  7815 raft_consensus.cc:2468] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 3.
I20260709 12:16:26.754356  7452 leader_election.cc:304] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:26.754876  7560 raft_consensus.cc:2468] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 3.
I20260709 12:16:26.755357  7918 raft_consensus.cc:2804] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:26.756278  7918 raft_consensus.cc:697] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 LEADER]: Becoming Leader. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Running, Role: LEADER
I20260709 12:16:26.757169  7918 consensus_queue.cc:237] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:26.764611  7307 catalog_manager.cc:5697] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 reported cstate change: term changed from 2 to 3, leader changed from 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67) to 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66). New cstate: current_term: 3 leader_uuid: "86d91c5ff0bd4582bf410ce99edeb328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.993964  7815 raft_consensus.cc:1275] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Refusing update from remote peer 1cf436d0350e46ebaebd98718017cc0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:26.995625  7912 consensus_queue.cc:1048] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:27.008028  7484 raft_consensus.cc:1275] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Refusing update from remote peer 1cf436d0350e46ebaebd98718017cc0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:27.009738  7912 consensus_queue.cc:1048] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:27.174813  7815 raft_consensus.cc:1275] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Refusing update from remote peer 86d91c5ff0bd4582bf410ce99edeb328: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:27.176151  7872 consensus_queue.cc:1048] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:27.187188  7560 raft_consensus.cc:1275] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Refusing update from remote peer 86d91c5ff0bd4582bf410ce99edeb328: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:27.188969  7918 consensus_queue.cc:1048] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:16:27.246136  7358 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:16:27.293959  7560 raft_consensus.cc:1275] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 5 FOLLOWER]: Refusing update from remote peer 86d91c5ff0bd4582bf410ce99edeb328: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:27.295436  7918 consensus_queue.cc:1048] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:27.305812  7814 raft_consensus.cc:1275] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 5 FOLLOWER]: Refusing update from remote peer 86d91c5ff0bd4582bf410ce99edeb328: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:27.308343  7872 consensus_queue.cc:1048] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:27.369355 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:27.377537  7560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb"
dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
mode: GRACEFUL
new_leader_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
 from {username='slave'} at 127.0.0.1:57878
I20260709 12:16:27.378185  7560 raft_consensus.cc:606] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 4 LEADER]: Received request to transfer leadership to TS 86d91c5ff0bd4582bf410ce99edeb328
I20260709 12:16:27.381218  7484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22b38bab9c6a4955a97108c436ff1bb6"
dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
mode: GRACEFUL
new_leader_uuid: "1cf436d0350e46ebaebd98718017cc0a"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:16:27.381747  7484 raft_consensus.cc:606] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 LEADER]: Received request to transfer leadership to TS 1cf436d0350e46ebaebd98718017cc0a
I20260709 12:16:27.384490  7484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f0cee7f7f014985974db72216d12e7a"
dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
mode: GRACEFUL
new_leader_uuid: "1cf436d0350e46ebaebd98718017cc0a"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:16:27.384966  7484 raft_consensus.cc:606] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 LEADER]: Received request to transfer leadership to TS 1cf436d0350e46ebaebd98718017cc0a
I20260709 12:16:27.385952 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:16:27.386557 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:27.387178 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:27.464840  7906 raft_consensus.cc:993] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a: : Instructing follower 86d91c5ff0bd4582bf410ce99edeb328 to start an election
I20260709 12:16:27.465412  7912 raft_consensus.cc:1081] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 4 LEADER]: Signalling peer 86d91c5ff0bd4582bf410ce99edeb328 to start an election
I20260709 12:16:27.466971  7484 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb"
dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
 from {username='slave'} at 127.0.0.1:52506
I20260709 12:16:27.467418  7484 raft_consensus.cc:493] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:27.467661  7484 raft_consensus.cc:3060] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:27.473064  7484 raft_consensus.cc:515] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:27.474788  7484 leader_election.cc:290] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 5 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67:33233)
I20260709 12:16:27.475744  7814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
I20260709 12:16:27.476001  7560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a329b17879e429e95bc6d32be006afb" candidate_uuid: "86d91c5ff0bd4582bf410ce99edeb328" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
I20260709 12:16:27.476401  7814 raft_consensus.cc:3060] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:27.476646  7560 raft_consensus.cc:3055] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:27.476984  7560 raft_consensus.cc:740] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Running, Role: LEADER
I20260709 12:16:27.477706  7560 consensus_queue.cc:260] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:27.478708  7560 raft_consensus.cc:3060] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:27.482540  7814 raft_consensus.cc:2468] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 5.
I20260709 12:16:27.483930  7452 leader_election.cc:304] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86d91c5ff0bd4582bf410ce99edeb328, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:27.484163  7560 raft_consensus.cc:2468] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86d91c5ff0bd4582bf410ce99edeb328 in term 5.
I20260709 12:16:27.484804  7872 raft_consensus.cc:2804] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:27.485360  7872 raft_consensus.cc:697] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 5 LEADER]: Becoming Leader. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Running, Role: LEADER
I20260709 12:16:27.486147  7872 consensus_queue.cc:237] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:27.493342  7310 catalog_manager.cc:5697] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 reported cstate change: term changed from 4 to 5, leader changed from 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67) to 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66). New cstate: current_term: 5 leader_uuid: "86d91c5ff0bd4582bf410ce99edeb328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.716706  7872 raft_consensus.cc:993] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328: : Instructing follower 1cf436d0350e46ebaebd98718017cc0a to start an election
I20260709 12:16:27.717522  7918 raft_consensus.cc:1081] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 LEADER]: Signalling peer 1cf436d0350e46ebaebd98718017cc0a to start an election
I20260709 12:16:27.719272  7560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f0cee7f7f014985974db72216d12e7a"
dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
 from {username='slave'} at 127.0.0.1:51030
I20260709 12:16:27.719798  7560 raft_consensus.cc:493] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:27.720201  7560 raft_consensus.cc:3060] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:27.726686  7560 raft_consensus.cc:515] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:27.728648  7560 leader_election.cc:290] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 4 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:27.730283  7484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0cee7f7f014985974db72216d12e7a" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:27.730675  7814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f0cee7f7f014985974db72216d12e7a" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
I20260709 12:16:27.731098  7484 raft_consensus.cc:3055] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:27.731562  7484 raft_consensus.cc:740] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Running, Role: LEADER
I20260709 12:16:27.731619  7814 raft_consensus.cc:3060] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:27.732486  7484 consensus_queue.cc:260] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:27.733798  7484 raft_consensus.cc:3060] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:27.738615  7814 raft_consensus.cc:2468] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 4.
I20260709 12:16:27.739859  7484 raft_consensus.cc:2468] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 4.
I20260709 12:16:27.740003  7526 leader_election.cc:304] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:27.740883  7912 raft_consensus.cc:2804] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:27.741432  7912 raft_consensus.cc:697] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 4 LEADER]: Becoming Leader. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Running, Role: LEADER
I20260709 12:16:27.742200  7912 consensus_queue.cc:237] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:27.749399  7310 catalog_manager.cc:5697] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a reported cstate change: term changed from 3 to 4, leader changed from 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66) to 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67). New cstate: current_term: 4 leader_uuid: "1cf436d0350e46ebaebd98718017cc0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:27.760785  7872 raft_consensus.cc:993] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328: : Instructing follower 1cf436d0350e46ebaebd98718017cc0a to start an election
I20260709 12:16:27.761307  7918 raft_consensus.cc:1081] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 LEADER]: Signalling peer 1cf436d0350e46ebaebd98718017cc0a to start an election
I20260709 12:16:27.762909  7560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22b38bab9c6a4955a97108c436ff1bb6"
dest_uuid: "1cf436d0350e46ebaebd98718017cc0a"
 from {username='slave'} at 127.0.0.1:51030
I20260709 12:16:27.763447  7560 raft_consensus.cc:493] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:27.763774  7560 raft_consensus.cc:3060] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:27.769155  7560 raft_consensus.cc:515] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:27.771049  7560 leader_election.cc:290] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 3 election: Requested vote from peers ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773), 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345)
I20260709 12:16:27.772017  7814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b38bab9c6a4955a97108c436ff1bb6" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1"
I20260709 12:16:27.772210  7484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b38bab9c6a4955a97108c436ff1bb6" candidate_uuid: "1cf436d0350e46ebaebd98718017cc0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86d91c5ff0bd4582bf410ce99edeb328"
I20260709 12:16:27.772738  7814 raft_consensus.cc:3060] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:27.772846  7484 raft_consensus.cc:3055] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:27.773252  7484 raft_consensus.cc:740] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86d91c5ff0bd4582bf410ce99edeb328, State: Running, Role: LEADER
I20260709 12:16:27.773972  7484 consensus_queue.cc:260] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:27.775024  7484 raft_consensus.cc:3060] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:27.778849  7814 raft_consensus.cc:2468] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 3.
I20260709 12:16:27.780184  7526 leader_election.cc:304] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cf436d0350e46ebaebd98718017cc0a, ea5edb9dbe9743e580031bfe1d2d50b1; no voters: 
I20260709 12:16:27.780736  7484 raft_consensus.cc:2468] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cf436d0350e46ebaebd98718017cc0a in term 3.
I20260709 12:16:27.780964  7912 raft_consensus.cc:2804] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:27.781589  7912 raft_consensus.cc:697] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 3 LEADER]: Becoming Leader. State: Replica: 1cf436d0350e46ebaebd98718017cc0a, State: Running, Role: LEADER
I20260709 12:16:27.782526  7912 consensus_queue.cc:237] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } }
I20260709 12:16:27.790647  7310 catalog_manager.cc:5697] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a reported cstate change: term changed from 2 to 3, leader changed from 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66) to 1cf436d0350e46ebaebd98718017cc0a (127.24.179.67). New cstate: current_term: 3 leader_uuid: "1cf436d0350e46ebaebd98718017cc0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:27.932859  7814 raft_consensus.cc:1275] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 5 FOLLOWER]: Refusing update from remote peer 86d91c5ff0bd4582bf410ce99edeb328: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:16:27.934267  7888 consensus_queue.cc:1048] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:27.949879  7560 raft_consensus.cc:1275] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 5 FOLLOWER]: Refusing update from remote peer 86d91c5ff0bd4582bf410ce99edeb328: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:16:27.951277  7888 consensus_queue.cc:1048] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cf436d0350e46ebaebd98718017cc0a" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:28.162163  7814 raft_consensus.cc:1275] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 4 FOLLOWER]: Refusing update from remote peer 1cf436d0350e46ebaebd98718017cc0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:28.163627  7856 consensus_queue.cc:1048] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:28.172506  7484 raft_consensus.cc:1275] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 4 FOLLOWER]: Refusing update from remote peer 1cf436d0350e46ebaebd98718017cc0a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:28.174299  7912 consensus_queue.cc:1048] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:16:28.247288  7358 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:16:28.257701  7814 raft_consensus.cc:1275] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Refusing update from remote peer 1cf436d0350e46ebaebd98718017cc0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:28.259214  7912 consensus_queue.cc:1048] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea5edb9dbe9743e580031bfe1d2d50b1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:28.269547  7484 raft_consensus.cc:1275] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Refusing update from remote peer 1cf436d0350e46ebaebd98718017cc0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:28.271054  7912 consensus_queue.cc:1048] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "86d91c5ff0bd4582bf410ce99edeb328" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:28.393730 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:28.424702 25293 tablet_server.cc:179] TabletServer@127.24.179.65:41773 shutting down...
W20260709 12:16:28.433107  7452 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 15 similar messages]
W20260709 12:16:28.437703  7452 consensus_peers.cc:597] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.448448 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:28.449440 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:28.450354 25293 raft_consensus.cc:2243] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.450997 25293 raft_consensus.cc:2272] T e09606ff486a4308b404dea23791c522 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.453382 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:28.454030 25293 raft_consensus.cc:2243] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.454574 25293 raft_consensus.cc:2272] T 2f0cee7f7f014985974db72216d12e7a P ea5edb9dbe9743e580031bfe1d2d50b1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.456930 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:28.457564 25293 raft_consensus.cc:2243] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.458048 25293 raft_consensus.cc:2272] T 0a329b17879e429e95bc6d32be006afb P ea5edb9dbe9743e580031bfe1d2d50b1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.460522 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:28.461143 25293 raft_consensus.cc:2243] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.461611 25293 raft_consensus.cc:2272] T ce96956ac94f4b18bc33fd50153efab8 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.463649 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:28.464304 25293 raft_consensus.cc:2243] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.464778 25293 raft_consensus.cc:2272] T 3a347ffd6e71445a8c01ccc22b42f064 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.466852 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:28.467407 25293 raft_consensus.cc:2243] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.467882 25293 raft_consensus.cc:2272] T cf369cc1618a438b9ef3a38a5ba252e9 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.469877 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:28.470548 25293 raft_consensus.cc:2243] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.470961 25293 raft_consensus.cc:2272] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.472949 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:28.473453 25293 raft_consensus.cc:2243] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.473847 25293 raft_consensus.cc:2272] T 410149d03e2e411b9ad55a216ccee270 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.476181 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:28.476821 25293 raft_consensus.cc:2243] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.477313 25293 raft_consensus.cc:2272] T 22b38bab9c6a4955a97108c436ff1bb6 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.479849 25293 tablet_replica.cc:333] stopping tablet replica
I20260709 12:16:28.480394 25293 raft_consensus.cc:2243] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.480862 25293 raft_consensus.cc:2272] T f4d6e2ea81954f098f276b0ee1628d50 P ea5edb9dbe9743e580031bfe1d2d50b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.511526 25293 tablet_server.cc:196] TabletServer@127.24.179.65:41773 shutdown complete.
W20260709 12:16:28.524101  7452 consensus_peers.cc:597] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.534683 25293 tablet_server.cc:179] TabletServer@127.24.179.66:0 shutting down...
I20260709 12:16:28.562809 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:28.563736 25293 tablet_replica.cc:333] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328: stopping tablet replica
I20260709 12:16:28.564878 25293 raft_consensus.cc:2243] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.565420 25293 raft_consensus.cc:2272] T 22b38bab9c6a4955a97108c436ff1bb6 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.569761 25293 tablet_replica.cc:333] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328: stopping tablet replica
I20260709 12:16:28.570746 25293 raft_consensus.cc:2243] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.571345 25293 raft_consensus.cc:2272] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:28.574258  7527 consensus_peers.cc:597] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a -> Peer 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345): Couldn't send request to peer 86d91c5ff0bd4582bf410ce99edeb328. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.574810 25293 tablet_replica.cc:333] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328: stopping tablet replica
I20260709 12:16:28.575556 25293 raft_consensus.cc:2243] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.576087 25293 raft_consensus.cc:2272] T 410149d03e2e411b9ad55a216ccee270 P 86d91c5ff0bd4582bf410ce99edeb328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.578783 25293 tablet_replica.cc:333] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328: stopping tablet replica
I20260709 12:16:28.579414 25293 raft_consensus.cc:2243] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.580199 25293 raft_consensus.cc:2272] T ce96956ac94f4b18bc33fd50153efab8 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.582484 25293 tablet_replica.cc:333] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328: stopping tablet replica
I20260709 12:16:28.583076 25293 raft_consensus.cc:2243] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.583966 25293 raft_consensus.cc:2272] T 0a329b17879e429e95bc6d32be006afb P 86d91c5ff0bd4582bf410ce99edeb328 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.586848 25293 tablet_replica.cc:333] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328: stopping tablet replica
I20260709 12:16:28.587438 25293 raft_consensus.cc:2243] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.587862 25293 raft_consensus.cc:2272] T e09606ff486a4308b404dea23791c522 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.590092 25293 tablet_replica.cc:333] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328: stopping tablet replica
I20260709 12:16:28.590698 25293 raft_consensus.cc:2243] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.591197 25293 raft_consensus.cc:2272] T 2f0cee7f7f014985974db72216d12e7a P 86d91c5ff0bd4582bf410ce99edeb328 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.593786 25293 tablet_replica.cc:333] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328: stopping tablet replica
I20260709 12:16:28.594480 25293 raft_consensus.cc:2243] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.595353 25293 raft_consensus.cc:2272] T f4d6e2ea81954f098f276b0ee1628d50 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.597749 25293 tablet_replica.cc:333] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328: stopping tablet replica
I20260709 12:16:28.598462 25293 raft_consensus.cc:2243] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.599042 25293 raft_consensus.cc:2272] T 3a347ffd6e71445a8c01ccc22b42f064 P 86d91c5ff0bd4582bf410ce99edeb328 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.602044 25293 tablet_replica.cc:333] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328: stopping tablet replica
I20260709 12:16:28.602597 25293 raft_consensus.cc:2243] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.603549 25293 raft_consensus.cc:2272] T cf369cc1618a438b9ef3a38a5ba252e9 P 86d91c5ff0bd4582bf410ce99edeb328 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.638314 25293 tablet_server.cc:196] TabletServer@127.24.179.66:0 shutdown complete.
W20260709 12:16:28.647387  7527 consensus_peers.cc:597] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a -> Peer 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345): Couldn't send request to peer 86d91c5ff0bd4582bf410ce99edeb328. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:42345: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.667825 25293 tablet_server.cc:179] TabletServer@127.24.179.67:0 shutting down...
W20260709 12:16:28.693490  7526 consensus_peers.cc:597] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:28.701241  7526 consensus_peers.cc:597] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:28.701758  7526 consensus_peers.cc:597] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.703886 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:28.704707 25293 tablet_replica.cc:333] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a: stopping tablet replica
I20260709 12:16:28.705423 25293 raft_consensus.cc:2243] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.705962 25293 raft_consensus.cc:2272] T f4d6e2ea81954f098f276b0ee1628d50 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.708868 25293 tablet_replica.cc:333] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a: stopping tablet replica
I20260709 12:16:28.709584 25293 raft_consensus.cc:2243] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.710566 25293 raft_consensus.cc:2272] T 22b38bab9c6a4955a97108c436ff1bb6 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:28.713809  7527 consensus_peers.cc:597] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a -> Peer 86d91c5ff0bd4582bf410ce99edeb328 (127.24.179.66:42345): Couldn't send request to peer 86d91c5ff0bd4582bf410ce99edeb328. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:42345: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.714231 25293 tablet_replica.cc:333] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a: stopping tablet replica
I20260709 12:16:28.715088 25293 raft_consensus.cc:2243] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.715608 25293 raft_consensus.cc:2272] T cf369cc1618a438b9ef3a38a5ba252e9 P 1cf436d0350e46ebaebd98718017cc0a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.717943 25293 tablet_replica.cc:333] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a: stopping tablet replica
I20260709 12:16:28.718672 25293 raft_consensus.cc:2243] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.719547 25293 raft_consensus.cc:2272] T 3a347ffd6e71445a8c01ccc22b42f064 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.721824 25293 tablet_replica.cc:333] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a: stopping tablet replica
I20260709 12:16:28.722489 25293 raft_consensus.cc:2243] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.723073 25293 raft_consensus.cc:2272] T ce96956ac94f4b18bc33fd50153efab8 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.725744 25293 tablet_replica.cc:333] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a: stopping tablet replica
I20260709 12:16:28.726616 25293 raft_consensus.cc:2243] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.727584 25293 raft_consensus.cc:2272] T 410149d03e2e411b9ad55a216ccee270 P 1cf436d0350e46ebaebd98718017cc0a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:28.730438  7526 consensus_peers.cc:597] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a -> Peer ea5edb9dbe9743e580031bfe1d2d50b1 (127.24.179.65:41773): Couldn't send request to peer ea5edb9dbe9743e580031bfe1d2d50b1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:41773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.730544 25293 tablet_replica.cc:333] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a: stopping tablet replica
I20260709 12:16:28.731326 25293 raft_consensus.cc:2243] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.732249 25293 raft_consensus.cc:2272] T 7e6b8b5e1a9a4100bfe8f0de30969e2d P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.734589 25293 tablet_replica.cc:333] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a: stopping tablet replica
I20260709 12:16:28.735211 25293 raft_consensus.cc:2243] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.736114 25293 raft_consensus.cc:2272] T 2f0cee7f7f014985974db72216d12e7a P 1cf436d0350e46ebaebd98718017cc0a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.739348 25293 tablet_replica.cc:333] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a: stopping tablet replica
I20260709 12:16:28.739936 25293 raft_consensus.cc:2243] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:28.740492 25293 raft_consensus.cc:2272] T 0a329b17879e429e95bc6d32be006afb P 1cf436d0350e46ebaebd98718017cc0a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.743369 25293 tablet_replica.cc:333] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a: stopping tablet replica
I20260709 12:16:28.743896 25293 raft_consensus.cc:2243] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.744693 25293 raft_consensus.cc:2272] T e09606ff486a4308b404dea23791c522 P 1cf436d0350e46ebaebd98718017cc0a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.796551 25293 tablet_server.cc:196] TabletServer@127.24.179.67:0 shutdown complete.
I20260709 12:16:28.823474 25293 master.cc:562] Master@127.24.179.126:37135 shutting down...
I20260709 12:16:28.852159 25293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:28.852823 25293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:28.853193 25293 tablet_replica.cc:333] T 00000000000000000000000000000000 P fffa0e02d57f46e58713a0e7e331ffa6: stopping tablet replica
I20260709 12:16:28.876106 25293 master.cc:584] Master@127.24.179.126:37135 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (15163 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:16:28.923862 25293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.179.126:41171
I20260709 12:16:28.925125 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:28.931037  7957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:28.931489  7958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:28.932060  7960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:28.933148 25293 server_base.cc:1061] running on GCE node
I20260709 12:16:28.934131 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:28.934321 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:28.934509 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599388934493 us; error 0 us; skew 500 ppm
I20260709 12:16:28.935048 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:28.937412 25293 webserver.cc:533] Webserver started at http://127.24.179.126:44535/ using document root <none> and password file <none>
I20260709 12:16:28.937881 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:28.938035 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:28.938277 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:28.939489 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894834136-25293-0/minicluster-data/master-0-root/instance:
uuid: "30dc32353a0e4d81bb0af15912e78c02"
format_stamp: "Formatted at 2026-07-09 12:16:28 on dist-test-slave-tjfs"
I20260709 12:16:28.944331 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:16:28.948036  7965 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:28.948902 25293 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:16:28.949231 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894834136-25293-0/minicluster-data/master-0-root
uuid: "30dc32353a0e4d81bb0af15912e78c02"
format_stamp: "Formatted at 2026-07-09 12:16:28 on dist-test-slave-tjfs"
I20260709 12:16:28.949546 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894834136-25293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894834136-25293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894834136-25293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:28.960727 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:28.962047 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:29.004019 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.126:41171
I20260709 12:16:29.004149  8016 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.126:41171 every 8 connection(s)
I20260709 12:16:29.008301  8017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.020751  8017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02: Bootstrap starting.
I20260709 12:16:29.026031  8017 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.030892  8017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02: No bootstrap required, opened a new log
I20260709 12:16:29.033385  8017 raft_consensus.cc:359] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30dc32353a0e4d81bb0af15912e78c02" member_type: VOTER }
I20260709 12:16:29.033829  8017 raft_consensus.cc:385] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.034128  8017 raft_consensus.cc:740] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30dc32353a0e4d81bb0af15912e78c02, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.034773  8017 consensus_queue.cc:260] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30dc32353a0e4d81bb0af15912e78c02" member_type: VOTER }
I20260709 12:16:29.035271  8017 raft_consensus.cc:399] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:29.035509  8017 raft_consensus.cc:493] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:29.035799  8017 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.041496  8017 raft_consensus.cc:515] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30dc32353a0e4d81bb0af15912e78c02" member_type: VOTER }
I20260709 12:16:29.042119  8017 leader_election.cc:304] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 30dc32353a0e4d81bb0af15912e78c02; no voters: 
I20260709 12:16:29.043422  8017 leader_election.cc:290] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:29.043910  8020 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.045418  8020 raft_consensus.cc:697] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02 [term 1 LEADER]: Becoming Leader. State: Replica: 30dc32353a0e4d81bb0af15912e78c02, State: Running, Role: LEADER
I20260709 12:16:29.046195  8020 consensus_queue.cc:237] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30dc32353a0e4d81bb0af15912e78c02" member_type: VOTER }
I20260709 12:16:29.046564  8017 sys_catalog.cc:565] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:29.051165  8022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "30dc32353a0e4d81bb0af15912e78c02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30dc32353a0e4d81bb0af15912e78c02" member_type: VOTER } }
I20260709 12:16:29.051234  8023 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30dc32353a0e4d81bb0af15912e78c02. Latest consensus state: current_term: 1 leader_uuid: "30dc32353a0e4d81bb0af15912e78c02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30dc32353a0e4d81bb0af15912e78c02" member_type: VOTER } }
I20260709 12:16:29.052091  8022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:29.052109  8023 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:29.056036  8028 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:29.062553  8028 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:29.064013 25293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:29.072050  8028 catalog_manager.cc:1383] Generated new cluster ID: ba85f0da900747e4847a8e67759cdfd5
I20260709 12:16:29.072408  8028 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:29.089627  8028 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:29.091176  8028 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:29.110545  8028 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02: Generated new TSK 0
I20260709 12:16:29.111269  8028 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:29.131520 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:29.138123  8040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:29.140798  8041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:29.141768  8043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:29.142705 25293 server_base.cc:1061] running on GCE node
I20260709 12:16:29.143719 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:29.143945 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:29.144124 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599389144108 us; error 0 us; skew 500 ppm
I20260709 12:16:29.144793 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:29.147419 25293 webserver.cc:533] Webserver started at http://127.24.179.65:39417/ using document root <none> and password file <none>
I20260709 12:16:29.148015 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:29.148257 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:29.148546 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:29.149760 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894834136-25293-0/minicluster-data/ts-0-root/instance:
uuid: "f4a87b395425442c9b8b2dded27c6979"
format_stamp: "Formatted at 2026-07-09 12:16:29 on dist-test-slave-tjfs"
I20260709 12:16:29.154891 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:16:29.158917  8048 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:29.159840 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:16:29.160209 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894834136-25293-0/minicluster-data/ts-0-root
uuid: "f4a87b395425442c9b8b2dded27c6979"
format_stamp: "Formatted at 2026-07-09 12:16:29 on dist-test-slave-tjfs"
I20260709 12:16:29.160537 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894834136-25293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894834136-25293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894834136-25293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:29.175127 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:29.176429 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:29.178009 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:29.180583 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:29.180861 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:29.181138 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:29.181329 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:29.225425 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.65:44829
I20260709 12:16:29.225530  8110 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.65:44829 every 8 connection(s)
I20260709 12:16:29.232059 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:29.241398  8115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:29.243075  8116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:29.246086 25293 server_base.cc:1061] running on GCE node
W20260709 12:16:29.246920  8118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:29.248252  8111 heartbeater.cc:344] Connected to a master server at 127.24.179.126:41171
I20260709 12:16:29.248585 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:16:29.248809  8111 heartbeater.cc:461] Registering TS with master...
W20260709 12:16:29.248934 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:29.249246 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599389249225 us; error 0 us; skew 500 ppm
I20260709 12:16:29.249929  8111 heartbeater.cc:507] Master 127.24.179.126:41171 requested a full tablet report, sending...
I20260709 12:16:29.250134 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:29.253005  7982 ts_manager.cc:194] Registered new tserver with Master: f4a87b395425442c9b8b2dded27c6979 (127.24.179.65:44829)
I20260709 12:16:29.253273 25293 webserver.cc:533] Webserver started at http://127.24.179.66:43249/ using document root <none> and password file <none>
I20260709 12:16:29.253963 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:29.254177 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:29.254519 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:29.255292  7982 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54252
I20260709 12:16:29.255755 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894834136-25293-0/minicluster-data/ts-1-root/instance:
uuid: "679736ba263c423aaaf222df879426d7"
format_stamp: "Formatted at 2026-07-09 12:16:29 on dist-test-slave-tjfs"
I20260709 12:16:29.261364 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:16:29.265563  8123 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:29.266516 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:16:29.266885 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894834136-25293-0/minicluster-data/ts-1-root
uuid: "679736ba263c423aaaf222df879426d7"
format_stamp: "Formatted at 2026-07-09 12:16:29 on dist-test-slave-tjfs"
I20260709 12:16:29.267251 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894834136-25293-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894834136-25293-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894834136-25293-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:29.281335 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:29.282860 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:29.284583 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:29.287387 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:29.287709 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:29.287990 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:29.288203 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:29.334117 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.66:42741
I20260709 12:16:29.334218  8185 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.66:42741 every 8 connection(s)
I20260709 12:16:29.340034 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:29.348162  8189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:29.349674  8190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:29.352368  8192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:29.353619 25293 server_base.cc:1061] running on GCE node
I20260709 12:16:29.353844  8186 heartbeater.cc:344] Connected to a master server at 127.24.179.126:41171
I20260709 12:16:29.354568  8186 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:29.354904 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:29.355221 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:29.355432 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599389355411 us; error 0 us; skew 500 ppm
I20260709 12:16:29.355499  8186 heartbeater.cc:507] Master 127.24.179.126:41171 requested a full tablet report, sending...
I20260709 12:16:29.356154 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:29.358445  7982 ts_manager.cc:194] Registered new tserver with Master: 679736ba263c423aaaf222df879426d7 (127.24.179.66:42741)
I20260709 12:16:29.359478 25293 webserver.cc:533] Webserver started at http://127.24.179.67:46627/ using document root <none> and password file <none>
I20260709 12:16:29.360177 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:29.360214  7982 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54262
I20260709 12:16:29.360400 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:29.360939 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:29.362700 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894834136-25293-0/minicluster-data/ts-2-root/instance:
uuid: "988de48204664db2b1fdf0005e5fed0c"
format_stamp: "Formatted at 2026-07-09 12:16:29 on dist-test-slave-tjfs"
I20260709 12:16:29.368113 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:16:29.372417  8197 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:29.373342 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:16:29.373735 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894834136-25293-0/minicluster-data/ts-2-root
uuid: "988de48204664db2b1fdf0005e5fed0c"
format_stamp: "Formatted at 2026-07-09 12:16:29 on dist-test-slave-tjfs"
I20260709 12:16:29.374069 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894834136-25293-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894834136-25293-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894834136-25293-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:29.388506 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:29.389967 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:29.391752 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:29.394461 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:29.394757 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:29.395049 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:29.395246 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:29.442070 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.67:45161
I20260709 12:16:29.442171  8259 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.67:45161 every 8 connection(s)
I20260709 12:16:29.459214  8260 heartbeater.cc:344] Connected to a master server at 127.24.179.126:41171
I20260709 12:16:29.459672  8260 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:29.460521  8260 heartbeater.cc:507] Master 127.24.179.126:41171 requested a full tablet report, sending...
I20260709 12:16:29.462802  7982 ts_manager.cc:194] Registered new tserver with Master: 988de48204664db2b1fdf0005e5fed0c (127.24.179.67:45161)
I20260709 12:16:29.463398 25293 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017540037s
I20260709 12:16:29.464722  7982 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54274
I20260709 12:16:29.492040  7982 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54286:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:29.494509  7982 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:29.558559  8076 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef04c4de18c4196ad47e0bc639d0d32 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f26da9405efe46609eb7e4b649f2f5e6]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:16:29.558887  8225 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef04c4de18c4196ad47e0bc639d0d32 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f26da9405efe46609eb7e4b649f2f5e6]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:16:29.558689  8075 tablet_service.cc:1511] Processing CreateTablet for tablet 818537cf17334128ba24fcd7bb885255 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f26da9405efe46609eb7e4b649f2f5e6]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:16:29.560218  8076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef04c4de18c4196ad47e0bc639d0d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.560544  8225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef04c4de18c4196ad47e0bc639d0d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.561064  8075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 818537cf17334128ba24fcd7bb885255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.563653  8224 tablet_service.cc:1511] Processing CreateTablet for tablet 818537cf17334128ba24fcd7bb885255 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f26da9405efe46609eb7e4b649f2f5e6]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:16:29.565299  8224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 818537cf17334128ba24fcd7bb885255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.573833  8151 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef04c4de18c4196ad47e0bc639d0d32 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f26da9405efe46609eb7e4b649f2f5e6]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:16:29.574272  8150 tablet_service.cc:1511] Processing CreateTablet for tablet 818537cf17334128ba24fcd7bb885255 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f26da9405efe46609eb7e4b649f2f5e6]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:16:29.575465  8151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef04c4de18c4196ad47e0bc639d0d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.576119  8150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 818537cf17334128ba24fcd7bb885255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.606976  8275 tablet_bootstrap.cc:492] T 818537cf17334128ba24fcd7bb885255 P f4a87b395425442c9b8b2dded27c6979: Bootstrap starting.
I20260709 12:16:29.615144  8276 tablet_bootstrap.cc:492] T 0ef04c4de18c4196ad47e0bc639d0d32 P 679736ba263c423aaaf222df879426d7: Bootstrap starting.
I20260709 12:16:29.616464  8277 tablet_bootstrap.cc:492] T 818537cf17334128ba24fcd7bb885255 P 988de48204664db2b1fdf0005e5fed0c: Bootstrap starting.
I20260709 12:16:29.617372  8275 tablet_bootstrap.cc:654] T 818537cf17334128ba24fcd7bb885255 P f4a87b395425442c9b8b2dded27c6979: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.624061  8277 tablet_bootstrap.cc:654] T 818537cf17334128ba24fcd7bb885255 P 988de48204664db2b1fdf0005e5fed0c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.624145  8276 tablet_bootstrap.cc:654] T 0ef04c4de18c4196ad47e0bc639d0d32 P 679736ba263c423aaaf222df879426d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.624796  8275 tablet_bootstrap.cc:492] T 818537cf17334128ba24fcd7bb885255 P f4a87b395425442c9b8b2dded27c6979: No bootstrap required, opened a new log
I20260709 12:16:29.625370  8275 ts_tablet_manager.cc:1403] T 818537cf17334128ba24fcd7bb885255 P f4a87b395425442c9b8b2dded27c6979: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 12:16:29.628057  8275 raft_consensus.cc:359] T 818537cf17334128ba24fcd7bb885255 P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:29.628731  8275 raft_consensus.cc:385] T 818537cf17334128ba24fcd7bb885255 P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.629058  8275 raft_consensus.cc:740] T 818537cf17334128ba24fcd7bb885255 P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a87b395425442c9b8b2dded27c6979, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.630198  8275 consensus_queue.cc:260] T 818537cf17334128ba24fcd7bb885255 P f4a87b395425442c9b8b2dded27c6979 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:29.632558  8276 tablet_bootstrap.cc:492] T 0ef04c4de18c4196ad47e0bc639d0d32 P 679736ba263c423aaaf222df879426d7: No bootstrap required, opened a new log
I20260709 12:16:29.633050  8277 tablet_bootstrap.cc:492] T 818537cf17334128ba24fcd7bb885255 P 988de48204664db2b1fdf0005e5fed0c: No bootstrap required, opened a new log
I20260709 12:16:29.633206  8276 ts_tablet_manager.cc:1403] T 0ef04c4de18c4196ad47e0bc639d0d32 P 679736ba263c423aaaf222df879426d7: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 12:16:29.633725  8277 ts_tablet_manager.cc:1403] T 818537cf17334128ba24fcd7bb885255 P 988de48204664db2b1fdf0005e5fed0c: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 12:16:29.634430  8111 heartbeater.cc:499] Master 127.24.179.126:41171 was elected leader, sending a full tablet report...
I20260709 12:16:29.634932  8275 ts_tablet_manager.cc:1434] T 818537cf17334128ba24fcd7bb885255 P f4a87b395425442c9b8b2dded27c6979: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260709 12:16:29.635998  8275 tablet_bootstrap.cc:492] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979: Bootstrap starting.
I20260709 12:16:29.636806  8276 raft_consensus.cc:359] T 0ef04c4de18c4196ad47e0bc639d0d32 P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } } peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } }
I20260709 12:16:29.637665  8276 raft_consensus.cc:385] T 0ef04c4de18c4196ad47e0bc639d0d32 P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.639086  8277 raft_consensus.cc:359] T 818537cf17334128ba24fcd7bb885255 P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:29.637962  8276 raft_consensus.cc:740] T 0ef04c4de18c4196ad47e0bc639d0d32 P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 679736ba263c423aaaf222df879426d7, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.640106  8277 raft_consensus.cc:385] T 818537cf17334128ba24fcd7bb885255 P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.640774  8277 raft_consensus.cc:740] T 818537cf17334128ba24fcd7bb885255 P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 988de48204664db2b1fdf0005e5fed0c, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.641259  8276 consensus_queue.cc:260] T 0ef04c4de18c4196ad47e0bc639d0d32 P 679736ba263c423aaaf222df879426d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } } peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } }
I20260709 12:16:29.641716  8277 consensus_queue.cc:260] T 818537cf17334128ba24fcd7bb885255 P 988de48204664db2b1fdf0005e5fed0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:29.644497  8275 tablet_bootstrap.cc:654] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.657895  8277 ts_tablet_manager.cc:1434] T 818537cf17334128ba24fcd7bb885255 P 988de48204664db2b1fdf0005e5fed0c: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.014s
I20260709 12:16:29.658463  8275 tablet_bootstrap.cc:492] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979: No bootstrap required, opened a new log
I20260709 12:16:29.658521  8186 heartbeater.cc:499] Master 127.24.179.126:41171 was elected leader, sending a full tablet report...
I20260709 12:16:29.659101  8260 heartbeater.cc:499] Master 127.24.179.126:41171 was elected leader, sending a full tablet report...
I20260709 12:16:29.659265  8275 ts_tablet_manager.cc:1403] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.007s
I20260709 12:16:29.661550  8277 tablet_bootstrap.cc:492] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c: Bootstrap starting.
I20260709 12:16:29.664146  8276 ts_tablet_manager.cc:1434] T 0ef04c4de18c4196ad47e0bc639d0d32 P 679736ba263c423aaaf222df879426d7: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.016s
I20260709 12:16:29.663950  8275 raft_consensus.cc:359] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } } peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } }
I20260709 12:16:29.664793  8275 raft_consensus.cc:385] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.665144  8275 raft_consensus.cc:740] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a87b395425442c9b8b2dded27c6979, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.665403  8276 tablet_bootstrap.cc:492] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7: Bootstrap starting.
I20260709 12:16:29.666090  8275 consensus_queue.cc:260] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } } peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } }
I20260709 12:16:29.668851  8275 ts_tablet_manager.cc:1434] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:16:29.669814  8277 tablet_bootstrap.cc:654] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.673285  8276 tablet_bootstrap.cc:654] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.681850  8276 tablet_bootstrap.cc:492] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7: No bootstrap required, opened a new log
I20260709 12:16:29.682461  8276 ts_tablet_manager.cc:1403] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:16:29.682801  8277 tablet_bootstrap.cc:492] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c: No bootstrap required, opened a new log
I20260709 12:16:29.683429  8277 ts_tablet_manager.cc:1403] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.014s
I20260709 12:16:29.686658  8277 raft_consensus.cc:359] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } } peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } }
I20260709 12:16:29.687500  8277 raft_consensus.cc:385] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.687774  8277 raft_consensus.cc:740] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 988de48204664db2b1fdf0005e5fed0c, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.688503  8277 consensus_queue.cc:260] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } } peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } }
I20260709 12:16:29.689169  8276 raft_consensus.cc:359] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:29.690016  8276 raft_consensus.cc:385] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.690327  8276 raft_consensus.cc:740] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 679736ba263c423aaaf222df879426d7, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.691157  8277 ts_tablet_manager.cc:1434] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:16:29.691315  8276 consensus_queue.cc:260] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:29.693821  8276 ts_tablet_manager.cc:1434] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:16:29.729813  8282 raft_consensus.cc:493] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.730580  8282 raft_consensus.cc:515] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:29.733736  8282 leader_election.cc:290] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4a87b395425442c9b8b2dded27c6979 (127.24.179.65:44829), 988de48204664db2b1fdf0005e5fed0c (127.24.179.67:45161)
I20260709 12:16:29.745044  8086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "818537cf17334128ba24fcd7bb885255" candidate_uuid: "679736ba263c423aaaf222df879426d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a87b395425442c9b8b2dded27c6979" is_pre_election: true
I20260709 12:16:29.745891  8086 raft_consensus.cc:2468] T 818537cf17334128ba24fcd7bb885255 P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 679736ba263c423aaaf222df879426d7 in term 0.
I20260709 12:16:29.746773  8235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "818537cf17334128ba24fcd7bb885255" candidate_uuid: "679736ba263c423aaaf222df879426d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "988de48204664db2b1fdf0005e5fed0c" is_pre_election: true
I20260709 12:16:29.747941  8235 raft_consensus.cc:2468] T 818537cf17334128ba24fcd7bb885255 P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 679736ba263c423aaaf222df879426d7 in term 0.
I20260709 12:16:29.747642  8126 leader_election.cc:304] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 679736ba263c423aaaf222df879426d7, f4a87b395425442c9b8b2dded27c6979; no voters: 
I20260709 12:16:29.749181  8282 raft_consensus.cc:2804] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.749537  8282 raft_consensus.cc:493] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.749848  8282 raft_consensus.cc:3060] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.756722  8282 raft_consensus.cc:515] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:29.759066  8282 leader_election.cc:290] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [CANDIDATE]: Term 1 election: Requested vote from peers f4a87b395425442c9b8b2dded27c6979 (127.24.179.65:44829), 988de48204664db2b1fdf0005e5fed0c (127.24.179.67:45161)
I20260709 12:16:29.759784  8086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "818537cf17334128ba24fcd7bb885255" candidate_uuid: "679736ba263c423aaaf222df879426d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a87b395425442c9b8b2dded27c6979"
I20260709 12:16:29.760033  8235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "818537cf17334128ba24fcd7bb885255" candidate_uuid: "679736ba263c423aaaf222df879426d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "988de48204664db2b1fdf0005e5fed0c"
I20260709 12:16:29.760538  8086 raft_consensus.cc:3060] T 818537cf17334128ba24fcd7bb885255 P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.760744  8235 raft_consensus.cc:3060] T 818537cf17334128ba24fcd7bb885255 P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.767833  8086 raft_consensus.cc:2468] T 818537cf17334128ba24fcd7bb885255 P f4a87b395425442c9b8b2dded27c6979 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 679736ba263c423aaaf222df879426d7 in term 1.
I20260709 12:16:29.768359  8235 raft_consensus.cc:2468] T 818537cf17334128ba24fcd7bb885255 P 988de48204664db2b1fdf0005e5fed0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 679736ba263c423aaaf222df879426d7 in term 1.
I20260709 12:16:29.769327  8126 leader_election.cc:304] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 679736ba263c423aaaf222df879426d7, f4a87b395425442c9b8b2dded27c6979; no voters: 
I20260709 12:16:29.770236  8282 raft_consensus.cc:2804] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.771284  8282 raft_consensus.cc:697] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [term 1 LEADER]: Becoming Leader. State: Replica: 679736ba263c423aaaf222df879426d7, State: Running, Role: LEADER
I20260709 12:16:29.772212  8282 consensus_queue.cc:237] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:29.780280  7982 catalog_manager.cc:5697] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 679736ba263c423aaaf222df879426d7 (127.24.179.66). New cstate: current_term: 1 leader_uuid: "679736ba263c423aaaf222df879426d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:29.797379  8283 raft_consensus.cc:493] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:29.797938  8283 raft_consensus.cc:515] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } } peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } }
I20260709 12:16:29.800227  8283 leader_election.cc:290] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4a87b395425442c9b8b2dded27c6979 (127.24.179.65:44829), 679736ba263c423aaaf222df879426d7 (127.24.179.66:42741)
I20260709 12:16:29.809585  8086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef04c4de18c4196ad47e0bc639d0d32" candidate_uuid: "988de48204664db2b1fdf0005e5fed0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a87b395425442c9b8b2dded27c6979" is_pre_election: true
I20260709 12:16:29.810463  8086 raft_consensus.cc:2468] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 988de48204664db2b1fdf0005e5fed0c in term 0.
I20260709 12:16:29.811893  8200 leader_election.cc:304] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 988de48204664db2b1fdf0005e5fed0c, f4a87b395425442c9b8b2dded27c6979; no voters: 
I20260709 12:16:29.812175  8161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef04c4de18c4196ad47e0bc639d0d32" candidate_uuid: "988de48204664db2b1fdf0005e5fed0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "679736ba263c423aaaf222df879426d7" is_pre_election: true
I20260709 12:16:29.812716  8283 raft_consensus.cc:2804] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:29.812958  8161 raft_consensus.cc:2468] T 0ef04c4de18c4196ad47e0bc639d0d32 P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 988de48204664db2b1fdf0005e5fed0c in term 0.
I20260709 12:16:29.813169  8283 raft_consensus.cc:493] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:29.813647  8283 raft_consensus.cc:3060] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.820487  8283 raft_consensus.cc:515] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } } peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } }
I20260709 12:16:29.822484  8283 leader_election.cc:290] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [CANDIDATE]: Term 1 election: Requested vote from peers f4a87b395425442c9b8b2dded27c6979 (127.24.179.65:44829), 679736ba263c423aaaf222df879426d7 (127.24.179.66:42741)
I20260709 12:16:29.823376  8086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef04c4de18c4196ad47e0bc639d0d32" candidate_uuid: "988de48204664db2b1fdf0005e5fed0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a87b395425442c9b8b2dded27c6979"
I20260709 12:16:29.823596  8161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef04c4de18c4196ad47e0bc639d0d32" candidate_uuid: "988de48204664db2b1fdf0005e5fed0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "679736ba263c423aaaf222df879426d7"
I20260709 12:16:29.824007  8086 raft_consensus.cc:3060] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.824208  8161 raft_consensus.cc:3060] T 0ef04c4de18c4196ad47e0bc639d0d32 P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:29.830585  8086 raft_consensus.cc:2468] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 988de48204664db2b1fdf0005e5fed0c in term 1.
I20260709 12:16:29.830578  8161 raft_consensus.cc:2468] T 0ef04c4de18c4196ad47e0bc639d0d32 P 679736ba263c423aaaf222df879426d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 988de48204664db2b1fdf0005e5fed0c in term 1.
I20260709 12:16:29.831941  8200 leader_election.cc:304] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 988de48204664db2b1fdf0005e5fed0c, f4a87b395425442c9b8b2dded27c6979; no voters: 
I20260709 12:16:29.832767  8283 raft_consensus.cc:2804] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:29.833827  8283 raft_consensus.cc:697] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [term 1 LEADER]: Becoming Leader. State: Replica: 988de48204664db2b1fdf0005e5fed0c, State: Running, Role: LEADER
I20260709 12:16:29.834733  8283 consensus_queue.cc:237] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } } peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } }
I20260709 12:16:29.842285  7982 catalog_manager.cc:5697] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c reported cstate change: term changed from 0 to 1, leader changed from <none> to 988de48204664db2b1fdf0005e5fed0c (127.24.179.67). New cstate: current_term: 1 leader_uuid: "988de48204664db2b1fdf0005e5fed0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:29.895418  7982 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54298:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:29.897486  7982 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:29.923542  8076 tablet_service.cc:1511] Processing CreateTablet for tablet b6ea8e11706c401b9e62e5b161f63d1e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=aee5ca7c09174b038b4ff07ea198207f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:16:29.924974  8076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ea8e11706c401b9e62e5b161f63d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.924975  8150 tablet_service.cc:1511] Processing CreateTablet for tablet b6ea8e11706c401b9e62e5b161f63d1e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=aee5ca7c09174b038b4ff07ea198207f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:16:29.926517  8150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ea8e11706c401b9e62e5b161f63d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.926409  8224 tablet_service.cc:1511] Processing CreateTablet for tablet b6ea8e11706c401b9e62e5b161f63d1e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=aee5ca7c09174b038b4ff07ea198207f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:16:29.927894  8224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ea8e11706c401b9e62e5b161f63d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.934198  8075 tablet_service.cc:1511] Processing CreateTablet for tablet c5cd2db17cba46dd9088c2dcb150495e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=aee5ca7c09174b038b4ff07ea198207f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:16:29.935024  8151 tablet_service.cc:1511] Processing CreateTablet for tablet c5cd2db17cba46dd9088c2dcb150495e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=aee5ca7c09174b038b4ff07ea198207f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:16:29.935686  8075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5cd2db17cba46dd9088c2dcb150495e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.936434  8151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5cd2db17cba46dd9088c2dcb150495e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.939970  8225 tablet_service.cc:1511] Processing CreateTablet for tablet c5cd2db17cba46dd9088c2dcb150495e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=aee5ca7c09174b038b4ff07ea198207f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:16:29.941475  8225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5cd2db17cba46dd9088c2dcb150495e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:29.943843  8275 tablet_bootstrap.cc:492] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979: Bootstrap starting.
I20260709 12:16:29.951277  8275 tablet_bootstrap.cc:654] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.956993  8277 tablet_bootstrap.cc:492] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c: Bootstrap starting.
I20260709 12:16:29.965452  8277 tablet_bootstrap.cc:654] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.965616  8275 tablet_bootstrap.cc:492] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979: No bootstrap required, opened a new log
I20260709 12:16:29.966295  8275 ts_tablet_manager.cc:1403] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.008s
I20260709 12:16:29.967509  8276 tablet_bootstrap.cc:492] T b6ea8e11706c401b9e62e5b161f63d1e P 679736ba263c423aaaf222df879426d7: Bootstrap starting.
I20260709 12:16:29.973278  8275 raft_consensus.cc:359] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:29.974155  8275 raft_consensus.cc:385] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.974529  8275 raft_consensus.cc:740] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a87b395425442c9b8b2dded27c6979, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.975373  8275 consensus_queue.cc:260] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:29.975991  8276 tablet_bootstrap.cc:654] T b6ea8e11706c401b9e62e5b161f63d1e P 679736ba263c423aaaf222df879426d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.978015  8275 ts_tablet_manager.cc:1434] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:16:29.978439  8277 tablet_bootstrap.cc:492] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c: No bootstrap required, opened a new log
I20260709 12:16:29.979130  8277 ts_tablet_manager.cc:1403] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.003s
I20260709 12:16:29.982560  8277 raft_consensus.cc:359] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:29.984687  8277 raft_consensus.cc:385] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.985121  8277 raft_consensus.cc:740] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 988de48204664db2b1fdf0005e5fed0c, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.986162  8277 consensus_queue.cc:260] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:29.987118  8276 tablet_bootstrap.cc:492] T b6ea8e11706c401b9e62e5b161f63d1e P 679736ba263c423aaaf222df879426d7: No bootstrap required, opened a new log
I20260709 12:16:29.987349  8275 tablet_bootstrap.cc:492] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979: Bootstrap starting.
I20260709 12:16:29.987804  8276 ts_tablet_manager.cc:1403] T b6ea8e11706c401b9e62e5b161f63d1e P 679736ba263c423aaaf222df879426d7: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.002s
I20260709 12:16:29.991243  8276 raft_consensus.cc:359] T b6ea8e11706c401b9e62e5b161f63d1e P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:29.991953  8277 ts_tablet_manager.cc:1434] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:16:29.992151  8276 raft_consensus.cc:385] T b6ea8e11706c401b9e62e5b161f63d1e P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:29.993875  8276 raft_consensus.cc:740] T b6ea8e11706c401b9e62e5b161f63d1e P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 679736ba263c423aaaf222df879426d7, State: Initialized, Role: FOLLOWER
I20260709 12:16:29.993963  8277 tablet_bootstrap.cc:492] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c: Bootstrap starting.
I20260709 12:16:29.995338  8275 tablet_bootstrap.cc:654] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:29.995011  8276 consensus_queue.cc:260] T b6ea8e11706c401b9e62e5b161f63d1e P 679736ba263c423aaaf222df879426d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:29.997673  8276 ts_tablet_manager.cc:1434] T b6ea8e11706c401b9e62e5b161f63d1e P 679736ba263c423aaaf222df879426d7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:16:29.998937  8276 tablet_bootstrap.cc:492] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7: Bootstrap starting.
I20260709 12:16:30.002945  8277 tablet_bootstrap.cc:654] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.008997  8276 tablet_bootstrap.cc:654] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:30.024360  8276 tablet_bootstrap.cc:492] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7: No bootstrap required, opened a new log
I20260709 12:16:30.025290  8276 ts_tablet_manager.cc:1403] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.003s
I20260709 12:16:30.029366  8276 raft_consensus.cc:359] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:30.029987  8276 raft_consensus.cc:385] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.030471  8276 raft_consensus.cc:740] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 679736ba263c423aaaf222df879426d7, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.031100  8275 tablet_bootstrap.cc:492] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979: No bootstrap required, opened a new log
I20260709 12:16:30.031739  8275 ts_tablet_manager.cc:1403] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.019s
I20260709 12:16:30.031427  8276 consensus_queue.cc:260] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:30.033124  8277 tablet_bootstrap.cc:492] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c: No bootstrap required, opened a new log
I20260709 12:16:30.033778  8277 ts_tablet_manager.cc:1403] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.020s
I20260709 12:16:30.034304  8276 ts_tablet_manager.cc:1434] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:16:30.035394  8275 raft_consensus.cc:359] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:30.036092  8275 raft_consensus.cc:385] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.036363  8275 raft_consensus.cc:740] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a87b395425442c9b8b2dded27c6979, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.037120  8275 consensus_queue.cc:260] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:30.037276  8277 raft_consensus.cc:359] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:30.038102  8277 raft_consensus.cc:385] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:30.038457  8277 raft_consensus.cc:740] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 988de48204664db2b1fdf0005e5fed0c, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.039350  8277 consensus_queue.cc:260] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:30.039893  8275 ts_tablet_manager.cc:1434] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:16:30.043351  8277 ts_tablet_manager.cc:1434] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
W20260709 12:16:30.058156  8031 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:30.082559  8283 raft_consensus.cc:493] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.083144  8283 raft_consensus.cc:515] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:30.084842  8283 leader_election.cc:290] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4a87b395425442c9b8b2dded27c6979 (127.24.179.65:44829), 679736ba263c423aaaf222df879426d7 (127.24.179.66:42741)
I20260709 12:16:30.085887  8086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ea8e11706c401b9e62e5b161f63d1e" candidate_uuid: "988de48204664db2b1fdf0005e5fed0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a87b395425442c9b8b2dded27c6979" is_pre_election: true
I20260709 12:16:30.085965  8161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ea8e11706c401b9e62e5b161f63d1e" candidate_uuid: "988de48204664db2b1fdf0005e5fed0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "679736ba263c423aaaf222df879426d7" is_pre_election: true
I20260709 12:16:30.086757  8086 raft_consensus.cc:2468] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 988de48204664db2b1fdf0005e5fed0c in term 0.
I20260709 12:16:30.086828  8161 raft_consensus.cc:2468] T b6ea8e11706c401b9e62e5b161f63d1e P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 988de48204664db2b1fdf0005e5fed0c in term 0.
I20260709 12:16:30.087915  8200 leader_election.cc:304] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 988de48204664db2b1fdf0005e5fed0c, f4a87b395425442c9b8b2dded27c6979; no voters: 
I20260709 12:16:30.088699  8283 raft_consensus.cc:2804] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:30.089032  8283 raft_consensus.cc:493] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.089325  8283 raft_consensus.cc:3060] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.094970  8283 raft_consensus.cc:515] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:30.096717  8283 leader_election.cc:290] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [CANDIDATE]: Term 1 election: Requested vote from peers f4a87b395425442c9b8b2dded27c6979 (127.24.179.65:44829), 679736ba263c423aaaf222df879426d7 (127.24.179.66:42741)
I20260709 12:16:30.097841  8086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ea8e11706c401b9e62e5b161f63d1e" candidate_uuid: "988de48204664db2b1fdf0005e5fed0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a87b395425442c9b8b2dded27c6979"
I20260709 12:16:30.097918  8161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ea8e11706c401b9e62e5b161f63d1e" candidate_uuid: "988de48204664db2b1fdf0005e5fed0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "679736ba263c423aaaf222df879426d7"
I20260709 12:16:30.098654  8086 raft_consensus.cc:3060] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.098734  8161 raft_consensus.cc:3060] T b6ea8e11706c401b9e62e5b161f63d1e P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.105525  8161 raft_consensus.cc:2468] T b6ea8e11706c401b9e62e5b161f63d1e P 679736ba263c423aaaf222df879426d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 988de48204664db2b1fdf0005e5fed0c in term 1.
I20260709 12:16:30.105561  8086 raft_consensus.cc:2468] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 988de48204664db2b1fdf0005e5fed0c in term 1.
I20260709 12:16:30.106983  8198 leader_election.cc:304] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 679736ba263c423aaaf222df879426d7, 988de48204664db2b1fdf0005e5fed0c; no voters: 
I20260709 12:16:30.107808  8283 raft_consensus.cc:2804] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:30.108249  8283 raft_consensus.cc:697] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [term 1 LEADER]: Becoming Leader. State: Replica: 988de48204664db2b1fdf0005e5fed0c, State: Running, Role: LEADER
I20260709 12:16:30.109072  8283 consensus_queue.cc:237] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:30.116138  7982 catalog_manager.cc:5697] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c reported cstate change: term changed from 0 to 1, leader changed from <none> to 988de48204664db2b1fdf0005e5fed0c (127.24.179.67). New cstate: current_term: 1 leader_uuid: "988de48204664db2b1fdf0005e5fed0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:30.134686  8281 raft_consensus.cc:493] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.135315  8281 raft_consensus.cc:515] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:30.137689  8281 leader_election.cc:290] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 679736ba263c423aaaf222df879426d7 (127.24.179.66:42741), 988de48204664db2b1fdf0005e5fed0c (127.24.179.67:45161)
I20260709 12:16:30.148696  8161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5cd2db17cba46dd9088c2dcb150495e" candidate_uuid: "f4a87b395425442c9b8b2dded27c6979" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "679736ba263c423aaaf222df879426d7" is_pre_election: true
I20260709 12:16:30.149204  8235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5cd2db17cba46dd9088c2dcb150495e" candidate_uuid: "f4a87b395425442c9b8b2dded27c6979" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "988de48204664db2b1fdf0005e5fed0c" is_pre_election: true
I20260709 12:16:30.149518  8161 raft_consensus.cc:2468] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4a87b395425442c9b8b2dded27c6979 in term 0.
I20260709 12:16:30.149964  8235 raft_consensus.cc:2468] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4a87b395425442c9b8b2dded27c6979 in term 0.
I20260709 12:16:30.150089  8282 raft_consensus.cc:493] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:30.150760  8049 leader_election.cc:304] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 679736ba263c423aaaf222df879426d7, f4a87b395425442c9b8b2dded27c6979; no voters: 
I20260709 12:16:30.150933  8282 raft_consensus.cc:515] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:30.151737  8281 raft_consensus.cc:2804] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:30.152107  8281 raft_consensus.cc:493] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.152490  8281 raft_consensus.cc:3060] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.153416  8282 leader_election.cc:290] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4a87b395425442c9b8b2dded27c6979 (127.24.179.65:44829), 988de48204664db2b1fdf0005e5fed0c (127.24.179.67:45161)
I20260709 12:16:30.154868  8235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5cd2db17cba46dd9088c2dcb150495e" candidate_uuid: "679736ba263c423aaaf222df879426d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "988de48204664db2b1fdf0005e5fed0c" is_pre_election: true
I20260709 12:16:30.154927  8086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5cd2db17cba46dd9088c2dcb150495e" candidate_uuid: "679736ba263c423aaaf222df879426d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a87b395425442c9b8b2dded27c6979" is_pre_election: true
I20260709 12:16:30.155586  8235 raft_consensus.cc:2468] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 679736ba263c423aaaf222df879426d7 in term 0.
I20260709 12:16:30.156690  8126 leader_election.cc:304] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 679736ba263c423aaaf222df879426d7, 988de48204664db2b1fdf0005e5fed0c; no voters: 
I20260709 12:16:30.157627  8282 raft_consensus.cc:2804] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:30.158046  8282 raft_consensus.cc:493] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:30.158417  8282 raft_consensus.cc:3060] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.161602  8281 raft_consensus.cc:515] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:30.163098  8086 raft_consensus.cc:2393] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 679736ba263c423aaaf222df879426d7 in current term 1: Already voted for candidate f4a87b395425442c9b8b2dded27c6979 in this term.
I20260709 12:16:30.164160  8281 leader_election.cc:290] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [CANDIDATE]: Term 1 election: Requested vote from peers 679736ba263c423aaaf222df879426d7 (127.24.179.66:42741), 988de48204664db2b1fdf0005e5fed0c (127.24.179.67:45161)
I20260709 12:16:30.165227  8161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5cd2db17cba46dd9088c2dcb150495e" candidate_uuid: "f4a87b395425442c9b8b2dded27c6979" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "679736ba263c423aaaf222df879426d7"
I20260709 12:16:30.165354  8235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5cd2db17cba46dd9088c2dcb150495e" candidate_uuid: "f4a87b395425442c9b8b2dded27c6979" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "988de48204664db2b1fdf0005e5fed0c"
I20260709 12:16:30.166247  8235 raft_consensus.cc:3060] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:30.167054  8282 raft_consensus.cc:515] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:30.168438  8161 raft_consensus.cc:2393] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f4a87b395425442c9b8b2dded27c6979 in current term 1: Already voted for candidate 679736ba263c423aaaf222df879426d7 in this term.
I20260709 12:16:30.171375  8282 leader_election.cc:290] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [CANDIDATE]: Term 1 election: Requested vote from peers f4a87b395425442c9b8b2dded27c6979 (127.24.179.65:44829), 988de48204664db2b1fdf0005e5fed0c (127.24.179.67:45161)
I20260709 12:16:30.172099  8086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5cd2db17cba46dd9088c2dcb150495e" candidate_uuid: "679736ba263c423aaaf222df879426d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a87b395425442c9b8b2dded27c6979"
I20260709 12:16:30.173017  8086 raft_consensus.cc:2393] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 679736ba263c423aaaf222df879426d7 in current term 1: Already voted for candidate f4a87b395425442c9b8b2dded27c6979 in this term.
I20260709 12:16:30.173280  8234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5cd2db17cba46dd9088c2dcb150495e" candidate_uuid: "679736ba263c423aaaf222df879426d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "988de48204664db2b1fdf0005e5fed0c"
I20260709 12:16:30.174676  8282 consensus_queue.cc:1048] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:30.175148  8126 leader_election.cc:304] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 679736ba263c423aaaf222df879426d7; no voters: 988de48204664db2b1fdf0005e5fed0c, f4a87b395425442c9b8b2dded27c6979
I20260709 12:16:30.175470  8235 raft_consensus.cc:2468] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a87b395425442c9b8b2dded27c6979 in term 1.
I20260709 12:16:30.176702  8282 raft_consensus.cc:2749] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:30.176748  8051 leader_election.cc:304] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 988de48204664db2b1fdf0005e5fed0c, f4a87b395425442c9b8b2dded27c6979; no voters: 679736ba263c423aaaf222df879426d7
I20260709 12:16:30.177784  8281 raft_consensus.cc:2804] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:30.178974  8281 raft_consensus.cc:697] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 1 LEADER]: Becoming Leader. State: Replica: f4a87b395425442c9b8b2dded27c6979, State: Running, Role: LEADER
I20260709 12:16:30.180032  8281 consensus_queue.cc:237] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:30.191184  7982 catalog_manager.cc:5697] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4a87b395425442c9b8b2dded27c6979 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "f4a87b395425442c9b8b2dded27c6979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:30.195725  8282 consensus_queue.cc:1048] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:30.263234  8235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ef04c4de18c4196ad47e0bc639d0d32"
dest_uuid: "988de48204664db2b1fdf0005e5fed0c"
mode: GRACEFUL
new_leader_uuid: "f4a87b395425442c9b8b2dded27c6979"
 from {username='slave'} at 127.0.0.1:50352
I20260709 12:16:30.263854  8235 raft_consensus.cc:606] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [term 1 LEADER]: Received request to transfer leadership to TS f4a87b395425442c9b8b2dded27c6979
I20260709 12:16:30.273706  8235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6ea8e11706c401b9e62e5b161f63d1e"
dest_uuid: "988de48204664db2b1fdf0005e5fed0c"
mode: GRACEFUL
new_leader_uuid: "f4a87b395425442c9b8b2dded27c6979"
 from {username='slave'} at 127.0.0.1:50352
I20260709 12:16:30.274250  8235 raft_consensus.cc:606] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [term 1 LEADER]: Received request to transfer leadership to TS f4a87b395425442c9b8b2dded27c6979
I20260709 12:16:30.403249  8283 consensus_queue.cc:1048] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:30.420995  8291 consensus_queue.cc:1048] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:30.432315  8283 raft_consensus.cc:993] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c: : Instructing follower f4a87b395425442c9b8b2dded27c6979 to start an election
I20260709 12:16:30.432960  8291 raft_consensus.cc:1081] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [term 1 LEADER]: Signalling peer f4a87b395425442c9b8b2dded27c6979 to start an election
I20260709 12:16:30.435112  8086 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ef04c4de18c4196ad47e0bc639d0d32"
dest_uuid: "f4a87b395425442c9b8b2dded27c6979"
 from {username='slave'} at 127.0.0.1:47532
I20260709 12:16:30.435909  8086 raft_consensus.cc:493] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:30.436327  8086 raft_consensus.cc:3060] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.444551  8086 raft_consensus.cc:515] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } } peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } }
I20260709 12:16:30.448349  8235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef04c4de18c4196ad47e0bc639d0d32" candidate_uuid: "f4a87b395425442c9b8b2dded27c6979" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "988de48204664db2b1fdf0005e5fed0c"
I20260709 12:16:30.449016  8235 raft_consensus.cc:3055] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:30.449175  8161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef04c4de18c4196ad47e0bc639d0d32" candidate_uuid: "f4a87b395425442c9b8b2dded27c6979" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "679736ba263c423aaaf222df879426d7"
I20260709 12:16:30.449436  8235 raft_consensus.cc:740] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 988de48204664db2b1fdf0005e5fed0c, State: Running, Role: LEADER
I20260709 12:16:30.449967  8161 raft_consensus.cc:3060] T 0ef04c4de18c4196ad47e0bc639d0d32 P 679736ba263c423aaaf222df879426d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.450508  8235 consensus_queue.cc:260] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } } peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } }
I20260709 12:16:30.451849  8235 raft_consensus.cc:3060] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.458541  8086 leader_election.cc:290] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979 [CANDIDATE]: Term 2 election: Requested vote from peers 988de48204664db2b1fdf0005e5fed0c (127.24.179.67:45161), 679736ba263c423aaaf222df879426d7 (127.24.179.66:42741)
I20260709 12:16:30.459803  8161 raft_consensus.cc:2468] T 0ef04c4de18c4196ad47e0bc639d0d32 P 679736ba263c423aaaf222df879426d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a87b395425442c9b8b2dded27c6979 in term 2.
I20260709 12:16:30.461254  8235 raft_consensus.cc:2468] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a87b395425442c9b8b2dded27c6979 in term 2.
I20260709 12:16:30.461294  8049 leader_election.cc:304] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 679736ba263c423aaaf222df879426d7, f4a87b395425442c9b8b2dded27c6979; no voters: 
I20260709 12:16:30.462587  8281 raft_consensus.cc:2804] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:30.463148  8281 raft_consensus.cc:697] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979 [term 2 LEADER]: Becoming Leader. State: Replica: f4a87b395425442c9b8b2dded27c6979, State: Running, Role: LEADER
I20260709 12:16:30.464100  8281 consensus_queue.cc:237] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } } peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } }
I20260709 12:16:30.474071  7982 catalog_manager.cc:5697] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979 reported cstate change: term changed from 1 to 2, leader changed from 988de48204664db2b1fdf0005e5fed0c (127.24.179.67) to f4a87b395425442c9b8b2dded27c6979 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "f4a87b395425442c9b8b2dded27c6979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:30.634770  8307 consensus_queue.cc:1048] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [LEADER]: Connected to new peer: Peer: permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:30.646346  8281 consensus_queue.cc:1048] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [LEADER]: Connected to new peer: Peer: permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:30.664772  8291 consensus_queue.cc:1048] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:30.671818  8283 raft_consensus.cc:993] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c: : Instructing follower f4a87b395425442c9b8b2dded27c6979 to start an election
I20260709 12:16:30.673163  8291 raft_consensus.cc:1081] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [term 1 LEADER]: Signalling peer f4a87b395425442c9b8b2dded27c6979 to start an election
I20260709 12:16:30.675045  8085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6ea8e11706c401b9e62e5b161f63d1e"
dest_uuid: "f4a87b395425442c9b8b2dded27c6979"
 from {username='slave'} at 127.0.0.1:47532
I20260709 12:16:30.677841  8085 raft_consensus.cc:493] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:30.678371  8085 raft_consensus.cc:3060] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.682607  8322 consensus_queue.cc:1048] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:30.687978  8085 raft_consensus.cc:515] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:30.693540  8085 leader_election.cc:290] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979 [CANDIDATE]: Term 2 election: Requested vote from peers 679736ba263c423aaaf222df879426d7 (127.24.179.66:42741), 988de48204664db2b1fdf0005e5fed0c (127.24.179.67:45161)
I20260709 12:16:30.694168  8235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ea8e11706c401b9e62e5b161f63d1e" candidate_uuid: "f4a87b395425442c9b8b2dded27c6979" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "988de48204664db2b1fdf0005e5fed0c"
I20260709 12:16:30.695011  8235 raft_consensus.cc:3055] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:30.695302  8235 raft_consensus.cc:740] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 988de48204664db2b1fdf0005e5fed0c, State: Running, Role: LEADER
I20260709 12:16:30.696229  8235 consensus_queue.cc:260] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:30.697502  8235 raft_consensus.cc:3060] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.698657  8161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ea8e11706c401b9e62e5b161f63d1e" candidate_uuid: "f4a87b395425442c9b8b2dded27c6979" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "679736ba263c423aaaf222df879426d7"
I20260709 12:16:30.699339  8161 raft_consensus.cc:3060] T b6ea8e11706c401b9e62e5b161f63d1e P 679736ba263c423aaaf222df879426d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.706348  8235 raft_consensus.cc:2468] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a87b395425442c9b8b2dded27c6979 in term 2.
I20260709 12:16:30.707686  8161 raft_consensus.cc:2468] T b6ea8e11706c401b9e62e5b161f63d1e P 679736ba263c423aaaf222df879426d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a87b395425442c9b8b2dded27c6979 in term 2.
I20260709 12:16:30.707942  8051 leader_election.cc:304] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 988de48204664db2b1fdf0005e5fed0c, f4a87b395425442c9b8b2dded27c6979; no voters: 
I20260709 12:16:30.708889  8307 raft_consensus.cc:2804] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:30.709335  8307 raft_consensus.cc:697] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979 [term 2 LEADER]: Becoming Leader. State: Replica: f4a87b395425442c9b8b2dded27c6979, State: Running, Role: LEADER
I20260709 12:16:30.710182  8307 consensus_queue.cc:237] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:30.716862  7980 catalog_manager.cc:5697] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979 reported cstate change: term changed from 1 to 2, leader changed from 988de48204664db2b1fdf0005e5fed0c (127.24.179.67) to f4a87b395425442c9b8b2dded27c6979 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "f4a87b395425442c9b8b2dded27c6979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:30.771944 25293 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:16:30.773818 25293 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:16:30.774255 25293 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:16:30.788139  8085 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5cd2db17cba46dd9088c2dcb150495e"
dest_uuid: "f4a87b395425442c9b8b2dded27c6979"
mode: GRACEFUL
new_leader_uuid: "988de48204664db2b1fdf0005e5fed0c"
 from {username='slave'} at 127.0.0.1:47538
I20260709 12:16:30.788700  8085 raft_consensus.cc:606] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 1 LEADER]: Received request to transfer leadership to TS 988de48204664db2b1fdf0005e5fed0c
I20260709 12:16:30.789975 25293 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:16:30.958042  8235 raft_consensus.cc:1275] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [term 2 FOLLOWER]: Refusing update from remote peer f4a87b395425442c9b8b2dded27c6979: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:30.959645  8307 consensus_queue.cc:1048] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979 [LEADER]: Connected to new peer: Peer: permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:30.968900  8161 raft_consensus.cc:1275] T 0ef04c4de18c4196ad47e0bc639d0d32 P 679736ba263c423aaaf222df879426d7 [term 2 FOLLOWER]: Refusing update from remote peer f4a87b395425442c9b8b2dded27c6979: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:30.970571  8307 consensus_queue.cc:1048] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979 [LEADER]: Connected to new peer: Peer: permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:31.118285  8235 raft_consensus.cc:1275] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [term 2 FOLLOWER]: Refusing update from remote peer f4a87b395425442c9b8b2dded27c6979: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:31.119711  8307 consensus_queue.cc:1048] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979 [LEADER]: Connected to new peer: Peer: permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:31.127868  8161 raft_consensus.cc:1275] T b6ea8e11706c401b9e62e5b161f63d1e P 679736ba263c423aaaf222df879426d7 [term 2 FOLLOWER]: Refusing update from remote peer f4a87b395425442c9b8b2dded27c6979: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:31.129853  8319 consensus_queue.cc:1048] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979 [LEADER]: Connected to new peer: Peer: permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:31.185016  8307 raft_consensus.cc:993] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979: : Instructing follower 988de48204664db2b1fdf0005e5fed0c to start an election
I20260709 12:16:31.185699  8307 raft_consensus.cc:1081] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 1 LEADER]: Signalling peer 988de48204664db2b1fdf0005e5fed0c to start an election
I20260709 12:16:31.187500  8235 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5cd2db17cba46dd9088c2dcb150495e"
dest_uuid: "988de48204664db2b1fdf0005e5fed0c"
 from {username='slave'} at 127.0.0.1:50342
I20260709 12:16:31.188131  8235 raft_consensus.cc:493] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:31.188591  8235 raft_consensus.cc:3060] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:31.194746  8235 raft_consensus.cc:515] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:31.196559  8235 leader_election.cc:290] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c [CANDIDATE]: Term 2 election: Requested vote from peers f4a87b395425442c9b8b2dded27c6979 (127.24.179.65:44829), 679736ba263c423aaaf222df879426d7 (127.24.179.66:42741)
I20260709 12:16:31.197744  8085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5cd2db17cba46dd9088c2dcb150495e" candidate_uuid: "988de48204664db2b1fdf0005e5fed0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4a87b395425442c9b8b2dded27c6979"
I20260709 12:16:31.197932  8161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5cd2db17cba46dd9088c2dcb150495e" candidate_uuid: "988de48204664db2b1fdf0005e5fed0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "679736ba263c423aaaf222df879426d7"
I20260709 12:16:31.198557  8085 raft_consensus.cc:3055] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:31.198635  8161 raft_consensus.cc:3060] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:31.198935  8085 raft_consensus.cc:740] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4a87b395425442c9b8b2dded27c6979, State: Running, Role: LEADER
I20260709 12:16:31.199877  8085 consensus_queue.cc:260] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:31.200961  8085 raft_consensus.cc:3060] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:31.205171  8161 raft_consensus.cc:2468] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 988de48204664db2b1fdf0005e5fed0c in term 2.
I20260709 12:16:31.206671  8198 leader_election.cc:304] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 679736ba263c423aaaf222df879426d7, 988de48204664db2b1fdf0005e5fed0c; no voters: 
I20260709 12:16:31.207635  8291 raft_consensus.cc:2804] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:31.208031  8085 raft_consensus.cc:2468] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 988de48204664db2b1fdf0005e5fed0c in term 2.
I20260709 12:16:31.208885  8291 raft_consensus.cc:697] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c [term 2 LEADER]: Becoming Leader. State: Replica: 988de48204664db2b1fdf0005e5fed0c, State: Running, Role: LEADER
I20260709 12:16:31.209978  8291 consensus_queue.cc:237] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } }
I20260709 12:16:31.216774  7982 catalog_manager.cc:5697] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c reported cstate change: term changed from 1 to 2, leader changed from f4a87b395425442c9b8b2dded27c6979 (127.24.179.65) to 988de48204664db2b1fdf0005e5fed0c (127.24.179.67). New cstate: current_term: 2 leader_uuid: "988de48204664db2b1fdf0005e5fed0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a87b395425442c9b8b2dded27c6979" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 44829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "679736ba263c423aaaf222df879426d7" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 42741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "988de48204664db2b1fdf0005e5fed0c" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 45161 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:31.416882 25293 tablet_server.cc:179] TabletServer@127.24.179.65:0 shutting down...
I20260709 12:16:31.441543 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:31.442385 25293 tablet_replica.cc:333] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979: stopping tablet replica
I20260709 12:16:31.443085 25293 raft_consensus.cc:2243] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:31.444075 25293 raft_consensus.cc:2272] T b6ea8e11706c401b9e62e5b161f63d1e P f4a87b395425442c9b8b2dded27c6979 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.447106 25293 tablet_replica.cc:333] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979: stopping tablet replica
I20260709 12:16:31.447736 25293 raft_consensus.cc:2243] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:31.448802 25293 raft_consensus.cc:2272] T 0ef04c4de18c4196ad47e0bc639d0d32 P f4a87b395425442c9b8b2dded27c6979 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.451859 25293 tablet_replica.cc:333] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979: stopping tablet replica
I20260709 12:16:31.452489 25293 raft_consensus.cc:2243] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:31.452952 25293 raft_consensus.cc:2272] T c5cd2db17cba46dd9088c2dcb150495e P f4a87b395425442c9b8b2dded27c6979 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.455312 25293 tablet_replica.cc:333] T 818537cf17334128ba24fcd7bb885255 P f4a87b395425442c9b8b2dded27c6979: stopping tablet replica
I20260709 12:16:31.455870 25293 raft_consensus.cc:2243] T 818537cf17334128ba24fcd7bb885255 P f4a87b395425442c9b8b2dded27c6979 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:31.456367 25293 raft_consensus.cc:2272] T 818537cf17334128ba24fcd7bb885255 P f4a87b395425442c9b8b2dded27c6979 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.480721 25293 tablet_server.cc:196] TabletServer@127.24.179.65:0 shutdown complete.
I20260709 12:16:31.494150 25293 tablet_server.cc:179] TabletServer@127.24.179.66:0 shutting down...
I20260709 12:16:31.546766 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:31.548127 25293 tablet_replica.cc:333] T b6ea8e11706c401b9e62e5b161f63d1e P 679736ba263c423aaaf222df879426d7: stopping tablet replica
I20260709 12:16:31.549314 25293 raft_consensus.cc:2243] T b6ea8e11706c401b9e62e5b161f63d1e P 679736ba263c423aaaf222df879426d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:31.550288 25293 raft_consensus.cc:2272] T b6ea8e11706c401b9e62e5b161f63d1e P 679736ba263c423aaaf222df879426d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.555156 25293 tablet_replica.cc:333] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7: stopping tablet replica
I20260709 12:16:31.556321 25293 raft_consensus.cc:2243] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:31.557081 25293 raft_consensus.cc:2272] T c5cd2db17cba46dd9088c2dcb150495e P 679736ba263c423aaaf222df879426d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.563763 25293 tablet_replica.cc:333] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7: stopping tablet replica
I20260709 12:16:31.565048 25293 raft_consensus.cc:2243] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:16:31.565842  8282 consensus_queue.cc:1175] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "988de48204664db2b1fdf0005e5fed0c" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:16:31.567749 25293 raft_consensus.cc:2272] T 818537cf17334128ba24fcd7bb885255 P 679736ba263c423aaaf222df879426d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.571269 25293 tablet_replica.cc:333] T 0ef04c4de18c4196ad47e0bc639d0d32 P 679736ba263c423aaaf222df879426d7: stopping tablet replica
I20260709 12:16:31.571934 25293 raft_consensus.cc:2243] T 0ef04c4de18c4196ad47e0bc639d0d32 P 679736ba263c423aaaf222df879426d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:31.572930 25293 raft_consensus.cc:2272] T 0ef04c4de18c4196ad47e0bc639d0d32 P 679736ba263c423aaaf222df879426d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.603478 25293 tablet_server.cc:196] TabletServer@127.24.179.66:0 shutdown complete.
I20260709 12:16:31.627990 25293 tablet_server.cc:179] TabletServer@127.24.179.67:0 shutting down...
I20260709 12:16:31.657239 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:31.658300 25293 tablet_replica.cc:333] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c: stopping tablet replica
I20260709 12:16:31.659499 25293 raft_consensus.cc:2243] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:31.660344 25293 raft_consensus.cc:2272] T b6ea8e11706c401b9e62e5b161f63d1e P 988de48204664db2b1fdf0005e5fed0c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.664052 25293 tablet_replica.cc:333] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c: stopping tablet replica
I20260709 12:16:31.664891 25293 raft_consensus.cc:2243] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:31.665612 25293 raft_consensus.cc:2272] T 0ef04c4de18c4196ad47e0bc639d0d32 P 988de48204664db2b1fdf0005e5fed0c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.669549 25293 tablet_replica.cc:333] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c: stopping tablet replica
I20260709 12:16:31.670302 25293 raft_consensus.cc:2243] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:31.671509 25293 pending_rounds.cc:70] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c: Trying to abort 1 pending ops.
I20260709 12:16:31.671768 25293 pending_rounds.cc:77] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305623106404294656 op_type: NO_OP noop_request { }
I20260709 12:16:31.672134 25293 raft_consensus.cc:2889] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:16:31.672511 25293 raft_consensus.cc:2272] T c5cd2db17cba46dd9088c2dcb150495e P 988de48204664db2b1fdf0005e5fed0c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.676564 25293 tablet_replica.cc:333] T 818537cf17334128ba24fcd7bb885255 P 988de48204664db2b1fdf0005e5fed0c: stopping tablet replica
I20260709 12:16:31.677194 25293 raft_consensus.cc:2243] T 818537cf17334128ba24fcd7bb885255 P 988de48204664db2b1fdf0005e5fed0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:31.677742 25293 raft_consensus.cc:2272] T 818537cf17334128ba24fcd7bb885255 P 988de48204664db2b1fdf0005e5fed0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.705353 25293 tablet_server.cc:196] TabletServer@127.24.179.67:0 shutdown complete.
I20260709 12:16:31.730167 25293 master.cc:562] Master@127.24.179.126:41171 shutting down...
I20260709 12:16:31.754294 25293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:31.755304 25293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:31.755728 25293 tablet_replica.cc:333] T 00000000000000000000000000000000 P 30dc32353a0e4d81bb0af15912e78c02: stopping tablet replica
I20260709 12:16:31.778472 25293 master.cc:584] Master@127.24.179.126:41171 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2902 ms)
[----------] 6 tests from LeaderRebalancerTest (496819 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:16:31.826620 25293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.179.126:42359
I20260709 12:16:31.828014 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:31.834888  8329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:31.834995  8330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:31.836489  8332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:31.837762 25293 server_base.cc:1061] running on GCE node
I20260709 12:16:31.838800 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:31.838999 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:31.839133 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599391839102 us; error 0 us; skew 500 ppm
I20260709 12:16:31.839622 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:31.842226 25293 webserver.cc:533] Webserver started at http://127.24.179.126:46413/ using document root <none> and password file <none>
I20260709 12:16:31.842840 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:31.843011 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:31.843252 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:31.844651 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894834136-25293-0/minicluster-data/master-0-root/instance:
uuid: "83edc39405c6434f93cb0d09c52102f7"
format_stamp: "Formatted at 2026-07-09 12:16:31 on dist-test-slave-tjfs"
I20260709 12:16:31.849912 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.002s
I20260709 12:16:31.854180  8337 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:31.855213 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:16:31.855603 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894834136-25293-0/minicluster-data/master-0-root
uuid: "83edc39405c6434f93cb0d09c52102f7"
format_stamp: "Formatted at 2026-07-09 12:16:31 on dist-test-slave-tjfs"
I20260709 12:16:31.855983 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894834136-25293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894834136-25293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894834136-25293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:31.905519 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:31.906967 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:31.950026 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.126:42359
I20260709 12:16:31.950157  8389 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.126:42359 every 8 connection(s)
I20260709 12:16:31.954634  8390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:31.969691  8390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7: Bootstrap starting.
I20260709 12:16:31.975239  8390 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:31.980095  8390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7: No bootstrap required, opened a new log
I20260709 12:16:31.982671  8390 raft_consensus.cc:359] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83edc39405c6434f93cb0d09c52102f7" member_type: VOTER }
I20260709 12:16:31.983120  8390 raft_consensus.cc:385] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:31.983412  8390 raft_consensus.cc:740] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83edc39405c6434f93cb0d09c52102f7, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.984053  8390 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83edc39405c6434f93cb0d09c52102f7" member_type: VOTER }
I20260709 12:16:31.984555  8390 raft_consensus.cc:399] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:31.984782  8390 raft_consensus.cc:493] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:31.985110  8390 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:31.990916  8390 raft_consensus.cc:515] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83edc39405c6434f93cb0d09c52102f7" member_type: VOTER }
I20260709 12:16:31.991528  8390 leader_election.cc:304] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83edc39405c6434f93cb0d09c52102f7; no voters: 
I20260709 12:16:31.992754  8390 leader_election.cc:290] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:31.993258  8393 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:31.994814  8393 raft_consensus.cc:697] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7 [term 1 LEADER]: Becoming Leader. State: Replica: 83edc39405c6434f93cb0d09c52102f7, State: Running, Role: LEADER
I20260709 12:16:31.995649  8393 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83edc39405c6434f93cb0d09c52102f7" member_type: VOTER }
I20260709 12:16:31.995914  8390 sys_catalog.cc:565] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:31.999415  8395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83edc39405c6434f93cb0d09c52102f7. Latest consensus state: current_term: 1 leader_uuid: "83edc39405c6434f93cb0d09c52102f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83edc39405c6434f93cb0d09c52102f7" member_type: VOTER } }
I20260709 12:16:31.999415  8394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83edc39405c6434f93cb0d09c52102f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83edc39405c6434f93cb0d09c52102f7" member_type: VOTER } }
I20260709 12:16:32.000335  8395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:32.000468  8394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:32.005039  8399 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:32.010382  8399 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:32.014501 25293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:32.020548  8399 catalog_manager.cc:1383] Generated new cluster ID: d64cf5ea4f9e4c2cab875194410bfdb9
I20260709 12:16:32.020906  8399 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:32.058265  8399 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:32.059830  8399 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:32.078280  8399 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7: Generated new TSK 0
I20260709 12:16:32.079038  8399 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:32.146358 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:32.153542  8411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:32.154667  8412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:32.157433  8414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:32.160298 25293 server_base.cc:1061] running on GCE node
I20260709 12:16:32.163327 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:32.163560 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:32.163813 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599392163791 us; error 0 us; skew 500 ppm
I20260709 12:16:32.164433 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:32.167110 25293 webserver.cc:533] Webserver started at http://127.24.179.65:46169/ using document root <none> and password file <none>
I20260709 12:16:32.167689 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:32.167908 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:32.168203 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:32.169454 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894834136-25293-0/minicluster-data/ts-0-root/instance:
uuid: "8493340c2bd047e59811b953aab2a423"
format_stamp: "Formatted at 2026-07-09 12:16:32 on dist-test-slave-tjfs"
I20260709 12:16:32.174708 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:16:32.178680  8419 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:32.179544 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:16:32.179900 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894834136-25293-0/minicluster-data/ts-0-root
uuid: "8493340c2bd047e59811b953aab2a423"
format_stamp: "Formatted at 2026-07-09 12:16:32 on dist-test-slave-tjfs"
I20260709 12:16:32.180212 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894834136-25293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894834136-25293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894834136-25293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:32.196125 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:32.197638 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:32.199422 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:32.202064 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:32.202338 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:32.202678 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:32.202874 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:32.248031 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.65:42549
I20260709 12:16:32.248152  8481 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.65:42549 every 8 connection(s)
I20260709 12:16:32.253973 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:32.263077  8486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:32.267630  8487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:32.269212  8489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:32.269686 25293 server_base.cc:1061] running on GCE node
I20260709 12:16:32.271829  8482 heartbeater.cc:344] Connected to a master server at 127.24.179.126:42359
I20260709 12:16:32.272584  8482 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:32.274482  8482 heartbeater.cc:507] Master 127.24.179.126:42359 requested a full tablet report, sending...
I20260709 12:16:32.277782 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:32.278201 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:32.278164  8355 ts_manager.cc:194] Registered new tserver with Master: 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549)
I20260709 12:16:32.278693 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599392278668 us; error 0 us; skew 500 ppm
I20260709 12:16:32.279620 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:32.281117  8355 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47864
I20260709 12:16:32.282831 25293 webserver.cc:533] Webserver started at http://127.24.179.66:42523/ using document root <none> and password file <none>
I20260709 12:16:32.283568 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:32.283833 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:32.284188 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:32.285660 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894834136-25293-0/minicluster-data/ts-1-root/instance:
uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
format_stamp: "Formatted at 2026-07-09 12:16:32 on dist-test-slave-tjfs"
I20260709 12:16:32.291016 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 12:16:32.295686  8494 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:32.296609 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:16:32.296926 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894834136-25293-0/minicluster-data/ts-1-root
uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
format_stamp: "Formatted at 2026-07-09 12:16:32 on dist-test-slave-tjfs"
I20260709 12:16:32.297204 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894834136-25293-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894834136-25293-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894834136-25293-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:32.322618 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:32.323899 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:32.325435 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:32.327987 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:32.328262 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:32.328531 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:32.328714 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:32.373837 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.66:41773
I20260709 12:16:32.373950  8556 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.66:41773 every 8 connection(s)
I20260709 12:16:32.379262 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:32.387948  8560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:32.390064  8561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:32.392648 25293 server_base.cc:1061] running on GCE node
W20260709 12:16:32.393174  8563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:32.394668 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:16:32.394946  8557 heartbeater.cc:344] Connected to a master server at 127.24.179.126:42359
W20260709 12:16:32.395004 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:32.395440 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599392395420 us; error 0 us; skew 500 ppm
I20260709 12:16:32.395499  8557 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:32.396147 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:32.396570  8557 heartbeater.cc:507] Master 127.24.179.126:42359 requested a full tablet report, sending...
I20260709 12:16:32.399485 25293 webserver.cc:533] Webserver started at http://127.24.179.67:33639/ using document root <none> and password file <none>
I20260709 12:16:32.399505  8355 ts_manager.cc:194] Registered new tserver with Master: 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:32.400476 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:32.400730 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:32.401046 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:32.401657  8355 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47866
I20260709 12:16:32.402467 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894834136-25293-0/minicluster-data/ts-2-root/instance:
uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
format_stamp: "Formatted at 2026-07-09 12:16:32 on dist-test-slave-tjfs"
I20260709 12:16:32.407956 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:16:32.412256  8568 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:32.413239 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:16:32.413611 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894834136-25293-0/minicluster-data/ts-2-root
uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
format_stamp: "Formatted at 2026-07-09 12:16:32 on dist-test-slave-tjfs"
I20260709 12:16:32.413919 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894834136-25293-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894834136-25293-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894834136-25293-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:32.435827 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:32.437191 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:32.438966 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:32.441524 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:32.441802 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:32.442059 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:32.442255 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:32.487429 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.67:46857
I20260709 12:16:32.487581  8630 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.67:46857 every 8 connection(s)
I20260709 12:16:32.503835  8631 heartbeater.cc:344] Connected to a master server at 127.24.179.126:42359
I20260709 12:16:32.504609  8631 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:32.505529  8631 heartbeater.cc:507] Master 127.24.179.126:42359 requested a full tablet report, sending...
I20260709 12:16:32.508014  8355 ts_manager.cc:194] Registered new tserver with Master: 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:32.508772 25293 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017624353s
I20260709 12:16:32.509943  8355 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47876
I20260709 12:16:32.539636  8355 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47890:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:32.542703  8355 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:32.628988  8522 tablet_service.cc:1511] Processing CreateTablet for tablet 9bd56b68349b4e1fbfcce01587970beb (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:32.630784  8522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd56b68349b4e1fbfcce01587970beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.633450  8447 tablet_service.cc:1511] Processing CreateTablet for tablet 9bd56b68349b4e1fbfcce01587970beb (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:32.635389  8447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd56b68349b4e1fbfcce01587970beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.635774  8521 tablet_service.cc:1511] Processing CreateTablet for tablet c008ec4acb3d4da6a43664e485015705 (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:32.636099  8445 tablet_service.cc:1511] Processing CreateTablet for tablet be4adda3de2941e2938a787df03d067d (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:32.637398  8521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c008ec4acb3d4da6a43664e485015705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.637766  8445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be4adda3de2941e2938a787df03d067d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.639760  8520 tablet_service.cc:1511] Processing CreateTablet for tablet be4adda3de2941e2938a787df03d067d (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:32.640596  8444 tablet_service.cc:1511] Processing CreateTablet for tablet 2e5a1692f6114807a5fc8c204c9ab5db (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:32.641309  8520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be4adda3de2941e2938a787df03d067d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.642475  8444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5a1692f6114807a5fc8c204c9ab5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.643929  8443 tablet_service.cc:1511] Processing CreateTablet for tablet a42cc48f010e4abaa34314467f07303b (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:32.644773  8446 tablet_service.cc:1511] Processing CreateTablet for tablet c008ec4acb3d4da6a43664e485015705 (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:32.645627  8443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42cc48f010e4abaa34314467f07303b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.647910  8596 tablet_service.cc:1511] Processing CreateTablet for tablet 9bd56b68349b4e1fbfcce01587970beb (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:32.648823  8519 tablet_service.cc:1511] Processing CreateTablet for tablet 2e5a1692f6114807a5fc8c204c9ab5db (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:32.649891  8596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd56b68349b4e1fbfcce01587970beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.651661  8518 tablet_service.cc:1511] Processing CreateTablet for tablet a42cc48f010e4abaa34314467f07303b (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:32.651805  8593 tablet_service.cc:1511] Processing CreateTablet for tablet 2e5a1692f6114807a5fc8c204c9ab5db (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:32.653224  8519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5a1692f6114807a5fc8c204c9ab5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.653676  8593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5a1692f6114807a5fc8c204c9ab5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.649930  8595 tablet_service.cc:1511] Processing CreateTablet for tablet c008ec4acb3d4da6a43664e485015705 (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:32.654493  8518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42cc48f010e4abaa34314467f07303b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.657126  8446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c008ec4acb3d4da6a43664e485015705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.656267  8595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c008ec4acb3d4da6a43664e485015705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.659286  8592 tablet_service.cc:1511] Processing CreateTablet for tablet a42cc48f010e4abaa34314467f07303b (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:32.661230  8592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42cc48f010e4abaa34314467f07303b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.663502  8594 tablet_service.cc:1511] Processing CreateTablet for tablet be4adda3de2941e2938a787df03d067d (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:32.664325  8517 tablet_service.cc:1511] Processing CreateTablet for tablet 8181bbcf7f2d496886d5e7f70c2574a7 (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:32.665540  8594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be4adda3de2941e2938a787df03d067d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.666020  8517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8181bbcf7f2d496886d5e7f70c2574a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.667764  8442 tablet_service.cc:1511] Processing CreateTablet for tablet 8181bbcf7f2d496886d5e7f70c2574a7 (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:32.668645  8591 tablet_service.cc:1511] Processing CreateTablet for tablet 8181bbcf7f2d496886d5e7f70c2574a7 (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:32.669417  8442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8181bbcf7f2d496886d5e7f70c2574a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.670455  8591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8181bbcf7f2d496886d5e7f70c2574a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.675428  8441 tablet_service.cc:1511] Processing CreateTablet for tablet cb9579a1ccb946368d94695df25d838f (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:32.677039  8441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9579a1ccb946368d94695df25d838f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.680125  8516 tablet_service.cc:1511] Processing CreateTablet for tablet cb9579a1ccb946368d94695df25d838f (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:32.681797  8516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9579a1ccb946368d94695df25d838f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.692610  8590 tablet_service.cc:1511] Processing CreateTablet for tablet cb9579a1ccb946368d94695df25d838f (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:32.694576  8590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9579a1ccb946368d94695df25d838f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.695152  8440 tablet_service.cc:1511] Processing CreateTablet for tablet a9e056e5c5ff45d4845bb126397f5b5c (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:32.696798  8440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e056e5c5ff45d4845bb126397f5b5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.699554  8515 tablet_service.cc:1511] Processing CreateTablet for tablet a9e056e5c5ff45d4845bb126397f5b5c (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:32.701599  8515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e056e5c5ff45d4845bb126397f5b5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.701967  8589 tablet_service.cc:1511] Processing CreateTablet for tablet a9e056e5c5ff45d4845bb126397f5b5c (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:32.704218  8589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e056e5c5ff45d4845bb126397f5b5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.732199  8439 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa11ad3bbcd4bb29777f40130d5fe7e (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:32.734108  8439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa11ad3bbcd4bb29777f40130d5fe7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.737465  8514 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa11ad3bbcd4bb29777f40130d5fe7e (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:32.739131  8514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa11ad3bbcd4bb29777f40130d5fe7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.789382  8646 tablet_bootstrap.cc:492] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423: Bootstrap starting.
I20260709 12:16:32.800997  8646 tablet_bootstrap.cc:654] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.811650  8588 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa11ad3bbcd4bb29777f40130d5fe7e (DEFAULT_TABLE table=test-workload [id=287b6c0f2d9a4f788b2b5da5da8c39d2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:32.839315  8588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa11ad3bbcd4bb29777f40130d5fe7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:32.851183  8648 tablet_bootstrap.cc:492] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f: Bootstrap starting.
I20260709 12:16:32.901753  8646 tablet_bootstrap.cc:492] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423: No bootstrap required, opened a new log
I20260709 12:16:32.921981  8648 tablet_bootstrap.cc:654] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.918915  8646 ts_tablet_manager.cc:1403] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423: Time spent bootstrapping tablet: real 0.130s	user 0.031s	sys 0.056s
I20260709 12:16:32.920455  8649 tablet_bootstrap.cc:492] T 9bd56b68349b4e1fbfcce01587970beb P 301dcdc3ecfe4926a8aa77edc79ab57d: Bootstrap starting.
I20260709 12:16:32.930727  8646 raft_consensus.cc:359] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:32.931690  8646 raft_consensus.cc:385] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.932056  8646 raft_consensus.cc:740] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.933269  8646 consensus_queue.cc:260] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:32.940837  8646 ts_tablet_manager.cc:1434] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.005s
I20260709 12:16:32.941462  8648 tablet_bootstrap.cc:492] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f: No bootstrap required, opened a new log
I20260709 12:16:32.941672  8482 heartbeater.cc:499] Master 127.24.179.126:42359 was elected leader, sending a full tablet report...
I20260709 12:16:32.942083  8648 ts_tablet_manager.cc:1403] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent bootstrapping tablet: real 0.091s	user 0.007s	sys 0.015s
I20260709 12:16:32.942759  8649 tablet_bootstrap.cc:654] T 9bd56b68349b4e1fbfcce01587970beb P 301dcdc3ecfe4926a8aa77edc79ab57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.945698  8648 raft_consensus.cc:359] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:32.946605  8648 raft_consensus.cc:385] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.946775  8646 tablet_bootstrap.cc:492] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423: Bootstrap starting.
I20260709 12:16:32.946949  8648 raft_consensus.cc:740] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.947975  8648 consensus_queue.cc:260] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:32.948979  8649 tablet_bootstrap.cc:492] T 9bd56b68349b4e1fbfcce01587970beb P 301dcdc3ecfe4926a8aa77edc79ab57d: No bootstrap required, opened a new log
I20260709 12:16:32.949582  8649 ts_tablet_manager.cc:1403] T 9bd56b68349b4e1fbfcce01587970beb P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.003s
I20260709 12:16:32.953122  8649 raft_consensus.cc:359] T 9bd56b68349b4e1fbfcce01587970beb P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:32.954005  8649 raft_consensus.cc:385] T 9bd56b68349b4e1fbfcce01587970beb P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.954311  8649 raft_consensus.cc:740] T 9bd56b68349b4e1fbfcce01587970beb P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.955308  8649 consensus_queue.cc:260] T 9bd56b68349b4e1fbfcce01587970beb P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:32.956583  8557 heartbeater.cc:499] Master 127.24.179.126:42359 was elected leader, sending a full tablet report...
I20260709 12:16:32.957794  8648 ts_tablet_manager.cc:1434] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.008s
I20260709 12:16:32.959066  8648 tablet_bootstrap.cc:492] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f: Bootstrap starting.
I20260709 12:16:32.966676  8648 tablet_bootstrap.cc:654] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.973555  8646 tablet_bootstrap.cc:654] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.985945  8631 heartbeater.cc:499] Master 127.24.179.126:42359 was elected leader, sending a full tablet report...
I20260709 12:16:32.986224  8649 ts_tablet_manager.cc:1434] T 9bd56b68349b4e1fbfcce01587970beb P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent starting tablet: real 0.036s	user 0.022s	sys 0.011s
I20260709 12:16:32.987659  8649 tablet_bootstrap.cc:492] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d: Bootstrap starting.
I20260709 12:16:32.988802  8648 tablet_bootstrap.cc:492] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f: No bootstrap required, opened a new log
I20260709 12:16:32.989550  8648 ts_tablet_manager.cc:1403] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.014s
I20260709 12:16:32.994014  8648 raft_consensus.cc:359] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:32.994949  8649 tablet_bootstrap.cc:654] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:32.995193  8646 tablet_bootstrap.cc:492] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423: No bootstrap required, opened a new log
I20260709 12:16:32.994989  8648 raft_consensus.cc:385] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:32.996001  8646 ts_tablet_manager.cc:1403] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.005s
I20260709 12:16:32.999920  8646 raft_consensus.cc:359] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.000821  8646 raft_consensus.cc:385] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.001159  8646 raft_consensus.cc:740] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.001314  8649 tablet_bootstrap.cc:492] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d: No bootstrap required, opened a new log
I20260709 12:16:33.002048  8649 ts_tablet_manager.cc:1403] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 12:16:32.995954  8648 raft_consensus.cc:740] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.003364  8648 consensus_queue.cc:260] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.005476  8649 raft_consensus.cc:359] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.005894  8648 ts_tablet_manager.cc:1434] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:16:33.006212  8649 raft_consensus.cc:385] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.002133  8646 consensus_queue.cc:260] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.006731  8649 raft_consensus.cc:740] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.008867  8646 ts_tablet_manager.cc:1434] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 12:16:33.011435  8646 tablet_bootstrap.cc:492] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423: Bootstrap starting.
W20260709 12:16:33.008944  8403 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:33.011044  8649 consensus_queue.cc:260] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.009995  8648 tablet_bootstrap.cc:492] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f: Bootstrap starting.
I20260709 12:16:33.020223  8646 tablet_bootstrap.cc:654] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.023082  8649 ts_tablet_manager.cc:1434] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:16:33.024583  8649 tablet_bootstrap.cc:492] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d: Bootstrap starting.
I20260709 12:16:33.027359  8646 tablet_bootstrap.cc:492] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423: No bootstrap required, opened a new log
I20260709 12:16:33.028039  8646 ts_tablet_manager.cc:1403] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 12:16:33.022096  8648 tablet_bootstrap.cc:654] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.031338  8646 raft_consensus.cc:359] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.032133  8649 tablet_bootstrap.cc:654] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.032209  8646 raft_consensus.cc:385] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.032891  8646 raft_consensus.cc:740] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.034017  8646 consensus_queue.cc:260] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.043751  8646 ts_tablet_manager.cc:1434] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 12:16:33.045564  8646 tablet_bootstrap.cc:492] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423: Bootstrap starting.
I20260709 12:16:33.056059  8646 tablet_bootstrap.cc:654] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.066677  8648 tablet_bootstrap.cc:492] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f: No bootstrap required, opened a new log
I20260709 12:16:33.067255  8648 ts_tablet_manager.cc:1403] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent bootstrapping tablet: real 0.058s	user 0.029s	sys 0.015s
I20260709 12:16:33.067561  8649 tablet_bootstrap.cc:492] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d: No bootstrap required, opened a new log
I20260709 12:16:33.068145  8649 ts_tablet_manager.cc:1403] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent bootstrapping tablet: real 0.044s	user 0.025s	sys 0.017s
I20260709 12:16:33.068629  8646 tablet_bootstrap.cc:492] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423: No bootstrap required, opened a new log
I20260709 12:16:33.069289  8646 ts_tablet_manager.cc:1403] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 12:16:33.070873  8649 raft_consensus.cc:359] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.070613  8648 raft_consensus.cc:359] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.071552  8649 raft_consensus.cc:385] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.071682  8648 raft_consensus.cc:385] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.071956  8649 raft_consensus.cc:740] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.072090  8648 raft_consensus.cc:740] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.072395  8646 raft_consensus.cc:359] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.073199  8646 raft_consensus.cc:385] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.073685  8646 raft_consensus.cc:740] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.072949  8649 consensus_queue.cc:260] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.073050  8648 consensus_queue.cc:260] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.074678  8646 consensus_queue.cc:260] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.075839  8648 ts_tablet_manager.cc:1434] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:16:33.077135  8648 tablet_bootstrap.cc:492] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f: Bootstrap starting.
I20260709 12:16:33.081419  8646 ts_tablet_manager.cc:1434] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.009s
I20260709 12:16:33.082840  8646 tablet_bootstrap.cc:492] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423: Bootstrap starting.
I20260709 12:16:33.084507  8648 tablet_bootstrap.cc:654] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.085330  8649 ts_tablet_manager.cc:1434] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 12:16:33.090251  8646 tablet_bootstrap.cc:654] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.090312  8649 tablet_bootstrap.cc:492] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d: Bootstrap starting.
I20260709 12:16:33.101526  8649 tablet_bootstrap.cc:654] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.109800  8646 tablet_bootstrap.cc:492] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423: No bootstrap required, opened a new log
I20260709 12:16:33.109898  8648 tablet_bootstrap.cc:492] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f: No bootstrap required, opened a new log
I20260709 12:16:33.110476  8648 ts_tablet_manager.cc:1403] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.015s
I20260709 12:16:33.110476  8646 ts_tablet_manager.cc:1403] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.011s
I20260709 12:16:33.110567  8649 tablet_bootstrap.cc:492] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d: No bootstrap required, opened a new log
I20260709 12:16:33.111392  8649 ts_tablet_manager.cc:1403] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.005s
I20260709 12:16:33.114027  8646 raft_consensus.cc:359] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.114982  8646 raft_consensus.cc:385] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.114499  8649 raft_consensus.cc:359] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.114502  8648 raft_consensus.cc:359] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.115348  8646 raft_consensus.cc:740] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.115479  8649 raft_consensus.cc:385] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.115610  8648 raft_consensus.cc:385] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.116087  8649 raft_consensus.cc:740] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.116156  8648 raft_consensus.cc:740] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.116348  8646 consensus_queue.cc:260] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.117065  8649 consensus_queue.cc:260] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.117179  8648 consensus_queue.cc:260] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.119055  8646 ts_tablet_manager.cc:1434] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:16:33.119661  8649 ts_tablet_manager.cc:1434] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:33.119892  8648 ts_tablet_manager.cc:1434] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:16:33.120247  8646 tablet_bootstrap.cc:492] T cb9579a1ccb946368d94695df25d838f P 8493340c2bd047e59811b953aab2a423: Bootstrap starting.
I20260709 12:16:33.120877  8649 tablet_bootstrap.cc:492] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d: Bootstrap starting.
I20260709 12:16:33.120905  8648 tablet_bootstrap.cc:492] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f: Bootstrap starting.
I20260709 12:16:33.128376  8646 tablet_bootstrap.cc:654] T cb9579a1ccb946368d94695df25d838f P 8493340c2bd047e59811b953aab2a423: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.128695  8648 tablet_bootstrap.cc:654] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.130762  8649 tablet_bootstrap.cc:654] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.138152  8651 raft_consensus.cc:493] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.139139  8651 raft_consensus.cc:515] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.143002  8648 tablet_bootstrap.cc:492] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f: No bootstrap required, opened a new log
I20260709 12:16:33.143469  8649 tablet_bootstrap.cc:492] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d: No bootstrap required, opened a new log
I20260709 12:16:33.143671  8648 ts_tablet_manager.cc:1403] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.009s
I20260709 12:16:33.144052  8649 ts_tablet_manager.cc:1403] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 12:16:33.147504  8648 raft_consensus.cc:359] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.148437  8648 raft_consensus.cc:385] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.148826  8648 raft_consensus.cc:740] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.148566  8649 raft_consensus.cc:359] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.149492  8649 raft_consensus.cc:385] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.149823  8649 raft_consensus.cc:740] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.149925  8648 consensus_queue.cc:260] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.150909  8649 consensus_queue.cc:260] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.152954  8648 ts_tablet_manager.cc:1434] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:16:33.153745  8649 ts_tablet_manager.cc:1434] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:16:33.154515  8648 tablet_bootstrap.cc:492] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f: Bootstrap starting.
I20260709 12:16:33.155088  8649 tablet_bootstrap.cc:492] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d: Bootstrap starting.
I20260709 12:16:33.162716  8649 tablet_bootstrap.cc:654] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.162719  8648 tablet_bootstrap.cc:654] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.176115  8648 tablet_bootstrap.cc:492] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f: No bootstrap required, opened a new log
I20260709 12:16:33.176998  8648 ts_tablet_manager.cc:1403] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.011s
I20260709 12:16:33.176160  8651 leader_election.cc:290] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:33.182907  8648 raft_consensus.cc:359] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.184227  8648 raft_consensus.cc:385] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.184654  8648 raft_consensus.cc:740] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.185938  8648 consensus_queue.cc:260] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.189925  8648 ts_tablet_manager.cc:1434] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:16:33.192768  8648 tablet_bootstrap.cc:492] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f: Bootstrap starting.
I20260709 12:16:33.193624  8649 tablet_bootstrap.cc:492] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d: No bootstrap required, opened a new log
I20260709 12:16:33.194300  8649 ts_tablet_manager.cc:1403] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.020s
I20260709 12:16:33.198148  8649 raft_consensus.cc:359] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.199000  8649 raft_consensus.cc:385] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.199420  8649 raft_consensus.cc:740] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.200242  8648 tablet_bootstrap.cc:654] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.200337  8649 consensus_queue.cc:260] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.200779  8654 raft_consensus.cc:493] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.201673  8654 raft_consensus.cc:515] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.209580  8653 raft_consensus.cc:493] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.210564  8653 raft_consensus.cc:515] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.215075  8648 tablet_bootstrap.cc:492] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f: No bootstrap required, opened a new log
I20260709 12:16:33.215962  8648 ts_tablet_manager.cc:1403] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.002s
I20260709 12:16:33.220726  8648 raft_consensus.cc:359] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.221786  8648 raft_consensus.cc:385] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.222167  8648 raft_consensus.cc:740] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.223598  8648 consensus_queue.cc:260] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.235385  8648 ts_tablet_manager.cc:1434] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent starting tablet: real 0.019s	user 0.015s	sys 0.004s
I20260709 12:16:33.237093  8648 tablet_bootstrap.cc:492] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f: Bootstrap starting.
I20260709 12:16:33.237679  8654 leader_election.cc:290] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:33.242638  8653 leader_election.cc:290] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:33.246130  8648 tablet_bootstrap.cc:654] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.260027  8648 tablet_bootstrap.cc:492] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f: No bootstrap required, opened a new log
I20260709 12:16:33.260771  8648 ts_tablet_manager.cc:1403] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.005s
I20260709 12:16:33.264761  8648 raft_consensus.cc:359] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.265805  8648 raft_consensus.cc:385] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.266158  8648 raft_consensus.cc:740] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.267232  8648 consensus_queue.cc:260] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.271061  8648 ts_tablet_manager.cc:1434] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.007s
I20260709 12:16:33.272572  8648 tablet_bootstrap.cc:492] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f: Bootstrap starting.
I20260709 12:16:33.281193  8648 tablet_bootstrap.cc:654] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.297356  8653 raft_consensus.cc:493] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.298305  8653 raft_consensus.cc:515] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.301486  8653 leader_election.cc:290] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:33.340034  8653 raft_consensus.cc:493] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.340778  8653 raft_consensus.cc:515] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.343762  8653 leader_election.cc:290] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:33.347024  8651 raft_consensus.cc:493] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.347908  8651 raft_consensus.cc:515] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.350952  8651 leader_election.cc:290] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:33.357856  8654 raft_consensus.cc:493] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.358951  8654 raft_consensus.cc:515] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.362221  8654 leader_election.cc:290] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:33.364115  8654 raft_consensus.cc:493] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.371464  8651 raft_consensus.cc:493] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.379101  8651 raft_consensus.cc:515] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.382241  8651 leader_election.cc:290] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:33.383685  8654 raft_consensus.cc:515] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.402367  8651 raft_consensus.cc:493] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.404614  8653 raft_consensus.cc:493] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.414743  8653 raft_consensus.cc:515] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.418356  8653 leader_election.cc:290] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:33.420154  8651 raft_consensus.cc:515] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.423673  8651 leader_election.cc:290] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:33.441666  8606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd56b68349b4e1fbfcce01587970beb" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:33.442943  8606 raft_consensus.cc:2468] T 9bd56b68349b4e1fbfcce01587970beb P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 0.
I20260709 12:16:33.446094  8606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42cc48f010e4abaa34314467f07303b" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:33.447244  8606 raft_consensus.cc:2468] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 0.
I20260709 12:16:33.454934  8654 leader_election.cc:290] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:33.456559  8654 raft_consensus.cc:493] T 9bd56b68349b4e1fbfcce01587970beb P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.457306  8654 raft_consensus.cc:515] T 9bd56b68349b4e1fbfcce01587970beb P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.457959  8653 raft_consensus.cc:493] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.461212  8653 raft_consensus.cc:515] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.464493  8653 leader_election.cc:290] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:33.467778  8606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a1692f6114807a5fc8c204c9ab5db" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:33.476014  8421 leader_election.cc:304] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:33.477394  8606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa11ad3bbcd4bb29777f40130d5fe7e" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:33.488737  8653 raft_consensus.cc:493] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.489769  8653 raft_consensus.cc:515] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.493983  8653 leader_election.cc:290] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:33.498780  8651 raft_consensus.cc:493] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.499977  8651 raft_consensus.cc:515] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.520665  8653 raft_consensus.cc:493] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.533715  8687 raft_consensus.cc:2804] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.534281  8687 raft_consensus.cc:493] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.534706  8687 raft_consensus.cc:3060] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.534862  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42cc48f010e4abaa34314467f07303b" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:33.535756  8456 raft_consensus.cc:2468] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 0.
I20260709 12:16:33.536237  8649 ts_tablet_manager.cc:1434] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent starting tablet: real 0.342s	user 0.105s	sys 0.178s
I20260709 12:16:33.537292  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9579a1ccb946368d94695df25d838f" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:33.534307  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c008ec4acb3d4da6a43664e485015705" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:33.539252  8457 raft_consensus.cc:2468] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 0.
I20260709 12:16:33.542344  8572 leader_election.cc:304] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:33.543108  8648 tablet_bootstrap.cc:492] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f: No bootstrap required, opened a new log
W20260709 12:16:33.543587  8572 leader_election.cc:343] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.543800  8648 ts_tablet_manager.cc:1403] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent bootstrapping tablet: real 0.272s	user 0.079s	sys 0.168s
I20260709 12:16:33.544474  8572 leader_election.cc:304] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:33.546674  8672 raft_consensus.cc:2804] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.547276  8672 raft_consensus.cc:493] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.547709  8672 raft_consensus.cc:3060] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.547523  8648 raft_consensus.cc:359] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.548802  8648 raft_consensus.cc:385] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.549137  8648 raft_consensus.cc:740] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.550177  8648 consensus_queue.cc:260] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.552778  8649 tablet_bootstrap.cc:492] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d: Bootstrap starting.
I20260709 12:16:33.552942  8648 ts_tablet_manager.cc:1434] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:16:33.554016  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c008ec4acb3d4da6a43664e485015705" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:33.555164  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42cc48f010e4abaa34314467f07303b" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:33.558736  8532 raft_consensus.cc:2468] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 0.
I20260709 12:16:33.558615  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd56b68349b4e1fbfcce01587970beb" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:33.539332  8651 leader_election.cc:290] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:33.556291  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9579a1ccb946368d94695df25d838f" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:33.559700  8529 raft_consensus.cc:2468] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 0.
I20260709 12:16:33.562779  8530 raft_consensus.cc:2468] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 0.
I20260709 12:16:33.564553  8570 leader_election.cc:304] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 8493340c2bd047e59811b953aab2a423
I20260709 12:16:33.564438  8687 raft_consensus.cc:515] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.570920  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd56b68349b4e1fbfcce01587970beb" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:33.571908  8455 raft_consensus.cc:2393] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f56aad176e14cf4a2ae5e90c249aa2f in current term 1: Already voted for candidate 8493340c2bd047e59811b953aab2a423 in this term.
I20260709 12:16:33.572543  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8181bbcf7f2d496886d5e7f70c2574a7" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:33.573024  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c008ec4acb3d4da6a43664e485015705" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:33.562004  8654 leader_election.cc:290] T 9bd56b68349b4e1fbfcce01587970beb P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549)
W20260709 12:16:33.530941  8421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:46857, user_credentials={real_user=slave}} blocked reactor thread for 55151us
I20260709 12:16:33.560077  8653 raft_consensus.cc:515] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.580857  8689 raft_consensus.cc:493] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.588351  8689 raft_consensus.cc:515] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.581152  8687 leader_election.cc:290] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 election: Requested vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:33.581079  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa11ad3bbcd4bb29777f40130d5fe7e" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:33.582315  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a1692f6114807a5fc8c204c9ab5db" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:33.583336  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd56b68349b4e1fbfcce01587970beb" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:33.584568  8649 tablet_bootstrap.cc:654] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.585958  8452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9579a1ccb946368d94695df25d838f" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:33.573738  8456 raft_consensus.cc:2468] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 0.
W20260709 12:16:33.587088  8498 leader_election.cc:343] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.580094  8654 raft_consensus.cc:2804] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.593240  8453 raft_consensus.cc:2468] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 0.
I20260709 12:16:33.595196  8531 raft_consensus.cc:2468] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 0.
I20260709 12:16:33.594607  8654 raft_consensus.cc:493] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.598080  8688 raft_consensus.cc:2804] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.598512  8654 raft_consensus.cc:3060] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.598881  8688 raft_consensus.cc:493] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.599794  8688 raft_consensus.cc:3060] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.599879  8457 raft_consensus.cc:2393] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 301dcdc3ecfe4926a8aa77edc79ab57d in current term 1: Already voted for candidate 8493340c2bd047e59811b953aab2a423 in this term.
I20260709 12:16:33.593894  8454 raft_consensus.cc:2468] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 0.
W20260709 12:16:33.602944  8498 leader_election.cc:343] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.604395  8498 leader_election.cc:304] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:33.594740  8421 leader_election.cc:304] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:33.605652  8498 leader_election.cc:304] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
W20260709 12:16:33.605916  8421 leader_election.cc:343] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.606817  8678 raft_consensus.cc:2804] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:16:33.607041  8421 leader_election.cc:343] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.607302  8678 raft_consensus.cc:493] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.608141  8678 raft_consensus.cc:3060] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.610495  8687 raft_consensus.cc:2804] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.617573  8498 leader_election.cc:304] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:33.617682  8606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8181bbcf7f2d496886d5e7f70c2574a7" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:33.622786  8606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c008ec4acb3d4da6a43664e485015705" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:33.625375  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd56b68349b4e1fbfcce01587970beb" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:33.626305  8605 raft_consensus.cc:3060] T 9bd56b68349b4e1fbfcce01587970beb P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.631495  8604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd56b68349b4e1fbfcce01587970beb" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:33.632799  8601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa11ad3bbcd4bb29777f40130d5fe7e" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:33.633433  8603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c008ec4acb3d4da6a43664e485015705" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:33.634809  8601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9579a1ccb946368d94695df25d838f" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:33.635088  8602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a1692f6114807a5fc8c204c9ab5db" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:33.635948  8570 leader_election.cc:304] T 9bd56b68349b4e1fbfcce01587970beb P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 8493340c2bd047e59811b953aab2a423
I20260709 12:16:33.615973  8646 tablet_bootstrap.cc:492] T cb9579a1ccb946368d94695df25d838f P 8493340c2bd047e59811b953aab2a423: No bootstrap required, opened a new log
I20260709 12:16:33.616544  8687 raft_consensus.cc:493] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.643265  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e056e5c5ff45d4845bb126397f5b5c" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:33.643934  8653 leader_election.cc:290] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:33.645407  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd56b68349b4e1fbfcce01587970beb" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:33.646493  8689 leader_election.cc:290] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:33.648907  8531 raft_consensus.cc:2468] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 0.
I20260709 12:16:33.649158  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a1692f6114807a5fc8c204c9ab5db" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
W20260709 12:16:33.649454  8572 leader_election.cc:343] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.649961  8530 raft_consensus.cc:2468] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 0.
I20260709 12:16:33.645905  8605 raft_consensus.cc:2468] T 9bd56b68349b4e1fbfcce01587970beb P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 1.
I20260709 12:16:33.650352  8653 raft_consensus.cc:2804] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.651037  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42cc48f010e4abaa34314467f07303b" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:33.651535  8693 raft_consensus.cc:2764] T 9bd56b68349b4e1fbfcce01587970beb P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:16:33.651877  8529 raft_consensus.cc:2468] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 0.
I20260709 12:16:33.651814  8421 leader_election.cc:304] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:33.652925  8532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa11ad3bbcd4bb29777f40130d5fe7e" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:33.653477  8651 raft_consensus.cc:2804] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:33.647302  8687 raft_consensus.cc:3060] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.646126  8690 raft_consensus.cc:493] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.662192  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd56b68349b4e1fbfcce01587970beb" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:33.663175  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c008ec4acb3d4da6a43664e485015705" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:33.647415  8646 ts_tablet_manager.cc:1403] T cb9579a1ccb946368d94695df25d838f P 8493340c2bd047e59811b953aab2a423: Time spent bootstrapping tablet: real 0.527s	user 0.147s	sys 0.258s
I20260709 12:16:33.651059  8653 raft_consensus.cc:493] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.666484  8530 raft_consensus.cc:3060] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.670099  8653 raft_consensus.cc:3060] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.663738  8421 leader_election.cc:304] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 301dcdc3ecfe4926a8aa77edc79ab57d
W20260709 12:16:33.664688  8498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.65:42549, user_credentials={real_user=slave}} blocked reactor thread for 47221.1us
I20260709 12:16:33.675269  8651 raft_consensus.cc:697] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [term 1 LEADER]: Becoming Leader. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Running, Role: LEADER
I20260709 12:16:33.675873  8691 raft_consensus.cc:2804] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:16:33.677816  8496 leader_election.cc:343] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.681120  8496 leader_election.cc:304] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423
I20260709 12:16:33.681711  8651 consensus_queue.cc:237] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.682268  8692 raft_consensus.cc:2749] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:33.682837  8496 leader_election.cc:304] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423
I20260709 12:16:33.682484  8678 raft_consensus.cc:515] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.684419  8529 raft_consensus.cc:2393] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8493340c2bd047e59811b953aab2a423 in current term 1: Already voted for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in this term.
W20260709 12:16:33.684343  8496 leader_election.cc:343] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:33.686290  8496 leader_election.cc:343] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.687585  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42cc48f010e4abaa34314467f07303b" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:33.680637  8691 raft_consensus.cc:493] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.666075  8690 raft_consensus.cc:515] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.695169  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42cc48f010e4abaa34314467f07303b" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:33.689426  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c008ec4acb3d4da6a43664e485015705" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:33.688087  8678 leader_election.cc:290] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:33.698076  8456 raft_consensus.cc:3060] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.698151  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4adda3de2941e2938a787df03d067d" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:33.699067  8678 raft_consensus.cc:493] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:33.700109  8572 leader_election.cc:343] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.692785  8654 raft_consensus.cc:515] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.700600  8678 raft_consensus.cc:515] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.697300  8690 leader_election.cc:290] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:33.690989  8691 raft_consensus.cc:3060] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.696300  8649 tablet_bootstrap.cc:492] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d: No bootstrap required, opened a new log
I20260709 12:16:33.704272  8649 ts_tablet_manager.cc:1403] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent bootstrapping tablet: real 0.152s	user 0.016s	sys 0.004s
I20260709 12:16:33.705485  8606 raft_consensus.cc:2393] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8493340c2bd047e59811b953aab2a423 in current term 1: Already voted for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in this term.
I20260709 12:16:33.689833  8530 raft_consensus.cc:2468] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 1.
I20260709 12:16:33.707135  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4adda3de2941e2938a787df03d067d" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:33.707975  8692 raft_consensus.cc:2749] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:33.707966  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c008ec4acb3d4da6a43664e485015705" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423"
W20260709 12:16:33.709038  8498 leader_election.cc:343] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.684579  8688 raft_consensus.cc:515] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.709744  8678 leader_election.cc:290] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:33.711148  8601 raft_consensus.cc:2393] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f56aad176e14cf4a2ae5e90c249aa2f in current term 1: Already voted for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in this term.
I20260709 12:16:33.714028  8649 raft_consensus.cc:359] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.715526  8649 raft_consensus.cc:385] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.715883  8649 raft_consensus.cc:740] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.717202  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9579a1ccb946368d94695df25d838f" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:33.716987  8649 consensus_queue.cc:260] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.717808  8421 leader_election.cc:304] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8493340c2bd047e59811b953aab2a423; no voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 4f56aad176e14cf4a2ae5e90c249aa2f
I20260709 12:16:33.697794  8694 raft_consensus.cc:2804] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.719347  8694 raft_consensus.cc:493] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.719728  8694 raft_consensus.cc:3060] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.720170  8649 ts_tablet_manager.cc:1434] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.002s
I20260709 12:16:33.721935  8649 tablet_bootstrap.cc:492] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d: Bootstrap starting.
I20260709 12:16:33.722466  8496 leader_election.cc:304] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423
I20260709 12:16:33.722888  8601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c008ec4acb3d4da6a43664e485015705" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:33.724020  8601 raft_consensus.cc:2393] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f56aad176e14cf4a2ae5e90c249aa2f in current term 1: Already voted for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in this term.
I20260709 12:16:33.705439  8646 raft_consensus.cc:359] T cb9579a1ccb946368d94695df25d838f P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.727134  8646 raft_consensus.cc:385] T cb9579a1ccb946368d94695df25d838f P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.727509  8646 raft_consensus.cc:740] T cb9579a1ccb946368d94695df25d838f P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.728338  8646 consensus_queue.cc:260] T cb9579a1ccb946368d94695df25d838f P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.729369  8453 raft_consensus.cc:3060] T cb9579a1ccb946368d94695df25d838f P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.730484  8601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4adda3de2941e2938a787df03d067d" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:33.731272  8601 raft_consensus.cc:2468] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 0.
I20260709 12:16:33.731451  8678 raft_consensus.cc:3060] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.739828  8672 raft_consensus.cc:515] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.742643  8687 raft_consensus.cc:515] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.744028  8454 raft_consensus.cc:2393] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f56aad176e14cf4a2ae5e90c249aa2f in current term 1: Already voted for candidate 8493340c2bd047e59811b953aab2a423 in this term.
I20260709 12:16:33.744058  8678 raft_consensus.cc:2749] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:33.745229  8456 raft_consensus.cc:2468] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 1.
I20260709 12:16:33.746419  8672 leader_election.cc:290] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:33.746793  8605 raft_consensus.cc:2393] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f56aad176e14cf4a2ae5e90c249aa2f in current term 1: Already voted for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in this term.
I20260709 12:16:33.747429  8498 leader_election.cc:304] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:33.748489  8688 leader_election.cc:290] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:33.711045  8654 leader_election.cc:290] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:33.748658  8697 raft_consensus.cc:2804] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:33.750432  8687 leader_election.cc:290] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 election: Requested vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:33.772423  8453 raft_consensus.cc:2468] T cb9579a1ccb946368d94695df25d838f P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 1.
I20260709 12:16:33.772627  8697 raft_consensus.cc:697] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Becoming Leader. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Running, Role: LEADER
I20260709 12:16:33.750703  8653 raft_consensus.cc:515] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.773743  8697 consensus_queue.cc:237] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.774884  8532 raft_consensus.cc:2393] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8493340c2bd047e59811b953aab2a423 in current term 1: Already voted for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in this term.
I20260709 12:16:33.751842  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e056e5c5ff45d4845bb126397f5b5c" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:33.777779  8530 raft_consensus.cc:2468] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 0.
I20260709 12:16:33.752085  8529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4adda3de2941e2938a787df03d067d" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:33.758116  8646 ts_tablet_manager.cc:1434] T cb9579a1ccb946368d94695df25d838f P 8493340c2bd047e59811b953aab2a423: Time spent starting tablet: real 0.091s	user 0.002s	sys 0.006s
I20260709 12:16:33.755801  8691 raft_consensus.cc:515] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.758752  8496 leader_election.cc:304] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 8493340c2bd047e59811b953aab2a423
I20260709 12:16:33.780493  8646 tablet_bootstrap.cc:492] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423: Bootstrap starting.
I20260709 12:16:33.757433  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42cc48f010e4abaa34314467f07303b" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:33.781840  8691 leader_election.cc:290] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:33.774695  8572 leader_election.cc:304] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:33.782413  8528 raft_consensus.cc:3060] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.779572  8529 raft_consensus.cc:2468] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 0.
I20260709 12:16:33.783069  8654 raft_consensus.cc:2804] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:33.783689  8654 raft_consensus.cc:697] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Becoming Leader. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Running, Role: LEADER
I20260709 12:16:33.784041  8421 leader_election.cc:304] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8493340c2bd047e59811b953aab2a423; no voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 4f56aad176e14cf4a2ae5e90c249aa2f
I20260709 12:16:33.784696  8654 consensus_queue.cc:237] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.785707  8687 raft_consensus.cc:3060] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.757167  8355 catalog_manager.cc:5697] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8493340c2bd047e59811b953aab2a423 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "8493340c2bd047e59811b953aab2a423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:33.786357  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa11ad3bbcd4bb29777f40130d5fe7e" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:33.767532  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42cc48f010e4abaa34314467f07303b" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:33.787604  8605 raft_consensus.cc:2393] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8493340c2bd047e59811b953aab2a423 in current term 1: Already voted for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in this term.
I20260709 12:16:33.771837  8649 tablet_bootstrap.cc:654] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.789431  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42cc48f010e4abaa34314467f07303b" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:33.756459  8699 raft_consensus.cc:2749] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:33.762923  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42cc48f010e4abaa34314467f07303b" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:33.792253  8456 raft_consensus.cc:2393] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 301dcdc3ecfe4926a8aa77edc79ab57d in current term 1: Already voted for candidate 8493340c2bd047e59811b953aab2a423 in this term.
I20260709 12:16:33.784737  8653 leader_election.cc:290] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:33.752939  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c008ec4acb3d4da6a43664e485015705" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:33.785303  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a1692f6114807a5fc8c204c9ab5db" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:33.765086  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9579a1ccb946368d94695df25d838f" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:33.766739  8694 raft_consensus.cc:515] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.796525  8694 leader_election.cc:290] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 election: Requested vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:33.790467  8496 leader_election.cc:304] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423
I20260709 12:16:33.797581  8453 raft_consensus.cc:2393] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f56aad176e14cf4a2ae5e90c249aa2f in current term 1: Already voted for candidate 8493340c2bd047e59811b953aab2a423 in this term.
I20260709 12:16:33.797835  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a1692f6114807a5fc8c204c9ab5db" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
W20260709 12:16:33.799537  8421 leader_election.cc:343] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.800150  8531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a1692f6114807a5fc8c204c9ab5db" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:33.800295  8601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa11ad3bbcd4bb29777f40130d5fe7e" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:33.801187  8531 raft_consensus.cc:2393] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8493340c2bd047e59811b953aab2a423 in current term 1: Already voted for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in this term.
I20260709 12:16:33.802207  8528 raft_consensus.cc:2468] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 1.
I20260709 12:16:33.802342  8421 leader_election.cc:304] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8493340c2bd047e59811b953aab2a423; no voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 4f56aad176e14cf4a2ae5e90c249aa2f
I20260709 12:16:33.806056  8570 leader_election.cc:304] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 8493340c2bd047e59811b953aab2a423
I20260709 12:16:33.807255  8688 raft_consensus.cc:2804] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.808135  8688 raft_consensus.cc:493] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.802911  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a1692f6114807a5fc8c204c9ab5db" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:33.807222  8352 catalog_manager.cc:5697] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66). New cstate: current_term: 1 leader_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:33.808694  8688 raft_consensus.cc:3060] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.808662  8691 raft_consensus.cc:2804] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.812587  8691 raft_consensus.cc:493] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.813248  8694 raft_consensus.cc:2749] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:33.807703  8570 leader_election.cc:304] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 8493340c2bd047e59811b953aab2a423
I20260709 12:16:33.815963  8691 raft_consensus.cc:3060] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.816308  8672 raft_consensus.cc:2804] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:33.817072  8672 raft_consensus.cc:493] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:33.817621  8672 raft_consensus.cc:3060] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.815482  8527 raft_consensus.cc:2468] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 1.
I20260709 12:16:33.819576  8653 raft_consensus.cc:2749] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:33.814538  8421 leader_election.cc:304] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8493340c2bd047e59811b953aab2a423; no voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 4f56aad176e14cf4a2ae5e90c249aa2f
W20260709 12:16:33.802651  8496 leader_election.cc:343] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.821924  8694 raft_consensus.cc:2749] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:33.822872  8570 leader_election.cc:304] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d; no voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423
I20260709 12:16:33.823930  8690 raft_consensus.cc:2749] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:33.826094  8570 leader_election.cc:304] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 8493340c2bd047e59811b953aab2a423
I20260709 12:16:33.827081  8690 raft_consensus.cc:2804] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:33.827798  8690 raft_consensus.cc:697] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Becoming Leader. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Running, Role: LEADER
I20260709 12:16:33.828711  8646 tablet_bootstrap.cc:654] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.828788  8690 consensus_queue.cc:237] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.831123  8649 tablet_bootstrap.cc:492] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d: No bootstrap required, opened a new log
I20260709 12:16:33.831756  8649 ts_tablet_manager.cc:1403] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent bootstrapping tablet: real 0.110s	user 0.014s	sys 0.000s
W20260709 12:16:33.828933  8496 leader_election.cc:343] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.831681  8687 raft_consensus.cc:2749] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:33.839145  8672 raft_consensus.cc:515] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.835592  8496 leader_election.cc:304] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423
I20260709 12:16:33.843896  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4adda3de2941e2938a787df03d067d" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423"
W20260709 12:16:33.846352  8572 leader_election.cc:343] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.847395  8649 raft_consensus.cc:359] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.848325  8649 raft_consensus.cc:385] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.848631  8649 raft_consensus.cc:740] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.850000  8653 raft_consensus.cc:2749] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:33.851701  8672 leader_election.cc:290] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:33.841940  8688 raft_consensus.cc:515] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.852478  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4adda3de2941e2938a787df03d067d" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:33.855425  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e056e5c5ff45d4845bb126397f5b5c" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423"
W20260709 12:16:33.857467  8572 leader_election.cc:343] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.857064  8353 catalog_manager.cc:5697] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67). New cstate: current_term: 1 leader_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:33.858819  8649 consensus_queue.cc:260] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.859357  8691 raft_consensus.cc:515] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.860842  8528 raft_consensus.cc:2393] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 301dcdc3ecfe4926a8aa77edc79ab57d in current term 1: Already voted for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in this term.
I20260709 12:16:33.863474  8688 leader_election.cc:290] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:33.864503  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4adda3de2941e2938a787df03d067d" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:33.865005  8570 leader_election.cc:304] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d; no voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423
I20260709 12:16:33.869474  8605 raft_consensus.cc:2393] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f56aad176e14cf4a2ae5e90c249aa2f in current term 1: Already voted for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in this term.
I20260709 12:16:33.862319  8691 leader_election.cc:290] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:33.864228  8649 ts_tablet_manager.cc:1434] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 12:16:33.871332  8688 raft_consensus.cc:2749] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:33.871578  8649 tablet_bootstrap.cc:492] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d: Bootstrap starting.
I20260709 12:16:33.871490  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e056e5c5ff45d4845bb126397f5b5c" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:33.872310  8528 raft_consensus.cc:3060] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.863353  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4adda3de2941e2938a787df03d067d" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423"
W20260709 12:16:33.873759  8498 leader_election.cc:343] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:33.874215  8498 leader_election.cc:304] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423
I20260709 12:16:33.875512  8691 raft_consensus.cc:2749] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:33.881013  8649 tablet_bootstrap.cc:654] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.881148  8454 raft_consensus.cc:2468] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 1.
I20260709 12:16:33.883325  8498 leader_election.cc:304] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 301dcdc3ecfe4926a8aa77edc79ab57d
I20260709 12:16:33.884817  8691 raft_consensus.cc:2804] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:33.885543  8691 raft_consensus.cc:697] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Becoming Leader. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Running, Role: LEADER
I20260709 12:16:33.887244  8646 tablet_bootstrap.cc:492] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423: No bootstrap required, opened a new log
I20260709 12:16:33.887142  8691 consensus_queue.cc:237] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.888195  8646 ts_tablet_manager.cc:1403] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423: Time spent bootstrapping tablet: real 0.108s	user 0.008s	sys 0.024s
I20260709 12:16:33.893769  8528 raft_consensus.cc:2468] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 1.
I20260709 12:16:33.895439  8570 leader_election.cc:304] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 8493340c2bd047e59811b953aab2a423
I20260709 12:16:33.896890  8688 raft_consensus.cc:2804] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:33.897478  8688 raft_consensus.cc:697] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Becoming Leader. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Running, Role: LEADER
I20260709 12:16:33.897629  8646 raft_consensus.cc:359] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.898772  8646 raft_consensus.cc:385] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.899538  8646 raft_consensus.cc:740] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.898927  8688 consensus_queue.cc:237] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.900868  8646 consensus_queue.cc:260] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.904788  8646 ts_tablet_manager.cc:1434] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423: Time spent starting tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 12:16:33.905818  8646 tablet_bootstrap.cc:492] T 8181bbcf7f2d496886d5e7f70c2574a7 P 8493340c2bd047e59811b953aab2a423: Bootstrap starting.
I20260709 12:16:33.909317  8649 tablet_bootstrap.cc:492] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d: No bootstrap required, opened a new log
I20260709 12:16:33.909941  8649 ts_tablet_manager.cc:1403] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.018s
I20260709 12:16:33.916471  8649 raft_consensus.cc:359] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.918601  8649 raft_consensus.cc:385] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.922605  8649 raft_consensus.cc:740] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.923571  8649 consensus_queue.cc:260] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.925397  8649 ts_tablet_manager.cc:1434] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.002s
I20260709 12:16:33.919803  8646 tablet_bootstrap.cc:654] T 8181bbcf7f2d496886d5e7f70c2574a7 P 8493340c2bd047e59811b953aab2a423: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.933909  8646 tablet_bootstrap.cc:492] T 8181bbcf7f2d496886d5e7f70c2574a7 P 8493340c2bd047e59811b953aab2a423: No bootstrap required, opened a new log
I20260709 12:16:33.934669  8646 ts_tablet_manager.cc:1403] T 8181bbcf7f2d496886d5e7f70c2574a7 P 8493340c2bd047e59811b953aab2a423: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.000s
I20260709 12:16:33.938241  8646 raft_consensus.cc:359] T 8181bbcf7f2d496886d5e7f70c2574a7 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.939373  8646 raft_consensus.cc:385] T 8181bbcf7f2d496886d5e7f70c2574a7 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.939726  8646 raft_consensus.cc:740] T 8181bbcf7f2d496886d5e7f70c2574a7 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.940768  8646 consensus_queue.cc:260] T 8181bbcf7f2d496886d5e7f70c2574a7 P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.943871  8646 ts_tablet_manager.cc:1434] T 8181bbcf7f2d496886d5e7f70c2574a7 P 8493340c2bd047e59811b953aab2a423: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:16:33.947551  8646 tablet_bootstrap.cc:492] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423: Bootstrap starting.
I20260709 12:16:33.956284  8646 tablet_bootstrap.cc:654] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:33.961489  8646 tablet_bootstrap.cc:492] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423: No bootstrap required, opened a new log
I20260709 12:16:33.962052  8646 ts_tablet_manager.cc:1403] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 12:16:33.964485  8352 catalog_manager.cc:5697] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66). New cstate: current_term: 1 leader_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:33.965268  8646 raft_consensus.cc:359] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.966009  8646 raft_consensus.cc:385] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:33.966329  8646 raft_consensus.cc:740] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.967247  8646 consensus_queue.cc:260] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.969589  8646 ts_tablet_manager.cc:1434] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:16:33.971846  8688 raft_consensus.cc:493] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.972506  8688 raft_consensus.cc:515] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:33.974853  8688 leader_election.cc:290] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:33.975817  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa11ad3bbcd4bb29777f40130d5fe7e" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:33.976003  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa11ad3bbcd4bb29777f40130d5fe7e" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:33.976919  8454 raft_consensus.cc:2393] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 301dcdc3ecfe4926a8aa77edc79ab57d in current term 1: Already voted for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in this term.
I20260709 12:16:33.978500  8572 leader_election.cc:304] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d; no voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423
I20260709 12:16:33.981648  8688 raft_consensus.cc:3060] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:33.985268  8353 catalog_manager.cc:5697] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67). New cstate: current_term: 1 leader_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:33.988642  8353 catalog_manager.cc:5697] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67). New cstate: current_term: 1 leader_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:33.991106  8688 raft_consensus.cc:2749] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:34.015434  8403 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:34.036314  8688 raft_consensus.cc:493] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.036969  8688 raft_consensus.cc:515] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:34.040050  8688 leader_election.cc:290] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:34.040335  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8181bbcf7f2d496886d5e7f70c2574a7" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:34.040760  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8181bbcf7f2d496886d5e7f70c2574a7" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:34.041115  8454 raft_consensus.cc:2468] T 8181bbcf7f2d496886d5e7f70c2574a7 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 0.
I20260709 12:16:34.041652  8528 raft_consensus.cc:2468] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 0.
I20260709 12:16:34.042409  8572 leader_election.cc:304] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:34.043380  8688 raft_consensus.cc:2804] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:34.043813  8688 raft_consensus.cc:493] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:34.044106  8688 raft_consensus.cc:3060] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:34.050251  8688 raft_consensus.cc:515] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:34.052749  8688 leader_election.cc:290] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:34.053656  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8181bbcf7f2d496886d5e7f70c2574a7" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:34.053905  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8181bbcf7f2d496886d5e7f70c2574a7" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:34.054541  8454 raft_consensus.cc:3060] T 8181bbcf7f2d496886d5e7f70c2574a7 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:34.054587  8528 raft_consensus.cc:3060] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:34.062925  8528 raft_consensus.cc:2468] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 1.
I20260709 12:16:34.064188  8570 leader_election.cc:304] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 
I20260709 12:16:34.064779  8454 raft_consensus.cc:2468] T 8181bbcf7f2d496886d5e7f70c2574a7 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 1.
I20260709 12:16:34.065006  8688 raft_consensus.cc:2804] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:34.066305  8688 raft_consensus.cc:697] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Becoming Leader. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Running, Role: LEADER
I20260709 12:16:34.067407  8688 consensus_queue.cc:237] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:34.077519  8353 catalog_manager.cc:5697] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67). New cstate: current_term: 1 leader_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:34.081951  8687 consensus_queue.cc:1048] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:34.089392  8688 raft_consensus.cc:493] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.090180  8688 raft_consensus.cc:515] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:34.092963  8688 leader_election.cc:290] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:34.093973  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a1692f6114807a5fc8c204c9ab5db" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:34.094797  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a1692f6114807a5fc8c204c9ab5db" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:34.095144  8454 raft_consensus.cc:2393] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 301dcdc3ecfe4926a8aa77edc79ab57d in current term 1: Already voted for candidate 8493340c2bd047e59811b953aab2a423 in this term.
I20260709 12:16:34.095664  8527 raft_consensus.cc:2393] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 301dcdc3ecfe4926a8aa77edc79ab57d in current term 1: Already voted for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in this term.
I20260709 12:16:34.097438  8572 leader_election.cc:304] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d; no voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423
I20260709 12:16:34.098265  8688 raft_consensus.cc:3060] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:34.105116  8687 consensus_queue.cc:1048] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:34.107195  8688 raft_consensus.cc:2749] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:34.175595  8691 consensus_queue.cc:1048] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:34.188524  8697 consensus_queue.cc:1048] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:34.204262  8687 raft_consensus.cc:493] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.204870  8687 raft_consensus.cc:515] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:34.206929  8687 leader_election.cc:290] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:34.208292  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4adda3de2941e2938a787df03d067d" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:34.208310  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4adda3de2941e2938a787df03d067d" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:34.209349  8605 raft_consensus.cc:2393] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8493340c2bd047e59811b953aab2a423 in current term 1: Already voted for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in this term.
I20260709 12:16:34.209360  8528 raft_consensus.cc:2393] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8493340c2bd047e59811b953aab2a423 in current term 1: Already voted for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in this term.
I20260709 12:16:34.210850  8421 leader_election.cc:304] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8493340c2bd047e59811b953aab2a423; no voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 4f56aad176e14cf4a2ae5e90c249aa2f
I20260709 12:16:34.211529  8687 raft_consensus.cc:3060] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:34.217846  8687 raft_consensus.cc:2749] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:34.260090  8687 raft_consensus.cc:493] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.260717  8687 raft_consensus.cc:515] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:34.262780  8687 leader_election.cc:290] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:34.263877  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e056e5c5ff45d4845bb126397f5b5c" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:34.264170  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e056e5c5ff45d4845bb126397f5b5c" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:34.264884  8528 raft_consensus.cc:2393] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8493340c2bd047e59811b953aab2a423 in current term 1: Already voted for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in this term.
I20260709 12:16:34.266004  8421 leader_election.cc:304] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8493340c2bd047e59811b953aab2a423; no voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 4f56aad176e14cf4a2ae5e90c249aa2f
I20260709 12:16:34.266782  8687 raft_consensus.cc:3060] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:34.273001  8687 raft_consensus.cc:2749] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:34.290887  8688 consensus_queue.cc:1048] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:34.292958  8688 consensus_queue.cc:1048] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:34.307415  8697 consensus_queue.cc:1048] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:34.308563  8690 consensus_queue.cc:1048] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:34.310595  8697 consensus_queue.cc:1048] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:34.332259  8654 consensus_queue.cc:1048] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:34.360322  8654 consensus_queue.cc:1048] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:34.373284  8690 consensus_queue.cc:1048] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:34.463392  8690 consensus_queue.cc:1048] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:34.476732  8688 consensus_queue.cc:1048] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:16:35.018749  8403 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:35.388347  8734 raft_consensus.cc:493] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.388991  8734 raft_consensus.cc:515] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:35.390887  8734 leader_election.cc:290] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:35.391918  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a1692f6114807a5fc8c204c9ab5db" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:35.392198  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a1692f6114807a5fc8c204c9ab5db" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:35.392634  8528 raft_consensus.cc:2468] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 1.
I20260709 12:16:35.392968  8605 raft_consensus.cc:2468] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 1.
I20260709 12:16:35.393930  8421 leader_election.cc:304] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:35.394827  8734 raft_consensus.cc:2804] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:35.395203  8734 raft_consensus.cc:493] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:35.395531  8734 raft_consensus.cc:3060] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.401914  8734 raft_consensus.cc:515] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:35.404114  8734 leader_election.cc:290] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 2 election: Requested vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:35.405009  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a1692f6114807a5fc8c204c9ab5db" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:35.405412  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a1692f6114807a5fc8c204c9ab5db" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:35.405829  8528 raft_consensus.cc:3060] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.406128  8605 raft_consensus.cc:3060] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.414981  8605 raft_consensus.cc:2468] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 2.
I20260709 12:16:35.414981  8528 raft_consensus.cc:2468] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 2.
I20260709 12:16:35.416751  8421 leader_election.cc:304] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:35.417752  8734 raft_consensus.cc:2804] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:35.418835  8734 raft_consensus.cc:697] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 2 LEADER]: Becoming Leader. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Running, Role: LEADER
I20260709 12:16:35.419638  8734 consensus_queue.cc:237] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:35.428144  8353 catalog_manager.cc:5697] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 reported cstate change: term changed from 0 to 2, leader changed from <none> to 8493340c2bd047e59811b953aab2a423 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "8493340c2bd047e59811b953aab2a423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:35.835738  8691 raft_consensus.cc:493] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:35.836345  8691 raft_consensus.cc:515] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:35.838435  8691 leader_election.cc:290] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:35.839259  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4adda3de2941e2938a787df03d067d" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:35.839531  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4adda3de2941e2938a787df03d067d" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:35.839951  8454 raft_consensus.cc:2468] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 1.
I20260709 12:16:35.840188  8605 raft_consensus.cc:2468] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 1.
I20260709 12:16:35.841266  8498 leader_election.cc:304] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:35.842214  8691 raft_consensus.cc:2804] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:35.842665  8691 raft_consensus.cc:493] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:35.843016  8691 raft_consensus.cc:3060] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.849550  8691 raft_consensus.cc:515] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:35.851475  8691 leader_election.cc:290] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 2 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:35.852550  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4adda3de2941e2938a787df03d067d" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:35.852674  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4adda3de2941e2938a787df03d067d" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:35.853264  8454 raft_consensus.cc:3060] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.853369  8605 raft_consensus.cc:3060] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.859798  8454 raft_consensus.cc:2468] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 2.
I20260709 12:16:35.859798  8605 raft_consensus.cc:2468] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 2.
I20260709 12:16:35.861248  8498 leader_election.cc:304] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:35.862063  8691 raft_consensus.cc:2804] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:35.863090  8691 raft_consensus.cc:697] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Becoming Leader. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Running, Role: LEADER
I20260709 12:16:35.863988  8691 consensus_queue.cc:237] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:35.871763  8353 catalog_manager.cc:5697] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f reported cstate change: term changed from 0 to 2, leader changed from <none> to 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66). New cstate: current_term: 2 leader_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:35.910769  8605 raft_consensus.cc:1275] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Refusing update from remote peer 8493340c2bd047e59811b953aab2a423: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:16:35.912074  8734 consensus_queue.cc:1048] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:35.930652  8528 raft_consensus.cc:1275] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Refusing update from remote peer 8493340c2bd047e59811b953aab2a423: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:16:35.936455  8744 consensus_queue.cc:1048] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:35.958429  8528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c008ec4acb3d4da6a43664e485015705"
dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
mode: GRACEFUL
new_leader_uuid: "8493340c2bd047e59811b953aab2a423"
 from {username='slave'} at 127.0.0.1:40000
I20260709 12:16:35.959359  8528 raft_consensus.cc:606] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Received request to transfer leadership to TS 8493340c2bd047e59811b953aab2a423
I20260709 12:16:35.965653  8528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be4adda3de2941e2938a787df03d067d"
dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
mode: GRACEFUL
new_leader_uuid: "8493340c2bd047e59811b953aab2a423"
 from {username='slave'} at 127.0.0.1:40000
I20260709 12:16:35.966310  8528 raft_consensus.cc:606] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Received request to transfer leadership to TS 8493340c2bd047e59811b953aab2a423
I20260709 12:16:35.985020  8605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a42cc48f010e4abaa34314467f07303b"
dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
mode: GRACEFUL
new_leader_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
 from {username='slave'} at 127.0.0.1:41404
I20260709 12:16:35.985636  8605 raft_consensus.cc:606] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Received request to transfer leadership to TS 4f56aad176e14cf4a2ae5e90c249aa2f
I20260709 12:16:35.991379  8605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8181bbcf7f2d496886d5e7f70c2574a7"
dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
mode: GRACEFUL
new_leader_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
 from {username='slave'} at 127.0.0.1:41404
I20260709 12:16:35.992065  8605 raft_consensus.cc:606] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Received request to transfer leadership to TS 4f56aad176e14cf4a2ae5e90c249aa2f
I20260709 12:16:35.998083  8605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb9579a1ccb946368d94695df25d838f"
dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
mode: GRACEFUL
new_leader_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
 from {username='slave'} at 127.0.0.1:41404
I20260709 12:16:35.998703  8605 raft_consensus.cc:606] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Received request to transfer leadership to TS 4f56aad176e14cf4a2ae5e90c249aa2f
I20260709 12:16:36.004439  8605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9e056e5c5ff45d4845bb126397f5b5c"
dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
mode: GRACEFUL
new_leader_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
 from {username='slave'} at 127.0.0.1:41404
I20260709 12:16:36.005193  8605 raft_consensus.cc:606] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Received request to transfer leadership to TS 4f56aad176e14cf4a2ae5e90c249aa2f
I20260709 12:16:36.010911  8528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fa11ad3bbcd4bb29777f40130d5fe7e"
dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
mode: GRACEFUL
new_leader_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
 from {username='slave'} at 127.0.0.1:40000
I20260709 12:16:36.011543  8528 raft_consensus.cc:606] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Received request to transfer leadership to TS 301dcdc3ecfe4926a8aa77edc79ab57d
I20260709 12:16:36.036991  8754 raft_consensus.cc:993] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d: : Instructing follower 4f56aad176e14cf4a2ae5e90c249aa2f to start an election
I20260709 12:16:36.038621  8754 raft_consensus.cc:1081] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Signalling peer 4f56aad176e14cf4a2ae5e90c249aa2f to start an election
I20260709 12:16:36.039314  8756 raft_consensus.cc:993] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d: : Instructing follower 4f56aad176e14cf4a2ae5e90c249aa2f to start an election
I20260709 12:16:36.039999  8688 raft_consensus.cc:1081] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Signalling peer 4f56aad176e14cf4a2ae5e90c249aa2f to start an election
I20260709 12:16:36.040841  8528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb9579a1ccb946368d94695df25d838f"
dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
 from {username='slave'} at 127.0.0.1:39992
I20260709 12:16:36.041641  8528 raft_consensus.cc:493] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:36.042063  8528 raft_consensus.cc:3060] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.042001  8527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8181bbcf7f2d496886d5e7f70c2574a7"
dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
 from {username='slave'} at 127.0.0.1:39992
I20260709 12:16:36.042853  8527 raft_consensus.cc:493] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:36.043294  8527 raft_consensus.cc:3060] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.050896  8528 raft_consensus.cc:515] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.051231  8527 raft_consensus.cc:515] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.053409  8528 leader_election.cc:290] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 2 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:36.053431  8527 leader_election.cc:290] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 2 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:36.054849  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8181bbcf7f2d496886d5e7f70c2574a7" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:36.055315  8601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8181bbcf7f2d496886d5e7f70c2574a7" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:36.055642  8454 raft_consensus.cc:3060] T 8181bbcf7f2d496886d5e7f70c2574a7 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.055892  8601 raft_consensus.cc:3055] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:36.056241  8601 raft_consensus.cc:740] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Running, Role: LEADER
I20260709 12:16:36.054906  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9579a1ccb946368d94695df25d838f" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:36.056537  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9579a1ccb946368d94695df25d838f" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:36.056999  8605 raft_consensus.cc:3055] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:36.057193  8453 raft_consensus.cc:3060] T cb9579a1ccb946368d94695df25d838f P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.057242  8601 consensus_queue.cc:260] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.057380  8605 raft_consensus.cc:740] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Running, Role: LEADER
I20260709 12:16:36.059005  8601 raft_consensus.cc:3060] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.059088  8605 consensus_queue.cc:260] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.060577  8605 raft_consensus.cc:3060] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.064841  8454 raft_consensus.cc:2468] T 8181bbcf7f2d496886d5e7f70c2574a7 P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 2.
I20260709 12:16:36.065971  8453 raft_consensus.cc:2468] T cb9579a1ccb946368d94695df25d838f P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 2.
I20260709 12:16:36.066583  8498 leader_election.cc:304] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:36.067585  8691 raft_consensus.cc:2804] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:36.067713  8601 raft_consensus.cc:2468] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 2.
I20260709 12:16:36.068181  8498 leader_election.cc:304] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:36.069185  8741 raft_consensus.cc:2804] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:36.070066  8605 raft_consensus.cc:2468] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 2.
I20260709 12:16:36.068177  8691 raft_consensus.cc:697] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Becoming Leader. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Running, Role: LEADER
I20260709 12:16:36.071123  8741 raft_consensus.cc:697] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Becoming Leader. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Running, Role: LEADER
I20260709 12:16:36.071317  8691 consensus_queue.cc:237] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.072177  8741 consensus_queue.cc:237] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.080719  8352 catalog_manager.cc:5697] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f reported cstate change: term changed from 1 to 2, leader changed from 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67) to 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66). New cstate: current_term: 2 leader_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:36.100665  8352 catalog_manager.cc:5697] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f reported cstate change: term changed from 1 to 2, leader changed from 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67) to 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66). New cstate: current_term: 2 leader_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:36.102978  8688 raft_consensus.cc:993] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d: : Instructing follower 4f56aad176e14cf4a2ae5e90c249aa2f to start an election
I20260709 12:16:36.103611  8754 raft_consensus.cc:1081] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Signalling peer 4f56aad176e14cf4a2ae5e90c249aa2f to start an election
I20260709 12:16:36.105456  8528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9e056e5c5ff45d4845bb126397f5b5c"
dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
 from {username='slave'} at 127.0.0.1:39992
I20260709 12:16:36.106112  8528 raft_consensus.cc:493] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:36.106585  8528 raft_consensus.cc:3060] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.113216  8528 raft_consensus.cc:515] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.116081  8528 leader_election.cc:290] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 2 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:36.116468  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e056e5c5ff45d4845bb126397f5b5c" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:36.116815  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e056e5c5ff45d4845bb126397f5b5c" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:36.117262  8454 raft_consensus.cc:3060] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.117525  8605 raft_consensus.cc:3055] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:36.117908  8605 raft_consensus.cc:740] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Running, Role: LEADER
I20260709 12:16:36.118705  8605 consensus_queue.cc:260] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.119783  8605 raft_consensus.cc:3060] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.123781  8454 raft_consensus.cc:2468] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 2.
I20260709 12:16:36.125056  8498 leader_election.cc:304] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:36.125771  8605 raft_consensus.cc:2468] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 2.
I20260709 12:16:36.125885  8741 raft_consensus.cc:2804] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:36.126574  8741 raft_consensus.cc:697] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Becoming Leader. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Running, Role: LEADER
I20260709 12:16:36.127427  8741 consensus_queue.cc:237] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.135905  8352 catalog_manager.cc:5697] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f reported cstate change: term changed from 1 to 2, leader changed from 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67) to 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66). New cstate: current_term: 2 leader_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:36.239935  8688 raft_consensus.cc:993] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d: : Instructing follower 4f56aad176e14cf4a2ae5e90c249aa2f to start an election
I20260709 12:16:36.240422  8754 raft_consensus.cc:1081] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Signalling peer 4f56aad176e14cf4a2ae5e90c249aa2f to start an election
I20260709 12:16:36.242071  8528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a42cc48f010e4abaa34314467f07303b"
dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
 from {username='slave'} at 127.0.0.1:39992
I20260709 12:16:36.242647  8528 raft_consensus.cc:493] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:36.242995  8528 raft_consensus.cc:3060] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.249054  8528 raft_consensus.cc:515] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.251183  8528 leader_election.cc:290] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 2 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:36.252179  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42cc48f010e4abaa34314467f07303b" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:36.252427  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42cc48f010e4abaa34314467f07303b" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:36.252919  8454 raft_consensus.cc:3060] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.253083  8605 raft_consensus.cc:3055] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:36.253509  8605 raft_consensus.cc:740] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Running, Role: LEADER
I20260709 12:16:36.254293  8605 consensus_queue.cc:260] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.255450  8605 raft_consensus.cc:3060] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.259414  8454 raft_consensus.cc:2468] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 2.
I20260709 12:16:36.260748  8498 leader_election.cc:304] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:36.261670  8741 raft_consensus.cc:2804] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:36.261941  8605 raft_consensus.cc:2468] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 2.
I20260709 12:16:36.262144  8741 raft_consensus.cc:697] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Becoming Leader. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Running, Role: LEADER
I20260709 12:16:36.263324  8741 consensus_queue.cc:237] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.271587  8352 catalog_manager.cc:5697] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f reported cstate change: term changed from 1 to 2, leader changed from 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67) to 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66). New cstate: current_term: 2 leader_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:36.297434  8454 raft_consensus.cc:1275] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Refusing update from remote peer 4f56aad176e14cf4a2ae5e90c249aa2f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:16:36.299233  8741 consensus_queue.cc:1048] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:36.306725  8691 raft_consensus.cc:993] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f: : Instructing follower 8493340c2bd047e59811b953aab2a423 to start an election
I20260709 12:16:36.307288  8691 raft_consensus.cc:1081] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Signalling peer 8493340c2bd047e59811b953aab2a423 to start an election
I20260709 12:16:36.309248  8453 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be4adda3de2941e2938a787df03d067d"
dest_uuid: "8493340c2bd047e59811b953aab2a423"
 from {username='slave'} at 127.0.0.1:59570
I20260709 12:16:36.310961  8453 raft_consensus.cc:493] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:36.311427  8453 raft_consensus.cc:3060] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:36.312729  8605 raft_consensus.cc:1275] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Refusing update from remote peer 4f56aad176e14cf4a2ae5e90c249aa2f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:16:36.314436  8757 consensus_queue.cc:1048] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:36.322474  8453 raft_consensus.cc:515] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.328043  8453 leader_election.cc:290] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 3 election: Requested vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:36.329457  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4adda3de2941e2938a787df03d067d" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:36.329916  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4adda3de2941e2938a787df03d067d" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:36.330363  8528 raft_consensus.cc:3055] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:36.330943  8528 raft_consensus.cc:740] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Running, Role: LEADER
I20260709 12:16:36.331063  8605 raft_consensus.cc:3060] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:36.332022  8528 consensus_queue.cc:260] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.333460  8528 raft_consensus.cc:3060] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:36.341104  8605 raft_consensus.cc:2468] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 3.
I20260709 12:16:36.342712  8528 raft_consensus.cc:2468] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 3.
I20260709 12:16:36.342763  8421 leader_election.cc:304] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:36.344085  8744 raft_consensus.cc:2804] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:36.344687  8744 raft_consensus.cc:697] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [term 3 LEADER]: Becoming Leader. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Running, Role: LEADER
I20260709 12:16:36.345544  8744 consensus_queue.cc:237] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.352542  8353 catalog_manager.cc:5697] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 reported cstate change: term changed from 2 to 3, leader changed from 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66) to 8493340c2bd047e59811b953aab2a423 (127.24.179.65). New cstate: current_term: 3 leader_uuid: "8493340c2bd047e59811b953aab2a423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:36.484067  8691 raft_consensus.cc:993] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f: : Instructing follower 301dcdc3ecfe4926a8aa77edc79ab57d to start an election
I20260709 12:16:36.484586  8691 raft_consensus.cc:1081] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Signalling peer 301dcdc3ecfe4926a8aa77edc79ab57d to start an election
I20260709 12:16:36.486500  8605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fa11ad3bbcd4bb29777f40130d5fe7e"
dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
 from {username='slave'} at 127.0.0.1:41392
I20260709 12:16:36.487097  8605 raft_consensus.cc:493] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:36.487429  8605 raft_consensus.cc:3060] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.493422  8605 raft_consensus.cc:515] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.495419  8605 leader_election.cc:290] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 2 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:36.496647  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa11ad3bbcd4bb29777f40130d5fe7e" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:36.496735  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa11ad3bbcd4bb29777f40130d5fe7e" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:36.497570  8453 raft_consensus.cc:3060] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.497570  8528 raft_consensus.cc:3055] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:36.498154  8528 raft_consensus.cc:740] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Running, Role: LEADER
I20260709 12:16:36.499116  8528 consensus_queue.cc:260] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.500538  8528 raft_consensus.cc:3060] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.506363  8453 raft_consensus.cc:2468] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 2.
I20260709 12:16:36.507838  8572 leader_election.cc:304] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:36.508627  8528 raft_consensus.cc:2468] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 2.
I20260709 12:16:36.508927  8754 raft_consensus.cc:2804] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:36.509488  8754 raft_consensus.cc:697] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 LEADER]: Becoming Leader. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Running, Role: LEADER
I20260709 12:16:36.510442  8754 consensus_queue.cc:237] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.520005  8352 catalog_manager.cc:5697] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d reported cstate change: term changed from 1 to 2, leader changed from 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66) to 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67). New cstate: current_term: 2 leader_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:36.526175  8453 raft_consensus.cc:1275] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Refusing update from remote peer 4f56aad176e14cf4a2ae5e90c249aa2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.527967  8691 consensus_queue.cc:1048] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:36.538143  8454 raft_consensus.cc:1275] T cb9579a1ccb946368d94695df25d838f P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Refusing update from remote peer 4f56aad176e14cf4a2ae5e90c249aa2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.538452  8605 raft_consensus.cc:1275] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Refusing update from remote peer 4f56aad176e14cf4a2ae5e90c249aa2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.540402  8741 consensus_queue.cc:1048] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:36.542717  8757 consensus_queue.cc:1048] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:36.554008  8741 raft_consensus.cc:993] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f: : Instructing follower 8493340c2bd047e59811b953aab2a423 to start an election
I20260709 12:16:36.554716  8741 raft_consensus.cc:1081] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Signalling peer 8493340c2bd047e59811b953aab2a423 to start an election
I20260709 12:16:36.556097  8601 raft_consensus.cc:1275] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Refusing update from remote peer 4f56aad176e14cf4a2ae5e90c249aa2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.558323  8757 consensus_queue.cc:1048] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:36.565234  8601 raft_consensus.cc:1275] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Refusing update from remote peer 4f56aad176e14cf4a2ae5e90c249aa2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.567719  8453 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c008ec4acb3d4da6a43664e485015705"
dest_uuid: "8493340c2bd047e59811b953aab2a423"
 from {username='slave'} at 127.0.0.1:59570
I20260709 12:16:36.568570  8453 raft_consensus.cc:493] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:36.569115  8453 raft_consensus.cc:3060] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.575199  8757 consensus_queue.cc:1048] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:36.580072  8453 raft_consensus.cc:515] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.584110  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c008ec4acb3d4da6a43664e485015705" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:36.584810  8527 raft_consensus.cc:3055] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:36.585151  8527 raft_consensus.cc:740] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Running, Role: LEADER
I20260709 12:16:36.586089  8527 consensus_queue.cc:260] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.586735  8453 leader_election.cc:290] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 2 election: Requested vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:36.587417  8527 raft_consensus.cc:3060] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.590214  8601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c008ec4acb3d4da6a43664e485015705" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:36.591100  8601 raft_consensus.cc:3060] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.598191  8453 raft_consensus.cc:1275] T 8181bbcf7f2d496886d5e7f70c2574a7 P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Refusing update from remote peer 4f56aad176e14cf4a2ae5e90c249aa2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.599854  8601 raft_consensus.cc:2468] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 2.
I20260709 12:16:36.600442  8757 consensus_queue.cc:1048] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:36.601377  8421 leader_election.cc:304] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:36.602559  8747 raft_consensus.cc:2804] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:36.603430  8747 raft_consensus.cc:697] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [term 2 LEADER]: Becoming Leader. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Running, Role: LEADER
I20260709 12:16:36.602964  8527 raft_consensus.cc:2468] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 2.
I20260709 12:16:36.604588  8747 consensus_queue.cc:237] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:36.614933  8355 catalog_manager.cc:5697] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 reported cstate change: term changed from 1 to 2, leader changed from 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66) to 8493340c2bd047e59811b953aab2a423 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "8493340c2bd047e59811b953aab2a423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:36.686319  8601 raft_consensus.cc:1275] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Refusing update from remote peer 4f56aad176e14cf4a2ae5e90c249aa2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.687997  8757 consensus_queue.cc:1048] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:36.698035  8453 raft_consensus.cc:1275] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Refusing update from remote peer 4f56aad176e14cf4a2ae5e90c249aa2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:36.700393  8741 consensus_queue.cc:1048] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:36.948521  8527 raft_consensus.cc:1275] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 3 FOLLOWER]: Refusing update from remote peer 8493340c2bd047e59811b953aab2a423: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:36.949853  8747 consensus_queue.cc:1048] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:36.958887  8601 raft_consensus.cc:1275] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 FOLLOWER]: Refusing update from remote peer 8493340c2bd047e59811b953aab2a423: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:36.961122  8744 consensus_queue.cc:1048] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:37.003176  8453 raft_consensus.cc:1275] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Refusing update from remote peer 301dcdc3ecfe4926a8aa77edc79ab57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:37.004782  8754 consensus_queue.cc:1048] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:37.015657  8527 raft_consensus.cc:1275] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Refusing update from remote peer 301dcdc3ecfe4926a8aa77edc79ab57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:37.017890  8777 consensus_queue.cc:1048] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:37.063062  8527 raft_consensus.cc:1275] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Refusing update from remote peer 8493340c2bd047e59811b953aab2a423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:37.064633  8744 consensus_queue.cc:1048] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:37.075238  8601 raft_consensus.cc:1275] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Refusing update from remote peer 8493340c2bd047e59811b953aab2a423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:37.080729  8747 consensus_queue.cc:1048] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:39.095558  8355 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46038:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:39.097976  8355 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:39.153518  8445 tablet_service.cc:1511] Processing CreateTablet for tablet edcac3e9bdff42ecb15bc6d821dc4ee3 (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:39.155045  8445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edcac3e9bdff42ecb15bc6d821dc4ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.155485  8515 tablet_service.cc:1511] Processing CreateTablet for tablet edcac3e9bdff42ecb15bc6d821dc4ee3 (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:39.156965  8515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edcac3e9bdff42ecb15bc6d821dc4ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.157925  8588 tablet_service.cc:1511] Processing CreateTablet for tablet edcac3e9bdff42ecb15bc6d821dc4ee3 (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:39.159690  8588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edcac3e9bdff42ecb15bc6d821dc4ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.160023  8442 tablet_service.cc:1511] Processing CreateTablet for tablet b3f75420696a42e48efef4fb251b75d1 (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:39.161487  8442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f75420696a42e48efef4fb251b75d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.164434  8591 tablet_service.cc:1511] Processing CreateTablet for tablet b3f75420696a42e48efef4fb251b75d1 (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:39.166081  8591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f75420696a42e48efef4fb251b75d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.167560  8520 tablet_service.cc:1511] Processing CreateTablet for tablet b3f75420696a42e48efef4fb251b75d1 (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:39.168442  8518 tablet_service.cc:1511] Processing CreateTablet for tablet 7af81e2425b04f18ada1ee59599705f9 (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:39.169148  8520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f75420696a42e48efef4fb251b75d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.169950  8518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7af81e2425b04f18ada1ee59599705f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.172307  8440 tablet_service.cc:1511] Processing CreateTablet for tablet 7af81e2425b04f18ada1ee59599705f9 (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:39.173823  8440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7af81e2425b04f18ada1ee59599705f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.178330  8592 tablet_service.cc:1511] Processing CreateTablet for tablet 7af81e2425b04f18ada1ee59599705f9 (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:39.182782  8592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7af81e2425b04f18ada1ee59599705f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.187603  8439 tablet_service.cc:1511] Processing CreateTablet for tablet e8f63e935ab34e7796d6b269458cfdbe (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:39.189196  8439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f63e935ab34e7796d6b269458cfdbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.189585  8521 tablet_service.cc:1511] Processing CreateTablet for tablet e8f63e935ab34e7796d6b269458cfdbe (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:39.191468  8521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f63e935ab34e7796d6b269458cfdbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.197283  8799 tablet_bootstrap.cc:492] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 4f56aad176e14cf4a2ae5e90c249aa2f: Bootstrap starting.
I20260709 12:16:39.208868  8799 tablet_bootstrap.cc:654] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 4f56aad176e14cf4a2ae5e90c249aa2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.225045  8441 tablet_service.cc:1511] Processing CreateTablet for tablet c1d221fd20f747e9bf79da7978e763ff (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:39.226891  8441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1d221fd20f747e9bf79da7978e763ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.226517  8588 tablet_service.cc:1511] Processing CreateTablet for tablet e8f63e935ab34e7796d6b269458cfdbe (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:39.228660  8588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f63e935ab34e7796d6b269458cfdbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.234834  8515 tablet_service.cc:1511] Processing CreateTablet for tablet c1d221fd20f747e9bf79da7978e763ff (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:39.236510  8515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1d221fd20f747e9bf79da7978e763ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.242444  8589 tablet_service.cc:1511] Processing CreateTablet for tablet c1d221fd20f747e9bf79da7978e763ff (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:39.244047  8589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1d221fd20f747e9bf79da7978e763ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.247648  8443 tablet_service.cc:1511] Processing CreateTablet for tablet ecead67c5c8446bc9043f981de6e5082 (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:39.249257  8443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecead67c5c8446bc9043f981de6e5082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.256345  8518 tablet_service.cc:1511] Processing CreateTablet for tablet ecead67c5c8446bc9043f981de6e5082 (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:39.258136  8518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecead67c5c8446bc9043f981de6e5082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.259203  8593 tablet_service.cc:1511] Processing CreateTablet for tablet ecead67c5c8446bc9043f981de6e5082 (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:39.260735  8593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecead67c5c8446bc9043f981de6e5082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.264350  8799 tablet_bootstrap.cc:492] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 4f56aad176e14cf4a2ae5e90c249aa2f: No bootstrap required, opened a new log
I20260709 12:16:39.265103  8799 ts_tablet_manager.cc:1403] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.013s
I20260709 12:16:39.265874  8446 tablet_service.cc:1511] Processing CreateTablet for tablet d71d7e9514614a8e80f85267d9a2c39f (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:39.267629  8446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d71d7e9514614a8e80f85267d9a2c39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.268563  8799 raft_consensus.cc:359] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.269454  8799 raft_consensus.cc:385] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.273919  8799 raft_consensus.cc:740] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.275044  8799 consensus_queue.cc:260] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.275354  8521 tablet_service.cc:1511] Processing CreateTablet for tablet d71d7e9514614a8e80f85267d9a2c39f (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:39.276901  8521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d71d7e9514614a8e80f85267d9a2c39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.280546  8799 ts_tablet_manager.cc:1434] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:16:39.281970  8799 tablet_bootstrap.cc:492] T 7af81e2425b04f18ada1ee59599705f9 P 4f56aad176e14cf4a2ae5e90c249aa2f: Bootstrap starting.
I20260709 12:16:39.286320  8800 tablet_bootstrap.cc:492] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d: Bootstrap starting.
I20260709 12:16:39.292204  8592 tablet_service.cc:1511] Processing CreateTablet for tablet d71d7e9514614a8e80f85267d9a2c39f (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:39.293936  8592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d71d7e9514614a8e80f85267d9a2c39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.297676  8444 tablet_service.cc:1511] Processing CreateTablet for tablet a5e428f7950e43bc8ee9d4488ca7fd61 (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:39.302035  8799 tablet_bootstrap.cc:654] T 7af81e2425b04f18ada1ee59599705f9 P 4f56aad176e14cf4a2ae5e90c249aa2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.308467  8444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e428f7950e43bc8ee9d4488ca7fd61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.325429  8802 tablet_bootstrap.cc:492] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423: Bootstrap starting.
I20260709 12:16:39.328980  8596 tablet_service.cc:1511] Processing CreateTablet for tablet a5e428f7950e43bc8ee9d4488ca7fd61 (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:39.330760  8596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e428f7950e43bc8ee9d4488ca7fd61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.331686  8800 tablet_bootstrap.cc:654] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.334918  8515 tablet_service.cc:1511] Processing CreateTablet for tablet a5e428f7950e43bc8ee9d4488ca7fd61 (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:39.336525  8515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e428f7950e43bc8ee9d4488ca7fd61. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:39.345461  8386 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0860 after lost signal to thread 25296
W20260709 12:16:39.348073  8386 debug-util.cc:398] Leaking SignalData structure 0x7b080032f020 after lost signal to thread 8481
W20260709 12:16:39.349586  8386 debug-util.cc:398] Leaking SignalData structure 0x7b080006fac0 after lost signal to thread 8556
W20260709 12:16:39.351231  8386 debug-util.cc:398] Leaking SignalData structure 0x7b080013cb20 after lost signal to thread 8630
I20260709 12:16:39.356129  8522 tablet_service.cc:1511] Processing CreateTablet for tablet 0fa4e6159720456f829d74ec7d29c267 (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:39.357698  8522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa4e6159720456f829d74ec7d29c267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.352371  8439 tablet_service.cc:1511] Processing CreateTablet for tablet 0fa4e6159720456f829d74ec7d29c267 (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:39.359329  8439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa4e6159720456f829d74ec7d29c267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.359812  8594 tablet_service.cc:1511] Processing CreateTablet for tablet 0fa4e6159720456f829d74ec7d29c267 (DEFAULT_TABLE table=soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:39.361263  8594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa4e6159720456f829d74ec7d29c267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:39.373006  8802 tablet_bootstrap.cc:654] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.399827  8799 tablet_bootstrap.cc:492] T 7af81e2425b04f18ada1ee59599705f9 P 4f56aad176e14cf4a2ae5e90c249aa2f: No bootstrap required, opened a new log
I20260709 12:16:39.400446  8799 ts_tablet_manager.cc:1403] T 7af81e2425b04f18ada1ee59599705f9 P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.003s
I20260709 12:16:39.409658  8799 raft_consensus.cc:359] T 7af81e2425b04f18ada1ee59599705f9 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.411134  8799 raft_consensus.cc:385] T 7af81e2425b04f18ada1ee59599705f9 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.412009  8799 raft_consensus.cc:740] T 7af81e2425b04f18ada1ee59599705f9 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.412906  8799 consensus_queue.cc:260] T 7af81e2425b04f18ada1ee59599705f9 P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.415478  8799 ts_tablet_manager.cc:1434] T 7af81e2425b04f18ada1ee59599705f9 P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.005s
I20260709 12:16:39.423946  8800 tablet_bootstrap.cc:492] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d: No bootstrap required, opened a new log
I20260709 12:16:39.432850  8802 tablet_bootstrap.cc:492] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423: No bootstrap required, opened a new log
I20260709 12:16:39.432947  8800 ts_tablet_manager.cc:1403] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent bootstrapping tablet: real 0.147s	user 0.026s	sys 0.018s
I20260709 12:16:39.433531  8802 ts_tablet_manager.cc:1403] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.022s
I20260709 12:16:39.436952  8799 tablet_bootstrap.cc:492] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f: Bootstrap starting.
I20260709 12:16:39.436959  8800 raft_consensus.cc:359] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.438831  8800 raft_consensus.cc:385] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.439220  8800 raft_consensus.cc:740] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.440268  8800 consensus_queue.cc:260] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.443182  8800 ts_tablet_manager.cc:1434] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:16:39.445180  8800 tablet_bootstrap.cc:492] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d: Bootstrap starting.
I20260709 12:16:39.447045  8802 raft_consensus.cc:359] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.448017  8802 raft_consensus.cc:385] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.448424  8802 raft_consensus.cc:740] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.449446  8802 consensus_queue.cc:260] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.452549  8802 ts_tablet_manager.cc:1434] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 12:16:39.445767  8799 tablet_bootstrap.cc:654] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.454201  8802 tablet_bootstrap.cc:492] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423: Bootstrap starting.
I20260709 12:16:39.459776  8800 tablet_bootstrap.cc:654] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.472739  8799 tablet_bootstrap.cc:492] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f: No bootstrap required, opened a new log
I20260709 12:16:39.473066  8802 tablet_bootstrap.cc:654] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.473506  8799 ts_tablet_manager.cc:1403] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent bootstrapping tablet: real 0.054s	user 0.007s	sys 0.013s
I20260709 12:16:39.478816  8800 tablet_bootstrap.cc:492] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d: No bootstrap required, opened a new log
I20260709 12:16:39.478514  8799 raft_consensus.cc:359] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.479592  8800 ts_tablet_manager.cc:1403] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.007s
I20260709 12:16:39.479997  8799 raft_consensus.cc:385] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.480604  8799 raft_consensus.cc:740] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.482100  8799 consensus_queue.cc:260] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.484900  8800 raft_consensus.cc:359] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.487673  8800 raft_consensus.cc:385] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.488036  8800 raft_consensus.cc:740] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.490935  8800 consensus_queue.cc:260] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.492156  8799 ts_tablet_manager.cc:1434] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.004s
I20260709 12:16:39.493331  8799 tablet_bootstrap.cc:492] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f: Bootstrap starting.
I20260709 12:16:39.493641  8800 ts_tablet_manager.cc:1434] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:16:39.494908  8800 tablet_bootstrap.cc:492] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d: Bootstrap starting.
I20260709 12:16:39.497393  8802 tablet_bootstrap.cc:492] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423: No bootstrap required, opened a new log
I20260709 12:16:39.498306  8802 ts_tablet_manager.cc:1403] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.012s
I20260709 12:16:39.501080  8799 tablet_bootstrap.cc:654] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.502105  8802 raft_consensus.cc:359] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.502785  8800 tablet_bootstrap.cc:654] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.503247  8802 raft_consensus.cc:385] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.503733  8802 raft_consensus.cc:740] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.504681  8802 consensus_queue.cc:260] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.507746  8802 ts_tablet_manager.cc:1434] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:16:39.509002  8802 tablet_bootstrap.cc:492] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423: Bootstrap starting.
I20260709 12:16:39.519620  8802 tablet_bootstrap.cc:654] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.533061  8802 tablet_bootstrap.cc:492] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423: No bootstrap required, opened a new log
I20260709 12:16:39.534054  8802 ts_tablet_manager.cc:1403] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.005s
I20260709 12:16:39.538208  8802 raft_consensus.cc:359] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.539355  8802 raft_consensus.cc:385] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.539805  8802 raft_consensus.cc:740] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.541006  8799 tablet_bootstrap.cc:492] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f: No bootstrap required, opened a new log
I20260709 12:16:39.541034  8800 tablet_bootstrap.cc:492] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d: No bootstrap required, opened a new log
I20260709 12:16:39.540877  8802 consensus_queue.cc:260] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.541790  8799 ts_tablet_manager.cc:1403] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.006s
I20260709 12:16:39.541989  8800 ts_tablet_manager.cc:1403] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent bootstrapping tablet: real 0.047s	user 0.024s	sys 0.018s
I20260709 12:16:39.547122  8802 ts_tablet_manager.cc:1434] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:16:39.548616  8802 tablet_bootstrap.cc:492] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423: Bootstrap starting.
I20260709 12:16:39.550323  8800 raft_consensus.cc:359] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.551540  8800 raft_consensus.cc:385] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.552000  8800 raft_consensus.cc:740] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.553188  8800 consensus_queue.cc:260] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.556164  8800 ts_tablet_manager.cc:1434] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:16:39.557222  8802 tablet_bootstrap.cc:654] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.557420  8800 tablet_bootstrap.cc:492] T e8f63e935ab34e7796d6b269458cfdbe P 301dcdc3ecfe4926a8aa77edc79ab57d: Bootstrap starting.
I20260709 12:16:39.575569  8799 raft_consensus.cc:359] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.577346  8799 raft_consensus.cc:385] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.577884  8799 raft_consensus.cc:740] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.579221  8799 consensus_queue.cc:260] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.583256  8799 ts_tablet_manager.cc:1434] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.004s
I20260709 12:16:39.585093  8799 tablet_bootstrap.cc:492] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f: Bootstrap starting.
I20260709 12:16:39.592799  8800 tablet_bootstrap.cc:654] T e8f63e935ab34e7796d6b269458cfdbe P 301dcdc3ecfe4926a8aa77edc79ab57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.595077  8799 tablet_bootstrap.cc:654] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.601519  8783 raft_consensus.cc:493] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:39.612740  8783 raft_consensus.cc:515] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.615203  8783 leader_election.cc:290] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:39.615803  8783 raft_consensus.cc:493] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:39.616287  8783 raft_consensus.cc:515] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.624235  8783 leader_election.cc:290] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:39.625386  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcac3e9bdff42ecb15bc6d821dc4ee3" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:39.625617  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af81e2425b04f18ada1ee59599705f9" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:39.627946  8453 raft_consensus.cc:2468] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 0.
I20260709 12:16:39.631250  8572 leader_election.cc:304] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
W20260709 12:16:39.633467  8572 leader_election.cc:343] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:39.638221  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcac3e9bdff42ecb15bc6d821dc4ee3" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:39.639482  8530 raft_consensus.cc:2468] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 0.
I20260709 12:16:39.639567  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af81e2425b04f18ada1ee59599705f9" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:39.640799  8528 raft_consensus.cc:2468] T 7af81e2425b04f18ada1ee59599705f9 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 0.
I20260709 12:16:39.642478  8802 tablet_bootstrap.cc:492] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423: No bootstrap required, opened a new log
I20260709 12:16:39.643225  8802 ts_tablet_manager.cc:1403] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423: Time spent bootstrapping tablet: real 0.095s	user 0.046s	sys 0.039s
I20260709 12:16:39.651590  8815 raft_consensus.cc:2804] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:39.658053  8815 raft_consensus.cc:493] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:39.658718  8815 raft_consensus.cc:3060] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:39.662932  8570 leader_election.cc:304] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 8493340c2bd047e59811b953aab2a423
I20260709 12:16:39.668311  8783 raft_consensus.cc:2804] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:39.668975  8783 raft_consensus.cc:493] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:39.669495  8783 raft_consensus.cc:3060] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:39.691087  8802 raft_consensus.cc:359] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.692230  8802 raft_consensus.cc:385] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.692588  8802 raft_consensus.cc:740] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.696811  8800 tablet_bootstrap.cc:492] T e8f63e935ab34e7796d6b269458cfdbe P 301dcdc3ecfe4926a8aa77edc79ab57d: No bootstrap required, opened a new log
I20260709 12:16:39.697096  8799 tablet_bootstrap.cc:492] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f: No bootstrap required, opened a new log
I20260709 12:16:39.697639  8800 ts_tablet_manager.cc:1403] T e8f63e935ab34e7796d6b269458cfdbe P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent bootstrapping tablet: real 0.140s	user 0.038s	sys 0.043s
I20260709 12:16:39.697799  8799 ts_tablet_manager.cc:1403] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent bootstrapping tablet: real 0.113s	user 0.042s	sys 0.029s
I20260709 12:16:39.699131  8783 raft_consensus.cc:515] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.701550  8799 raft_consensus.cc:359] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.701787  8800 raft_consensus.cc:359] T e8f63e935ab34e7796d6b269458cfdbe P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.705704  8799 raft_consensus.cc:385] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.704316  8802 consensus_queue.cc:260] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.703183  8815 raft_consensus.cc:515] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.706211  8799 raft_consensus.cc:740] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.707307  8799 consensus_queue.cc:260] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.708123  8802 ts_tablet_manager.cc:1434] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 12:16:39.709378  8802 tablet_bootstrap.cc:492] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423: Bootstrap starting.
I20260709 12:16:39.709452  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcac3e9bdff42ecb15bc6d821dc4ee3" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:39.710191  8799 ts_tablet_manager.cc:1434] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.006s
I20260709 12:16:39.705811  8800 raft_consensus.cc:385] T e8f63e935ab34e7796d6b269458cfdbe P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.710304  8456 raft_consensus.cc:3060] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:39.711602  8799 tablet_bootstrap.cc:492] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f: Bootstrap starting.
I20260709 12:16:39.719519  8799 tablet_bootstrap.cc:654] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.720067  8800 raft_consensus.cc:740] T e8f63e935ab34e7796d6b269458cfdbe P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.722245  8800 consensus_queue.cc:260] T e8f63e935ab34e7796d6b269458cfdbe P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.721196  8815 leader_election.cc:290] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:39.723100  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcac3e9bdff42ecb15bc6d821dc4ee3" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:39.725149  8528 raft_consensus.cc:3060] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:39.729583  8802 tablet_bootstrap.cc:654] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.732303  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af81e2425b04f18ada1ee59599705f9" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:39.733116  8454 raft_consensus.cc:3060] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:39.742516  8783 leader_election.cc:290] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:39.723309  8456 raft_consensus.cc:2468] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 1.
I20260709 12:16:39.745014  8572 leader_election.cc:304] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:39.746073  8815 raft_consensus.cc:2804] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:39.746258  8454 raft_consensus.cc:2468] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 1.
I20260709 12:16:39.746848  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af81e2425b04f18ada1ee59599705f9" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:39.747687  8530 raft_consensus.cc:3060] T 7af81e2425b04f18ada1ee59599705f9 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:39.748075  8815 raft_consensus.cc:697] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Becoming Leader. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Running, Role: LEADER
I20260709 12:16:39.748313  8572 leader_election.cc:304] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:39.749456  8783 raft_consensus.cc:2804] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:39.749895  8815 consensus_queue.cc:237] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.754045  8800 ts_tablet_manager.cc:1434] T e8f63e935ab34e7796d6b269458cfdbe P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 12:16:39.759913  8800 tablet_bootstrap.cc:492] T a5e428f7950e43bc8ee9d4488ca7fd61 P 301dcdc3ecfe4926a8aa77edc79ab57d: Bootstrap starting.
I20260709 12:16:39.745293  8528 raft_consensus.cc:2468] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 1.
I20260709 12:16:39.763592  8799 tablet_bootstrap.cc:492] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f: No bootstrap required, opened a new log
I20260709 12:16:39.761364  8530 raft_consensus.cc:2468] T 7af81e2425b04f18ada1ee59599705f9 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 1.
I20260709 12:16:39.767187  8799 ts_tablet_manager.cc:1403] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.035s
I20260709 12:16:39.770861  8800 tablet_bootstrap.cc:654] T a5e428f7950e43bc8ee9d4488ca7fd61 P 301dcdc3ecfe4926a8aa77edc79ab57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.771315  8783 raft_consensus.cc:697] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Becoming Leader. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Running, Role: LEADER
I20260709 12:16:39.772625  8783 consensus_queue.cc:237] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.778939  8814 raft_consensus.cc:493] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:39.779610  8814 raft_consensus.cc:515] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.780416  8802 tablet_bootstrap.cc:492] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423: No bootstrap required, opened a new log
I20260709 12:16:39.780164  8799 raft_consensus.cc:359] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.780687  8800 tablet_bootstrap.cc:492] T a5e428f7950e43bc8ee9d4488ca7fd61 P 301dcdc3ecfe4926a8aa77edc79ab57d: No bootstrap required, opened a new log
I20260709 12:16:39.781289  8802 ts_tablet_manager.cc:1403] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423: Time spent bootstrapping tablet: real 0.072s	user 0.013s	sys 0.003s
I20260709 12:16:39.781410  8800 ts_tablet_manager.cc:1403] T a5e428f7950e43bc8ee9d4488ca7fd61 P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 12:16:39.781023  8799 raft_consensus.cc:385] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.782944  8799 raft_consensus.cc:740] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.783915  8815 raft_consensus.cc:493] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:39.783766  8799 consensus_queue.cc:260] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.784562  8815 raft_consensus.cc:515] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.785830  8802 raft_consensus.cc:359] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.786912  8802 raft_consensus.cc:385] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.787395  8802 raft_consensus.cc:740] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.788223  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f75420696a42e48efef4fb251b75d1" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:39.789131  8456 raft_consensus.cc:2468] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 0.
I20260709 12:16:39.790674  8572 leader_election.cc:304] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:39.790743  8802 consensus_queue.cc:260] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.789646  8815 leader_election.cc:290] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:39.794106  8802 ts_tablet_manager.cc:1434] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:16:39.795442  8802 tablet_bootstrap.cc:492] T ecead67c5c8446bc9043f981de6e5082 P 8493340c2bd047e59811b953aab2a423: Bootstrap starting.
I20260709 12:16:39.785984  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d221fd20f747e9bf79da7978e763ff" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:39.789134  8799 ts_tablet_manager.cc:1434] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.003s
I20260709 12:16:39.800119  8799 tablet_bootstrap.cc:492] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f: Bootstrap starting.
W20260709 12:16:39.800457  8498 leader_election.cc:343] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:39.792273  8815 raft_consensus.cc:2804] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:39.803617  8815 raft_consensus.cc:493] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:39.804549  8815 raft_consensus.cc:3060] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:39.802763  8601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d221fd20f747e9bf79da7978e763ff" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:39.812083  8802 tablet_bootstrap.cc:654] T ecead67c5c8446bc9043f981de6e5082 P 8493340c2bd047e59811b953aab2a423: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.814514  8814 leader_election.cc:290] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
W20260709 12:16:39.812216  8496 leader_election.cc:343] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:39.815574  8496 leader_election.cc:304] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423
I20260709 12:16:39.817929  8814 raft_consensus.cc:2749] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:39.804026  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f75420696a42e48efef4fb251b75d1" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:39.819986  8530 raft_consensus.cc:2468] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 0.
I20260709 12:16:39.827986  8802 tablet_bootstrap.cc:492] T ecead67c5c8446bc9043f981de6e5082 P 8493340c2bd047e59811b953aab2a423: No bootstrap required, opened a new log
I20260709 12:16:39.814535  8799 tablet_bootstrap.cc:654] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.828723  8802 ts_tablet_manager.cc:1403] T ecead67c5c8446bc9043f981de6e5082 P 8493340c2bd047e59811b953aab2a423: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.008s
I20260709 12:16:39.833154  8802 raft_consensus.cc:359] T ecead67c5c8446bc9043f981de6e5082 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.834195  8802 raft_consensus.cc:385] T ecead67c5c8446bc9043f981de6e5082 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.834686  8802 raft_consensus.cc:740] T ecead67c5c8446bc9043f981de6e5082 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.835620  8802 consensus_queue.cc:260] T ecead67c5c8446bc9043f981de6e5082 P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.838626  8802 ts_tablet_manager.cc:1434] T ecead67c5c8446bc9043f981de6e5082 P 8493340c2bd047e59811b953aab2a423: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:16:39.812896  8800 raft_consensus.cc:359] T a5e428f7950e43bc8ee9d4488ca7fd61 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.840155  8802 tablet_bootstrap.cc:492] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423: Bootstrap starting.
I20260709 12:16:39.839318  8800 raft_consensus.cc:385] T a5e428f7950e43bc8ee9d4488ca7fd61 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.841480  8800 raft_consensus.cc:740] T a5e428f7950e43bc8ee9d4488ca7fd61 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.842563  8800 consensus_queue.cc:260] T a5e428f7950e43bc8ee9d4488ca7fd61 P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.845471  8800 ts_tablet_manager.cc:1434] T a5e428f7950e43bc8ee9d4488ca7fd61 P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.000s
I20260709 12:16:39.846906  8800 tablet_bootstrap.cc:492] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d: Bootstrap starting.
I20260709 12:16:39.848261  8814 raft_consensus.cc:493] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:39.848937  8814 raft_consensus.cc:515] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.853741  8601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f63e935ab34e7796d6b269458cfdbe" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:39.854041  8814 leader_election.cc:290] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:39.854266  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f63e935ab34e7796d6b269458cfdbe" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:39.854621  8601 raft_consensus.cc:2468] T e8f63e935ab34e7796d6b269458cfdbe P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 0.
I20260709 12:16:39.855189  8454 raft_consensus.cc:2468] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 0.
I20260709 12:16:39.856793  8498 leader_election.cc:304] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:39.857582  8799 tablet_bootstrap.cc:492] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f: No bootstrap required, opened a new log
I20260709 12:16:39.848846  8815 raft_consensus.cc:515] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.858362  8799 ts_tablet_manager.cc:1403] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent bootstrapping tablet: real 0.059s	user 0.004s	sys 0.012s
I20260709 12:16:39.860464  8814 raft_consensus.cc:2804] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:39.865234  8814 raft_consensus.cc:493] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:39.865623  8814 raft_consensus.cc:3060] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:39.861660  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f75420696a42e48efef4fb251b75d1" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:39.866993  8454 raft_consensus.cc:3060] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:39.870620  8352 catalog_manager.cc:5697] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67). New cstate: current_term: 1 leader_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:39.873911  8799 raft_consensus.cc:359] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.874987  8799 raft_consensus.cc:385] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.875412  8799 raft_consensus.cc:740] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.862709  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f75420696a42e48efef4fb251b75d1" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:39.875319  8813 raft_consensus.cc:493] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:39.876504  8530 raft_consensus.cc:3060] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:39.876655  8813 raft_consensus.cc:515] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.862028  8802 tablet_bootstrap.cc:654] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.879485  8813 leader_election.cc:290] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:39.877139  8799 consensus_queue.cc:260] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.881660  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecead67c5c8446bc9043f981de6e5082" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:39.882581  8456 raft_consensus.cc:2468] T ecead67c5c8446bc9043f981de6e5082 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 0.
I20260709 12:16:39.860725  8815 leader_election.cc:290] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:39.884626  8799 ts_tablet_manager.cc:1434] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:16:39.884366  8498 leader_election.cc:304] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:39.885908  8799 tablet_bootstrap.cc:492] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f: Bootstrap starting.
I20260709 12:16:39.887010  8787 raft_consensus.cc:2804] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:39.887473  8787 raft_consensus.cc:493] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:39.887863  8787 raft_consensus.cc:3060] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:39.893666  8601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecead67c5c8446bc9043f981de6e5082" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:39.901685  8802 tablet_bootstrap.cc:492] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423: No bootstrap required, opened a new log
W20260709 12:16:39.902094  8496 leader_election.cc:343] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:39.902539  8802 ts_tablet_manager.cc:1403] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.000s
I20260709 12:16:39.906255  8802 raft_consensus.cc:359] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.908548  8802 raft_consensus.cc:385] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.909121  8800 tablet_bootstrap.cc:654] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.909628  8799 tablet_bootstrap.cc:654] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.909032  8802 raft_consensus.cc:740] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.911202  8802 consensus_queue.cc:260] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.872745  8352 catalog_manager.cc:5697] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67). New cstate: current_term: 1 leader_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:39.915515  8454 raft_consensus.cc:2468] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 1.
I20260709 12:16:39.917268  8802 ts_tablet_manager.cc:1434] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:16:39.918712  8802 tablet_bootstrap.cc:492] T a5e428f7950e43bc8ee9d4488ca7fd61 P 8493340c2bd047e59811b953aab2a423: Bootstrap starting.
I20260709 12:16:39.912715  8530 raft_consensus.cc:2468] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 1.
I20260709 12:16:39.917176  8572 leader_election.cc:304] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:39.921633  8815 raft_consensus.cc:2804] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:39.922312  8815 raft_consensus.cc:697] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Becoming Leader. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Running, Role: LEADER
I20260709 12:16:39.923411  8815 consensus_queue.cc:237] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.928817  8802 tablet_bootstrap.cc:654] T a5e428f7950e43bc8ee9d4488ca7fd61 P 8493340c2bd047e59811b953aab2a423: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.920190  8814 raft_consensus.cc:515] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.942101  8799 tablet_bootstrap.cc:492] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f: No bootstrap required, opened a new log
I20260709 12:16:39.943429  8814 leader_election.cc:290] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:39.943813  8799 ts_tablet_manager.cc:1403] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.000s
I20260709 12:16:39.906683  8787 raft_consensus.cc:515] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.947420  8799 raft_consensus.cc:359] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.948319  8799 raft_consensus.cc:385] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.948856  8799 raft_consensus.cc:740] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.949891  8799 consensus_queue.cc:260] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.951040  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f63e935ab34e7796d6b269458cfdbe" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:39.952066  8454 raft_consensus.cc:3060] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:39.952127  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecead67c5c8446bc9043f981de6e5082" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:39.952966  8456 raft_consensus.cc:3060] T ecead67c5c8446bc9043f981de6e5082 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:39.955716  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecead67c5c8446bc9043f981de6e5082" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
W20260709 12:16:39.957504  8496 leader_election.cc:343] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:39.948201  8787 leader_election.cc:290] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:39.951287  8601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f63e935ab34e7796d6b269458cfdbe" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:39.958916  8601 raft_consensus.cc:3060] T e8f63e935ab34e7796d6b269458cfdbe P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:39.961345  8799 ts_tablet_manager.cc:1434] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:16:39.963851  8454 raft_consensus.cc:2468] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 1.
I20260709 12:16:39.965832  8498 leader_election.cc:304] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:39.967298  8787 raft_consensus.cc:2804] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:39.968040  8787 raft_consensus.cc:697] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Becoming Leader. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Running, Role: LEADER
I20260709 12:16:39.969280  8787 consensus_queue.cc:237] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.972872  8799 tablet_bootstrap.cc:492] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f: Bootstrap starting.
I20260709 12:16:39.978544  8788 raft_consensus.cc:493] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:39.979223  8788 raft_consensus.cc:515] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.982275  8802 tablet_bootstrap.cc:492] T a5e428f7950e43bc8ee9d4488ca7fd61 P 8493340c2bd047e59811b953aab2a423: No bootstrap required, opened a new log
I20260709 12:16:39.983095  8802 ts_tablet_manager.cc:1403] T a5e428f7950e43bc8ee9d4488ca7fd61 P 8493340c2bd047e59811b953aab2a423: Time spent bootstrapping tablet: real 0.065s	user 0.023s	sys 0.024s
I20260709 12:16:39.985131  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d221fd20f747e9bf79da7978e763ff" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:39.985985  8530 raft_consensus.cc:2468] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 0.
I20260709 12:16:39.986884  8788 leader_election.cc:290] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:39.988250  8421 leader_election.cc:304] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:39.989394  8799 tablet_bootstrap.cc:654] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:39.988127  8802 raft_consensus.cc:359] T a5e428f7950e43bc8ee9d4488ca7fd61 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.990935  8802 raft_consensus.cc:385] T a5e428f7950e43bc8ee9d4488ca7fd61 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:39.993609  8802 raft_consensus.cc:740] T a5e428f7950e43bc8ee9d4488ca7fd61 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Initialized, Role: FOLLOWER
I20260709 12:16:39.994570  8802 consensus_queue.cc:260] T a5e428f7950e43bc8ee9d4488ca7fd61 P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:39.992219  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d221fd20f747e9bf79da7978e763ff" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:39.996058  8784 raft_consensus.cc:2804] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:39.996534  8784 raft_consensus.cc:493] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:39.996927  8784 raft_consensus.cc:3060] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:39.997257  8802 ts_tablet_manager.cc:1434] T a5e428f7950e43bc8ee9d4488ca7fd61 P 8493340c2bd047e59811b953aab2a423: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 12:16:39.998559  8802 tablet_bootstrap.cc:492] T 0fa4e6159720456f829d74ec7d29c267 P 8493340c2bd047e59811b953aab2a423: Bootstrap starting.
I20260709 12:16:40.005349  8802 tablet_bootstrap.cc:654] T 0fa4e6159720456f829d74ec7d29c267 P 8493340c2bd047e59811b953aab2a423: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:39.996795  8421 leader_election.cc:343] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:40.009945  8799 tablet_bootstrap.cc:492] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f: No bootstrap required, opened a new log
I20260709 12:16:40.010746  8799 ts_tablet_manager.cc:1403] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.000s
I20260709 12:16:40.014346  8799 raft_consensus.cc:359] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.015300  8799 raft_consensus.cc:385] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:40.015618  8799 raft_consensus.cc:740] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Initialized, Role: FOLLOWER
I20260709 12:16:40.016633  8799 consensus_queue.cc:260] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.017117  8456 raft_consensus.cc:2468] T ecead67c5c8446bc9043f981de6e5082 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 1.
I20260709 12:16:40.019572  8799 ts_tablet_manager.cc:1434] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:16:40.007745  8784 raft_consensus.cc:515] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.023746  8800 tablet_bootstrap.cc:492] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d: No bootstrap required, opened a new log
I20260709 12:16:40.024410  8802 tablet_bootstrap.cc:492] T 0fa4e6159720456f829d74ec7d29c267 P 8493340c2bd047e59811b953aab2a423: No bootstrap required, opened a new log
I20260709 12:16:40.025311  8802 ts_tablet_manager.cc:1403] T 0fa4e6159720456f829d74ec7d29c267 P 8493340c2bd047e59811b953aab2a423: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.013s
I20260709 12:16:40.025995  8530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d221fd20f747e9bf79da7978e763ff" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:40.024432  8800 ts_tablet_manager.cc:1403] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent bootstrapping tablet: real 0.178s	user 0.006s	sys 0.012s
I20260709 12:16:40.026912  8530 raft_consensus.cc:3060] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:40.031304  8800 raft_consensus.cc:359] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.035068  8800 raft_consensus.cc:385] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:40.035553  8800 raft_consensus.cc:740] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Initialized, Role: FOLLOWER
I20260709 12:16:40.034119  8802 raft_consensus.cc:359] T 0fa4e6159720456f829d74ec7d29c267 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.036482  8802 raft_consensus.cc:385] T 0fa4e6159720456f829d74ec7d29c267 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:40.036841  8802 raft_consensus.cc:740] T 0fa4e6159720456f829d74ec7d29c267 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Initialized, Role: FOLLOWER
I20260709 12:16:40.037632  8802 consensus_queue.cc:260] T 0fa4e6159720456f829d74ec7d29c267 P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.039835  8784 leader_election.cc:290] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 election: Requested vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:40.040805  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d221fd20f747e9bf79da7978e763ff" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:40.041867  8802 ts_tablet_manager.cc:1434] T 0fa4e6159720456f829d74ec7d29c267 P 8493340c2bd047e59811b953aab2a423: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 12:16:40.041621  8530 raft_consensus.cc:2468] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 1.
I20260709 12:16:40.038677  8800 consensus_queue.cc:260] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.043335  8605 raft_consensus.cc:3060] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:40.045164  8800 ts_tablet_manager.cc:1434] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:16:40.046577  8800 tablet_bootstrap.cc:492] T ecead67c5c8446bc9043f981de6e5082 P 301dcdc3ecfe4926a8aa77edc79ab57d: Bootstrap starting.
I20260709 12:16:40.053972  8800 tablet_bootstrap.cc:654] T ecead67c5c8446bc9043f981de6e5082 P 301dcdc3ecfe4926a8aa77edc79ab57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:40.055450  8421 leader_election.cc:304] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:40.056586  8784 raft_consensus.cc:2804] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:40.057152  8784 raft_consensus.cc:697] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 1 LEADER]: Becoming Leader. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Running, Role: LEADER
I20260709 12:16:40.058182  8784 consensus_queue.cc:237] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.067080  8814 raft_consensus.cc:493] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.067816  8814 raft_consensus.cc:515] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.070354  8814 leader_election.cc:290] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:40.073349  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e428f7950e43bc8ee9d4488ca7fd61" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:40.074312  8453 raft_consensus.cc:2468] T a5e428f7950e43bc8ee9d4488ca7fd61 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 0.
I20260709 12:16:40.076398  8498 leader_election.cc:304] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:40.078827  8813 raft_consensus.cc:2804] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:40.079339  8813 raft_consensus.cc:493] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:40.079747  8813 raft_consensus.cc:3060] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:40.082993  8403 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:40.095644  8605 raft_consensus.cc:2468] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 1.
I20260709 12:16:40.105159  8606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e428f7950e43bc8ee9d4488ca7fd61" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:40.106233  8606 raft_consensus.cc:2468] T a5e428f7950e43bc8ee9d4488ca7fd61 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 0.
I20260709 12:16:40.026811  8601 raft_consensus.cc:2468] T e8f63e935ab34e7796d6b269458cfdbe P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 1.
I20260709 12:16:40.125571  8355 catalog_manager.cc:5697] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66). New cstate: current_term: 1 leader_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:40.122975  8353 catalog_manager.cc:5697] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8493340c2bd047e59811b953aab2a423 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "8493340c2bd047e59811b953aab2a423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:40.133685  8813 raft_consensus.cc:515] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.138669  8498 leader_election.cc:304] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 301dcdc3ecfe4926a8aa77edc79ab57d
I20260709 12:16:40.139614  8813 leader_election.cc:290] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:40.140460  8814 raft_consensus.cc:2804] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:40.141918  8800 tablet_bootstrap.cc:492] T ecead67c5c8446bc9043f981de6e5082 P 301dcdc3ecfe4926a8aa77edc79ab57d: No bootstrap required, opened a new log
I20260709 12:16:40.146461  8814 raft_consensus.cc:697] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Becoming Leader. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Running, Role: LEADER
I20260709 12:16:40.147644  8814 consensus_queue.cc:237] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.148363  8800 ts_tablet_manager.cc:1403] T ecead67c5c8446bc9043f981de6e5082 P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent bootstrapping tablet: real 0.102s	user 0.039s	sys 0.030s
I20260709 12:16:40.153165  8800 raft_consensus.cc:359] T ecead67c5c8446bc9043f981de6e5082 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.154316  8800 raft_consensus.cc:385] T ecead67c5c8446bc9043f981de6e5082 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:40.154750  8800 raft_consensus.cc:740] T ecead67c5c8446bc9043f981de6e5082 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Initialized, Role: FOLLOWER
I20260709 12:16:40.155992  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e428f7950e43bc8ee9d4488ca7fd61" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:40.156673  8605 raft_consensus.cc:3060] T a5e428f7950e43bc8ee9d4488ca7fd61 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:40.155665  8352 catalog_manager.cc:5697] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d reported cstate change: term changed from 0 to 1, leader changed from <none> to 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67). New cstate: current_term: 1 leader_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:40.162853  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e428f7950e43bc8ee9d4488ca7fd61" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:40.165827  8456 raft_consensus.cc:3060] T a5e428f7950e43bc8ee9d4488ca7fd61 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:40.170625  8605 raft_consensus.cc:2468] T a5e428f7950e43bc8ee9d4488ca7fd61 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 1.
I20260709 12:16:40.156033  8800 consensus_queue.cc:260] T ecead67c5c8446bc9043f981de6e5082 P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.176786  8800 ts_tablet_manager.cc:1434] T ecead67c5c8446bc9043f981de6e5082 P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.005s
I20260709 12:16:40.178220  8800 tablet_bootstrap.cc:492] T d71d7e9514614a8e80f85267d9a2c39f P 301dcdc3ecfe4926a8aa77edc79ab57d: Bootstrap starting.
I20260709 12:16:40.178925  8456 raft_consensus.cc:2468] T a5e428f7950e43bc8ee9d4488ca7fd61 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 1.
I20260709 12:16:40.183516  8498 leader_election.cc:304] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:40.184688  8814 raft_consensus.cc:2804] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:40.185254  8814 raft_consensus.cc:697] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Becoming Leader. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Running, Role: LEADER
I20260709 12:16:40.186638  8800 tablet_bootstrap.cc:654] T d71d7e9514614a8e80f85267d9a2c39f P 301dcdc3ecfe4926a8aa77edc79ab57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:40.186179  8814 consensus_queue.cc:237] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.188301  8355 catalog_manager.cc:5697] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66). New cstate: current_term: 1 leader_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:40.211416  8788 raft_consensus.cc:493] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.212459  8788 raft_consensus.cc:515] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.212811  8840 raft_consensus.cc:493] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.216667  8840 raft_consensus.cc:515] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.222374  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa4e6159720456f829d74ec7d29c267" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:40.223217  8456 raft_consensus.cc:2468] T 0fa4e6159720456f829d74ec7d29c267 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 0.
I20260709 12:16:40.224004  8788 leader_election.cc:290] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:40.224952  8498 leader_election.cc:304] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:40.225288  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71d7e9514614a8e80f85267d9a2c39f" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:40.225991  8813 raft_consensus.cc:2804] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:40.226426  8813 raft_consensus.cc:493] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:40.226792  8813 raft_consensus.cc:3060] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:40.226948  8421 leader_election.cc:343] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:40.245616  8783 consensus_queue.cc:1048] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:40.246073  8840 leader_election.cc:290] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:40.246029  8352 catalog_manager.cc:5697] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66). New cstate: current_term: 1 leader_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:40.248677  8820 consensus_queue.cc:1048] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:16:40.223083  8496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.179.67:46857, user_credentials={real_user=slave}} blocked reactor thread for 47902.9us
I20260709 12:16:40.256062  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71d7e9514614a8e80f85267d9a2c39f" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:40.256873  8527 raft_consensus.cc:2468] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 0.
I20260709 12:16:40.258862  8815 consensus_queue.cc:1048] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:40.258014  8813 raft_consensus.cc:515] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.261636  8421 leader_election.cc:304] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 301dcdc3ecfe4926a8aa77edc79ab57d
I20260709 12:16:40.263062  8784 raft_consensus.cc:2804] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:40.263015  8601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa4e6159720456f829d74ec7d29c267" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" is_pre_election: true
I20260709 12:16:40.265971  8813 leader_election.cc:290] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:40.266675  8454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa4e6159720456f829d74ec7d29c267" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:40.266791  8784 raft_consensus.cc:493] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:40.268515  8601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa4e6159720456f829d74ec7d29c267" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:40.274854  8454 raft_consensus.cc:3060] T 0fa4e6159720456f829d74ec7d29c267 P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:40.274902  8784 raft_consensus.cc:3060] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:40.270907  8496 leader_election.cc:343] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:40.287914  8496 leader_election.cc:343] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:40.288497  8800 tablet_bootstrap.cc:492] T d71d7e9514614a8e80f85267d9a2c39f P 301dcdc3ecfe4926a8aa77edc79ab57d: No bootstrap required, opened a new log
I20260709 12:16:40.290259  8454 raft_consensus.cc:2468] T 0fa4e6159720456f829d74ec7d29c267 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 1.
I20260709 12:16:40.291863  8800 ts_tablet_manager.cc:1403] T d71d7e9514614a8e80f85267d9a2c39f P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent bootstrapping tablet: real 0.114s	user 0.017s	sys 0.032s
I20260709 12:16:40.290552  8783 consensus_queue.cc:1048] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:40.296654  8498 leader_election.cc:304] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 301dcdc3ecfe4926a8aa77edc79ab57d
I20260709 12:16:40.300194  8800 raft_consensus.cc:359] T d71d7e9514614a8e80f85267d9a2c39f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.301033  8800 raft_consensus.cc:385] T d71d7e9514614a8e80f85267d9a2c39f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:40.301302  8800 raft_consensus.cc:740] T d71d7e9514614a8e80f85267d9a2c39f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Initialized, Role: FOLLOWER
I20260709 12:16:40.302049  8800 consensus_queue.cc:260] T d71d7e9514614a8e80f85267d9a2c39f P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.304492  8800 ts_tablet_manager.cc:1434] T d71d7e9514614a8e80f85267d9a2c39f P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:16:40.305588  8800 tablet_bootstrap.cc:492] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d: Bootstrap starting.
I20260709 12:16:40.310945  8784 raft_consensus.cc:515] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.312839  8800 tablet_bootstrap.cc:654] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:40.313134  8813 raft_consensus.cc:2804] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:40.313997  8784 leader_election.cc:290] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 election: Requested vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:40.315457  8601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71d7e9514614a8e80f85267d9a2c39f" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:40.316196  8601 raft_consensus.cc:3060] T d71d7e9514614a8e80f85267d9a2c39f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:40.334182  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71d7e9514614a8e80f85267d9a2c39f" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:40.335217  8527 raft_consensus.cc:3060] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:40.325426  8813 raft_consensus.cc:697] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Becoming Leader. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Running, Role: LEADER
I20260709 12:16:40.366593  8813 consensus_queue.cc:237] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.371968  8601 raft_consensus.cc:2468] T d71d7e9514614a8e80f85267d9a2c39f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 1.
I20260709 12:16:40.372851  8800 tablet_bootstrap.cc:492] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d: No bootstrap required, opened a new log
I20260709 12:16:40.373467  8800 ts_tablet_manager.cc:1403] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent bootstrapping tablet: real 0.068s	user 0.029s	sys 0.025s
I20260709 12:16:40.374687  8421 leader_election.cc:304] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:40.375654  8784 raft_consensus.cc:2804] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:40.376308  8784 raft_consensus.cc:697] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [term 1 LEADER]: Becoming Leader. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Running, Role: LEADER
I20260709 12:16:40.377200  8784 consensus_queue.cc:237] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.386757  8527 raft_consensus.cc:2468] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 1.
I20260709 12:16:40.391865  8800 raft_consensus.cc:359] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.396129  8800 raft_consensus.cc:385] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:40.396989  8800 raft_consensus.cc:740] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Initialized, Role: FOLLOWER
I20260709 12:16:40.400147  8800 consensus_queue.cc:260] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.409659  8800 ts_tablet_manager.cc:1434] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.004s
I20260709 12:16:40.412134  8783 consensus_queue.cc:1048] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:40.419659  8352 catalog_manager.cc:5697] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66). New cstate: current_term: 1 leader_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:40.424355  8355 catalog_manager.cc:5697] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8493340c2bd047e59811b953aab2a423 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "8493340c2bd047e59811b953aab2a423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:40.438431  8840 consensus_queue.cc:1048] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:40.448540  8858 consensus_queue.cc:1048] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:40.478694  8840 consensus_queue.cc:1048] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:40.540275  8858 raft_consensus.cc:493] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.540956  8858 raft_consensus.cc:515] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.544458  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa4e6159720456f829d74ec7d29c267" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:40.545563  8456 raft_consensus.cc:2393] T 0fa4e6159720456f829d74ec7d29c267 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 301dcdc3ecfe4926a8aa77edc79ab57d in current term 1: Already voted for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in this term.
I20260709 12:16:40.545608  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa4e6159720456f829d74ec7d29c267" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:40.547631  8570 leader_election.cc:304] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d; no voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423
I20260709 12:16:40.548631  8815 raft_consensus.cc:3060] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:40.555429  8858 leader_election.cc:290] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:40.560820  8815 raft_consensus.cc:2749] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:40.570328  8605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edcac3e9bdff42ecb15bc6d821dc4ee3"
dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
mode: GRACEFUL
new_leader_uuid: "8493340c2bd047e59811b953aab2a423"
 from {username='slave'} at 127.0.0.1:41404
I20260709 12:16:40.571213  8605 raft_consensus.cc:606] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Received request to transfer leadership to TS 8493340c2bd047e59811b953aab2a423
I20260709 12:16:40.577346  8605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3f75420696a42e48efef4fb251b75d1"
dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
mode: GRACEFUL
new_leader_uuid: "8493340c2bd047e59811b953aab2a423"
 from {username='slave'} at 127.0.0.1:41404
I20260709 12:16:40.578090  8605 raft_consensus.cc:606] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Received request to transfer leadership to TS 8493340c2bd047e59811b953aab2a423
I20260709 12:16:40.584673  8605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7af81e2425b04f18ada1ee59599705f9"
dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
mode: GRACEFUL
new_leader_uuid: "8493340c2bd047e59811b953aab2a423"
 from {username='slave'} at 127.0.0.1:41404
I20260709 12:16:40.585459  8605 raft_consensus.cc:606] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Received request to transfer leadership to TS 8493340c2bd047e59811b953aab2a423
I20260709 12:16:40.587564  8815 raft_consensus.cc:493] T ecead67c5c8446bc9043f981de6e5082 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:40.588284  8815 raft_consensus.cc:515] T ecead67c5c8446bc9043f981de6e5082 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.591710  8815 leader_election.cc:290] T ecead67c5c8446bc9043f981de6e5082 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:40.591964  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecead67c5c8446bc9043f981de6e5082" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" is_pre_election: true
I20260709 12:16:40.593585  8530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8f63e935ab34e7796d6b269458cfdbe"
dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
mode: GRACEFUL
new_leader_uuid: "8493340c2bd047e59811b953aab2a423"
 from {username='slave'} at 127.0.0.1:40000
I20260709 12:16:40.594422  8530 raft_consensus.cc:606] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Received request to transfer leadership to TS 8493340c2bd047e59811b953aab2a423
I20260709 12:16:40.594671  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecead67c5c8446bc9043f981de6e5082" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8493340c2bd047e59811b953aab2a423" is_pre_election: true
I20260709 12:16:40.595587  8456 raft_consensus.cc:2393] T ecead67c5c8446bc9043f981de6e5082 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 301dcdc3ecfe4926a8aa77edc79ab57d in current term 1: Already voted for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in this term.
I20260709 12:16:40.596788  8572 leader_election.cc:304] T ecead67c5c8446bc9043f981de6e5082 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d; no voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423
I20260709 12:16:40.598187  8815 raft_consensus.cc:3060] T ecead67c5c8446bc9043f981de6e5082 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:40.609494  8815 raft_consensus.cc:2749] T ecead67c5c8446bc9043f981de6e5082 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:40.621090  8784 consensus_queue.cc:1048] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:40.621687  8456 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1d221fd20f747e9bf79da7978e763ff"
dest_uuid: "8493340c2bd047e59811b953aab2a423"
mode: GRACEFUL
new_leader_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
 from {username='slave'} at 127.0.0.1:46230
I20260709 12:16:40.622725  8456 raft_consensus.cc:606] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 1 LEADER]: Received request to transfer leadership to TS 4f56aad176e14cf4a2ae5e90c249aa2f
I20260709 12:16:40.636438  8846 raft_consensus.cc:993] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423: : Instructing follower 4f56aad176e14cf4a2ae5e90c249aa2f to start an election
I20260709 12:16:40.637061  8784 raft_consensus.cc:1081] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 1 LEADER]: Signalling peer 4f56aad176e14cf4a2ae5e90c249aa2f to start an election
I20260709 12:16:40.643289  8456 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d71d7e9514614a8e80f85267d9a2c39f"
dest_uuid: "8493340c2bd047e59811b953aab2a423"
mode: GRACEFUL
new_leader_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
 from {username='slave'} at 127.0.0.1:46230
I20260709 12:16:40.644165  8456 raft_consensus.cc:606] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [term 1 LEADER]: Received request to transfer leadership to TS 4f56aad176e14cf4a2ae5e90c249aa2f
I20260709 12:16:40.648815  8784 consensus_queue.cc:1048] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:40.654748  8527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1d221fd20f747e9bf79da7978e763ff"
dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
 from {username='slave'} at 127.0.0.1:39984
I20260709 12:16:40.660768  8813 consensus_queue.cc:1048] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:40.679539  8813 consensus_queue.cc:1048] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:40.682250  8858 raft_consensus.cc:993] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d: : Instructing follower 8493340c2bd047e59811b953aab2a423 to start an election
I20260709 12:16:40.683127  8858 raft_consensus.cc:1081] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Signalling peer 8493340c2bd047e59811b953aab2a423 to start an election
I20260709 12:16:40.686182  8527 raft_consensus.cc:493] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:40.686913  8527 raft_consensus.cc:3060] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:40.688009  8453 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edcac3e9bdff42ecb15bc6d821dc4ee3"
dest_uuid: "8493340c2bd047e59811b953aab2a423"
 from {username='slave'} at 127.0.0.1:59560
I20260709 12:16:40.688773  8453 raft_consensus.cc:493] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:40.689199  8453 raft_consensus.cc:3060] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:40.692767  8814 consensus_queue.cc:1048] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:40.714771  8531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fa4e6159720456f829d74ec7d29c267"
dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
mode: GRACEFUL
new_leader_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
 from {username='slave'} at 127.0.0.1:40000
I20260709 12:16:40.715525  8531 raft_consensus.cc:606] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Received request to transfer leadership to TS 301dcdc3ecfe4926a8aa77edc79ab57d
I20260709 12:16:40.714301  8453 raft_consensus.cc:515] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.726346  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcac3e9bdff42ecb15bc6d821dc4ee3" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:40.726696  8453 leader_election.cc:290] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 2 election: Requested vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:40.727069  8528 raft_consensus.cc:3060] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:40.732326  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edcac3e9bdff42ecb15bc6d821dc4ee3" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:40.733093  8605 raft_consensus.cc:3055] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:40.733426  8605 raft_consensus.cc:740] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Running, Role: LEADER
I20260709 12:16:40.735984  8528 raft_consensus.cc:2468] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 2.
I20260709 12:16:40.741559  8421 leader_election.cc:304] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:40.743145  8814 consensus_queue.cc:1048] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:40.745589  8784 raft_consensus.cc:2804] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:40.746189  8784 raft_consensus.cc:697] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423 [term 2 LEADER]: Becoming Leader. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Running, Role: LEADER
I20260709 12:16:40.747193  8784 consensus_queue.cc:237] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.751015  8527 raft_consensus.cc:515] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.763135  8840 consensus_queue.cc:1048] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:40.734325  8605 consensus_queue.cc:260] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.771571  8813 consensus_queue.cc:1048] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:40.783509  8870 raft_consensus.cc:993] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f: : Instructing follower 301dcdc3ecfe4926a8aa77edc79ab57d to start an election
I20260709 12:16:40.784078  8814 raft_consensus.cc:1081] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Signalling peer 301dcdc3ecfe4926a8aa77edc79ab57d to start an election
I20260709 12:16:40.790671  8601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fa4e6159720456f829d74ec7d29c267"
dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
 from {username='slave'} at 127.0.0.1:41392
I20260709 12:16:40.791342  8601 raft_consensus.cc:493] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:40.791736  8601 raft_consensus.cc:3060] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:40.771512  8605 raft_consensus.cc:3060] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:40.815378  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d221fd20f747e9bf79da7978e763ff" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:40.816198  8453 raft_consensus.cc:3055] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:40.816509  8453 raft_consensus.cc:740] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Running, Role: LEADER
I20260709 12:16:40.817368  8453 consensus_queue.cc:260] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.818581  8453 raft_consensus.cc:3060] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:40.818881  8601 raft_consensus.cc:515] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.819447  8606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d221fd20f747e9bf79da7978e763ff" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:40.820384  8606 raft_consensus.cc:3060] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:40.821492  8601 leader_election.cc:290] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 2 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:40.823405  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa4e6159720456f829d74ec7d29c267" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:40.824640  8605 raft_consensus.cc:2468] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 2.
I20260709 12:16:40.827317  8352 catalog_manager.cc:5697] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423 reported cstate change: term changed from 1 to 2, leader changed from 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67) to 8493340c2bd047e59811b953aab2a423 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "8493340c2bd047e59811b953aab2a423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:40.831772  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa4e6159720456f829d74ec7d29c267" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:40.832526  8528 raft_consensus.cc:3055] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:40.832823  8528 raft_consensus.cc:740] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Running, Role: LEADER
I20260709 12:16:40.833621  8528 consensus_queue.cc:260] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.834801  8528 raft_consensus.cc:3060] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:40.830099  8606 raft_consensus.cc:2468] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 2.
I20260709 12:16:40.839341  8496 leader_election.cc:304] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 
I20260709 12:16:40.840606  8813 raft_consensus.cc:2804] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:40.841178  8813 raft_consensus.cc:697] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Becoming Leader. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Running, Role: LEADER
I20260709 12:16:40.842132  8813 consensus_queue.cc:237] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.843313  8528 raft_consensus.cc:2468] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 2.
I20260709 12:16:40.844769  8570 leader_election.cc:304] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 8493340c2bd047e59811b953aab2a423
I20260709 12:16:40.845718  8820 raft_consensus.cc:2804] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:40.846211  8820 raft_consensus.cc:697] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 LEADER]: Becoming Leader. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Running, Role: LEADER
I20260709 12:16:40.847105  8820 consensus_queue.cc:237] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.815490  8527 leader_election.cc:290] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 2 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:40.855681  8352 catalog_manager.cc:5697] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f reported cstate change: term changed from 1 to 2, leader changed from 8493340c2bd047e59811b953aab2a423 (127.24.179.65) to 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66). New cstate: current_term: 2 leader_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:40.859202  8453 raft_consensus.cc:2468] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 2.
I20260709 12:16:40.858053  8354 catalog_manager.cc:5697] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d reported cstate change: term changed from 1 to 2, leader changed from 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66) to 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67). New cstate: current_term: 2 leader_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:40.867044  8784 consensus_queue.cc:1048] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:40.887305  8784 consensus_queue.cc:1048] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:40.903175  8788 raft_consensus.cc:993] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423: : Instructing follower 4f56aad176e14cf4a2ae5e90c249aa2f to start an election
I20260709 12:16:40.903695  8788 raft_consensus.cc:1081] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [term 1 LEADER]: Signalling peer 4f56aad176e14cf4a2ae5e90c249aa2f to start an election
I20260709 12:16:40.905813  8527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d71d7e9514614a8e80f85267d9a2c39f"
dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
 from {username='slave'} at 127.0.0.1:39984
I20260709 12:16:40.906590  8527 raft_consensus.cc:493] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:40.907066  8527 raft_consensus.cc:3060] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:40.914170  8527 raft_consensus.cc:515] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.916328  8527 leader_election.cc:290] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 2 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:40.917228  8453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71d7e9514614a8e80f85267d9a2c39f" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:40.917963  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71d7e9514614a8e80f85267d9a2c39f" candidate_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:40.918016  8453 raft_consensus.cc:3055] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:40.918619  8453 raft_consensus.cc:740] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Running, Role: LEADER
I20260709 12:16:40.918637  8605 raft_consensus.cc:3060] T d71d7e9514614a8e80f85267d9a2c39f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:40.919667  8453 consensus_queue.cc:260] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.921254  8453 raft_consensus.cc:3060] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:40.926944  8605 raft_consensus.cc:2468] T d71d7e9514614a8e80f85267d9a2c39f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 2.
I20260709 12:16:40.928453  8496 leader_election.cc:304] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 
I20260709 12:16:40.929493  8813 raft_consensus.cc:2804] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:40.930160  8813 raft_consensus.cc:697] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Becoming Leader. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Running, Role: LEADER
I20260709 12:16:40.931201  8813 consensus_queue.cc:237] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.936463  8453 raft_consensus.cc:2468] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f56aad176e14cf4a2ae5e90c249aa2f in term 2.
I20260709 12:16:40.941222  8351 catalog_manager.cc:5697] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f reported cstate change: term changed from 1 to 2, leader changed from 8493340c2bd047e59811b953aab2a423 (127.24.179.65) to 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66). New cstate: current_term: 2 leader_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:40.955089  8815 raft_consensus.cc:993] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d: : Instructing follower 8493340c2bd047e59811b953aab2a423 to start an election
I20260709 12:16:40.955682  8820 raft_consensus.cc:1081] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Signalling peer 8493340c2bd047e59811b953aab2a423 to start an election
I20260709 12:16:40.957901  8453 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7af81e2425b04f18ada1ee59599705f9"
dest_uuid: "8493340c2bd047e59811b953aab2a423"
 from {username='slave'} at 127.0.0.1:59560
I20260709 12:16:40.958707  8453 raft_consensus.cc:493] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:40.959147  8453 raft_consensus.cc:3060] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:40.968402  8453 raft_consensus.cc:515] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.970837  8453 leader_election.cc:290] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 2 election: Requested vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:40.971860  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af81e2425b04f18ada1ee59599705f9" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:40.972177  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af81e2425b04f18ada1ee59599705f9" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:40.972790  8527 raft_consensus.cc:3060] T 7af81e2425b04f18ada1ee59599705f9 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:40.972877  8605 raft_consensus.cc:3055] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:40.974608  8605 raft_consensus.cc:740] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Running, Role: LEADER
I20260709 12:16:40.976238  8605 consensus_queue.cc:260] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.978567  8605 raft_consensus.cc:3060] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:40.982071  8527 raft_consensus.cc:2468] T 7af81e2425b04f18ada1ee59599705f9 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 2.
I20260709 12:16:40.983472  8421 leader_election.cc:304] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f56aad176e14cf4a2ae5e90c249aa2f, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:40.984549  8784 raft_consensus.cc:2804] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:40.985358  8784 raft_consensus.cc:697] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423 [term 2 LEADER]: Becoming Leader. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Running, Role: LEADER
I20260709 12:16:40.986330  8784 consensus_queue.cc:237] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:40.988734  8605 raft_consensus.cc:2468] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 2.
I20260709 12:16:40.995695  8351 catalog_manager.cc:5697] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423 reported cstate change: term changed from 1 to 2, leader changed from 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67) to 8493340c2bd047e59811b953aab2a423 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "8493340c2bd047e59811b953aab2a423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:41.036625  8820 raft_consensus.cc:993] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d: : Instructing follower 8493340c2bd047e59811b953aab2a423 to start an election
I20260709 12:16:41.037259  8783 raft_consensus.cc:1081] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Signalling peer 8493340c2bd047e59811b953aab2a423 to start an election
I20260709 12:16:41.040096  8453 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3f75420696a42e48efef4fb251b75d1"
dest_uuid: "8493340c2bd047e59811b953aab2a423"
 from {username='slave'} at 127.0.0.1:59560
I20260709 12:16:41.041891  8813 raft_consensus.cc:993] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f: : Instructing follower 8493340c2bd047e59811b953aab2a423 to start an election
I20260709 12:16:41.042068  8453 raft_consensus.cc:493] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:41.046816  8813 raft_consensus.cc:1081] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Signalling peer 8493340c2bd047e59811b953aab2a423 to start an election
I20260709 12:16:41.047101  8453 raft_consensus.cc:3060] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:41.048895  8454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8f63e935ab34e7796d6b269458cfdbe"
dest_uuid: "8493340c2bd047e59811b953aab2a423"
 from {username='slave'} at 127.0.0.1:59570
I20260709 12:16:41.049605  8454 raft_consensus.cc:493] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:41.049998  8454 raft_consensus.cc:3060] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:41.056661  8453 raft_consensus.cc:515] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:41.058969  8454 raft_consensus.cc:515] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:41.059381  8453 leader_election.cc:290] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 2 election: Requested vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:41.060760  8605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f75420696a42e48efef4fb251b75d1" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:41.061292  8454 leader_election.cc:290] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 2 election: Requested vote from peers 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773), 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67:46857)
I20260709 12:16:41.061477  8605 raft_consensus.cc:3055] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:41.061822  8605 raft_consensus.cc:740] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Running, Role: LEADER
I20260709 12:16:41.062652  8605 consensus_queue.cc:260] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:41.062929  8606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f63e935ab34e7796d6b269458cfdbe" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
I20260709 12:16:41.063735  8606 raft_consensus.cc:3060] T e8f63e935ab34e7796d6b269458cfdbe P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:41.063814  8605 raft_consensus.cc:3060] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:41.066958  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f63e935ab34e7796d6b269458cfdbe" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:41.067859  8528 raft_consensus.cc:3055] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:41.068204  8528 raft_consensus.cc:740] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Running, Role: LEADER
I20260709 12:16:41.066958  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f75420696a42e48efef4fb251b75d1" candidate_uuid: "8493340c2bd047e59811b953aab2a423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:41.069099  8528 consensus_queue.cc:260] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:41.070914  8528 raft_consensus.cc:3060] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:41.074066  8606 raft_consensus.cc:2468] T e8f63e935ab34e7796d6b269458cfdbe P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 2.
I20260709 12:16:41.074821  8605 raft_consensus.cc:2468] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 2.
I20260709 12:16:41.069130  8527 raft_consensus.cc:3060] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:41.075811  8421 leader_election.cc:304] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:41.077208  8421 leader_election.cc:304] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:41.078239  8784 raft_consensus.cc:2804] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:41.078794  8784 raft_consensus.cc:697] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423 [term 2 LEADER]: Becoming Leader. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Running, Role: LEADER
I20260709 12:16:41.078796  8528 raft_consensus.cc:2468] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 2.
I20260709 12:16:41.080021  8784 consensus_queue.cc:237] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:41.082439  8788 raft_consensus.cc:2804] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:41.096204  8527 raft_consensus.cc:2468] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8493340c2bd047e59811b953aab2a423 in term 2.
I20260709 12:16:41.103798  8788 raft_consensus.cc:697] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [term 2 LEADER]: Becoming Leader. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Running, Role: LEADER
I20260709 12:16:41.105161  8788 consensus_queue.cc:237] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:41.117126  8351 catalog_manager.cc:5697] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423 reported cstate change: term changed from 1 to 2, leader changed from 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66) to 8493340c2bd047e59811b953aab2a423 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "8493340c2bd047e59811b953aab2a423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:41.119388  8351 catalog_manager.cc:5697] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 reported cstate change: term changed from 1 to 2, leader changed from 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67) to 8493340c2bd047e59811b953aab2a423 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "8493340c2bd047e59811b953aab2a423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:41.241223  8453 raft_consensus.cc:1275] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Refusing update from remote peer 4f56aad176e14cf4a2ae5e90c249aa2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:41.242988  8813 consensus_queue.cc:1048] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:41.256531  8606 raft_consensus.cc:1275] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Refusing update from remote peer 4f56aad176e14cf4a2ae5e90c249aa2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:41.259615  8840 consensus_queue.cc:1048] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:41.266269  8453 raft_consensus.cc:3060] T 0fa4e6159720456f829d74ec7d29c267 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:41.277354  8453 raft_consensus.cc:1275] T 0fa4e6159720456f829d74ec7d29c267 P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Refusing update from remote peer 301dcdc3ecfe4926a8aa77edc79ab57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:41.279035  8820 consensus_queue.cc:1048] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:41.292230  8527 raft_consensus.cc:1275] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Refusing update from remote peer 301dcdc3ecfe4926a8aa77edc79ab57d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:41.295868  8815 consensus_queue.cc:1048] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:41.301329  8606 raft_consensus.cc:1275] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Refusing update from remote peer 8493340c2bd047e59811b953aab2a423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:41.307515  8876 consensus_queue.cc:1048] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:41.318096  8528 raft_consensus.cc:1275] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Refusing update from remote peer 8493340c2bd047e59811b953aab2a423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:41.322628  8846 consensus_queue.cc:1048] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:41.328756  8453 raft_consensus.cc:1275] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Refusing update from remote peer 4f56aad176e14cf4a2ae5e90c249aa2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:41.333168  8840 consensus_queue.cc:1048] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:41.350142  8606 raft_consensus.cc:1275] T d71d7e9514614a8e80f85267d9a2c39f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Refusing update from remote peer 4f56aad176e14cf4a2ae5e90c249aa2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:41.358537  8813 consensus_queue.cc:1048] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:41.538704  8527 raft_consensus.cc:1275] T 7af81e2425b04f18ada1ee59599705f9 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Refusing update from remote peer 8493340c2bd047e59811b953aab2a423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:41.540388  8846 consensus_queue.cc:1048] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:41.554664  8606 raft_consensus.cc:1275] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Refusing update from remote peer 8493340c2bd047e59811b953aab2a423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:41.557886  8788 consensus_queue.cc:1048] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:41.573884  8527 raft_consensus.cc:1275] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Refusing update from remote peer 8493340c2bd047e59811b953aab2a423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:41.637749  8527 raft_consensus.cc:1275] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Refusing update from remote peer 8493340c2bd047e59811b953aab2a423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:41.631958  8784 consensus_queue.cc:1048] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:16:41.658607  8605 raft_consensus.cc:1275] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Refusing update from remote peer 8493340c2bd047e59811b953aab2a423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:41.666261  8784 consensus_queue.cc:1048] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:16:41.668556  8788 consensus_queue.cc:1048] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:41.674543  8606 raft_consensus.cc:1275] T e8f63e935ab34e7796d6b269458cfdbe P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Refusing update from remote peer 8493340c2bd047e59811b953aab2a423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:41.677713  8788 consensus_queue.cc:1048] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:43.721235  8351 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46038:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:16:43.748122  8351 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46038:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:16:43.775439 25293 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:16:43.971715  8910 log.cc:927] Time spent T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f: Append to log took a long time: real 0.092s	user 0.002s	sys 0.000s
W20260709 12:16:43.972129  8907 log.cc:927] Time spent T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:16:44.105373  8934 tablet.cc:1724] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.128968  8942 tablet.cc:1724] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.096045  8935 tablet.cc:1724] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.151818  8933 tablet.cc:1724] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.165292  8937 tablet.cc:1724] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:16:44.194092  8926 log.cc:927] Time spent T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 12:16:44.214347  8932 log.cc:927] Time spent T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
I20260709 12:16:44.213541  8940 tablet.cc:1724] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:16:44.224375  8632 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:0fa4e6159720456f829d74ec7d29c267)
W20260709 12:16:44.225769  8632 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:0fa4e6159720456f829d74ec7d29c267)
I20260709 12:16:44.250579  8455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3f75420696a42e48efef4fb251b75d1"
dest_uuid: "8493340c2bd047e59811b953aab2a423"
mode: GRACEFUL
new_leader_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
 from {username='slave'} at 127.0.0.1:46236
W20260709 12:16:44.250712  8558 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:0fa4e6159720456f829d74ec7d29c267)
I20260709 12:16:44.251603  8455 raft_consensus.cc:606] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [term 2 LEADER]: Received request to transfer leadership to TS 301dcdc3ecfe4926a8aa77edc79ab57d
I20260709 12:16:44.287281  8950 tablet.cc:1724] T a5e428f7950e43bc8ee9d4488ca7fd61 P 8493340c2bd047e59811b953aab2a423: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.290769  8934 tablet.cc:1724] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.219570  8946 tablet.cc:1724] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.289227  8949 tablet.cc:1724] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.313059  8959 tablet.cc:1724] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:16:44.317732  8421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:46857, user_credentials={real_user=slave}} blocked reactor thread for 58774us
I20260709 12:16:44.326102  8351 catalog_manager.cc:5789] TS 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773) does not have the latest schema for tablet a5e428f7950e43bc8ee9d4488ca7fd61 (table soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]). Expected version 1 got 0
I20260709 12:16:44.346760  8954 tablet.cc:1724] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 4f56aad176e14cf4a2ae5e90c249aa2f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.349093  8935 tablet.cc:1724] T 0fa4e6159720456f829d74ec7d29c267 P 8493340c2bd047e59811b953aab2a423: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.293819  8942 tablet.cc:1724] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.359365  8956 tablet.cc:1724] T a5e428f7950e43bc8ee9d4488ca7fd61 P 301dcdc3ecfe4926a8aa77edc79ab57d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.365024  8940 tablet.cc:1724] T ecead67c5c8446bc9043f981de6e5082 P 8493340c2bd047e59811b953aab2a423: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.366564  8351 catalog_manager.cc:5789] TS 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773) does not have the latest schema for tablet ecead67c5c8446bc9043f981de6e5082 (table soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]). Expected version 1 got 0
I20260709 12:16:44.371528  8351 catalog_manager.cc:5789] TS 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773) does not have the latest schema for tablet c1d221fd20f747e9bf79da7978e763ff (table soft_deleted_table [id=0861e1b6de6e443ba34353289648629a]). Expected version 1 got 0
I20260709 12:16:44.377530  8934 tablet.cc:1724] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.391701  8934 tablet.cc:1724] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.406373  8937 tablet.cc:1724] T d71d7e9514614a8e80f85267d9a2c39f P 301dcdc3ecfe4926a8aa77edc79ab57d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.412104  8949 tablet.cc:1724] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.423403  8528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1d221fd20f747e9bf79da7978e763ff"
dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
mode: GRACEFUL
new_leader_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
 from {username='slave'} at 127.0.0.1:33618
I20260709 12:16:44.424327  8528 raft_consensus.cc:606] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Received request to transfer leadership to TS 301dcdc3ecfe4926a8aa77edc79ab57d
I20260709 12:16:44.426433 25293 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:16:44.427188 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:44.431003  8933 tablet.cc:1724] T ecead67c5c8446bc9043f981de6e5082 P 301dcdc3ecfe4926a8aa77edc79ab57d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.434125  8937 tablet.cc:1724] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.448762  8457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e5a1692f6114807a5fc8c204c9ab5db"
dest_uuid: "8493340c2bd047e59811b953aab2a423"
mode: GRACEFUL
new_leader_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
 from {username='slave'} at 127.0.0.1:46236
I20260709 12:16:44.449640  8457 raft_consensus.cc:606] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 2 LEADER]: Received request to transfer leadership to TS 301dcdc3ecfe4926a8aa77edc79ab57d
I20260709 12:16:44.450788  8935 tablet.cc:1724] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.466113  8528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb9579a1ccb946368d94695df25d838f"
dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
mode: GRACEFUL
new_leader_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
 from {username='slave'} at 127.0.0.1:33618
I20260709 12:16:44.465972  8950 tablet.cc:1724] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.466866  8528 raft_consensus.cc:606] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Received request to transfer leadership to TS 301dcdc3ecfe4926a8aa77edc79ab57d
I20260709 12:16:44.468241  8956 tablet.cc:1724] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.480625  8933 tablet.cc:1724] T e8f63e935ab34e7796d6b269458cfdbe P 301dcdc3ecfe4926a8aa77edc79ab57d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.484225 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:16:44.488305 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:44.501494  8942 tablet.cc:1724] T 7af81e2425b04f18ada1ee59599705f9 P 4f56aad176e14cf4a2ae5e90c249aa2f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:44.503288  8917 raft_consensus.cc:993] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423: : Instructing follower 301dcdc3ecfe4926a8aa77edc79ab57d to start an election
I20260709 12:16:44.503927  8917 raft_consensus.cc:1081] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [term 2 LEADER]: Signalling peer 301dcdc3ecfe4926a8aa77edc79ab57d to start an election
I20260709 12:16:44.510223  8606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3f75420696a42e48efef4fb251b75d1"
dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
 from {username='slave'} at 127.0.0.1:41378
I20260709 12:16:44.510986  8606 raft_consensus.cc:493] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:44.511404  8606 raft_consensus.cc:3060] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:44.522114  8606 raft_consensus.cc:515] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:44.525350  8606 leader_election.cc:290] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 3 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:44.525799  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f75420696a42e48efef4fb251b75d1" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:44.526710  8457 raft_consensus.cc:3055] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:44.527094  8457 raft_consensus.cc:740] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Running, Role: LEADER
I20260709 12:16:44.527094  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f75420696a42e48efef4fb251b75d1" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:44.527878  8527 raft_consensus.cc:3060] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:44.528245  8457 consensus_queue.cc:260] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:44.530418  8457 raft_consensus.cc:3060] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:44.534745  8527 raft_consensus.cc:2468] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 3.
I20260709 12:16:44.536553  8570 leader_election.cc:304] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 
I20260709 12:16:44.537609  8927 raft_consensus.cc:2804] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:44.538122  8927 raft_consensus.cc:697] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 LEADER]: Becoming Leader. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Running, Role: LEADER
I20260709 12:16:44.539269  8927 consensus_queue.cc:237] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:44.539794  8457 raft_consensus.cc:2468] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 3.
I20260709 12:16:44.542438  8354 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7: soft_deleted_table [id=0861e1b6de6e443ba34353289648629a] alter complete (version 1)
I20260709 12:16:44.551688  8352 catalog_manager.cc:5697] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d reported cstate change: term changed from 2 to 3, leader changed from 8493340c2bd047e59811b953aab2a423 (127.24.179.65) to 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67). New cstate: current_term: 3 leader_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:44.629551  8912 raft_consensus.cc:993] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f: : Instructing follower 301dcdc3ecfe4926a8aa77edc79ab57d to start an election
I20260709 12:16:44.630187  8870 raft_consensus.cc:1081] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Signalling peer 301dcdc3ecfe4926a8aa77edc79ab57d to start an election
I20260709 12:16:44.631882  8606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb9579a1ccb946368d94695df25d838f"
dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
 from {username='slave'} at 127.0.0.1:41392
I20260709 12:16:44.632447  8606 raft_consensus.cc:493] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:44.632820  8606 raft_consensus.cc:3060] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:44.638965  8606 raft_consensus.cc:515] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:44.640892  8606 leader_election.cc:290] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 3 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:44.641867  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9579a1ccb946368d94695df25d838f" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:44.642225  8527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9579a1ccb946368d94695df25d838f" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:44.642742  8457 raft_consensus.cc:3060] T cb9579a1ccb946368d94695df25d838f P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:44.642858  8527 raft_consensus.cc:3055] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:44.643313  8527 raft_consensus.cc:740] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Running, Role: LEADER
I20260709 12:16:44.644330  8527 consensus_queue.cc:260] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:44.645860  8527 raft_consensus.cc:3060] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:44.651969  8457 raft_consensus.cc:2468] T cb9579a1ccb946368d94695df25d838f P 8493340c2bd047e59811b953aab2a423 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 3.
I20260709 12:16:44.653550  8572 leader_election.cc:304] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:44.655174  8885 raft_consensus.cc:2804] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:44.655793  8885 raft_consensus.cc:697] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 LEADER]: Becoming Leader. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Running, Role: LEADER
I20260709 12:16:44.656401  8527 raft_consensus.cc:2468] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 3.
I20260709 12:16:44.657074  8885 consensus_queue.cc:237] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:44.666736  8352 catalog_manager.cc:5697] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d reported cstate change: term changed from 2 to 3, leader changed from 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66) to 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67). New cstate: current_term: 3 leader_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:44.787410  8912 raft_consensus.cc:993] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f: : Instructing follower 301dcdc3ecfe4926a8aa77edc79ab57d to start an election
I20260709 12:16:44.787948  8870 raft_consensus.cc:1081] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Signalling peer 301dcdc3ecfe4926a8aa77edc79ab57d to start an election
I20260709 12:16:44.789595  8606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1d221fd20f747e9bf79da7978e763ff"
dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
 from {username='slave'} at 127.0.0.1:41392
I20260709 12:16:44.790144  8606 raft_consensus.cc:493] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:44.790496  8606 raft_consensus.cc:3060] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:44.797435  8606 raft_consensus.cc:515] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:44.799300  8606 leader_election.cc:290] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 3 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:44.800119  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d221fd20f747e9bf79da7978e763ff" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:44.800307  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d221fd20f747e9bf79da7978e763ff" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:44.800851  8457 raft_consensus.cc:3060] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:44.800976  8528 raft_consensus.cc:3055] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:44.801388  8528 raft_consensus.cc:740] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f56aad176e14cf4a2ae5e90c249aa2f, State: Running, Role: LEADER
I20260709 12:16:44.802105  8528 consensus_queue.cc:260] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:44.803154  8528 raft_consensus.cc:3060] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:44.806891  8457 raft_consensus.cc:2468] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 3.
I20260709 12:16:44.808426  8572 leader_election.cc:304] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 8493340c2bd047e59811b953aab2a423; no voters: 
I20260709 12:16:44.809235  8885 raft_consensus.cc:2804] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:44.809259  8528 raft_consensus.cc:2468] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 3.
I20260709 12:16:44.809864  8885 raft_consensus.cc:697] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 LEADER]: Becoming Leader. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Running, Role: LEADER
I20260709 12:16:44.810904  8885 consensus_queue.cc:237] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:44.818048  8352 catalog_manager.cc:5697] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d reported cstate change: term changed from 2 to 3, leader changed from 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66) to 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67). New cstate: current_term: 3 leader_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:44.953547  8917 raft_consensus.cc:993] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423: : Instructing follower 301dcdc3ecfe4926a8aa77edc79ab57d to start an election
I20260709 12:16:44.954138  8846 raft_consensus.cc:1081] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 2 LEADER]: Signalling peer 301dcdc3ecfe4926a8aa77edc79ab57d to start an election
I20260709 12:16:44.955962  8606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e5a1692f6114807a5fc8c204c9ab5db"
dest_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d"
 from {username='slave'} at 127.0.0.1:41378
I20260709 12:16:44.956562  8606 raft_consensus.cc:493] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:44.956992  8606 raft_consensus.cc:3060] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:44.963845  8606 raft_consensus.cc:515] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:44.966377  8606 leader_election.cc:290] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 3 election: Requested vote from peers 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549), 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773)
I20260709 12:16:44.967434  8528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a1692f6114807a5fc8c204c9ab5db" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f"
I20260709 12:16:44.967623  8457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5a1692f6114807a5fc8c204c9ab5db" candidate_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "8493340c2bd047e59811b953aab2a423"
I20260709 12:16:44.968050  8528 raft_consensus.cc:3060] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:44.968320  8457 raft_consensus.cc:3055] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:44.968643  8457 raft_consensus.cc:740] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8493340c2bd047e59811b953aab2a423, State: Running, Role: LEADER
I20260709 12:16:44.969453  8457 consensus_queue.cc:260] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:44.970647  8457 raft_consensus.cc:3060] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:44.974233  8528 raft_consensus.cc:2468] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 3.
I20260709 12:16:44.975703  8570 leader_election.cc:304] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 301dcdc3ecfe4926a8aa77edc79ab57d, 4f56aad176e14cf4a2ae5e90c249aa2f; no voters: 
I20260709 12:16:44.976684  8885 raft_consensus.cc:2804] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:44.977178  8885 raft_consensus.cc:697] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 LEADER]: Becoming Leader. State: Replica: 301dcdc3ecfe4926a8aa77edc79ab57d, State: Running, Role: LEADER
I20260709 12:16:44.977484  8457 raft_consensus.cc:2468] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 301dcdc3ecfe4926a8aa77edc79ab57d in term 3.
I20260709 12:16:44.978132  8885 consensus_queue.cc:237] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } }
I20260709 12:16:44.987306  8352 catalog_manager.cc:5697] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d reported cstate change: term changed from 2 to 3, leader changed from 8493340c2bd047e59811b953aab2a423 (127.24.179.65) to 301dcdc3ecfe4926a8aa77edc79ab57d (127.24.179.67). New cstate: current_term: 3 leader_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "301dcdc3ecfe4926a8aa77edc79ab57d" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 46857 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:45.029206  8528 raft_consensus.cc:1275] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 3 FOLLOWER]: Refusing update from remote peer 301dcdc3ecfe4926a8aa77edc79ab57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:16:45.030582  8885 consensus_queue.cc:1048] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:45.040038  8457 raft_consensus.cc:1275] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [term 3 FOLLOWER]: Refusing update from remote peer 301dcdc3ecfe4926a8aa77edc79ab57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:16:45.043092  8885 consensus_queue.cc:1048] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:45.167845  8528 raft_consensus.cc:1275] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 3 FOLLOWER]: Refusing update from remote peer 301dcdc3ecfe4926a8aa77edc79ab57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:45.169188  8885 consensus_queue.cc:1048] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:45.179364  8453 raft_consensus.cc:1275] T cb9579a1ccb946368d94695df25d838f P 8493340c2bd047e59811b953aab2a423 [term 3 FOLLOWER]: Refusing update from remote peer 301dcdc3ecfe4926a8aa77edc79ab57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:45.181393  8969 consensus_queue.cc:1048] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:45.382436  8528 raft_consensus.cc:1275] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 3 FOLLOWER]: Refusing update from remote peer 301dcdc3ecfe4926a8aa77edc79ab57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:16:45.383991  8969 consensus_queue.cc:1048] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:45.392467  8453 raft_consensus.cc:1275] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 3 FOLLOWER]: Refusing update from remote peer 301dcdc3ecfe4926a8aa77edc79ab57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:16:45.394582  8885 consensus_queue.cc:1048] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:45.489621 25293 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:16:45.495999 25293 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:16:45.496677 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:45.502508 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:45.502990 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:45.535461  8453 raft_consensus.cc:1275] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 3 FOLLOWER]: Refusing update from remote peer 301dcdc3ecfe4926a8aa77edc79ab57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:45.535460  8528 raft_consensus.cc:1275] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 3 FOLLOWER]: Refusing update from remote peer 301dcdc3ecfe4926a8aa77edc79ab57d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:45.537395  8969 consensus_queue.cc:1048] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8493340c2bd047e59811b953aab2a423" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 42549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:45.538136  8885 consensus_queue.cc:1048] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f56aad176e14cf4a2ae5e90c249aa2f" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:46.504104 25293 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:16:46.510673 25293 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:16:46.511250 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:46.516361 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:46.516891 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:47.518000 25293 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:16:47.523861 25293 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:16:47.524380 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:47.531637 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:47.532109 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:48.533191 25293 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:16:48.538611 25293 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:16:48.539160 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:48.543931 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:48.544443 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:49.545629 25293 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:16:49.551558 25293 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:16:49.552157 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:49.557742 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:49.558497 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:50.559541 25293 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:16:50.565220 25293 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:16:50.565759 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:50.574723 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:50.575412 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:51.576725 25293 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:16:51.582506 25293 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:16:51.583035 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:51.588392 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:51.588896 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:52.590224 25293 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:16:52.597568 25293 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:16:52.598119 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:52.602943 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:52.603559 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:53.604964 25293 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:16:53.610307 25293 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:16:53.610870 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:53.615722 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:53.616255 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:54.686945 25293 tablet_server.cc:179] TabletServer@127.24.179.65:0 shutting down...
I20260709 12:16:54.740334 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:54.741667 25293 tablet_replica.cc:333] T 0fa4e6159720456f829d74ec7d29c267 P 8493340c2bd047e59811b953aab2a423: stopping tablet replica
W20260709 12:16:54.742578  8572 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
I20260709 12:16:54.743381 25293 raft_consensus.cc:2243] T 0fa4e6159720456f829d74ec7d29c267 P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.744666 25293 raft_consensus.cc:2272] T 0fa4e6159720456f829d74ec7d29c267 P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:54.748478  8572 consensus_peers.cc:597] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d -> Peer 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549): Couldn't send request to peer 8493340c2bd047e59811b953aab2a423. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:54.749255  8498 consensus_peers.cc:597] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f -> Peer 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549): Couldn't send request to peer 8493340c2bd047e59811b953aab2a423. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:54.750835 25293 tablet_replica.cc:333] T a5e428f7950e43bc8ee9d4488ca7fd61 P 8493340c2bd047e59811b953aab2a423: stopping tablet replica
I20260709 12:16:54.751770 25293 raft_consensus.cc:2243] T a5e428f7950e43bc8ee9d4488ca7fd61 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.752421 25293 raft_consensus.cc:2272] T a5e428f7950e43bc8ee9d4488ca7fd61 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.755579 25293 tablet_replica.cc:333] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423: stopping tablet replica
I20260709 12:16:54.756414 25293 raft_consensus.cc:2243] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.757179 25293 raft_consensus.cc:2272] T d71d7e9514614a8e80f85267d9a2c39f P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.760999 25293 tablet_replica.cc:333] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423: stopping tablet replica
I20260709 12:16:54.761842 25293 raft_consensus.cc:2243] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.762616 25293 raft_consensus.cc:2272] T c1d221fd20f747e9bf79da7978e763ff P 8493340c2bd047e59811b953aab2a423 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.765555 25293 tablet_replica.cc:333] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423: stopping tablet replica
I20260709 12:16:54.766322 25293 raft_consensus.cc:2243] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.767504 25293 raft_consensus.cc:2272] T 7af81e2425b04f18ada1ee59599705f9 P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.770210 25293 tablet_replica.cc:333] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423: stopping tablet replica
I20260709 12:16:54.770954 25293 raft_consensus.cc:2243] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.771551 25293 raft_consensus.cc:2272] T b3f75420696a42e48efef4fb251b75d1 P 8493340c2bd047e59811b953aab2a423 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.774636 25293 tablet_replica.cc:333] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423: stopping tablet replica
I20260709 12:16:54.775399 25293 raft_consensus.cc:2243] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.776690 25293 raft_consensus.cc:2272] T c008ec4acb3d4da6a43664e485015705 P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.780380 25293 tablet_replica.cc:333] T 8181bbcf7f2d496886d5e7f70c2574a7 P 8493340c2bd047e59811b953aab2a423: stopping tablet replica
I20260709 12:16:54.781070 25293 raft_consensus.cc:2243] T 8181bbcf7f2d496886d5e7f70c2574a7 P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.781611 25293 raft_consensus.cc:2272] T 8181bbcf7f2d496886d5e7f70c2574a7 P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.784327 25293 tablet_replica.cc:333] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423: stopping tablet replica
I20260709 12:16:54.784977 25293 raft_consensus.cc:2243] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.785501 25293 raft_consensus.cc:2272] T a9e056e5c5ff45d4845bb126397f5b5c P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.788367 25293 tablet_replica.cc:333] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423: stopping tablet replica
I20260709 12:16:54.788980 25293 raft_consensus.cc:2243] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.789903 25293 raft_consensus.cc:2272] T e8f63e935ab34e7796d6b269458cfdbe P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.792528 25293 tablet_replica.cc:333] T cb9579a1ccb946368d94695df25d838f P 8493340c2bd047e59811b953aab2a423: stopping tablet replica
I20260709 12:16:54.793274 25293 raft_consensus.cc:2243] T cb9579a1ccb946368d94695df25d838f P 8493340c2bd047e59811b953aab2a423 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.794121 25293 raft_consensus.cc:2272] T cb9579a1ccb946368d94695df25d838f P 8493340c2bd047e59811b953aab2a423 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.796742 25293 tablet_replica.cc:333] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423: stopping tablet replica
I20260709 12:16:54.797356 25293 raft_consensus.cc:2243] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.798547 25293 raft_consensus.cc:2272] T be4adda3de2941e2938a787df03d067d P 8493340c2bd047e59811b953aab2a423 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.801436 25293 tablet_replica.cc:333] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423: stopping tablet replica
I20260709 12:16:54.802091 25293 raft_consensus.cc:2243] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.802681 25293 raft_consensus.cc:2272] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.805374 25293 tablet_replica.cc:333] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423: stopping tablet replica
I20260709 12:16:54.805940 25293 raft_consensus.cc:2243] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.806499 25293 raft_consensus.cc:2272] T a42cc48f010e4abaa34314467f07303b P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.809029 25293 tablet_replica.cc:333] T ecead67c5c8446bc9043f981de6e5082 P 8493340c2bd047e59811b953aab2a423: stopping tablet replica
I20260709 12:16:54.809644 25293 raft_consensus.cc:2243] T ecead67c5c8446bc9043f981de6e5082 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.810240 25293 raft_consensus.cc:2272] T ecead67c5c8446bc9043f981de6e5082 P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.813155 25293 tablet_replica.cc:333] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423: stopping tablet replica
I20260709 12:16:54.813742 25293 raft_consensus.cc:2243] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.814862 25293 raft_consensus.cc:2272] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 8493340c2bd047e59811b953aab2a423 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.817648 25293 tablet_replica.cc:333] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423: stopping tablet replica
I20260709 12:16:54.818240 25293 raft_consensus.cc:2243] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.818830 25293 raft_consensus.cc:2272] T 2e5a1692f6114807a5fc8c204c9ab5db P 8493340c2bd047e59811b953aab2a423 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.821350 25293 tablet_replica.cc:333] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423: stopping tablet replica
I20260709 12:16:54.821916 25293 raft_consensus.cc:2243] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.822992 25293 raft_consensus.cc:2272] T 9bd56b68349b4e1fbfcce01587970beb P 8493340c2bd047e59811b953aab2a423 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.872256 25293 tablet_server.cc:196] TabletServer@127.24.179.65:0 shutdown complete.
W20260709 12:16:54.918514  8572 consensus_peers.cc:597] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d -> Peer 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549): Couldn't send request to peer 8493340c2bd047e59811b953aab2a423. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:42549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:54.928719 25293 tablet_server.cc:179] TabletServer@127.24.179.66:0 shutting down...
I20260709 12:16:54.966199 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:54.967348 25293 tablet_replica.cc:333] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f: stopping tablet replica
I20260709 12:16:54.969151 25293 raft_consensus.cc:2243] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.970589 25293 raft_consensus.cc:2272] T a5e428f7950e43bc8ee9d4488ca7fd61 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:54.972466  8498 consensus_peers.cc:597] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f -> Peer 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549): Couldn't send request to peer 8493340c2bd047e59811b953aab2a423. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:42549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:54.974001 25293 tablet_replica.cc:333] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f: stopping tablet replica
I20260709 12:16:54.975031 25293 raft_consensus.cc:2243] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.975744 25293 raft_consensus.cc:2272] T 0fa4e6159720456f829d74ec7d29c267 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.978766 25293 tablet_replica.cc:333] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f: stopping tablet replica
I20260709 12:16:54.979612 25293 raft_consensus.cc:2243] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:54.980822 25293 raft_consensus.cc:2272] T d71d7e9514614a8e80f85267d9a2c39f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.983737 25293 tablet_replica.cc:333] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f: stopping tablet replica
I20260709 12:16:54.984472 25293 raft_consensus.cc:2243] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.985180 25293 raft_consensus.cc:2272] T b3f75420696a42e48efef4fb251b75d1 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.988687 25293 tablet_replica.cc:333] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f: stopping tablet replica
I20260709 12:16:54.989610 25293 raft_consensus.cc:2243] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.990326 25293 raft_consensus.cc:2272] T c1d221fd20f747e9bf79da7978e763ff P 4f56aad176e14cf4a2ae5e90c249aa2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.993839 25293 tablet_replica.cc:333] T 7af81e2425b04f18ada1ee59599705f9 P 4f56aad176e14cf4a2ae5e90c249aa2f: stopping tablet replica
W20260709 12:16:54.993913  8572 consensus_peers.cc:597] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d -> Peer 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549): Couldn't send request to peer 8493340c2bd047e59811b953aab2a423. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:42549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:54.994822 25293 raft_consensus.cc:2243] T 7af81e2425b04f18ada1ee59599705f9 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.995707 25293 raft_consensus.cc:2272] T 7af81e2425b04f18ada1ee59599705f9 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.999642 25293 tablet_replica.cc:333] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f: stopping tablet replica
I20260709 12:16:55.000509 25293 raft_consensus.cc:2243] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:55.001163 25293 raft_consensus.cc:2272] T e8f63e935ab34e7796d6b269458cfdbe P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.003773 25293 tablet_replica.cc:333] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f: stopping tablet replica
I20260709 12:16:55.004441 25293 raft_consensus.cc:2243] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:55.005505 25293 raft_consensus.cc:2272] T a9e056e5c5ff45d4845bb126397f5b5c P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.008023 25293 tablet_replica.cc:333] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f: stopping tablet replica
I20260709 12:16:55.008733 25293 raft_consensus.cc:2243] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:55.009800 25293 raft_consensus.cc:2272] T a42cc48f010e4abaa34314467f07303b P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.012642 25293 tablet_replica.cc:333] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f: stopping tablet replica
I20260709 12:16:55.013307 25293 raft_consensus.cc:2243] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:55.014611 25293 raft_consensus.cc:2272] T ecead67c5c8446bc9043f981de6e5082 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.018285 25293 tablet_replica.cc:333] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 4f56aad176e14cf4a2ae5e90c249aa2f: stopping tablet replica
W20260709 12:16:55.019085  8570 consensus_peers.cc:597] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d -> Peer 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773): Couldn't send request to peer 4f56aad176e14cf4a2ae5e90c249aa2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:55.019402 25293 raft_consensus.cc:2243] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:55.020083 25293 raft_consensus.cc:2272] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.022722 25293 tablet_replica.cc:333] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f: stopping tablet replica
I20260709 12:16:55.023303 25293 raft_consensus.cc:2243] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:55.024377 25293 raft_consensus.cc:2272] T 8181bbcf7f2d496886d5e7f70c2574a7 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.027189 25293 tablet_replica.cc:333] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f: stopping tablet replica
I20260709 12:16:55.027865 25293 raft_consensus.cc:2243] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:55.028419 25293 raft_consensus.cc:2272] T c008ec4acb3d4da6a43664e485015705 P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.030974 25293 tablet_replica.cc:333] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f: stopping tablet replica
I20260709 12:16:55.031598 25293 raft_consensus.cc:2243] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:55.032104 25293 raft_consensus.cc:2272] T 9bd56b68349b4e1fbfcce01587970beb P 4f56aad176e14cf4a2ae5e90c249aa2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.034582 25293 tablet_replica.cc:333] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f: stopping tablet replica
I20260709 12:16:55.035199 25293 raft_consensus.cc:2243] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:55.035744 25293 raft_consensus.cc:2272] T 2e5a1692f6114807a5fc8c204c9ab5db P 4f56aad176e14cf4a2ae5e90c249aa2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.038166 25293 tablet_replica.cc:333] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f: stopping tablet replica
I20260709 12:16:55.038796 25293 raft_consensus.cc:2243] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:55.039304 25293 raft_consensus.cc:2272] T cb9579a1ccb946368d94695df25d838f P 4f56aad176e14cf4a2ae5e90c249aa2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.041724 25293 tablet_replica.cc:333] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f: stopping tablet replica
I20260709 12:16:55.042306 25293 raft_consensus.cc:2243] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:55.042912 25293 raft_consensus.cc:2272] T be4adda3de2941e2938a787df03d067d P 4f56aad176e14cf4a2ae5e90c249aa2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.045394 25293 tablet_replica.cc:333] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f: stopping tablet replica
I20260709 12:16:55.045954 25293 raft_consensus.cc:2243] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:55.046486 25293 raft_consensus.cc:2272] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 4f56aad176e14cf4a2ae5e90c249aa2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.091760 25293 tablet_server.cc:196] TabletServer@127.24.179.66:0 shutdown complete.
W20260709 12:16:55.093426  8570 consensus_peers.cc:597] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d -> Peer 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773): Couldn't send request to peer 4f56aad176e14cf4a2ae5e90c249aa2f. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:41773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:55.136224 25293 tablet_server.cc:179] TabletServer@127.24.179.67:0 shutting down...
W20260709 12:16:55.151970  8572 consensus_peers.cc:597] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d -> Peer 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549): Couldn't send request to peer 8493340c2bd047e59811b953aab2a423. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:42549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:55.160105  8570 consensus_peers.cc:597] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d -> Peer 4f56aad176e14cf4a2ae5e90c249aa2f (127.24.179.66:41773): Couldn't send request to peer 4f56aad176e14cf4a2ae5e90c249aa2f. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:41773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:55.171212  8572 consensus_peers.cc:597] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d -> Peer 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549): Couldn't send request to peer 8493340c2bd047e59811b953aab2a423. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:42549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:55.176395  8572 consensus_peers.cc:597] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d -> Peer 8493340c2bd047e59811b953aab2a423 (127.24.179.65:42549): Couldn't send request to peer 8493340c2bd047e59811b953aab2a423. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:42549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:55.178880 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:55.179787 25293 tablet_replica.cc:333] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d: stopping tablet replica
I20260709 12:16:55.180847 25293 raft_consensus.cc:2243] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:55.181808 25293 raft_consensus.cc:2272] T 0fa4e6159720456f829d74ec7d29c267 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.184522 25293 tablet_replica.cc:333] T d71d7e9514614a8e80f85267d9a2c39f P 301dcdc3ecfe4926a8aa77edc79ab57d: stopping tablet replica
I20260709 12:16:55.185163 25293 raft_consensus.cc:2243] T d71d7e9514614a8e80f85267d9a2c39f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:55.185670 25293 raft_consensus.cc:2272] T d71d7e9514614a8e80f85267d9a2c39f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.188138 25293 tablet_replica.cc:333] T a5e428f7950e43bc8ee9d4488ca7fd61 P 301dcdc3ecfe4926a8aa77edc79ab57d: stopping tablet replica
I20260709 12:16:55.188720 25293 raft_consensus.cc:2243] T a5e428f7950e43bc8ee9d4488ca7fd61 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:55.189235 25293 raft_consensus.cc:2272] T a5e428f7950e43bc8ee9d4488ca7fd61 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.191762 25293 tablet_replica.cc:333] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d: stopping tablet replica
I20260709 12:16:55.192368 25293 raft_consensus.cc:2243] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:55.193315 25293 raft_consensus.cc:2272] T b3f75420696a42e48efef4fb251b75d1 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.195794 25293 tablet_replica.cc:333] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d: stopping tablet replica
I20260709 12:16:55.196413 25293 raft_consensus.cc:2243] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:55.197361 25293 raft_consensus.cc:2272] T c1d221fd20f747e9bf79da7978e763ff P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.199901 25293 tablet_replica.cc:333] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d: stopping tablet replica
I20260709 12:16:55.200634 25293 raft_consensus.cc:2243] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:55.201177 25293 raft_consensus.cc:2272] T 7af81e2425b04f18ada1ee59599705f9 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.203586 25293 tablet_replica.cc:333] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d: stopping tablet replica
I20260709 12:16:55.204173 25293 raft_consensus.cc:2243] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:55.205156 25293 raft_consensus.cc:2272] T 2e5a1692f6114807a5fc8c204c9ab5db P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.207641 25293 tablet_replica.cc:333] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d: stopping tablet replica
I20260709 12:16:55.208348 25293 raft_consensus.cc:2243] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:55.208909 25293 raft_consensus.cc:2272] T c008ec4acb3d4da6a43664e485015705 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.211555 25293 tablet_replica.cc:333] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d: stopping tablet replica
I20260709 12:16:55.212212 25293 raft_consensus.cc:2243] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:55.212767 25293 raft_consensus.cc:2272] T 8181bbcf7f2d496886d5e7f70c2574a7 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.215178 25293 tablet_replica.cc:333] T e8f63e935ab34e7796d6b269458cfdbe P 301dcdc3ecfe4926a8aa77edc79ab57d: stopping tablet replica
I20260709 12:16:55.215818 25293 raft_consensus.cc:2243] T e8f63e935ab34e7796d6b269458cfdbe P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:55.216355 25293 raft_consensus.cc:2272] T e8f63e935ab34e7796d6b269458cfdbe P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.218626 25293 tablet_replica.cc:333] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d: stopping tablet replica
I20260709 12:16:55.219221 25293 raft_consensus.cc:2243] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:55.219765 25293 raft_consensus.cc:2272] T a9e056e5c5ff45d4845bb126397f5b5c P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.222189 25293 tablet_replica.cc:333] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d: stopping tablet replica
I20260709 12:16:55.223018 25293 raft_consensus.cc:2243] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:55.223578 25293 raft_consensus.cc:2272] T a42cc48f010e4abaa34314467f07303b P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.225883 25293 tablet_replica.cc:333] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d: stopping tablet replica
I20260709 12:16:55.226497 25293 raft_consensus.cc:2243] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:55.227397 25293 raft_consensus.cc:2272] T 9fa11ad3bbcd4bb29777f40130d5fe7e P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.229643 25293 tablet_replica.cc:333] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d: stopping tablet replica
I20260709 12:16:55.230233 25293 raft_consensus.cc:2243] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:55.230777 25293 raft_consensus.cc:2272] T be4adda3de2941e2938a787df03d067d P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.233101 25293 tablet_replica.cc:333] T ecead67c5c8446bc9043f981de6e5082 P 301dcdc3ecfe4926a8aa77edc79ab57d: stopping tablet replica
I20260709 12:16:55.233698 25293 raft_consensus.cc:2243] T ecead67c5c8446bc9043f981de6e5082 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:55.234294 25293 raft_consensus.cc:2272] T ecead67c5c8446bc9043f981de6e5082 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.237198 25293 tablet_replica.cc:333] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d: stopping tablet replica
I20260709 12:16:55.237839 25293 raft_consensus.cc:2243] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:55.238581 25293 raft_consensus.cc:2272] T edcac3e9bdff42ecb15bc6d821dc4ee3 P 301dcdc3ecfe4926a8aa77edc79ab57d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.240850 25293 tablet_replica.cc:333] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d: stopping tablet replica
I20260709 12:16:55.241410 25293 raft_consensus.cc:2243] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:55.242476 25293 raft_consensus.cc:2272] T cb9579a1ccb946368d94695df25d838f P 301dcdc3ecfe4926a8aa77edc79ab57d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.244856 25293 tablet_replica.cc:333] T 9bd56b68349b4e1fbfcce01587970beb P 301dcdc3ecfe4926a8aa77edc79ab57d: stopping tablet replica
I20260709 12:16:55.245399 25293 raft_consensus.cc:2243] T 9bd56b68349b4e1fbfcce01587970beb P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:55.245880 25293 raft_consensus.cc:2272] T 9bd56b68349b4e1fbfcce01587970beb P 301dcdc3ecfe4926a8aa77edc79ab57d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.291455 25293 tablet_server.cc:196] TabletServer@127.24.179.67:0 shutdown complete.
I20260709 12:16:55.335012 25293 master.cc:562] Master@127.24.179.126:42359 shutting down...
I20260709 12:16:55.363511 25293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:55.364337 25293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:55.364769 25293 tablet_replica.cc:333] T 00000000000000000000000000000000 P 83edc39405c6434f93cb0d09c52102f7: stopping tablet replica
I20260709 12:16:55.405653 25293 master.cc:584] Master@127.24.179.126:42359 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (23637 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:16:55.464093 25293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.24.179.126:32855
I20260709 12:16:55.465277 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:55.472061  9004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:55.472605  9005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:55.472647  9007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:55.473603 25293 server_base.cc:1061] running on GCE node
I20260709 12:16:55.474771 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:55.474963 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:55.475176 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599415475143 us; error 0 us; skew 500 ppm
I20260709 12:16:55.475754 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:55.478539 25293 webserver.cc:533] Webserver started at http://127.24.179.126:39845/ using document root <none> and password file <none>
I20260709 12:16:55.479153 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:55.479362 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:55.479665 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:55.480989 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894834136-25293-0/minicluster-data/master-0-root/instance:
uuid: "9c8df2f357bf4fb29ded26bbbd16df2e"
format_stamp: "Formatted at 2026-07-09 12:16:55 on dist-test-slave-tjfs"
I20260709 12:16:55.486001 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 12:16:55.489759  9012 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:55.490737 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:16:55.491123 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894834136-25293-0/minicluster-data/master-0-root
uuid: "9c8df2f357bf4fb29ded26bbbd16df2e"
format_stamp: "Formatted at 2026-07-09 12:16:55 on dist-test-slave-tjfs"
I20260709 12:16:55.491423 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894834136-25293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894834136-25293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894834136-25293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:55.515961 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:55.517349 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:55.559020 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.126:32855
I20260709 12:16:55.559126  9063 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.126:32855 every 8 connection(s)
I20260709 12:16:55.563439  9064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:55.577072  9064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e: Bootstrap starting.
I20260709 12:16:55.582610  9064 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.587463  9064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e: No bootstrap required, opened a new log
I20260709 12:16:55.590022  9064 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c8df2f357bf4fb29ded26bbbd16df2e" member_type: VOTER }
I20260709 12:16:55.590523  9064 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.590770  9064 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8df2f357bf4fb29ded26bbbd16df2e, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.591459  9064 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c8df2f357bf4fb29ded26bbbd16df2e" member_type: VOTER }
I20260709 12:16:55.591957  9064 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:55.592193  9064 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:55.592415  9064 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.598080  9064 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c8df2f357bf4fb29ded26bbbd16df2e" member_type: VOTER }
I20260709 12:16:55.598735  9064 leader_election.cc:304] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c8df2f357bf4fb29ded26bbbd16df2e; no voters: 
I20260709 12:16:55.599912  9064 leader_election.cc:290] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:55.600314  9067 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:55.601900  9067 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e [term 1 LEADER]: Becoming Leader. State: Replica: 9c8df2f357bf4fb29ded26bbbd16df2e, State: Running, Role: LEADER
I20260709 12:16:55.602773  9067 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c8df2f357bf4fb29ded26bbbd16df2e" member_type: VOTER }
I20260709 12:16:55.603225  9064 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:55.608158  9068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c8df2f357bf4fb29ded26bbbd16df2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c8df2f357bf4fb29ded26bbbd16df2e" member_type: VOTER } }
I20260709 12:16:55.609140  9068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:55.609054  9069 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c8df2f357bf4fb29ded26bbbd16df2e. Latest consensus state: current_term: 1 leader_uuid: "9c8df2f357bf4fb29ded26bbbd16df2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c8df2f357bf4fb29ded26bbbd16df2e" member_type: VOTER } }
I20260709 12:16:55.610049  9069 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:55.613107  9075 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:55.622071  9075 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:55.623421 25293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:55.632656  9075 catalog_manager.cc:1383] Generated new cluster ID: 5299f72aba024749a432804c63a95bb4
I20260709 12:16:55.632964  9075 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:55.662912  9075 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:55.664397  9075 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:55.677297  9075 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e: Generated new TSK 0
I20260709 12:16:55.678007  9075 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:55.690439 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:55.697249  9085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:55.698364  9086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:55.700186  9088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:55.700670 25293 server_base.cc:1061] running on GCE node
I20260709 12:16:55.701721 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:55.701915 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:55.702042 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599415702027 us; error 0 us; skew 500 ppm
I20260709 12:16:55.702593 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:55.705142 25293 webserver.cc:533] Webserver started at http://127.24.179.65:45789/ using document root <none> and password file <none>
I20260709 12:16:55.705631 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:55.705786 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:55.706032 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:55.707631 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894834136-25293-0/minicluster-data/ts-0-root/instance:
uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
format_stamp: "Formatted at 2026-07-09 12:16:55 on dist-test-slave-tjfs"
I20260709 12:16:55.713279 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.003s
I20260709 12:16:55.717074  9093 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:55.718132 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:16:55.718503 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894834136-25293-0/minicluster-data/ts-0-root
uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
format_stamp: "Formatted at 2026-07-09 12:16:55 on dist-test-slave-tjfs"
I20260709 12:16:55.718815 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894834136-25293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894834136-25293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894834136-25293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:55.765208 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:55.766564 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:55.768354 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:55.771003 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:55.771283 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:55.771565 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:55.771768 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:55.816382 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.65:46313
I20260709 12:16:55.816486  9155 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.65:46313 every 8 connection(s)
I20260709 12:16:55.822196 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:55.829859  9160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:55.830248  9161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:55.833695 25293 server_base.cc:1061] running on GCE node
W20260709 12:16:55.834856  9164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:55.835886 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:55.836095 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:55.836263 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599415836251 us; error 0 us; skew 500 ppm
I20260709 12:16:55.837056 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:55.840243 25293 webserver.cc:533] Webserver started at http://127.24.179.66:34687/ using document root <none> and password file <none>
I20260709 12:16:55.840704  9156 heartbeater.cc:344] Connected to a master server at 127.24.179.126:32855
I20260709 12:16:55.840880 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:55.841231  9156 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:55.841270 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:55.841746 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:55.842208  9156 heartbeater.cc:507] Master 127.24.179.126:32855 requested a full tablet report, sending...
I20260709 12:16:55.843214 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894834136-25293-0/minicluster-data/ts-1-root/instance:
uuid: "4e7c74ee6cca49f594649b4d754ffafb"
format_stamp: "Formatted at 2026-07-09 12:16:55 on dist-test-slave-tjfs"
I20260709 12:16:55.844982  9029 ts_manager.cc:194] Registered new tserver with Master: 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313)
I20260709 12:16:55.847158  9029 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44318
I20260709 12:16:55.849195 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:16:55.853371  9168 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:55.854295 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:16:55.854718 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894834136-25293-0/minicluster-data/ts-1-root
uuid: "4e7c74ee6cca49f594649b4d754ffafb"
format_stamp: "Formatted at 2026-07-09 12:16:55 on dist-test-slave-tjfs"
I20260709 12:16:55.855059 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894834136-25293-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894834136-25293-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894834136-25293-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:55.880772 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:55.882118 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:55.883783 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:55.886265 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:55.886549 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:16:55.886822 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:55.887006 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:55.931113 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.66:41367
I20260709 12:16:55.931281  9230 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.66:41367 every 8 connection(s)
I20260709 12:16:55.936610 25293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:55.944869  9234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:55.946831  9235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:55.949123 25293 server_base.cc:1061] running on GCE node
W20260709 12:16:55.949731  9238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:55.950350  9231 heartbeater.cc:344] Connected to a master server at 127.24.179.126:32855
I20260709 12:16:55.951011  9231 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:55.951098 25293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:55.951489 25293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:55.951686 25293 hybrid_clock.cc:648] HybridClock initialized: now 1783599415951668 us; error 0 us; skew 500 ppm
I20260709 12:16:55.952039  9231 heartbeater.cc:507] Master 127.24.179.126:32855 requested a full tablet report, sending...
I20260709 12:16:55.952376 25293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:55.954694  9029 ts_manager.cc:194] Registered new tserver with Master: 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:16:55.956264  9029 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44320
I20260709 12:16:55.957460 25293 webserver.cc:533] Webserver started at http://127.24.179.67:35413/ using document root <none> and password file <none>
I20260709 12:16:55.958357 25293 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:55.958653 25293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:55.959015 25293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:55.960435 25293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894834136-25293-0/minicluster-data/ts-2-root/instance:
uuid: "058e0a9d20594e21ab2293398d9f0958"
format_stamp: "Formatted at 2026-07-09 12:16:55 on dist-test-slave-tjfs"
I20260709 12:16:55.965720 25293 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:16:55.969759  9242 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:55.970850 25293 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:16:55.971251 25293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894834136-25293-0/minicluster-data/ts-2-root
uuid: "058e0a9d20594e21ab2293398d9f0958"
format_stamp: "Formatted at 2026-07-09 12:16:55 on dist-test-slave-tjfs"
I20260709 12:16:55.971592 25293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894834136-25293-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894834136-25293-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdXjYGN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894834136-25293-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:55.995198 25293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:55.996582 25293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:55.997990 25293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:56.000550 25293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:56.000844 25293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:56.001132 25293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:56.001324 25293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:56.046521 25293 rpc_server.cc:307] RPC server started. Bound to: 127.24.179.67:40061
I20260709 12:16:56.046711  9304 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.179.67:40061 every 8 connection(s)
I20260709 12:16:56.062474  9305 heartbeater.cc:344] Connected to a master server at 127.24.179.126:32855
I20260709 12:16:56.063086  9305 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:56.063957  9305 heartbeater.cc:507] Master 127.24.179.126:32855 requested a full tablet report, sending...
I20260709 12:16:56.066148  9029 ts_manager.cc:194] Registered new tserver with Master: 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:16:56.066469 25293 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016488961s
I20260709 12:16:56.067790  9029 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44328
I20260709 12:16:56.095088  9029 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44336:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:56.098127  9029 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:56.171542  9121 tablet_service.cc:1511] Processing CreateTablet for tablet 47bb7e61288740c6a083cfe1b95fc2ea (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:56.173207  9121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47bb7e61288740c6a083cfe1b95fc2ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.176175  9120 tablet_service.cc:1511] Processing CreateTablet for tablet 5fe7fdb2ca1d43b1bf6448d810658fed (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:56.177877  9120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fe7fdb2ca1d43b1bf6448d810658fed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.183971  9119 tablet_service.cc:1511] Processing CreateTablet for tablet 8d27de9091884e219dac46f087f8aaff (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:56.185626  9119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d27de9091884e219dac46f087f8aaff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.189669  9196 tablet_service.cc:1511] Processing CreateTablet for tablet 47bb7e61288740c6a083cfe1b95fc2ea (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:56.191474  9196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47bb7e61288740c6a083cfe1b95fc2ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.193646  9117 tablet_service.cc:1511] Processing CreateTablet for tablet 64600ebe7baf4321bc70ad565a1874b2 (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:56.195472  9117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64600ebe7baf4321bc70ad565a1874b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.195807  9194 tablet_service.cc:1511] Processing CreateTablet for tablet 8d27de9091884e219dac46f087f8aaff (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:56.197383  9194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d27de9091884e219dac46f087f8aaff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.197589  9192 tablet_service.cc:1511] Processing CreateTablet for tablet 64600ebe7baf4321bc70ad565a1874b2 (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:56.193858  9195 tablet_service.cc:1511] Processing CreateTablet for tablet 5fe7fdb2ca1d43b1bf6448d810658fed (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:56.199724  9193 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba8ff03279945b681d828571c1f4181 (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:56.203727  9118 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba8ff03279945b681d828571c1f4181 (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:56.205407  9118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba8ff03279945b681d828571c1f4181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.207855  9191 tablet_service.cc:1511] Processing CreateTablet for tablet 0a404d23da7f43fcb50c7d2126f76d4a (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:56.208345  9116 tablet_service.cc:1511] Processing CreateTablet for tablet 0a404d23da7f43fcb50c7d2126f76d4a (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:56.209828  9116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a404d23da7f43fcb50c7d2126f76d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.211905  9193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba8ff03279945b681d828571c1f4181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.217851  9191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a404d23da7f43fcb50c7d2126f76d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.218602  9190 tablet_service.cc:1511] Processing CreateTablet for tablet 45a062c6b1a04686ae6f927c8cf0b838 (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:56.220199  9190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a062c6b1a04686ae6f927c8cf0b838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.220381  9115 tablet_service.cc:1511] Processing CreateTablet for tablet 45a062c6b1a04686ae6f927c8cf0b838 (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:56.224067  9192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64600ebe7baf4321bc70ad565a1874b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.234329  9195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fe7fdb2ca1d43b1bf6448d810658fed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.235466  9114 tablet_service.cc:1511] Processing CreateTablet for tablet e236c3da863a44e096522ad9d8ceaa58 (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:56.241820  9189 tablet_service.cc:1511] Processing CreateTablet for tablet e236c3da863a44e096522ad9d8ceaa58 (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:56.242914  9115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a062c6b1a04686ae6f927c8cf0b838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.243466  9189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e236c3da863a44e096522ad9d8ceaa58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.247063  9114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e236c3da863a44e096522ad9d8ceaa58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.260900  9113 tablet_service.cc:1511] Processing CreateTablet for tablet 88dfecf4a1a84b618cbda9cbbc5d1e48 (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:56.262511  9188 tablet_service.cc:1511] Processing CreateTablet for tablet 88dfecf4a1a84b618cbda9cbbc5d1e48 (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:56.263397  9113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88dfecf4a1a84b618cbda9cbbc5d1e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.264112  9188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88dfecf4a1a84b618cbda9cbbc5d1e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.292520  9266 tablet_service.cc:1511] Processing CreateTablet for tablet 64600ebe7baf4321bc70ad565a1874b2 (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:56.304667  9266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64600ebe7baf4321bc70ad565a1874b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.296140  9268 tablet_service.cc:1511] Processing CreateTablet for tablet 8d27de9091884e219dac46f087f8aaff (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:56.311839  9268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d27de9091884e219dac46f087f8aaff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.299142  9267 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba8ff03279945b681d828571c1f4181 (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:56.316012  9267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba8ff03279945b681d828571c1f4181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.306486  9270 tablet_service.cc:1511] Processing CreateTablet for tablet 47bb7e61288740c6a083cfe1b95fc2ea (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:56.322166  9270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47bb7e61288740c6a083cfe1b95fc2ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.302224  9269 tablet_service.cc:1511] Processing CreateTablet for tablet 5fe7fdb2ca1d43b1bf6448d810658fed (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:56.327905  9269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fe7fdb2ca1d43b1bf6448d810658fed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.331837  9265 tablet_service.cc:1511] Processing CreateTablet for tablet 0a404d23da7f43fcb50c7d2126f76d4a (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:56.336951  9264 tablet_service.cc:1511] Processing CreateTablet for tablet 45a062c6b1a04686ae6f927c8cf0b838 (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:56.334194  9265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a404d23da7f43fcb50c7d2126f76d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.341223  9264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a062c6b1a04686ae6f927c8cf0b838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.376084  9320 tablet_bootstrap.cc:492] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1: Bootstrap starting.
I20260709 12:16:56.389000  9263 tablet_service.cc:1511] Processing CreateTablet for tablet e236c3da863a44e096522ad9d8ceaa58 (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:56.391975  9262 tablet_service.cc:1511] Processing CreateTablet for tablet 88dfecf4a1a84b618cbda9cbbc5d1e48 (DEFAULT_TABLE table=test-workload [id=853b280bc5154a2e877f5c4182a089bf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:56.404984  9263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e236c3da863a44e096522ad9d8ceaa58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.411818  9262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88dfecf4a1a84b618cbda9cbbc5d1e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:56.421132  9321 tablet_bootstrap.cc:492] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb: Bootstrap starting.
I20260709 12:16:56.445219  9320 tablet_bootstrap.cc:654] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.452994  9321 tablet_bootstrap.cc:654] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.503747  9323 tablet_bootstrap.cc:492] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958: Bootstrap starting.
I20260709 12:16:56.515784  9321 tablet_bootstrap.cc:492] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb: No bootstrap required, opened a new log
I20260709 12:16:56.516546  9321 ts_tablet_manager.cc:1403] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent bootstrapping tablet: real 0.096s	user 0.012s	sys 0.008s
I20260709 12:16:56.521348  9323 tablet_bootstrap.cc:654] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.522060  9320 tablet_bootstrap.cc:492] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1: No bootstrap required, opened a new log
I20260709 12:16:56.522727  9320 ts_tablet_manager.cc:1403] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent bootstrapping tablet: real 0.147s	user 0.010s	sys 0.010s
I20260709 12:16:56.525326  9321 raft_consensus.cc:359] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.526286  9321 raft_consensus.cc:385] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.525960  9320 raft_consensus.cc:359] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.526652  9321 raft_consensus.cc:740] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.526829  9320 raft_consensus.cc:385] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.527173  9320 raft_consensus.cc:740] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.527922  9323 tablet_bootstrap.cc:492] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958: No bootstrap required, opened a new log
I20260709 12:16:56.527608  9321 consensus_queue.cc:260] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.528594  9323 ts_tablet_manager.cc:1403] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.005s
I20260709 12:16:56.527987  9320 consensus_queue.cc:260] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.530544  9231 heartbeater.cc:499] Master 127.24.179.126:32855 was elected leader, sending a full tablet report...
I20260709 12:16:56.531085  9321 ts_tablet_manager.cc:1434] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:16:56.532267  9321 tablet_bootstrap.cc:492] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb: Bootstrap starting.
I20260709 12:16:56.533222  9323 raft_consensus.cc:359] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.534492  9323 raft_consensus.cc:385] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.534955  9323 raft_consensus.cc:740] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.536141  9323 consensus_queue.cc:260] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.540015  9321 tablet_bootstrap.cc:654] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.547365  9320 ts_tablet_manager.cc:1434] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent starting tablet: real 0.024s	user 0.015s	sys 0.008s
I20260709 12:16:56.548278  9305 heartbeater.cc:499] Master 127.24.179.126:32855 was elected leader, sending a full tablet report...
I20260709 12:16:56.549052  9320 tablet_bootstrap.cc:492] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Bootstrap starting.
W20260709 12:16:56.551100  9306 tablet.cc:2406] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:16:56.547369  9323 ts_tablet_manager.cc:1434] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958: Time spent starting tablet: real 0.018s	user 0.016s	sys 0.004s
I20260709 12:16:56.555083  9323 tablet_bootstrap.cc:492] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958: Bootstrap starting.
I20260709 12:16:56.556914  9321 tablet_bootstrap.cc:492] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb: No bootstrap required, opened a new log
I20260709 12:16:56.557646  9321 ts_tablet_manager.cc:1403] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.004s
I20260709 12:16:56.558377  9320 tablet_bootstrap.cc:654] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.547435  9156 heartbeater.cc:499] Master 127.24.179.126:32855 was elected leader, sending a full tablet report...
I20260709 12:16:56.562085  9321 raft_consensus.cc:359] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.562927  9323 tablet_bootstrap.cc:654] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.563616  9321 raft_consensus.cc:385] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.564229  9321 raft_consensus.cc:740] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.565635  9321 consensus_queue.cc:260] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.572139  9321 ts_tablet_manager.cc:1434] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 12:16:56.573876  9321 tablet_bootstrap.cc:492] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 4e7c74ee6cca49f594649b4d754ffafb: Bootstrap starting.
I20260709 12:16:56.576589  9323 tablet_bootstrap.cc:492] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958: No bootstrap required, opened a new log
I20260709 12:16:56.577310  9323 ts_tablet_manager.cc:1403] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.004s
I20260709 12:16:56.581066  9323 raft_consensus.cc:359] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.581915  9323 raft_consensus.cc:385] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.582255  9323 raft_consensus.cc:740] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.583223  9323 consensus_queue.cc:260] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.585327  9321 tablet_bootstrap.cc:654] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 4e7c74ee6cca49f594649b4d754ffafb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.586457  9323 ts_tablet_manager.cc:1434] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 12:16:56.587743  9323 tablet_bootstrap.cc:492] T 64600ebe7baf4321bc70ad565a1874b2 P 058e0a9d20594e21ab2293398d9f0958: Bootstrap starting.
I20260709 12:16:56.595451  9323 tablet_bootstrap.cc:654] T 64600ebe7baf4321bc70ad565a1874b2 P 058e0a9d20594e21ab2293398d9f0958: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.599299  9326 raft_consensus.cc:493] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.600191  9326 raft_consensus.cc:515] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.611734  9323 tablet_bootstrap.cc:492] T 64600ebe7baf4321bc70ad565a1874b2 P 058e0a9d20594e21ab2293398d9f0958: No bootstrap required, opened a new log
I20260709 12:16:56.612298  9323 ts_tablet_manager.cc:1403] T 64600ebe7baf4321bc70ad565a1874b2 P 058e0a9d20594e21ab2293398d9f0958: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.009s
I20260709 12:16:56.616612  9320 tablet_bootstrap.cc:492] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1: No bootstrap required, opened a new log
I20260709 12:16:56.616899  9323 raft_consensus.cc:359] T 64600ebe7baf4321bc70ad565a1874b2 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.617496  9320 ts_tablet_manager.cc:1403] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent bootstrapping tablet: real 0.069s	user 0.033s	sys 0.020s
I20260709 12:16:56.617846  9323 raft_consensus.cc:385] T 64600ebe7baf4321bc70ad565a1874b2 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.618223  9323 raft_consensus.cc:740] T 64600ebe7baf4321bc70ad565a1874b2 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Initialized, Role: FOLLOWER
W20260709 12:16:56.618997  9077 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:56.619345  9323 consensus_queue.cc:260] T 64600ebe7baf4321bc70ad565a1874b2 P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.621414  9326 leader_election.cc:290] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:16:56.621486  9320 raft_consensus.cc:359] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.622586  9320 raft_consensus.cc:385] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.623041  9320 raft_consensus.cc:740] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.624426  9323 ts_tablet_manager.cc:1434] T 64600ebe7baf4321bc70ad565a1874b2 P 058e0a9d20594e21ab2293398d9f0958: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 12:16:56.624011  9320 consensus_queue.cc:260] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.625519  9321 tablet_bootstrap.cc:492] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 4e7c74ee6cca49f594649b4d754ffafb: No bootstrap required, opened a new log
I20260709 12:16:56.625777  9323 tablet_bootstrap.cc:492] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958: Bootstrap starting.
I20260709 12:16:56.626191  9321 ts_tablet_manager.cc:1403] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.011s
I20260709 12:16:56.626868  9320 ts_tablet_manager.cc:1434] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:16:56.628209  9320 tablet_bootstrap.cc:492] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1: Bootstrap starting.
I20260709 12:16:56.634572  9323 tablet_bootstrap.cc:654] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.637948  9320 tablet_bootstrap.cc:654] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.642678  9328 raft_consensus.cc:493] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.643579  9328 raft_consensus.cc:515] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.647697  9327 raft_consensus.cc:493] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.648101  9323 tablet_bootstrap.cc:492] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958: No bootstrap required, opened a new log
I20260709 12:16:56.649320  9323 ts_tablet_manager.cc:1403] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.011s
I20260709 12:16:56.648619  9327 raft_consensus.cc:515] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.652979  9323 raft_consensus.cc:359] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } }
I20260709 12:16:56.658728  9327 leader_election.cc:290] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:16:56.663180  9328 leader_election.cc:290] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:16:56.653815  9323 raft_consensus.cc:385] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.629936  9321 raft_consensus.cc:359] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.679925  9323 raft_consensus.cc:740] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.681488  9321 raft_consensus.cc:385] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.690759  9323 consensus_queue.cc:260] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } }
I20260709 12:16:56.684689  9321 raft_consensus.cc:740] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.699767  9323 ts_tablet_manager.cc:1434] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.002s
I20260709 12:16:56.701213  9323 tablet_bootstrap.cc:492] T 2ba8ff03279945b681d828571c1f4181 P 058e0a9d20594e21ab2293398d9f0958: Bootstrap starting.
I20260709 12:16:56.697630  9327 raft_consensus.cc:493] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.703177  9327 raft_consensus.cc:515] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.702888  9321 consensus_queue.cc:260] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.709654  9327 leader_election.cc:290] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:16:56.712257  9321 ts_tablet_manager.cc:1434] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.000s
I20260709 12:16:56.715454  9321 tablet_bootstrap.cc:492] T 2ba8ff03279945b681d828571c1f4181 P 4e7c74ee6cca49f594649b4d754ffafb: Bootstrap starting.
I20260709 12:16:56.718986  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a404d23da7f43fcb50c7d2126f76d4a" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb" is_pre_election: true
W20260709 12:16:56.721345  9246 leader_election.cc:343] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.723459  9321 tablet_bootstrap.cc:654] T 2ba8ff03279945b681d828571c1f4181 P 4e7c74ee6cca49f594649b4d754ffafb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.730881  9323 tablet_bootstrap.cc:654] T 2ba8ff03279945b681d828571c1f4181 P 058e0a9d20594e21ab2293398d9f0958: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.732316  9320 tablet_bootstrap.cc:492] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1: No bootstrap required, opened a new log
I20260709 12:16:56.733103  9320 ts_tablet_manager.cc:1403] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent bootstrapping tablet: real 0.105s	user 0.028s	sys 0.041s
I20260709 12:16:56.737640  9279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64600ebe7baf4321bc70ad565a1874b2" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958" is_pre_election: true
I20260709 12:16:56.738788  9279 raft_consensus.cc:2468] T 64600ebe7baf4321bc70ad565a1874b2 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 0.
I20260709 12:16:56.740826  9095 leader_election.cc:304] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:16:56.741683  9327 raft_consensus.cc:2804] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:56.742130  9327 raft_consensus.cc:493] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.737475  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe7fdb2ca1d43b1bf6448d810658fed" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958" is_pre_election: true
I20260709 12:16:56.742575  9327 raft_consensus.cc:3060] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:56.745504  9095 leader_election.cc:343] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.751971  9320 raft_consensus.cc:359] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } }
I20260709 12:16:56.757921  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe7fdb2ca1d43b1bf6448d810658fed" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb" is_pre_election: true
I20260709 12:16:56.763019  9320 raft_consensus.cc:385] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.758908  9327 raft_consensus.cc:515] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.759826  9205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64600ebe7baf4321bc70ad565a1874b2" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb" is_pre_election: true
I20260709 12:16:56.763478  9130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a062c6b1a04686ae6f927c8cf0b838" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" is_pre_election: true
I20260709 12:16:56.755901  9323 tablet_bootstrap.cc:492] T 2ba8ff03279945b681d828571c1f4181 P 058e0a9d20594e21ab2293398d9f0958: No bootstrap required, opened a new log
I20260709 12:16:56.761786  9131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a404d23da7f43fcb50c7d2126f76d4a" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" is_pre_election: true
I20260709 12:16:56.764923  9323 ts_tablet_manager.cc:1403] T 2ba8ff03279945b681d828571c1f4181 P 058e0a9d20594e21ab2293398d9f0958: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.009s
I20260709 12:16:56.765314  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a062c6b1a04686ae6f927c8cf0b838" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958" is_pre_election: true
W20260709 12:16:56.765820  9097 leader_election.cc:343] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:56.766180  9171 leader_election.cc:343] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.766525  9097 leader_election.cc:304] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 058e0a9d20594e21ab2293398d9f0958, 4e7c74ee6cca49f594649b4d754ffafb
W20260709 12:16:56.767352  9170 leader_election.cc:343] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.763528  9320 raft_consensus.cc:740] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.767921  9170 leader_election.cc:304] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e7c74ee6cca49f594649b4d754ffafb; no voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1
I20260709 12:16:56.768784  9320 consensus_queue.cc:260] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } }
I20260709 12:16:56.769394  9327 leader_election.cc:290] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 election: Requested vote from peers 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:16:56.769569  9323 raft_consensus.cc:359] T 2ba8ff03279945b681d828571c1f4181 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.770246  9327 raft_consensus.cc:2749] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:56.770906  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64600ebe7baf4321bc70ad565a1874b2" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:16:56.771004  9323 raft_consensus.cc:385] T 2ba8ff03279945b681d828571c1f4181 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.771677  9280 raft_consensus.cc:3060] T 64600ebe7baf4321bc70ad565a1874b2 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.771725  9323 raft_consensus.cc:740] T 2ba8ff03279945b681d828571c1f4181 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.773298  9323 consensus_queue.cc:260] T 2ba8ff03279945b681d828571c1f4181 P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.769433  9326 raft_consensus.cc:2749] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:56.779701  9321 tablet_bootstrap.cc:492] T 2ba8ff03279945b681d828571c1f4181 P 4e7c74ee6cca49f594649b4d754ffafb: No bootstrap required, opened a new log
I20260709 12:16:56.780436  9321 ts_tablet_manager.cc:1403] T 2ba8ff03279945b681d828571c1f4181 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.013s
I20260709 12:16:56.782014  9280 raft_consensus.cc:2468] T 64600ebe7baf4321bc70ad565a1874b2 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 1.
I20260709 12:16:56.783705  9095 leader_election.cc:304] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:16:56.784735  9327 raft_consensus.cc:2804] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:56.784394  9321 raft_consensus.cc:359] T 2ba8ff03279945b681d828571c1f4181 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.785195  9328 raft_consensus.cc:493] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.785293  9321 raft_consensus.cc:385] T 2ba8ff03279945b681d828571c1f4181 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.786661  9321 raft_consensus.cc:740] T 2ba8ff03279945b681d828571c1f4181 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.786230  9328 raft_consensus.cc:515] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.787370  9320 ts_tablet_manager.cc:1434] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent starting tablet: real 0.054s	user 0.003s	sys 0.017s
I20260709 12:16:56.785310  9327 raft_consensus.cc:697] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Becoming Leader. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Running, Role: LEADER
I20260709 12:16:56.787825  9321 consensus_queue.cc:260] T 2ba8ff03279945b681d828571c1f4181 P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.788753  9327 consensus_queue.cc:237] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.790488  9323 ts_tablet_manager.cc:1434] T 2ba8ff03279945b681d828571c1f4181 P 058e0a9d20594e21ab2293398d9f0958: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 12:16:56.790532  9321 ts_tablet_manager.cc:1434] T 2ba8ff03279945b681d828571c1f4181 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.006s
I20260709 12:16:56.792065  9321 tablet_bootstrap.cc:492] T 47bb7e61288740c6a083cfe1b95fc2ea P 4e7c74ee6cca49f594649b4d754ffafb: Bootstrap starting.
I20260709 12:16:56.793684  9205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64600ebe7baf4321bc70ad565a1874b2" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
W20260709 12:16:56.795289  9245 leader_election.cc:343] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.795941  9245 leader_election.cc:304] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958; no voters: 4e7c74ee6cca49f594649b4d754ffafb, 849b8dd5b8bb411eaf0e0a2288aae6a1
W20260709 12:16:56.797334  9097 leader_election.cc:343] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.797816  9131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e236c3da863a44e096522ad9d8ceaa58" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" is_pre_election: true
I20260709 12:16:56.800150  9321 tablet_bootstrap.cc:654] T 47bb7e61288740c6a083cfe1b95fc2ea P 4e7c74ee6cca49f594649b4d754ffafb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.800449  9323 tablet_bootstrap.cc:492] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958: Bootstrap starting.
I20260709 12:16:56.788697  9320 tablet_bootstrap.cc:492] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1: Bootstrap starting.
I20260709 12:16:56.804744  9328 leader_election.cc:290] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:16:56.805908  9328 raft_consensus.cc:2749] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:56.807251  9205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e236c3da863a44e096522ad9d8ceaa58" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb" is_pre_election: true
I20260709 12:16:56.808226  9205 raft_consensus.cc:2468] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 0.
I20260709 12:16:56.810114  9246 leader_election.cc:304] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 4e7c74ee6cca49f594649b4d754ffafb; no voters: 
W20260709 12:16:56.818363  9245 leader_election.cc:343] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.819370  9320 tablet_bootstrap.cc:654] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.819906  9328 raft_consensus.cc:2804] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:56.827728  9328 raft_consensus.cc:493] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.828291  9328 raft_consensus.cc:3060] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.829739  9320 tablet_bootstrap.cc:492] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1: No bootstrap required, opened a new log
I20260709 12:16:56.824524  9323 tablet_bootstrap.cc:654] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.830377  9320 ts_tablet_manager.cc:1403] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.005s
W20260709 12:16:56.821659  9097 leader_election.cc:343] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.835815  9320 raft_consensus.cc:359] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.836683  9320 raft_consensus.cc:385] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.837023  9320 raft_consensus.cc:740] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.837977  9320 consensus_queue.cc:260] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.838608  9321 tablet_bootstrap.cc:492] T 47bb7e61288740c6a083cfe1b95fc2ea P 4e7c74ee6cca49f594649b4d754ffafb: No bootstrap required, opened a new log
I20260709 12:16:56.839519  9321 ts_tablet_manager.cc:1403] T 47bb7e61288740c6a083cfe1b95fc2ea P 4e7c74ee6cca49f594649b4d754ffafb: Time spent bootstrapping tablet: real 0.048s	user 0.023s	sys 0.018s
I20260709 12:16:56.840947  9320 ts_tablet_manager.cc:1434] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:56.842306  9320 tablet_bootstrap.cc:492] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1: Bootstrap starting.
I20260709 12:16:56.842665  9328 raft_consensus.cc:515] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.844309  9321 raft_consensus.cc:359] T 47bb7e61288740c6a083cfe1b95fc2ea P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } }
I20260709 12:16:56.845505  9321 raft_consensus.cc:385] T 47bb7e61288740c6a083cfe1b95fc2ea P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.845906  9321 raft_consensus.cc:740] T 47bb7e61288740c6a083cfe1b95fc2ea P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.846098  9131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e236c3da863a44e096522ad9d8ceaa58" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:16:56.848438  9321 consensus_queue.cc:260] T 47bb7e61288740c6a083cfe1b95fc2ea P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } }
W20260709 12:16:56.849052  9245 leader_election.cc:343] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.837693  9027 catalog_manager.cc:5697] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.849586  9323 tablet_bootstrap.cc:492] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958: No bootstrap required, opened a new log
I20260709 12:16:56.850350  9323 ts_tablet_manager.cc:1403] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958: Time spent bootstrapping tablet: real 0.050s	user 0.027s	sys 0.000s
I20260709 12:16:56.850486  9320 tablet_bootstrap.cc:654] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.853981  9323 raft_consensus.cc:359] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.854923  9323 raft_consensus.cc:385] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.854876  9205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e236c3da863a44e096522ad9d8ceaa58" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:16:56.855863  9321 ts_tablet_manager.cc:1434] T 47bb7e61288740c6a083cfe1b95fc2ea P 4e7c74ee6cca49f594649b4d754ffafb: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.003s
I20260709 12:16:56.855808  9323 raft_consensus.cc:740] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.856099  9205 raft_consensus.cc:3060] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.857331  9321 tablet_bootstrap.cc:492] T 5fe7fdb2ca1d43b1bf6448d810658fed P 4e7c74ee6cca49f594649b4d754ffafb: Bootstrap starting.
I20260709 12:16:56.857331  9323 consensus_queue.cc:260] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.866627  9321 tablet_bootstrap.cc:654] T 5fe7fdb2ca1d43b1bf6448d810658fed P 4e7c74ee6cca49f594649b4d754ffafb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.869015  9323 ts_tablet_manager.cc:1434] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:16:56.869625  9205 raft_consensus.cc:2468] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 1.
I20260709 12:16:56.870888  9328 leader_election.cc:290] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:16:56.877260  9323 tablet_bootstrap.cc:492] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958: Bootstrap starting.
I20260709 12:16:56.877978  9246 leader_election.cc:304] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 4e7c74ee6cca49f594649b4d754ffafb; no voters: 849b8dd5b8bb411eaf0e0a2288aae6a1
I20260709 12:16:56.880836  9328 raft_consensus.cc:2804] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:56.881619  9328 raft_consensus.cc:697] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Becoming Leader. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Running, Role: LEADER
I20260709 12:16:56.881749  9321 tablet_bootstrap.cc:492] T 5fe7fdb2ca1d43b1bf6448d810658fed P 4e7c74ee6cca49f594649b4d754ffafb: No bootstrap required, opened a new log
I20260709 12:16:56.882593  9321 ts_tablet_manager.cc:1403] T 5fe7fdb2ca1d43b1bf6448d810658fed P 4e7c74ee6cca49f594649b4d754ffafb: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.015s
I20260709 12:16:56.882990  9328 consensus_queue.cc:237] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.886075  9321 raft_consensus.cc:359] T 5fe7fdb2ca1d43b1bf6448d810658fed P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.887007  9321 raft_consensus.cc:385] T 5fe7fdb2ca1d43b1bf6448d810658fed P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.887415  9323 tablet_bootstrap.cc:654] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.887363  9321 raft_consensus.cc:740] T 5fe7fdb2ca1d43b1bf6448d810658fed P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.888688  9321 consensus_queue.cc:260] T 5fe7fdb2ca1d43b1bf6448d810658fed P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.892087  9321 ts_tablet_manager.cc:1434] T 5fe7fdb2ca1d43b1bf6448d810658fed P 4e7c74ee6cca49f594649b4d754ffafb: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:16:56.894068  9321 tablet_bootstrap.cc:492] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb: Bootstrap starting.
I20260709 12:16:56.896464  9320 tablet_bootstrap.cc:492] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1: No bootstrap required, opened a new log
I20260709 12:16:56.897466  9320 ts_tablet_manager.cc:1403] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.037s
I20260709 12:16:56.901014  9323 tablet_bootstrap.cc:492] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958: No bootstrap required, opened a new log
I20260709 12:16:56.901747  9323 ts_tablet_manager.cc:1403] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.000s
I20260709 12:16:56.902490  9321 tablet_bootstrap.cc:654] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.903888  9320 raft_consensus.cc:359] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.907496  9320 raft_consensus.cc:385] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.908180  9320 raft_consensus.cc:740] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.908454  9323 raft_consensus.cc:359] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.909291  9321 tablet_bootstrap.cc:492] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb: No bootstrap required, opened a new log
I20260709 12:16:56.909293  9323 raft_consensus.cc:385] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.909897  9323 raft_consensus.cc:740] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.910063  9321 ts_tablet_manager.cc:1403] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.007s
I20260709 12:16:56.910640  9320 consensus_queue.cc:260] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.910888  9323 consensus_queue.cc:260] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.917065  9323 ts_tablet_manager.cc:1434] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 12:16:56.918033  9320 ts_tablet_manager.cc:1434] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 12:16:56.918327  9323 tablet_bootstrap.cc:492] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958: Bootstrap starting.
I20260709 12:16:56.919274  9320 tablet_bootstrap.cc:492] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Bootstrap starting.
I20260709 12:16:56.925431  9320 tablet_bootstrap.cc:654] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.926172  9323 tablet_bootstrap.cc:654] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.913053  9321 raft_consensus.cc:359] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.926738  9321 raft_consensus.cc:385] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.927094  9321 raft_consensus.cc:740] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.926569  9026 catalog_manager.cc:5697] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 reported cstate change: term changed from 0 to 1, leader changed from <none> to 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "058e0a9d20594e21ab2293398d9f0958" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:56.927938  9321 consensus_queue.cc:260] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.932924  9321 ts_tablet_manager.cc:1434] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.002s
I20260709 12:16:56.934160  9321 tablet_bootstrap.cc:492] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb: Bootstrap starting.
I20260709 12:16:56.945479  9328 raft_consensus.cc:493] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.946179  9328 raft_consensus.cc:515] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } }
I20260709 12:16:56.946645  9320 tablet_bootstrap.cc:492] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1: No bootstrap required, opened a new log
I20260709 12:16:56.947288  9320 ts_tablet_manager.cc:1403] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.001s
I20260709 12:16:56.947713  9321 tablet_bootstrap.cc:654] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.948684  9328 leader_election.cc:290] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:16:56.946687  9323 tablet_bootstrap.cc:492] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958: No bootstrap required, opened a new log
I20260709 12:16:56.950591  9131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47bb7e61288740c6a083cfe1b95fc2ea" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" is_pre_election: true
I20260709 12:16:56.951009  9323 ts_tablet_manager.cc:1403] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.004s
I20260709 12:16:56.951305  9131 raft_consensus.cc:2468] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 0.
I20260709 12:16:56.952625  9245 leader_election.cc:304] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:16:56.953756  9321 tablet_bootstrap.cc:492] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb: No bootstrap required, opened a new log
I20260709 12:16:56.953846  9205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47bb7e61288740c6a083cfe1b95fc2ea" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb" is_pre_election: true
I20260709 12:16:56.954320  9321 ts_tablet_manager.cc:1403] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 12:16:56.954115  9323 raft_consensus.cc:359] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.954685  9205 raft_consensus.cc:2468] T 47bb7e61288740c6a083cfe1b95fc2ea P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 0.
I20260709 12:16:56.955525  9320 raft_consensus.cc:359] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.956110  9348 raft_consensus.cc:2804] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:56.956379  9320 raft_consensus.cc:385] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.956611  9348 raft_consensus.cc:493] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.956909  9320 raft_consensus.cc:740] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.957059  9348 raft_consensus.cc:3060] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.957849  9320 consensus_queue.cc:260] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.958567  9321 raft_consensus.cc:359] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.959347  9321 raft_consensus.cc:385] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.959626  9321 raft_consensus.cc:740] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.960494  9320 ts_tablet_manager.cc:1434] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:16:56.960367  9321 consensus_queue.cc:260] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.961721  9320 tablet_bootstrap.cc:492] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Bootstrap starting.
I20260709 12:16:56.964126  9328 raft_consensus.cc:493] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.964768  9328 raft_consensus.cc:515] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.967257  9328 leader_election.cc:290] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:16:56.970645  9320 tablet_bootstrap.cc:654] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.971954  9131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe7fdb2ca1d43b1bf6448d810658fed" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" is_pre_election: true
I20260709 12:16:56.972867  9131 raft_consensus.cc:2468] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 0.
I20260709 12:16:56.974004  9321 ts_tablet_manager.cc:1434] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
I20260709 12:16:56.975471  9245 leader_election.cc:304] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:16:56.954880  9323 raft_consensus.cc:385] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.976583  9323 raft_consensus.cc:740] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.977540  9323 consensus_queue.cc:260] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.974913  9348 raft_consensus.cc:515] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } }
I20260709 12:16:56.974164  9205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe7fdb2ca1d43b1bf6448d810658fed" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb" is_pre_election: true
I20260709 12:16:56.980211  9205 raft_consensus.cc:2468] T 5fe7fdb2ca1d43b1bf6448d810658fed P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 0.
I20260709 12:16:56.982311  9328 raft_consensus.cc:2804] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:56.982617  9131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47bb7e61288740c6a083cfe1b95fc2ea" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:16:56.978556  9321 tablet_bootstrap.cc:492] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb: Bootstrap starting.
I20260709 12:16:56.985666  9205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47bb7e61288740c6a083cfe1b95fc2ea" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:16:56.986943  9205 raft_consensus.cc:3060] T 47bb7e61288740c6a083cfe1b95fc2ea P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.991356  9320 tablet_bootstrap.cc:492] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 849b8dd5b8bb411eaf0e0a2288aae6a1: No bootstrap required, opened a new log
I20260709 12:16:56.991997  9320 ts_tablet_manager.cc:1403] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.015s
I20260709 12:16:56.994520  9321 tablet_bootstrap.cc:654] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.995601  9320 raft_consensus.cc:359] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.996610  9328 raft_consensus.cc:493] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.986357  9348 leader_election.cc:290] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:16:56.990988  9131 raft_consensus.cc:3060] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.996601  9320 raft_consensus.cc:385] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.997948  9320 raft_consensus.cc:740] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.997236  9328 raft_consensus.cc:3060] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.999138  9323 ts_tablet_manager.cc:1434] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.001s
I20260709 12:16:56.998978  9320 consensus_queue.cc:260] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.997267  9205 raft_consensus.cc:2468] T 47bb7e61288740c6a083cfe1b95fc2ea P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 1.
I20260709 12:16:57.002818  9320 ts_tablet_manager.cc:1434] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:16:57.003180  9246 leader_election.cc:304] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 4e7c74ee6cca49f594649b4d754ffafb; no voters: 
I20260709 12:16:57.004194  9320 tablet_bootstrap.cc:492] T e236c3da863a44e096522ad9d8ceaa58 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Bootstrap starting.
I20260709 12:16:57.008610  9328 raft_consensus.cc:515] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:56.990916  9365 raft_consensus.cc:493] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.011970  9320 tablet_bootstrap.cc:654] T e236c3da863a44e096522ad9d8ceaa58 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.012612  9348 raft_consensus.cc:2804] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.012573  9365 raft_consensus.cc:515] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.015823  9328 leader_election.cc:290] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:16:57.019454  9205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe7fdb2ca1d43b1bf6448d810658fed" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:16:57.020428  9205 raft_consensus.cc:3060] T 5fe7fdb2ca1d43b1bf6448d810658fed P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.016645  9365 leader_election.cc:290] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:16:57.016985  9130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe7fdb2ca1d43b1bf6448d810658fed" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:16:57.022212  9130 raft_consensus.cc:3060] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.023198  9129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88dfecf4a1a84b618cbda9cbbc5d1e48" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" is_pre_election: true
I20260709 12:16:57.024343  9129 raft_consensus.cc:2468] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 0.
I20260709 12:16:57.019591  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88dfecf4a1a84b618cbda9cbbc5d1e48" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb" is_pre_election: true
I20260709 12:16:57.026242  9206 raft_consensus.cc:2468] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 0.
I20260709 12:16:57.011876  9131 raft_consensus.cc:2468] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 1.
I20260709 12:16:57.028275  9245 leader_election.cc:304] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:16:57.014019  9323 tablet_bootstrap.cc:492] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958: Bootstrap starting.
I20260709 12:16:57.040627  9365 raft_consensus.cc:2804] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.041263  9365 raft_consensus.cc:493] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.041754  9365 raft_consensus.cc:3060] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.045083  9205 raft_consensus.cc:2468] T 5fe7fdb2ca1d43b1bf6448d810658fed P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 1.
I20260709 12:16:57.047830  9348 raft_consensus.cc:697] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Becoming Leader. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Running, Role: LEADER
I20260709 12:16:57.055276  9130 raft_consensus.cc:2468] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 1.
I20260709 12:16:57.056262  9348 consensus_queue.cc:237] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } }
I20260709 12:16:57.061010  9321 tablet_bootstrap.cc:492] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb: No bootstrap required, opened a new log
I20260709 12:16:57.061213  9246 leader_election.cc:304] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 4e7c74ee6cca49f594649b4d754ffafb; no voters: 
I20260709 12:16:57.061800  9321 ts_tablet_manager.cc:1403] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb: Time spent bootstrapping tablet: real 0.085s	user 0.019s	sys 0.034s
I20260709 12:16:57.062462  9368 raft_consensus.cc:2804] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.063202  9368 raft_consensus.cc:697] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Becoming Leader. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Running, Role: LEADER
I20260709 12:16:57.064204  9368 consensus_queue.cc:237] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.065050  9365 raft_consensus.cc:515] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.065532  9321 raft_consensus.cc:359] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.066463  9321 raft_consensus.cc:385] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.066802  9321 raft_consensus.cc:740] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.067814  9321 consensus_queue.cc:260] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.053805  9323 tablet_bootstrap.cc:654] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.070863  9321 ts_tablet_manager.cc:1434] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:16:57.072475  9130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88dfecf4a1a84b618cbda9cbbc5d1e48" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:16:57.073246  9130 raft_consensus.cc:3060] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.073632  9320 tablet_bootstrap.cc:492] T e236c3da863a44e096522ad9d8ceaa58 P 849b8dd5b8bb411eaf0e0a2288aae6a1: No bootstrap required, opened a new log
I20260709 12:16:57.074237  9320 ts_tablet_manager.cc:1403] T e236c3da863a44e096522ad9d8ceaa58 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent bootstrapping tablet: real 0.070s	user 0.022s	sys 0.042s
I20260709 12:16:57.077392  9320 raft_consensus.cc:359] T e236c3da863a44e096522ad9d8ceaa58 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.078143  9320 raft_consensus.cc:385] T e236c3da863a44e096522ad9d8ceaa58 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.078444  9320 raft_consensus.cc:740] T e236c3da863a44e096522ad9d8ceaa58 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.082130  9320 consensus_queue.cc:260] T e236c3da863a44e096522ad9d8ceaa58 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.081709  9026 catalog_manager.cc:5697] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 reported cstate change: term changed from 0 to 1, leader changed from <none> to 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "058e0a9d20594e21ab2293398d9f0958" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.091847  9320 ts_tablet_manager.cc:1434] T e236c3da863a44e096522ad9d8ceaa58 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:16:57.093354  9326 raft_consensus.cc:493] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.094837  9326 raft_consensus.cc:515] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.095546  9320 tablet_bootstrap.cc:492] T 45a062c6b1a04686ae6f927c8cf0b838 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Bootstrap starting.
I20260709 12:16:57.096267  9327 raft_consensus.cc:493] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.097078  9327 raft_consensus.cc:515] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.101276  9365 leader_election.cc:290] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:16:57.102581  9205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88dfecf4a1a84b618cbda9cbbc5d1e48" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:16:57.103343  9205 raft_consensus.cc:3060] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.103789  9131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64600ebe7baf4321bc70ad565a1874b2" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" is_pre_election: true
I20260709 12:16:57.104308  9027 catalog_manager.cc:5697] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 reported cstate change: term changed from 0 to 1, leader changed from <none> to 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "058e0a9d20594e21ab2293398d9f0958" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:57.107406  9326 leader_election.cc:290] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:16:57.107661  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64600ebe7baf4321bc70ad565a1874b2" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958" is_pre_election: true
I20260709 12:16:57.107501  9320 tablet_bootstrap.cc:654] T 45a062c6b1a04686ae6f927c8cf0b838 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.108533  9280 raft_consensus.cc:2393] T 64600ebe7baf4321bc70ad565a1874b2 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e7c74ee6cca49f594649b4d754ffafb in current term 1: Already voted for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in this term.
I20260709 12:16:57.110280  9170 leader_election.cc:304] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e7c74ee6cca49f594649b4d754ffafb; no voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1
I20260709 12:16:57.089919  9130 raft_consensus.cc:2468] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 1.
I20260709 12:16:57.112211  9326 raft_consensus.cc:3060] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.113170  9245 leader_election.cc:304] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:16:57.113786  9323 tablet_bootstrap.cc:492] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958: No bootstrap required, opened a new log
I20260709 12:16:57.114224  9365 raft_consensus.cc:2804] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.114454  9323 ts_tablet_manager.cc:1403] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958: Time spent bootstrapping tablet: real 0.101s	user 0.008s	sys 0.026s
I20260709 12:16:57.114580  9205 raft_consensus.cc:2468] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 1.
I20260709 12:16:57.115130  9365 raft_consensus.cc:697] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Becoming Leader. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Running, Role: LEADER
I20260709 12:16:57.116230  9365 consensus_queue.cc:237] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.118255  9323 raft_consensus.cc:359] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.119143  9323 raft_consensus.cc:385] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.119503  9323 raft_consensus.cc:740] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.120327  9323 consensus_queue.cc:260] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.122720  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba8ff03279945b681d828571c1f4181" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb" is_pre_election: true
I20260709 12:16:57.123483  9206 raft_consensus.cc:2468] T 2ba8ff03279945b681d828571c1f4181 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 0.
I20260709 12:16:57.124392  9320 tablet_bootstrap.cc:492] T 45a062c6b1a04686ae6f927c8cf0b838 P 849b8dd5b8bb411eaf0e0a2288aae6a1: No bootstrap required, opened a new log
I20260709 12:16:57.124626  9097 leader_election.cc:304] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e7c74ee6cca49f594649b4d754ffafb, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:16:57.125149  9320 ts_tablet_manager.cc:1403] T 45a062c6b1a04686ae6f927c8cf0b838 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.004s
I20260709 12:16:57.125618  9346 raft_consensus.cc:2804] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.126144  9346 raft_consensus.cc:493] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.126538  9346 raft_consensus.cc:3060] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.127014  9368 raft_consensus.cc:493] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.127591  9368 raft_consensus.cc:515] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.128422  9320 raft_consensus.cc:359] T 45a062c6b1a04686ae6f927c8cf0b838 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.129160  9327 leader_election.cc:290] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:16:57.129962  9368 leader_election.cc:290] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:16:57.130318  9323 ts_tablet_manager.cc:1434] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:16:57.130564  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba8ff03279945b681d828571c1f4181" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958" is_pre_election: true
I20260709 12:16:57.131297  9280 raft_consensus.cc:2468] T 2ba8ff03279945b681d828571c1f4181 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 0.
I20260709 12:16:57.132800  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a062c6b1a04686ae6f927c8cf0b838" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb" is_pre_election: true
I20260709 12:16:57.133632  9206 raft_consensus.cc:2468] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 0.
I20260709 12:16:57.133559  9130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a062c6b1a04686ae6f927c8cf0b838" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" is_pre_election: true
I20260709 12:16:57.129223  9320 raft_consensus.cc:385] T 45a062c6b1a04686ae6f927c8cf0b838 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.135147  9246 leader_election.cc:304] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 4e7c74ee6cca49f594649b4d754ffafb; no voters: 
I20260709 12:16:57.136893  9320 raft_consensus.cc:740] T 45a062c6b1a04686ae6f927c8cf0b838 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.137574  9365 raft_consensus.cc:2804] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.138017  9365 raft_consensus.cc:493] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.137727  9320 consensus_queue.cc:260] T 45a062c6b1a04686ae6f927c8cf0b838 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.138376  9365 raft_consensus.cc:3060] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.140221  9320 ts_tablet_manager.cc:1434] T 45a062c6b1a04686ae6f927c8cf0b838 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:16:57.141206  9130 raft_consensus.cc:2468] T 45a062c6b1a04686ae6f927c8cf0b838 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 0.
I20260709 12:16:57.144765  9326 raft_consensus.cc:2749] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:57.147535  9365 raft_consensus.cc:515] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.149896  9365 leader_election.cc:290] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:16:57.151100  9130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a062c6b1a04686ae6f927c8cf0b838" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:16:57.151206  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a062c6b1a04686ae6f927c8cf0b838" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:16:57.151845  9130 raft_consensus.cc:3060] T 45a062c6b1a04686ae6f927c8cf0b838 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.151949  9206 raft_consensus.cc:3060] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.152374  9027 catalog_manager.cc:5697] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 reported cstate change: term changed from 0 to 1, leader changed from <none> to 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "058e0a9d20594e21ab2293398d9f0958" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:57.155714  9346 raft_consensus.cc:515] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.158988  9346 leader_election.cc:290] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 election: Requested vote from peers 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:16:57.159590  9205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba8ff03279945b681d828571c1f4181" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:16:57.160295  9205 raft_consensus.cc:3060] T 2ba8ff03279945b681d828571c1f4181 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.160233  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba8ff03279945b681d828571c1f4181" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:16:57.161177  9280 raft_consensus.cc:3060] T 2ba8ff03279945b681d828571c1f4181 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.162974  9206 raft_consensus.cc:2468] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 1.
I20260709 12:16:57.164378  9246 leader_election.cc:304] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 4e7c74ee6cca49f594649b4d754ffafb; no voters: 
I20260709 12:16:57.165308  9365 raft_consensus.cc:2804] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.165848  9365 raft_consensus.cc:697] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Becoming Leader. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Running, Role: LEADER
I20260709 12:16:57.166770  9365 consensus_queue.cc:237] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.169828  9280 raft_consensus.cc:2468] T 2ba8ff03279945b681d828571c1f4181 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 1.
I20260709 12:16:57.171499  9095 leader_election.cc:304] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:16:57.172463  9346 raft_consensus.cc:2804] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.173202  9205 raft_consensus.cc:2468] T 2ba8ff03279945b681d828571c1f4181 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 1.
I20260709 12:16:57.173339  9346 raft_consensus.cc:697] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Becoming Leader. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Running, Role: LEADER
I20260709 12:16:57.176611  9346 consensus_queue.cc:237] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.174877  9130 raft_consensus.cc:2468] T 45a062c6b1a04686ae6f927c8cf0b838 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 1.
I20260709 12:16:57.183703  9027 catalog_manager.cc:5697] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 reported cstate change: term changed from 0 to 1, leader changed from <none> to 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "058e0a9d20594e21ab2293398d9f0958" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:57.196491  9326 raft_consensus.cc:493] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.197127  9326 raft_consensus.cc:515] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.199180  9326 leader_election.cc:290] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:16:57.200343  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d27de9091884e219dac46f087f8aaff" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958" is_pre_election: true
I20260709 12:16:57.200428  9130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d27de9091884e219dac46f087f8aaff" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" is_pre_election: true
I20260709 12:16:57.200274  9026 catalog_manager.cc:5697] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.201294  9280 raft_consensus.cc:2468] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 0.
I20260709 12:16:57.201388  9130 raft_consensus.cc:2468] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 0.
I20260709 12:16:57.202513  9170 leader_election.cc:304] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 4e7c74ee6cca49f594649b4d754ffafb; no voters: 
I20260709 12:16:57.203752  9326 raft_consensus.cc:2804] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.204155  9326 raft_consensus.cc:493] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.204500  9326 raft_consensus.cc:3060] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.212015  9326 raft_consensus.cc:515] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.213723  9326 leader_election.cc:290] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:16:57.214692  9130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d27de9091884e219dac46f087f8aaff" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:16:57.214877  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d27de9091884e219dac46f087f8aaff" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:16:57.215373  9130 raft_consensus.cc:3060] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.215524  9280 raft_consensus.cc:3060] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.221781  9280 raft_consensus.cc:2468] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 1.
I20260709 12:16:57.221781  9130 raft_consensus.cc:2468] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 1.
I20260709 12:16:57.223146  9170 leader_election.cc:304] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 4e7c74ee6cca49f594649b4d754ffafb; no voters: 
I20260709 12:16:57.224025  9326 raft_consensus.cc:2804] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.224931  9326 raft_consensus.cc:697] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 1 LEADER]: Becoming Leader. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Running, Role: LEADER
I20260709 12:16:57.225841  9326 consensus_queue.cc:237] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.232932  9346 raft_consensus.cc:493] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.233584  9346 raft_consensus.cc:515] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.235050  9026 catalog_manager.cc:5697] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66). New cstate: current_term: 1 leader_uuid: "4e7c74ee6cca49f594649b4d754ffafb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.236716  9205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a404d23da7f43fcb50c7d2126f76d4a" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb" is_pre_election: true
I20260709 12:16:57.236914  9346 leader_election.cc:290] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:16:57.237535  9205 raft_consensus.cc:2468] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 0.
I20260709 12:16:57.239133  9097 leader_election.cc:304] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e7c74ee6cca49f594649b4d754ffafb, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:16:57.239853  9346 raft_consensus.cc:2804] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.237196  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a404d23da7f43fcb50c7d2126f76d4a" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958" is_pre_election: true
I20260709 12:16:57.240279  9346 raft_consensus.cc:493] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.240717  9346 raft_consensus.cc:3060] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.240752  9280 raft_consensus.cc:2468] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 0.
I20260709 12:16:57.248390  9346 raft_consensus.cc:515] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.250638  9346 leader_election.cc:290] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 election: Requested vote from peers 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:16:57.251477  9205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a404d23da7f43fcb50c7d2126f76d4a" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:16:57.251693  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a404d23da7f43fcb50c7d2126f76d4a" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:16:57.252195  9205 raft_consensus.cc:3060] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.252331  9280 raft_consensus.cc:3060] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.259027  9280 raft_consensus.cc:2468] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 1.
I20260709 12:16:57.259142  9205 raft_consensus.cc:2468] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 1.
I20260709 12:16:57.260280  9095 leader_election.cc:304] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:16:57.261059  9346 raft_consensus.cc:2804] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.261564  9346 raft_consensus.cc:697] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Becoming Leader. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Running, Role: LEADER
I20260709 12:16:57.262526  9346 consensus_queue.cc:237] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.270627  9026 catalog_manager.cc:5697] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.372905  9280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47bb7e61288740c6a083cfe1b95fc2ea"
dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
mode: GRACEFUL
new_leader_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
 from {username='slave'} at 127.0.0.1:54000
I20260709 12:16:57.373610  9280 raft_consensus.cc:606] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Received request to transfer leadership to TS 849b8dd5b8bb411eaf0e0a2288aae6a1
I20260709 12:16:57.379457  9280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fe7fdb2ca1d43b1bf6448d810658fed"
dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
mode: GRACEFUL
new_leader_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
 from {username='slave'} at 127.0.0.1:54000
I20260709 12:16:57.380065  9280 raft_consensus.cc:606] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Received request to transfer leadership to TS 849b8dd5b8bb411eaf0e0a2288aae6a1
I20260709 12:16:57.394997  9130 raft_consensus.cc:3060] T e236c3da863a44e096522ad9d8ceaa58 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.395891  9206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d27de9091884e219dac46f087f8aaff"
dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
mode: GRACEFUL
new_leader_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
 from {username='slave'} at 127.0.0.1:58776
I20260709 12:16:57.396636  9206 raft_consensus.cc:606] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 1 LEADER]: Received request to transfer leadership to TS 849b8dd5b8bb411eaf0e0a2288aae6a1
I20260709 12:16:57.398080  9346 consensus_queue.cc:1048] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:57.406600  9365 consensus_queue.cc:1048] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.420680  9385 consensus_queue.cc:1048] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:57.425791  9131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64600ebe7baf4321bc70ad565a1874b2"
dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
mode: GRACEFUL
new_leader_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
 from {username='slave'} at 127.0.0.1:39124
I20260709 12:16:57.426618  9131 raft_consensus.cc:606] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Received request to transfer leadership to TS 4e7c74ee6cca49f594649b4d754ffafb
I20260709 12:16:57.429590  9346 raft_consensus.cc:993] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1: : Instructing follower 4e7c74ee6cca49f594649b4d754ffafb to start an election
I20260709 12:16:57.430116  9346 raft_consensus.cc:1081] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Signalling peer 4e7c74ee6cca49f594649b4d754ffafb to start an election
I20260709 12:16:57.433586  9206 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64600ebe7baf4321bc70ad565a1874b2"
dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
 from {username='slave'} at 127.0.0.1:58760
I20260709 12:16:57.434734  9206 raft_consensus.cc:493] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:57.435194  9206 raft_consensus.cc:3060] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.446246  9365 consensus_queue.cc:1048] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:57.455102  9131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a404d23da7f43fcb50c7d2126f76d4a"
dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
mode: GRACEFUL
new_leader_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
 from {username='slave'} at 127.0.0.1:39124
I20260709 12:16:57.454771  9206 raft_consensus.cc:515] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.456595  9131 raft_consensus.cc:606] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Received request to transfer leadership to TS 4e7c74ee6cca49f594649b4d754ffafb
I20260709 12:16:57.457818  9206 leader_election.cc:290] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 2 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:16:57.458480  9130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64600ebe7baf4321bc70ad565a1874b2" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:16:57.459230  9130 raft_consensus.cc:3055] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:57.459316  9279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64600ebe7baf4321bc70ad565a1874b2" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:16:57.459656  9130 raft_consensus.cc:740] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Running, Role: LEADER
I20260709 12:16:57.460644  9130 consensus_queue.cc:260] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.461580  9130 raft_consensus.cc:3060] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.469810  9368 consensus_queue.cc:1048] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:57.473913  9280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45a062c6b1a04686ae6f927c8cf0b838"
dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
mode: GRACEFUL
new_leader_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
 from {username='slave'} at 127.0.0.1:54000
I20260709 12:16:57.474653  9280 raft_consensus.cc:606] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Received request to transfer leadership to TS 4e7c74ee6cca49f594649b4d754ffafb
I20260709 12:16:57.483554  9280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e236c3da863a44e096522ad9d8ceaa58"
dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
mode: GRACEFUL
new_leader_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
 from {username='slave'} at 127.0.0.1:54000
I20260709 12:16:57.484295  9280 raft_consensus.cc:606] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Received request to transfer leadership to TS 4e7c74ee6cca49f594649b4d754ffafb
I20260709 12:16:57.486284  9348 consensus_queue.cc:1048] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.489295  9130 raft_consensus.cc:2468] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 2.
I20260709 12:16:57.493192  9171 leader_election.cc:304] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e7c74ee6cca49f594649b4d754ffafb, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 058e0a9d20594e21ab2293398d9f0958
I20260709 12:16:57.494764  9326 raft_consensus.cc:2804] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.495339  9326 raft_consensus.cc:697] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 LEADER]: Becoming Leader. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Running, Role: LEADER
I20260709 12:16:57.496290  9326 consensus_queue.cc:237] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.510982  9368 raft_consensus.cc:993] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958: : Instructing follower 4e7c74ee6cca49f594649b4d754ffafb to start an election
I20260709 12:16:57.511525  9368 raft_consensus.cc:1081] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Signalling peer 4e7c74ee6cca49f594649b4d754ffafb to start an election
I20260709 12:16:57.514052  9206 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e236c3da863a44e096522ad9d8ceaa58"
dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
 from {username='slave'} at 127.0.0.1:58756
I20260709 12:16:57.514357  9328 raft_consensus.cc:993] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958: : Instructing follower 849b8dd5b8bb411eaf0e0a2288aae6a1 to start an election
I20260709 12:16:57.515549  9328 raft_consensus.cc:1081] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Signalling peer 849b8dd5b8bb411eaf0e0a2288aae6a1 to start an election
I20260709 12:16:57.514773  9206 raft_consensus.cc:493] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:57.516613  9206 raft_consensus.cc:3060] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.518596  9131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47bb7e61288740c6a083cfe1b95fc2ea"
dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
 from {username='slave'} at 127.0.0.1:39116
I20260709 12:16:57.518981  9328 consensus_queue.cc:1048] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:57.519338  9131 raft_consensus.cc:493] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:57.519942  9131 raft_consensus.cc:3060] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.525693  9206 raft_consensus.cc:515] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.528306  9206 leader_election.cc:290] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 2 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:16:57.530437  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e236c3da863a44e096522ad9d8ceaa58" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:16:57.530988  9130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e236c3da863a44e096522ad9d8ceaa58" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:16:57.531258  9280 raft_consensus.cc:3055] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:57.531669  9280 raft_consensus.cc:740] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Running, Role: LEADER
I20260709 12:16:57.532565  9280 consensus_queue.cc:260] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.534029  9280 raft_consensus.cc:3060] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.531697  9130 raft_consensus.cc:3060] T e236c3da863a44e096522ad9d8ceaa58 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.535135  9348 consensus_queue.cc:1048] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.539529  9027 catalog_manager.cc:5697] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb reported cstate change: term changed from 1 to 2, leader changed from 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65) to 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66). New cstate: current_term: 2 leader_uuid: "4e7c74ee6cca49f594649b4d754ffafb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.533716  9131 raft_consensus.cc:515] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } }
I20260709 12:16:57.544260  9131 leader_election.cc:290] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 2 election: Requested vote from peers 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:16:57.545521  9280 raft_consensus.cc:2468] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 2.
I20260709 12:16:57.546171  9279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47bb7e61288740c6a083cfe1b95fc2ea" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:16:57.546986  9279 raft_consensus.cc:3055] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:57.547325  9279 raft_consensus.cc:740] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Running, Role: LEADER
I20260709 12:16:57.547917  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47bb7e61288740c6a083cfe1b95fc2ea" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:16:57.548682  9206 raft_consensus.cc:3060] T 47bb7e61288740c6a083cfe1b95fc2ea P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.548260  9279 consensus_queue.cc:260] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } }
I20260709 12:16:57.549468  9130 raft_consensus.cc:2468] T e236c3da863a44e096522ad9d8ceaa58 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 2.
I20260709 12:16:57.553010  9171 leader_election.cc:304] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e7c74ee6cca49f594649b4d754ffafb, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:16:57.554210  9392 raft_consensus.cc:2804] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.554787  9392 raft_consensus.cc:697] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 LEADER]: Becoming Leader. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Running, Role: LEADER
I20260709 12:16:57.555779  9392 consensus_queue.cc:237] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.558486  9206 raft_consensus.cc:2468] T 47bb7e61288740c6a083cfe1b95fc2ea P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 2.
I20260709 12:16:57.559850  9097 leader_election.cc:304] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e7c74ee6cca49f594649b4d754ffafb, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:16:57.560611  9385 raft_consensus.cc:2804] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.561127  9385 raft_consensus.cc:697] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 LEADER]: Becoming Leader. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Running, Role: LEADER
I20260709 12:16:57.549576  9279 raft_consensus.cc:3060] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.562000  9385 consensus_queue.cc:237] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } }
I20260709 12:16:57.563694  9328 raft_consensus.cc:993] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958: : Instructing follower 849b8dd5b8bb411eaf0e0a2288aae6a1 to start an election
I20260709 12:16:57.564254  9328 raft_consensus.cc:1081] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Signalling peer 849b8dd5b8bb411eaf0e0a2288aae6a1 to start an election
I20260709 12:16:57.568681  9368 consensus_queue.cc:1048] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.572638  9279 raft_consensus.cc:2468] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 2.
I20260709 12:16:57.573650  9130 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fe7fdb2ca1d43b1bf6448d810658fed"
dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
 from {username='slave'} at 127.0.0.1:39116
I20260709 12:16:57.574419  9130 raft_consensus.cc:493] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:57.574934  9130 raft_consensus.cc:3060] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.577883  9029 catalog_manager.cc:5697] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb reported cstate change: term changed from 1 to 2, leader changed from 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67) to 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66). New cstate: current_term: 2 leader_uuid: "4e7c74ee6cca49f594649b4d754ffafb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.583948  9130 raft_consensus.cc:515] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.590806  9328 consensus_queue.cc:1048] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.592116  9279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe7fdb2ca1d43b1bf6448d810658fed" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:16:57.592854  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe7fdb2ca1d43b1bf6448d810658fed" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:16:57.592936  9279 raft_consensus.cc:3055] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:57.594331  9279 raft_consensus.cc:740] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Running, Role: LEADER
I20260709 12:16:57.593454  9026 catalog_manager.cc:5697] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1 reported cstate change: term changed from 1 to 2, leader changed from 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67) to 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.595295  9279 consensus_queue.cc:260] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.596570  9279 raft_consensus.cc:3060] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.593590  9206 raft_consensus.cc:3060] T 5fe7fdb2ca1d43b1bf6448d810658fed P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.593811  9130 leader_election.cc:290] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 2 election: Requested vote from peers 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:16:57.607720  9328 raft_consensus.cc:993] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958: : Instructing follower 4e7c74ee6cca49f594649b4d754ffafb to start an election
I20260709 12:16:57.608290  9348 raft_consensus.cc:1081] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Signalling peer 4e7c74ee6cca49f594649b4d754ffafb to start an election
I20260709 12:16:57.609387  9206 raft_consensus.cc:2468] T 5fe7fdb2ca1d43b1bf6448d810658fed P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 2.
I20260709 12:16:57.610554  9205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45a062c6b1a04686ae6f927c8cf0b838"
dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
 from {username='slave'} at 127.0.0.1:58756
I20260709 12:16:57.611284  9205 raft_consensus.cc:493] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:57.612776  9205 raft_consensus.cc:3060] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.610803  9097 leader_election.cc:304] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e7c74ee6cca49f594649b4d754ffafb, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:16:57.615097  9327 raft_consensus.cc:2804] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.615027  9328 consensus_queue.cc:1048] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:57.615756  9327 raft_consensus.cc:697] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 LEADER]: Becoming Leader. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Running, Role: LEADER
I20260709 12:16:57.616705  9327 consensus_queue.cc:237] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.617118  9279 raft_consensus.cc:2468] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 2.
I20260709 12:16:57.618594  9346 consensus_queue.cc:1048] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:57.623148  9205 raft_consensus.cc:515] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.625756  9205 leader_election.cc:290] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 2 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:16:57.627842  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a062c6b1a04686ae6f927c8cf0b838" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:16:57.628746  9280 raft_consensus.cc:3055] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:57.629382  9280 raft_consensus.cc:740] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Running, Role: LEADER
I20260709 12:16:57.630359  9280 consensus_queue.cc:260] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.632181  9280 raft_consensus.cc:3060] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.641835  9280 raft_consensus.cc:2468] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 2.
I20260709 12:16:57.643224  9170 leader_election.cc:304] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 4e7c74ee6cca49f594649b4d754ffafb; no voters: 
I20260709 12:16:57.643824  9129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a062c6b1a04686ae6f927c8cf0b838" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:16:57.644117  9392 raft_consensus.cc:2804] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.644502  9129 raft_consensus.cc:3060] T 45a062c6b1a04686ae6f927c8cf0b838 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.644788  9392 raft_consensus.cc:697] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 LEADER]: Becoming Leader. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Running, Role: LEADER
I20260709 12:16:57.645784  9392 consensus_queue.cc:237] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.648690  9027 catalog_manager.cc:5697] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 reported cstate change: term changed from 1 to 2, leader changed from 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67) to 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.656281  9029 catalog_manager.cc:5697] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb reported cstate change: term changed from 1 to 2, leader changed from 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67) to 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66). New cstate: current_term: 2 leader_uuid: "4e7c74ee6cca49f594649b4d754ffafb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.655256  9129 raft_consensus.cc:2468] T 45a062c6b1a04686ae6f927c8cf0b838 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 2.
I20260709 12:16:57.659332  9328 consensus_queue.cc:1048] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.660612  9327 consensus_queue.cc:1048] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:57.666684  9326 consensus_queue.cc:1048] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.695161  9376 consensus_queue.cc:1048] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.711966  9327 consensus_queue.cc:1048] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:57.713389  9326 raft_consensus.cc:993] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb: : Instructing follower 849b8dd5b8bb411eaf0e0a2288aae6a1 to start an election
I20260709 12:16:57.714143  9376 raft_consensus.cc:1081] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 1 LEADER]: Signalling peer 849b8dd5b8bb411eaf0e0a2288aae6a1 to start an election
I20260709 12:16:57.717296  9129 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d27de9091884e219dac46f087f8aaff"
dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
 from {username='slave'} at 127.0.0.1:39106
I20260709 12:16:57.718138  9129 raft_consensus.cc:493] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:57.718874  9129 raft_consensus.cc:3060] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.727941  9129 raft_consensus.cc:515] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.730697  9129 leader_election.cc:290] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 2 election: Requested vote from peers 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:16:57.731587  9205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d27de9091884e219dac46f087f8aaff" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:16:57.733067  9205 raft_consensus.cc:3055] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:57.733438  9205 raft_consensus.cc:740] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Running, Role: LEADER
I20260709 12:16:57.734180  9279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d27de9091884e219dac46f087f8aaff" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:16:57.734306  9205 consensus_queue.cc:260] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.736236  9205 raft_consensus.cc:3060] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.740842  9398 consensus_queue.cc:1048] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:57.745774  9205 raft_consensus.cc:2468] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 2.
I20260709 12:16:57.735231  9279 raft_consensus.cc:3060] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.749423  9097 leader_election.cc:304] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e7c74ee6cca49f594649b4d754ffafb, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:16:57.750309  9398 raft_consensus.cc:2804] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.750923  9398 raft_consensus.cc:697] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 LEADER]: Becoming Leader. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Running, Role: LEADER
I20260709 12:16:57.751926  9398 consensus_queue.cc:237] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.759575  9327 raft_consensus.cc:993] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1: : Instructing follower 4e7c74ee6cca49f594649b4d754ffafb to start an election
I20260709 12:16:57.760140  9327 raft_consensus.cc:1081] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Signalling peer 4e7c74ee6cca49f594649b4d754ffafb to start an election
I20260709 12:16:57.761368  9279 raft_consensus.cc:2468] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 2.
I20260709 12:16:57.762327  9206 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a404d23da7f43fcb50c7d2126f76d4a"
dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
 from {username='slave'} at 127.0.0.1:58760
I20260709 12:16:57.761159  9027 catalog_manager.cc:5697] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 reported cstate change: term changed from 1 to 2, leader changed from 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66) to 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.763103  9206 raft_consensus.cc:493] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:57.763541  9206 raft_consensus.cc:3060] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.771864  9206 raft_consensus.cc:515] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.774039  9206 leader_election.cc:290] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 2 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:16:57.774853  9129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a404d23da7f43fcb50c7d2126f76d4a" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:16:57.775264  9279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a404d23da7f43fcb50c7d2126f76d4a" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:16:57.775674  9129 raft_consensus.cc:3055] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:57.775943  9279 raft_consensus.cc:3060] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.776077  9129 raft_consensus.cc:740] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Running, Role: LEADER
I20260709 12:16:57.777002  9129 consensus_queue.cc:260] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.778113  9129 raft_consensus.cc:3060] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.782719  9279 raft_consensus.cc:2468] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 2.
I20260709 12:16:57.784001  9129 raft_consensus.cc:2468] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 2.
I20260709 12:16:57.784121  9170 leader_election.cc:304] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 4e7c74ee6cca49f594649b4d754ffafb; no voters: 
I20260709 12:16:57.785044  9376 raft_consensus.cc:2804] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.785481  9376 raft_consensus.cc:697] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [term 2 LEADER]: Becoming Leader. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Running, Role: LEADER
I20260709 12:16:57.786330  9376 consensus_queue.cc:237] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:16:57.793351  9027 catalog_manager.cc:5697] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb reported cstate change: term changed from 1 to 2, leader changed from 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65) to 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66). New cstate: current_term: 2 leader_uuid: "4e7c74ee6cca49f594649b4d754ffafb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.879379  9279 raft_consensus.cc:3060] T 64600ebe7baf4321bc70ad565a1874b2 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.885406  9279 raft_consensus.cc:1275] T 64600ebe7baf4321bc70ad565a1874b2 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Refusing update from remote peer 4e7c74ee6cca49f594649b4d754ffafb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:57.886956  9376 consensus_queue.cc:1048] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:57.896776  9129 raft_consensus.cc:1275] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Refusing update from remote peer 4e7c74ee6cca49f594649b4d754ffafb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:57.898515  9407 consensus_queue.cc:1048] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:57.988873  9279 raft_consensus.cc:1275] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Refusing update from remote peer 849b8dd5b8bb411eaf0e0a2288aae6a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:57.990370  9398 consensus_queue.cc:1048] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:57.993014  9279 raft_consensus.cc:1275] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Refusing update from remote peer 4e7c74ee6cca49f594649b4d754ffafb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:57.994763  9407 consensus_queue.cc:1048] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.002556  9206 raft_consensus.cc:1275] T 47bb7e61288740c6a083cfe1b95fc2ea P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Refusing update from remote peer 849b8dd5b8bb411eaf0e0a2288aae6a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.004107  9327 consensus_queue.cc:1048] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:58.008283  9129 raft_consensus.cc:1275] T e236c3da863a44e096522ad9d8ceaa58 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Refusing update from remote peer 4e7c74ee6cca49f594649b4d754ffafb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.012105  9392 consensus_queue.cc:1048] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.024438  9206 raft_consensus.cc:1275] T 5fe7fdb2ca1d43b1bf6448d810658fed P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Refusing update from remote peer 849b8dd5b8bb411eaf0e0a2288aae6a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.025930  9327 consensus_queue.cc:1048] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.034829  9280 raft_consensus.cc:1275] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Refusing update from remote peer 849b8dd5b8bb411eaf0e0a2288aae6a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.036675  9327 consensus_queue.cc:1048] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.096725  9129 raft_consensus.cc:1275] T 45a062c6b1a04686ae6f927c8cf0b838 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Refusing update from remote peer 4e7c74ee6cca49f594649b4d754ffafb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.098330  9392 consensus_queue.cc:1048] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.106824  9280 raft_consensus.cc:1275] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Refusing update from remote peer 4e7c74ee6cca49f594649b4d754ffafb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.109014  9376 consensus_queue.cc:1048] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.226709  9280 raft_consensus.cc:1275] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Refusing update from remote peer 4e7c74ee6cca49f594649b4d754ffafb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.228242  9376 consensus_queue.cc:1048] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.237283  9129 raft_consensus.cc:1275] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Refusing update from remote peer 4e7c74ee6cca49f594649b4d754ffafb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.239841  9376 consensus_queue.cc:1048] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.245249  9280 raft_consensus.cc:1275] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Refusing update from remote peer 849b8dd5b8bb411eaf0e0a2288aae6a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.247066  9346 consensus_queue.cc:1048] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.248490  9206 raft_consensus.cc:1275] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Refusing update from remote peer 849b8dd5b8bb411eaf0e0a2288aae6a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.252010  9346 consensus_queue.cc:1048] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:00.522841  9029 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43918:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:17:00.525363  9029 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:17:00.584394  9115 tablet_service.cc:1511] Processing CreateTablet for tablet 29b81e8bdfd94606a8ef07d8a45b01ed (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:17:00.585652  9115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29b81e8bdfd94606a8ef07d8a45b01ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.586164  9191 tablet_service.cc:1511] Processing CreateTablet for tablet 29b81e8bdfd94606a8ef07d8a45b01ed (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:17:00.587749  9191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29b81e8bdfd94606a8ef07d8a45b01ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.590721  9114 tablet_service.cc:1511] Processing CreateTablet for tablet 81643c03104b4481b16048823f724518 (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:17:00.592875  9114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81643c03104b4481b16048823f724518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.592298  9268 tablet_service.cc:1511] Processing CreateTablet for tablet 29b81e8bdfd94606a8ef07d8a45b01ed (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:17:00.594907  9268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29b81e8bdfd94606a8ef07d8a45b01ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.599028  9194 tablet_service.cc:1511] Processing CreateTablet for tablet 81643c03104b4481b16048823f724518 (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:17:00.600742  9194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81643c03104b4481b16048823f724518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.599114  9265 tablet_service.cc:1511] Processing CreateTablet for tablet 81643c03104b4481b16048823f724518 (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:17:00.604529  9265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81643c03104b4481b16048823f724518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.632190  9113 tablet_service.cc:1511] Processing CreateTablet for tablet 7f80caa5ccce44dfb84e1bdfb40890ff (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:17:00.633956  9113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f80caa5ccce44dfb84e1bdfb40890ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.638680  9192 tablet_service.cc:1511] Processing CreateTablet for tablet 7f80caa5ccce44dfb84e1bdfb40890ff (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:17:00.640390  9192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f80caa5ccce44dfb84e1bdfb40890ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.647828  9421 tablet_bootstrap.cc:492] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1: Bootstrap starting.
I20260709 12:17:00.652722  9419 tablet_bootstrap.cc:492] T 29b81e8bdfd94606a8ef07d8a45b01ed P 4e7c74ee6cca49f594649b4d754ffafb: Bootstrap starting.
I20260709 12:17:00.666105  9264 tablet_service.cc:1511] Processing CreateTablet for tablet 7f80caa5ccce44dfb84e1bdfb40890ff (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:17:00.667964  9264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f80caa5ccce44dfb84e1bdfb40890ff. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:17:00.675521  9077 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:00.680260  9421 tablet_bootstrap.cc:654] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.683800  9420 tablet_bootstrap.cc:492] T 29b81e8bdfd94606a8ef07d8a45b01ed P 058e0a9d20594e21ab2293398d9f0958: Bootstrap starting.
I20260709 12:17:00.686877  9115 tablet_service.cc:1511] Processing CreateTablet for tablet 4c013a14a40a4f4e81572ddea538a499 (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:17:00.688393  9115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c013a14a40a4f4e81572ddea538a499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.690661  9420 tablet_bootstrap.cc:654] T 29b81e8bdfd94606a8ef07d8a45b01ed P 058e0a9d20594e21ab2293398d9f0958: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.699608  9191 tablet_service.cc:1511] Processing CreateTablet for tablet 4c013a14a40a4f4e81572ddea538a499 (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:17:00.701187  9191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c013a14a40a4f4e81572ddea538a499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.706647  9419 tablet_bootstrap.cc:654] T 29b81e8bdfd94606a8ef07d8a45b01ed P 4e7c74ee6cca49f594649b4d754ffafb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.708545  9268 tablet_service.cc:1511] Processing CreateTablet for tablet 4c013a14a40a4f4e81572ddea538a499 (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:17:00.710222  9268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c013a14a40a4f4e81572ddea538a499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.711102  9114 tablet_service.cc:1511] Processing CreateTablet for tablet e9dd45d5f936427f800b673225451b31 (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:17:00.713707  9114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9dd45d5f936427f800b673225451b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.734855  9195 tablet_service.cc:1511] Processing CreateTablet for tablet e9dd45d5f936427f800b673225451b31 (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:17:00.736450  9195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9dd45d5f936427f800b673225451b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.737109  9270 tablet_service.cc:1511] Processing CreateTablet for tablet e9dd45d5f936427f800b673225451b31 (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:17:00.738619  9118 tablet_service.cc:1511] Processing CreateTablet for tablet 29a1493397a647df9b867e697a235303 (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:17:00.742017  9118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a1493397a647df9b867e697a235303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.741671  9196 tablet_service.cc:1511] Processing CreateTablet for tablet 29a1493397a647df9b867e697a235303 (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:17:00.742512  9262 tablet_service.cc:1511] Processing CreateTablet for tablet 29a1493397a647df9b867e697a235303 (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:17:00.743216  9196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a1493397a647df9b867e697a235303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.738615  9270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9dd45d5f936427f800b673225451b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.744988  9262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a1493397a647df9b867e697a235303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.761822  9116 tablet_service.cc:1511] Processing CreateTablet for tablet 57761cf5069a4757914e17943339e76a (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:17:00.763445  9116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57761cf5069a4757914e17943339e76a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.774080  9196 tablet_service.cc:1511] Processing CreateTablet for tablet 57761cf5069a4757914e17943339e76a (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:17:00.775701  9196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57761cf5069a4757914e17943339e76a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.779881  9113 tablet_service.cc:1511] Processing CreateTablet for tablet 86e972558e17492aa6cabded365ee981 (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:17:00.781504  9113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e972558e17492aa6cabded365ee981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.787494  9265 tablet_service.cc:1511] Processing CreateTablet for tablet 57761cf5069a4757914e17943339e76a (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:17:00.789137  9265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57761cf5069a4757914e17943339e76a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.791203  9269 tablet_service.cc:1511] Processing CreateTablet for tablet 86e972558e17492aa6cabded365ee981 (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:17:00.792768  9269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e972558e17492aa6cabded365ee981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.793277  9420 tablet_bootstrap.cc:492] T 29b81e8bdfd94606a8ef07d8a45b01ed P 058e0a9d20594e21ab2293398d9f0958: No bootstrap required, opened a new log
I20260709 12:17:00.793922  9420 ts_tablet_manager.cc:1403] T 29b81e8bdfd94606a8ef07d8a45b01ed P 058e0a9d20594e21ab2293398d9f0958: Time spent bootstrapping tablet: real 0.110s	user 0.022s	sys 0.012s
I20260709 12:17:00.797902  9420 raft_consensus.cc:359] T 29b81e8bdfd94606a8ef07d8a45b01ed P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:00.798774  9420 raft_consensus.cc:385] T 29b81e8bdfd94606a8ef07d8a45b01ed P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.799094  9420 raft_consensus.cc:740] T 29b81e8bdfd94606a8ef07d8a45b01ed P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.801208  9420 consensus_queue.cc:260] T 29b81e8bdfd94606a8ef07d8a45b01ed P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:00.796146  9115 tablet_service.cc:1511] Processing CreateTablet for tablet 644b89077d9f4d5095bf07700ea052a5 (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:17:00.811774  9115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 644b89077d9f4d5095bf07700ea052a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.787493  9195 tablet_service.cc:1511] Processing CreateTablet for tablet 86e972558e17492aa6cabded365ee981 (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:17:00.821899  9195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e972558e17492aa6cabded365ee981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.822144  9194 tablet_service.cc:1511] Processing CreateTablet for tablet 644b89077d9f4d5095bf07700ea052a5 (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:17:00.823580  9194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 644b89077d9f4d5095bf07700ea052a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:00.824340  9266 tablet_service.cc:1511] Processing CreateTablet for tablet 644b89077d9f4d5095bf07700ea052a5 (DEFAULT_TABLE table=soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:17:00.825457  9266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 644b89077d9f4d5095bf07700ea052a5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:17:00.813937  9170 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:40061, user_credentials={real_user=slave}} blocked reactor thread for 56883.8us
I20260709 12:17:00.837291  9421 tablet_bootstrap.cc:492] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1: No bootstrap required, opened a new log
I20260709 12:17:00.843500  9420 ts_tablet_manager.cc:1434] T 29b81e8bdfd94606a8ef07d8a45b01ed P 058e0a9d20594e21ab2293398d9f0958: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.002s
I20260709 12:17:00.858217  9420 tablet_bootstrap.cc:492] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958: Bootstrap starting.
I20260709 12:17:00.850567  9421 ts_tablet_manager.cc:1403] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent bootstrapping tablet: real 0.203s	user 0.014s	sys 0.006s
I20260709 12:17:00.869884  9421 raft_consensus.cc:359] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:00.870715  9421 raft_consensus.cc:385] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.871037  9421 raft_consensus.cc:740] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.871877  9421 consensus_queue.cc:260] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:00.865960  9419 tablet_bootstrap.cc:492] T 29b81e8bdfd94606a8ef07d8a45b01ed P 4e7c74ee6cca49f594649b4d754ffafb: No bootstrap required, opened a new log
I20260709 12:17:00.873234  9419 ts_tablet_manager.cc:1403] T 29b81e8bdfd94606a8ef07d8a45b01ed P 4e7c74ee6cca49f594649b4d754ffafb: Time spent bootstrapping tablet: real 0.221s	user 0.009s	sys 0.014s
I20260709 12:17:00.876636  9419 raft_consensus.cc:359] T 29b81e8bdfd94606a8ef07d8a45b01ed P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:00.877466  9419 raft_consensus.cc:385] T 29b81e8bdfd94606a8ef07d8a45b01ed P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.877900  9419 raft_consensus.cc:740] T 29b81e8bdfd94606a8ef07d8a45b01ed P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.878924  9419 consensus_queue.cc:260] T 29b81e8bdfd94606a8ef07d8a45b01ed P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:00.888864  9420 tablet_bootstrap.cc:654] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.892567  9419 ts_tablet_manager.cc:1434] T 29b81e8bdfd94606a8ef07d8a45b01ed P 4e7c74ee6cca49f594649b4d754ffafb: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 12:17:00.893886  9419 tablet_bootstrap.cc:492] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb: Bootstrap starting.
I20260709 12:17:00.901018  9419 tablet_bootstrap.cc:654] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.890843  9421 ts_tablet_manager.cc:1434] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 12:17:00.905021  9421 tablet_bootstrap.cc:492] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Bootstrap starting.
I20260709 12:17:00.913666  9421 tablet_bootstrap.cc:654] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.916059  9420 tablet_bootstrap.cc:492] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958: No bootstrap required, opened a new log
I20260709 12:17:00.918871  9420 ts_tablet_manager.cc:1403] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.006s
I20260709 12:17:00.920241  9419 tablet_bootstrap.cc:492] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb: No bootstrap required, opened a new log
I20260709 12:17:00.921088  9419 ts_tablet_manager.cc:1403] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.003s
I20260709 12:17:00.922362  9420 raft_consensus.cc:359] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:00.923278  9420 raft_consensus.cc:385] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.923586  9420 raft_consensus.cc:740] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.924465  9419 raft_consensus.cc:359] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:00.924453  9420 consensus_queue.cc:260] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:00.927204  9420 ts_tablet_manager.cc:1434] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:17:00.928193  9420 tablet_bootstrap.cc:492] T 7f80caa5ccce44dfb84e1bdfb40890ff P 058e0a9d20594e21ab2293398d9f0958: Bootstrap starting.
I20260709 12:17:00.930327  9421 tablet_bootstrap.cc:492] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1: No bootstrap required, opened a new log
I20260709 12:17:00.931102  9421 ts_tablet_manager.cc:1403] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.007s
I20260709 12:17:00.933912  9420 tablet_bootstrap.cc:654] T 7f80caa5ccce44dfb84e1bdfb40890ff P 058e0a9d20594e21ab2293398d9f0958: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.934381  9419 raft_consensus.cc:385] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.934785  9419 raft_consensus.cc:740] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.934875  9421 raft_consensus.cc:359] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:00.936199  9421 raft_consensus.cc:385] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.935781  9419 consensus_queue.cc:260] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:00.939260  9419 ts_tablet_manager.cc:1434] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:17:00.940894  9419 tablet_bootstrap.cc:492] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb: Bootstrap starting.
I20260709 12:17:00.936681  9421 raft_consensus.cc:740] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.943297  9421 consensus_queue.cc:260] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:00.946122  9421 ts_tablet_manager.cc:1434] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:17:00.947208  9420 tablet_bootstrap.cc:492] T 7f80caa5ccce44dfb84e1bdfb40890ff P 058e0a9d20594e21ab2293398d9f0958: No bootstrap required, opened a new log
I20260709 12:17:00.947376  9421 tablet_bootstrap.cc:492] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1: Bootstrap starting.
I20260709 12:17:00.947899  9420 ts_tablet_manager.cc:1403] T 7f80caa5ccce44dfb84e1bdfb40890ff P 058e0a9d20594e21ab2293398d9f0958: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.001s
I20260709 12:17:00.951012  9419 tablet_bootstrap.cc:654] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.951354  9420 raft_consensus.cc:359] T 7f80caa5ccce44dfb84e1bdfb40890ff P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:00.952216  9420 raft_consensus.cc:385] T 7f80caa5ccce44dfb84e1bdfb40890ff P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.952550  9420 raft_consensus.cc:740] T 7f80caa5ccce44dfb84e1bdfb40890ff P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.955991  9421 tablet_bootstrap.cc:654] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.956262  9420 consensus_queue.cc:260] T 7f80caa5ccce44dfb84e1bdfb40890ff P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:00.959136  9420 ts_tablet_manager.cc:1434] T 7f80caa5ccce44dfb84e1bdfb40890ff P 058e0a9d20594e21ab2293398d9f0958: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:17:00.960357  9420 tablet_bootstrap.cc:492] T 4c013a14a40a4f4e81572ddea538a499 P 058e0a9d20594e21ab2293398d9f0958: Bootstrap starting.
I20260709 12:17:00.968895  9419 tablet_bootstrap.cc:492] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb: No bootstrap required, opened a new log
I20260709 12:17:00.969607  9419 ts_tablet_manager.cc:1403] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.010s
I20260709 12:17:00.970116  9421 tablet_bootstrap.cc:492] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1: No bootstrap required, opened a new log
I20260709 12:17:00.970803  9421 ts_tablet_manager.cc:1403] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.015s
I20260709 12:17:00.973048  9419 raft_consensus.cc:359] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:00.973989  9419 raft_consensus.cc:385] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.974453  9419 raft_consensus.cc:740] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.974027  9421 raft_consensus.cc:359] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:00.974995  9421 raft_consensus.cc:385] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.975363  9421 raft_consensus.cc:740] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.976228  9421 consensus_queue.cc:260] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:00.978817  9421 ts_tablet_manager.cc:1434] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:17:00.975364  9419 consensus_queue.cc:260] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:00.980144  9420 tablet_bootstrap.cc:654] T 4c013a14a40a4f4e81572ddea538a499 P 058e0a9d20594e21ab2293398d9f0958: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.982949  9421 tablet_bootstrap.cc:492] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Bootstrap starting.
I20260709 12:17:00.984938  9419 ts_tablet_manager.cc:1434] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 12:17:00.986284  9419 tablet_bootstrap.cc:492] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb: Bootstrap starting.
I20260709 12:17:00.991151  9421 tablet_bootstrap.cc:654] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.993932  9419 tablet_bootstrap.cc:654] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.996300  9420 tablet_bootstrap.cc:492] T 4c013a14a40a4f4e81572ddea538a499 P 058e0a9d20594e21ab2293398d9f0958: No bootstrap required, opened a new log
I20260709 12:17:00.996992  9420 ts_tablet_manager.cc:1403] T 4c013a14a40a4f4e81572ddea538a499 P 058e0a9d20594e21ab2293398d9f0958: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.004s
I20260709 12:17:01.000691  9420 raft_consensus.cc:359] T 4c013a14a40a4f4e81572ddea538a499 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.001539  9420 raft_consensus.cc:385] T 4c013a14a40a4f4e81572ddea538a499 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.001897  9420 raft_consensus.cc:740] T 4c013a14a40a4f4e81572ddea538a499 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.002794  9420 consensus_queue.cc:260] T 4c013a14a40a4f4e81572ddea538a499 P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.007828  9420 ts_tablet_manager.cc:1434] T 4c013a14a40a4f4e81572ddea538a499 P 058e0a9d20594e21ab2293398d9f0958: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:17:01.009061  9420 tablet_bootstrap.cc:492] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958: Bootstrap starting.
I20260709 12:17:01.008985  9348 raft_consensus.cc:493] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.009730  9348 raft_consensus.cc:515] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.011674  9421 tablet_bootstrap.cc:492] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1: No bootstrap required, opened a new log
I20260709 12:17:01.012382  9421 ts_tablet_manager.cc:1403] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.011s
I20260709 12:17:01.014878  9419 tablet_bootstrap.cc:492] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb: No bootstrap required, opened a new log
I20260709 12:17:01.015022  9348 leader_election.cc:290] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:17:01.015909  9419 ts_tablet_manager.cc:1403] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.011s
I20260709 12:17:01.014902  9129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81643c03104b4481b16048823f724518" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" is_pre_election: true
I20260709 12:17:01.016391  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81643c03104b4481b16048823f724518" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb" is_pre_election: true
I20260709 12:17:01.016709  9129 raft_consensus.cc:2468] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 0.
W20260709 12:17:01.018272  9246 leader_election.cc:343] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.018947  9245 leader_election.cc:304] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 4e7c74ee6cca49f594649b4d754ffafb
I20260709 12:17:01.019840  9348 raft_consensus.cc:2804] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:01.020237  9348 raft_consensus.cc:493] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.020092  9421 raft_consensus.cc:359] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.020738  9348 raft_consensus.cc:3060] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.021349  9421 raft_consensus.cc:385] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.021203  9419 raft_consensus.cc:359] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.021782  9421 raft_consensus.cc:740] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.022117  9419 raft_consensus.cc:385] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.022490  9419 raft_consensus.cc:740] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.022753  9421 consensus_queue.cc:260] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.023612  9419 consensus_queue.cc:260] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.026638  9421 ts_tablet_manager.cc:1434] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:17:01.027486  9419 ts_tablet_manager.cc:1434] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:17:01.028709  9419 tablet_bootstrap.cc:492] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb: Bootstrap starting.
I20260709 12:17:01.033387  9421 tablet_bootstrap.cc:492] T 29a1493397a647df9b867e697a235303 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Bootstrap starting.
I20260709 12:17:01.033694  9420 tablet_bootstrap.cc:654] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.035362  9419 tablet_bootstrap.cc:654] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.038702  9423 raft_consensus.cc:493] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.039336  9423 raft_consensus.cc:515] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.043987  9421 tablet_bootstrap.cc:654] T 29a1493397a647df9b867e697a235303 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.045648  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f80caa5ccce44dfb84e1bdfb40890ff" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958" is_pre_election: true
I20260709 12:17:01.046540  9280 raft_consensus.cc:2468] T 7f80caa5ccce44dfb84e1bdfb40890ff P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 0.
I20260709 12:17:01.047847  9129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f80caa5ccce44dfb84e1bdfb40890ff" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" is_pre_election: true
I20260709 12:17:01.048645  9129 raft_consensus.cc:2468] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 0.
I20260709 12:17:01.051471  9170 leader_election.cc:304] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 4e7c74ee6cca49f594649b4d754ffafb; no voters: 
I20260709 12:17:01.053611  9326 raft_consensus.cc:2804] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:01.054003  9326 raft_consensus.cc:493] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.054322  9326 raft_consensus.cc:3060] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.056133  9348 raft_consensus.cc:515] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.058939  9421 tablet_bootstrap.cc:492] T 29a1493397a647df9b867e697a235303 P 849b8dd5b8bb411eaf0e0a2288aae6a1: No bootstrap required, opened a new log
I20260709 12:17:01.059147  9348 leader_election.cc:290] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:17:01.059553  9130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81643c03104b4481b16048823f724518" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:17:01.059959  9421 ts_tablet_manager.cc:1403] T 29a1493397a647df9b867e697a235303 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.003s
I20260709 12:17:01.060259  9408 raft_consensus.cc:493] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.060957  9408 raft_consensus.cc:515] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.060221  9130 raft_consensus.cc:3060] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.063233  9419 tablet_bootstrap.cc:492] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb: No bootstrap required, opened a new log
I20260709 12:17:01.063964  9419 ts_tablet_manager.cc:1403] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.014s
I20260709 12:17:01.063519  9421 raft_consensus.cc:359] T 29a1493397a647df9b867e697a235303 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.064348  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81643c03104b4481b16048823f724518" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:17:01.064368  9421 raft_consensus.cc:385] T 29a1493397a647df9b867e697a235303 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.065047  9421 raft_consensus.cc:740] T 29a1493397a647df9b867e697a235303 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.065840  9421 consensus_queue.cc:260] T 29a1493397a647df9b867e697a235303 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.067440  9419 raft_consensus.cc:359] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.068220  9419 raft_consensus.cc:385] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:17:01.068480  9246 leader_election.cc:343] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.068506  9419 raft_consensus.cc:740] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.069530  9419 consensus_queue.cc:260] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.070088  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b81e8bdfd94606a8ef07d8a45b01ed" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958" is_pre_election: true
I20260709 12:17:01.070883  9280 raft_consensus.cc:2468] T 29b81e8bdfd94606a8ef07d8a45b01ed P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 0.
I20260709 12:17:01.071329  9421 ts_tablet_manager.cc:1434] T 29a1493397a647df9b867e697a235303 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 12:17:01.072057  9423 leader_election.cc:290] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:17:01.072428  9095 leader_election.cc:304] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:17:01.073009  9421 tablet_bootstrap.cc:492] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Bootstrap starting.
I20260709 12:17:01.073431  9346 raft_consensus.cc:2804] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:01.073880  9346 raft_consensus.cc:493] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.074229  9346 raft_consensus.cc:3060] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.075910  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b81e8bdfd94606a8ef07d8a45b01ed" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb" is_pre_election: true
I20260709 12:17:01.076668  9206 raft_consensus.cc:2468] T 29b81e8bdfd94606a8ef07d8a45b01ed P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 0.
I20260709 12:17:01.063066  9408 leader_election.cc:290] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:17:01.080348  9419 ts_tablet_manager.cc:1434] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.008s
I20260709 12:17:01.081763  9419 tablet_bootstrap.cc:492] T 4c013a14a40a4f4e81572ddea538a499 P 4e7c74ee6cca49f594649b4d754ffafb: Bootstrap starting.
I20260709 12:17:01.083773  9421 tablet_bootstrap.cc:654] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.088913  9419 tablet_bootstrap.cc:654] T 4c013a14a40a4f4e81572ddea538a499 P 4e7c74ee6cca49f594649b4d754ffafb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.098289  9421 tablet_bootstrap.cc:492] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1: No bootstrap required, opened a new log
I20260709 12:17:01.099152  9421 ts_tablet_manager.cc:1403] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.005s
I20260709 12:17:01.101616  9346 raft_consensus.cc:515] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.103390  9421 raft_consensus.cc:359] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.104357  9419 tablet_bootstrap.cc:492] T 4c013a14a40a4f4e81572ddea538a499 P 4e7c74ee6cca49f594649b4d754ffafb: No bootstrap required, opened a new log
I20260709 12:17:01.105798  9421 raft_consensus.cc:385] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.106153  9421 raft_consensus.cc:740] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.106988  9421 consensus_queue.cc:260] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.107645  9346 leader_election.cc:290] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 election: Requested vote from peers 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:17:01.108472  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b81e8bdfd94606a8ef07d8a45b01ed" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:17:01.106200  9419 ts_tablet_manager.cc:1403] T 4c013a14a40a4f4e81572ddea538a499 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.004s
I20260709 12:17:01.109335  9206 raft_consensus.cc:3060] T 29b81e8bdfd94606a8ef07d8a45b01ed P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.110291  9421 ts_tablet_manager.cc:1434] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:17:01.111923  9421 tablet_bootstrap.cc:492] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1: Bootstrap starting.
I20260709 12:17:01.112262  9419 raft_consensus.cc:359] T 4c013a14a40a4f4e81572ddea538a499 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.113101  9419 raft_consensus.cc:385] T 4c013a14a40a4f4e81572ddea538a499 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.113418  9419 raft_consensus.cc:740] T 4c013a14a40a4f4e81572ddea538a499 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.114285  9419 consensus_queue.cc:260] T 4c013a14a40a4f4e81572ddea538a499 P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.104784  9130 raft_consensus.cc:2468] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 1.
I20260709 12:17:01.104260  9326 raft_consensus.cc:515] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.119988  9245 leader_election.cc:304] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 4e7c74ee6cca49f594649b4d754ffafb
I20260709 12:17:01.120903  9348 raft_consensus.cc:2804] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:01.122743  9437 raft_consensus.cc:493] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.123749  9437 raft_consensus.cc:515] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.132717  9130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f80caa5ccce44dfb84e1bdfb40890ff" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:17:01.133594  9130 raft_consensus.cc:3060] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.151646  9421 tablet_bootstrap.cc:654] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:01.157491  9095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.67:40061, user_credentials={real_user=slave}} blocked reactor thread for 60464us
I20260709 12:17:01.159484  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b81e8bdfd94606a8ef07d8a45b01ed" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:17:01.159842  9419 ts_tablet_manager.cc:1434] T 4c013a14a40a4f4e81572ddea538a499 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent starting tablet: real 0.051s	user 0.012s	sys 0.002s
I20260709 12:17:01.160292  9280 raft_consensus.cc:3060] T 29b81e8bdfd94606a8ef07d8a45b01ed P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.161711  9419 tablet_bootstrap.cc:492] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb: Bootstrap starting.
I20260709 12:17:01.167726  9437 leader_election.cc:290] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:17:01.167743  9326 leader_election.cc:290] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:17:01.168845  9279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f80caa5ccce44dfb84e1bdfb40890ff" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:17:01.169611  9279 raft_consensus.cc:3060] T 7f80caa5ccce44dfb84e1bdfb40890ff P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.172662  9130 raft_consensus.cc:2468] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 1.
I20260709 12:17:01.173758  9277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81643c03104b4481b16048823f724518" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958" is_pre_election: true
I20260709 12:17:01.175030  9280 raft_consensus.cc:2468] T 29b81e8bdfd94606a8ef07d8a45b01ed P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 1.
I20260709 12:17:01.178727  9348 raft_consensus.cc:697] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Becoming Leader. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Running, Role: LEADER
I20260709 12:17:01.179294  9419 tablet_bootstrap.cc:654] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.180538  9171 leader_election.cc:304] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e7c74ee6cca49f594649b4d754ffafb, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:17:01.186283  9348 consensus_queue.cc:237] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.186362  9326 raft_consensus.cc:2804] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:01.190454  9326 raft_consensus.cc:697] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [term 1 LEADER]: Becoming Leader. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Running, Role: LEADER
I20260709 12:17:01.191380  9326 consensus_queue.cc:237] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.187569  9095 leader_election.cc:304] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:17:01.194479  9408 raft_consensus.cc:2804] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:01.195247  9408 raft_consensus.cc:697] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Becoming Leader. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Running, Role: LEADER
I20260709 12:17:01.196309  9408 consensus_queue.cc:237] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.197340  9130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81643c03104b4481b16048823f724518" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" is_pre_election: true
I20260709 12:17:01.198315  9130 raft_consensus.cc:2393] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e7c74ee6cca49f594649b4d754ffafb in current term 1: Already voted for candidate 058e0a9d20594e21ab2293398d9f0958 in this term.
I20260709 12:17:01.189812  9346 raft_consensus.cc:493] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.201740  9346 raft_consensus.cc:515] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.181043  9206 raft_consensus.cc:2468] T 29b81e8bdfd94606a8ef07d8a45b01ed P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 1.
I20260709 12:17:01.184095  9421 tablet_bootstrap.cc:492] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1: No bootstrap required, opened a new log
I20260709 12:17:01.184958  9420 tablet_bootstrap.cc:492] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958: No bootstrap required, opened a new log
I20260709 12:17:01.204608  9421 ts_tablet_manager.cc:1403] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent bootstrapping tablet: real 0.093s	user 0.028s	sys 0.039s
I20260709 12:17:01.205297  9346 leader_election.cc:290] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:17:01.207137  9278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c013a14a40a4f4e81572ddea538a499" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958" is_pre_election: true
I20260709 12:17:01.208076  9278 raft_consensus.cc:2468] T 4c013a14a40a4f4e81572ddea538a499 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 0.
I20260709 12:17:01.208319  9421 raft_consensus.cc:359] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.209195  9421 raft_consensus.cc:385] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.209506  9421 raft_consensus.cc:740] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.209852  9095 leader_election.cc:304] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:17:01.211018  9346 raft_consensus.cc:2804] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:01.211452  9346 raft_consensus.cc:493] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.210315  9421 consensus_queue.cc:260] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.211820  9346 raft_consensus.cc:3060] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.213786  9421 ts_tablet_manager.cc:1434] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:17:01.215323  9421 tablet_bootstrap.cc:492] T e9dd45d5f936427f800b673225451b31 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Bootstrap starting.
I20260709 12:17:01.189057  9279 raft_consensus.cc:2468] T 7f80caa5ccce44dfb84e1bdfb40890ff P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 1.
I20260709 12:17:01.216023  9420 ts_tablet_manager.cc:1403] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958: Time spent bootstrapping tablet: real 0.207s	user 0.014s	sys 0.006s
I20260709 12:17:01.216058  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c013a14a40a4f4e81572ddea538a499" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb" is_pre_election: true
I20260709 12:17:01.223094  9206 raft_consensus.cc:2468] T 4c013a14a40a4f4e81572ddea538a499 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 0.
I20260709 12:17:01.225737  9420 raft_consensus.cc:359] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.226639  9420 raft_consensus.cc:385] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.226948  9420 raft_consensus.cc:740] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.227787  9420 consensus_queue.cc:260] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.234632  9420 ts_tablet_manager.cc:1434] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:17:01.236371  9420 tablet_bootstrap.cc:492] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958: Bootstrap starting.
I20260709 12:17:01.236944  9421 tablet_bootstrap.cc:654] T e9dd45d5f936427f800b673225451b31 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.241487  9170 leader_election.cc:304] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e7c74ee6cca49f594649b4d754ffafb; no voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1
I20260709 12:17:01.244349  9419 tablet_bootstrap.cc:492] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb: No bootstrap required, opened a new log
I20260709 12:17:01.248610  9437 raft_consensus.cc:3060] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.252120  9027 catalog_manager.cc:5697] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:01.256536  9346 raft_consensus.cc:515] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.259894  9346 leader_election.cc:290] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 election: Requested vote from peers 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:17:01.261358  9420 tablet_bootstrap.cc:654] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.261471  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c013a14a40a4f4e81572ddea538a499" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:17:01.262352  9206 raft_consensus.cc:3060] T 4c013a14a40a4f4e81572ddea538a499 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.261606  9029 catalog_manager.cc:5697] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66). New cstate: current_term: 1 leader_uuid: "4e7c74ee6cca49f594649b4d754ffafb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:01.264348  9437 raft_consensus.cc:2749] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:01.266700  9277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c013a14a40a4f4e81572ddea538a499" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:17:01.267679  9277 raft_consensus.cc:3060] T 4c013a14a40a4f4e81572ddea538a499 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.271695  9206 raft_consensus.cc:2468] T 4c013a14a40a4f4e81572ddea538a499 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 1.
I20260709 12:17:01.265396  9419 ts_tablet_manager.cc:1403] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb: Time spent bootstrapping tablet: real 0.104s	user 0.018s	sys 0.043s
I20260709 12:17:01.273463  9097 leader_election.cc:304] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e7c74ee6cca49f594649b4d754ffafb, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:17:01.274358  9346 raft_consensus.cc:2804] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:01.274979  9346 raft_consensus.cc:697] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Becoming Leader. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Running, Role: LEADER
I20260709 12:17:01.275913  9346 consensus_queue.cc:237] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.276162  9408 raft_consensus.cc:493] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.276942  9408 raft_consensus.cc:515] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.277580  9419 raft_consensus.cc:359] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.284564  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e972558e17492aa6cabded365ee981" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb" is_pre_election: true
I20260709 12:17:01.285084  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e972558e17492aa6cabded365ee981" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958" is_pre_election: true
W20260709 12:17:01.289484  9095 leader_election.cc:343] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:01.290479  9097 leader_election.cc:343] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.292034  9097 leader_election.cc:304] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 058e0a9d20594e21ab2293398d9f0958, 4e7c74ee6cca49f594649b4d754ffafb
I20260709 12:17:01.293308  9346 raft_consensus.cc:2749] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:01.293699  9277 raft_consensus.cc:2468] T 4c013a14a40a4f4e81572ddea538a499 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 1.
I20260709 12:17:01.287843  9419 raft_consensus.cc:385] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.295674  9419 raft_consensus.cc:740] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.296636  9408 leader_election.cc:290] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:17:01.297055  9419 consensus_queue.cc:260] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.274467  9026 catalog_manager.cc:5697] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 reported cstate change: term changed from 0 to 1, leader changed from <none> to 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "058e0a9d20594e21ab2293398d9f0958" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:01.303313  9419 ts_tablet_manager.cc:1434] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 12:17:01.304544  9419 tablet_bootstrap.cc:492] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb: Bootstrap starting.
I20260709 12:17:01.307250  9420 tablet_bootstrap.cc:492] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958: No bootstrap required, opened a new log
I20260709 12:17:01.307957  9420 ts_tablet_manager.cc:1403] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958: Time spent bootstrapping tablet: real 0.072s	user 0.019s	sys 0.016s
I20260709 12:17:01.309576  9421 tablet_bootstrap.cc:492] T e9dd45d5f936427f800b673225451b31 P 849b8dd5b8bb411eaf0e0a2288aae6a1: No bootstrap required, opened a new log
I20260709 12:17:01.310143  9421 ts_tablet_manager.cc:1403] T e9dd45d5f936427f800b673225451b31 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent bootstrapping tablet: real 0.095s	user 0.029s	sys 0.012s
I20260709 12:17:01.311708  9419 tablet_bootstrap.cc:654] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.311455  9420 raft_consensus.cc:359] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.312332  9420 raft_consensus.cc:385] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.312724  9420 raft_consensus.cc:740] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.312917  9421 raft_consensus.cc:359] T e9dd45d5f936427f800b673225451b31 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.313665  9421 raft_consensus.cc:385] T e9dd45d5f936427f800b673225451b31 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.313947  9421 raft_consensus.cc:740] T e9dd45d5f936427f800b673225451b31 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.313690  9420 consensus_queue.cc:260] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.317441  9420 ts_tablet_manager.cc:1434] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:17:01.317245  9421 consensus_queue.cc:260] T e9dd45d5f936427f800b673225451b31 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.318003  9419 tablet_bootstrap.cc:492] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb: No bootstrap required, opened a new log
I20260709 12:17:01.318720  9419 ts_tablet_manager.cc:1403] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.001s
I20260709 12:17:01.319008  9420 tablet_bootstrap.cc:492] T 57761cf5069a4757914e17943339e76a P 058e0a9d20594e21ab2293398d9f0958: Bootstrap starting.
I20260709 12:17:01.319602  9421 ts_tablet_manager.cc:1434] T e9dd45d5f936427f800b673225451b31 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260709 12:17:01.320684  9421 tablet_bootstrap.cc:492] T 644b89077d9f4d5095bf07700ea052a5 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Bootstrap starting.
I20260709 12:17:01.323630  9419 raft_consensus.cc:359] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.324429  9419 raft_consensus.cc:385] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.324883  9419 raft_consensus.cc:740] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.325645  9419 consensus_queue.cc:260] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.328264  9419 ts_tablet_manager.cc:1434] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:17:01.329348  9419 tablet_bootstrap.cc:492] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb: Bootstrap starting.
I20260709 12:17:01.330709  9420 tablet_bootstrap.cc:654] T 57761cf5069a4757914e17943339e76a P 058e0a9d20594e21ab2293398d9f0958: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.333842  9421 tablet_bootstrap.cc:654] T 644b89077d9f4d5095bf07700ea052a5 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.338778  9419 tablet_bootstrap.cc:654] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.348114  9437 raft_consensus.cc:493] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.348765  9437 raft_consensus.cc:515] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.352451  9277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9dd45d5f936427f800b673225451b31" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958" is_pre_election: true
I20260709 12:17:01.352144  9028 catalog_manager.cc:5697] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:01.354255  9170 leader_election.cc:343] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.355002  9437 leader_election.cc:290] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:17:01.359838  9130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9dd45d5f936427f800b673225451b31" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" is_pre_election: true
I20260709 12:17:01.360692  9130 raft_consensus.cc:2468] T e9dd45d5f936427f800b673225451b31 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 0.
I20260709 12:17:01.362131  9171 leader_election.cc:304] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e7c74ee6cca49f594649b4d754ffafb, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 058e0a9d20594e21ab2293398d9f0958
I20260709 12:17:01.363306  9437 raft_consensus.cc:2804] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:01.363682  9437 raft_consensus.cc:493] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.364029  9437 raft_consensus.cc:3060] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.376148  9421 tablet_bootstrap.cc:492] T 644b89077d9f4d5095bf07700ea052a5 P 849b8dd5b8bb411eaf0e0a2288aae6a1: No bootstrap required, opened a new log
I20260709 12:17:01.376842  9421 ts_tablet_manager.cc:1403] T 644b89077d9f4d5095bf07700ea052a5 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent bootstrapping tablet: real 0.056s	user 0.020s	sys 0.027s
I20260709 12:17:01.379235  9420 tablet_bootstrap.cc:492] T 57761cf5069a4757914e17943339e76a P 058e0a9d20594e21ab2293398d9f0958: No bootstrap required, opened a new log
I20260709 12:17:01.380004  9420 ts_tablet_manager.cc:1403] T 57761cf5069a4757914e17943339e76a P 058e0a9d20594e21ab2293398d9f0958: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.032s
I20260709 12:17:01.379917  9421 raft_consensus.cc:359] T 644b89077d9f4d5095bf07700ea052a5 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.380877  9421 raft_consensus.cc:385] T 644b89077d9f4d5095bf07700ea052a5 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.381191  9421 raft_consensus.cc:740] T 644b89077d9f4d5095bf07700ea052a5 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.381889  9421 consensus_queue.cc:260] T 644b89077d9f4d5095bf07700ea052a5 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.384054  9421 ts_tablet_manager.cc:1434] T 644b89077d9f4d5095bf07700ea052a5 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:17:01.385646  9420 raft_consensus.cc:359] T 57761cf5069a4757914e17943339e76a P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.386370  9420 raft_consensus.cc:385] T 57761cf5069a4757914e17943339e76a P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.386723  9420 raft_consensus.cc:740] T 57761cf5069a4757914e17943339e76a P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.387554  9420 consensus_queue.cc:260] T 57761cf5069a4757914e17943339e76a P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.389168  9348 raft_consensus.cc:493] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.389664  9348 raft_consensus.cc:515] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.390095  9419 tablet_bootstrap.cc:492] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb: No bootstrap required, opened a new log
I20260709 12:17:01.390479  9420 ts_tablet_manager.cc:1434] T 57761cf5069a4757914e17943339e76a P 058e0a9d20594e21ab2293398d9f0958: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 12:17:01.390707  9419 ts_tablet_manager.cc:1403] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.006s
I20260709 12:17:01.391732  9420 tablet_bootstrap.cc:492] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958: Bootstrap starting.
I20260709 12:17:01.392047  9348 leader_election.cc:290] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:17:01.393383  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a1493397a647df9b867e697a235303" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb" is_pre_election: true
I20260709 12:17:01.393767  9408 raft_consensus.cc:493] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.394145  9206 raft_consensus.cc:2468] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 0.
I20260709 12:17:01.394827  9437 raft_consensus.cc:515] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.395370  9130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a1493397a647df9b867e697a235303" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" is_pre_election: true
I20260709 12:17:01.395955  9246 leader_election.cc:304] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 4e7c74ee6cca49f594649b4d754ffafb; no voters: 
I20260709 12:17:01.396191  9130 raft_consensus.cc:2468] T 29a1493397a647df9b867e697a235303 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 0.
I20260709 12:17:01.396925  9348 raft_consensus.cc:2804] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:01.397318  9437 leader_election.cc:290] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:17:01.397341  9348 raft_consensus.cc:493] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.398010  9348 raft_consensus.cc:3060] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.398794  9277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9dd45d5f936427f800b673225451b31" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:17:01.400112  9420 tablet_bootstrap.cc:654] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:01.400472  9170 leader_election.cc:343] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.400025  9419 raft_consensus.cc:359] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.401054  9419 raft_consensus.cc:385] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.401407  9419 raft_consensus.cc:740] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.404013  9130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9dd45d5f936427f800b673225451b31" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:17:01.405489  9130 raft_consensus.cc:3060] T e9dd45d5f936427f800b673225451b31 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.406654  9348 raft_consensus.cc:515] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.410509  9129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a1493397a647df9b867e697a235303" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:17:01.397151  9408 raft_consensus.cc:515] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.411247  9129 raft_consensus.cc:3060] T 29a1493397a647df9b867e697a235303 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.411378  9419 consensus_queue.cc:260] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.414176  9419 ts_tablet_manager.cc:1434] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:17:01.414463  9277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57761cf5069a4757914e17943339e76a" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958" is_pre_election: true
I20260709 12:17:01.415251  9277 raft_consensus.cc:2468] T 57761cf5069a4757914e17943339e76a P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 0.
I20260709 12:17:01.415481  9348 leader_election.cc:290] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:17:01.415798  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57761cf5069a4757914e17943339e76a" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb" is_pre_election: true
I20260709 12:17:01.416468  9206 raft_consensus.cc:2468] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 0.
I20260709 12:17:01.416647  9095 leader_election.cc:304] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:17:01.417601  9408 leader_election.cc:290] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:17:01.417930  9346 raft_consensus.cc:2804] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:01.418417  9346 raft_consensus.cc:493] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.418848  9346 raft_consensus.cc:3060] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.418934  9420 tablet_bootstrap.cc:492] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958: No bootstrap required, opened a new log
I20260709 12:17:01.419646  9420 ts_tablet_manager.cc:1403] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.004s
I20260709 12:17:01.422228  9205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a1493397a647df9b867e697a235303" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:17:01.423020  9205 raft_consensus.cc:3060] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.422901  9420 raft_consensus.cc:359] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.423816  9420 raft_consensus.cc:385] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.424122  9420 raft_consensus.cc:740] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.424861  9420 consensus_queue.cc:260] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.425333  9129 raft_consensus.cc:2468] T 29a1493397a647df9b867e697a235303 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 1.
I20260709 12:17:01.427153  9420 ts_tablet_manager.cc:1434] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:17:01.427386  9245 leader_election.cc:304] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:17:01.428198  9420 tablet_bootstrap.cc:492] T e9dd45d5f936427f800b673225451b31 P 058e0a9d20594e21ab2293398d9f0958: Bootstrap starting.
I20260709 12:17:01.429997  9348 raft_consensus.cc:2804] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:01.430681  9348 raft_consensus.cc:697] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Becoming Leader. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Running, Role: LEADER
I20260709 12:17:01.431586  9348 consensus_queue.cc:237] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.436580  9420 tablet_bootstrap.cc:654] T e9dd45d5f936427f800b673225451b31 P 058e0a9d20594e21ab2293398d9f0958: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.446712  9130 raft_consensus.cc:2468] T e9dd45d5f936427f800b673225451b31 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 1.
I20260709 12:17:01.446556  9346 raft_consensus.cc:515] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.448107  9171 leader_election.cc:304] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e7c74ee6cca49f594649b4d754ffafb, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 058e0a9d20594e21ab2293398d9f0958
I20260709 12:17:01.449126  9420 tablet_bootstrap.cc:492] T e9dd45d5f936427f800b673225451b31 P 058e0a9d20594e21ab2293398d9f0958: No bootstrap required, opened a new log
I20260709 12:17:01.449388  9437 raft_consensus.cc:2804] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:01.449396  9346 leader_election.cc:290] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 election: Requested vote from peers 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:17:01.449765  9420 ts_tablet_manager.cc:1403] T e9dd45d5f936427f800b673225451b31 P 058e0a9d20594e21ab2293398d9f0958: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.004s
I20260709 12:17:01.450219  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57761cf5069a4757914e17943339e76a" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:17:01.450917  9206 raft_consensus.cc:3060] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.451200  9277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57761cf5069a4757914e17943339e76a" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:17:01.451833  9277 raft_consensus.cc:3060] T 57761cf5069a4757914e17943339e76a P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.453090  9420 raft_consensus.cc:359] T e9dd45d5f936427f800b673225451b31 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.453770  9437 raft_consensus.cc:697] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 LEADER]: Becoming Leader. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Running, Role: LEADER
I20260709 12:17:01.453996  9420 raft_consensus.cc:385] T e9dd45d5f936427f800b673225451b31 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.454296  9420 raft_consensus.cc:740] T e9dd45d5f936427f800b673225451b31 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.455156  9420 consensus_queue.cc:260] T e9dd45d5f936427f800b673225451b31 P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.455322  9437 consensus_queue.cc:237] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.453001  9026 catalog_manager.cc:5697] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 reported cstate change: term changed from 0 to 1, leader changed from <none> to 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "058e0a9d20594e21ab2293398d9f0958" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:01.457372  9420 ts_tablet_manager.cc:1434] T e9dd45d5f936427f800b673225451b31 P 058e0a9d20594e21ab2293398d9f0958: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:17:01.458724  9205 raft_consensus.cc:2468] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 1.
I20260709 12:17:01.458752  9206 raft_consensus.cc:2468] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 1.
I20260709 12:17:01.461656  9097 leader_election.cc:304] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e7c74ee6cca49f594649b4d754ffafb, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:17:01.462502  9346 raft_consensus.cc:2804] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:01.462998  9346 raft_consensus.cc:697] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Becoming Leader. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Running, Role: LEADER
I20260709 12:17:01.463864  9346 consensus_queue.cc:237] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.468266  9277 raft_consensus.cc:2468] T 57761cf5069a4757914e17943339e76a P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 1.
I20260709 12:17:01.467998  9027 catalog_manager.cc:5697] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66). New cstate: current_term: 1 leader_uuid: "4e7c74ee6cca49f594649b4d754ffafb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:01.478118  9028 catalog_manager.cc:5697] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65). New cstate: current_term: 1 leader_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:01.508998  9348 raft_consensus.cc:493] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.509706  9348 raft_consensus.cc:515] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.511765  9348 leader_election.cc:290] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:17:01.512862  9130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e972558e17492aa6cabded365ee981" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" is_pre_election: true
I20260709 12:17:01.512876  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e972558e17492aa6cabded365ee981" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb" is_pre_election: true
I20260709 12:17:01.513919  9130 raft_consensus.cc:2468] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 0.
I20260709 12:17:01.513922  9206 raft_consensus.cc:2468] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 0.
I20260709 12:17:01.515358  9246 leader_election.cc:304] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 4e7c74ee6cca49f594649b4d754ffafb; no voters: 
I20260709 12:17:01.516209  9348 raft_consensus.cc:2804] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:01.516564  9348 raft_consensus.cc:493] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.516856  9348 raft_consensus.cc:3060] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.523288  9348 raft_consensus.cc:515] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.525225  9348 leader_election.cc:290] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:17:01.526147  9130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e972558e17492aa6cabded365ee981" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:17:01.526436  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e972558e17492aa6cabded365ee981" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:17:01.526957  9130 raft_consensus.cc:3060] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.527010  9206 raft_consensus.cc:3060] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.535154  9130 raft_consensus.cc:2468] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 1.
I20260709 12:17:01.535537  9206 raft_consensus.cc:2468] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 1.
I20260709 12:17:01.536728  9245 leader_election.cc:304] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:17:01.537899  9348 raft_consensus.cc:2804] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:01.538504  9348 raft_consensus.cc:697] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Becoming Leader. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Running, Role: LEADER
I20260709 12:17:01.539357  9348 consensus_queue.cc:237] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.543655  9437 raft_consensus.cc:493] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.544356  9437 raft_consensus.cc:515] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.546692  9437 leader_election.cc:290] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:17:01.547506  9130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644b89077d9f4d5095bf07700ea052a5" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" is_pre_election: true
I20260709 12:17:01.547888  9277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644b89077d9f4d5095bf07700ea052a5" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958" is_pre_election: true
I20260709 12:17:01.548485  9130 raft_consensus.cc:2468] T 644b89077d9f4d5095bf07700ea052a5 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 0.
I20260709 12:17:01.548601  9277 raft_consensus.cc:2468] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 0.
I20260709 12:17:01.549072  9028 catalog_manager.cc:5697] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 reported cstate change: term changed from 0 to 1, leader changed from <none> to 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67). New cstate: current_term: 1 leader_uuid: "058e0a9d20594e21ab2293398d9f0958" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:01.549834  9171 leader_election.cc:304] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e7c74ee6cca49f594649b4d754ffafb, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:17:01.550922  9437 raft_consensus.cc:2804] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:01.551330  9437 raft_consensus.cc:493] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.551703  9437 raft_consensus.cc:3060] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.560477  9437 raft_consensus.cc:515] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.562685  9437 leader_election.cc:290] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:17:01.563443  9130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644b89077d9f4d5095bf07700ea052a5" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:17:01.563903  9277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644b89077d9f4d5095bf07700ea052a5" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:17:01.564106  9130 raft_consensus.cc:3060] T 644b89077d9f4d5095bf07700ea052a5 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.564565  9277 raft_consensus.cc:3060] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.570189  9130 raft_consensus.cc:2468] T 644b89077d9f4d5095bf07700ea052a5 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 1.
I20260709 12:17:01.570766  9277 raft_consensus.cc:2468] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 1.
I20260709 12:17:01.571569  9171 leader_election.cc:304] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e7c74ee6cca49f594649b4d754ffafb, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:17:01.572891  9437 raft_consensus.cc:2804] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:01.573575  9437 raft_consensus.cc:697] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 LEADER]: Becoming Leader. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Running, Role: LEADER
I20260709 12:17:01.574342  9437 consensus_queue.cc:237] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:01.583683  9028 catalog_manager.cc:5697] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66). New cstate: current_term: 1 leader_uuid: "4e7c74ee6cca49f594649b4d754ffafb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:01.591958  9437 consensus_queue.cc:1048] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:01.596797  9346 consensus_queue.cc:1048] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:01.606505  9326 consensus_queue.cc:1048] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:01.632519  9442 consensus_queue.cc:1048] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:01.763731  9445 consensus_queue.cc:1048] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:01.758558  9442 consensus_queue.cc:1048] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:17:01.777271  9476 consensus_queue.cc:1048] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:01.805657  9346 consensus_queue.cc:1048] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:01.825053  9445 consensus_queue.cc:1048] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:01.864262  9280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81643c03104b4481b16048823f724518"
dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
mode: GRACEFUL
new_leader_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
 from {username='slave'} at 127.0.0.1:54000
I20260709 12:17:01.865312  9280 raft_consensus.cc:606] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Received request to transfer leadership to TS 849b8dd5b8bb411eaf0e0a2288aae6a1
I20260709 12:17:01.870070  9476 consensus_queue.cc:1048] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:01.875893  9280 raft_consensus.cc:3060] T e9dd45d5f936427f800b673225451b31 P 058e0a9d20594e21ab2293398d9f0958 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.888144  9206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f80caa5ccce44dfb84e1bdfb40890ff"
dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
mode: GRACEFUL
new_leader_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
 from {username='slave'} at 127.0.0.1:58776
I20260709 12:17:01.889034  9206 raft_consensus.cc:606] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [term 1 LEADER]: Received request to transfer leadership to TS 849b8dd5b8bb411eaf0e0a2288aae6a1
I20260709 12:17:01.899350  9326 consensus_queue.cc:1048] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:01.925431  9277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29a1493397a647df9b867e697a235303"
dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
mode: GRACEFUL
new_leader_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
 from {username='slave'} at 127.0.0.1:54000
I20260709 12:17:01.926153  9277 raft_consensus.cc:606] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Received request to transfer leadership to TS 4e7c74ee6cca49f594649b4d754ffafb
I20260709 12:17:01.933523  9326 consensus_queue.cc:1048] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:01.943957  9442 consensus_queue.cc:1048] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:01.947410  9129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57761cf5069a4757914e17943339e76a"
dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
mode: GRACEFUL
new_leader_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
 from {username='slave'} at 127.0.0.1:39124
I20260709 12:17:01.948318  9129 raft_consensus.cc:606] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Received request to transfer leadership to TS 4e7c74ee6cca49f594649b4d754ffafb
I20260709 12:17:01.957276  9280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86e972558e17492aa6cabded365ee981"
dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
mode: GRACEFUL
new_leader_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
 from {username='slave'} at 127.0.0.1:54000
I20260709 12:17:01.958007  9280 raft_consensus.cc:606] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Received request to transfer leadership to TS 4e7c74ee6cca49f594649b4d754ffafb
I20260709 12:17:01.969347  9206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "644b89077d9f4d5095bf07700ea052a5"
dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
mode: GRACEFUL
new_leader_uuid: "058e0a9d20594e21ab2293398d9f0958"
 from {username='slave'} at 127.0.0.1:58776
I20260709 12:17:01.970098  9206 raft_consensus.cc:606] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 LEADER]: Received request to transfer leadership to TS 058e0a9d20594e21ab2293398d9f0958
I20260709 12:17:01.970712  9480 consensus_queue.cc:1048] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:01.973510  9408 raft_consensus.cc:993] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1: : Instructing follower 4e7c74ee6cca49f594649b4d754ffafb to start an election
I20260709 12:17:01.974264  9408 raft_consensus.cc:1081] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Signalling peer 4e7c74ee6cca49f594649b4d754ffafb to start an election
I20260709 12:17:01.985373  9205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57761cf5069a4757914e17943339e76a"
dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
 from {username='slave'} at 127.0.0.1:58760
I20260709 12:17:01.986205  9205 raft_consensus.cc:493] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:01.986733  9205 raft_consensus.cc:3060] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.991426  9441 consensus_queue.cc:1048] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:01.999084  9205 raft_consensus.cc:515] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:02.001904  9205 leader_election.cc:290] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 2 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:17:02.003338  9277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57761cf5069a4757914e17943339e76a" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:17:02.006713  9130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57761cf5069a4757914e17943339e76a" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:17:02.007510  9130 raft_consensus.cc:3055] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:02.007817  9130 raft_consensus.cc:740] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Running, Role: LEADER
I20260709 12:17:02.008863  9130 consensus_queue.cc:260] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:02.011204  9423 consensus_queue.cc:1048] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:02.012020  9130 raft_consensus.cc:3060] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.016141  9476 consensus_queue.cc:1048] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:02.026933  9476 raft_consensus.cc:993] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958: : Instructing follower 4e7c74ee6cca49f594649b4d754ffafb to start an election
I20260709 12:17:02.027644  9476 raft_consensus.cc:1081] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Signalling peer 4e7c74ee6cca49f594649b4d754ffafb to start an election
I20260709 12:17:02.031538  9130 raft_consensus.cc:2468] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 2.
I20260709 12:17:02.031967  9206 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86e972558e17492aa6cabded365ee981"
dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
 from {username='slave'} at 127.0.0.1:58756
I20260709 12:17:02.032699  9206 raft_consensus.cc:493] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:02.033155  9206 raft_consensus.cc:3060] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.033046  9171 leader_election.cc:304] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e7c74ee6cca49f594649b4d754ffafb, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 058e0a9d20594e21ab2293398d9f0958
I20260709 12:17:02.035264  9423 raft_consensus.cc:2804] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:02.035887  9423 raft_consensus.cc:697] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb [term 2 LEADER]: Becoming Leader. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Running, Role: LEADER
I20260709 12:17:02.037138  9423 consensus_queue.cc:237] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:02.049646  9423 raft_consensus.cc:993] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb: : Instructing follower 058e0a9d20594e21ab2293398d9f0958 to start an election
I20260709 12:17:02.050220  9206 raft_consensus.cc:515] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:02.055460  9206 leader_election.cc:290] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 2 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:17:02.057363  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e972558e17492aa6cabded365ee981" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:17:02.057991  9280 raft_consensus.cc:3055] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:02.058276  9280 raft_consensus.cc:740] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Running, Role: LEADER
I20260709 12:17:02.059324  9280 consensus_queue.cc:260] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:02.059862  9326 consensus_queue.cc:1048] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:02.060640  9280 raft_consensus.cc:3060] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.057363  9129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e972558e17492aa6cabded365ee981" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:17:02.063722  9129 raft_consensus.cc:3060] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.068907  9280 raft_consensus.cc:2468] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 2.
I20260709 12:17:02.070581  9170 leader_election.cc:304] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 4e7c74ee6cca49f594649b4d754ffafb; no voters: 
I20260709 12:17:02.071626  9326 raft_consensus.cc:2804] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:02.072177  9326 raft_consensus.cc:697] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 LEADER]: Becoming Leader. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Running, Role: LEADER
I20260709 12:17:02.051558  9493 raft_consensus.cc:1081] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 LEADER]: Signalling peer 058e0a9d20594e21ab2293398d9f0958 to start an election
I20260709 12:17:02.073496  9326 consensus_queue.cc:237] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:02.075793  9280 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "644b89077d9f4d5095bf07700ea052a5"
dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
 from {username='slave'} at 127.0.0.1:53978
I20260709 12:17:02.076589  9280 raft_consensus.cc:493] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:02.077013  9280 raft_consensus.cc:3060] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.084399  9280 raft_consensus.cc:515] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:02.084704  9129 raft_consensus.cc:2468] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 2.
I20260709 12:17:02.086539  9280 leader_election.cc:290] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 2 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:17:02.088935  9129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644b89077d9f4d5095bf07700ea052a5" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:17:02.088927  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644b89077d9f4d5095bf07700ea052a5" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:17:02.089799  9129 raft_consensus.cc:3060] T 644b89077d9f4d5095bf07700ea052a5 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.089957  9206 raft_consensus.cc:3055] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:02.091569  9206 raft_consensus.cc:740] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Running, Role: LEADER
I20260709 12:17:02.091686  9026 catalog_manager.cc:5697] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb reported cstate change: term changed from 1 to 2, leader changed from 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65) to 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66). New cstate: current_term: 2 leader_uuid: "4e7c74ee6cca49f594649b4d754ffafb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:02.093446  9206 consensus_queue.cc:260] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:02.094695  9206 raft_consensus.cc:3060] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.099148  9129 raft_consensus.cc:2468] T 644b89077d9f4d5095bf07700ea052a5 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 2.
I20260709 12:17:02.100656  9245 leader_election.cc:304] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:17:02.101989  9348 raft_consensus.cc:2804] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:02.102666  9348 raft_consensus.cc:697] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 [term 2 LEADER]: Becoming Leader. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Running, Role: LEADER
I20260709 12:17:02.104256  9348 consensus_queue.cc:237] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:02.104894  9206 raft_consensus.cc:2468] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 2.
I20260709 12:17:02.114542  9326 raft_consensus.cc:993] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb: : Instructing follower 849b8dd5b8bb411eaf0e0a2288aae6a1 to start an election
I20260709 12:17:02.115057  9326 raft_consensus.cc:1081] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [term 1 LEADER]: Signalling peer 849b8dd5b8bb411eaf0e0a2288aae6a1 to start an election
I20260709 12:17:02.115092  9029 catalog_manager.cc:5697] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 reported cstate change: term changed from 1 to 2, leader changed from 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66) to 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67). New cstate: current_term: 2 leader_uuid: "058e0a9d20594e21ab2293398d9f0958" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:02.117152  9129 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f80caa5ccce44dfb84e1bdfb40890ff"
dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
 from {username='slave'} at 127.0.0.1:39106
I20260709 12:17:02.117817  9129 raft_consensus.cc:493] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:02.118230  9129 raft_consensus.cc:3060] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.118979  9027 catalog_manager.cc:5697] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb reported cstate change: term changed from 1 to 2, leader changed from 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67) to 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66). New cstate: current_term: 2 leader_uuid: "4e7c74ee6cca49f594649b4d754ffafb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:02.127704  9129 raft_consensus.cc:515] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:02.130721  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f80caa5ccce44dfb84e1bdfb40890ff" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:17:02.131265  9206 raft_consensus.cc:3055] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:02.131448  9129 leader_election.cc:290] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 2 election: Requested vote from peers 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:17:02.131542  9206 raft_consensus.cc:740] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Running, Role: LEADER
I20260709 12:17:02.132690  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f80caa5ccce44dfb84e1bdfb40890ff" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:17:02.132844  9206 consensus_queue.cc:260] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:02.133471  9280 raft_consensus.cc:3060] T 7f80caa5ccce44dfb84e1bdfb40890ff P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.134303  9206 raft_consensus.cc:3060] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.139171  9280 raft_consensus.cc:2468] T 7f80caa5ccce44dfb84e1bdfb40890ff P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 2.
I20260709 12:17:02.139509  9206 raft_consensus.cc:2468] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 2.
I20260709 12:17:02.140825  9095 leader_election.cc:304] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:17:02.141703  9442 raft_consensus.cc:2804] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:02.142194  9442 raft_consensus.cc:697] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 LEADER]: Becoming Leader. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Running, Role: LEADER
I20260709 12:17:02.143153  9442 consensus_queue.cc:237] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:02.150940  9027 catalog_manager.cc:5697] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1 reported cstate change: term changed from 1 to 2, leader changed from 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66) to 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:02.298074  9476 raft_consensus.cc:993] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958: : Instructing follower 4e7c74ee6cca49f594649b4d754ffafb to start an election
I20260709 12:17:02.298667  9348 raft_consensus.cc:1081] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Signalling peer 4e7c74ee6cca49f594649b4d754ffafb to start an election
I20260709 12:17:02.300335  9206 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29a1493397a647df9b867e697a235303"
dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
 from {username='slave'} at 127.0.0.1:58756
I20260709 12:17:02.300904  9206 raft_consensus.cc:493] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:02.301213  9206 raft_consensus.cc:3060] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.307092  9206 raft_consensus.cc:515] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:02.308725  9206 leader_election.cc:290] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 2 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:17:02.309623  9129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a1493397a647df9b867e697a235303" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:17:02.309808  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a1493397a647df9b867e697a235303" candidate_uuid: "4e7c74ee6cca49f594649b4d754ffafb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:17:02.310371  9129 raft_consensus.cc:3060] T 29a1493397a647df9b867e697a235303 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.310493  9280 raft_consensus.cc:3055] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:02.310961  9280 raft_consensus.cc:740] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Running, Role: LEADER
I20260709 12:17:02.311643  9280 consensus_queue.cc:260] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:02.312613  9280 raft_consensus.cc:3060] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.317162  9129 raft_consensus.cc:2468] T 29a1493397a647df9b867e697a235303 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 2.
I20260709 12:17:02.318187  9280 raft_consensus.cc:2468] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e7c74ee6cca49f594649b4d754ffafb in term 2.
I20260709 12:17:02.318755  9171 leader_election.cc:304] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e7c74ee6cca49f594649b4d754ffafb, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:17:02.319644  9493 raft_consensus.cc:2804] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:02.320140  9493 raft_consensus.cc:697] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 LEADER]: Becoming Leader. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Running, Role: LEADER
I20260709 12:17:02.321020  9493 consensus_queue.cc:237] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:02.329846  9029 catalog_manager.cc:5697] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb reported cstate change: term changed from 1 to 2, leader changed from 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67) to 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66). New cstate: current_term: 2 leader_uuid: "4e7c74ee6cca49f594649b4d754ffafb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:02.377120  9476 raft_consensus.cc:993] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958: : Instructing follower 849b8dd5b8bb411eaf0e0a2288aae6a1 to start an election
I20260709 12:17:02.377653  9348 raft_consensus.cc:1081] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Signalling peer 849b8dd5b8bb411eaf0e0a2288aae6a1 to start an election
I20260709 12:17:02.379462  9129 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81643c03104b4481b16048823f724518"
dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
 from {username='slave'} at 127.0.0.1:39116
I20260709 12:17:02.379926  9129 raft_consensus.cc:493] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:02.380235  9129 raft_consensus.cc:3060] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.385833  9129 raft_consensus.cc:515] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:02.387414  9129 leader_election.cc:290] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 2 election: Requested vote from peers 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367), 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67:40061)
I20260709 12:17:02.388370  9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81643c03104b4481b16048823f724518" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:17:02.388613  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81643c03104b4481b16048823f724518" candidate_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
I20260709 12:17:02.388985  9206 raft_consensus.cc:3060] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.389226  9280 raft_consensus.cc:3055] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:02.389599  9280 raft_consensus.cc:740] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Running, Role: LEADER
I20260709 12:17:02.390365  9280 consensus_queue.cc:260] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:02.391434  9280 raft_consensus.cc:3060] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.394894  9206 raft_consensus.cc:2468] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 2.
I20260709 12:17:02.396297  9097 leader_election.cc:304] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e7c74ee6cca49f594649b4d754ffafb, 849b8dd5b8bb411eaf0e0a2288aae6a1; no voters: 
I20260709 12:17:02.397135  9346 raft_consensus.cc:2804] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:02.397641  9346 raft_consensus.cc:697] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 LEADER]: Becoming Leader. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Running, Role: LEADER
I20260709 12:17:02.397740  9280 raft_consensus.cc:2468] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 849b8dd5b8bb411eaf0e0a2288aae6a1 in term 2.
I20260709 12:17:02.398699  9346 consensus_queue.cc:237] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:02.406917  9029 catalog_manager.cc:5697] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 reported cstate change: term changed from 1 to 2, leader changed from 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67) to 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65). New cstate: current_term: 2 leader_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:02.500661  9129 raft_consensus.cc:1275] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Refusing update from remote peer 4e7c74ee6cca49f594649b4d754ffafb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.502524  9493 consensus_queue.cc:1048] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:02.511725  9280 raft_consensus.cc:3060] T 57761cf5069a4757914e17943339e76a P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.520507  9280 raft_consensus.cc:1275] T 57761cf5069a4757914e17943339e76a P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Refusing update from remote peer 4e7c74ee6cca49f594649b4d754ffafb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.521999  9493 consensus_queue.cc:1048] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:02.524665  9206 raft_consensus.cc:1275] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Refusing update from remote peer 058e0a9d20594e21ab2293398d9f0958: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.526229  9476 consensus_queue.cc:1048] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:02.536640  9129 raft_consensus.cc:1275] T 644b89077d9f4d5095bf07700ea052a5 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Refusing update from remote peer 058e0a9d20594e21ab2293398d9f0958: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.537986  9445 consensus_queue.cc:1048] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:02.581351  9280 raft_consensus.cc:1275] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Refusing update from remote peer 4e7c74ee6cca49f594649b4d754ffafb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.582800  9493 consensus_queue.cc:1048] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:02.583359  9129 raft_consensus.cc:1275] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Refusing update from remote peer 4e7c74ee6cca49f594649b4d754ffafb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.584735  9493 consensus_queue.cc:1048] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:02.683526  9280 raft_consensus.cc:1275] T 7f80caa5ccce44dfb84e1bdfb40890ff P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Refusing update from remote peer 849b8dd5b8bb411eaf0e0a2288aae6a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.684751  9346 consensus_queue.cc:1048] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:02.695410  9206 raft_consensus.cc:1275] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Refusing update from remote peer 849b8dd5b8bb411eaf0e0a2288aae6a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.699033  9499 consensus_queue.cc:1048] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:02.778569  9280 raft_consensus.cc:1275] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Refusing update from remote peer 849b8dd5b8bb411eaf0e0a2288aae6a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.780069  9499 consensus_queue.cc:1048] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:02.788290  9206 raft_consensus.cc:1275] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Refusing update from remote peer 849b8dd5b8bb411eaf0e0a2288aae6a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.789893  9499 consensus_queue.cc:1048] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:02.853570  9129 raft_consensus.cc:1275] T 29a1493397a647df9b867e697a235303 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Refusing update from remote peer 4e7c74ee6cca49f594649b4d754ffafb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.854993  9493 consensus_queue.cc:1048] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:02.863767  9280 raft_consensus.cc:1275] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Refusing update from remote peer 4e7c74ee6cca49f594649b4d754ffafb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.865324  9326 consensus_queue.cc:1048] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb [LEADER]: Connected to new peer: Peer: permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:04.976046  9027 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43918:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:17:05.000036  9027 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:43918:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:17:05.069301 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:17:05.200230  9522 log.cc:927] Time spent T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:17:05.247087  9543 tablet.cc:1724] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:17:05.256790  9171 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.65:46313, user_credentials={real_user=slave}} blocked reactor thread for 71908.4us
W20260709 12:17:05.285033  9537 log.cc:927] Time spent T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958: Append to log took a long time: real 0.056s	user 0.003s	sys 0.000s
W20260709 12:17:05.288501  9539 log.cc:927] Time spent T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 12:17:05.410981  9558 tablet.cc:1724] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.423362  9556 tablet.cc:1724] T e9dd45d5f936427f800b673225451b31 P 058e0a9d20594e21ab2293398d9f0958: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.386718  9561 tablet.cc:1724] T e9dd45d5f936427f800b673225451b31 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:17:05.472833  9554 log.cc:927] Time spent T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 12:17:05.458992  9246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.179.66:41367, user_credentials={real_user=slave}} blocked reactor thread for 88756.4us
W20260709 12:17:05.489187  9547 log.cc:927] Time spent T 7f80caa5ccce44dfb84e1bdfb40890ff P 058e0a9d20594e21ab2293398d9f0958: Append to log took a long time: real 0.140s	user 0.003s	sys 0.000s
I20260709 12:17:05.501192  9563 tablet.cc:1724] T 4c013a14a40a4f4e81572ddea538a499 P 4e7c74ee6cca49f594649b4d754ffafb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.478785  9559 tablet.cc:1724] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.418308  9553 tablet.cc:1724] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.515914  9562 tablet.cc:1724] T 29a1493397a647df9b867e697a235303 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.523694  9567 tablet.cc:1724] T 29b81e8bdfd94606a8ef07d8a45b01ed P 4e7c74ee6cca49f594649b4d754ffafb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.525758  9204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a404d23da7f43fcb50c7d2126f76d4a"
dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
mode: GRACEFUL
new_leader_uuid: "058e0a9d20594e21ab2293398d9f0958"
 from {username='slave'} at 127.0.0.1:33324
I20260709 12:17:05.526741  9204 raft_consensus.cc:606] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [term 2 LEADER]: Received request to transfer leadership to TS 058e0a9d20594e21ab2293398d9f0958
I20260709 12:17:05.586198  9576 tablet.cc:1724] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.599438  9558 tablet.cc:1724] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.607146  9574 tablet.cc:1724] T 29b81e8bdfd94606a8ef07d8a45b01ed P 058e0a9d20594e21ab2293398d9f0958: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.620816  9576 tablet.cc:1724] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.624286  9553 tablet.cc:1724] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.626478  9572 tablet.cc:1724] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.627935  9559 tablet.cc:1724] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.597582  9543 tablet.cc:1724] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:17:05.634841  9573 log.cc:927] Time spent T 57761cf5069a4757914e17943339e76a P 058e0a9d20594e21ab2293398d9f0958: Append to log took a long time: real 0.051s	user 0.004s	sys 0.000s
I20260709 12:17:05.639405  9575 raft_consensus.cc:993] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb: : Instructing follower 058e0a9d20594e21ab2293398d9f0958 to start an election
I20260709 12:17:05.638628  9558 tablet.cc:1724] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.640053  9575 raft_consensus.cc:1081] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [term 2 LEADER]: Signalling peer 058e0a9d20594e21ab2293398d9f0958 to start an election
I20260709 12:17:05.654320  9273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a404d23da7f43fcb50c7d2126f76d4a"
dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
 from {username='slave'} at 127.0.0.1:53978
I20260709 12:17:05.655025  9273 raft_consensus.cc:493] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:05.655442  9273 raft_consensus.cc:3060] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.670166  9567 tablet.cc:1724] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.678984  9556 tablet.cc:1724] T 4c013a14a40a4f4e81572ddea538a499 P 058e0a9d20594e21ab2293398d9f0958: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.680665  9563 tablet.cc:1724] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.687280  9559 tablet.cc:1724] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.695967  9561 tablet.cc:1724] T 644b89077d9f4d5095bf07700ea052a5 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.700035  9558 tablet.cc:1724] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.700451  9556 tablet.cc:1724] T 7f80caa5ccce44dfb84e1bdfb40890ff P 058e0a9d20594e21ab2293398d9f0958: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.702668  9273 raft_consensus.cc:515] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:05.706061  9273 leader_election.cc:290] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 3 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:17:05.707652  9128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a404d23da7f43fcb50c7d2126f76d4a" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:17:05.717947  9128 raft_consensus.cc:3060] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.708709  9202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a404d23da7f43fcb50c7d2126f76d4a" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:17:05.722820  9202 raft_consensus.cc:3055] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:05.723219  9202 raft_consensus.cc:740] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4e7c74ee6cca49f594649b4d754ffafb, State: Running, Role: LEADER
I20260709 12:17:05.724195  9202 consensus_queue.cc:260] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:05.725581  9202 raft_consensus.cc:3060] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.710165  9129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d27de9091884e219dac46f087f8aaff"
dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
mode: GRACEFUL
new_leader_uuid: "058e0a9d20594e21ab2293398d9f0958"
 from {username='slave'} at 127.0.0.1:36578
I20260709 12:17:05.726830  9129 raft_consensus.cc:606] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 LEADER]: Received request to transfer leadership to TS 058e0a9d20594e21ab2293398d9f0958
I20260709 12:17:05.730785 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:05.731649 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:05.736081  9574 tablet.cc:1724] T 57761cf5069a4757914e17943339e76a P 058e0a9d20594e21ab2293398d9f0958: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.737417  9576 tablet.cc:1724] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:17:05.758445  9202 raft_consensus.cc:2468] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 3.
I20260709 12:17:05.760273  9246 leader_election.cc:304] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 4e7c74ee6cca49f594649b4d754ffafb; no voters: 
I20260709 12:17:05.762809  9503 raft_consensus.cc:2804] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:05.763402  9503 raft_consensus.cc:697] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [term 3 LEADER]: Becoming Leader. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Running, Role: LEADER
I20260709 12:17:05.764381  9503 consensus_queue.cc:237] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:05.771767  9128 raft_consensus.cc:2468] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 3.
I20260709 12:17:05.772637  9129 raft_consensus.cc:1240] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 3 FOLLOWER]: Rejecting Update request from peer 4e7c74ee6cca49f594649b4d754ffafb for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:05.799145  9026 catalog_manager.cc:5697] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 reported cstate change: term changed from 2 to 3, leader changed from 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66) to 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67). New cstate: current_term: 3 leader_uuid: "058e0a9d20594e21ab2293398d9f0958" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:05.803488  9027 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e: soft_deleted_table [id=26f868e119934b25b5a16a41ab30e309] alter complete (version 1)
I20260709 12:17:06.147607  9441 raft_consensus.cc:993] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1: : Instructing follower 058e0a9d20594e21ab2293398d9f0958 to start an election
I20260709 12:17:06.148145  9530 raft_consensus.cc:1081] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 LEADER]: Signalling peer 058e0a9d20594e21ab2293398d9f0958 to start an election
I20260709 12:17:06.149727  9279 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d27de9091884e219dac46f087f8aaff"
dest_uuid: "058e0a9d20594e21ab2293398d9f0958"
 from {username='slave'} at 127.0.0.1:53992
I20260709 12:17:06.150298  9279 raft_consensus.cc:493] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:06.150657  9279 raft_consensus.cc:3060] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.157075  9279 raft_consensus.cc:515] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:06.160045  9279 leader_election.cc:290] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 3 election: Requested vote from peers 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313), 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367)
I20260709 12:17:06.160192  9129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d27de9091884e219dac46f087f8aaff" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1"
I20260709 12:17:06.160621  9202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d27de9091884e219dac46f087f8aaff" candidate_uuid: "058e0a9d20594e21ab2293398d9f0958" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4e7c74ee6cca49f594649b4d754ffafb"
I20260709 12:17:06.161058  9129 raft_consensus.cc:3055] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:06.161301  9202 raft_consensus.cc:3060] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.161420  9129 raft_consensus.cc:740] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 849b8dd5b8bb411eaf0e0a2288aae6a1, State: Running, Role: LEADER
I20260709 12:17:06.162375  9129 consensus_queue.cc:260] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:06.163748  9129 raft_consensus.cc:3060] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.170094  9202 raft_consensus.cc:2468] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 3.
I20260709 12:17:06.171559  9246 leader_election.cc:304] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 058e0a9d20594e21ab2293398d9f0958, 4e7c74ee6cca49f594649b4d754ffafb; no voters: 
I20260709 12:17:06.171629  9129 raft_consensus.cc:2468] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 058e0a9d20594e21ab2293398d9f0958 in term 3.
I20260709 12:17:06.172554  9503 raft_consensus.cc:2804] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:06.173110  9503 raft_consensus.cc:697] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [term 3 LEADER]: Becoming Leader. State: Replica: 058e0a9d20594e21ab2293398d9f0958, State: Running, Role: LEADER
I20260709 12:17:06.173998  9503 consensus_queue.cc:237] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } }
I20260709 12:17:06.182271  9029 catalog_manager.cc:5697] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 reported cstate change: term changed from 2 to 3, leader changed from 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65) to 058e0a9d20594e21ab2293398d9f0958 (127.24.179.67). New cstate: current_term: 3 leader_uuid: "058e0a9d20594e21ab2293398d9f0958" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "058e0a9d20594e21ab2293398d9f0958" member_type: VOTER last_known_addr { host: "127.24.179.67" port: 40061 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:06.184948  9202 raft_consensus.cc:1275] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [term 3 FOLLOWER]: Refusing update from remote peer 058e0a9d20594e21ab2293398d9f0958: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:06.186619  9503 consensus_queue.cc:1048] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:06.202083  9129 raft_consensus.cc:1275] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 3 FOLLOWER]: Refusing update from remote peer 058e0a9d20594e21ab2293398d9f0958: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:06.203824  9565 consensus_queue.cc:1048] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:06.575309  9129 raft_consensus.cc:1275] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 3 FOLLOWER]: Refusing update from remote peer 058e0a9d20594e21ab2293398d9f0958: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:06.576799  9503 consensus_queue.cc:1048] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "849b8dd5b8bb411eaf0e0a2288aae6a1" member_type: VOTER last_known_addr { host: "127.24.179.65" port: 46313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:06.592813  9202 raft_consensus.cc:1275] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 3 FOLLOWER]: Refusing update from remote peer 058e0a9d20594e21ab2293398d9f0958: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:06.595121  9565 consensus_queue.cc:1048] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e7c74ee6cca49f594649b4d754ffafb" member_type: VOTER last_known_addr { host: "127.24.179.66" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:06.732851 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:06.740447 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:06.740950 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:07.742054 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:07.747372 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:07.747879 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:08.749035 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:08.755438 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:08.756093 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:09.757197 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:09.762693 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:09.763114 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:10.764474 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:10.772572 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:10.773293 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:11.790179 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:11.819670 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:11.822721 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:12.824563 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:12.829870 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:12.830334 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:13.831262 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:13.836810 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:13.837244 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:14.838716 25293 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:14.848141 25293 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:14.848829 25293 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:15.916368 25293 tablet_server.cc:179] TabletServer@127.24.179.65:0 shutting down...
W20260709 12:17:15.933594  9171 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260709 12:17:15.953783  9171 consensus_peers.cc:597] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb -> Peer 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313): Couldn't send request to peer 849b8dd5b8bb411eaf0e0a2288aae6a1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:15.969914 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:15.971249 25293 tablet_replica.cc:333] T 644b89077d9f4d5095bf07700ea052a5 P 849b8dd5b8bb411eaf0e0a2288aae6a1: stopping tablet replica
I20260709 12:17:15.972813 25293 raft_consensus.cc:2243] T 644b89077d9f4d5095bf07700ea052a5 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:17:15.973409  9171 consensus_peers.cc:597] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb -> Peer 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313): Couldn't send request to peer 849b8dd5b8bb411eaf0e0a2288aae6a1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:15.974054 25293 raft_consensus.cc:2272] T 644b89077d9f4d5095bf07700ea052a5 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:15.977527 25293 tablet_replica.cc:333] T e9dd45d5f936427f800b673225451b31 P 849b8dd5b8bb411eaf0e0a2288aae6a1: stopping tablet replica
I20260709 12:17:15.978523 25293 raft_consensus.cc:2243] T e9dd45d5f936427f800b673225451b31 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:15.979454 25293 raft_consensus.cc:2272] T e9dd45d5f936427f800b673225451b31 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:15.984061 25293 tablet_replica.cc:333] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1: stopping tablet replica
I20260709 12:17:15.985028 25293 raft_consensus.cc:2243] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:15.985760 25293 raft_consensus.cc:2272] T 57761cf5069a4757914e17943339e76a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:15.988699 25293 tablet_replica.cc:333] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1: stopping tablet replica
I20260709 12:17:15.989487 25293 raft_consensus.cc:2243] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:15.990103 25293 raft_consensus.cc:2272] T 86e972558e17492aa6cabded365ee981 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:15.992723 25293 tablet_replica.cc:333] T 29a1493397a647df9b867e697a235303 P 849b8dd5b8bb411eaf0e0a2288aae6a1: stopping tablet replica
I20260709 12:17:15.993621 25293 raft_consensus.cc:2243] T 29a1493397a647df9b867e697a235303 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:15.994299 25293 raft_consensus.cc:2272] T 29a1493397a647df9b867e697a235303 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:15.997301 25293 tablet_replica.cc:333] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1: stopping tablet replica
I20260709 12:17:15.997959 25293 raft_consensus.cc:2243] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:15.999084 25293 raft_consensus.cc:2272] T 4c013a14a40a4f4e81572ddea538a499 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.002507 25293 tablet_replica.cc:333] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1: stopping tablet replica
I20260709 12:17:16.003314 25293 raft_consensus.cc:2243] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:16.004528 25293 raft_consensus.cc:2272] T 7f80caa5ccce44dfb84e1bdfb40890ff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.008200 25293 tablet_replica.cc:333] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1: stopping tablet replica
I20260709 12:17:16.009083 25293 raft_consensus.cc:2243] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:16.010717 25293 raft_consensus.cc:2272] T 29b81e8bdfd94606a8ef07d8a45b01ed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.017922 25293 tablet_replica.cc:333] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1: stopping tablet replica
I20260709 12:17:16.019040 25293 raft_consensus.cc:2243] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:16.020680 25293 raft_consensus.cc:2272] T 2ba8ff03279945b681d828571c1f4181 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.024362 25293 tablet_replica.cc:333] T e236c3da863a44e096522ad9d8ceaa58 P 849b8dd5b8bb411eaf0e0a2288aae6a1: stopping tablet replica
I20260709 12:17:16.025100 25293 raft_consensus.cc:2243] T e236c3da863a44e096522ad9d8ceaa58 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.025775 25293 raft_consensus.cc:2272] T e236c3da863a44e096522ad9d8ceaa58 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.028750 25293 tablet_replica.cc:333] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1: stopping tablet replica
I20260709 12:17:16.029424 25293 raft_consensus.cc:2243] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:16.030730 25293 raft_consensus.cc:2272] T 81643c03104b4481b16048823f724518 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.034801 25293 tablet_replica.cc:333] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 849b8dd5b8bb411eaf0e0a2288aae6a1: stopping tablet replica
W20260709 12:17:16.035147  9171 consensus_peers.cc:597] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb -> Peer 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313): Couldn't send request to peer 849b8dd5b8bb411eaf0e0a2288aae6a1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:16.035745 25293 raft_consensus.cc:2243] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.036377 25293 raft_consensus.cc:2272] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.039515 25293 tablet_replica.cc:333] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1: stopping tablet replica
I20260709 12:17:16.040167 25293 raft_consensus.cc:2243] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.040691 25293 raft_consensus.cc:2272] T 8d27de9091884e219dac46f087f8aaff P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.043397 25293 tablet_replica.cc:333] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1: stopping tablet replica
I20260709 12:17:16.043957 25293 raft_consensus.cc:2243] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.044526 25293 raft_consensus.cc:2272] T 0a404d23da7f43fcb50c7d2126f76d4a P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.047245 25293 tablet_replica.cc:333] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1: stopping tablet replica
I20260709 12:17:16.047799 25293 raft_consensus.cc:2243] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.048489 25293 raft_consensus.cc:2272] T 64600ebe7baf4321bc70ad565a1874b2 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.051421 25293 tablet_replica.cc:333] T 45a062c6b1a04686ae6f927c8cf0b838 P 849b8dd5b8bb411eaf0e0a2288aae6a1: stopping tablet replica
I20260709 12:17:16.052088 25293 raft_consensus.cc:2243] T 45a062c6b1a04686ae6f927c8cf0b838 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.052755 25293 raft_consensus.cc:2272] T 45a062c6b1a04686ae6f927c8cf0b838 P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.056552 25293 tablet_replica.cc:333] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1: stopping tablet replica
I20260709 12:17:16.057372 25293 raft_consensus.cc:2243] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:16.058679 25293 raft_consensus.cc:2272] T 47bb7e61288740c6a083cfe1b95fc2ea P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:16.060943  9171 consensus_peers.cc:597] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb -> Peer 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313): Couldn't send request to peer 849b8dd5b8bb411eaf0e0a2288aae6a1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:16.062542 25293 tablet_replica.cc:333] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1: stopping tablet replica
I20260709 12:17:16.063457 25293 raft_consensus.cc:2243] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:16.064893 25293 raft_consensus.cc:2272] T 5fe7fdb2ca1d43b1bf6448d810658fed P 849b8dd5b8bb411eaf0e0a2288aae6a1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:16.113128  9245 consensus_peers.cc:597] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 -> Peer 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313): Couldn't send request to peer 849b8dd5b8bb411eaf0e0a2288aae6a1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:46313: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:16.116074  9245 consensus_peers.cc:597] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 -> Peer 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313): Couldn't send request to peer 849b8dd5b8bb411eaf0e0a2288aae6a1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:46313: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:16.118485 25293 tablet_server.cc:196] TabletServer@127.24.179.65:0 shutdown complete.
W20260709 12:17:16.153357  9171 consensus_peers.cc:597] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb -> Peer 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313): Couldn't send request to peer 849b8dd5b8bb411eaf0e0a2288aae6a1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:46313: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:16.174656 25293 tablet_server.cc:179] TabletServer@127.24.179.66:0 shutting down...
I20260709 12:17:16.211977 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:16.213023 25293 tablet_replica.cc:333] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb: stopping tablet replica
I20260709 12:17:16.214483 25293 raft_consensus.cc:2243] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.215543 25293 raft_consensus.cc:2272] T 644b89077d9f4d5095bf07700ea052a5 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:16.217628  9245 consensus_peers.cc:597] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 -> Peer 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313): Couldn't send request to peer 849b8dd5b8bb411eaf0e0a2288aae6a1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:46313: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:16.218987 25293 tablet_replica.cc:333] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb: stopping tablet replica
I20260709 12:17:16.219843 25293 raft_consensus.cc:2243] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:16.220883 25293 raft_consensus.cc:2272] T 86e972558e17492aa6cabded365ee981 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.223841 25293 tablet_replica.cc:333] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb: stopping tablet replica
I20260709 12:17:16.224606 25293 raft_consensus.cc:2243] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:16.225617 25293 raft_consensus.cc:2272] T 57761cf5069a4757914e17943339e76a P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.228318 25293 tablet_replica.cc:333] T 4c013a14a40a4f4e81572ddea538a499 P 4e7c74ee6cca49f594649b4d754ffafb: stopping tablet replica
I20260709 12:17:16.228986 25293 raft_consensus.cc:2243] T 4c013a14a40a4f4e81572ddea538a499 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.229656 25293 raft_consensus.cc:2272] T 4c013a14a40a4f4e81572ddea538a499 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.232326 25293 tablet_replica.cc:333] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb: stopping tablet replica
I20260709 12:17:16.233034 25293 raft_consensus.cc:2243] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.233662 25293 raft_consensus.cc:2272] T 81643c03104b4481b16048823f724518 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.237239 25293 tablet_replica.cc:333] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb: stopping tablet replica
I20260709 12:17:16.238451 25293 raft_consensus.cc:2243] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:16.239717 25293 raft_consensus.cc:2272] T e9dd45d5f936427f800b673225451b31 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:16.239711  9245 consensus_peers.cc:597] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 -> Peer 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313): Couldn't send request to peer 849b8dd5b8bb411eaf0e0a2288aae6a1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:46313: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:16.242666 25293 tablet_replica.cc:333] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb: stopping tablet replica
I20260709 12:17:16.243438 25293 raft_consensus.cc:2243] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:16.244552 25293 raft_consensus.cc:2272] T 29a1493397a647df9b867e697a235303 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.247354 25293 tablet_replica.cc:333] T 29b81e8bdfd94606a8ef07d8a45b01ed P 4e7c74ee6cca49f594649b4d754ffafb: stopping tablet replica
I20260709 12:17:16.248041 25293 raft_consensus.cc:2243] T 29b81e8bdfd94606a8ef07d8a45b01ed P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.248657 25293 raft_consensus.cc:2272] T 29b81e8bdfd94606a8ef07d8a45b01ed P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.251362 25293 tablet_replica.cc:333] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb: stopping tablet replica
I20260709 12:17:16.252030 25293 raft_consensus.cc:2243] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.252606 25293 raft_consensus.cc:2272] T 0a404d23da7f43fcb50c7d2126f76d4a P 4e7c74ee6cca49f594649b4d754ffafb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.255260 25293 tablet_replica.cc:333] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb: stopping tablet replica
I20260709 12:17:16.255946 25293 raft_consensus.cc:2243] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:16.257468 25293 raft_consensus.cc:2272] T 45a062c6b1a04686ae6f927c8cf0b838 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.261221 25293 tablet_replica.cc:333] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb: stopping tablet replica
W20260709 12:17:16.261708  9171 consensus_peers.cc:597] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb -> Peer 849b8dd5b8bb411eaf0e0a2288aae6a1 (127.24.179.65:46313): Couldn't send request to peer 849b8dd5b8bb411eaf0e0a2288aae6a1. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.65:46313: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:16.261987 25293 raft_consensus.cc:2243] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:16.263188 25293 raft_consensus.cc:2272] T 64600ebe7baf4321bc70ad565a1874b2 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.265872 25293 tablet_replica.cc:333] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb: stopping tablet replica
I20260709 12:17:16.266628 25293 raft_consensus.cc:2243] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.267237 25293 raft_consensus.cc:2272] T 8d27de9091884e219dac46f087f8aaff P 4e7c74ee6cca49f594649b4d754ffafb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.269999 25293 tablet_replica.cc:333] T 5fe7fdb2ca1d43b1bf6448d810658fed P 4e7c74ee6cca49f594649b4d754ffafb: stopping tablet replica
I20260709 12:17:16.270720 25293 raft_consensus.cc:2243] T 5fe7fdb2ca1d43b1bf6448d810658fed P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.271291 25293 raft_consensus.cc:2272] T 5fe7fdb2ca1d43b1bf6448d810658fed P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.274703 25293 tablet_replica.cc:333] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb: stopping tablet replica
I20260709 12:17:16.275404 25293 raft_consensus.cc:2243] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:17:16.275935  9246 consensus_peers.cc:597] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 -> Peer 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367): Couldn't send request to peer 4e7c74ee6cca49f594649b4d754ffafb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:16.276237 25293 raft_consensus.cc:2272] T 7f80caa5ccce44dfb84e1bdfb40890ff P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.279069 25293 tablet_replica.cc:333] T 47bb7e61288740c6a083cfe1b95fc2ea P 4e7c74ee6cca49f594649b4d754ffafb: stopping tablet replica
I20260709 12:17:16.279651 25293 raft_consensus.cc:2243] T 47bb7e61288740c6a083cfe1b95fc2ea P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.280122 25293 raft_consensus.cc:2272] T 47bb7e61288740c6a083cfe1b95fc2ea P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.282722 25293 tablet_replica.cc:333] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb: stopping tablet replica
I20260709 12:17:16.283286 25293 raft_consensus.cc:2243] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:16.284201 25293 raft_consensus.cc:2272] T e236c3da863a44e096522ad9d8ceaa58 P 4e7c74ee6cca49f594649b4d754ffafb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.286773 25293 tablet_replica.cc:333] T 2ba8ff03279945b681d828571c1f4181 P 4e7c74ee6cca49f594649b4d754ffafb: stopping tablet replica
I20260709 12:17:16.287343 25293 raft_consensus.cc:2243] T 2ba8ff03279945b681d828571c1f4181 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.287822 25293 raft_consensus.cc:2272] T 2ba8ff03279945b681d828571c1f4181 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.290333 25293 tablet_replica.cc:333] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 4e7c74ee6cca49f594649b4d754ffafb: stopping tablet replica
I20260709 12:17:16.290912 25293 raft_consensus.cc:2243] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.291396 25293 raft_consensus.cc:2272] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 4e7c74ee6cca49f594649b4d754ffafb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.340204 25293 tablet_server.cc:196] TabletServer@127.24.179.66:0 shutdown complete.
W20260709 12:17:16.360728  9246 consensus_peers.cc:597] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 -> Peer 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367): Couldn't send request to peer 4e7c74ee6cca49f594649b4d754ffafb. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:41367: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:16.390551 25293 tablet_server.cc:179] TabletServer@127.24.179.67:0 shutting down...
W20260709 12:17:16.400704  9246 consensus_peers.cc:597] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 -> Peer 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367): Couldn't send request to peer 4e7c74ee6cca49f594649b4d754ffafb. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:41367: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:16.412813  9246 consensus_peers.cc:597] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 -> Peer 4e7c74ee6cca49f594649b4d754ffafb (127.24.179.66:41367): Couldn't send request to peer 4e7c74ee6cca49f594649b4d754ffafb. Status: Network error: Client connection negotiation failed: client connection to 127.24.179.66:41367: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:16.429778 25293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:16.430856 25293 tablet_replica.cc:333] T e9dd45d5f936427f800b673225451b31 P 058e0a9d20594e21ab2293398d9f0958: stopping tablet replica
I20260709 12:17:16.431571 25293 raft_consensus.cc:2243] T e9dd45d5f936427f800b673225451b31 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.432123 25293 raft_consensus.cc:2272] T e9dd45d5f936427f800b673225451b31 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.434787 25293 tablet_replica.cc:333] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958: stopping tablet replica
I20260709 12:17:16.435420 25293 raft_consensus.cc:2243] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:16.436337 25293 raft_consensus.cc:2272] T 644b89077d9f4d5095bf07700ea052a5 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.438778 25293 tablet_replica.cc:333] T 57761cf5069a4757914e17943339e76a P 058e0a9d20594e21ab2293398d9f0958: stopping tablet replica
I20260709 12:17:16.439391 25293 raft_consensus.cc:2243] T 57761cf5069a4757914e17943339e76a P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.439924 25293 raft_consensus.cc:2272] T 57761cf5069a4757914e17943339e76a P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.442195 25293 tablet_replica.cc:333] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958: stopping tablet replica
I20260709 12:17:16.442991 25293 raft_consensus.cc:2243] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.443540 25293 raft_consensus.cc:2272] T 86e972558e17492aa6cabded365ee981 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.445868 25293 tablet_replica.cc:333] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958: stopping tablet replica
I20260709 12:17:16.446569 25293 raft_consensus.cc:2243] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.447125 25293 raft_consensus.cc:2272] T 29a1493397a647df9b867e697a235303 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.449396 25293 tablet_replica.cc:333] T 4c013a14a40a4f4e81572ddea538a499 P 058e0a9d20594e21ab2293398d9f0958: stopping tablet replica
I20260709 12:17:16.449965 25293 raft_consensus.cc:2243] T 4c013a14a40a4f4e81572ddea538a499 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.450554 25293 raft_consensus.cc:2272] T 4c013a14a40a4f4e81572ddea538a499 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.452965 25293 tablet_replica.cc:333] T 7f80caa5ccce44dfb84e1bdfb40890ff P 058e0a9d20594e21ab2293398d9f0958: stopping tablet replica
I20260709 12:17:16.453567 25293 raft_consensus.cc:2243] T 7f80caa5ccce44dfb84e1bdfb40890ff P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.454083 25293 raft_consensus.cc:2272] T 7f80caa5ccce44dfb84e1bdfb40890ff P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.456522 25293 tablet_replica.cc:333] T 29b81e8bdfd94606a8ef07d8a45b01ed P 058e0a9d20594e21ab2293398d9f0958: stopping tablet replica
I20260709 12:17:16.457226 25293 raft_consensus.cc:2243] T 29b81e8bdfd94606a8ef07d8a45b01ed P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.457819 25293 raft_consensus.cc:2272] T 29b81e8bdfd94606a8ef07d8a45b01ed P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.460222 25293 tablet_replica.cc:333] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958: stopping tablet replica
I20260709 12:17:16.460881 25293 raft_consensus.cc:2243] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:16.461859 25293 raft_consensus.cc:2272] T 8d27de9091884e219dac46f087f8aaff P 058e0a9d20594e21ab2293398d9f0958 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.464387 25293 tablet_replica.cc:333] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958: stopping tablet replica
I20260709 12:17:16.465058 25293 raft_consensus.cc:2243] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.465623 25293 raft_consensus.cc:2272] T 81643c03104b4481b16048823f724518 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.468040 25293 tablet_replica.cc:333] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958: stopping tablet replica
I20260709 12:17:16.468652 25293 raft_consensus.cc:2243] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:16.469636 25293 raft_consensus.cc:2272] T 88dfecf4a1a84b618cbda9cbbc5d1e48 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.472048 25293 tablet_replica.cc:333] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958: stopping tablet replica
I20260709 12:17:16.472649 25293 raft_consensus.cc:2243] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.473276 25293 raft_consensus.cc:2272] T 5fe7fdb2ca1d43b1bf6448d810658fed P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.475673 25293 tablet_replica.cc:333] T 2ba8ff03279945b681d828571c1f4181 P 058e0a9d20594e21ab2293398d9f0958: stopping tablet replica
I20260709 12:17:16.476327 25293 raft_consensus.cc:2243] T 2ba8ff03279945b681d828571c1f4181 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.476825 25293 raft_consensus.cc:2272] T 2ba8ff03279945b681d828571c1f4181 P 058e0a9d20594e21ab2293398d9f0958 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.479261 25293 tablet_replica.cc:333] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958: stopping tablet replica
I20260709 12:17:16.479885 25293 raft_consensus.cc:2243] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.480440 25293 raft_consensus.cc:2272] T e236c3da863a44e096522ad9d8ceaa58 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.483064 25293 tablet_replica.cc:333] T 64600ebe7baf4321bc70ad565a1874b2 P 058e0a9d20594e21ab2293398d9f0958: stopping tablet replica
I20260709 12:17:16.483726 25293 raft_consensus.cc:2243] T 64600ebe7baf4321bc70ad565a1874b2 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.484334 25293 raft_consensus.cc:2272] T 64600ebe7baf4321bc70ad565a1874b2 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.486900 25293 tablet_replica.cc:333] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958: stopping tablet replica
I20260709 12:17:16.487479 25293 raft_consensus.cc:2243] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.488093 25293 raft_consensus.cc:2272] T 45a062c6b1a04686ae6f927c8cf0b838 P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.490594 25293 tablet_replica.cc:333] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958: stopping tablet replica
I20260709 12:17:16.491145 25293 raft_consensus.cc:2243] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.491684 25293 raft_consensus.cc:2272] T 47bb7e61288740c6a083cfe1b95fc2ea P 058e0a9d20594e21ab2293398d9f0958 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.494055 25293 tablet_replica.cc:333] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958: stopping tablet replica
I20260709 12:17:16.494683 25293 raft_consensus.cc:2243] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:16.495779 25293 raft_consensus.cc:2272] T 0a404d23da7f43fcb50c7d2126f76d4a P 058e0a9d20594e21ab2293398d9f0958 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.541375 25293 tablet_server.cc:196] TabletServer@127.24.179.67:0 shutdown complete.
I20260709 12:17:16.582875 25293 master.cc:562] Master@127.24.179.126:32855 shutting down...
I20260709 12:17:16.612520 25293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:16.613229 25293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.613610 25293 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9c8df2f357bf4fb29ded26bbbd16df2e: stopping tablet replica
I20260709 12:17:16.635840 25293 master.cc:584] Master@127.24.179.126:32855 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (21234 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (44873 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (541693 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:17:16.702332 25293 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2225 messages since previous log ~32 seconds ago
I20260709 12:17:16.702859 25293 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2230 messages since previous log ~32 seconds ago
I20260709 12:17:16.703066 25293 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2229 messages since previous log ~32 seconds ago
I20260709 12:17:16.703241 25293 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~53 seconds ago
I20260709 12:17:16.703409 25293 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~53 seconds ago
I20260709 12:17:16.703591 25293 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 5 messages since previous log ~185 seconds ago
I20260709 12:17:16.703742 25293 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~462 seconds ago
I20260709 12:17:16.703881 25293 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~462 seconds ago
I20260709 12:17:16.704087 25293 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 13 messages since previous log ~0 seconds ago
I20260709 12:17:16.704399 25293 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~20 seconds ago
